EPYC vs 2xTR?

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

josh

Active Member
Oct 21, 2013
615
190
43
Hello,

Looking to rent 4x3090s and 3x3080Tis on vast.ai.

Would an EPYC setup make more sense than 2x ThreadRipper setups?

Thanks
 

josh

Active Member
Oct 21, 2013
615
190
43
The dual socket server boards should not support TR at all. Plus TR may not have XGMI lanes to support 2S.
Oh I don't mean 2x TR on the same system. I was comparing the overheads between two separate TR systems vs 1x EPYC.
 
Last edited:

msg7086

Active Member
May 2, 2017
423
148
43
36
I guess you need to first clarify the workload, and whether the workload can be split into 2 systems. Usually at high end world one giant system is less cost effective than multiple smaller systems.
 

josh

Active Member
Oct 21, 2013
615
190
43
I guess you need to first clarify the workload, and whether the workload can be split into 2 systems. Usually at high end world one giant system is less cost effective than multiple smaller systems.
Workload is GPU rental for Deep Learning. Usually jobs are 1-4x GPU slices so workload definitely can be split.