EPYC vs 2xTR?

josh

Active Member
Oct 21, 2013
551
155
43
Hello,

Looking to rent 4x3090s and 3x3080Tis on vast.ai.

Would an EPYC setup make more sense than 2x ThreadRipper setups?

Thanks
 

josh

Active Member
Oct 21, 2013
551
155
43
The dual socket server boards should not support TR at all. Plus TR may not have XGMI lanes to support 2S.
Oh I don't mean 2x TR on the same system. I was comparing the overheads between two separate TR systems vs 1x EPYC.
 
Last edited:

msg7086

Active Member
May 2, 2017
359
111
43
34
I guess you need to first clarify the workload, and whether the workload can be split into 2 systems. Usually at high end world one giant system is less cost effective than multiple smaller systems.
 

josh

Active Member
Oct 21, 2013
551
155
43
I guess you need to first clarify the workload, and whether the workload can be split into 2 systems. Usually at high end world one giant system is less cost effective than multiple smaller systems.
Workload is GPU rental for Deep Learning. Usually jobs are 1-4x GPU slices so workload definitely can be split.