NVIDIA 3000 series?

josh

Active Member
Oct 21, 2013
370
92
28
How do the NVIDIA 3000 series perform with ML compared to 2000? Currently using 2070S just purchased early this year. Don't want to upgrade if it's not necessary.
 

dandanio

Active Member
Oct 10, 2017
147
50
28
The question is then: how fast do you need them to perform? Is your current hardware holding you back? Do you feel like 10-20-50% speedup is necessary for you to be more productive? If so, you may need to take a look at 3090 or some such. They are faster, but not really like 50% faster...
 

rafale77

New Member
Sep 28, 2020
12
4
3
Don't mean to pick on you but most ML usually doesn't require much GPU. Deep learning does. If you run deep learning frameworks then the question indeed is how much of it do you need? I am also looking at it from a power consumption perspective and though you may not need it to be faster, the 3000 series is definitely a lot more power efficient. So if you are using your GPU a lot today, you may still benefit from some lower power savings. The downside though is that it likely will require some time for the driver and for cuda/cudnn to make full use of the new GPU.
 

josh

Active Member
Oct 21, 2013
370
92
28
Sorry, I totally meant deep learning not ML. I've been experimenting with neural nets but nothing too heavy yet to be frustrated with 2070S. The driver issue does make sense and power savings is definitely a consideration for me.
 

rafale77

New Member
Sep 28, 2020
12
4
3
I am on the same boat and am looking to see how the 3070 will perform. My 2070 which I got for a relative bargain is a champ but consumes 60-100W on a constant basis...
 

Patrick

Administrator
Staff member
Dec 21, 2010
11,968
4,931
113
William is going to do the RTX 3090 first. I got confirmation ours is finally getting here next week.
 
  • Like
Reactions: William

Dreece

int 21h
William is going to do the RTX 3090 first. I got confirmation ours is finally getting here next week.
Could you ask William if he can do some kind of performance test with Adobe Premiere comparing say the last gen 2080rtx to the new behemoth 3090?... layer up a load of 4k/8k clips and add some GPU accelerated effects etc and roll out an export on both cards? - real life usage rather than synthetics. Not quite ML/DL, but would be helpful.
 

BackupProphet

Well-Known Member
Jul 2, 2014
804
289
63
Stavanger, Norway
kingmakers.no
I do some deep learning, and I ordered a 3090 RTX just because that my 2080 with 8GB is not enough for some large models which may require 16-20GB of memory. Ironically this is related to NLP stuff, not image classification stuff.

But for the last few years, I've seen a more of a significant performance jump by upgrading libraries. I think Tensorflow 1.2 to 2.3 was like 5-10 times faster training on my CPU. And the 2080 is somewhere between 10-50x faster again
 
  • Like
Reactions: Patrick and T_Minus

Patrick

Administrator
Staff member
Dec 21, 2010
11,968
4,931
113
I do some deep learning, and I ordered a 3090 RTX just because that my 2080 with 8GB is not enough for some large models which may require 16-20GB of memory. Ironically this is related to NLP stuff, not image classification stuff.
I still want to know where to order these!
 

josh

Active Member
Oct 21, 2013
370
92
28
I do some deep learning, and I ordered a 3090 RTX just because that my 2080 with 8GB is not enough for some large models which may require 16-20GB of memory. Ironically this is related to NLP stuff, not image classification stuff.

But for the last few years, I've seen a more of a significant performance jump by upgrading libraries. I think Tensorflow 1.2 to 2.3 was like 5-10 times faster training on my CPU. And the 2080 is somewhere between 10-50x faster again
Have you tried NVLink with 2x 2080?
 

josh

Active Member
Oct 21, 2013
370
92
28
Should I get another 2070S and NVLink with my old card or straight up buy a 2080S? EVGA B-Stock has some pretty amazing prices during the sales.