Every time I go to Great Deals/For Sale, my purpose is to see if there are any new deals or sales. So I have to change the sort from Last Message Descending to First Message Descending (4 clicks). This is stressing me out. Possible to remember last sort?
singles are 32 bit. halves are 16 bit, doubles are 64 bit
you dont need these cards for deep learning. just get a consumer RTX card. even a RTX 2060 demolishes these.
and if you want to spend more, a 3060Ti is all you need. Demolishing $8000 cards.
i complained about this on the previous design. The Deals and For Sale pages, its 100x more useful to sort by Start Date, not last post. I want to see the latest deal or sale. Why do I care what people are chatting about on irrelevant threads? Yet you have removed the sort option completely on...
you would look at the program you are running and what AVX modes it utilises. each cpu can do a certain number of AVX per tick.
if the program uses AVX-512 the Xeon scalables are twice as fast as 2nd gen EPYC per tick. if its just AVX, they will be the same per tick. older 1st gen EPYC are half...
the only people who want you to use big models are the people selling the hardware. its a scam sorry. who did the largest state of the art 33GB model recently? nvidia. hmm what a coincidence. dont be a sheep homey (unless you make money being a sheep and i cant blame u.. :p)
gpu direct and Nvlink are Nvidias way to cover up deep learnings dark secret that it doesn’t scale. it’s not embarrassingly parallel. Researchers are too busy Buying these as a stop gap and not focusing on the hard questions.
this is why I say a 2080ti farm is the go for actual work these...