Tesla V100 16GB GPU SXM2 PCIe 3.0x16 ($267/$287)

[pututu]

Not sure if this is a good deal considering that this one comes with the SMX2 → PCIE adaptor board installed with 16GB rather than the more expensive 32GB vram which has more memory headroom for running LLM . There are two options with ($277 + $10 ship) and without a heatink ($257 + $10 ship) as of this posting. Haven't dealt with this ebay seller from China. If anyone has any comments or any experience with such setup, please share. Also, keep in mind that V100 won't likely be supported in the next major CUDA release i.e. version 13 onwards. IMO, the V100 still has several years of decent performance for that price before the A100 becomes affordable.

Seems like this one needs a 70mm fan and I don't know for sure if the heatsink will be sufficient to keep the temperature below 80°C, assuming ambient of 25-30°C max and running at stock, otherwise use power limit.

 

[jbv1982]

That seems like a really good price because I want to say the PCI-E versions of those are something like $600. However I would be worried about it fitting in my R740 and longevity in general.

 

[EasyRhino]

so, stupid questions...

1) no video out, right?

2) similar in generation to like... geforce 10 series?

 

[vbcurtis]

No video out.
The Tesla P-series is the Geforce 10-generation. The P100 was the HBM card from that generation, and the V100 is about 50% faster than the P100.

 

[efschu3]

No. 10series does not have tensore cores. Volta was the first. So quiet useable today, from a performance view. Pascal (10series) not so.

 

[Hal]

someone had/have experience with this?
I'm interested but I think it is not a good choice for my Dell R730dx.

 

[EasyRhino]

I was thinking of turning it into a remote gaming server card. But I have a feeling a lot of things would go wrong with that idea. like compatibility, drivers, or cooling, for instance.

 

[simplex6]

Seems expensive.

I bougth 4 of them for around $400 total on ebay quite recently.

 

[jbv1982]

Seems expensive.

I bougth 4 of them for around $400 total on ebay quite recently.

With the PCI-E adapter and heatsink?

 

[simplex6]

With the PCI-E adapter and heatsink?

Sorry, no, just the cards. My server supports SXM2 and had the heatsink.
But a 4x SXM2 board from taobao or similar sources would be still a better deal if you are looking for multiple cards.

Or, buying the card from a cheaper source, and a separate waterblock+PCIe here:

Water Cooler SXM2 to PCIE Adapter for NVIDIA Tesla P100, V100 GPUs w/ Heatsink | eBay UK

Find many great new & used options and get the best deals for Water Cooler SXM2 to PCIE Adapter for NVIDIA Tesla P100, V100 GPUs w/ Heatsink at the best online prices at eBay UK! Free delivery for many products!

www.ebay.co.uk

 

[pututu]

But a 4x SXM2 board from taobao or similar sources would be still a better deal if you are looking for multiple cards.

If you bought the Supermicro AOM-SXMV baseboard back in 2022/23, those were cheap but not now. If you have a link to that board and if it is still a great deal, it will very much appreciated if you can share that link with us. To run that baseboard and utilize the performance fully, you will need a server motherboard and that's additional cost. The one that I posted, should be able to run on any consumer motherboard and certainly will be cost effective if you are looking for one or two cards only.

 

[gsrcrxsi]

Sorry, no, just the cards. My server supports SXM2 and had the heatsink.
But a 4x SXM2 board from taobao or similar sources would be still a better deal if you are looking for multiple cards.

Or, buying the card from a cheaper source, and a separate waterblock+PCIe here:

Water Cooler SXM2 to PCIE Adapter for NVIDIA Tesla P100, V100 GPUs w/ Heatsink | eBay UK

Find many great new & used options and get the best deals for Water Cooler SXM2 to PCIE Adapter for NVIDIA Tesla P100, V100 GPUs w/ Heatsink at the best online prices at eBay UK! Free delivery for many products!

www.ebay.co.uk

not anymore. the AOM-SXMV is almost impossible to find anymore. the other models of SXM2 boards (like the Dell version) is hardware locked to their platform and requires special drivers to work and wont work with standard systems.

you can't take the listings on taobao or xianyu at face value. most of the listings have a fake price and/or no stock. when asking the seller they will tell you the real price and if they have stock. most sellers I asked don't actually have the board at all.

 

[simplex6]

not anymore. the AOM-SXMV is almost impossible to find anymore. the other models of SXM2 boards (like the Dell version) is hardware locked to their platform and requires special drivers to work and wont work with standard systems.

you can't take the listings on taobao or xianyu at face value. most of the listings have a fake price and/or no stock. when asking the seller they will tell you the real price and if they have stock. most sellers I asked don't actually have the board at all.

Gotcha!

Now that I checked, most links on superbuy are dead now. Was working last year.

I think the best bang for the buck right now is buying a cheap SXM2 server, like a T181-G20

Or just rolling a grid of 24GB K80s if power is not an issue

 

[gsrcrxsi]

a lot of people dont want a 1U server (insanely loud), and also dont want to be stuck to the same platform forever. and that particular server uses a more custom PSU setup. you need the infrastructure to run it. it ends up being a lot more trouble than it's worth.

being able to put the GPUs on a more modern platform or better form factor is much more desirable IMO.

 

[simplex6]

Tbh, the "infrastructure" is just connecting 2880W of PSUs together, crimping some ring terminals, and bolting it on the board (the original OCP connector is also connected to the PDB thru wires ring terminals)

I'm planning to water cool it, that kinda solves noise issues.

Btw, that's also an option, and seems better than a large heatsink and fans:

Pardon Our Interruption...

 

[pututu]

Always the same pattern repeats itself. Whenever the CPUs or the proprietary GPUs like SMX2 prices tanked, the motherboard that supports it become really expensive or at least holds its price for a longer period than the CPUs or the proprietary GPUs.

 

[pututu]

Ten units were already sold on the version with heatsink. Curious if anyone on this forum bought one.

 

[simplex6]

Seems like an even better option:
NVIDIA V100 SXM2 300G NVlink interconnect Dual Card SXM2 Adapter Board | eBay

 

[gsrcrxsi]

Seems like an even better option:
NVIDIA V100 SXM2 300G NVlink interconnect Dual Card SXM2 Adapter Board | eBay

Depends on your limitations. Keep in mind with this you still need to buy/acquire the extension cables and the PCIe adapter boards. And probably decently more difficult to adapt to anything other than a mining rack type setup.

A lot of folks will greatly prefer the kind of board that can plug directly into a PCIe slot.

 

[EasyRhino]

I was thinking of getting one of these and adapters and using it as a bootleg gaming GPU. (no video out, so just remote gaming, I guess). But the cost and the resultant gaming performance didn't look worth it.