EU [WTB] Storage and low end recent gpus

[luckylinux]

This is a very expensive hobby, and I kept telling everyone I could to get them while they were cheap. It's not that bad to recoup some of my costs.

I know, it's my own Fault for not asking & buying when I had the Chance. For now I guess the Mi50 16GB will have to do ...

So far the most promising Chassis + PSU + Motherboard Combo I found supporting up to 8xGPUs is this 4U Rack Case from TYAN (approx. 700 EUR shipped) with a Dual Socket LGA3647 (2x1600W PSU, although it seems to only deliver 8x6-Pin + 8x8-Pin Power Connectors whereas the Mi50 requires 2x8-Pin each):



Otherwise I keep looking for those single Socket AMD EPYC / Intel Xeon Scalable Deals with somewhat decent PCIe Configuration (say 2 direct GPU installation + 1-2 Risers needed) but just the Board is like 250-300 EUR .

 

[iraqigeek]

So far the most promising Chassis + PSU + Motherboard Combo I found supporting up to 8xGPUs is this 4U Rack Case from TYAN (approx. 700 EUR shipped) with a Dual Socket LGA3647 (2x1600W PSU, although it seems to only deliver 8x6-Pin + 8x8-Pin Power Connectors whereas the Mi50 requires 2x8-Pin each):

Looks nice! If you have a rack to mount it (pun not intended) and have a dozen DDR4 RAM sticks laying around, I'd say go for it! Those beefy PCIe switches look nice!

Gigabyte's G292 line used to be quite cheap when it first hit ebay but then the AI bubble started soon after and prices shot up a lot. It's a nifty 2U unit that can also host eight dual slot GPUs, perfect for Mi50s.

Otherwise I keep looking for those single Socket AMD EPYC / Intel Xeon Scalable Deals with somewhat decent PCIe Configuration (say 2 direct GPU installation + 1-2 Risers needed) but just the Board is like 250-300 EUR .

Two GPUs are pretty easy with many LGA3647/LGA4189/SP bards. Some let you do up to four (SPC621D8, X11SPA, X11SPL, MU71-SU0). Basically, if the board has seven PCIe slots (as long as each is at least Gen 3 X4) you can install four dual slot cards like the Mi50 without risers.

 

[luckylinux]

Looks nice! If you have a rack to mount it (pun not intended) and have a dozen DDR4 RAM sticks laying around, I'd say go for it! Those beefy PCIe switches look nice!

I have a Rack to mount it but it's a bit wasted to be honest (I should have a few Units left, but I wasn't really planning on adding 2x4U extra).

I'm mainly concerned about the noise though and how it can be controlled though. Also not sure about Rails availability.

RAM I can get (still have a few I could transfer) pretty cheap. I would probably go for 24x32GB = 768GB .

Gigabyte's G292 line used to be quite cheap when it first hit ebay but then the AI bubble started soon after and prices shot up a lot. It's a nifty 2U unit that can also host eight dual slot GPUs, perfect for Mi50s.

Gigabyte's G292 ... for 8 (not 4 ???) dual Slot GPUs ?

Two GPUs are pretty easy with many LGA3647/LGA4189/SP bards. Some let you do up to four (SPC621D8, X11SPA, X11SPL, MU71-SU0). Basically, if the board has seven PCIe slots (as long as each is at least Gen 3 X4) you can install four dual slot cards like the Mi50 without risers.

On Supermicro X9/X10 Series for Xeon E5 v2/v3/v4 (not sure about X11 Series for Xeon Scalable) the last PCIe Slot is Typically a PCH (Chipset) connected Slot which is only 2.0 x4 (yes, PCIe 2.0 - YIKES).

Then finding the right Chassis might be the Challange ... I usually go for the Fractal Define Series but the R5/R6 has only 7xPCIe Slots (I would need 8x since 4xdual Slot, the R6 has 2x extra with a Riser though). Looks like I might need to go to some uncharted Territory for me. Something like the Fractal Design Meshify 2 XL has 9xPCIe Slots so it could fit the Bill. The Fractal Design Define 7 XL of course would also work but it's probably more expensive (9 x PCIe Slots + 3 x PCIe Slots with Riser).

Plus at those Prices (cheapest is around 400 EUR from China) ... wouldn't it just be better to get an AMD EPYC 7002 Series System based on Supermicro H11SSL-i Version 2 from China, should be around 500-600 EUR including CPU.

Too bad there is no easy way to "bring out" a PCIe x16 Slot (Bifurcation NOT possible) from the HYVE Server that I have. It would require a PCIe Active Adapter (to either 4xU.2 or 4xM.2), around 150-200 EUR, plus some Oculink Cables going somewhere out of the System to another Chassis, then a "standard" SFF-8643 to PCIe x16 Adapter such as this one:


Probably at the very least around 300 EUR plus Oculink SFF-8611/SFF-8612 Cables. Not sure if it's really worth it at that Point though.

Other Ideas ?

Feel free to PM me about the X10DRX or if you have other Boards for Sale BTW .

EDIT 1: the Supermicro H11SSL-i indeed would be limited to 3xGPUs without Risers, so that's probably not an Option .

 

[potrebitel]

Just go to alibaba.com and search for Mi50 32GB. That's how I bought mine. I searched now, and there are a couple of sellers selling the 32GB model for €165 plus shipping.

Can you please provide a link ? For the past days I've tried to search for 32GB versions and one quote is $650, the others haven't got back to me at all.

It may turn out the 32GB mi50 are gone for now.

 

[luckylinux]

And now even the Supply of AMD Radeon Mi50 16GB seems to have almost completely depleted .

PIOsPartsLap Offer expirde yesterday before I could order another 5 of them, they only have 1 in Stock now .

 

[iraqigeek]

And now even the Supply of AMD Radeon Mi50 16GB seems to have almost completely depleted .

PIOsPartsLap Offer expirde yesterday before I could order another 5 of them, they only have 1 in Stock now .

Of course, any card is better than no card.

On kleinanzeigen I see someone selling the 32GB for €315 and the 16GB for €175. If anyone wants a 32GB Mi50 for the low low price of €300, I have a few

 

[luckylinux]

Of course, any card is better than no card.

On kleinanzeigen I see someone selling the 32GB for €315 and the 16GB for €175. If anyone wants a 32GB Mi50 for the low low price of €300, I have a few

On eBay the latest Mi50 16GB are selling via PIOsPartsLapPL (apparently they also have a Polish Subsidiary) but ... Counter-Offer at 97 EUR / Piece for 5 Pieces like WTF ?

 

[iraqigeek]

Can you please provide a link ? For the past days I've tried to search for 32GB versions and one quote is $650, the others haven't got back to me at all.

It may turn out the 32GB mi50 are gone for now.

They are selling quickly. If you can't find sellers, it's probably because they ran out.

 

[iraqigeek]

On eBay the latest Mi50 16GB are selling via PIOsPartsLapPL (apparently they also have a Polish Subsidiary) but ... Counter-Offer at 97 EUR / Piece for 5 Pieces like WTF ?

Supply and demand.

 

[luckylinux]

Supply and demand.

Yeah, Life sucks .

Cheapest right now is to buy from

AMD Radeon Instinct MI50 Accelerator Vega 20 16GB HBM2 PCIe 4.0 x16 | eBay.de

With a PCIe 4.0 x16 interface, the accelerator enables fast data transfer, which is crucial in intensive applications such as machine learning, data analysis, and simulations. Invest in the future of your work and accelerate your computing processes with this exceptional accelerator.

www.ebay.de

Just put 3 or more in the Cart and use the suggested Coupon Code for -10%: RSTRCW25

Shipping to Denmark from Poland was also 13 EUR only, instead of 21 EUR from Germany.

So all in all, these came out 91 EUR / Piece shipped instead of 73 EUR / Piece shipped.

100 EUR wasted really but given the alternatives and Prices everywhere else .

 

[MSameer]

If someone is interested, aliexpress still has this seller selling the 32GB card (i confirmed with him).

216 euros with all possible discounts + VAT. Mine'd be 270 euros ( I know i was told how to get it cheaper from alibaba but i had to spend the money elsewhere).

Please note I do not know the seller and I am not affliated.

https://a.aliexpress.com/_Exfp9Rm

 

[redblood]

If someone is interested, aliexpress still has this seller selling the 32GB card (i confirmed with him).

216 euros with all possible discounts + VAT. Mine'd be 270 euros ( I know i was told how to get it cheaper from alibaba but i had to spend the money elsewhere).

Please note I do not know the seller and I am not affliated.

https://a.aliexpress.com/_Exfp9Rm

just tried it's 340€ for me

a lot of providers on alibaba say it's out of stock, others sell it for 250-300 USD before tax shipping and custom duties.

 

[MSameer]

just tried it's 340€ for me

a lot of providers on alibaba say it's out of stock, others sell it for 250-300 USD before tax shipping and custom duties.

340 is the initial price but there is -40 coupone (blackfriday sale 11V1<something>). I cannot see it anymore that i used it + store specific code (visit store page to collect it) + coins and you get it for cheap.

EDIT: just proceed to checkout and see what you will get. You can always cancel without paying.

EDIT2: seller told me only 16g is available after i made the order so cancelibg it.

 

[iraqigeek]

216 euros with all possible discounts + VAT. Mine'd be 270 euros ( I know i was told how to get it cheaper from alibaba but i had to spend the money elsewhere).

I'm waiting for prices to hit 300 to start selling some of my cards

Just checked alibaba and they're at ~€205 there, before shipping and taxes. I'd say the minimum order quantity there is 4-5 to spread shipping costs.

https://a.aliexpress.com/_Exfp9Rm

I get "Sorry, this item's currently unavailable in your location" when I try the link

 

[MSameer]

I'm waiting for prices to hit 300 to start selling some of my cards

I can buy 2 if you are willing to negotiate a bit

 

[luckylinux]

Given the current Price Situation I'd say I'll wait for some "new" (other) Cards to hit the used Cards Market .

Granted 16GB VRAM is not a lot and you probably cannot split efficiently many Things, so a couple high-VRAM GPUs can turn useful still.

I have 20 x 16GB Radeon Mi50 right now (the last 5 I bought when they were already quite expensive unfortunately), but it is what it is .

And since for that 4U Chassis with dual LGA3647 (Xeon Scalable v1/v2) the Seller didn't want to negotiate anything at all and claimed that 620 EUR was the Price without VAT (with 0% according to him), even though eBay listed it as 620 EUR including VAT (inkl. MwSt), I gave up on that.

Now I'm thinking of using some x4 Risers wired to a few of my existing 1U HYVE EPYC 7642 Servers, put the GPUs in some Chassis like:

Would this PCIe Active Switch to SFF-8644 work in your Experience ? Based on some Feedback here about NVMe SSD Drives (I know, different Thing, but probably still relevant), the Conclusion was that at least cheap SFF-8643 SAS Cables (instead of special SFF-8644 NVMe Cables with matched Impedance) could be used "OK" (no experienced Issues) as long as the Device was operating at PCIe 3.0. Thing is that the PCIe Switch is operating at PCIe 4.0 and the AMD Radeon Mi50 GPUs as well, so even if I can configure the HYVE BIOS to use PCIe 3.0 only, I guess it's still PCIe 4.0 downstream, isn't it ?

Pardon Our Interruption...

That Dell seems to be this one (MXH932):

Transparent Host & Target | SFF-8644 |PCIe Gen4 Adapter | MXH932 | Microchip

The Dolphin Express MXH932 is a 256 Gigabit/s Transparent Host and Target PCI Express IO expansion card. The adapter card uses the new PCIe chipset from Microchip, PCIe 4.0 cable infrastructure and comes with extensive software and support.

www.dolphinics.com

Alternatively maybe this one ?

Serial Cables PCIE GEN4 X16 SFF-8644 Host Card w/Broadcom Atlas B0 PCIE Switch | eBay

“Serial Cables was very early to commit to PCIe and one of the first to put a PCIe switch onto a x16 and x8 host card to extend Gen3 PCIe outside the server that was available to the public,” said Paul J. Mutschler, CEO, Serial Cables.

www.ebay.com

Then of course some SFF-8644 to SFF-8643 PCIe Brackets on the Target side, GPUs and some SFF-8643 to PCIe x16 (electrical x4) Risers + Cables ?

 

[iraqigeek]

I can buy 2 if you are willing to negotiate a bit

That's the price after negotiation
I spent quite a bit more than I thought I'd do on local LLM inference, and want to recover some of that.

BTW, if you have some 32 or 64GB RDIMM/LRDIMM DDR4-2666 sticks to spare, I'd be willing exchange a couple of Mi50s for 512GB RAM.

 

[MSameer]

That's the price after negotiation

I understand. I can still use my gaming GPU for AI

BTW, if you have some 32 or 64GB RDIMM/LRDIMM DDR4-2666 sticks to spare, I'd be willing exchange a couple of Mi50s for 512GB RAM.

Unfortunately I have only 4 sticks of 32 GB which will go into my 2 NAS servers

 

[luckylinux]

That's the price after negotiation
I spent quite a bit more than I thought I'd do on local LLM inference, and want to recover some of that.

BTW, if you have some 32 or 64GB RDIMM/LRDIMM DDR4-2666 sticks to spare, I'd be willing exchange a couple of Mi50s for 512GB RAM.

Now that is interesting.

How much are you willing to pay for those 32GB / 64GB RDIMMs or LRDIMMs ?

 

[iraqigeek]

Now that is interesting.

How much are you willing to pay for those 32GB / 64GB RDIMMs or LRDIMMs ?

Two Mi50 32GB cards for 512GB