Training build: New SXM2 NVLink board... has anyone used it yet?

[bt619]

After being inspired by the topics surrounding using SXM2 and SXM4 in DIY builds, I have set out to do this as well. There is a fairly new version of the 4x (quad) GPU SXM2 board that started showing up online recently. Looks like an improvement as its on a standard E-ATX footprint with ATX power, a Broadcom PLX switch and 2x 8i uplinks on the board, a full backing plate and multi-stage VRM at each GPU for cooler steady power. I ordered one. It was about the same price as the older YMZX-4GPU-Q1 style board.

Has anyone used one of these already? If so, how do you feel about it?

Build’s Name: The Hot Stepper
Operating System/ Storage Platform: Ubuntu 24
CPU: Intel Xeon Platinum 8351N
Motherboard: ASRock Rack SPC621D8
Chassis: Nagao open frame
Drives: NVMe
RAM: 12GB Samsung
Add-in Cards: Thunderbolt 4
Power Supply: 1600W

Usage Profile: Model Training

 

[Patriot]

I would much rather use the supermicro aoc sxm2 board than these... but the price on that and these seems a bit high to recycle some old V100s
V100s have great HBM bandwidth but I dont think you will get very high token rate on first gen tensor cores.

I also would want to run 8 of them...