EU Huawei RH2288H V3 (ddr4/v4) full fronts 187€

Xeroxxx

Member
Mar 12, 2020
77
38
18
Within multiple virtual machines. Tesla M60 allows to logically split the GPU. However requires some licensing for VMware Enterprise Plus and NVIDIA vGPU.
 
Last edited:

Xeroxxx

Member
Mar 12, 2020
77
38
18
There is VMWare User Group (VMUG), it includes 365 Day Trial License for nearly every product for 1 year. Costs for VMUG and/or Enterprise Plus aswell as NVIDIA vGPU is publicly available on the internet.
 

grenskul

Member
Nov 8, 2020
62
37
18
Just finished moving from my hp 380p g8 . Super happy with the machine. Super quiet , performance has been nice and those thick boy fans move a lot of air.
 

Labs

Member
Mar 21, 2019
86
16
8
User-configurable bifurcation is highly unlikely since the PCIe lanes (apart from the 2 x8 slots) are meant to be used with risers. Those risers contain an EEPROM which in turn contains info about the riser's physical slot layout. The EEPROM is read out by the CPLD during post and the lane bifurcation is set accordingly, fully transparent to the user. Only option apart from changing the backplane and cabling is to go for fabric switch based cards @Sogndal94 mentioned.
Where do you see any EEPROM on those risers? I am looking at the BC11PERH with 2x PCIe x16 (electricaly 1x x8 and 1x x16) and also BC11PERG with 1x x16 and 2x x8 (electrically all 3 are x8) and what I see is a TI PD545A (similar with the NXP PCA9545A) for the 3x x8 riser and an NXP PCA9545A (quad bidirectional translating switch controlled via the I2C-bus) for the 2x x16 riser.
 

tic226

Member
Feb 2, 2017
52
29
8
121
DE
Where do you see any EEPROM on those risers? I am looking at the BC11PERH with 2x PCIe x16 (electricaly 1x x8 and 1x x16) and also BC11PERG with 1x x16 and 2x x8 (electrically all 3 are x8) and what I see is a TI PD545A (similar with the NXP PCA9545A) for the 3x x8 riser and an NXP PCA9545A (quad bidirectional translating switch controlled via the I2C-bus) for the 2x x16 riser.
Yeah you're absolutely right, i was thinking of a completely different platform when writing that. The ICs on the Huawei riser are of course switches to facilitate SMBus communication.
 

Xeroxxx

Member
Mar 12, 2020
77
38
18
My Tesla M60 demands more power than the server wants to deliver with 750W PSUs. I ordered two 1200 Platinum PSUs for a bang of the buck.
 

Xeroxxx

Member
Mar 12, 2020
77
38
18
Received the 1200W Platinum PSUs today. They are labeled LiteOn and fit perfectly. Server now starts with NVIDIA Tesla M60 attached to the Riser Card power plug. I feel they are less noisy and consume some marginal less power.
 

Labs

Member
Mar 21, 2019
86
16
8
Received the 1200W Platinum PSUs today. They are labeled LiteOn and fit perfectly. Server now starts with NVIDIA Tesla M60 attached to the Riser Card power plug. I feel they are less noisy and consume some marginal less power.
What power cables did you use between GPU and riser card? I see the riser card with 2 x16 PCIe slots has a slightly different PCB pins on the PCIe slot that goes in the motherboard maybe to support more power for the connectors.
 

Xeroxxx

Member
Mar 12, 2020
77
38
18
What power cables did you use between GPU and riser card? I see the riser card with 2 x16 PCIe slots has a slightly different PCB pins on the PCIe slot that goes in the motherboard maybe to support more power for the connectors.
Its an 8 PIN CPU connector (EPS12V) (up to 240 Watts). My GPU uses 8 PIN CPU as well. However there are cables to get from 8 PIN CPU to 2 x 6 PIN PCIe. The Riser card only delivers 75 Watts per PCIe Slot as specified, so ~300 Watt total.

I've two 750 Watt PSUs and two E5-2658Av3 laying around. If anyone is interested drop me a pm.
 

Labs

Member
Mar 21, 2019
86
16
8
Its an 8 PIN CPU connector (EPS12V) (up to 240 Watts). My GPU uses 8 PIN CPU as well. However there are cables to get from 8 PIN CPU to 2 x 6 PIN PCIe. The Riser card only delivers 75 Watts per PCIe Slot as specified, so ~300 Watt total.
I think it can deliver more because looking at the 2 slot vs. 3 slot riser the 2 slot riser with extra power connectors has the PCIe pins that goes into the motherboard in different way maybe to support more power.
I mean this:

1652961488968.png
 

Xeroxxx

Member
Mar 12, 2020
77
38
18
The slot shown above is not for power. When you unplug the riser card you will see to full 16x PCIe look-a-likes. The first one in the front will provide 12V power. Its a long single plated stripe. As there are 2 x 12V EPS, I think it can provide up to 450 Watts (8P EPS12V is specified 225-240Watts as I recall). You can assume that form the documentation as well, but there is not enough space for two cards on one riser when they are 2 slot :) Thinking about an additional Tesla P4 :)

However server will no start when to much power is drawn. Thats why I've two 1200W PSUs.
 

Labs

Member
Mar 21, 2019
86
16
8
The slot shown above is not for power. When you unplug the riser card you will see to full 16x PCIe look-a-likes. The first one in the front will provide 12V power. Its a long single plated stripe. As there are 2 x 12V EPS, I think it can provide up to 450 Watts (8P EPS12V is specified 225-240Watts as I recall). You can assume that form the documentation as well, but there is not enough space for two cards on one riser when they are 2 slot :) Thinking about an additional Tesla P4 :)

However server will no start when to much power is drawn. Thats why I've two 1200W PSUs.
I think the power is taken from both slots but first slot delivers more. I also replaced my PSUs with 1200W ones.
I am thinking to get some Tesla T4 but for the moment they are pricey...