This build started out here: https://forums.servethehome.com/ind...ild-for-fluid-simulation-now-with-pics.17703/
With upgrades accumulating over time, it is time to show off once more
Build’s Name: AMD is still back
Working title: Noctua fans. How many are enough
Operating System/ Storage Platform: OpenSUSE leap 15.1
CPU: 2x AMD Epyc 7551 retail
Motherboard: Supermicro H11DSi rev. 1
Chassis: Phanteks Enthoo Pro
Drives: Samsung 970 Evo Plus 500GB, HGST 7.68TB SN200 Ultrastar NVMe, 3x WD red 6TB (software RAID5)
RAM: 512GB populated as 16x32GB Samsung DDR4-2666 reg ECC
Add-in Cards: the cheapest AMD RX 570 8GB I could find
Power Supply: Seasonic Focus Plus Platinum 850W
Other Bits: Now with water cooling for CPUs and VRMs. And a few 3D-printed bits like the memory coolers and standoffs for the top cover
Usage Profile: Code development, CFD simulations
The most time-consuming upgrade was obviously water cooling. Doing your first custom loop on expensive hardware can be quite exciting. Here is a list of parts, if someone is interested:
Radiator: Alphacool Nexxxos ST30 full copper 420mm
Pump/reservoir: Alphacool Eisfach - Single Laing D5 Eispumpe VPP755
Tubing: EK Water Blocks EK-Tube ZMT 16/10
Fittings: Mostly Alphacool Eiszapfen
CPU blocks: EK-Velocity sTR4 - Nickel + Acetal
VRM block: Anfi-tec UPC002 13x88mm UPC002 (13 x 82-120mm) - Universal
Liquid: Aqua Computer Double Protect Ultra. 1l was enough.
More info
All fans are now connected to the fan controller on the front, that is also equipped with temperature sensors. It's not perfect because control is not very sensitive at low RPMs. But still miles ahead of Supermicros overly aggressive fan control.
I haven't dialed in a stable CPU overclock yet. But temps are pretty good, with CPUs temps around 40°C under full load, and CPU VRMs staying below 60°C. From a few tests it seems like the motherboards OCP will be the limiting factor.
VRMs other than the CPU got a little copper heatsink glued on with 2k thermal adhesive: Alphacool GPU RAM Copper Heatsinks 6,5x6,5mm - 10 Stk. Phobya 2-Komponenten-Wärmeleitkleber
All fans are obviously Noctua: 3x Noctua NF-A14 PWM intake front and bottom, 3x Noctua NF-A14 PWM exhaust/radiator, 1x Noctua NF-A14 PWM on the PCIe slots and 4x Noctua NF-A6x25 PWM for memory.
What I would have done differently
Not try to order a monoblock here: Monoblock HCM PRO MBD-H11DSI-NT-B
After almost 3 months of excuses, I gave up and cancelled the order. Also, a lone thermal pad arrived in the mail at some point, that was supposed to go on the VRMs. At a thickness of 5mm, I have my doubts that this will perform any better than the stock aluminium heatsink. Also, it was severely damaged during shipping.
Use a thicker radiator. I ordered only 30mm thick because I had hopes of getting both radiator and fans inside the case. It might work, but only with all power cables routed inside the case. With the fans outside, a thicker radiator would fit. But anyway, temps are still good.
Leave out the fill/drain port. With the reservoir/pump combo I used, filling and draining the loop is nightmare. The port I added is no help at all. But once I had the loop filled and free of air bubbles, I was just too lazy to do it all again. Definitely a task on the list for the first loop maintenance.
Use a different case with more room to build in. The only problem is: I still haven't found one. Since I am not a fan tempered glass side panels, I guess no amount of money I am willing to spend on a case will ever change that.
Pictures
Epyc Water cooling upgrade
With upgrades accumulating over time, it is time to show off once more
Build’s Name: AMD is still back
Working title: Noctua fans. How many are enough
Operating System/ Storage Platform: OpenSUSE leap 15.1
CPU: 2x AMD Epyc 7551 retail
Motherboard: Supermicro H11DSi rev. 1
Chassis: Phanteks Enthoo Pro
Drives: Samsung 970 Evo Plus 500GB, HGST 7.68TB SN200 Ultrastar NVMe, 3x WD red 6TB (software RAID5)
RAM: 512GB populated as 16x32GB Samsung DDR4-2666 reg ECC
Add-in Cards: the cheapest AMD RX 570 8GB I could find
Power Supply: Seasonic Focus Plus Platinum 850W
Other Bits: Now with water cooling for CPUs and VRMs. And a few 3D-printed bits like the memory coolers and standoffs for the top cover
Usage Profile: Code development, CFD simulations
The most time-consuming upgrade was obviously water cooling. Doing your first custom loop on expensive hardware can be quite exciting. Here is a list of parts, if someone is interested:
Radiator: Alphacool Nexxxos ST30 full copper 420mm
Pump/reservoir: Alphacool Eisfach - Single Laing D5 Eispumpe VPP755
Tubing: EK Water Blocks EK-Tube ZMT 16/10
Fittings: Mostly Alphacool Eiszapfen
CPU blocks: EK-Velocity sTR4 - Nickel + Acetal
VRM block: Anfi-tec UPC002 13x88mm UPC002 (13 x 82-120mm) - Universal
Liquid: Aqua Computer Double Protect Ultra. 1l was enough.
More info
All fans are now connected to the fan controller on the front, that is also equipped with temperature sensors. It's not perfect because control is not very sensitive at low RPMs. But still miles ahead of Supermicros overly aggressive fan control.
I haven't dialed in a stable CPU overclock yet. But temps are pretty good, with CPUs temps around 40°C under full load, and CPU VRMs staying below 60°C. From a few tests it seems like the motherboards OCP will be the limiting factor.
VRMs other than the CPU got a little copper heatsink glued on with 2k thermal adhesive: Alphacool GPU RAM Copper Heatsinks 6,5x6,5mm - 10 Stk. Phobya 2-Komponenten-Wärmeleitkleber
All fans are obviously Noctua: 3x Noctua NF-A14 PWM intake front and bottom, 3x Noctua NF-A14 PWM exhaust/radiator, 1x Noctua NF-A14 PWM on the PCIe slots and 4x Noctua NF-A6x25 PWM for memory.
What I would have done differently
Not try to order a monoblock here: Monoblock HCM PRO MBD-H11DSI-NT-B
After almost 3 months of excuses, I gave up and cancelled the order. Also, a lone thermal pad arrived in the mail at some point, that was supposed to go on the VRMs. At a thickness of 5mm, I have my doubts that this will perform any better than the stock aluminium heatsink. Also, it was severely damaged during shipping.
Use a thicker radiator. I ordered only 30mm thick because I had hopes of getting both radiator and fans inside the case. It might work, but only with all power cables routed inside the case. With the fans outside, a thicker radiator would fit. But anyway, temps are still good.
Leave out the fill/drain port. With the reservoir/pump combo I used, filling and draining the loop is nightmare. The port I added is no help at all. But once I had the loop filled and free of air bubbles, I was just too lazy to do it all again. Definitely a task on the list for the first loop maintenance.
Use a different case with more room to build in. The only problem is: I still haven't found one. Since I am not a fan tempered glass side panels, I guess no amount of money I am willing to spend on a case will ever change that.
Pictures
Epyc Water cooling upgrade
Last edited:
