PVE nodes- Supermico H11SSL-C & EPYC 7401P in progress

[EluRex]

Build’s Name: RCluster (30 nodes)
Operating System/ Storage Platform: Proxmox VE 5.1
CPU: AMD Ryzen 7401P
Motherboard: Supermicro H11SSL-C
Chassis: RMC3116-670-HSE with SAS3 expander
Drives: (16) Seagate ST6000NM0034 SAS3 6TB
RAM: DDR4 2666mhz ECC Reg 64GB x4 and 64GB x8
Network Cards: MCX354A-FCBT in IB FDR14
Power Supply: DSP Dual 800w Platinum
SSD Cache: Samsung sm961 1TB (undecided)
Other Bits: 2 x Mellanox SX6036 FDR14 switch for HA purpose

AMD EPYC 7401P are really huge and they are really as described as Intel indicated, glued together and the slide installation method is kinda new to me



Motherboard

some of the ram module

SAS3 HDD




SSD Cache with cooling

some modules are sm960 pro 1tb


chassis 16 3.5" bay with 2 2.5 bay @back



mellanox nic

one of the mellanox switch


another 4 supermicro x11ssh-ctf for home lab nodes

 

[Evan]

With all the $$ spend elsewhere isn’t the ssd a bit underdone, an enterprise one would have been nicer.
What’s going to run on that ?
Big cluster

 

[PigLover]

What is the workload for the cluster?

Sent from my VS996 using Tapatalk

 

[EluRex]

With all the $$ spend elsewhere isn’t the ssd a bit underdone, an enterprise one would have been nicer.
What’s going to run on that ?
Big cluster

Most of the parts are purchased @ unbelievable low price except motherboard and cpu...

I am still undecided on SSD cache and so far only purchased a few for testing. Ideally Intel optane SSD would be great but its way too pricey. Unfortunately Samsung Z-NAND SSD is still no way to be found... good thing is SSD cache can be added after the cluster goes live

The cluster will run Proxmox VE 5.1 (kvm hypervisor) + ZFS/CEPH bluestore

@PigLover ,

The cluster will run Odoo ERP/PLM/MES/Workflow/Zimbra Enterprise Email Suite, Corporate CMS/WebRTC and hadoop. they are replacing nodes ranging 5 yrs old~ 10 yrs old servers... then more services will added to the cluster