New build to host my Proxmox hypevisor

[marcel]

Hi,

I'm consider the next build to host my Proxmox hypevisor. I now have an Xeon E5-2699v3. It's old and power hungry.


AMD Ryzen 9 7900 Boxed

ASRock Rack B650D4U

Inter-Tech IPC 2U-2098-SL

Kingston ValueRAM KVR48U40BD8-32

Corsair MP600 PRO 1TB

Corsair MP600 PRO 2TB


Maybe I build a second one so I can run a cluster. Also I have separate storage. Also considering to migrate this to new hardware, and OS in time.


What do you think of this setup?

Things I can do better?

How much power will this system use?

 

[T_Minus]

I don't know about that RAM or SSD.. I stay away from Corsair in general if I can
I'd check ebay for used enterprise NVME \ SSD, very affordable now and better for proxmox use case.

That 7900 is a new class of performance, will be amazinggg

 

[marcel]

Thank you for the reply!

With enterprise level NVME do you think of Intel, Samsung?

 

[T_Minus]

Intel or Samsung would be good choices

If you don't need the newest or fastest you can buy the Intel p3600 \ p3605 NVME 1.6TB for 40-80$ each, that same generation P3700 are pretty cheap now too, but personally I'd skip p3700 and jump to 4600\4610. If you want little newer the Intel P4500\4510 or P4600\4610 are about 2x as much as those.

If you want newer and\or faster there's more intel and samsung to pick from, but price goes up pretty quick for latest drives etc.

If you want capacity >2TB you won't find that in the P3600\3500\3700 for a deal if they even exist, I thnk they topped out at 2TB but it's been awhile since Iwas shoppnig for those to the point I was comparing, and researching now it's more of.. is it a GREAT deal for some capacity\perf buy D:

 

[nexox]

Intel will give you firmware for their enterprise drives, Samsung pretty much won't, may make a difference for you, maybe not.

 

[marcel]

You can choose between TLC, and QLC. I read that TLC is more durable as QLC. It is also faster. I think with I/O of VM's and the durability maybe better to choose for TLC? Although they are more expensive.

Samsung 980 Pro (met heatsink) 2TB kopen? - Prijzen - Tweakers

 

[marcel]

Of course I'm considering my options, and still learning every day. What if I use shared storage with Proxmox and create an high availability cluster? I can create a ZFS pool of 2,5 SSD drives.

If I go this route then an 1Tb NVME is enough in my Proxmox hypevisor.

Samsung 980 Pro (zonder heatsink) 1TB kopen? - Prijzen - Tweakers

I already have 10Gb available in my rack. I'm an Unifi fan.

 

[DavidRa]

If you don't need the newest or fastest you can buy the Intel p3600 \ p3605 NVME 1.6TB for 40-80$ each, that same generation P3700 are pretty cheap now too, but personally I'd skip p3700 and jump to 4600\4610. If you want little newer the Intel P4500\4510 or P4600\4610 are about 2x as much as those

Where on earth are you finding them for USD40-80? The cheapest I'm seeing even now for the P3700 800GB is USD100-150, let alone the 1.6TB.

 

[nexox]

Where on earth are you finding them for USD40-80?

The p3600 is cheaper than the p3700, several auctions have ended in this range recently, for example: Intel SSD DC P3600 Series SSDPEDME020T4D 2.0TB PCIe 3.0 NVMe Drive Dell JFRHP 2 | eBay

 

[louie1961]

Something seems out of place with that build. Why spend the money on a server board and not use ECC ram? I am not saying you need ECC ram, but if you aren't going to use ECC ram, you could get by with a cheaper motherboard that would use less power.

I also think if your goal is to consume less power, you are probably over shooting on the CPU. I would probably get something like the Ryzen 7 Pro 5750GE and save a ton of power with a 35 watt TDP processor. But that's just my preference. My latest Proxmox build is based on an HP Elitedesk Mini 800 with an intel i5-12500T and 32 GB of non-ecc ram. My previous server was based on a E5-2690v3 with 64 GB of ECC memory. The old unit idled at ~70 watts. The new unit idles at ~8 watts. But everything runs so much faster on the new machine. Photoprism was able to index my picture library in about 1/4 the time.

I also don't store any data on my Proxmox machines, other than the actual VM and container images, and snapshots. I keep all my data on a separate NAS, and store all my ISOs, backups, etc. there. I keep all my data there too and mount my docker volumes in CIFS shares. As a result I generally only keep a pair of 1 TB drives in my Proxmox machines in a ZFS Raid 1/mirror array for the OS and VM/container images. So I would probably either choose a board with a better NIC (my network is 2.5 gbe, but maybe yours is faster?) or add a faster NIC to your build list.

 

[T_Minus]

Where on earth are you finding them for USD40-80? The cheapest I'm seeing even now for the P3700 800GB is USD100-150, let alone the 1.6TB.

Like the cheap (NIB) optanes -- they sell quick, and come\go -- not constantly that great of a price

I have some PCIE 1.6TB P3600 I may be interested in selling for what I paid -- just because I've since gotten 3.2tb drives i'll make a post if I do in the next couple weeks.