(Proxmox) Single drive for Boot and VMs

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

servape

New Member
Mar 26, 2022
14
2
3
What are the downsides to using a single drive (500GB NVME M2) for both the Proxmox boot drive and VMs? I plan on having (3) 14TB HDDs for other data.

This is for home use.
 
Last edited:

i386

Well-Known Member
Mar 18, 2016
4,245
1,546
113
34
Germany
The vms could wear Out the SSD and kill it and degrade the Performance of the vms and proxmox thanks to sustained io

(500gb and m.2 screams consumer SSD)
 

MrCalvin

IT consultant, Denmark
Aug 22, 2016
87
15
8
51
Denmark
www.wit.dk
The vms could wear Out the SSD and kill it and degrade the Performance of the vms and proxmox thanks to sustained io

(500gb and m.2 screams consumer SSD)
Why does placing root and VM disk on the same drive increase wear-out? Let's say compared to placing root and VM disk on each 256GB M.2?
I would claim it would be even worse.
I don't in general see a lot of IO of the root-volumes, regardless of being root-volume of VM or the hypervisor.
 
Last edited:

servape

New Member
Mar 26, 2022
14
2
3
The vms could wear Out the SSD and kill it and degrade the Performance of the vms and proxmox thanks to sustained io

(500gb and m.2 screams consumer SSD)
Wear out an SSD? From what I've read, most people use SSD for speed/performance of the VMs and OS.. So you put VMs on a standard mechanical HDD?

"screams consumer SSD" yes. This is for home use.
 

Stephan

Well-Known Member
Apr 21, 2017
944
712
93
Germany
I like boot separate, with RAID1 even. When things go sideways for a node I want to have a bootable system for diagnosing. Homelab also. I like it when systems can still limp along even with 50% of components dead. To me resilience is a good virtue.
 
  • Like
Reactions: Glock24 and zac1

zac1

Well-Known Member
Oct 1, 2022
432
358
63
Why does placing root and VM disk on the same drive increase wear-out? Let's say compared to placing root and VM disk on each 256GB M.2?
I would claim it would be even worse.
I don't in general see a lot of IO of the root-volumes, regardless of being root-volume of VM or the hypervisor.
Putting VMs on same drive as root would hasten the decline of your boot drive. I would want to at least mirror in this situation.

Wear out an SSD? From what I've read, most people use SSD for speed/performance of the VMs and OS.. So you put VMs on a standard mechanical HDD?

"screams consumer SSD" yes. This is for home use.
Consumer SSDs have a fraction of the endurance of enterprise- or datacenter-oriented SSDs. They also lack things like power loss protection. Depending on your VM workloads, this may or may not be a problem.

You can get used datacenter SSDs for pennies on the dollar. See Buyer’s Guide to getting a used datacenter SSD inexpensively.
 

servape

New Member
Mar 26, 2022
14
2
3
I understand that but my needs are probably 1/10000 that of a data center, lol. I've been running services on a single Windows machine for 10 years now with an old 128GB SSD.
 

Stephan

Well-Known Member
Apr 21, 2017
944
712
93
Germany
Whatever floats your boat. ;-) Recommend then to get a single Micron MAX 5100 SATA for cheap and install everything on it and be done again for 10 years. Drive has a large TBW rating, i.e. hard to kill with writes. Firmware update available from micron.com after registration. Power-loss protection. Low power usage.
 

servape

New Member
Mar 26, 2022
14
2
3
This project was put on the side and I am back on it again. I am looking into used, enterprise SSDs like several have mentioned in this thread. I would like the Proxmox boot drive to be strickly the OS only and in RAIDZ1. Does anyone have any recommendations for a low cost - low capacity (128GB range) and reliable/high endurance drive?
 

i386

Well-Known Member
Mar 18, 2016
4,245
1,546
113
34
Germany
For os only and No vms on IT (different than the Question in the OP): Stick with a SATA Dom or m.2 SSD.
 

servape

New Member
Mar 26, 2022
14
2
3
I found (2) 240GB MZ-7LM2400 $25 each. No longer in warranty but seller says it only has light usage, only 200GB written.
 

zac1

Well-Known Member
Oct 1, 2022
432
358
63
You could probably get SM863 with an order of magnitude more endurance than those PM863s for a similar price on eBay.
 

PigLover

Moderator
Jan 26, 2011
3,186
1,545
113
I love discussions like this where everybody gets all pedantic and raves about things like SSD "wearout" without even considering the actual use case. You usually get this with the "ZFS requires ECC" thingy. But this one is a fun basket advice focusing in on the wrong things too.

Putting the boot and VMs together on one drive really is not a worrisome thing for homelab use cases. There is no actual data available to show otherwise.

For a home lab, running typical home lab things, and with modern (last two years) better consumer SSDs this is not a real worry. Look at the actual wear level performance specs and consider how much (or, really, how little) disk write things like Home Assistant or other home-lab apps do. Don't pull thing out of your used laptop or go for the cheapest Samsung EVO drive - stay to the middle/upper range of consumer SSDs and you are looking at YEARS of use.

Now - if the OP was asking about an NVR app for 10 cameras with continuous recording the story is quite different.

ps - there are good reasons not to do this too. But they really revolve around life cycle of your lab and the value of having boot and VMs separate when you are making changes or replacing things.

pps - if the pedants want to give some better advice they should really be nagging you to make sure you do regular backups. All drives actually do fail. Not because you mixed uses on them in ways that bother people. But because they are physical things that break. And all of the wear-level specs are really just statically derived. Most drives do much better than expected. Often 5-10x better. But some drives fail on day two. Do backups! Do backups!! Do backups!!!
 

bigfellasdad

Member
Apr 10, 2018
86
44
18
67
My proxmox server run from a consumer 1tb Samsung nvme, I back it all up to a 12tb spinning zfs mirror. If the nvme dies, I'll fire up my old t620 plus openwrt for Internet so I can listen to Spotify during the 90 mins it would take to rebuild and recover my lab.

Hth
 
  • Love
Reactions: PigLover

Glock24

Active Member
May 13, 2019
159
93
28
The biggest downside I can think of is no redundancy, if the 500GB drive fails you lose all.

SSD wear will depend much on what you'll be runnning in your VM, but if not something write intensive like torrenting or DVR then there should be no problem with endurance.
 

Bjorn Smith

Well-Known Member
Sep 3, 2019
877
485
63
49
r00t.dk
I think its always good practice to separate OS from Data. In this case Proxmox is the OS and the VM's the data.
If the root drive dies you have lost your VM's - and if you do not have a good backup strategy you are not in a good place.
If you have VM's on one drive, proxmox on the other, you have at least made it possible to reinstall proxmox and still have the data for your VM's available.

And also consider that proxmox when its running will not write a lot of data on your, but if you put VM's on the drive you are putting more stress onto the "important" drive for your VM solution.

It is certainly true that for a homelab many of the good practices does not matter much - but why not practice stuff that is considered best practice - even if its a hobby and you only have small requirements.

A disk can die at any time and if you put all your eggs in the same basket you are making it harder for your self.

Obviously you should also have a backup strategy in place.

So yes, anything goes, but you can buy a cheap small SATA ssd and put proxmox on that and would probably not have to worry much about it being worn out.

Small enterprise SSD's are cheap.
 
  • Like
Reactions: bigfellasdad