Different disk sets for Proxmox Ceph pools?

chilipepperz

Active Member
Mar 17, 2016
212
63
28
50
So I'm using Proxmox VE 5.4. I have a Ceph cluster made up of hard drives with some SSDs for caching. Great!

I've also got a bunch of NVMe SSDs across the nodes. There are too many for simply being used as cache devices. I want to use them as an all-NVMe Ceph pool.

If I add them to the Ceph by adding OSD via CLI or GUI I'm getting them added to the main pool.

Is there a way to add NVMe devices to a different set in a different pool so they're not combined with the slower pool?
 

MikeWebb

Member
Jan 28, 2018
87
21
8
50
I see that ceph now has a nvme, ssd and hdd type. a quick google resulted in a few hits that showed how to create crushmaps and rules for device type pools. Sorry I can't help more, I'm trying to not go down toooo far the ceph rabbit hole. I'm focusing on OSD nodes with mixed ssd and hdd but sounds like issues needing similar solutions.
 

Patrick

Administrator
Staff member
Dec 21, 2010
11,908
4,871
113
I think @MikeWebb has the right idea for now.

I agree @chilipepperz that Ceph admin in Proxmox having a feature like this would be useful. Ceph handles tiering, but if you want to explicitly play with this, you need to go outside the normal offering.