Optane DCPMM Virtualization on Proxmox - VFIO_MAP_DMA failed

[NablaSquaredG]

Hey folks,

I'm trying something very niche: Virtualize NVDIMM aka Optane DCPMM on Proxmox.

I followed those guides:

Using QEMU Virtualization | Persistent Memory Documentation

docs.pmem.io

How To Provision Intel® Optane™ DC Persistent Memory for KVM/QEMU...

Use Intel Optane DC persistent memory in app-direct mode on a KVM/QEMU VM so applications can access persistent memory without modification.

www.intel.com

Optane DCPMM in Mixed Mode @ Intel Xeon 8259CL @ ASRock EPC621D8A
Proxmox 8.2 with 6.8 kernel

I compiled my own Qemu (pve-qemu-kvm-8.1.5-5) with pmem supported enabled, so the pmem flag is recognized

However, all I get is a

kvm: -device nvdimm,memdev=mem1,id=nv1,label-size=2M: VFIO_MAP_DMA failed: Operation not supported
kvm: -device nvdimm,memdev=mem1,id=nv1,label-size=2M: vfio_dma_map(0x59782afbe560, 0x880000000, 0xffe00000, 0x73401fe00000) = -95 (Operation not supported)
qemu: hardware error: vfio: DMA mapping failed, unable to continue

I am successfully using SR-IOV on the machine, so IOMMU should work?

Any ideas how to fix this?

 

[mrpasc]

Optane DCPMM in Mixed Mode

Think this will only work if in app direct mode.

 

[gb00s]

Hey folks,

I'm trying something very niche: Virtualize NVDIMM aka Optane DCPMM on Proxmox.

I followed those guides:

Using QEMU Virtualization | Persistent Memory Documentation

docs.pmem.io

How To Provision Intel® Optane™ DC Persistent Memory for KVM/QEMU...

Use Intel Optane DC persistent memory in app-direct mode on a KVM/QEMU VM so applications can access persistent memory without modification.

www.intel.com

Optane DCPMM in Mixed Mode @ Intel Xeon 8259CL @ ASRock EPC621D8A
Proxmox 8.2 with 6.8 kernel

I compiled my own Qemu (pve-qemu-kvm-8.1.5-5) with pmem supported enabled, so the pmem flag is recognized

However, all I get is a

kvm: -device nvdimm,memdev=mem1,id=nv1,label-size=2M: VFIO_MAP_DMA failed: Operation not supported
kvm: -device nvdimm,memdev=mem1,id=nv1,label-size=2M: vfio_dma_map(0x59782afbe560, 0x880000000, 0xffe00000, 0x73401fe00000) = -95 (Operation not supported)
qemu: hardware error: vfio: DMA mapping failed, unable to continue

I am successfully using SR-IOV on the machine, so IOMMU should work?

Any ideas how to fix this?

Show us your args for the vm please.