[Help!] RTX A5000 Error 43

[mukami]

So i purchased this device secondhand a few months ago, and now im running into error 43, physically the device looks fine, but even in a new VM on proxmox the device errors with error 43.

if anyone has any ideas on what i can try please let me know! have been trying to find different bios to flash but have had no luck finding anything.
currently dont have a separate test bench to try and test this further, but have it installed in my r730

 

[CyklonDX]

1) Which driver are you using inside your kvm
2) Are correct power cables connected to it?
3) Which version of proxmox kernel are you using? / Are you trying to do vgpu?
4) Are you passing through whole gpu through pcie addressing? Or just a slice? (if you are trying to passthrough whole gpu, you need to make sure all gpu components are also passed through - run lspci | grep NV ... you'll likely need to passthrough an audio device on same pcie lane, and make sure its mounted on same pci address, and subaddress space)

ex.
lspci | grep NV
87:00.0 VGA compatible controller: NVIDIA Corporation GA104GL [RTX A4000] (rev a1)
87:00.1 Audio device: NVIDIA Corporation GA104 High Definition Audio Controller (rev a1)

then you need to figure out how to correctly add it inside proxmox (on normal kvm it would be as follows)

    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x87' slot='0x00' function='0x0'/>
      </source>
      <alias name='hostdev0'/>
      <address type='pci' domain='0x0000' bus='0x04' slot='0x00' function='0x0' multifunction='on'/>
    </hostdev>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x87' slot='0x00' function='0x1'/>
      </source>
      <alias name='hostdev1'/>
      <address type='pci' domain='0x0000' bus='0x04' slot='0x00' function='0x1'/>
    </hostdev>

(When NV/AMD driver doesn't see whole device it reports there is something wrong.)

 

[mukami]

1) Which driver are you using inside your kvm
2) Are correct power cables connected to it?
3) Which version of proxmox kernel are you using? / Are you trying to do vgpu?
4) Are you passing through whole gpu through pcie addressing? Or just a slice? (if you are trying to passthrough whole gpu, you need to make sure all gpu components are also passed through - run lspci | grep NV ... you'll likely need to passthrough an audio device on same pcie lane, and make sure its mounted on same pci address, and subaddress space)

ex.
lspci | grep NV
87:00.0 VGA compatible controller: NVIDIA Corporation GA104GL [RTX A4000] (rev a1)
87:00.1 Audio device: NVIDIA Corporation GA104 High Definition Audio Controller (rev a1)

then you need to figure out how to correctly add it inside proxmox (on normal kvm it would be as follows)

    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x87' slot='0x00' function='0x0'/>
      </source>
      <alias name='hostdev0'/>
      <address type='pci' domain='0x0000' bus='0x04' slot='0x00' function='0x0' multifunction='on'/>
    </hostdev>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x87' slot='0x00' function='0x1'/>
      </source>
      <alias name='hostdev1'/>
      <address type='pci' domain='0x0000' bus='0x04' slot='0x00' function='0x1'/>
    </hostdev>

View attachment 32839

(When NV/AMD driver doesn't see whole device it reports there is something wrong.)

So to answer some questions,
running the latest rtx / quadro desktop driver 535 for windows server 2019,
proxmox VE 7.4-16 kernel 5.15.116-1-pve
not running vgpu, just trying to passthrough the entire device to the VM

passing through all functions so it should be passing through the entire device!

 

[CyklonDX]

Have you tried selecting Primary GPU?

Try getting quadro driver for windows 10 *(nv may have blocked stuff on server drivers)