[Help!] RTX A5000 Error 43

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

mukami

New Member
Nov 20, 2023
2
0
1
So i purchased this device secondhand a few months ago, and now im running into error 43, physically the device looks fine, but even in a new VM on proxmox the device errors with error 43.

if anyone has any ideas on what i can try please let me know! have been trying to find different bios to flash but have had no luck finding anything.
currently dont have a separate test bench to try and test this further, but have it installed in my r730
 

CyklonDX

Well-Known Member
Nov 8, 2022
924
317
63
1) Which driver are you using inside your kvm
2) Are correct power cables connected to it?
3) Which version of proxmox kernel are you using? / Are you trying to do vgpu?
4) Are you passing through whole gpu through pcie addressing? Or just a slice? (if you are trying to passthrough whole gpu, you need to make sure all gpu components are also passed through - run lspci | grep NV ... you'll likely need to passthrough an audio device on same pcie lane, and make sure its mounted on same pci address, and subaddress space)

ex.
lspci | grep NV
87:00.0 VGA compatible controller: NVIDIA Corporation GA104GL [RTX A4000] (rev a1)
87:00.1 Audio device: NVIDIA Corporation GA104 High Definition Audio Controller (rev a1)

then you need to figure out how to correctly add it inside proxmox (on normal kvm it would be as follows)

XML:
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x87' slot='0x00' function='0x0'/>
      </source>
      <alias name='hostdev0'/>
      <address type='pci' domain='0x0000' bus='0x04' slot='0x00' function='0x0' multifunction='on'/>
    </hostdev>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x87' slot='0x00' function='0x1'/>
      </source>
      <alias name='hostdev1'/>
      <address type='pci' domain='0x0000' bus='0x04' slot='0x00' function='0x1'/>
    </hostdev>


1700527823603.png

(When NV/AMD driver doesn't see whole device it reports there is something wrong.)
 
Last edited:

mukami

New Member
Nov 20, 2023
2
0
1
1) Which driver are you using inside your kvm
2) Are correct power cables connected to it?
3) Which version of proxmox kernel are you using? / Are you trying to do vgpu?
4) Are you passing through whole gpu through pcie addressing? Or just a slice? (if you are trying to passthrough whole gpu, you need to make sure all gpu components are also passed through - run lspci | grep NV ... you'll likely need to passthrough an audio device on same pcie lane, and make sure its mounted on same pci address, and subaddress space)

ex.
lspci | grep NV
87:00.0 VGA compatible controller: NVIDIA Corporation GA104GL [RTX A4000] (rev a1)
87:00.1 Audio device: NVIDIA Corporation GA104 High Definition Audio Controller (rev a1)

then you need to figure out how to correctly add it inside proxmox (on normal kvm it would be as follows)

XML:
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x87' slot='0x00' function='0x0'/>
      </source>
      <alias name='hostdev0'/>
      <address type='pci' domain='0x0000' bus='0x04' slot='0x00' function='0x0' multifunction='on'/>
    </hostdev>
    <hostdev mode='subsystem' type='pci' managed='yes'>
      <driver name='vfio'/>
      <source>
        <address domain='0x0000' bus='0x87' slot='0x00' function='0x1'/>
      </source>
      <alias name='hostdev1'/>
      <address type='pci' domain='0x0000' bus='0x04' slot='0x00' function='0x1'/>
    </hostdev>


View attachment 32839

(When NV/AMD driver doesn't see whole device it reports there is something wrong.)
So to answer some questions,
running the latest rtx / quadro desktop driver 535 for windows server 2019,
proxmox VE 7.4-16 kernel 5.15.116-1-pve
not running vgpu, just trying to passthrough the entire device to the VM
1700584790410.png
passing through all functions so it should be passing through the entire device!
1700584871328.png
 

CyklonDX

Well-Known Member
Nov 8, 2022
924
317
63
Have you tried selecting Primary GPU?

Try getting quadro driver for windows 10 *(nv may have blocked stuff on server drivers)