Troubleshooting GPU passthrough ESXi 6.5

AveryFreeman

consummate homelabber
Mar 17, 2017
254
23
18
40
Near Seattle
averyfreeman.com
Yeah, you've gotta tell us what you're working with. If it's a GeForce, I'm out of ideas. Try and find some resources from other people who've gotten it working, but AFAIK it's a really hard nut to crack, that's why I bought a Quadro.
 

AveryFreeman

consummate homelabber
Mar 17, 2017
254
23
18
40
Near Seattle
averyfreeman.com
@AveryFreeman I did hypervisor.cpuid.v0=false before even installing the GPU in the VM. I Started the System with it, and shut it down right after it. After that I installed the PCI Device and added pciPassthru.use64bitMMIO = "TRUE", pciPassthru1.msiEnabled = "FALSE" and pciPassthru0.msiEnabled = "FALSE"

Then I started the VM again and Installed the Device Drivers. If I Keep the SVGA then I will only get Bluescreens at the windows Start. I deinstalled the Nvidia Drivers now, reinstalled them, then they work for this short period (No code 43) but after one reboot Code 43 appears again.

I even tried the ACS Check , but that also didn't help. I am on the Newest Windows Version.
Did you see this post? Might be helpful - if you saw/tried it already, I apologize. Looks like there's hope for geforce people after all, though.

 

superempie

Member
Sep 25, 2015
67
8
8
The Netherlands
2 Geforces working fine here in my setup and happy with it for multiple months. EVGA 1070 for Linux Mint and ASUS 1080Ti for gaming. No passthru map adjustments needed. Depends on your hardware.
Typing this on it. Might only did ACS parameter for USB issues.
 
Last edited:

Iamfreaky

New Member
Mar 25, 2021
3
0
1
@AveryFreeman Yeah i tried that.

My Currently status is that it kinda works with the new GPU Drivers from NVIDIA, which dont generate Code 43 anymore. No need anymore for working on the VMX at least in 6.5.0.

Restarting the Client Works without any problem. Restarting the host still gives a BSOD if the GPU wasnt deactivatet befor the Host reboots.

I can manuell start the scripts, which will work. but not via the group rules in Windows automatically at boot or shutdown.
 

pro_info

New Member
Jun 27, 2021
2
0
1
France
Hello guys,
I've been following this topic for a few years now without an account on this forum, but I came to the news to see if some of you have passed the passthrough with the R465 and higher drivers that are supposed to allow virtualization. For my part I don't see any difference in my tests.
Historically I was under ESXi 6.7, the reboot gave an error 43, and I had tweaked a script to deactivate / reactivate, but it is not viable when the vm crashes, you have to restart the whole hypervisor ...

I switched a year ago to unraid, which allows me to inject the dump of my vbios which makes the card work without any problem, but in terms of stability and reliability, ESXi is far ahead, not to mention the snapshots, the dynamic vmdk...
It is for this reason and the one of the Aquantica network chip support of my QNA-UC5G1T 5Gbe that I am looking to switch back to ESXi. (I have to manage the adapter in passthrough by a vm and rerouted the upnp between two subnets, it works but it is not ideal).

i7-9700K
EVGA RTX 2070
...
I'm still trying variations of post #205, but without much success. I'll see if version 6.5 works and if it can satisfy me as a last resort.
FYI, with a pre-R465 driver, method #205 works directly with a GTX 750Ti I had lying around.

So as announced the drivers higher than R465 should work without problems, I believed it, but for my part no change, I have the error after a reboot of the VM. As said before, I have the impression that something has been changed on the RTX 2xxx generation that complicates the task.

I will put my configuration later today after some more tests.
(I go through a translation, sorry if everything is not understandable, it seems to me rather good.)
 

pro_info

New Member
Jun 27, 2021
2
0
1
France
Indeed, under ESXi 6.5, with the R471 driver, my RTX 2070 is functional even after several restarts of the VM. And without any modification on the passthru.map or vmx side.
I still need to see if I can get my NIC 5Gbe to work, it looks like I can't install the drivers.
export lspci-v RTX2070 esxi.png

Edit :
Well, everything works now, I had to update the 6.5 version with the last patch to be able to install the adapter drivers and then downgrade the esx-cli which crashes miserably when you want to edit a VM.

I have a strange behaviour when I launch the VM with the GPU passthrough, the fans of the graphic card pump 10-15 times and then the VM starts correctly, same behaviour when I stop.

Edit2 : Now the fans are not pumping, I don't know what could have solved the problem...
 
Last edited:

Eds89

Member
Feb 21, 2016
62
0
6
32
I'm wondering if someone can give me some pointers as I'm revisiting doing this myself but struggling a bit;
I have a custom build server running ESXi 7.0 U2, with a Quadro P400 connected.
I have the Quadro passed through to my VM, but even with R471 driver, I got Error 43, so had to add the hypervisor.cpuid.v0 = FALSE
Rebooted, and that error disappears, however, I am not seeing any GPU usage when doing a 4K transcode.
I have a physical monitor connected to the card, and have tried a couple of configs with it being the primary, to no avail.
I also tried svga.present = FALSE, but then I get no physical video output, nor anything via the console. Doing this also causes the error 43 to return to the device when I connect via RDP.

Not sure what else I need to try, but feels like I am very close to getting it working.

Appreciate any advice you may be able to offer.
Eds