so after spending perhaps a week trying to get the right combo of drivers on the host and the container I stumbled upon this: Home · NVIDIA/nvidia-docker Wiki · GitHub and got it working in minutes
everything works
everything works