The major benefits are that you save 15-20% on the initial installation per GPU and some on the ongoing costs since you are using more GPUs per chassis.
I am really interested in the build-out of that Gigabyte server. It is a dual root design so are you planning to use 2x Mellanox cards and avoid the NUMA penalty?
Hey Patrick,
Sorry for the long delay it took our supplier a while to get this system built out.
It's our first dual root design for we didn't go the 2x Mellanox route with it yet however it has room if needed.
As we've only ran single root systems in the past I've got a question for you.
Our system seems to only show 4 GPU's when running nvidia-smi topo -m
ubuntu@4U-GPU:~# nvidia-smi topo -m
GPU0 GPU1 GPU2 GPU3 CPU Affinity
GPU0 X PIX PIX PIX 0-11,24-35
GPU1 PIX X PIX PIX 0-11,24-35
GPU2 PIX PIX X PIX 0-11,24-35
GPU3 PIX PIX PIX X 0-11,24-35
Not sure if there is anything extra special we need to do in order to show the other cards on the system.
Any help would be greatly appreciated as I couldn't find anything online about this while trying the Googler.