So I have this Mellanox ConnectX-3 and ESXi 6.7U1 and I want to tune ..

Discussion in 'VMware, VirtualBox, Citrix' started by svtkobra7, Dec 6, 2018 at 11:36 AM.

  1. svtkobra7

    svtkobra7 Active Member

    Joined:
    Jan 2, 2017
    Messages:
    188
    Likes Received:
    36
    I have two Connect X-3 cards, port 1 to switch, port 2 direct connection between hosts. Set up with virtual switch + port group in ESXi (6.7 U1), private IP assigned by FreeNAS ... (intended purpose is a high bandwidth transport for replication / segmented from all other traffic)

    So when FreeNAS-01 & FreeNAS-02 talk (iperf) they get ~14 Gbps (and I thought that seemed "low"), but when I create a vmkernel for ESXi to use, and use the same exact iperf settings, I get ~34 Gbps.

    My theory is that the default settings of ESXi are "conservative" and TSO et al can be manually tweaked to allow more of that juice to be passed through to the VM ...

    I found a few bits regarding this on the web, tried to tweak the settings, and ended up totally screwing the network settings on both hosts. And it looks like the settings have changed in format etc ...

    Anyone have any ideas for optimization here? Thanks in advance.

    Reference link = [SOLVED]Mellanox ConnectX 3 can't get 40G only 10G
     
    #1
Similar Threads: Mellanox ConnectX-3
Forum Title Date
VMware, VirtualBox, Citrix Proxmox issues with SR-IOV and Mellanox Connectx-3 Dec 20, 2015
VMware, VirtualBox, Citrix ESXi + XPEnology + Mellanox performance? Today at 8:27 AM
VMware, VirtualBox, Citrix Mellanox ConnectX-2 and ESXi 6.5 Oct 13, 2017
VMware, VirtualBox, Citrix Mellanox unhappy w/ vtD passthru in vSphere Nov 24, 2016
VMware, VirtualBox, Citrix Mellanox ConnectX-2 and ESXi 6.0 - Barely Working - Terrible Performance Nov 7, 2016

Share This Page