Now that 40gbe hardware has fallen a bit in price I made the move but had some questions on the speeds I am getting.
My setup:
R720xd with a ConnectX 3 running ESXI, the VM is Centos connected with a VMNetx3 adapter. On the other side I have an R710 with a ConnectX 3 running ESXI and a Centos VM. Both VMs are connected to a vswitch and the Cx3’s are connected directly via a twinaxe qsfp + cable (no physical switch in the picture… yet.)
Running Iperf I am getting about 1600 MB a sec between the vms.
This might be a dumb question but if I Iperf 127.0.0.1 on the 710 I get about 21gbps. Is that the max I will ever get out of this box? I had assumed there was some offloading of some of the work to the NIC and I guess I assumed I would get better performance.
I did read this thread Can't get more than 20Gbps out of a 40GbE network - Suggestions? but am still not coming close to this formula
Gen 2 x8: 40 GT/s*8b/10b = 32 Gbit/s (4 GB/s).
My setup:
R720xd with a ConnectX 3 running ESXI, the VM is Centos connected with a VMNetx3 adapter. On the other side I have an R710 with a ConnectX 3 running ESXI and a Centos VM. Both VMs are connected to a vswitch and the Cx3’s are connected directly via a twinaxe qsfp + cable (no physical switch in the picture… yet.)
Running Iperf I am getting about 1600 MB a sec between the vms.
This might be a dumb question but if I Iperf 127.0.0.1 on the 710 I get about 21gbps. Is that the max I will ever get out of this box? I had assumed there was some offloading of some of the work to the NIC and I guess I assumed I would get better performance.
I did read this thread Can't get more than 20Gbps out of a 40GbE network - Suggestions? but am still not coming close to this formula
Gen 2 x8: 40 GT/s*8b/10b = 32 Gbit/s (4 GB/s).