Hi,
I'm using 2 Connect-X card (VPI) on ESXi 6.7 with DAC Cable in ETH mode.
On both nodes, link is up, speed is 10000 Mbps, Full duplex but I'm unable to ping.
On loopback no problem :
---------------------------------------------------------------------------
PING 10.0.10.2 (10.0.10.2): 56 data bytes
64 bytes from 10.0.10.2: icmp_seq=0 ttl=64 time=0.066 ms
64 bytes from 10.0.10.2: icmp_seq=1 ttl=64 time=0.079 ms
--- 10.0.10.2 ping statistics ---
2 packets transmitted, 2 packets received, 0% packet loss
round-trip min/avg/max = 0.066/0.073/0.079 ms
---------------------------------------------------------------------------
On remote :
---------------------------------------------------------------------------
PING 10.0.10.1 (10.0.10.1): 56 data bytes
--- 10.0.10.1 ping statistics ---
3 packets transmitted, 0 packets received, 100% packet loss
---------------------------------------------------------------------------
On first ESXi :
----------------------------------------------------------------------------------------------------------------------------------
Name PCI Driver Link Speed Duplex MAC Address MTU Description
vmnic0 0000:03:00.0 mlx4_en Up 10000Mbps Full 00:02:c9:xx:xx:xx 1500 Mellanox Technologies MT26428 [ConnectX VPI - 10GigE / IB QDR, PCIe 2.0 5GT/s]
----------------------------------------------------------------------------------------------------------------------------------
On second ESXi :
----------------------------------------------------------------------------------------------------------------------------------
Name PCI Driver Link Speed Duplex MAC Address MTU Description
vmnic2 0000:06:00.0 mlx4_en Up 10000Mbps Full 00:02:c9:xx:xx:xx 1500 Mellanox Technologies MT26428 [ConnectX VPI - 10GigE / IB QDR, PCIe 2.0 5GT/s]
----------------------------------------------------------------------------------------------------------------------------------
I tried with integrated driver and with 1.9.10.0 driver but the problem is still the same.
-------------------------------------------------
driver: mlx4_en
version: 1.9.10.0 (Oct-19-2014)
firmware-version: 2.9.1000
bus-info: 0000:03:00.0
-------------------------------------------------
The firmware is the latest available for this (old) hardware.
I tried with Linux and the problem is exactly the same.
In infiniband mode there no problem, everything is working fine but in ethernet mode, no ping
.
With tcpdump, I only see ARP request, no answer (and nothing on the other node).
-------------------------------------------------------------------------------------------
01:11:53.037222 ARP, Request who-has 10.0.10.1 tell 10.0.10.2, length 28
01:11:54.038300 ARP, Request who-has 10.0.10.1 tell 10.0.10.2, length 28
01:11:55.040514 ARP, Request who-has 10.0.10.1 tell 10.0.10.2, length 28
-------------------------------------------------------------------------------------------
On the cards, the green led is on and sometimes the orange led blinks.
Any idea ?
Thanks to all.
I'm using 2 Connect-X card (VPI) on ESXi 6.7 with DAC Cable in ETH mode.
On both nodes, link is up, speed is 10000 Mbps, Full duplex but I'm unable to ping.
On loopback no problem :
---------------------------------------------------------------------------
PING 10.0.10.2 (10.0.10.2): 56 data bytes
64 bytes from 10.0.10.2: icmp_seq=0 ttl=64 time=0.066 ms
64 bytes from 10.0.10.2: icmp_seq=1 ttl=64 time=0.079 ms
--- 10.0.10.2 ping statistics ---
2 packets transmitted, 2 packets received, 0% packet loss
round-trip min/avg/max = 0.066/0.073/0.079 ms
---------------------------------------------------------------------------
On remote :
---------------------------------------------------------------------------
PING 10.0.10.1 (10.0.10.1): 56 data bytes
--- 10.0.10.1 ping statistics ---
3 packets transmitted, 0 packets received, 100% packet loss
---------------------------------------------------------------------------
On first ESXi :
----------------------------------------------------------------------------------------------------------------------------------
Name PCI Driver Link Speed Duplex MAC Address MTU Description
vmnic0 0000:03:00.0 mlx4_en Up 10000Mbps Full 00:02:c9:xx:xx:xx 1500 Mellanox Technologies MT26428 [ConnectX VPI - 10GigE / IB QDR, PCIe 2.0 5GT/s]
----------------------------------------------------------------------------------------------------------------------------------
On second ESXi :
----------------------------------------------------------------------------------------------------------------------------------
Name PCI Driver Link Speed Duplex MAC Address MTU Description
vmnic2 0000:06:00.0 mlx4_en Up 10000Mbps Full 00:02:c9:xx:xx:xx 1500 Mellanox Technologies MT26428 [ConnectX VPI - 10GigE / IB QDR, PCIe 2.0 5GT/s]
----------------------------------------------------------------------------------------------------------------------------------
I tried with integrated driver and with 1.9.10.0 driver but the problem is still the same.
-------------------------------------------------
driver: mlx4_en
version: 1.9.10.0 (Oct-19-2014)
firmware-version: 2.9.1000
bus-info: 0000:03:00.0
-------------------------------------------------
The firmware is the latest available for this (old) hardware.
I tried with Linux and the problem is exactly the same.
In infiniband mode there no problem, everything is working fine but in ethernet mode, no ping
.With tcpdump, I only see ARP request, no answer (and nothing on the other node).
-------------------------------------------------------------------------------------------
01:11:53.037222 ARP, Request who-has 10.0.10.1 tell 10.0.10.2, length 28
01:11:54.038300 ARP, Request who-has 10.0.10.1 tell 10.0.10.2, length 28
01:11:55.040514 ARP, Request who-has 10.0.10.1 tell 10.0.10.2, length 28
-------------------------------------------------------------------------------------------
On the cards, the green led is on and sometimes the orange led blinks.
Any idea ?
Thanks to all.