I have a Dell R510 running the newest version of OMV with an Intel 82599es based Silicom PE210G2BPI9 2x10Gbps LC/LC MMF NIC on the newest ixgbe driver (downloaded and compiled locally). I also have a Dell R710 running the newest version of Ubuntu LTS 20.04 with the same NIC and the same driver. The NICs are directly connected to one another with brand new LC/LC MMF cables and static private IP addresses.
I am able to raise a link between both NICs on their respective hosts, but no matter what I do I cannot discern why I have a flapping issue:
Before upgrading the firmware, this was happening on both hosts whenever a link was established.
After upgrading the firmware, the issue only seems to be happening on the OMV host, which is why I'm posting here now.
I have checked transmit/receive and driver/interface errors and there are none.
I have also checked and even replaced the LC/LC MMF cables.
At this point, I'm wondering if there's some strange configuration race condition or mix-up somewhere from when I was troubleshooting getting these NICs up in the first place (it wasn't easy getting to this point).
Does anyone have any insight as to what the issue might be or where I can go from here?
I am able to raise a link between both NICs on their respective hosts, but no matter what I do I cannot discern why I have a flapping issue:
Bash:
$ dmesg | tail
[ 4083.171821] ixgbe 0000:03:00.0 enp3s0f0: NIC Link is Down
[ 4083.199845] ixgbe 0000:03:00.0 enp3s0f0: NIC Link is Up 10 Gbps, Flow Control: RX/TX
[ 4083.280158] ixgbe 0000:03:00.0 enp3s0f0: NIC Link is Down
[ 4083.303846] ixgbe 0000:03:00.0 enp3s0f0: NIC Link is Up 10 Gbps, Flow Control: RX/TX
[ 4085.187773] ixgbe 0000:03:00.0 enp3s0f0: NIC Link is Down
[ 4085.727752] ixgbe 0000:03:00.0 enp3s0f0: NIC Link is Up 10 Gbps, Flow Control: RX/TX
[ 4087.203750] ixgbe 0000:03:00.0 enp3s0f0: NIC Link is Down
[ 4087.743725] ixgbe 0000:03:00.0 enp3s0f0: NIC Link is Up 10 Gbps, Flow Control: RX/TX
[ 4089.219666] ixgbe 0000:03:00.0 enp3s0f0: NIC Link is Down
[ 4089.759698] ixgbe 0000:03:00.0 enp3s0f0: NIC Link is Up 10 Gbps, Flow Control: RX/TX
Before upgrading the firmware, this was happening on both hosts whenever a link was established.
After upgrading the firmware, the issue only seems to be happening on the OMV host, which is why I'm posting here now.
I have checked transmit/receive and driver/interface errors and there are none.
I have also checked and even replaced the LC/LC MMF cables.
At this point, I'm wondering if there's some strange configuration race condition or mix-up somewhere from when I was troubleshooting getting these NICs up in the first place (it wasn't easy getting to this point).
Does anyone have any insight as to what the issue might be or where I can go from here?