Celestica Seastone DX010 - not working in 100GbE with Mellanox ConnectX-4, need help?

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

MichalPL

Active Member
Feb 10, 2019
189
25
28
I have an unexpected problem with Celestica DX010, I just (few days ago) start the new company network and realized that I don't have link with 100GbE cards at 100GbE speed, 40GbE is working fine (with Mellanox ConnectX-4 100GbE and Mellanox ConnectX-3 40GbE cards), but 100 isn't. Autoneg is not working too yet.

What is funny 100GbE is working fine between Celestica DX010 and another Celestica DX010, same cables or transceivers are working fine too ConnectX-4 100GbE and another ConnectX-4 100GbE (real copy file speed is ~7GB/s on Windows and Ryzen 5000), but Celestica and ConnectX-4 not.

any thoughts how to make it working?
 

MichalPL

Active Member
Feb 10, 2019
189
25
28
This is my sonic version, issues that I know are:
*No auto-negotiation (hardware is supporting it but OS not)
*Huge delay in status of the connected transceivers


1626707433811.png
 

nasbdh9

Active Member
Aug 4, 2019
164
96
28
autonegotiation is not supported, depending on your cable (SFP28/QSFP28) it may be KR/KR4 instead of KP/KP4, so you need to set the FEC of the port to RS on the switch, and the network card will automatically recognize the FEC from the switch Without manual setting, you can use mlxlink and mlxcables to do related diagnosis