Would it work in a live boot or Ubuntu or so I need to install?Did you tried a linux live distribution to see if the ports work ? just to see if the OS isn't the culprit.
Would it work in a live boot or Ubuntu or so I need to install?Did you tried a linux live distribution to see if the ports work ? just to see if the OS isn't the culprit.
Thanks for the reminder. I'll give it a try in my next visit to the Colo in a few weeks.Here's a config from my CX534A flashed with Lenovo's FCBT firmware. Hope it's helpful for you.
Firmware link: Mellanox ConnectX-3 Firmware (For Windows) - Lenovo Support US
Bash:[root@ESXi2:~] /opt/mellanox/bin/mlxconfig q Device #1: ---------- Device type: ConnectX3 Device: mt4099_pciconf0 Configurations: Next Boot SRIOV_EN True(1) NUM_OF_VFS 16 LINK_TYPE_P1 ETH(2) PHY_TYPE_P1 XFI(2) XFI_MODE_P1 _10G(0) FORCE_MODE_P1 False(0) LINK_TYPE_P2 ETH(2) PHY_TYPE_P2 XFI(2) XFI_MODE_P2 _10G(0) FORCE_MODE_P2 False(0) LOG_BAR_SIZE 3 BOOT_PKEY_P1 0 BOOT_PKEY_P2 0 BOOT_OPTION_ROM_EN_P1 False(0) BOOT_VLAN_EN_P1 False(0) BOOT_RETRY_CNT_P1 0 LEGACY_BOOT_PROTOCOL_P1 None(0) BOOT_VLAN_P1 1 BOOT_OPTION_ROM_EN_P2 False(0) BOOT_VLAN_EN_P2 False(0) BOOT_RETRY_CNT_P2 0 LEGACY_BOOT_PROTOCOL_P2 None(0) BOOT_VLAN_P2 1 IP_VER_P1 IPv4(0) IP_VER_P2 IPv4(0) CQ_TIMESTAMP True(1) STEER_FORCE_VLAN False(0)
Just spitballing, but there's a recovery header on the card that you can short which will put the card into recovery mode for flashing.
Details on how to do it can be found in the thread linked in post #13.
just live boot a debian iso no need to install, you should see both portsWould it work in a live boot or Ubuntu or so I need to install?
No need to install.Would it work in a live boot or Ubuntu or so I need to install?
I was able to recover it using the linked thread but the 1'st port doesn't want to come up. Windows did see it as a interface and I tried two known working cables and ports. I wonder if it's just a bad connector inside the port.Here's a config from my CX534A flashed with Lenovo's FCBT firmware. Hope it's helpful for you.
Firmware link: Mellanox ConnectX-3 Firmware (For Windows) - Lenovo Support US
Bash:[root@ESXi2:~] /opt/mellanox/bin/mlxconfig q Device #1: ---------- Device type: ConnectX3 Device: mt4099_pciconf0 Configurations: Next Boot SRIOV_EN True(1) NUM_OF_VFS 16 LINK_TYPE_P1 ETH(2) PHY_TYPE_P1 XFI(2) XFI_MODE_P1 _10G(0) FORCE_MODE_P1 False(0) LINK_TYPE_P2 ETH(2) PHY_TYPE_P2 XFI(2) XFI_MODE_P2 _10G(0) FORCE_MODE_P2 False(0) LOG_BAR_SIZE 3 BOOT_PKEY_P1 0 BOOT_PKEY_P2 0 BOOT_OPTION_ROM_EN_P1 False(0) BOOT_VLAN_EN_P1 False(0) BOOT_RETRY_CNT_P1 0 LEGACY_BOOT_PROTOCOL_P1 None(0) BOOT_VLAN_P1 1 BOOT_OPTION_ROM_EN_P2 False(0) BOOT_VLAN_EN_P2 False(0) BOOT_RETRY_CNT_P2 0 LEGACY_BOOT_PROTOCOL_P2 None(0) BOOT_VLAN_P2 1 IP_VER_P1 IPv4(0) IP_VER_P2 IPv4(0) CQ_TIMESTAMP True(1) STEER_FORCE_VLAN False(0)
Just spitballing, but there's a recovery header on the card that you can short which will put the card into recovery mode for flashing.
Details on how to do it can be found in the thread linked in post #13.
PS C:\Users\Administrator> flint -d mt502_pciconf0 -i C:\image\CX3-2_42_5032.bin burn
Current FW version on flash: 2.42.5000
New FW version: 2.42.5032
Burning FS2 FW image without signatures - OK
Restoring signature - OK
~] /opt/mellanox/bin/mlxfwmanager
Querying Mellanox devices firmware ...
Device #1:
----------
Device Type: ConnectX3
Part Number: MCX354A-FCB_A2-A5
Description: ConnectX-3 VPI adapter card; dual-port QSFP; FDR IB (56Gb/s) and 40GigE; PCIe3.0 x8 8GT/s; RoHS R6
PSID: MT_1090120019
PCI Device Name: mt4099_pci_cr0
Port1 MAC: 24be058b97a1
Port2 MAC: 24be058b97a2
Versions: Current Available
FW 2.42.5032 N/A
PXE 3.4.0754 N/A
UEFI 14.11.0047 N/A
Status: No matching image found
~] /opt/mellanox/bin/mlxconfig -d mt4099_pci_cr0 query
Device #1:
----------
Device type: ConnectX3
Device: mt4099_pci_cr0
Configurations: Next Boot
SRIOV_EN False(0)
NUM_OF_VFS 8
LINK_TYPE_P1 ETH(2)
PHY_TYPE_P1 XFI(2)
XFI_MODE_P1 _10G(0)
FORCE_MODE_P1 False(0)
LINK_TYPE_P2 ETH(2)
PHY_TYPE_P2 0
XFI_MODE_P2 _10G(0)
FORCE_MODE_P2 False(0)
LOG_BAR_SIZE 3
BOOT_PKEY_P1 0
BOOT_PKEY_P2 0
BOOT_OPTION_ROM_EN_P1 False(0)
BOOT_VLAN_EN_P1 False(0)
BOOT_RETRY_CNT_P1 0
LEGACY_BOOT_PROTOCOL_P1 None(0)
BOOT_VLAN_P1 1
BOOT_OPTION_ROM_EN_P2 False(0)
BOOT_VLAN_EN_P2 False(0)
BOOT_RETRY_CNT_P2 0
LEGACY_BOOT_PROTOCOL_P2 None(0)
BOOT_VLAN_P2 1
IP_VER_P1 IPv4(0)
IP_VER_P2 IPv4(0)
CQ_TIMESTAMP True(1)
STEER_FORCE_VLAN False(0)
This value is incorrect.I was able to recover it using the linked thread but the 1'st port doesn't want to come up. Windows did see it as a interface and I tried two known working cables and ports. I wonder if it's just a bad connector inside the port.
Recovery reflash:
Check after boot:Code:PS C:\Users\Administrator> flint -d mt502_pciconf0 -i C:\image\CX3-2_42_5032.bin burn Current FW version on flash: 2.42.5000 New FW version: 2.42.5032 Burning FS2 FW image without signatures - OK Restoring signature - OK
card:Code:~] /opt/mellanox/bin/mlxfwmanager Querying Mellanox devices firmware ... Device #1: ---------- Device Type: ConnectX3 Part Number: MCX354A-FCB_A2-A5 Description: ConnectX-3 VPI adapter card; dual-port QSFP; FDR IB (56Gb/s) and 40GigE; PCIe3.0 x8 8GT/s; RoHS R6 PSID: MT_1090120019 PCI Device Name: mt4099_pci_cr0 Port1 MAC: 24be058b97a1 Port2 MAC: 24be058b97a2 Versions: Current Available FW 2.42.5032 N/A PXE 3.4.0754 N/A UEFI 14.11.0047 N/A Status: No matching image found ~] /opt/mellanox/bin/mlxconfig -d mt4099_pci_cr0 query Device #1: ---------- Device type: ConnectX3 Device: mt4099_pci_cr0 Configurations: Next Boot SRIOV_EN False(0) NUM_OF_VFS 8 LINK_TYPE_P1 ETH(2) PHY_TYPE_P1 XFI(2) XFI_MODE_P1 _10G(0) FORCE_MODE_P1 False(0) LINK_TYPE_P2 ETH(2) PHY_TYPE_P2 0 XFI_MODE_P2 _10G(0) FORCE_MODE_P2 False(0) LOG_BAR_SIZE 3 BOOT_PKEY_P1 0 BOOT_PKEY_P2 0 BOOT_OPTION_ROM_EN_P1 False(0) BOOT_VLAN_EN_P1 False(0) BOOT_RETRY_CNT_P1 0 LEGACY_BOOT_PROTOCOL_P1 None(0) BOOT_VLAN_P1 1 BOOT_OPTION_ROM_EN_P2 False(0) BOOT_VLAN_EN_P2 False(0) BOOT_RETRY_CNT_P2 0 LEGACY_BOOT_PROTOCOL_P2 None(0) BOOT_VLAN_P2 1 IP_VER_P1 IPv4(0) IP_VER_P2 IPv4(0) CQ_TIMESTAMP True(1) STEER_FORCE_VLAN False(0)
View attachment 25512
PHY_TYPE_P2 0
1: XAUI
2: XFI
3: SGMII