Problem with setup of HP Connectx-3 VPI Pro HP 544+ 764284-B21B Card CX354A

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.
T

tochnia

New Member
Mar 5, 2022
15
3
3
I have tested in same PC, connecting to same Brocade 6610 switch port, with same cable and same transceivers another VPI /non-pro/ card CX354A and connection worked fine.
But now with same setup and HP Connectx-3 VPI Pro HP 544+ 764284-B21B Card CX354A it is showing "Network Cable Unplugged" in Windows 10.
Tried to change: LINK_TYPE, XFI_MODE , PHY_TYPE, FORCE_MODE but nothing seems to work.
I haven't tried to cross flash it as its current FW level is higher than those available from Mellanox 2.42.5056 vs 2.42.5000.
Using default Windows drivers..

Can someone show working Ethernet 40GB setup for VPI Pro card, or advice what I can troubleshoot further.

Here it is my current setup:


C:\WINDOWS\system32>mlxconfig -d /dev/mst/mt4103_pci_cr0 query

Device #1:
----------

Device type: ConnectX3Pro
Device: /dev/mst/mt4103_pci_cr0

Configurations: Next Boot
SRIOV_EN True(1)
NUM_OF_VFS 16
LINK_TYPE_P1 ETH(2)
PHY_TYPE_P1 XAUI(1)
XFI_MODE_P1 _40G(2)
FORCE_MODE_P1 True(1)
LINK_TYPE_P2 ETH(2)
PHY_TYPE_P2 XAUI(1)
XFI_MODE_P2 _40G(2)
FORCE_MODE_P2 True(1)
LOG_BAR_SIZE 5
BOOT_PKEY_P1 0
BOOT_PKEY_P2 0
BOOT_OPTION_ROM_EN_P1 True(1)
BOOT_VLAN_EN_P1 False(0)
BOOT_RETRY_CNT_P1 0
LEGACY_BOOT_PROTOCOL_P1 PXE(1)
BOOT_VLAN_P1 1
BOOT_OPTION_ROM_EN_P2 True(1)
BOOT_VLAN_EN_P2 False(0)
BOOT_RETRY_CNT_P2 0
LEGACY_BOOT_PROTOCOL_P2 PXE(1)
BOOT_VLAN_P2 1
IP_VER_P1 IPv4(0)
IP_VER_P2 IPv4(0)
CQ_TIMESTAMP True(1)
STEER_FORCE_VLAN False(0)

C:\WINDOWS\system32>

C:\WINDOWS\system32>mlxfwmanager --query
Querying Mellanox devices firmware ...

Device #1:
----------

Device Type: ConnectX3Pro
Part Number: 764284-B21_Ax
Description: HP InfiniBand FDR/Ethernet 10Gb/40Gb 2-port 544+QSFP Adapter
PSID: HP_1370110017
PCI Device Name: mt4103_pci_cr0
Port1 MAC: 9440c9b9fa51
Port2 MAC: 9440c9b9fa52
Versions: Current Available
FW 2.42.5056 N/A
CLP 8025 N/A
PXE 3.4.0754 N/A
UEFI 14.11.0049 N/A

Status: No matching image found


C:\WINDOWS\system32>
 
P

prdtabim

Active Member
Jan 29, 2022
171
66
28
tochnia said:
I have tested in same PC, connecting to same Brocade 6610 switch port, with same cable and same transceivers another VPI /non-pro/ card CX354A and connection worked fine.
But now with same setup and HP Connectx-3 VPI Pro HP 544+ 764284-B21B Card CX354A it is showing "Network Cable Unplugged" in Windows 10.
Tried to change: LINK_TYPE, XFI_MODE , PHY_TYPE, FORCE_MODE but nothing seems to work.
I haven't tried to cross flash it as its current FW level is higher than those available from Mellanox 2.42.5056 vs 2.42.5000.
Using default Windows drivers..

Can someone show working Ethernet 40GB setup for VPI Pro card, or advice what I can troubleshoot further.

Here it is my current setup:


C:\WINDOWS\system32>mlxconfig -d /dev/mst/mt4103_pci_cr0 query

Device #1:
----------

Device type: ConnectX3Pro
Device: /dev/mst/mt4103_pci_cr0

Configurations: Next Boot
SRIOV_EN True(1)
NUM_OF_VFS 16
LINK_TYPE_P1 ETH(2)
PHY_TYPE_P1 XAUI(1)
XFI_MODE_P1 _40G(2)
FORCE_MODE_P1 True(1)
LINK_TYPE_P2 ETH(2)
PHY_TYPE_P2 XAUI(1)
XFI_MODE_P2 _40G(2)
FORCE_MODE_P2 True(1)
LOG_BAR_SIZE 5
BOOT_PKEY_P1 0
BOOT_PKEY_P2 0
BOOT_OPTION_ROM_EN_P1 True(1)
BOOT_VLAN_EN_P1 False(0)
BOOT_RETRY_CNT_P1 0
LEGACY_BOOT_PROTOCOL_P1 PXE(1)
BOOT_VLAN_P1 1
BOOT_OPTION_ROM_EN_P2 True(1)
BOOT_VLAN_EN_P2 False(0)
BOOT_RETRY_CNT_P2 0
LEGACY_BOOT_PROTOCOL_P2 PXE(1)
BOOT_VLAN_P2 1
IP_VER_P1 IPv4(0)
IP_VER_P2 IPv4(0)
CQ_TIMESTAMP True(1)
STEER_FORCE_VLAN False(0)

C:\WINDOWS\system32>

C:\WINDOWS\system32>mlxfwmanager --query
Querying Mellanox devices firmware ...

Device #1:
----------

Device Type: ConnectX3Pro
Part Number: 764284-B21_Ax
Description: HP InfiniBand FDR/Ethernet 10Gb/40Gb 2-port 544+QSFP Adapter
PSID: HP_1370110017
PCI Device Name: mt4103_pci_cr0
Port1 MAC: 9440c9b9fa51
Port2 MAC: 9440c9b9fa52
Versions: Current Available
FW 2.42.5056 N/A
CLP 8025 N/A
PXE 3.4.0754 N/A
UEFI 14.11.0049 N/A

Status: No matching image found


C:\WINDOWS\system32>
Click to expand...

HP 764285-B21 - works perfectly. Using the last fw from HP website.

Set PHY_TYPE_P1 and PHY_TYPE_P2 to 2 ( XFI mode ).
Set FORCE_MODE_P1 and FORCE_MODE_P2 to 0 unless you will always use a 40Gb/s link.

Code: 
mlxconfig -d /dev/mst/mt4103_pci_cr0 q                                                                              

Device #1:
----------

Device type:    ConnectX3Pro    
Device:         /dev/mst/mt4103_pci_cr0

Configurations:                              Next Boot
         SRIOV_EN                            False(0)        
         NUM_OF_VFS                          16              
         WOL_MAGIC_EN_P2                     True(1)         
         LINK_TYPE_P1                        ETH(2)          
         PHY_TYPE_P1                         XFI(2)          
         XFI_MODE_P1                         _40G(2)         
         FORCE_MODE_P1                       False(0)        
         LINK_TYPE_P2                        ETH(2)          
         PHY_TYPE_P2                         XFI(2)          
         XFI_MODE_P2                         _40G(2)         
         FORCE_MODE_P2                       False(0)        
         LOG_BAR_SIZE                        5               
         BOOT_PKEY_P1                        0               
         BOOT_PKEY_P2                        0               
         BOOT_OPTION_ROM_EN_P1               True(1)         
         BOOT_VLAN_EN_P1                     False(0)        
         BOOT_RETRY_CNT_P1                   0               
         LEGACY_BOOT_PROTOCOL_P1             PXE(1)          
         BOOT_VLAN_P1                        1               
         BOOT_OPTION_ROM_EN_P2               True(1)         
         BOOT_VLAN_EN_P2                     False(0)        
         BOOT_RETRY_CNT_P2                   0               
         LEGACY_BOOT_PROTOCOL_P2             PXE(1)          
         BOOT_VLAN_P2                        1               
         IP_VER_P1                           IPv4(0)         
         IP_VER_P2                           IPv4(0)         
         CQ_TIMESTAMP                        True(1)         
         STEER_FORCE_VLAN                    False(0)   

 mlxfwmanager --query
Querying Mellanox devices firmware ...

Device #1:
----------

  Device Type:      ConnectX3Pro
  Part Number:      764285-B21_Ax
  Description:      HP InfiniBand FDR/Ethernet 10Gb/40Gb 2-port 544+FLR-QSFP Adapter
  PSID:             HP_1380110017
  PCI Device Name:  /dev/mst/mt4103_pci_cr0
  Port1 MAC:        
  Port2 MAC:        
  Versions:         Current        Available     
     FW             2.42.5700      N/A           
     CLP            8025           N/A           
     PXE            3.4.0754       N/A           
     UEFI           14.11.0049     N/A           

  Status:           No matching image found
 
  • Like
Reactions: tochnia
T

tochnia

New Member
Mar 5, 2022
15
3
3
Interesting, but with same HP Firmware Version as yours: 2.42.5700 and same settings I still get "Network Cable Unplugged" in Windows 10.
When I reflash card with Mellanox Firmware /which is a bit older: 2.42.5000/ it started working immediately.
HP on their side didn't list Windows 10 as supported OS, so either Windows drivers are not fully supporting HP version of card, or they use some feature in firmware not compatible with Windows 10. As HP firmware showed more options available than Mellanox one.

So here it is combination which worked for me:

mlxfwmanager --query
Querying Mellanox devices firmware ...

Device #1:
----------

Device Type: ConnectX3Pro
Part Number: MCX354A-FCC_Ax
Description: ConnectX-3 Pro VPI adapter card; dual-port QSFP; FDR IB (56Gb/s) and 40GigE;PCIe3.0 x8 8GT/s;RoHS R6
PSID: MT_1090111019
PCI Device Name: mt4103_pci_cr0
Port1 MAC: 9440c9b9fa51
Port2 MAC: 9440c9b9fa52
Versions: Current Available
FW 2.42.5000 N/A
PXE 3.4.0752 N/A

Status: No matching image found


mlxconfig -d /dev/mst/mt4103_pci_cr0 query

Device #1:
----------

Device type: ConnectX3Pro
Device: /dev/mst/mt4103_pci_cr0

Configurations: Next Boot
SRIOV_EN True(1)
NUM_OF_VFS 16
LINK_TYPE_P1 ETH(2)
LINK_TYPE_P2 ETH(2)
LOG_BAR_SIZE 3
BOOT_PKEY_P1 0
BOOT_PKEY_P2 0
BOOT_OPTION_ROM_EN_P1 True(1)
BOOT_VLAN_EN_P1 False(0)
BOOT_RETRY_CNT_P1 0
LEGACY_BOOT_PROTOCOL_P1 PXE(1)
BOOT_VLAN_P1 1
BOOT_OPTION_ROM_EN_P2 True(1)
BOOT_VLAN_EN_P2 False(0)
BOOT_RETRY_CNT_P2 0
LEGACY_BOOT_PROTOCOL_P2 PXE(1)
BOOT_VLAN_P2 1
IP_VER_P1 IPv4(0)
IP_VER_P2 IPv4(0)
CQ_TIMESTAMP True(1)
 
You must log in or register to reply here.
Top Bottom