Mellanox 312B flash and connection issue

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

siosios

New Member
Oct 25, 2023
2
0
1
Hi all,

I have a question, I bought a few CX312B’s from from eBay and I’m having an issue with just one of them. Would the EDC number not matching between the sticker on the card and what’s shown in console with -vpd cause the card not to pick up a carrier signal? Or am I just making a noob mistake using the wrong flash? I have tried 2 different HP flash files and 2 nvidia flash files and can’t get the card online. Any help would be appreciated to point me in the right direction.


PCIe 10GbE x8 6W
V2 N/A 5720
V4 N/A 9CDC715D0990
V5 N/A 0C
VA N/A HP:V2=MFG:V3=FW_VER:V4=MAC:V5=PCAR
VB N/A HP ConnectX-3Pro SFP+
RV Checksum Complement 0x91
IDTAG Board Id HP Ethernet 10G 2-port 546SFP+ Adapter

Image type: FS2
FW Version: 2.42.5044
FW Release Date: 21.10.2018
Product Version: 02.42.50.44
Rom Info: version_id=8025 type=CLP
type=UEFI version=14.11.48 cpu=AMD64
type=PXE version=3.4.754
Device ID: 4103
Description: Node Port1 Port2 Sys image
GUIDs: ffffffffffffffff ffffffffffffffff ffffffffffffffff ffffffffffffffff
MACs: 9cdc715d0990 9cdc715d0991
VSD:
PSID: HP_2240110004

MST devices:
------------
/dev/mst/mt4103_pciconf0 - PCI configuration cycles access.
domain:bus:dev.fn=0000:04:00.0 addr.reg=88 data.reg=92 cr_bar.gw_offset=-1
Chip revision is: 00
/dev/mst/mt4103_pci_cr0 - PCI direct access.
domain:bus:dev.fn=0000:04:00.0 bar=0x93c00000 size=0x100000
Chip revision is: 00

Configurations: Next Boot
SRIOV_EN True(1)
NUM_OF_VFS 16
PHY_TYPE_P1 XFI(2)
XFI_MODE_P1 _10G(0)
FORCE_MODE_P1 False(0)
PHY_TYPE_P2 XFI(2)
XFI_MODE_P2 _10G(0)
FORCE_MODE_P2 False(0)
LOG_BAR_SIZE 5
BOOT_OPTION_ROM_EN_P1 False(0)
BOOT_VLAN_EN_P1 False(0)
BOOT_RETRY_CNT_P1 0
LEGACY_BOOT_PROTOCOL_P1 None(0)
BOOT_VLAN_P1 1
BOOT_OPTION_ROM_EN_P2 False(0)
BOOT_VLAN_EN_P2 False(0)
BOOT_RETRY_CNT_P2 0
LEGACY_BOOT_PROTOCOL_P2 None(0)
BOOT_VLAN_P2 1
IP_VER_P1 IPv4_IPv6(2)
IP_VER_P2 IPv4_IPv6(2)
CQ_TIMESTAMP True(1)
STEER_FORCE_VLAN False(0)

[ 1.272181] mlx4_core: Mellanox ConnectX core driver v4.0-0
[ 1.272204] mlx4_core: Initializing 0000:04:00.0
[ 7.571319] mlx4_core 0000:04:00.0: DMFS high rate steer mode is: disabled performance optimized steering
[ 7.571632] mlx4_core 0000:04:00.0: 63.008 Gb/s available PCIe bandwidth (8.0 GT/s PCIe x8 link)
[ 7.852939] mlx4_en: Mellanox ConnectX HCA Ethernet driver v4.0-0
[ 7.853090] mlx4_en 0000:04:00.0: Activating port:1
[ 7.857318] mlx4_en: 0000:04:00.0: Port 1: Using 32 TX rings
[ 7.857322] mlx4_en: 0000:04:00.0: Port 1: Using 16 RX rings
[ 7.857568] mlx4_en: 0000:04:00.0: Port 1: Initializing port
[ 7.857904] mlx4_en 0000:04:00.0: registered PHC clock
[ 7.858341] mlx4_core 0000:04:00.0: Unsupported cable detected
[ 7.858485] mlx4_en 0000:04:00.0: Activating port:2
[ 7.859696] mlx4_core 0000:04:00.0 enp4s0: renamed from eth0
[ 7.861023] mlx4_en: 0000:04:00.0: Port 2: Using 32 TX rings
[ 7.861026] mlx4_en: 0000:04:00.0: Port 2: Using 16 RX rings
[ 7.861227] mlx4_en: 0000:04:00.0: Port 2: Initializing port
[ 7.900174] mlx4_core 0000:04:00.0 enp4s0d1: renamed from eth0
[ 7.911562] <mlx4_ib> mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v4.0-0
[ 7.912285] <mlx4_ib> mlx4_ib_add: counter index 2 for port 1 allocated 1
[ 7.912287] <mlx4_ib> mlx4_ib_add: counter index 3 for port 2 allocated 1
[ 17.819420] mlx4_en: enp4s0: Steering Mode 1
[ 17.850679] mlx4_en: enp4s0: Link Down
[ 17.883962] mlx4_en: enp4s0d1: Steering Mode 1
[ 17.914409] mlx4_en: enp4s0d1: Link Down
Querying Mellanox devices firmware ...

Device #1:
----------

Device Type: ConnectX3Pro
Part Number: 779799-B21_Ax
Description: HP Ethernet 10G 2-port 546FLR-SFP+ Adapter
PSID: HP_2240110004
PCI Device Name: /dev/mst/mt4103_pci_cr0
Port1 MAC: 9cdc715d0990
Port2 MAC: 9cdc715d0991
Versions: Current Available
FW 2.42.5044 2.42.5044
CLP 8025 8025
PXE 3.4.0754 3.4.0754
UEFI 14.11.0048 14.11.0048

Status: Up to date
 

Attachments

Last edited:

siosios

New Member
Oct 25, 2023
2
0
1
ok so i did a custom firmware with the ini from one of the other working cards

Code:
mlxburn -fw fw-ConnectX3Pro-rel.mlx -conf orig_firmware.ini -wrimage fw-ConnectX3-pro-4103.2_40_5030.bin
Code:
root@sys:~/Downloads# ./verify
PSID:                  HP_1200111023
PSID:                  HP_1200111023
Image type:            FS2
FW Version:            2.40.5030
FW Release Date:       4.1.2017
MIC Version:           2.0.0
Config Sectors:        2
PRS Name:              cx3pro_hp_MCX312B_4mb.prs
Device ID:             4103
Description:           Node             Port1            Port2            Sys image
GUIDs:                 0002c9000100d050 0002c9000100d051 0002c9000100d052 0002c9000100d050
MACs:                                       0002c9000001     0002c9000002
VSD:                   n/a
PSID:                  HP_1200111023

     FS2 failsafe image. Start address: 0x0. Chunk size 0x80000:

     NOTE: The addresses below are contiguous logical addresses. Physical addresses on
           flash may be different, based on the image start address and chunk size

     /0x00000038-0x0000065b (0x000624)/ (BOOT2) - OK
     /0x0000065c-0x00002bcf (0x002574)/ (BOOT2) - OK
     /0x00002bd0-0x00003b73 (0x000fa4)/ (Configuration) - OK
     /0x00003b74-0x00003bb7 (0x000044)/ (GUID) - OK
     /0x00003bb8-0x00003d2f (0x000178)/ (Image Info) - OK
     /0x00003d30-0x00011183 (0x00d454)/ (DDR) - OK
     /0x00011184-0x000121e7 (0x001064)/ (DDR) - OK
     /0x000121e8-0x000125b7 (0x0003d0)/ (DDR) - OK
     /0x000125b8-0x00050587 (0x03dfd0)/ (DDR) - OK
     /0x00050588-0x0005540b (0x004e84)/ (DDR) - OK
     /0x0005540c-0x0005984f (0x004444)/ (DDR) - OK
     /0x00059850-0x0005a347 (0x000af8)/ (DDR) - OK
     /0x0005a348-0x00089aeb (0x02f7a4)/ (DDR) - OK
     /0x00089aec-0x0008d697 (0x003bac)/ (DDR) - OK
     /0x0008d698-0x000a298b (0x0152f4)/ (DDR) - OK
     /0x000a298c-0x000a2a93 (0x000108)/ (DDR) - OK
     /0x000a2a94-0x000a77e7 (0x004d54)/ (DDR) - OK
     /0x000a77e8-0x000a8fe3 (0x0017fc)/ (Configuration) - OK
     /0x000a8fe4-0x000a9057 (0x000074)/ (Jump addresses) - OK
     /0x000a9058-0x000a985f (0x000808)/ (FW Configuration) - OK
     /0x00000000-0x000a985f (0x0a9860)/ (Full Image) - OK

-I- FW image verification succeeded. Image is bootable.
Code:
flint -d /dev/mst/mt4103_pciconf0 -i fw-ConnectX3-pro-4103.2_40_5030.bin -allow_psid_change burn
Code:
hca_id: mlx4_0
        transport:                      InfiniBand (0)
        fw_ver:                         2.40.5030
        node_guid:                      9cdc:7103:005d:0990
        sys_image_guid:                 9cdc:7103:005d:0990
        vendor_id:                      0x02c9
        vendor_part_id:                 4103
        hw_ver:                         0x0
        board_id:                       HP_1200111023
        phys_port_cnt:                  2
                port:   1
                        state:                  PORT_DOWN (1)
                        max_mtu:                4096 (5)
                        active_mtu:             1024 (3)
                        sm_lid:                 0
                        port_lid:               0
                        port_lmc:               0x00
                        link_layer:             Ethernet

                port:   2
                        state:                  PORT_DOWN (1)
                        max_mtu:                4096 (5)
                        active_mtu:             1024 (3)
                        sm_lid:                 0
                        port_lid:               0
                        port_lmc:               0x00
                        link_layer:             Ethernet
Code:
root@sys:~/Downloads# flint -d /dev/mst/mt4103_pciconf0 q
Image type:            FS2
FW Version:            2.40.5030
FW Release Date:       4.1.2017
Device ID:             4103
Description:           Node             Port1            Port2            Sys image
GUIDs:                 ffffffffffffffff ffffffffffffffff ffffffffffffffff ffffffffffffffff
MACs:                                       9cdc715d0990     9cdc715d0991
VSD:                  
PSID:                  HP_1200111023
found this post with a similar issue

still cant get the ports to come online. i guess its just a bad card that needs tossed in the trash.
 
Last edited: