Hi,
I bought some Oracle labeled CX354A's from ebay (Oracle 7046442) .
Flashed them with the FCBT firmware, everything is working out nice so far.
But I just can't get them to connect with 56G, or even enable the extended link speed.
Device Info:
Showing up as
ibstatus:
ibstat:
I tried to put them into FDR mode via ibportstate, but no whatter what I do, it doesn't work.
Are the card not capable of FDR IB, or am I just using the wrong commands?
I bought some Oracle labeled CX354A's from ebay (Oracle 7046442) .
Flashed them with the FCBT firmware, everything is working out nice so far.
But I just can't get them to connect with 56G, or even enable the extended link speed.
Device Info:
Code:
Device #1:
----------
Device Type: ConnectX3
Part Number: MCX354A-FCB_A2-A5
Description: ConnectX-3 VPI adapter card; dual-port QSFP; FDR IB (56Gb/s) and 40GigE; PCIe3.0 x8 8GT/s; RoHS R6
PSID: MT_1090120019
PCI Device Name: /dev/mst/mt4099_pci_cr1
Port1 GUID: 0010e00001759be1
Port2 GUID: 0010e00001759be2
Versions: Current Available
FW 2.42.5000 N/A
Status: No matching image found
Device #2:
----------
Device Type: ConnectX3
Part Number: MCX354A-FCB_A2-A5
Description: ConnectX-3 VPI adapter card; dual-port QSFP; FDR IB (56Gb/s) and 40GigE; PCIe3.0 x8 8GT/s; RoHS R6
PSID: MT_1090120019
PCI Device Name: /dev/mst/mt4099_pci_cr0
Port1 GUID: 0010e00001789fa1
Port2 GUID: 0010e00001789fa2
Versions: Current Available
FW 2.42.5000 N/A
Status: No matching image found
43:00.0 Network controller: Mellanox Technologies MT27500 Family [ConnectX-3]
ibstatus:
Code:
Infiniband device 'mlx4_0' port 1 status:
default gid: fe80:0000:0000:0000:0010:e000:0178:9fa1
base lid: 0x1
sm lid: 0x1
state: 4: ACTIVE
phys state: 5: LinkUp
rate: 40 Gb/sec (4X QDR)
link_layer: InfiniBand
Infiniband device 'mlx4_0' port 2 status:
default gid: fe80:0000:0000:0000:0010:e000:0178:9fa2
base lid: 0x0
sm lid: 0x0
state: 1: DOWN
phys state: 2: Polling
rate: 10 Gb/sec (4X)
link_layer: InfiniBand
Infiniband device 'mlx4_1' port 1 status:
default gid: fe80:0000:0000:0000:0010:e000:0175:9be1
base lid: 0x2
sm lid: 0x1
state: 4: ACTIVE
phys state: 5: LinkUp
rate: 40 Gb/sec (4X QDR)
link_layer: InfiniBand
Infiniband device 'mlx4_1' port 2 status:
default gid: fe80:0000:0000:0000:0010:e000:0175:9be2
base lid: 0x0
sm lid: 0x0
state: 1: DOWN
phys state: 2: Polling
rate: 10 Gb/sec (4X)
link_layer: InfiniBand
Code:
CA 'mlx4_0'
CA type: MT4099
Number of ports: 2
Firmware version: 2.42.5000
Hardware version: 1
Node GUID: 0x0010e00001789fa0
System image GUID: 0x0010e00001789fa3
Port 1:
State: Active
Physical state: LinkUp
Rate: 40
Base lid: 1
LMC: 0
SM lid: 1
Capability mask: 0x0251486a
Port GUID: 0x0010e00001789fa1
Link layer: InfiniBand
Port 2:
State: Down
Physical state: Polling
Rate: 10
Base lid: 0
LMC: 0
SM lid: 0
Capability mask: 0x02514868
Port GUID: 0x0010e00001789fa2
Link layer: InfiniBand
CA 'mlx4_1'
CA type: MT4099
Number of ports: 2
Firmware version: 2.42.5000
Hardware version: 1
Node GUID: 0x0010e00001759be0
System image GUID: 0x0010e00001759be3
Port 1:
State: Active
Physical state: LinkUp
Rate: 40
Base lid: 2
LMC: 0
SM lid: 1
Capability mask: 0x02514868
Port GUID: 0x0010e00001759be1
Link layer: InfiniBand
Port 2:
State: Down
Physical state: Polling
Rate: 10
Base lid: 0
LMC: 0
SM lid: 0
Capability mask: 0x02514868
Port GUID: 0x0010e00001759be2
Link layer: InfiniBand
Code:
CA/RT PortInfo:
# Port info: Lid 1 port 1
LinkState:.......................Active
PhysLinkState:...................LinkUp
Lid:.............................1
SMLid:...........................1
LMC:.............................0
LinkWidthSupported:..............1X or 4X
LinkWidthEnabled:................4X
LinkWidthActive:.................4X
LinkSpeedSupported:..............2.5 Gbps or 5.0 Gbps or 10.0 Gbps
LinkSpeedEnabled:................2.5 Gbps or 5.0 Gbps or 10.0 Gbps
LinkSpeedActive:.................10.0 Gbps
LinkSpeedExtSupported:...........14.0625 Gbps
LinkSpeedExtEnabled:.............0
LinkSpeedExtActive:..............No Extended Speed
Mkey:............................<not displayed>
MkeyLeasePeriod:.................0
ProtectBits:.....................0
# MLNX ext Port info: Lid 1 port 1
StateChangeEnable:...............0x00
LinkSpeedSupported:..............0x01
LinkSpeedEnabled:................0x00
LinkSpeedActive:.................0x00
Are the card not capable of FDR IB, or am I just using the wrong commands?