HP 649281-B21 ConnectX-3 VPI MCX354A-FCBT $25 shipped Ebay

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.
K

kapone

Well-Known Member
May 23, 2015
1,095
642
113
I think these are CX2 not CX3...

Edit: Nope...looks like CX3 after all.
 
  • Like
Reactions: tjk
tjk

tjk

Active Member
Mar 3, 2013
481
199
43
LOL! STH traffic to listing caused a $5 per card increase, and BO's at $29 for qty of 10 or higher being rejected.
 
tjk

tjk

Active Member
Mar 3, 2013
481
199
43
Other sellers are accepting $25 BO on qty 5 or more, just FYI.
 
e97

e97

Active Member
Jun 3, 2015
324
194
43
Picked up two on BO @ $20
HP 656089-001 Infiband 4 X 10/40GB DP adapter 544QSFP
ebay DOT com/itm/282289568253

Not sure the revision, will let you know when I get them!


Firmware:

Mellanox: 2_42_5000 07-Sep-17

mellanox DOT com/page/firmware_table_ConnectX3IB

HP: 2.42.5000(22 Feb 2018)

LINUX:
support.hpe DOT com/hpsc/swd/public/detail?sp4ts.oid=6947977&swItemId=MTX_6c3269847a3f4623b1ef56f5f5&swEnvOid=4184

WIN:
support.hpe DOT com/hpsc/swd/public/detail?sp4ts.oid=6947977&swItemId=MTX_3de2dd123a304e08ba8f042e4d&swEnvOid=4184



Tools:

Mellanox 4.10.0

mellanox DOT com/page/management_tools

HP: 4.10.0-104(13 Aug 2018)

LINUX:
support.hpe DOT com/hpsc/swd/public/detail?sp4ts.oid=6947977&swItemId=MTX_883ca9d263284d58bbdf020cbb&swEnvOid=4184#tab5

WIN:
support.hpe DOT com/hpsc/swd/public/detail?sp4ts.oid=6947977&swItemId=MTX_8ae9cf0d4b664a9c98ff43fb96&swEnvOid=4184

Still working out an updated flashing procedure
 
Last edited:
zxv

zxv

The more I C, the less I see.
Sep 10, 2017
156
57
28
To flash firmware on Ubuntu 18.04:

Install the firmware update tool.
apt-get install -y mstflint

Get the PCI address of the mellanox card.
lspci|grep -i Mellanox
83:00.0 Network controller: Mellanox Technologies MT27500 Family [ConnectX-3]

Save the PCI address.
ADDR=$(lspci|grep -i Mellanox|cut -d' ' -f1)

Query the hardware version and current firmware.
mstflint -d ${ADDR} query full
Image type: FS2
FW Version: 2.42.5000
FW Release Date: 5.9.2017
MIC Version: 2.0.0
Config Sectors: 1
PRS Name: cx3-1_MCX354A_fdr_09v.prs
Product Version: 02.42.50.00
Rom Info: type=PXE version=3.4.752
Device ID: 4099
Description: Node Port1 Port2 Sys image
GUIDs: 0010e00001434530 0010e00001434531 0010e00001434532 0010e00001434533
MACs: 0010e0434531 0010e0434532
VSD: n/a
PSID: MT_1090120019

Use the model and PSID to identify firmware and download from melanox.
http://www.mellanox.com/page/software_overview_eth

Flash the firmware.
FIRMWARE=fw-ConnectX3-rel-2_42_5000-MCX354A-FCB_A2-A5-FlexBoot-3.4.752.bin
mstflint -d ${ADDR} -i ${FIRMWARE} b
 
  • Like
Reactions: MikeWebb, gigatexal and e97
D

Dave Corder

Active Member
Dec 21, 2015
296
192
43
41
e97 said:
Picked up two on BO @ $20
HP 656089-001 Infiband 4 X 10/40GB DP adapter 544QSFP
ebay DOT com/itm/282289568253

Not sure the revision, will let you know when I get them!
Click to expand...
What the hell, why not? Seller just accepted my offer of $20 each for 2.
 
e97

e97

Active Member
Jun 3, 2015
324
194
43
Not sure if the .bin generation from .mlx and .ini is necessary anymore or if the downloads are flash-able directly

How to back-up firmware before making any changes:

  1. Download and install MFT

  2. Command: mst start

  3. Figure out your device. There will be two. a pci_crX and a pciconfX or something like that. You want to use the crX device unless otherwise noted. Use whole path, e.g. /dev/mst/mt26428_pci_cr0.
    Command: mst status

  4. Save basic info such as GUIDs, MACs, etc.:
    Command: flint -d (device) query full > flint_query.txt

  5. Save low-level flash chip info:
    Command: flint -d (device) hw query > flint_hwinfo.txt

  6. Save existing firmware. This is very helpful if you have card that works with your system and some that do not:
    Command: flint -d (device) ri orig_firmware.bin

  7. Save existing FW configuration:
    Command: flint -d (device) dc orig_firmware.ini

  8. Save existing PXE ROM image (if any- mine didn't have this):
    Command: flint -d (device) rrom orig_rom.bin

  9. Save existing PCI VPD (vital product data):
    Command: mlxburn -d (device pciconfX) -vpd > orig_vpd.txt

  10. Now things are a little different. The link 3 guide shows you how to burn your own .bin from a mlx and ini file. The mlx is a multi-adapter file. You have to create a .bin file specific for your adapter. The mlx files used to be available, but now only specific bin files are available. However, if you do manage to obtain a mlx, then you also need to obtain the ini file corresponding to your specific adapter and burn the .bin.
    Example command: mlxburn -fw fw-ConnectX3-rel.mlx -conf MCX312A-XCB_A2-A6.ini -wrimage mlnx_firmware.bin

  11. Once you have the .bin, then you need to verify it (bootable, all pass):
    Command: flint -i mlnx_firmware.bin verify

  12. Then you need to double check the firmware version and PSID.
    Command: flint -i mlnx_firmware.bin query full

  13. Finally, burn the new firmware image. If you are flashing an identical card that has a different PSID, e.g. flashing a Mellanox card that has been rebranded as HP with Mellanox firmware, then you need the -allow_psid_change flag. Otherwise, you do not need it.
    Command: flint -d (device) -i mlnx_firmware.bin -allow_psid_change burn

  14. Reboot and run the query full command again to make sure the flash worked. Also verify that the PSID has changed if you were cross-brand flashing.

    source: Rocket Science: Flashing Rebranded Mellanox Infiniband Cards and Homelab Infiniband Part 2
Click to expand...
 
Last edited:
svtkobra7

svtkobra7

Active Member
Jan 2, 2017
362
88
28
fohdeesha said:
can confirm, you can flash the latest mellanox 40gbE firmware directly to them (works on either QCBT rev a2 and up or any rev FCBT) https://forums.servethehome.com/ind...net-dual-port-qsfp-adapter.20525/#post-198015
Click to expand...
Any confirm if this work with ESXi 6.7U1 (and possibly pass through to FreeNAS - I know Chelsio is the FreeNAS "preferred" card)? I don't see it on the HCL. Bought a ICX 6450-24 today and planned on using the integrated X540-AT2 + Mikrotik S+RJ10, but think 2 of these (1 per ESXi Host) + 2 x DAC may be a better play.

source: VMware Compatibility Guide - I/O Device Search | VMware ESXi 6.7 - IO Devices not certified for upgrade
 
You must log in or register to reply here.
Top Bottom