Anyone flashing Mellanox ConnectX-3 in qty?

Discussion in 'Networking' started by Biren78, Aug 27, 2017.

  1. Biren78

    Biren78 Active Member

    Joined:
    Jan 16, 2013
    Messages:
    550
    Likes Received:
    94
    Anyone here have a box or two that they've used for flash Mellanox ConnectX-3 from HP or IBM to stock? I'm finding myself about to do a dozen. Tooling seems like I'd have an easier time using Windows instead of Linux.

    Can anyone give me some pointers on a flash box? I'd also like to hear if there's any issue with the motherboard like we all had at some time with flashing LSI cards.
     
    #1
    Kat likes this.
  2. darkconz

    darkconz Member

    Joined:
    Jun 6, 2013
    Messages:
    179
    Likes Received:
    13
    I've flashed it in consumer Asus, Gigabyte boards and on SuperMicro/Intel boards. All worked and all were done in Windows Trial versions


    Sent from my iPhone using Tapatalk
     
    #2
  3. Marsh

    Marsh Moderator

    Joined:
    May 12, 2013
    Messages:
    1,954
    Likes Received:
    889
    I flashed 20 HP CX3 cards use these instructions

    Put these lines in a batch file

    Do these two lines once to create mlnx_firmware.bin
    mlxburn -fw fw-ConnectX3-rel.mlx -conf MCX354A-FCB_A2-A5.ini -wrimage HP_mlnx_firmware.bin
    mlxburn -fw fw-ConnectX3-rel.mlx -conf MCX354A-FCB_A2-A5.ini -wrimage fw-ConnectX3-rel-2_31_5050-MCX354A-FCB_A2-A5-56GbE_VPI.bin

    echo Cross Flash HP card to use Mellanox CX3 firmware
    pause

    call flint -i HP_mlnx_firmware.bin verify
    call flint -i HP_mlnx_firmware.bin query full

    pause
    call flint -d mt4099_pciconf0 -i HP_mlnx_firmware.bin -allow_psid_change burn

    pause

    You need to download and install WinMFT_x64_4_5_0_31.exe
    You also need ConnectX3-rel-2_40_5000.tgz ( this is the version I used )
    latter version is ConnectX3-rel-2_40_5030.tgz ( dated March 2017 )
     
    #3
    WeekendWarrior and abq like this.
  4. Marsh

    Marsh Moderator

    Joined:
    May 12, 2013
    Messages:
    1,954
    Likes Received:
    889
  5. Marsh

    Marsh Moderator

    Joined:
    May 12, 2013
    Messages:
    1,954
    Likes Received:
    889
    Check-CX3.bat

    set DEV= mt4099_pciconf0
    set LOGFILE=cx3.txt

    mst status
    call "C:\Program Files\Mellanox\WinMFT\flint" -d mt4099_pciconf0 query > %LOGFILE%
    REM call "C:\Program Files\Mellanox\WinMFT\flint" -d mt4099_pci_cr0 query > %LOGFILE%

    ibv_devinfo >> %LOGFILE%
    ibv_devinfo
    vstat >> %LOGFILE%
    vstat

    iblinkinfo >> %LOGFILE%
    iblinkinfo

    mlxconfig -d mt4099_pciconf0 query
    mlxconfig -d mt4099_pciconf0 query >> %LOGFILE%

    pause
     
    #5
  6. labo

    labo New Member

    Joined:
    Jan 21, 2015
    Messages:
    6
    Likes Received:
    0
    Hello, can anyone post the INI file for the mod from QCBT to FCBT?
    fw fw-ConnectX3-rel.mlx -conf MCX354A-FCB_A2-A5.ini
    Thanks
     
    #6
  7. Marsh

    Marsh Moderator

    Joined:
    May 12, 2013
    Messages:
    1,954
    Likes Received:
    889
    edit the ini file and add the following lines under the [IB] section:

    port1_802_3ap_56kr4_enable = true

    port1_802_3ap_56kr4_ability = true

    port2_802_3ap_56kr4_enable = true

    port2_802_3ap_56kr4_ability = true
     
    #7
  8. labo

    labo New Member

    Joined:
    Jan 21, 2015
    Messages:
    6
    Likes Received:
    0
    Ok, thanks. But I see these already in my ini file.
    This is what I want to do. I have cx3 mcx354A-qcbt and want to convert into cx3 mcx354A-fcbt.
    So I can do 40GBe/56Gb Ethernet. Please help with directions. thanks in advance.
     
    #8
  9. labo

    labo New Member

    Joined:
    Jan 21, 2015
    Messages:
    6
    Likes Received:
    0
    BTW, I flashed the latest MCX354A-FCB_A2-A5 firmware but the adapter still says qcbt instead of fcbt.
     
    #9
  10. i386

    i386 Well-Known Member

    Joined:
    Mar 18, 2016
    Messages:
    1,533
    Likes Received:
    355
    When you burn the firmware you have to use the paramter for changing the psid.
     
    #10
  11. labo

    labo New Member

    Joined:
    Jan 21, 2015
    Messages:
    6
    Likes Received:
    0
    OK, thats the part I'm missing.
    But I'm not seeing any examples, anywhere. Only thing I see is option --allow_psid_change
    which I have used it while burning. Is there anything else needed?
     
    #11
  12. i386

    i386 Well-Known Member

    Joined:
    Mar 18, 2016
    Messages:
    1,533
    Likes Received:
    355
    The "allow_psid_change" parameter should do the trick.
    Can you post the complete command you used to burn the firmware?
     
    #12
  13. Biren78

    Biren78 Active Member

    Joined:
    Jan 16, 2013
    Messages:
    550
    Likes Received:
    94
    This should be a guide in the resources section
     
    #13
  14. edrozenberg

    edrozenberg New Member

    Joined:
    Nov 26, 2017
    Messages:
    4
    Likes Received:
    0
    You're probably done by now :)

    If by box you mean a PC for flashing cards, I'm personally looking at one of these for future flashing:
    Supermicro | Products | SuperServers | Mini 1U | E300-8D
    Supermicro | Products | SuperServers | Mini 1U | E300-9A

    Only takes 1 PCIe card at a time, so requires power shutdown and boot for each card. Low-profile cards only (not full height cards). Many cards are low profile and come with a low profile bracket. Some cards are still full height though (such as a number of LSI SAS cards).
     
    #14

Share This Page