Mellanox IS5030 Speed Issues: Only DDR?

[vitrag]

i picked them up from the following URL, user Jed Storey has been kind enough to keep them shared from his google drive

Mellanox Interconnect Community

mymellanox.force.com

1. Download latest firmware image. ThisSalesforce is the link they gave me, but it might be temporary. Hereimage-PPC_M405EX-EFM_1.1.3004.img it is on my google drive.
2. Starting from Section 5.1, follow the instructions in “FabricIT Enterprise Fabric Management Software User Manual For EFM Rev 1.1.3004”. (ThisSalesforce is the link they gave me, link FabricIT EFM 1.1.3004 User Manual.pdf on my google drive.). This assumes you can already ssh into the switch. If not, read the Installation Guide (available online) or earlier sections of that User Manual for how to setup the ethernet port.

I would like to figure out how to get licences for my switch to enable all 36 ports, still a bummer there

 

[i386]

Search the forums for ltrace, try it out and report back

 

[vitrag]

Thanks i will try this out using qemu-ppc route

 

[gdv-it]

Hello, sorry for reviving this old Thread.

here are my experiences with the IS5030 Switches.

- Some of them are IBM Rebrands with a 20Gbit limit in the IB-Switch Firmware (not in the FabricIT Management Firmware)
- First i update them to the latest Firmware (image-EFM_PPC_M405EX-ppc-m405ex-20141204-210425)
- You can generate the two Licenes (EFM_CONFIG and PORTS_ENABLE) by yourself with a PPC-Qemu Debian 8 and the files from the latest Firmware. This will unlock the whole 36 Ports and the FabricIT Management Web-Interface. You can enable the integrated SM.
- at this Point, you have a working managed switch with a 20GBit limit on all ports.
- The IB-Switch Firmware is allready located in the Firmware Update File above (fw-IS4-rel-7_4_2360-MIS5030Q_A1-A2.bin)
- It can be flashed with a remote IB-Connected System (for Example a Win10 with WinMFT and WinOF)
- get the LID ID of the Switch, query the IB-Switch Informations with flint:

PS C:\Program Files\Mellanox\WinMFT> flint -d lid-1 q full                                                              Image type:            FS2
FW Version:            7.4.2360
Min FIT Version:       1.0.0.0
MIC Version:           1.5.0
Device ID:             48438
Description:           Node             Sys image
GUIDs:                 0002c902004b3510 0002c902004b3513
VSD:                   n/a
PSID:                  IBM0060000011

- here we can see, the Switch PSID is IBM Rebranded, reflash them to original Mellanox

PS C:\Program Files\Mellanox\WinMFT> flint -d lid-0x0001 -allow_psid_change -i .\fw-IS4-rel-7_4_2360-MIS5030Q_A1-A2.bin b

    Current FW version on flash:  7.4.2360
    New FW version:               7.4.2360

    Note: The new FW version is the same as the current FW version on flash.

 Do you want to continue ? (y/n) [n] : y


    You are about to replace current PSID on flash - "IBM0060000011" with a different PSID - "MT_0D00110012".
    Note: It is highly recommended not to change the PSID.

 Do you want to continue ? (y/n) [n] : y
Burning FS2 FW image without signatures - OK

-W- Failed to update FW boot address. Power cycle the device in order to load the new FW.

Restoring signature                     - OK

- now we have the following query output

PS C:\Program Files\Mellanox\WinMFT> flint -d lid-1 q full
Image type:            FS2
FW Version:            7.4.2360
Min FIT Version:       1.0.0.0
MIC Version:           1.5.0
Device ID:             48438
Description:           Node             Sys image
GUIDs:                 0002c902004b3510 0002c902004b3513
VSD:                   n/a
PSID:                  MT_0D00110012

- reboot the switch
- you should now run at full QDR 40G

 

[mrazu]

Thank You very much for Your effort and the shared guide. I successfully upgraded my IS50XX IBM branded switch to QDR speeds.

In my case I updated the firmware using the web UI of the switch. It took about 45 minutes with uploading.
The image-PPC_M405EX-EFM_1.1.3004.img file can be used directly in the System > FabricIT Upgrade > Install New Image to (non-active) Partition X > Install from local file. The web UI will start showing the progress of the installation after it successfully uploads the img to the switch. Reboot is required after the successful install.

My thanks goes to Tim111 as well for helping me with the licenses in https://forums.servethehome.com/index.php?threads/mellanox-is5030-license-issue.22926/

Firmware switching was done as You suggested using flint tool, It was new to me that it actually can burn firmware to a switch instead of local HCA, thanks for that. I used Ubuntu 20.04.6 LTS for this and I got flint tool from apt-get install mstflint, not from nvidia downloaded tgz - these are sometimes "too new" and are not working with older hardware as I have old ConnectX-2 QDR IB HCAs installed.

So for future reference:
The fw-IS4-rel-7_4_2360-MIS5030Q_A1-A2.bin file, we need to burn to the switch, is located inside the image-PPC_M405EX-EFM_1.1.3004.img file.

unzip image-PPC_M405EX-EFM_1.1.3004.img
tar -zxvf image-EFM_PPC_M405EX-ppc-m405ex-20141204-210425.tgz
ls ./opt/tms/bin/fw-IS4-rel-7_4_2360-MIS5030Q_A1-A2.bin

#see if ib connection to the switch is up with
ibstat
#find lid id of the switch with
dump_fts
#get switch info with
mstflint -d lid-0x0001 q full
#burn original firmware with
mstflint -d lid-0x0001 -allow_psid_change -i ./opt/tms/bin/fw-IS4-rel-7_4_2360-MIS5030Q_A1-A2.bin b
#check whether the switch PSID was updated 
mstflint -d lid-0x0001 q full

Reboot is needed for the new fw to reload.

Thank You again for finding the solution as we can now enjoy our ancient tech to its full potential again

 

[gdv-it]

Ancient but dirt cheap at ~ 50€.

Looked inside and the production quality are very good. Hope they are working another 5-10 Years.

I was suprised too, that you can flash from a client.
Im just wondering if the remote flashable firmware is a massive security hole.