Mellanox SN2700-CS2F Switch: SSD bad, need installer

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

Cirrusflyer

New Member
Aug 29, 2021
4
0
1
Dear all,
I bought a used Mellanox SN2700-CS2F Switch.

Apparently, the SSD is bad as it does show 0GB when checking in the BIOS & "No boot device found" message also showing up in the CLI.

So I plan now to replace the SSD using the steps described here
Salesforce

mellanox.my.salesforce.com
mellanox.my.salesforce.com

I need the X86_64-3.5.1000-21-installer.bin for a new clean installation (a clone of another (16 port) MLNX Switch did not help as the MAC addresses of the ports differ etc.)

Anybody here who can support us / provide the installer ?

Thank you for your help ;-)
 

mcdaguo

New Member
Jul 2, 2020
9
0
1
Dear all,
I bought a used Mellanox SN2700-CS2F Switch.

Apparently, the SSD is bad as it does show 0GB when checking in the BIOS & "No boot device found" message also showing up in the CLI.

So I plan now to replace the SSD using the steps described here
Salesforce

mellanox.my.salesforce.com
mellanox.my.salesforce.com

I need the X86_64-3.5.1000-21-installer.bin for a new clean installation (a clone of another (16 port) MLNX Switch did not help as the MAC addresses of the ports differ etc.)

Anybody here who can support us / provide the installer ?

Thank you for your help ;-)
I also encountered a similar problem
 

Rand__

Well-Known Member
Mar 6, 2014
6,626
1,767
113
I think many ppl here might be interested in an Onyx installation binary;)
 

vishone

New Member
Oct 16, 2019
12
1
3
Rand__,帖子:351440,成员:2615 said:
我认为这里的许多人可能对 Onyx 安装二进制文件感兴趣;)
[/引用]
嘿,兄弟
你有这个 Onyx 安装二进制文件吗?
 

tr33ks

New Member
Nov 3, 2022
2
5
3
You can clone ssd from another switch with same arch and then adapt hardware config database.
I was able to start SN2410 with ssd cloned from SN2700
 

ITPro44

New Member
Nov 17, 2022
5
3
3
You can clone ssd from another switch with same arch and then adapt hardware config database.
I was able to start SN2410 with ssd cloned from SN2700
We are facing this exact situation. Can you tell me how you adapted the hardware config database? Cheers!
 

tr33ks

New Member
Nov 3, 2022
2
5
3
You need shell access on the switch (you can find how to do this on this forum).
Program that reads and writes to database is mddbreq
First you need to write correct MAC-addresses of management interfaces.
Code:
mddbreq /config/mfg/mfdb set modify - /mfg/mfdb/interface/map/macifname/1/macaddr macaddr802 XX:XX:XX:XX:XX:XX
mddbreq /config/mfg/mfdb set modify - /mfg/mfdb/interface/map/macifname/2/macaddr macaddr802 YY:YY:YY:YY:YY:YY
Then set hostid (MAC-address of mgmt0 without ":")
Code:
mddbreq /config/mfg/mfdb set modify - /mfg/mfdb/system/hostid string XXXXXXXXXXXX
And configuration type
Code:
first check the current value
mddbreq /config/mfg/mfdb query get - /mfg/mfdb/switchx/system/chassis/config/type
        Attrib: value
        Type: string
        Value: MSN2700
then set to correct switch model (2410 in my case)
mddbreq /config/mfg/mfdb set modify - /mfg/mfdb/switchx/system/chassis/config/type string MSN2410
Then reboot a switch and check that management interfaces work.
Now go to switch cli and reapply profile
Code:
enable
conf t
system profile eth-default
Switch will erase config and reboot. Now it should work fine.
I also had to add missing ports to initial config manually (2700 have 32 ports while 2410 have 56, so there were only 32 ports in config), but i believe that reapplying profile fixes that. To add the port you need to add 3 records in initial config (port 33 in example):
Code:
mddbreq /config/db/initial set modify - /portd/config/license/label_port/1/33 uint8 33
mddbreq /config/db/initial set modify - /portd/config/license/label_port/1/33/vpd_license bool true
mddbreq /config/db/initial set modify - /portd/config/license/label_port/1/33/vpd_max_speed uint32 0
I've added all missing ports via bash script.
Also i didn't know how to get to the shell from cli at that moment, so i just connected ssd to a linux pc and mounted partition labeled CONFIG to access database files. I've also unpacked Onyx img file and used mddbreq from there, it was located in /opt/tms/bin
 

NablaSquaredG

Layer 1 Magician
Aug 17, 2020
1,320
800
113
I'd like to add to @tr33ks 's post that there may be additional config keys worth changing:
Code:
Name: /mfg/mfdb/switchx/system/local_mgmt_pn
        Attrib: value
        Type: string
        Value: MSN2100-BB2F

Name: /mfg/mfdb/switchx/system/local_mgmt_sn
        Attrib: value
        Type: string
        Value: MT1234X56789
       
Name: /mfg/mfdb/switchx/system/type
        Attrib: value
        Type: string
        Value: MSN2100B
Another hint:
I got an Mellanox SN2700, but the Cumulus version. I wanted to use MLNX-OS on it, so I took the image from my SN2100 and flashed it to the SN2700 SSD, modified all the db stuff mentioned above and installed the SSD.
But: It did not boot and didn't even let me log in o_O
One hint was the error
Code:
do_IRQ: 0.38 No irq handler for vector
Solution:
The BIOS version was ancient! Switch had BIOS from 03/08/2016 installed (Ver: 0ABZS017_01_01.213)

To update the BIOS, I had to change the grub command line to enable single user mode. For this, you need to mount the BOOTMGR partition, and edit BOOTMGR/boot/grub2/grub.cfg:
First, remove / comment out the
Code:
set superusers="bootmgr"
password_pbkdf2 bootmgr grub.pbkdf2.sha512.10000.6B8FE34BDAE790140A879147E319B2241C5E5717DF927293FD812C74B13A684CB746B669786D6E8C78ACCE86FB002711DFAAD72860C6B268C629B1697AB233EF.D5290E4C6E4B40EAA1398A24AE151114EA1E262E0781AEE09BADCFE82F66DE0AA87EFDB3C712013F1C8B1699A31D43E5C3032B6EFAED8A334CD1E95D8D493685
we always want an unlocked GRUB.
Then, append single to the MLNX-OS cmdline, like
Code:
menuentry 'X86_64 3.10.2102 2022-05-03 02:34:20 x86_64 1' --class os --unrestricted {
        set root=(hd0,4)
        linux /vmlinuz ro root=/dev/sda6   fips=0 img_id=1 crashkernel=128M quiet loglevel=4 panic=10 console=tty0 console=ttyS0,115200n8 fsck.mode=force fsck.repair=yes single
        
}
Reinstall SSD in switch, boot, then do
Code:
/opt/tms/bin/bios_auto_update.sh
It will take one or two minutes

Output should look like
Code:
[admin@localhost root]# /opt/tms/bin/bios_auto_update.sh

bios_ivb.rom: OK
Jan 1 01:02:14     Current BIOS ver: 0ABZS017_01.01.213
Jan 1 01:02:14     BIOS will be updated to ver: 0ABZS017_02.02.004

    BIOS update is being performed.
Please don't reboot or power-off the system.
Jan 1 01:03:14     BIOS /opt/tms/bin/bios_ivb.rom update success
Jan 1 01:03:14     BIOS update success.
You can then reboot with reboot now

Updated BIOS version should be
Code:
BIOS Date: 09/13/2018 12:00:00 Ver: 0ABZS017_02.02.004
And your MLNX-OS should work :)
 
Last edited:
  • Like
Reactions: Rand__ and ano

Marc_

Always a school day
Jul 22, 2022
66
10
8
I've just had the exact same issue with a SN2700-CS2R0S. M.2 has died and now just drops straight to the shell on boot. I've got a copy of ONYX (X86_64-3.10.4006-installer.bin) from some other sn's I upgraded a while back. Following the above is it possible to rebuild from scratch or would I need to clone another SSD?
 

NablaSquaredG

Layer 1 Magician
Aug 17, 2020
1,320
800
113
I've just had the exact same issue with a SN2700-CS2R0S. M.2 has died and now just drops straight to the shell on boot. I've got a copy of ONYX (X86_64-3.10.4006-installer.bin) from some other sn's I upgraded a while back. Following the above is it possible to rebuild from scratch or would I need to clone another SSD?
No need to clone the SSD if you have an installer.

Download https://switchdev.mellanox.com/onie/onie-recovery-x86_64-mlnx_x86-r0.iso and burn to a USB stick. Put this USB stick into the switch, boot the switch, go to BIOS (CTRL+B, password admin), disable CSM(!!!), reboot switch, go to BIOS, boot from USB, Embed ONIE

Once that is done, put the installer X86_64-3.10.4006-installer.bin on a FAT32 formatted USB stick and put that one into the switch. Boot the switch, select "Install OS" in ONIE and wait.


PSA: You might have to change your baudrate to 9600 if you can't enter BIOS. Seems like some old BIOS versions used 9600 instead of 115200.
 
  • Like
Reactions: ano and Marc_

Marc_

Always a school day
Jul 22, 2022
66
10
8
No need to clone the SSD if you have an installer.

Download https://switchdev.mellanox.com/onie/onie-recovery-x86_64-mlnx_x86-r0.iso and burn to a USB stick. Put this USB stick into the switch, boot the switch, go to BIOS (CTRL+B, password admin), disable CSM(!!!), reboot switch, go to BIOS, boot from USB, Embed ONIE

Once that is done, put the installer X86_64-3.10.4006-installer.bin on a FAT32 formatted USB stick and put that one into the switch. Boot the switch, select "Install OS" in ONIE and wait.


PSA: You might have to change your baudrate to 9600 if you can't enter BIOS. Seems like some old BIOS versions used 9600 instead of 115200.
Spot on. Back up and running. Thank you :)