Mellanox Switches - Tips & Tricks

[cy384]

Is the dual core 1.4G Celeron powerful to handle 3Gbit WAN?

Anything that needs packets to get passed to the CPU is going to be limited, the one in the SN2010 is roughly comparable to a Raspberry Pi 4. 3Gb/s for common home NAT and iptables firewall type stuff might be too much, but I haven't tested workloads like that. I'm planning to use it for basic switching, internal routing, messing with VXLANs, PTP, things like that which are fully hardware accelerated on these devices.

Long term, I'm leaning towards Debian (like this), since it's what I use most.

 

[MgDuke]

I can confirm I could boot & backup SN2100 switch with Clonezilla by both ONIE and PXE (Legacy).

Compatible ISO: http://free.nchc.org.tw/clonezilla-live/stable/clonezilla-live-3.2.2-15-amd64.iso

PXE config (unpack ISO, extract 3 files vmlinuz, initrd.img, filesystem.squashfs and adjust your path's):

label Clonezilla-live-serial
    MENU LABEL Clonezilla (serial console)
    KERNEL clonezilla/2/vmlinuz
    APPEND initrd=clonezilla/2/initrd.img boot=live nopersistent noeject dhcp fetch=tftp://192.168.1.10/clonezilla/2/filesystem.squashfs live-media=ram ocs_live_run=ocs-live-general live-getty  console=ttyS0,115200n8

With ONIE (Enter Restore):
onie-nos-install http://free.nchc.org.tw/clonezilla-live/onie/clonezilla-live-3.2.2-15-amd64.iso-onie.bin

Credits to Steven Shiau (clonezilla author)

 

[NablaSquaredG]

so I think everything you can do in Onyx is doable without it (though probably less convenient).

Absolutely not.

The public Mellanox switchdev driver has lots of features, but especially QoS / buffer allocation stuff for RoCE

You can find release notes here: Home

What if I told you that with the Mellanox internal SDK, those switches could even do MPLS?

 

[up3up4]

Absolutely not.

The public Mellanox switchdev driver has lots of features, but especially QoS / buffer allocation stuff for RoCE

You can find release notes here: Home

What if I told you that with the Mellanox internal SDK, those switches could even do MPLS?

Can those qsfp ports be split into 4 10Gb in openwrt?

 

[NablaSquaredG]

@nasbdh9 do you know how to write to Mellanox SN2700 fan & PSU EEPROMs via I²C from Cumulus Linux? I need to mod some fan / PSUs PSIDs

I did it via Onyx and mellaggra in the past, but I don't want to install Onyx just for that

cumulus@cumulus:mgmt:~$ cat test.bin | sudo tee /sys/bus/i2c/devices/11-0050/eeprom
tee: /sys/bus/i2c/devices/11-0050/eeprom: Permission denied

hmm. Any idea how to disable write protect or whatever that is?

 

[nasbdh9]

@nasbdh9 do you know how to write to Mellanox SN2700 fan & PSU EEPROMs via I²C from Cumulus Linux? I need to mod some fan / PSUs PSIDs

I did it via Onyx and mellaggra in the past, but I don't want to install Onyx just for that

cumulus@cumulus:mgmt:~$ cat test.bin | sudo tee /sys/bus/i2c/devices/11-0050/eeprom
tee: /sys/bus/i2c/devices/11-0050/eeprom: Permission denied

hmm. Any idea how to disable write protect or whatever that is?

Haven't tried changing these on Cumulus Linux,
but you can try chang in onie.

 

[NablaSquaredG]

but you can try chang in onie.

Not ONIE / System EEPROM

I mean EEPROM in the fan modules / power supplies

 

[MgDuke]

Here is a single archive containing all the Innodisk SSD firmwares and their corresponding application scripts.

https://drive.google.com/file/d/1HJWb7mgRYuqL8mbjcgbkqld9zzOEIeyt/view?usp=share_link

Be careful, don't run scripts blindly.