EU Mellanox SX6036 36ports QSFP €150

istamov

New Member
Jul 31, 2015
14
4
3
If this will help anyone, here is what I did to upgrade the switch (mine came with 3.5.1006) to the latest version (3.6.8008).
1) First you should go to Drivers & Software - HPE Support Center. (under tab "Installation Instructions") and check what should be the correct upgrade path according to your initial version.
2) Then on Drivers & Software - HPE Support Center. (under tab "Revision History") you can download the relevant releases and put them on a shared network folder (I guess USB flash drive will also do, but you have to check the manual for that).

Just to be on the safe side, I've decided to go through some more releases, so several hours later my upgrade path was:
3.5.1006 -> 3.6.1002 -> 3.6.2002 -> 3.6.3004 -> 3.6.4006 -> 3.6.5000 -> 3.6.6106 -> 3.6.8008

The commands below are short version of the installation procedure, please read very carefully the HPE instructions from the links above and adjust to your environment:
Code:
Login via SSH:

enable
conf t
image fetch scp://<username>:<password>@192.168.1.1:/tftpboot/MLNX-OS/image-PPC_M460EX-3.6.1002.img
no ib sm
image install image-PPC_M460EX-3.6.1002.img
image boot next
configuration write
reload

enable
conf t
image delete image-PPC_M460EX-3.6.1002.img
image fetch scp://<username>:<password>@192.168.1.1:/tftpboot/MLNX-OS/image-PPC_M460EX-3.6.2002.img
no ib sm
image install image-PPC_M460EX-3.6.2002.img
image boot next
configuration write
reload

enable
conf t
image delete image-PPC_M460EX-3.6.2002.img
image fetch scp://<username>:<password>@192.168.1.1:/tftpboot/MLNX-OS/image-PPC_M460EX-3.6.3004.img
no ib sm
image install image-PPC_M460EX-3.6.3004.img
image boot next
configuration write
reload

enable
conf t
image delete image-PPC_M460EX-3.6.3004.img
image fetch scp://<username>:<password>@192.168.1.1:/tftpboot/MLNX-OS/image-PPC_M460EX-3.6.4006.img
no ib sm
image install image-PPC_M460EX-3.6.4006.img
image boot next
configuration write
reload

enable
conf t
image delete image-PPC_M460EX-3.6.4006.img
image fetch scp://<username>:<password>@192.168.1.1:/tftpboot/MLNX-OS/image-PPC_M460EX-3.6.5000.img
no ib sm
image install image-PPC_M460EX-3.6.5000.img
image boot next
configuration write
reload

enable
conf t
image delete image-PPC_M460EX-3.6.5000.img
image fetch scp://<username>:<password>@192.168.1.1:/tftpboot/MLNX-OS/image-PPC_M460EX-3.6.6106.img
no ib sm
image install image-PPC_M460EX-3.6.6106.img
image boot next
configuration write
reload

enable
conf t
image delete image-PPC_M460EX-3.6.6106.img
image fetch scp://<username>:<password>@192.168.1.1:/tftpboot/MLNX-OS/image-PPC_M460EX-3.6.8008.img
no ib sm
image install image-PPC_M460EX-3.6.8008.img
image boot next
configuration write
reload
Then to convert the switch to ETH:
Code:
### Convert the switch to Ethernet only
configure terminal
license install <your-license-key>
system profile eth-single-switch
 
  • Like
Reactions: TedB and joddlarn

Rand__

Well-Known Member
Mar 6, 2014
4,497
878
113
Is that really necessary? I just dumped the newest file to the box via the webgui (upload image) and upgraded in one step without any issue whatsover on two boxes. Then added license, changed type and was done.

But o/c if it makes you feel better take the long road, just wonder why;)
 

istamov

New Member
Jul 31, 2015
14
4
3
That is what I did on my first switch (just upload the latest version via web GUI) and it was much, much faster :)
It's just that it seems to be running under high CPU load (about 2.5 all the time) and I can't find the reason, so I decided to follow the upgrade procedure for the second one and see if it makes any difference (still 2 more versions to go before finding out if it did help, I will share the results :) ).
 

a.out

New Member
May 3, 2016
17
11
3
54
According to documentation, the shortest supported upgrade is 3.5.1006 -> 3.6.2002 -> 3.6.4006 -> 3.6.5000 -> 3.6.8008 which would save you some time if you choose to take the scenic route (no pun intended). As @Rand_ did it will probably yield the same end result, just that no one bothered to verify it from a Q&A perspective.
 

mkstrom

New Member
Sep 6, 2018
2
1
3
Hello

I recently bought one of these switches and found a slightly newer firmware directly from the Mellanox site. I found it through the Lenovo site, which points to a Mellanox page with OEM Mlnx-OS images for Lenovo/IBM. The reason I'm writing this is that it seems to be a slightly newer image than the HP one listed here, the version is 3.6.8010, vs the HP 3.6.8008. I haven't checked what the differences are but thought I would mention it here.

I used the Lenovo image from Mellanox and did a straight upgrade through the Web-gui without any issues. I haven't been able to test the switch fully, since im missing cables atm, but the switch comes up and reports the correct version atleast.

Image Download. The images are under the Switches tab.

I also had a question regarding the ethernet license. I PM:ed the "license member" from the other thread in Networking a week ago, but haven't recieved an answer yet. He haven't been online for a while. So if someone else have any information regarding the ethernet licensing, feel free to PM me.

Thank you
 

istamov

New Member
Jul 31, 2015
14
4
3
I followed the whole upgrade path, unfortunately it did not help with the CPU load that I am seeing (with no connected ports, only the MGMT process is active):

Code:
switch-xxxxxx [standalone: master] # show version
Product name:      MLNX-OS
Product release:   3.6.8010
Build ID:          #1-dev
Build date:        2018-08-20 18:04:16
Target arch:       ppc
Target hw:         m460ex
Built by:          jenkins@2687ab0dc039
Version summary:   PPC_M460EX 3.6.8010 2018-08-20 18:04:16 ppc

Product model:     ppc
Host ID:           XXXXXXXXXXXX

Uptime:            24m 42.050s
CPU load averages: 3.17 / 4.10 / 3.48
Number of CPUs:    1
System memory:     754 MB used / 1273 MB free / 2027 MB total
Swap:              0 MB used / 0 MB free / 0 MB total
Can somebody else please check what is the CPU load on their switch too (once converted to "eth-single-switch" profile)?

@Rand__ , just wanted to say thanks for this great find, these switches seem to be perfect for a home lab :)
 

Joqur

Member
Feb 22, 2019
42
20
8
I followed the whole upgrade path, unfortunately it did not help with the CPU load that I am seeing (with no connected ports, only the MGMT process is active):

Code:
switch-xxxxxx [standalone: master] # show version
Product name:      MLNX-OS
Product release:   3.6.8010
Build ID:          #1-dev
Build date:        2018-08-20 18:04:16
Target arch:       ppc
Target hw:         m460ex
Built by:          jenkins@2687ab0dc039
Version summary:   PPC_M460EX 3.6.8010 2018-08-20 18:04:16 ppc

Product model:     ppc
Host ID:           XXXXXXXXXXXX

Uptime:            24m 42.050s
CPU load averages: 3.17 / 4.10 / 3.48
Number of CPUs:    1
System memory:     754 MB used / 1273 MB free / 2027 MB total
Swap:              0 MB used / 0 MB free / 0 MB total
Can somebody else please check what is the CPU load on their switch too (once converted to "eth-single-switch" profile)?

@Rand__ , just wanted to say thanks for this great find, these switches seem to be perfect for a home lab :)
I'm going through the upgrade path right now, and I can check this for you.

I run my switch using the VPI profile, but I'll see how it behaves with the eth-single-switch profile
 

Freebsd1976

Active Member
Feb 23, 2018
202
30
28
I followed the whole upgrade path, unfortunately it did not help with the CPU load that I am seeing (with no connected ports, only the MGMT process is active):

Code:
switch-xxxxxx [standalone: master] # show version
Product name:      MLNX-OS
Product release:   3.6.8010
Build ID:          #1-dev
Build date:        2018-08-20 18:04:16
Target arch:       ppc
Target hw:         m460ex
Built by:          jenkins@2687ab0dc039
Version summary:   PPC_M460EX 3.6.8010 2018-08-20 18:04:16 ppc

Product model:     ppc
Host ID:           XXXXXXXXXXXX

Uptime:            24m 42.050s
CPU load averages: 3.17 / 4.10 / 3.48
Number of CPUs:    1
System memory:     754 MB used / 1273 MB free / 2027 MB total
Swap:              0 MB used / 0 MB free / 0 MB total
Can somebody else please check what is the CPU load on their switch too (once converted to "eth-single-switch" profile)?

@Rand__ , just wanted to say thanks for this great find, these switches seem to be perfect for a home lab :)
goto webui see status menu cpu utilization submenu
 

Joqur

Member
Feb 22, 2019
42
20
8
I followed the whole upgrade path, unfortunately it did not help with the CPU load that I am seeing (with no connected ports, only the MGMT process is active):

Code:
switch-xxxxxx [standalone: master] # show version
Product name:      MLNX-OS
Product release:   3.6.8010
Build ID:          #1-dev
Build date:        2018-08-20 18:04:16
Target arch:       ppc
Target hw:         m460ex
Built by:          jenkins@2687ab0dc039
Version summary:   PPC_M460EX 3.6.8010 2018-08-20 18:04:16 ppc

Product model:     ppc
Host ID:           XXXXXXXXXXXX

Uptime:            24m 42.050s
CPU load averages: 3.17 / 4.10 / 3.48
Number of CPUs:    1
System memory:     754 MB used / 1273 MB free / 2027 MB total
Swap:              0 MB used / 0 MB free / 0 MB total
Can somebody else please check what is the CPU load on their switch too (once converted to "eth-single-switch" profile)?

@Rand__ , just wanted to say thanks for this great find, these switches seem to be perfect for a home lab :)
Product name: MLNX-OS

Product release: 3.6.8010

Build ID: #1-dev

Build date: 2018-08-20 18:04:16

Target arch: ppc

Target hw: m460ex

Built by: jenkins@2687ab0dc039

Version summary: PPC_M460EX 3.6.8010 2018-08-20 18:04:16 ppc


Product model: ppc

Host ID:


Uptime: 33m 22.710s

CPU load averages: 2.54 / 2.43 / 2.41

Number of CPUs: 1

System memory: 779 MB used / 1248 MB free / 2027 MB total

Swap: 0 MB used / 0 MB free / 0 MB total
 

hmartin

Active Member
Sep 20, 2017
175
110
43
33
What's the idle power consumption of these things? They look like they're screaming space heaters, but you never know ;)
 

istamov

New Member
Jul 31, 2015
14
4
3
@Joqur, thank you for the confirmation, CPU load seems to be about the same on your device, so it should be normal behaviour.

@hmartin, as others have said, the power consumption is about 40-50 Watts (as reported from the UPS and mostly idle, with 1-2 transceivers connected).
Screen Shot 2019-05-03 at 10.00.36.png
 

Rand__

Well-Known Member
Mar 6, 2014
4,497
878
113
Actually I think the power consumption on these is pretty amazing.
My 6012 currently uses ~40W (onboard based on 12v sensor, so + conversion loss) with 8 active ports the idle load is around 30W or so (note i am using passive cables/DACs).
So basically each port only adds maybe 5W, which makes this one a 200W max box with 36 56GB/s port - show me any other switch that is as efficient...
 
  • Like
Reactions: Bernhard Neuhauser

joddlarn

Member
Jul 14, 2018
42
14
8
Sweden
Today I was trying to run this too :)
Found (couple of hours ago) an easier way:
chroot /{dir-with-unpacked-img}/ qemu-ppc-static /opt/tms/bin/genlicense
A quick follow-up on this. @mkstrom posted a link to the IBM/Lenovo download site. On that page there is a x86_64 version of the software. This can be exctracted too and run without the need of qemu.
 
  • Like
Reactions: JTF195

DDD

New Member
Oct 8, 2013
3
1
3
Germany
Got mine last Thursday but only had time to do a quick check if it is working. Everything seems ok (boots and webui is running) but it is really loud.
Mine has only one PSU installed. Is this the same with the other units?

A quick follow-up on this. @mkstrom posted a link to the IBM/Lenovo download site. On that page there is a x86_64 version of the software. This can be exctracted too and run without the need of qemu.
But what do you do with this tool without the shared secret? Is there a way to extract it from the switch?
 
  • Like
Reactions: JTF195