EU Mellanox SX6036 36ports QSFP €150

Discussion in 'Great Deals' started by Rand__, Apr 10, 2019.

  1. istamov

    istamov New Member

    Joined:
    Jul 31, 2015
    Messages:
    14
    Likes Received:
    4
    If this will help anyone, here is what I did to upgrade the switch (mine came with 3.5.1006) to the latest version (3.6.8008).
    1) First you should go to Drivers & Software - HPE Support Center. (under tab "Installation Instructions") and check what should be the correct upgrade path according to your initial version.
    2) Then on Drivers & Software - HPE Support Center. (under tab "Revision History") you can download the relevant releases and put them on a shared network folder (I guess USB flash drive will also do, but you have to check the manual for that).

    Just to be on the safe side, I've decided to go through some more releases, so several hours later my upgrade path was:
    3.5.1006 -> 3.6.1002 -> 3.6.2002 -> 3.6.3004 -> 3.6.4006 -> 3.6.5000 -> 3.6.6106 -> 3.6.8008

    The commands below are short version of the installation procedure, please read very carefully the HPE instructions from the links above and adjust to your environment:
    Code:
    Login via SSH:
    
    enable
    conf t
    image fetch scp://<username>:<password>@192.168.1.1:/tftpboot/MLNX-OS/image-PPC_M460EX-3.6.1002.img
    no ib sm
    image install image-PPC_M460EX-3.6.1002.img
    image boot next
    configuration write
    reload
    
    enable
    conf t
    image delete image-PPC_M460EX-3.6.1002.img
    image fetch scp://<username>:<password>@192.168.1.1:/tftpboot/MLNX-OS/image-PPC_M460EX-3.6.2002.img
    no ib sm
    image install image-PPC_M460EX-3.6.2002.img
    image boot next
    configuration write
    reload
    
    enable
    conf t
    image delete image-PPC_M460EX-3.6.2002.img
    image fetch scp://<username>:<password>@192.168.1.1:/tftpboot/MLNX-OS/image-PPC_M460EX-3.6.3004.img
    no ib sm
    image install image-PPC_M460EX-3.6.3004.img
    image boot next
    configuration write
    reload
    
    enable
    conf t
    image delete image-PPC_M460EX-3.6.3004.img
    image fetch scp://<username>:<password>@192.168.1.1:/tftpboot/MLNX-OS/image-PPC_M460EX-3.6.4006.img
    no ib sm
    image install image-PPC_M460EX-3.6.4006.img
    image boot next
    configuration write
    reload
    
    enable
    conf t
    image delete image-PPC_M460EX-3.6.4006.img
    image fetch scp://<username>:<password>@192.168.1.1:/tftpboot/MLNX-OS/image-PPC_M460EX-3.6.5000.img
    no ib sm
    image install image-PPC_M460EX-3.6.5000.img
    image boot next
    configuration write
    reload
    
    enable
    conf t
    image delete image-PPC_M460EX-3.6.5000.img
    image fetch scp://<username>:<password>@192.168.1.1:/tftpboot/MLNX-OS/image-PPC_M460EX-3.6.6106.img
    no ib sm
    image install image-PPC_M460EX-3.6.6106.img
    image boot next
    configuration write
    reload
    
    enable
    conf t
    image delete image-PPC_M460EX-3.6.6106.img
    image fetch scp://<username>:<password>@192.168.1.1:/tftpboot/MLNX-OS/image-PPC_M460EX-3.6.8008.img
    no ib sm
    image install image-PPC_M460EX-3.6.8008.img
    image boot next
    configuration write
    reload
    Then to convert the switch to ETH:
    Code:
    ### Convert the switch to Ethernet only
    configure terminal
    license install <your-license-key>
    system profile eth-single-switch
     
    #81
    TedB and joddlarn like this.
  2. Rand__

    Rand__ Well-Known Member

    Joined:
    Mar 6, 2014
    Messages:
    3,692
    Likes Received:
    586
    Is that really necessary? I just dumped the newest file to the box via the webgui (upload image) and upgraded in one step without any issue whatsover on two boxes. Then added license, changed type and was done.

    But o/c if it makes you feel better take the long road, just wonder why;)
     
    #82
  3. istamov

    istamov New Member

    Joined:
    Jul 31, 2015
    Messages:
    14
    Likes Received:
    4
    That is what I did on my first switch (just upload the latest version via web GUI) and it was much, much faster :)
    It's just that it seems to be running under high CPU load (about 2.5 all the time) and I can't find the reason, so I decided to follow the upgrade procedure for the second one and see if it makes any difference (still 2 more versions to go before finding out if it did help, I will share the results :) ).
     
    #83
  4. Rand__

    Rand__ Well-Known Member

    Joined:
    Mar 6, 2014
    Messages:
    3,692
    Likes Received:
    586
    well that sounds like a good thing to test, thanks:)
     
    #84
  5. a.out

    a.out New Member

    Joined:
    May 3, 2016
    Messages:
    15
    Likes Received:
    8
    According to documentation, the shortest supported upgrade is 3.5.1006 -> 3.6.2002 -> 3.6.4006 -> 3.6.5000 -> 3.6.8008 which would save you some time if you choose to take the scenic route (no pun intended). As @Rand_ did it will probably yield the same end result, just that no one bothered to verify it from a Q&A perspective.
     
    #85
  6. mkstrom

    mkstrom New Member

    Joined:
    Sep 6, 2018
    Messages:
    2
    Likes Received:
    1
    Hello

    I recently bought one of these switches and found a slightly newer firmware directly from the Mellanox site. I found it through the Lenovo site, which points to a Mellanox page with OEM Mlnx-OS images for Lenovo/IBM. The reason I'm writing this is that it seems to be a slightly newer image than the HP one listed here, the version is 3.6.8010, vs the HP 3.6.8008. I haven't checked what the differences are but thought I would mention it here.

    I used the Lenovo image from Mellanox and did a straight upgrade through the Web-gui without any issues. I haven't been able to test the switch fully, since im missing cables atm, but the switch comes up and reports the correct version atleast.

    Image Download. The images are under the Switches tab.

    I also had a question regarding the ethernet license. I PM:ed the "license member" from the other thread in Networking a week ago, but haven't recieved an answer yet. He haven't been online for a while. So if someone else have any information regarding the ethernet licensing, feel free to PM me.

    Thank you
     
    #86
  7. istamov

    istamov New Member

    Joined:
    Jul 31, 2015
    Messages:
    14
    Likes Received:
    4
    I followed the whole upgrade path, unfortunately it did not help with the CPU load that I am seeing (with no connected ports, only the MGMT process is active):

    Code:
    switch-xxxxxx [standalone: master] # show version
    Product name:      MLNX-OS
    Product release:   3.6.8010
    Build ID:          #1-dev
    Build date:        2018-08-20 18:04:16
    Target arch:       ppc
    Target hw:         m460ex
    Built by:          jenkins@2687ab0dc039
    Version summary:   PPC_M460EX 3.6.8010 2018-08-20 18:04:16 ppc
    
    Product model:     ppc
    Host ID:           XXXXXXXXXXXX
    
    Uptime:            24m 42.050s
    CPU load averages: 3.17 / 4.10 / 3.48
    Number of CPUs:    1
    System memory:     754 MB used / 1273 MB free / 2027 MB total
    Swap:              0 MB used / 0 MB free / 0 MB total
    
    Can somebody else please check what is the CPU load on their switch too (once converted to "eth-single-switch" profile)?

    @Rand__ , just wanted to say thanks for this great find, these switches seem to be perfect for a home lab :)
     
    #87
  8. Joqur

    Joqur New Member

    Joined:
    Feb 22, 2019
    Messages:
    14
    Likes Received:
    4
    I'm going through the upgrade path right now, and I can check this for you.

    I run my switch using the VPI profile, but I'll see how it behaves with the eth-single-switch profile
     
    #88
  9. hlhjedsfg

    hlhjedsfg New Member

    Joined:
    Feb 2, 2018
    Messages:
    21
    Likes Received:
    4
    #89
    joddlarn likes this.
  10. Freebsd1976

    Freebsd1976 Member

    Joined:
    Feb 23, 2018
    Messages:
    100
    Likes Received:
    8
    goto webui see status menu cpu utilization submenu
     
    #90
  11. joddlarn

    joddlarn Member

    Joined:
    Jul 14, 2018
    Messages:
    30
    Likes Received:
    7
    #91
  12. Joqur

    Joqur New Member

    Joined:
    Feb 22, 2019
    Messages:
    14
    Likes Received:
    4
    Product name: MLNX-OS

    Product release: 3.6.8010

    Build ID: #1-dev

    Build date: 2018-08-20 18:04:16

    Target arch: ppc

    Target hw: m460ex

    Built by: jenkins@2687ab0dc039

    Version summary: PPC_M460EX 3.6.8010 2018-08-20 18:04:16 ppc


    Product model: ppc

    Host ID:


    Uptime: 33m 22.710s

    CPU load averages: 2.54 / 2.43 / 2.41

    Number of CPUs: 1

    System memory: 779 MB used / 1248 MB free / 2027 MB total

    Swap: 0 MB used / 0 MB free / 0 MB total
     
    #92
  13. hmartin

    hmartin Active Member

    Joined:
    Sep 20, 2017
    Messages:
    123
    Likes Received:
    83
    What's the idle power consumption of these things? They look like they're screaming space heaters, but you never know ;)
     
    #93
  14. Rand__

    Rand__ Well-Known Member

    Joined:
    Mar 6, 2014
    Messages:
    3,692
    Likes Received:
    586
    #94
  15. Joqur

    Joqur New Member

    Joined:
    Feb 22, 2019
    Messages:
    14
    Likes Received:
    4
    #95
  16. istamov

    istamov New Member

    Joined:
    Jul 31, 2015
    Messages:
    14
    Likes Received:
    4
    @Joqur, thank you for the confirmation, CPU load seems to be about the same on your device, so it should be normal behaviour.

    @hmartin, as others have said, the power consumption is about 40-50 Watts (as reported from the UPS and mostly idle, with 1-2 transceivers connected).
    Screen Shot 2019-05-03 at 10.00.36.png
     
    #96
  17. Rand__

    Rand__ Well-Known Member

    Joined:
    Mar 6, 2014
    Messages:
    3,692
    Likes Received:
    586
    Actually I think the power consumption on these is pretty amazing.
    My 6012 currently uses ~40W (onboard based on 12v sensor, so + conversion loss) with 8 active ports the idle load is around 30W or so (note i am using passive cables/DACs).
    So basically each port only adds maybe 5W, which makes this one a 200W max box with 36 56GB/s port - show me any other switch that is as efficient...
     
    #97
    Bernhard Neuhauser likes this.
  18. joddlarn

    joddlarn Member

    Joined:
    Jul 14, 2018
    Messages:
    30
    Likes Received:
    7
    A quick follow-up on this. @mkstrom posted a link to the IBM/Lenovo download site. On that page there is a x86_64 version of the software. This can be exctracted too and run without the need of qemu.
     
    #98
    JTF195 likes this.
  19. DDD

    DDD New Member

    Joined:
    Oct 8, 2013
    Messages:
    3
    Likes Received:
    1
    Got mine last Thursday but only had time to do a quick check if it is working. Everything seems ok (boots and webui is running) but it is really loud.
    Mine has only one PSU installed. Is this the same with the other units?

    But what do you do with this tool without the shared secret? Is there a way to extract it from the switch?
     
    #99
    JTF195 likes this.
  20. Rand__

    Rand__ Well-Known Member

    Joined:
    Mar 6, 2014
    Messages:
    3,692
    Likes Received:
    586
    Yes this is the one psu model.
    It should be less loud after booting.
     
    #100
Similar Threads: Mellanox SX6036
Forum Title Date
Great Deals HP Branded Mellanox ConnectX-4 100GbE/IB (single port) for $92.95 Dec 21, 2019
Great Deals Mellanox ConnectX-3 on ebay look strange Oct 21, 2019
Great Deals Mellanox ConnectX-3 Pro (HPE) for $49.99 Oct 6, 2019
Great Deals Mellanox QSFP to SFP+ Adapter $10 Oct 1, 2019
Great Deals Mellanox 354A Pro $40 Jul 17, 2019

Share This Page