Beware of EMC switches sold as Mellanox SX6XXX on eBay

[longtongue]

Greetings again
I was able to flash an EMC switch on the latest version of MellanoxOS SX6012. Everything works well. But when I try to update via the web interface in the second slot, my connection is lost at the stage of downloading the firmware image, and I cannot connect to the switch. And, accordingly, I can’t finish the firmware.
Has anyone encountered anything like this?
Is there any way to restart the network from the command line?

 

[Freebsd1976]

Thanks for answers. I figured it out. The problem was with the Microtik router. I had to connect directly to the PC. After updating the MLNXOS firmware, the connection with the router was established in normal mode.

not only Microtik router, also netgear router.
using dumb 2-layer switch when conversion is better choice

 

[Terry Wallace]

TFTP doesnt like routers FYI Its in Trivial nature of the protocol. Direct or dumb switch is the best bet for anything tftp

 

[Terry Wallace]

Greetings again
I was able to flash an EMC switch on the latest version of MellanoxOS SX6012. Everything works well. But when I try to update via the web interface in the second slot, my connection is lost at the stage of downloading the firmware image, and I cannot connect to the switch. And, accordingly, I can’t finish the firmware.
Has anyone encountered anything like this?
Is there any way to restart the network from the command line?

This is not uncommon.. read the threads in the upgrade section.. Dont remember the exact command it was, but command line clear out the OLD images (mine had like 2-3) which makes room for the download to complete..

 

[John123]

Hello all,

for an EMC sx6015 switch there is a command to edit GUID?
or if someone can identify ROM on board in order to replace it

thanks

 

[w4rell]

Hello there ! Just to say the guide was almost perfect, i converted 3 EMC SX6012 I love so much these switches and community I'm planning to do something about the MSX60-DKIT whom we can't find anywhere (3d printing) maybe some will be interested in !

 

[xmagusx]

I believe I have made an error somewhere in dodgy route's excellent guide. I do well until I reach the step "mlxi2c show fru /CPU", and my output differs significantly from what's shown. Anyone have an idea what I may have done incorrectly? I found this post which looks similar, but it simply links back to this thread and then got marked solved.

[admin@sx6012f1 ~]# mlxi2c show fru /CPU
Feb 14 10:47:34 INFO    LOG: Initializing SX log with STDOUT as output file.
Feb 14 10:47:34 ERROR   ACCESS_REG: Failed to open the DPT shared memory
Feb 14 10:47:34 ERROR   ACCESS_REG_INIT: Failed loading the DPT
Feb 14 10:47:34 ERROR   ACCESS_REG: Failed to open the DPT shared memory
-E- mlxi2c: mi_opend Failed status(MLXI2C_SX_CMDIF_INIT_FAILED:63)

 

[w4rell]

I believe I have made an error somewhere in dodgy route's excellent guide. I do well until I reach the step "mlxi2c show fru /CPU", and my output differs significantly from what's shown. Anyone have an idea what I may have done incorrectly? I found this post which looks similar, but it simply links back to this thread and then got marked solved.

[admin@sx6012f1 ~]# mlxi2c show fru /CPU
Feb 14 10:47:34 INFO    LOG: Initializing SX log with STDOUT as output file.
Feb 14 10:47:34 ERROR   ACCESS_REG: Failed to open the DPT shared memory
Feb 14 10:47:34 ERROR   ACCESS_REG_INIT: Failed loading the DPT
Feb 14 10:47:34 ERROR   ACCESS_REG: Failed to open the DPT shared memory
-E- mlxi2c: mi_opend Failed status(MLXI2C_SX_CMDIF_INIT_FAILED:63)

Does your fans going down ? If not you certainly miss this part and below : Send the updated FRU to the switch

 

[xmagusx]

Does your fans going down ? If not you certainly miss this part and below : Send the updated FRU to the switch

If they are, it's not by much. This is what I did to update the FRU:

Spoiler: Console output

[admin@sx6012f1 ~]# vi emc_to_6012
dd if=/dev/zero bs=16 count=256 of="$2" 2> /dev/null

dd if="$1" bs=16 count=12 of="$2" conv=notrunc 2> /dev/null
dd if="$1" bs=16 count=5 of="$2" skip=12 seek=14 conv=notrunc 2> /dev/null

printf "\x20" | dd of="$2" bs=1 seek=1 count=1 conv=notrunc 2> /dev/null
printf "\x00" | dd of="$2" bs=1 seek=5 count=1 conv=notrunc 2> /dev/null

printf "\x05\x0E\x02\x14\x06\x16\x07" | dd of="$2" bs=1 seek=15 count=7 conv=nott
runc 2> /dev/null

printf "\x00\x1A\x00\x03\x05\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00
\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00" | dd of="$2" bs=1 seek
=192 count=32 conv=notrunc 2> /dev/null
printf "\x00\x12\x00\x01\x06\x00\x00\x00\x00\x01\x00\x00\x02\x88\x04\x04\x02\x02
\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x0A\x00\x01\x07\x00
\x00\x00\x00\x02\x10\x00\x00\x00\x00\x00" | dd of="$2" bs=1 seek=320 count=48 co
nv=notrunc 2> /dev/null

printf "\x4D\x53\x58\x36\x30\x31\x32\x46\x2D\x32\x42\x46\x53\x00" | dd of="$2" b
s=1 seek=64 count=14 conv=notrunc 2> /dev/null

~
"emc_to_6012" 15L, 1029C written
[admin@sx6012f1 ~]# /opt/tms/bin/mellaggra _read_fru 1 0x51 1000 fru_backplate.bin
Read fru 1 - 0x51, sz - 4096 to file fru_backplate.bin
[admin@sx6012f1 ~]# sh emc_to_6012 "fru_backplate.bin" "fru_patched.bin"
[admin@sx6012f1 ~]# /opt/tms/bin/mellaggra _write_fru 1 0x51 1000 fru_patched.bin
[admin@sx6012f1 ~]# mst status
MST modules:
------------
    MST PCI module loaded
    MST PCI configuration module loaded

MST devices:
------------
/dev/mst/dev-i2c-0               - Embedded I2C master
/dev/mst/dev-i2c-1               - Embedded I2C master
/dev/mst/mt51000_pciconf0        - PCI configuration cycles access.
                                   domain:bus:dev.fn=0001:81:00.0 addr.reg=88 data.reg=92
                                   Chip revision is: 02
[admin@sx6012f1 ~]# lspci
0000:40:00.0 PCI bridge: Unknown device aaa0:bed0 (rev 01)
0001:80:00.0 PCI bridge: Unknown device aaa1:bed1 (rev 01)
0001:81:00.0 InfiniBand: Mellanox Technologies Unknown device c738 (rev 02)

 

[w4rell]

When everything is fine, they should ramp down 2 times until you can hear them without any ears protections haha.
Restart from the part I said and apply again every step of the guide, it should solve your problem. I'm not in front of my switches to confirm and can't help you more for now.

 

[r_sync_failed]

In case someone cannot download the old SX60xx update guide:

Index of /fd/msx60xx

Originally from this thread but I couldn't find it anymore.

 

[xmagusx]

When everything is fine, they should ramp down 2 times until you can hear them without any ears protections haha.
Restart from the part I said and apply again every step of the guide, it should solve your problem. I'm not in front of my switches to confirm and can't help you more for now.

It was still having issues so I tried the process on my other one and it seems to have worked like a charm. I suspect I may have a hardware failure or bad connection somewhere in the first one. Just hesitant to open it up and poke around without knowing what is easily reseatable and what is fragile.

Update: reseated all the connection points I could easily find and ran through the guide from step one and it worked like a champ this time. Both sx6012 switches have now been converted from EMC to Mellanox successfully. Thank you all for your help and this amazing thread!

 

[longtongue]

Hello! Converted EMC to SX6012. Now the web interface is very slow. Loads each page in a few minutes. After conversion. I used it and everything worked well. The switch was lying there for some time, and now I turned it on and I can’t even enter my login and password. I tried switching from version 3.6.8012 to 3.4.0012. I managed to enter my username and password, but the pages still load very slowly. Any ideas what could be the problem?
Thanks in advance!

 

[klui]

Login through the console and see if there are any logs, go into the shell and look at log files. If the console is also laggy then my guess is your flash is failing.

 

[longtongue]

Login through the console and see if there are any logs, go into the shell and look at log files. If the console is also laggy then my guess is your flash is failing.

how can I see it correctly? "show logs" doesn't show anything special. "logging monitor" does not output anything at all with different parameters.
The ssh pic doesn't seem to slow down.

 

[longtongue]

OU! The web interface has loaded. I was able to access the logs.

Spoiler: ERROR

Feb 26 11:17:29 switch-fea744 hwd[4940]: TID 1208129920: [hwd.ERR]: hwd_ll_mi_refresh_one_presence_change: Could not refresh module:[0x00ff], type:[MODULE_OUT] ,code:[58,MLXI2C_HASH_NOT_EXIST_MEM]
Feb 26 11:17:29 switch-fea744 hwd[4940]: TID 1208129920: [hwd.ERR]: hwd_handle_interrupts_event(), hwd_main.c:24373, build 1: Failed to refresh subsystem:[255] after interrupt receive, code:[14019,IO verify failed]
Feb 26 11:17:29 switch-fea744 hwd[4940]: TID 1208129920: [hwd.ERR]: lew_universal_event_handler(), libevent_wrapper.c:304, build 1: Error code 14019 (IO verify failed) returned
Feb 26 11:20:04 switch-fea744 chad[4823]: [chad.ERR]: init_blocks_info(), fru_info.c:365, build 1: Number of the blocks 11 is greater than maximum allowed 10
Feb 26 11:20:05 switch-fea744 chad[4823]: [chad.ERR]: init_blocks_info(), fru_info.c:365, build 1: Number of the blocks 11 is greater than maximum allowed 10
Feb 26 11:20:42 switch-fea744 hwd[4943]: TID 1208129920: [hwd.ERR]: init_blocks_info(), fru_info.c:365, build 1: Number of the blocks 11 is greater than maximum allowed 10
Feb 26 11:20:42 switch-fea744 hwd[4943]: TID 1208129920: [hwd.ERR]: init_blocks_info(), fru_info.c:365, build 1: Number of the blocks 11 is greater than maximum allowed 10
Feb 26 11:31:00 switch-fea744 clusterd[5735]: [clusterd.ERR]: bn_binding_get_str(), bnode_types.c:2358, build 1: Unexpected NULL
Feb 26 11:31:00 switch-fea744 clusterd[5735]: [clusterd.ERR]: bn_binding_get_tstr(), bnode_types.c:2398, build 1: Error code 14001 (unexpected NULL) returned
Feb 26 11:31:00 switch-fea744 clusterd[5735]: [clusterd.ERR]: cl_get_my_hostid(), cl_membership.c:2600, build 1: Error code 14001 (unexpected NULL) returned
Feb 26 11:31:00 switch-fea744 clusterd[5735]: [clusterd.ERR]: cl_membership_init2(), cl_membership.c:301, build 1: Could not query my hostid
Feb 26 11:31:00 switch-fea744 clusterd[5735]: [clusterd.ERR]: cl_init(), cl_main.c:271, build 1: Error code 14001 (unexpected NULL) returned
Feb 26 11:31:00 switch-fea744 clusterd[5735]: [clusterd.ERR]: main(), cl_main.c:60, build 1: Error code 14001 (unexpected NULL) returned

Spoiler: WARNING

Feb 26 10:53:16 switch-fea744 clusterd[16436]: [clusterd.WARNING]: mlnx_get_str: Unable to get '/chad/state/golden_profile' using '99'!
Feb 26 10:53:16 switch-fea744 clusterd[16436]: [clusterd.WARNING]: mlnx_get_str: Unable to get '/ha/state/merge_proposed' using 'unknown'!
Feb 26 10:59:23 switch-fea744 health[4888]: [health.WARNING]: CPU Utilization raising detected top output flowing:
Feb 26 11:03:56 switch-fea744 had[5106]: [had.WARNING]: had_handle_link_change_event: Interface already up!
Feb 26 11:19:54 switch-fea744 mgmtd[4248]: [mgmtd.WARNING]: Unexpected system shutdown detected! Notifications will be sent in 1 minute...
Feb 26 11:20:43 switch-fea744 hwd[4943]: TID 1208129920: [hwd.WARNING]: hwd_update_license_status: code:[0]
Feb 26 11:21:05 switch-fea744 pgm[4906]: [pgm.WARNING]: pgm_set_timeout: Request 0x27CE1 and current 0x28435!
Feb 26 11:27:28 switch-fea744 had[5106]: [had.WARNING]: had_handle_link_change_event: Interface already up!
Feb 26 11:31:12 switch-fea744 clusterd[5858]: [clusterd.WARNING]: mlnx_get_str: Unable to get '/ha/state/merge_proposed' using 'unknown'!
Feb 26 11:31:12 switch-fea744 had[5106]: [had.WARNING]: had_handle_link_change_event: Interface already up!

 

[longtongue]

I decided to connect directly to the PC and check how the web interface works. It turned out that he was just flying. It looks like the problem is somewhere in the connection with the Mikrotik roturer. Has anyone encountered such a problem and was able to solve it? Or is it not love at first sight?
Router Mikrotik RB2011UiAS-2HnD-IN.
Switch Mellanox SX6012 (EMC)
UPDATE
It turned out it was the cable. After going through several cables, I found a cable with which the web interface flies through Mikrotik. Apparently they are very picky about cables. Hmm... Although why was this not immediately noticeable?

 

[rmsth]

Has anyone tried SPTSBP2CLCKS INTEL 100G-CWDM4 1271-1331NM OPTICAL TRANSCEIVER MODULE NEW | eBay on the cross-flashed SX6012?
What's your experience or is the price to good to be true?

 

[klui]

They link at 40G.

 

[Softlution]

Hi everyone. I started with the guide to convert an EMC mellanox sx6012 .If the switch is successfully converted, is it going to support Ethernet?