UK Mellanox SX6012 - 12Ports 56Gb InfiniBand Switch

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

gb00s

Well-Known Member
Jul 25, 2018
1,189
600
113
Poland
Some Mellanox SX6012 are on the market. Haven't seen them for a while in "EU". I was able to offer a substantially lower price which was accepted. Ok, it's UK with customs fee for EU citizens, but still cheaper than importing from US with crazy shipping rates.

eBay - LINK
 
  • Like
Reactions: ecosse and Rand__

Stephan

Well-Known Member
Apr 21, 2017
929
706
93
Germany
Was looking for two of those for a while... seller just accepted my OBO and gave me 50 quid off. Because what is a home without 56 Gbps MLAG hitless CEPH storage failover within a 2x 28 watts empty/idle power envelope...

My gratitute to @gb00s for sharing the link! I even had the words on my watchlist but who knows when ebay could have been ar*ed to tell me.

Here is another fan (I needed CC autotranslate):
Edit: According to comments below video, he also lurks on STH. ;-)
 
Last edited:

Stephan

Well-Known Member
Apr 21, 2017
929
706
93
Germany
Aaand all five are sold. Figured they would sell fast. Who bought the other 3? Now looking for a MSX60-DKIT...
Offered 150 GBP per switch, seller went down to 125. Basically 200 EUR per switch including shipping and tax.
 

gb00s

Well-Known Member
Jul 25, 2018
1,189
600
113
Poland
So my package sent with eBay GPS got lost. No Mellanox SX6012 for me. I hope you guys have fun.
 

Stephan

Well-Known Member
Apr 21, 2017
929
706
93
Germany
No parcel tracking available? Sent using Pitney Bowes? You mean global shipping program i.e. GSP? Hope you will get they money back. Is Poland that much more unreliable for shipping than Germany? In Germany through ubiquity of tracking parcels are rarely lost. At least by DHL, UPS, GLS. Hermes is treating its sub "contractors" like sjit, so damage possibility there is highest.
 

gb00s

Well-Known Member
Jul 25, 2018
1,189
600
113
Poland
No parcel tracking available? Sent using Pitney Bowes? You mean global shipping program i.e. GSP? Hope you will get they money back. Is Poland that much more unreliable for shipping than Germany? In Germany through ubiquity of tracking parcels are rarely lost. At least by DHL, UPS, GLS. Hermes is treating its sub "contractors" like sjit, so damage possibility there is highest.
You see it from the totally wrong side. No, money is not the issue here. Ebay will refund. Yes, it arrived at the GSP centre in 1 day and since then there's been no tracking update. Of course, Pitney Bowes. Normally I have no issues to have parcels from around the world delivered here.

But, if you are looking for 12-15 months for a working and affordable SX6012, you find it at a reasonable price, you already start to re-build your home lab around it and you buy stuff for it and then you wait 4 weeks and you don't get. I'm stuck now. I found it. You got yours. I did not.
 
  • Sad
Reactions: UhClem and Fritz

UhClem

just another Bozo on the bus
Jun 26, 2012
438
252
63
NH, USA
Damn! @gb00s , that really sucks!
I sincerely feel your pain, and empathize ... but ...

It would be a very righteous, and noble, gesture if @Stephan would sell you one of his.
Of course, Stephan should ignore the above spoiler :)
[When I find a great deal, I often buy a spare, just in case ... In the proposed scenario, Murphy would interject himself soon after the package departed DE to PL.:rolleyes:]
Edit: I will pay for the shipping [economical, but tracked]!
 
Last edited:

Stephan

Well-Known Member
Apr 21, 2017
929
706
93
Germany
@UhClem Best I can do is offer to unbrick as many 6012 as he wants, in case somebody can donate a unit that is otherwise dead. Would have to be shipped to DE. Otherwise I'd have just spent two weeks on the BDI 2000 jtag unit in vain. Also I just checked ebay for other offers, 1kEUR i.e. quintupled price. Insane. Then I checked prices for the BDI, also tripled. What is going on...

I am not convinced the parcel is really lost. Maybe stuck in customs. He needs to pester Pitney Bowes and ebay hard to look for it.
 

Cruzader

Well-Known Member
Jan 1, 2021
552
563
93
I am not convinced the parcel is really lost. Maybe stuck in customs. He needs to pester Pitney Bowes and ebay hard to look for it.
Its probably not lost indeed, but ebay has given up on it.

Im getting 3-5 shipments a week with ebay global shipping and this does happend from time to time.
i was getting a shipment from the US 2weeks ago, tracked fine intil last terminal 1hr away from here but a 10€ fee needed to be paid.

There starts the fun.

I do not own the shipment.
eBay does not own the shipment.
eBay seller does not own the shipment.
Pitney Bowes does not have a contact point, they are only the accounting company doing the export/import formalities but still end up as sender for local freighters.
Local freighter will only deal with pitney as owner, nobody can get pitney to deal with them.

Ive had multiple shipment that shows fine on tracking for evry party involved and is sitting on terminal ready to be delivered.
But nobody is able to clear the fee or give delivery approval, ebay close them all as damaged/lost and refund.
 

Stephan

Well-Known Member
Apr 21, 2017
929
706
93
Germany
Its almost like a mad ghost of dead company Mellanox is roaming the Earth, messing with anyone trying to bring up such a switch at cents on the dollar with firmware it wasn't sold with. On Feb 25th 2022 I bricked the first switch I touched and later that day it became clear that I probably had a wiped bootloader. Game over. Owhhh fsck. Fsck fsck fsck. I think I am in the same homelab camp as gb00s. Homelab that just lost one MLAG leg.

About two years ago I created a folder with information, firmwares etc., intent on buying some clusterable switches on the cheap, either Mellanox or Arista. Turns out Mellanox. So now I had the choice: Put up a fight to reflash the switch, or give up? With 30 years of electronics and embedded experience, I decided to fight. I was willing to put in the time and even more money to bring the switch back. Knowing full well that even if I bought a JTAG unit for the price of a single switch, and a new switch, too, opportunity cost vis-a-vis my day job's billing rate would be way way higher when fighting to reflash.

I already told in the other big Mellanox thread that it was very difficult for me to obtain detailed manuals and BDI firmware capable of talking to the SX6012 PPC 460EX chip. What I didn't tell was the lengths I went to to find and contact people who were in any way involved with AMCC's PPC endeavour. Be it Linux ppc commits, U-Boot bring up of an obscure eval kit, or random Italian people casually mentioning 460EX on a long forgotten e-mail list. Getting mad at just how bad Google has become at finding such "old" stuff. Switching to Yandex and Bing. Appreciating archive.org. Finding out that basically every company involved has either been bought or dissolved. Followed people's tracks, finding obituary from 2014. Scanned all Abatron ebay listings worldwide for hints on pp4xx firmware. Went on Aliexpress, Alibaba, Taobao to look for contact who might have firmware. Checked Lauterbach TRACE32 availability and licensing, which was none or insanely expensive. Subscribed to obscure Mandarin-only "AmoBBS" where someone from Beijing posted he had worked on ppc4xx with Abatron, to find they want $$$ to even be able to message people. Never got that invite to "sonsivri.to" BBS where similar conversation happened. Mailed Indian-descent people who worked for AMMC but who no longer exist. Wow, sjit excuse the french. Explored alternate avenues by reading up on the entire xbox360 NOR flash modding with clip history. Read the entire history of u-boot commits for ppc400 (removed in 2017, because no longer used by anyone) to make a list who to mail to next. Thought about how to get ahold of retired Abatron founders Rudolf Dummermuth and Max Vock in Switzerland. Drive there? Call neighbours listed in the phone book? Switched default search engine to Bing. Looked for BDI users on Twitter, messaged a few. Looked again into bdi3k clones from Taobao. Found NXP PPC lineage but PowerDebug really is only good for their chips. Studied OpenOCD documentation and code. Went over some NORway Teensy code's programming algorithms for NOR flash, and guess what, nobody employed SLC Strata Flash in consumer game consoles so there was no compatible code written that would have worked out of the box. Tracked down new old stock of the NOR flash chips on Aliexpress should I have to go down that path and needed chips to debug Teensy code first. Loaded Mellanox U-boot into Ghidra to check various low level init functions, because "Canyonlands" eval kit for 460EX had this CPLD which needed to be mapped into some address space and a byte with zeros has to be written to it, to disable hardware write protect of flash and EEPROM chips. I suspected (wrongly) Mellanox might have a similar feature and back then, I did not have that 1600+ page user manual of the 460EX. Opened a ticket at Mellanox because well GPL, could they send me the source code for their U-Boot fork. No answer yet. ;-) Read GPL license to find out they only need to do this for 3 years, well maybe they read that too.

And finally, after a few days of leaving no stone unturned, I almost would have not gotten a certain ZIP file from somebody I wrote to, because my mail server turned him away with intentionally non-descript "550 5.1.1 User unknown" upon detection of a Windows executable in the mail. Only by accident I found this in the rspamd logs while looking for something else.

I don't have the slightest doubt that the ghost of Mellanox and the Universe wanted that switch dead and in a recycling bin. But when they saw me pulling up old 460EX BDI configs that I scraped from mailing list posts in vscodium, to rewrite them for Mellanox specifics, they gave up and moved on. Moved on to you perhaps.

Long story short, I have no doubt Cruzader is right. But. But I strongly suspect if you invest a little of your time to figure out how to contact a Pitney Bowes that doesn't want to be contacted, making it easy for them to identify your parcel when they see it (mine came in a 90x60x30 server box), who sent it, who are you, how to contact you swiftly, why contents are very important for you, always asking, if you can't help me yourself, do you know who can, then I guess this will turn up at your door. Do you have a fax machine? I keep a very well-greased hylafax + YajHFC around just for such occasions. I'd send a letter to every company in UK that I can pull out of public company records that is named "Pitney Bowes". Call the front desk. They will be surprised, because not even 1 in 10,000 is this persistent. Everyone else writes the parcel off and ebay pays them back and that's the end of it.

Of course there has to be a plan B. You could switch brands, jump on flightics.com fly to Israel for 100, buy a cheap Arista 7050 for 300, fly back with night machine. An Andy von Bechtolsheim machine and you can tell it. AMD x86 control plane and merchant silicon.

It took me a while to write this. Even exported ungoogled-chromium history to reconstruct bits. Anyway, thanks for reading. I'm subbing this thread, would be interested in how things turn out.