Mellanox SX6005 unmanaged switch - VPI (?)

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

AveryFreeman

consummate homelabber
Mar 17, 2017
413
54
28
42
Near Seattle
averyfreeman.com
Hey,

so I was looking at this SX6005 unmanaged switch's PDF, and it seems to say it has "VPI" which allows it to use both infiniband and ethernet

Is the ethernet functionality included out of the box on the unmanaged switches, or is it something you have to add with a gateway firmware upgrade? (e.g. UPGR-6036-GW for the SX6036 managed switch)

I'm still pretty confused by the material I've read about it, and I can't seem to find a definitive answer. Has anyone tried ethernet on one for themselves? (I think SX6005 and SX6012 are same line)

Thanks
 

i386

Well-Known Member
Mar 18, 2016
4,250
1,548
113
34
Germany
The 6005 is a "dumb" Switch. Even for infiniband you would need an external Subnet Manager.
Vpi is supported by the managed Version (6012) and requires a license.
 

AveryFreeman

consummate homelabber
Mar 17, 2017
413
54
28
42
Near Seattle
averyfreeman.com
The 6005 is a "dumb" Switch. Even for infiniband you would need an external Subnet Manager.
Vpi is supported by the managed Version (6012) and requires a license.
Yeah, thanks for getting back to me - I get that IB needs a subnet manager. I don't intend to use one for IB at all. Do they support ethernet?

The description pages and PDFs I read really don't make it clear - the first blurb on their product description says something about VPI supporting IB and Ethernet "side by side", but then everything else talks about IB.

Can one use a SX6005 solely for 40GbE?

Edit: I think I found some answers about using VPI here: https://www.mellanox.com/related-docs/prod_gateway_systems/Configuring_Mellanox_Hardware%20_for_VPI_Operation_Application_Note_Archive.pdf

It's strange, though - it only lists SX6012 and higher models (the managed models) as being compatible with VPI, but on the SX6005 product description page the SwitchX-2 line clearly says it supports VPI: https://support.mellanox.com/s/productdetails/a2v50000000XoR3AAK/sx6005

There's a bug report saying the SX6005 can't enable ethernet on its backplane ports for a certain firmware version:
Network Interfaces Cannot enable 40GbE on backplane ports 9.3.4000 9.3.6000

So I mean, I guess that confirms that ethernet on these models is (usually) a thing?
 
Last edited:

AveryFreeman

consummate homelabber
Mar 17, 2017
413
54
28
42
Near Seattle
averyfreeman.com
6005? No.
6012? Yes with the ethernet/gateway license.

Edit:
First link when I search for mellanox 6005: https://www.mellanox.com/related-docs/prod_ib_switch_systems/PB_SX6005.pdf
"Vpi" is not mentioned in that pdf
Well, I mean this kind of thing would be helpful in most normal situations, but with Mellanox it throws up even more confusion.

First off, product page: https://support.mellanox.com/s/productdetails/a2v50000000XoR3AAK/sx6005
SX6005/SX6012 12-port 56Gb/s InfiniBand/VPI Switch Systems . . .
OK, that sounds like both of them are VPI, but in same paragraph:

. . . The SX6012 with Virtual Protocol Interconnect (VPI) supporting InfiniBand and Ethernet connectivity provide the highest performing and most flexible . . .
That one only identifies the SX6012 as being VPI (?) it's totally nuts... It seems like the SX6012 is more in-line with the sx6036, etc. since it's managed, so I'm not really sure why they lumped it in with the sx6005 for a product description...

Then there's bug fix lists for unmanaged switch firmware (sx6005, sx6015 and sx6025) that makes references to 56GbE, 40GbE being fixed, etc. (I could have swore I saw one of these that said the word "ethernet" the other night, but am not finding it now): https://www.mellanox.com/pdf/firmware/fw-SwitchX--9_4_2000-release_notes.pdf

I think I'm over it. There seems to be enough evidence of it not being ethernet-compatible that I'm too scared to buy one now. Just wish I could have heard from someone who's actually used one.
 

klui

Well-Known Member
Feb 3, 2019
846
464
63
The support doc is poorly worded.

The definitive answer is the SX6005's datasheet where as @i386 stated "VPI" is nowhere to be found.
 
  • Like
Reactions: AveryFreeman