Mellanox 8-port 40gb QDR IB switches

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.
MiniKnight

MiniKnight

Well-Known Member
Mar 30, 2012
3,073
974
113
NYC
My co-worker got one for around $500 and is really happy. $50 cards x 8 + cables + these and for just over $1100 he has an 8-way IB QDR setup:
From Israel: Mellanox MIS5022Q 1BFR Infiniscale Infiniband Switch 8 Ports Cable | eBay at $450
From US 1: Mellanox 40GB s Infiniband Switch 8 Port MIS5022Q 1BFR IS5022 QSFP | eBay $525 no rack kit
From US 2: Mellanox IS5022 8 Port Non Blocking Remotely Managed 40GB s Infiniband Switch | eBay $599 obo incl rack kit

Moving up to a big 36 port isn't that much more: New F s Mellanox MIS5025Q 1SFC 36 Port QDR Infiniband Switch 2 88TB s IS5025 | eBay $760.
 
  • Like
Reactions: T_Minus, Chuckleb and Aestr
Boddy

Boddy

Active Member
Oct 25, 2014
772
144
43
Do you think the 36 port Mellanox MIS5025Q would be compatible with Dell SwitchX QDR/FDR 16+16 Port InfiniBand Switch Blade 1965W MCX384A-BCAA?

I was originally thinking of a DDR switch. QDR is probably overkill for my pair of C6100s running L5639s (but I should have lots of headroom :) )

What cables do you suggest? I guess these can be very expensive unless I go copper?

I heard that other QDR switches can be loud, this one is rated at 55dB which does not sound too loud?
 
Patrick

Patrick

Administrator
Staff member
Dec 21, 2010
12,519
5,826
113
Decent chance it will work since it is Mellanox to Mellanox.
 
  • Like
Reactions: Boddy
Boddy

Boddy

Active Member
Oct 25, 2014
772
144
43
Thanks Patrick, greatly appreciate your feedback.:)
Important to know when purchasing expensive (for me) equipment. :D
 
tby

tby

Active Member
Aug 22, 2013
222
111
43
Snellville, GA
set-inform.com
Boddy said:
Do you think the 36 port Mellanox MIS5025Q would be compatible with Dell SwitchX QDR/FDR 16+16 Port InfiniBand Switch Blade 1965W MCX384A-BCAA?
Click to expand...
No, the 1965W card is 40GbE-only. For Infiniband mezzanine you need JR3P1 (QDR/10GbE), K75R1 (FDR/40GbE), or T483W (single-port FDR/40GbE). There might also be a single-port QDR card out there but I don't know the part number.
 
  • Like
Reactions: Boddy
C

Chuntzu

Active Member
Jun 30, 2013
383
98
28
I regards to the newer 36 port switches, like the MIS5025Q-1SFC. I purchased one a while back but it turned out its software license only activates 18 of the 36 ports...I may have been the only unlucky one but I would ask before purchasing that all the ports are unlocked.
 
  • Like
Reactions: Chuckleb and Boddy
Boddy

Boddy

Active Member
Oct 25, 2014
772
144
43
tby said:
No, the 1965W card is 40GbE-only. For Infiniband mezzanine you need JR3P1 (QDR/10GbE), K75R1 (FDR/40GbE), or T483W (single-port FDR/40GbE). There might also be a single-port QDR card out there but I don't know the part number.
Click to expand...
Many thanks tby for your feedback. I'm bit confused and new to this stuff. I had a look at page 9 of your supported documentation, on table 3 the 01965W is listed as a supported PSID.

I picked up a swag of 01965W for a song on EBay.
Are you saying that they would not work with this switch?
Any clarification would be greatly appreciated.
Cheers
 
tby

tby

Active Member
Aug 22, 2013
222
111
43
Snellville, GA
set-inform.com
The 1965W and X8GJ4 cards are Ethernet-only. I know the eBay listings for the 1965W say Infiniband but they also say it's a 16+16 port switch blade.

You need a VPI card to work with an Infiniband switch. T483W, K75R1, or JR3P1.
 
  • Like
Reactions: Boddy and NetWise
Boddy

Boddy

Active Member
Oct 25, 2014
772
144
43
tby said:
The 1965W and X8GJ4 cards are Ethernet-only. I know the eBay listings for the 1965W say Infiniband but they also say it's a 16+16 port switch blade.

You need a VPI card to work with an Infiniband switch. T483W, K75R1, or JR3P1.
Click to expand...
Hi tby. Thanks ever so much for your insightful and valuable feedback! :)

Anyone have any spec sheets for 1965W (not listed on Mellanox site)
Do you know what sort of speed the 1965W
What does 16+16 refer to?
What sort of cables would I need to use?

Bummer they are sold as 'infiniband' and are not the 40Gb variety.
It pays to get facts first before purchase.

Many thanks for your help :)
 
Boddy

Boddy

Active Member
Oct 25, 2014
772
144
43
Chuntzu said:
I regards to the newer 36 port switches, like the MIS5025Q-1SFC. I purchased one a while back but it turned out its software license only activates 18 of the 36 ports...I may have been the only unlucky one but I would ask before purchasing that all the ports are unlocked.
Click to expand...
FYI. Feedback from seller when I enquired if some of the ports could be locked:

'With this Mellanox model? We have sold over 100 of these and I've never heard of this. Have never had a complaint and there is nothing on mellanox.com to say any ports are locked. See http://www.mellanox.com/page/products_dyn?product_family=60
I think Cisco etc block ports, but not Mellanox.
These are Infiniband QDR switches, not Ethernet.'
 
P

PnoT

Active Member
Mar 1, 2015
650
162
43
Texas
LasseKongo said:
It sure look like a nice switch, thinking of maybe replacing my 36 port with one of those. A question to the original poster, what is your co workers experience with the noise level of this switch ? Is it quiet enough to have in an office environment ?

Also for those interested, they are now available for $290, that´s really cheap.
Mellanox InfiniScale IV IS5022 QDR 8-Port InfiniBand Switch MIS5022Q-1BFR
Click to expand...
I have this exact model and it is NOT quiet enough for a small office :D

It is the loudest thing in my rack of 5 servers and 4 switches and I can easily hear it behind a closed door upstairs.
 
  • Like
Reactions: Patrick
R

Rus Taliss

New Member
Sep 14, 2017
4
0
1
59
BackupProphet said:
Hmm. What about this switch?
IBM Mellanox Flex System lB6131 IB6131 InfiniBand QDR 90Y3583 90Y3450 90Y3453
Click to expand...
Why is this the ONLY thread to mention the IB6131 ??? Hardly mention.. IF it is specific to the IBM FLEX chassis ) i doubt it) .. as it has MLNX-OS installed.
The SX fabric must be beyond anyone .. tho the IB6131 was released in 2011 !!
Thus we have a switch with 14 internal SX switch nodes (NO schematic of that ANYWHERE @@# grrr.. ) and 18 external FDR ports that surely must be useful
 
You must log in or register to reply here.
Top Bottom