10GigE Switch -- Want to buy, need info.

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

T_Minus

Build. Break. Fix. Repeat
Feb 15, 2015
7,650
2,066
113
I was thinking about going with the NETGEAR ProSAFE XS712T it was ~1300$ new, now they're way more which must have happened recently.

I'm looking for used now... what to look for? I want 8-16 Ports and that's probably it unless the deal is great :) I plan to eventually have 2 seperate 10GigE networks or maybe fiber 2nd network so I don't need high density either way.

Ideally around $800 would be great. I know NetGear makes the 8 port version around 800 new, but I'm looking for other options too just to see what's out there.

Also would be nice to find a SFP+ switch to connect to the 10GigE so I can use the cheap Mellanox in some other boxes.

I guess I'm looking for a couple things then :)

- 8-16 port 10GigE Layer2/3 Managed Switch
- 8-16 port SFP+ Switch
- 10GigE/Infini Mellanox Connect-X3 Cards ( believe these are the best choice )
- 10GigE Mellanox cables
- 10GigE transceivers for above


I believe that's what I'm after :) Educate me on other options or choices if you have ideas. I'm not going all Fiber.
 
Last edited:

mrkrad

Well-Known Member
Oct 13, 2012
1,244
52
48
Real SFP+ 24 port 10gbe switches start used around $2200. 10GBASE-T requires far more power to accomplish the same bandwidth so it is not as popular as an optics like the XS712T! or the XS708E. the nic cards will cost a ton more $$ for 10GBASE-T !
 

T_Minus

Build. Break. Fix. Repeat
Feb 15, 2015
7,650
2,066
113
I'm not concerned with the GiGe latency/power.

What are you trying to say about the rest though, it's perplexing to me.

1. I didn't mention wanting 24 ports of anything, especially at once on one switch, or right now in general.

2. I can get ConnectX-3 for <$150/each. That's 1/2 what a 10GigE Intel NIC cost used.

3. You mentioned parts I already mentioned (NetGear).

What aer you trying to convince me of ?
 

PithyChats

Active Member
Feb 3, 2015
173
85
28
For 10GbE SFP+ switches, here are a few options that are often under $1000 on Ebay:

IBM G8124 - L3 (Juniper EX2500 Clone)
Fujitsu XG2600 - L2, decently low latency
Gnodal 4008 (Seems to have disappeared of late) L2, ultra low latency 40GbE included as well

There are also a few that sometime drop to around $1000 but rarely:

Cisco N5K-C5020P-BF
Dell 8024F

I think the Gondal is best value of the above, but the Dell 8024F may have the best resale value. Also depends on whether you need low latency or not.
 
  • Like
Reactions: T_Minus

PithyChats

Active Member
Feb 3, 2015
173
85
28
I'm not concerned with the GiGe latency/power.

What are you trying to say about the rest though, it's perplexing to me.

1. I didn't mention wanting 24 ports of anything, especially at once on one switch, or right now in general.

2. I can get ConnectX-3 for <$150/each. That's 1/2 what a 10GigE Intel NIC cost used.

3. You mentioned parts I already mentioned (NetGear).

What aer you trying to convince me of ?
For the mellanox cards, is there a particular reason you want Connectx-3? I have picked up Connectx-2 cards for a cheap as $25, and you can generally get them around $50 each. (You do give up a few features such as RoCE/RDMA, but do you need these?)
 
  • Like
Reactions: T_Minus

T_Minus

Build. Break. Fix. Repeat
Feb 15, 2015
7,650
2,066
113
For 10GbE SFP+ switches, here are a few options that are often under $1000 on Ebay:

IBM G8124 - L3 (Juniper EX2500 Clone)
Fujitsu XG2600 - L2, decently low latency
Gnodal 4008 (Seems to have disappeared of late) L2, ultra low latency 40GbE included as well

There are also a few that sometime drop to around $1000 but rarely:

Cisco N5K-C5020P-BF
Dell 8024F

I think the Gondal is best value of the above, but the Dell 8024F may have the best resale value. Also depends on whether you need low latency or not.
That Dell 8024F is looking like the way to go! Although the Gnodal I was checking out earlier, if more come up <1k that may be interesting to go too since it includes 40GbE too :) Oh the choices.
 

T_Minus

Build. Break. Fix. Repeat
Feb 15, 2015
7,650
2,066
113
For the mellanox cards, is there a particular reason you want Connectx-3? I have picked up Connectx-2 cards for a cheap as $25, and you can generally get them around $50 each. (You do give up a few features such as RoCE/RDMA, but do you need these?)
Great, info. No. I didn't compare the 2 just noticed how cheap the Connectx-3 were. For $50 for a 2 that does the same, even better :)
Thank you for that info.

Looks like the ConnectX-3 cards I can get for $100/Each shipped from one supplier.
 
Last edited:

PigLover

Moderator
Jan 26, 2011
3,186
1,546
113
In my experience - for general light lab use @ 10Gbe - there is little advantage for ConnectX-3 EN vs ConnectX-2 EN. There might be a small advantage by having a longer support life on the ConnextX-3 line. They do support RDMA (while the -2s don't) but I've been generally underwhelmed by the value of RDMA.

eBay seller Liquid8Technology lists ConnectX-3 EN for $149.99 obo and I know they regularly accept @ $95 and might go lower. As you've noted finding $25-50 for ConnectX-2 EN is quite common though the seller's come and go.
 
Last edited:
  • Like
Reactions: MiniKnight

PigLover

Moderator
Jan 26, 2011
3,186
1,546
113
It doesn't look like any juniper switch that I've used so probably not a Juniper OEM. It does look interesting but is still pretty pricey for home/lab use. I'd be worried about how loud those fans would be!
 
  • Like
Reactions: MiniKnight

NetWise

Active Member
Jun 29, 2012
596
133
43
Edmonton, AB, Canada
It doesn't look like any juniper switch that I've used so probably not a Juniper OEM. It does look interesting but is still pretty pricey for home/lab use. I'd be worried about how loud those fans would be!
Well, it's supposed to be the step up version from the G8124F - and both of mine (G8124's) are pretty loud. They settle down to "moderately loud" but on startup, they're screamers to be sure.
 

Chuckleb

Moderator
Mar 5, 2013
1,017
331
83
Minnesota
Yeah be careful on which ConnectX3 you get. There are two lines of the VPI cards, some that do 10GbE and some that do 40GbE. the TCBT is 10GbE and the FCBT is the 40GbE. There are others in there too, those are the only ones I remember off the top of my hat. If you go CX3, you'll probably want to get some of the QSFP -> SFP+ adapters, they are about $30, so cheaper to buy the $25-30 box of CX2 cards.
 
  • Like
Reactions: T_Minus

T_Minus

Build. Break. Fix. Repeat
Feb 15, 2015
7,650
2,066
113
Yeah be careful on which ConnectX3 you get. There are two lines of the VPI cards, some that do 10GbE and some that do 40GbE. the TCBT is 10GbE and the FCBT is the 40GbE. There are others in there too, those are the only ones I remember off the top of my hat. If you go CX3, you'll probably want to get some of the QSFP -> SFP+ adapters, they are about $30, so cheaper to buy the $25-30 box of CX2 cards.
Thank you! I'd love to go all 40GbE... lol

Sounds like the CX2 is the way to go.
 

britinpdx

Active Member
Feb 8, 2013
367
184
43
Portland OR
Time to break out the Mellanox decoder ring again (from Mellanox docs) ..

Adapter Card part number takes the form of "MHTS#I-XBR" where the fields are as follows

M Mellanox Technologies
H Adapter Type H = InfiniBand Host Channel Adapter, N = Ethernet Network Interface Card
T Media (P = SFP+)
S Adapter Architecture
H = ConnectX®or ConnectX-2
# # ports 1 = 1, 2 = 2
I Host Interface X = PCI-X, 4 = PCIe x4, 8 = PCIe Gen1 x8, 9 = PCIe (Gen2 x8),
G Generation <blank> = Initial product generation, B= generation B, C= generation C
- Separator
X Memory Size X = MemFree, 1=128MB, 2=256MB, 3=512MB
B Bracket S = Short, T = Tall, N = None
R RoHS <blank> = non RoHS, C = RoHS R-5 w/ Exemption, R = RoHS R-6 Lead-Free

The most common cards on eBay of late are the MNPH29B and MNPH29D.

The current cheapest listing is this one ..