Cheapest Way to Go 10 Gig or Faster?

[Kneelbeforezod]

My new used SM 24 Bay came with an Intel X-520 DA2 so I'd Like to to 10 gig or faster. From Everything I've read i should be able to do direct connect between my workstation which the the dual 2696V3 and the Server without the need for a 10 gig switch. I was looking at getting a MCX312A-XCBT. What cable would would i need? From what i understand shorter runs can use passive under 5M and Active Over 5m. Would I also need the transcievers?

 

[Blinky 42]

If your 2 servers are physically close, go ahead and get a used or new SFP+ DAC. I would avoid them over 5M - the cost for the active DAC's is usually on par with getting a pair of SFP+ transceivers and whatever length of fiber you need. The active DAC cables also don't seem to be as well supported in interfaec cards (better luck in switches).
DAC cables are also a bit more of a pain to run vs fiber with the somewhat fragile twinax cable and the bulky SPF+ and strain relief on each end.

I have a whole slew of Arista and Cisco DAC cables, they seem fine in everything but HP switches which are a royal pain and need HP branded cables.
SFP-H10GB-CU3M CISCO SFP + TWINAX COPPER CABLE 3M PASSIVE DAC CABLE | eBay I have many of these that work with Mellanox and intel cards, Quanta and Juniper switches

 

[Kneelbeforezod]

I'm looking at about 20 feet from box to box - longer if i route the cable around the periphery of the room

 

[Blinky 42]

For 20ft - go with SR SFP+ optics and OM3 fiber. New or used will probably be fine - new is pretty cheap these days (~$12/transceiver), used is probably ~$5. Used fiber is a bit more hit and miss depending on how abused it was when installed / removed.

 

[Blinky 42]

Example new list prices from fiberstore - trick is shipping, so buy more to amortize the shipping out
OM3 50/125 LC-LC Multimode Fiber Optic Cable Duplex 7m (23ft) - Aqua | FS.COM - 7m OM3 LC/LC $4.70
Best Price Cisco SFP-10G-SR 10GBASE-SR SFP+ LC Transceiver| FS.COM - SFP+ 850mm module $16 x2

Most things I order from them come from the USA so are a lot faster than it used to be with DHL from China.

 

[Kneelbeforezod]

For 20ft - go with SR SFP+ optics and OM3 fiber. New or used will probably be fine - new is pretty cheap these days (~$12/transceiver), used is probably ~$5. Used fiber is a bit more hit and miss depending on how abused it was when installed / removed.

OK that's what i thought - i found this in a broadcom document:
For mid-range distances, use laser optimized multi-mode fiber (LOMMF) cables, either OM3 or OM4, with SFP+ connectors

Thanks!

 

[Kneelbeforezod]

Those prices aren't bad at all

 

[i386]

Cheapest Way to Go 10 Gig or Faster?

10gbe:
mellanox cx2 or cx3, the cx2 can be had for <15$, cx3 20-30$
cisco sfp+ 3m cables (compatible with most switches & nics) ~10$
transceivers from different brands 5$+

40gbe:
mellanox cx3 (hp, dell or ibm/lenovo branded) ~35$ (vpi nics, support ethernet and infiniband)
qsfp+ 3m cables (ibm branded) 15$+
cisco 40gbe multimode transceivers ~25$

100gbe:
mellanox cx4 (hp branded), >=320$ (vpi nics, support ethernet and infiniband)
qsfp28 3m cables 120$+
transceivers 130$+

 

[Kneelbeforezod]

40gbe:
mellanox cx3 (hp, dell or ibm/lenovo branded) ~35$ (vpi nics, support ethernet and infiniband)
qsfp+ 3m cables (ibm branded) 15$+
cisco 40gbe multimode transceivers ~25$

The OM3 Stuff would work for 40 since it go up to 100 gbe right?

 

[Evan]

The OM3 Stuff would work for 40 since it go up to 100 gbe right?

Yep. Works fine.

 

[Evan]

Cisco DAC in only double the price of a quality CAT7 cable and about the same price as a quality OM4 patch cable when you have a good discount with Cisco.
For short range they are what I would use for server connections if SFP+