40GBE/100GBE Upgrade on the cheap

[alex1002]

Good Morning,
Thanks for Serverthehome I was able to get 10GBE for cheap. Now I am ready to go for 40/100GBE. Can you guys make some recommendation for switches/cards on a budget.
Thank you

 

[pyro_]

How many ports do you need

 

[i386]

40gbe:

Switches: Arista 7050 series, available in different configurations from 2-32 qsfp+ ports. They are eol, but can get security/firmware updates till december 2018. Price varies depeding on the configuration, $450-$950

Nics: Mellanox connectX-3 vpi (pro) and en cards, hp branded cads can be had for <$50/pc on ebay.

100gbe:

Switches: Cheapest switch I have seen on ebay was >$5000, HP branded Mellanox switch
Nics: Mellanox ConnectX-4 vpi, >$350/pc

I would get 40gbe gear as 100gbe is very expensive and the nics require x16 slots.

 

[alex1002]

I need 8-12 ports. But bet most switches are min 24.

Sent from my LG-H831 using Tapatalk

 

[pyro_]

There are a number of them that only offer 2-4 ports but have additional gig or 10gb ports which is why i asked as those would be cheaper if you only really needed a handful of them. But ya for your needs you will need a larger switch than that

 

[fractal]

There are a number of them that only offer 2-4 ports but have additional gig or 10gb ports which is why i asked as those would be cheaper if you only really needed a handful of them. But ya for your needs you will need a larger switch than that

I too have been looking at that EOL Arista but the power/heat/noise are turning me off.

Not to hijack the thread, but what might you recommend at 2-4 ports? Hopefully something with some 10G ports or that support 10G fanouts.

 

[MiniKnight]

@fractal 40G w 10G? There's 48 10G w/ both 4 and 6 40G but they're gonna use the same power.

 

[CookiesLikeWhoa]

I too have been looking at that EOL Arista but the power/heat/noise are turning me off.

Not to hijack the thread, but what might you recommend at 2-4 ports? Hopefully something with some 10G ports or that support 10G fanouts.

The Arista can have the fans turned down from the cli. I have mine set at 40%. You could sleep with it on no problem. Heat isn't an issue either. But the power draw is something.

 

[i386]

I need 8-12 ports.

Mellanox has some ethernet switches with 12x 40 or 100gbe ports, but they are the opposite of cheap.

I have the Arista 7050Q-16 which can be configured as 16x 40gbe or 14x 40gbe + 8x 10gbe ports:

 

[_alex]

Mellanox has some ethernet switches with 12x 40 or 100gbe ports, but they are the opposite of cheap.

I have the Arista 7050Q-16 which can be configured as 16x 40gbe or 14x 40gbe + 8x 10gbe ports:
View attachment 7101

Did you measure the power draw of these ?
Power-Usage for the Mellanox 12-Port 40GbE Switches is imho exceptionally low, in the range of 35-40W.

 

[pyro_]

I too have been looking at that EOL Arista but the power/heat/noise are turning me off.

Not to hijack the thread, but what might you recommend at 2-4 ports? Hopefully something with some 10G ports or that support 10G fanouts.

Take a look at the juniper ex4300. 4x 40gb built in and you can get a 4x10gb sfp+ module for them. Will also have 24 or 48 gig ports and have poe+ as an option


Sent from my iPhone using Tapatalk

 

[i386]

4x 40gb

My interpretation of his other post was that he needs 8-12 40gbe ports

 

[pyro_]

I was replying to fractals comment that he was interested in the 2-4 port options


Sent from my iPhone using Tapatalk

 

[hweisheimer]

Did you measure the power draw of these ?
Power-Usage for the Mellanox 12-Port 40GbE Switches is imho exceptionally low, in the range of 35-40W.

I was curious about this too, and Arista's data sheet says "Typical / Maximum Power Draw* 192W / 303W"

 

[Evan]

That Mellanox SX1012, the SX6012 56G infiband switch looks the same, I wonder if they are identical inside and a cross flash is possible...

 

[Evan]

That Mellanox SX1012, the SX6012 56G infiband switch looks the same, I wonder if they are identical inside and a cross flash is possible...

Found this thread ... just made the connection

Beware of EMC switches sold as Mellanox SX6XXX on eBay

 

[i386]

That Mellanox SX1012, the SX6012 56G infiband switch looks the same, I wonder if they are identical inside and a cross flash is possible...

Very likely that mellanox used the same hardware. Question is what will be required to boot mlnx-os (or another operating system).

 

[Evan]

Very likely that mellanox used the same hardware. Question is what will be required to boot mlnx-os (or another operating system).

My google-fu is lacking or looks not possible at least in an easy way. Shame as there is a lot more used 6012’s around I am sure.
At the stated idle power of the switch it would be perfect for home, who needs 10 when you can have 40

 

[Chankster]

My google-fu is lacking or looks not possible at least in an easy way. Shame as there is a lot more used 6012’s around I am sure.
At the stated idle power of the switch it would be perfect for home, who needs 10 when you can have 40

Short answer: message @mpogr from the thread linked above and they can help you convert it over.

 

[alex1002]

I am getting serious about the juniper ex4300. Hows the command config learning curve for these switches. I never owned juniper before.

Sent from my LG-H831 using Tapatalk