Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)

[chlastakov]

There is no licensing (its honor based) for Arista you can use everything without a worry.

Perfect, thank you!

I found Arista DCS-7050TX-64 which is exactly what I'm looking for. Only downside is 315W / 387W Typical/Max Power Draw (Typical power consumption measured at 25C ambient with 50% load)

Brocade ICX7750 120W idle sounds much better, but maybe I miscalculated "Typical Power Draw". What exact problem you have with "PowerPC and DDR3 SO-RDIMM"? You needed to replace them? I never replaced switch components before, just used them.

I'm also looking at Arista DCS-7050S-52, which have only SFP+ ports, but have 103W / 185W Typical/Max Power Draw. I did know that RJ45 10G switches are power hungry, but I don't know how to avoid them. Buying SFP+ to RJ45 module for each port is expensive and I don't know if power draw would be better compared to RJ45 switch at all.

 

[NablaSquaredG]

I found Arista DCS-7050TX-64 which is exactly what I'm looking for. Only downside is 315W / 387W Typical/Max Power Draw (Typical power consumption measured at 25C ambient with 50% load)

They calculate power draw differently.

I have a 7050TX sitting on my desk right now, it takes 200W in IDLE.

Brocade ICX7750 120W idle sounds

The 120W IDLE were for the -48F SFP+ model, I didn't know you were looking for RJ45.


The Brocade ICX7750(-48F / -48C / -26Q) and the Arista 7050 (TX / SX / QX) have the same chip (Broadcom Trident II) - so they will pretty much require the same power

hat exact problem you have with "PowerPC and DDR3 SO-RDIMM"? You needed to replace them?

PowerPC is potentially slow. DDR3 SO-RDIMM is impossible to find in case it breaks. I had an ICX7750-48F with broken SO-RDIMM, so I know quite well..

Buying SFP+ to RJ45 module for each port is expensive and I don't know if power draw would be better compared to RJ45 switch at all.

No, those SFP+ to RJ45 modules are usually less power efficient (and less range, etc) than a switch with native RJ45 ports.

I did know that RJ45 10G switches are power hungry, but I don't know how to avoid them.

What's your use case? Do you need 48x 10G RJ45 ports? If you really need them, those 200W for the switch should not be a problem.

 

[chlastakov]

The Brocade ICX7750(-48F / -48C / -26Q) and the Arista 7050 (TX / SX / QX) have the same chip (Broadcom Trident II) - so they will pretty much require the same power

That was very usefull. I go with Arista 7050 then. Many thanks.

What's your use case? Do you need 48x 10G RJ45 ports? If you really need them, those 200W for the switch should not be a problem.

My Supermicro servers unfortunately have mostly RJ45 10Gbit ports. For now it's simpler with classic 1G switches, but I'd like to upgrade whole rack to 10G. I'm expanding from one rack setup to two racks, so I'm considering simplest and cheapest option that includes stacking for LAG across switches.

 

[nintendoeats]

I just wanna say @fohdeesha I used to work as a technical writer. Your documentation is very good. Also, do I spy Asciidoc and Antora?

 

[klui]

I have a 7050TX sitting on my desk right now, it takes 200W in IDLE.

I think it's due to your 7050TX being a 72 instead of a 64. The latter idles between 160-170W 103-113W (see https://forums.servethehome.com/index.php?threads/power-consumption-thread.34673/post-456637). I'm surprised 2 more QSFP/2 MXP requires that much idle power.

 

[panterateama]

Hey all, I just wanted to jump on and say thanks to fohdeesha and everyone else for helping me pick my next switch. I wanted some 10Gb goodness so upgrading from Cisco 3750X to a Brocade 7250-48P. I lucked out on a used one for $75 CAD in mint shape from an electronics recycling place nearby that said it was in working order and pulled from production recently.

Sadly, I did not get a mini USB cable to go with it they only had the one they use for the shop... I didn't realize I would need one before I bought it so I spent all of last night (2am ish) trying to cobble together a usb to serial adapter to cisco console rj45 cable to keystone to hacked up mini usb cable... it was a mess lol.

I got it to show me the console readout while it boots but would not take any input in putty. Tried a few key combos, changed some settings in putty and still nothing. I could see output, but could not seem to send anything to it. I hit keys and nothing showed on the console screen. (I've used the same com cable and console cable with the Cisco with no issue so I know its fine. Not sure if I'm missing something or if its just my janky keystone to mini usb.

So ordered a com to mini usb cable from amazon hoping it'll work. Wish me luck

Is there really no way to console this think with rj45?

Also, this thing screams when it starts up, which is expected, but even once its idling, its a lot louder than the Cisco I have running currently. I've seen some people add 120mm fans to the top of the case but that adds to rack space and have only a 24U rack, I'm trying to avoid anything that sticks out.

I know there a lot of other fan models recommended, but with 517 pages of posts on this thread dating back nearly 6 years, I've only been able to go through about a 10th of it so far, I was wondering if there are any in specific that would be recommended for 2025. I see Noctua has some 40x20 fans but they don't have a very high CFM or static pressure so I'm worried about heat.

Any recommendations before I start opening it up and tinkering are appreciated!

Thanks again!

 

[kapone]

I've only been able to go through about a 10th of it so far

Keep going...

A word of advice, not just to you but to all "newbies" (Sorry, had to say it) - There's no shortcuts. No one is sitting here waiting for you to ask questions and simply give you the answer.

Learn. Read. Educate yourself on these things. Don't ask stupid questions (They've all been asked and most likely answered a few years back)

This is enterprise gear you're playing with....very different from consumer gear.

 

[panterateama]

@kapone no worries and I completely understand. lol, my Cisco 3750 48 port PoE L3 Switch aint a linksys either haha. I know my way around an enterprise switch, but I've never modded ones internals before

And don't worry, I plan on reading every word before I dive into replacing the Cisco fully. I just didn't want to let a good deal pass by as the recyclers usually sell stuff quick so I didn't want to wait before bringing it home.

I'll do my best to read through and try to extract the good stuff I need.

 

[RoachedCoach]

Hey all, I just wanted to jump on and say thanks to fohdeesha and everyone else for helping me pick my next switch. I wanted some 10Gb goodness so upgrading from Cisco 3750X to a Brocade 7250-48P. I lucked out on a used one for $75 CAD in mint shape from an electronics recycling place nearby that said it was in working order and pulled from production recently.

Sadly, I did not get a mini USB cable to go with it they only had the one they use for the shop... I didn't realize I would need one before I bought it so I spent all of last night (2am ish) trying to cobble together a usb to serial adapter to cisco console rj45 cable to keystone to hacked up mini usb cable... it was a mess lol.

I got it to show me the console readout while it boots but would not take any input in putty. Tried a few key combos, changed some settings in putty and still nothing. I could see output, but could not seem to send anything to it. I hit keys and nothing showed on the console screen. (I've used the same com cable and console cable with the Cisco with no issue so I know its fine. Not sure if I'm missing something or if its just my janky keystone to mini usb.

So ordered a com to mini usb cable from amazon hoping it'll work. Wish me luck

Is there really no way to console this think with rj45?

Also, this thing screams when it starts up, which is expected, but even once its idling, its a lot louder than the Cisco I have running currently. I've seen some people add 120mm fans to the top of the case but that adds to rack space and have only a 24U rack, I'm trying to avoid anything that sticks out.

I know there a lot of other fan models recommended, but with 517 pages of posts on this thread dating back nearly 6 years, I've only been able to go through about a 10th of it so far, I was wondering if there are any in specific that would be recommended for 2025. I see Noctua has some 40x20 fans but they don't have a very high CFM or static pressure so I'm worried about heat.

Any recommendations before I start opening it up and tinkering are appreciated!

Thanks again!

As far as the console cable, I lucked out with an ebay one that apparently no longer exists - but a lot of people seemed successful with this reddit thread:
https://www.reddit.com/r/Brocade/comments/b71xtq
For fans, this was my solution and it's going on 5 years so I'm gonna call it successful. Requires no case cutting, but you do add a fan internally, plus replace the originals. You DO NOT want Noctuas, they are nowhere remotely up to the task.

https://forums.servethehome.com/index.php?threads/brocade-icx-series-cheap-powerful-10gbe-40gbe-switching.21107/page-159#post-256375

 

[panterateama]

As far as the console cable, I lucked out with an ebay one that apparently no longer exists - but a lot of people seemed successful with this reddit thread:
https://www.reddit.com/r/Brocade/comments/b71xtq
For fans, this was my solution and it's going on 5 years so I'm gonna call it successful. Requires no case cutting, but you do add a fan internally, plus replace the originals. You DO NOT want Noctuas, they are nowhere remotely up to the task.

https://forums.servethehome.com/index.php?threads/brocade-icx-series-cheap-powerful-10gbe-40gbe-switching.21107/page-159#post-256375

Thanks for the info!

 

[panterateama]

I picked up a standard rs232 to mini usb cable and connected it to my FTDI usb to console rs232 cable for my cisco and got it. I can finally send commands! first things first, it was part of a stack so I removed it from stack.

Now to play!

 

[nintendoeats]

Just wanted to update on my 6450-48p from calgarycomputerwholesale, since they still have a lot of units at very nice prices. I realized after my first post that I should have specified this was mostly relevant to Canadians (since generally options are fewer and prices higher here). I guess I figured since I mentioned CAD that was implied.

Arrived well packed. The rightmost RJ45 module was a little bit impacted; it might have gotten a whack at some point. I was able to work it back no problem and I'm using a few ports on it it without issue.

So far everything I've tried as been working. It reports PoE and I can enable it. My sole PoE device is a Netgear GS108Tv2, and the Brocade reported that it had "incompatible signaling" or something similar. This doesn't worry me, because I think it's some combination of sketchy cabling between the two switches, the age of the Netgear, and the fact that I disabled legacy PoE.

I'm still waiting for my fibre gear so I haven't been able to try the SFP+ ports. The switch itself seems to think they are just fine.

Other than that I have been able to follow the guide, bring it up, and integrate it into my simple setup without issue. Even set a nice banner.

 

[korpo53]

Hi all,

I recently picked up a 7250 to sit on the other side of the house from my 6610, and I'm running into problems on step 1 of configuring it. I tried a Proliphic USB-serial adapter and serial to mini-USB, as well as a FTDI Cisco cable to the hacked up keystone and cable linked above. In both instances I get console output as expected, but it ignores my keypresses. That's "mash b for bootloader" and once it boots, "press enter to log in". I get the same behavior with Putty or Royal TS, and I've been pulling my hair out with this for days.

I have no reason to think any of the cables are bad, I get information as it boots, and the Cisco cable works fine for my 6610. I'm happy to buy a different cable if what I have isn't right, but at this point I've spent almost as much in cables as on the switch. Is there anything in the console output that would tell me what's wrong, or should I be doing something with the reset button, or something else? Any other ideas before I throw this thing across the room?

 

[panterateama]

@korpo53 I had the exact same issue with a hacked up mini usb. I could see it, but couldn't type anything in. I ended up using an FTDI usb to com cable and an rs232 to mini usb cable from amazon. I'm in Canada but I assume it should be similarly available in most places. Heres the link for the rs232 to mini usb: https://www.amazon.ca/dp/B09TFGV7Z1?ref=ppx_yo2ov_dt_b_fed_asin_title As for the ftdi usb to com port, I got it years ago for use on a cisco switch so I'm not sure brand or model but I know its FTDI. Also double check the putty/console settings for the communication.

Best of luck!

 

[korpo53]

@korpo53 I had the exact same issue with a hacked up mini usb. I could see it, but couldn't type anything in. I ended up using an FTDI usb to com cable and an rs232 to mini usb cable from amazon. I'm in Canada but I assume it should be similarly available in most places. Heres the link for the rs232 to mini usb: https://www.amazon.ca/dp/B09TFGV7Z1?ref=ppx_yo2ov_dt_b_fed_asin_title As for the ftdi usb to com port, I got it years ago for use on a cisco switch so I'm not sure brand or model but I know its FTDI. Also double check the putty/console settings for the communication.

Best of luck!

Thanks @panterateama, that gives me hope that this stupid thing doesn't have to go back to eBay. This is the cable I was using:

https://www.amazon.com/dp/B0CL2BPDNK?th=1

They all look similar enough, but this one had reviews saying "works with Brocade switches", and was recommended somewhere on Reddit, so I went with that.

I just ordered a FTDI USB to serial thing, so wish me luck that's the final piece of the puzzle. Of course, this all happens two weeks after I clean out that big box of assorted cables in the garage I'll never use.

 

[chlastakov]

I can't help myself, but it looks like that 6xxx series are better than 7xxx. At least in terms of the number of ports. 7xxx of course have better throughput and allow more units in stack. 6xxx is much cheaper, at least in EU (we have 2x to 3x prices than in US generally). Any good reason to buy 7xxx instead of 6xxx? Any other than it's newer and have newer firmware? What do you think?

 

[BoGs]

I can't help myself, but it looks like that 6xxx series are better than 7xxx. At least in terms of the number of ports. 7xxx of course have better throughput and allow more units in stack. 6xxx is much cheaper, at least in EU (we have 2x to 3x prices than in US generally). Any good reason to buy 7xxx instead of 6xxx? Any other than it's newer and have newer firmware? What do you think?

There is a slightly newer firmware I believe but overall 6610 will use more power, then the 7{1,2}xx but not have the port diversification. I sometimes debate going back to my icx6610 if it would be less power then a 48 port sfp and a poe switch

 

[chlastakov]

There is a slightly newer firmware I believe but overall 6610 will use more power, then the 7{1,2}xx but not have the port diversification. I sometimes debate going back to my icx6610 if it would be less power then a 48 port sfp and a poe switch

You can't compare 6610 with 7{1,2}xx which both have single PSU. I believe 7450 is the one you want to compare with

 

[i386]

Any good reason to buy 7xxx instead of 6xxx?

multi gig support, 802.3bt poe (up to 90w per port)

edit: of course for specific models

 

[BoGs]

multi gig support, 802.3bt poe (up to 90w per port)

edit: of course for specific models

That is what I run an ICX7150-48PZ and it is WAY louder then my 6610, by a long shot. 7450 is quieter and PoH, so maybe that which I was testing. Overall I am not on board with multigig with the noise and power requirements.

Plus Ruckus / brocade have the stupid 2 tier cooling, stage 1 or 2. My Arista scales up and down with temperature, why can newer switches not have that as my 7150 runs at 32c.