Drag to reposition cover

Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

rjrobert

New Member
Mar 7, 2023
7
2
3
Well, definitely something weird going on in my network. I just installed TFTP on my OpnSense firewall and connected the switch directly to it (no other switches in the way) and it’s working now. Can’t explain why, but I’ll take the win.

Thanks for the quick replies gents!
 

kickstart24

New Member
Jan 9, 2025
13
0
1
Looking to expand from the router on a stick config so I can do intervlan communication through the switch and offload the router.

On the Brocade, do I just need to set up the VLANs in the router config and then add the router-interfaces in the switch config (per Terry Henry's video). Anything else that needs to be done?
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,925
3,480
113
34
fohdeesha.com
Looking to expand from the router on a stick config so I can do intervlan communication through the switch and offload the router.

On the Brocade, do I just need to set up the VLANs in the router config and then add the router-interfaces in the switch config (per Terry Henry's video). Anything else that needs to be done?
transit vlan to the router, default route on the switch pointing to firewalls ip on that transit net, routes on the firewall for all your subnets pointing to the ICXs IP on the transit subnet, probably new outbound nat rules on the firewall for all your other subnets on the switch
 
  • Like
Reactions: cyinite

kickstart24

New Member
Jan 9, 2025
13
0
1
transit vlan to the router, default route on the switch pointing to firewalls ip on that transit net, routes on the firewall for all your subnets pointing to the ICXs IP on the transit subnet, probably new outbound nat rules on the firewall for all your other subnets on the switch
Thanks. Would the transit VLAN just be VLAN 1 with the port number used to communicate with the router untagged?

Do you know of any documentation/guides/old threads for setting up the brocade *with intervlan routing) connected to a router?

It looks like I just need to setup the VLANs, the router-interfaces, transit VLAN to router, and default route on the switch pointing to firewalls ip on that transit net. The rest of the setup is on the router?
 
Last edited:

kapone

Well-Known Member
May 23, 2015
1,392
825
113
Thanks. Would the transit VLAN just be VLAN 1 with the port number used to communicate with the router untagged?

Do you know of any documentation/guides/old threads for setting up the brocade *with intervlan routing) connected to a router?

It looks like I just need to setup the VLANs, the router-interfaces, transit VLAN to router, and default route on the switch pointing to firewalls ip on that transit net. The rest of the setup is on the router?
https://forums.servethehome.com/index.php?threads/layer-3-switch-w-pfsense.23236/post-216621
 

jmdomini

New Member
Jan 30, 2024
18
4
1
:eek::eek:

There should be plenty of heatsinks...
Got all the parts today and finished the rebuild. Good news is the temperatures look MUCH better. Bad news is GL are the replacement fans loud! I tried to stick with the existing (quiet) fans but the temp was hanging around 82C, which while an improvement still seemed high.

Slot 1 Current Temperature: 63.5 deg-C (Sensor 1), 37.0 deg-C (Sensor 2)
Warning level.......: 100.0 deg-C
Shutdown level......: 105.0 deg-C

I suppose it's probably too much to ask for a quiet and powerful fan?
 

zinm

New Member
Jan 8, 2025
1
0
1
Last edited:

kickstart24

New Member
Jan 9, 2025
13
0
1
I'm following the Fohdeesha guide for setting up an ICX6450. when I type "ip dhcp-client disable" or "router-interface ve 1" after typing "vlan 1", I get the following


ICX6430-24P Switch(config)#ip dhcp-client disable
Invalid input -> disable
Type ? for a list
ICX6430-24P Switch(config)#


ICX6430-24P Switch(config-vlan-1)#router-interface ve 1
Invalid input -> router-interface ve 1
Type ? for a list

What am I doing wrong?
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,925
3,480
113
34
fohdeesha.com
I'm following the Fohdeesha guide for setting up a ICX6450. when I type "router-interface ve 1", I get the following

ICX6430-24P Switch(config-vlan-1)#router-interface ve 1
Invalid input -> router-interface ve 1
Type ? for a list

what am i doing wrong?
you have an icx6430, not a 6450, and those do not support the routing.layer 3 firmware which the guide is based off of, it also has no 10gb
 

kickstart24

New Member
Jan 9, 2025
13
0
1
If you are flashing an ICX-6450, do you enter "setenv image_name ICX64xx/ICX64R08030u.bin" or "setenv image_name ICX64xx/ICX64S08030u.bin" ?
 

Ralph_IT

I'm called Ralph
Apr 12, 2021
216
116
43
/home
If you are flashing an ICX-6450, do you enter "setenv image_name ICX64xx/ICX64R08030u.bin" or "setenv image_name ICX64xx/ICX64S08030u.bin" ?
The file with 'R' in its name indicases 'routing' (layer 3) firmware.
The 'S' is for switching.
I'd install the 'R'.
 

poningru

New Member
Jul 24, 2024
17
20
3
Apologies if this has been covered before, Is there any difference in power usage between the router and switch firmware? I have an ICX7450, not sure I need the router firmware for anything other than management through the normal ports.
 

sic0048

Active Member
Dec 24, 2018
182
143
43
Any estimates what the life expectancy of the icx6450 are? Or brocade in general?
There are too many variables to accurately predict - heat, humidity, dust, the quality of the power being supplied, etc can all affect the lifespan of equipment.

That being said, enterprise network switches are designed to last YEARS running 24/7 without issues. I'd expect at least 5-10 years in a normal enterprise environment. In a typical home environment, I'd expect them to last even longer (probably well over 10 years) because they likely aren't being pushed as hard as they would be in a typical enterprise environment.

For example, in Jan 2019 I bought some enterprise network switches that were being sold by a recycler on Ebay (meaning they had already lived their useful life in the enterprise environment) and they have been running flawlessly. Those switches were initially released in 2012. I have no idea how old my particular units are, but they are likely older than 10 years and still working just fine.
 
Last edited:

Dave Corder

Well-Known Member
Dec 21, 2015
387
277
63
42
I just had something weird happen...

My ICX6610-40P core switch has two of the KAIAM QSFP+40G-LR4 optics. Each one is connected to a Dell R720 with a ConnectX-3 card (also with a KAIAM QSFP+40G-LR4 optic) via 5M SMF.

About two hours ago, at almost the same time (just 22 seconds apart), both of the connections went down, with nothing in the system log on the switch or the kernel logs on the other end. I did a reload on the switch and everything came back up normally.

I've never seen anything like that before, and until this, the switch has been rock solid for years. I'm at a loss for an explanation...anyone have any guesses as to what might have happened?
 

AntoineNet

New Member
Jul 25, 2024
8
0
1
NOTE #1: do not PM me with switch questions, they will be ignored - post them in this public thread, where hundreds of other members can also answer, and the answer will be public for future users

NOTE #2 06-22-2023: Yes, this post is still up to date and nothing has changed: in fact judging by google analytics, they're more popular than ever. A v2 of the popular config guide has just been published, and I've added licensing information to it so you can unlock your switches on your own


Firmware + Docs + Feature Licenses:
NOTE: If you buy any of these, use the setup guide at the following link. It will get you set up with a fresh slate, the latest firmware, & the latest documentation. It will also get you fully licensed if your switch requires it. Please do not post questions unless you've followed this first to get set up on the latest software:


Starting a master thread for a few of my favorite affordable switches - I've been using and reverse engineering this switch line for years and figured it's time to share the goodies. The prices below fluctuate a lot with demand and with the best offer feature can usually be beaten. Switches are listed in order of raw capacity/capability, not price.

Choice Beef Cuts:

Brocade FCX - ~$30 on ebay
  • original beef
  • 24/48 1gbE copper (PoE available)
  • I recommend these as a very cheap platform to learn networking with (as they support everything, including BGP), or a lab box. For switches to use in your permanent home network, you might want to look below at the newer models
  • Full layer 3, IPV4 + IPV6 routing, L2/L3/L4 ACL's, VRRP, OSPF, SNMP, sflow, VRFs, tunnels, BGP
  • No 10gbE by default. See Here for notes on adding 10gbE cards
  • The non-PoE models are a little quieter than a dell R710 or ICX6610
  • The PoE models are the loudest switch I've ever used - not recommended for home
  • Fans cannot be modified
  • ~40w power draw
  • 2x redundant hot-swap PSU's
  • Aggregate capacity: 152gbps / 114Mpps (wirespeed regardless of features enabled)
  • Again, these are best for a lab environment on a budget where you don't care about a bunch of 10gbE or noise, but want advanced networking features such as BGP and VRFs

  • Datasheet
Brocade ICX7150-C12P - ~$210 on ebay





Brocade ICX6450 - ~$120 on ebay
  • the beef snack
  • 24/48 1gbE copper (PoE available)
  • 4x 10gbE SFP+
  • Full layer 3, IPV4 + IPV6 routing, L2/L3/L4 ACL's, VRRP, OSPF, SNMP, sflow, all the usual
  • 25w power draw for the 24-port models with or without PoE
  • 50w power draw for the 48-port models with or without PoE
  • 1 small fan, nearly silent (48 port and PoE models have 2 or 3 fans, but they can be removed if you're not using near full PoE load)
  • single built in PSU
  • fans can be modified/replaced to run even quieter/near silent
  • Aggregate capacity: 176gbps / 132Mpps (wirespeed regardless of features enabled)

  • Datasheet
  • FAQ
  • Architecture Brief
Brocade ICX7250 - ~$300 on ebay

  • medium beef
  • 24/48 1gbE copper (PoE available)
  • 8x 10gbE SFP+
  • Full layer 3, IPV4 + IPV6 routing, L2/L3/L4 ACL's, VRRP, OSPF, SNMP, sflow, all the usual, but also adding VRFs and tunnels (but no BGP)
  • 50w power draw for the 24 port
  • 65w power draw for the 48 port
  • nearly silent (same sound level as the ICX6450)
  • single built in PSU
  • fans can be modified/replaced to run even quieter/near silent
  • Aggregate capacity: 256gbps / 190Mpps (wirespeed regardless of features enabled)

  • Datasheet
  • STH post with detailed information




Brocade ICX6610 - ~$200 on ebay
  • the BEEF KING
  • 24/48 1gbE copper (PoE available)
  • 16x 10gbE (8x SFP+ in the front, 8x via 2 QSFP+ breakout ports on the rear)
  • 2x 40gbE (separate from the previously mentioned breakout ports)
  • Supports OpenFlow in hardware for SDN, including hybrid port mode
  • SupportS MACSEC on the SFP+ ports for 80gbps of real time L2 AES-128 encryption
  • Same OS features as ICX6450 but adds advanced protocols like BGP, VRFs, tunnels, everything
  • 80w power draw for the 24 port models with or without PoE
  • 110w power draw for the 48 port models with or without PoE
  • audible - about the same as an R710, little quieter than LB6M
  • 2x redundant hot-swap PSU's
  • Fans cannot be modified
  • Aggregate capacity: 528gbps / 396Mpps (wirespeed regardless of features enabled)

  • Datasheet
  • FAQ
  • Architecture Brief
  • (note: when the above PDF's say the QSFP ports can only be used for stacking, they're lying)
Brocade ICX6650 - ~$600 on ebay

  • beef overload
  • 64x 10gbE (56x SFP+ on front, 8x via 2x QSFP breakout on the rear)
  • 4x 40gbE via rear QSFP (separate from QSFP breakout ports)
  • Supports OpenFlow in hardware for SDN, including hybrid port mode
  • Same OS features as ICX6610 - everything including advanced protocols like BGP, VRFs, tunnels, etc
  • 120w power draw
  • audible - louder than the ICX6610, not screaming but would not want it next to you
  • 2x redundant hot-swap PSU's
  • Fans cannot be modified
  • Aggregate capacity: 1600gbps / 1190Mpps (wirespeed regardless of features enabled)
  • does NOT support stacking
  • DOES support MCT / MC-LAG (cross-chassis LACP)
  • These start to lose out cost wise compared to some Arista models with the same port count, such as the 7050T-64 which are a very good value - it's up to you if you prefer Arista's EOS or Brocade's FastIron OS

  • Datasheet
  • STH post with detailed information


Software:
These all run Brocade's FastIron OS. If you've done the LB6M flash, it's the same as that (but a much newer version). If you've ever used cisco gear, the CLI is about 90% identical. It's still under active development for all of these switches (most recent firmware release for them was 2 weeks ago).

The firmware/docs are freely available from Ruckus's site (who acquired these from brocade), you just need to make a free account. I also mirror an easy to grab ZIP of the latest FW and docu on my update guide linked above.

Since it's been asked before, yes - all of these are proper ASIC L3 routers that do everything in hardware at line rate, with no oversubscription. Nothing is punted to the management CPU.

These are enterprise/datacenter switches, so the main focus is the CLI interface. However they do have a web UI - granted it's very minimal. You can see screenshots here: Imgur

Optics:
Brocade switches will take any make of optics, the brand does not matter. I've been using quite a few of the $7 dollar 10gbase-SR avago/jdsu/etc modules off of ebay with no issues for a few years. However since "official" Brocade SFP+ modules have come down in price to around $8, I would recommend those as they unlock optical monitoring, so you can see link strength, module temp, etc. They will take any manner of DAC's as well. Same goes for the 40gbE QSFP+ ports on the rear of the 6610 - optics or DACs, your choice.

NOTE: All Brocade switches are compatible with the Mikrotik S+RJ10 SFP+ 10gbase-T copper module, if you want to cheaply turn some of the sfp+ ports into rj45 10gbE copper ports: Mikrotik 6-Speed Rj-45 Module Up To 10Gbps Speeds

Other:
I've tried to keep these a secret hoping to not wreck the used market for them, but there seems to be enough on ebay now it shouldn't matter. Many STH members have already been using them and discussing them in PM's, and I figured all the info and stuff we've shared privately would be of much more use out in the open. I have reverse engineered quite a bit of all these switches and found some things that are nowhere else on the internet - I will post the discoveries I think won't get me in trouble here as I find time


Hi ! This is AMAZING! Could anyone confirm if this method still works to enable licensing of the 10 Gigabit SFP+ ports on the switch for the Brocade ICX6610. Thanks in advance