Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)

[Drewy]

@richtj99
you don’t need a lag between switches that are stacked. Stacking makes them 1 logical switch. All vlans etc are available on both switches. The stack link\connection handles all management and inter switch traffic. You don’t have to run additional lags between the switches, the stack does it all.

 

[SuperMiguel]

Does stacking only work with certain port? Certain cable?

I have two 6610 want to use the 10g for stacking

 

[ozkan]

the 7250 doesn't have fan or PSU modules, they're all built in. Sounds like @ozkan your fan is failed or not being detected properly, on the integrated units without hotswap stuff it will report that as a generic PSU failure sometimes. Check that the fan is spinning

I think I found the problem, but have no idea how to solve. There is small warning when I boot the switch with 8030u;

ICX7250-48 Switch>Successfuly set IngressClassPort on CPU port to 2

PS 1, Internal Power supply detected with no power.

ICX7250-48 Switch>en

Is there any idea what causes this ?

Edit :

I've got my hands dirty and checked every point that measurable. PSU output seems good;

EMPTY
Yellow : 12.01V
Yellow : 12.01V
EMPTY
Black : GND
Black : GND

There seems 2x 12V feeding DC converter board.

12V DC connector on switch board;

1. Orange : 3.4V 6. Orange : 3.4V
2. Brown : 3.4V 7. Brown : 3.4V
3. Green : 3.4V 8. Yellow : 3.4V
4. Black : GND 9. Yellow : 11.7V
5. Black : GND 10. Yellow: 11.7V

Fan pins also read;
11.67V

PSU seems OK, but I powered the switch on, PWR led is orange and not green. I think I need to find 2x 12V DC PSU to test if inline PSU is the problem.

 

[CorvetteGS]

Haven't had a chance to re-write the guide with new instructions for getting to the recommended 8092 train - it's the new UFI images that require a bit more steps for switches with older firmware. Been working on it this week though.

Hey @fohdeesha is this going to happen in the near future? Just picked up a new switch and I'm debating on waiting for the revised guide before messing with it or if I should just use the guide as it stands now and do it all over when you update it with the latest firmware. Thanks for your hard work!

 

[Rttg]

if you would like to actually block anything on physical port 20 from getting out to the internet, that's also possible, but it requires creating and applying the ACL a little differently

I hate to revisit this mention from a few years back, but can you apply ACLs to a single port when running the router image on an ICX6450?

For some reason, I’m only seeing the ‘ip access-group’ option when configuring a ``ve`` not a physical interface (and because I’m looking to add 802.1p marking to packets flowing across a single, unrouted VLAN, that doesn’t seem to work).

 

[richtj99]

A follow up question.

Right now I am using two 6450's:

Switch 1: 1/2/1, 1/2/2, 1/2/3 are in a lag to switch 2.
Show Int brief shows a 30gb lag

With the ICX7250:

If I setup a stack, how would I be able to setup that same 30gb lag (assuming the 6450 units go away)?

Or is the best I can do is stack two 10gb connections?

@richtj99
you don’t need a lag between switches that are stacked. Stacking makes them 1 logical switch. All vlans etc are available on both switches. The stack link\connection handles all management and inter switch traffic. You don’t have to run additional lags between the switches, the stack does it all.

 

[Drewy]

pretty sure some of what you can do related to stacking will be dependant on the firmware version you are running.
with the 7250 up to 4 of the 10gb ports can be used for stacking. You can also configure truck stack ports, (I think) you could use any of:
1 port each switch - linear stack
2 ports each switch - either trunked linear stack or a non trunked ring stack
4 ports each switch - trunked ring stack

ICX 7250 stacking topologies

docs.ruckuswireless.com

 

[fohdeesha]

I hate to revisit this mention from a few years back, but can you apply ACLs to a single port when running the router image on an ICX6450?

For some reason, I’m only seeing the ‘ip access-group’ option when configuring a ``ve`` not a physical interface (and because I’m looking to add 802.1p marking to packets flowing across a single, unrouted VLAN, that doesn’t seem to work).

enable
conf t
enable acl-per-port-per-vlan
write mem
reload

Commscope Technical Content Portal

docs.commscope.com

 

[fohdeesha]

Hey @fohdeesha is this going to happen in the near future? Just picked up a new switch and I'm debating on waiting for the revised guide before messing with it or if I should just use the guide as it stands now and do it all over when you update it with the latest firmware. Thanks for your hard work!

I would just follow it now, I hope to get it updated this week but work has been really unpredictable. Once you follow the guide, when the new version / later codetrain is out, you will be able to jump to it with a single command

 

[SuperMiguel]

Does stacking only work with certain port? Certain cable?

I have two 6610 want to use the 10g for stacking

bump

 

[fohdeesha]

bump

6610 can only use the rear 40gbe ports for stacking. all of this and pretty much every question on the last 3 pages is answered in the documentation included in the firmware zip. specifically fastiron-08030b-switchstackingguide.pdf for the 6 series and fastiron-08080-switchstackingguide.pdf for the 7 series

I'll be disappearing from this thread in a month or two so you all need to get accustomed to reading documentation

 

[infoMatt]

I'll be disappearing from this thread in a month or two

Whaaaaat??? Have you found some other toys to play with?

 

[i386]

I'll be disappearing from this thread in a month or two so you all need to get accustomed to reading documentation

I think you replied/answered to too many simple questions and folks got spoiled ._.

 

[tozmo]

Between the first page, fohdeesha’s website, the search function here, we have almost everything sorted from “routine use” perspective.

maybe people can catalogue our findings here, Brocade ICX Series at home Wiki

 

[Drewy]

A quick sanity check if I may. Not looking for solutions\instructions, just a simple yes or no will suffice.
i’m wanting to use l3 routing for some of my subnets but other (the internet of tat) I’d like to still route via my opnsense box which will also be the default route for the subnets that are routed l3 at the switch.
At some point (assuming I get comfortable with extended acl’s) all routing may happen at the l3 switch level but the “mixed” model allows me to get the internal 10gb traffic routed at line speed at not capped at 1gb by the opnsense box, sooner.
is this possible (not how, I can read manuals and earlier posts…) ?

 

[infoMatt]

is this possible (not how, I can read manuals and earlier posts…) ?

Yes. Define VEs on the VLANs that you want to be routed inside the switch, and let the others be defined as pure layer2, w/out any IP addresses.

 

[nw60312]

In the layer 3 example above, is it possible to have the switch route traffic but forward things like mdns broadcasts to the opnsense router where they can be reflected to select other vlans?

 

[infoMatt]

In the layer 3 example above, is it possible to have the switch route traffic but forward things like mdns broadcasts to the opnsense router where they can be reflected to select other vlans?

The easiest way that I can think of is to use a linux box running Avahi with an interface on every VLAN where you want to listen and repeat the mDNS queries to. Be careful with the firewall rules on this machine, or it can be used to "jump" between networks.

 

[LodeRunner]

The easiest way that I can think of is to use a linux box running Avahi with an interface on every VLAN where you want to listen and repeat the mDNS queries to. Be careful with the firewall rules on this machine, or it can be used to "jump" between networks.

Having to do stuff like hoping the mdns-proxy/avahi-reflector would work stably and not cause grief for my wife is why I flattened my network back out after having full layer 3 VLAN routing done on the switch.

 

[Propaganda]

What is recommended for firmware L2(sps) or L3(spr)? I will be running some vlans which pfsense is handling the routing on at the moment so should I just stick to L2?