Drag to reposition cover

Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

Matt0925

New Member
May 13, 2024
6
0
1
looks fine to me, altho the "ip route 192.168.1.0/24 192.168.1.1" statement is redundant as you already have a default pointing to the same IP. that much flapping on every single port really looks like a hardware fault, can you unplug one connection at a time and see if it goes away? this includes the whole SFP+ copper module, maybe one of them is bad and friggin things up
Thanks for the thoughts. I probably added the duplicate when I was trying to figure out why my connection was dropping, at first I figured I messed up setting things up so I was reentering some of it. So the line "ip route 0.0.0.0/0 192.168.1.1" accomplishes the same thing? I can remove the redundant one, though it doesn't sound like it's the cause of my issues?

Right now I just have it connected to the router through a dumb switch into one of the 1gig ports and the UPS plugged into it. Not showing a dropped connection on either of those since yesterday. Both transceivers are still plugged in, though nothing into them. I'll remove one, add my PC to the other and give it some time, see if that causes a problem, add unRaid and work my way up.

My other issue is I'm on a timeline, return window closes in just a couple days so I'm inclined to ship this one back and grab another off eBay instead. But I'll report back with any findings, thank you

Next morning edit-

Started with the PC last night, no drops for about an hour. Added the unRaid server through the DAC cable, no drops. I then moved PC to another port and the other transceiver, then not thinking put the PC to sleep so of course it disconnected. But started back up this morning and it's had no disconnects since. So at this point it does not seem to be the PC, unRaid, DAC cable or either transceivers causing issues.

Leaves two options, OPNSense or the backup unRaid connection. My guess is OPNSense, though not a clue what the cause could be. Regardless when I get a chance I'll connect it as well and see.
 
Last edited:

fohdeesha

Kaini Industries
Nov 20, 2016
2,780
3,150
113
33
fohdeesha.com
Thanks for the thoughts. I probably added the duplicate when I was trying to figure out why my connection was dropping, at first I figured I messed up setting things up so I was reentering some of it. So the line "ip route 0.0.0.0/0 192.168.1.1" accomplishes the same thing? I can remove the redundant one, though it doesn't sound like it's the cause of my issues?

Right now I just have it connected to the router through a dumb switch into one of the 1gig ports and the UPS plugged into it. Not showing a dropped connection on either of those since yesterday. Both transceivers are still plugged in, though nothing into them. I'll remove one, add my PC to the other and give it some time, see if that causes a problem, add unRaid and work my way up.

My other issue is I'm on a timeline, return window closes in just a couple days so I'm inclined to ship this one back and grab another off eBay instead. But I'll report back with any findings, thank you

Next morning edit-

Started with the PC last night, no drops for about an hour. Added the unRaid server through the DAC cable, no drops. I then moved PC to another port and the other transceiver, then not thinking put the PC to sleep so of course it disconnected. But started back up this morning and it's had no disconnects since. So at this point it does not seem to be the PC, unRaid, DAC cable or either transceivers causing issues.

Leaves two options, OPNSense or the backup unRaid connection. My guess is OPNSense, though not a clue what the cause could be. Regardless when I get a chance I'll connect it as well and see.
wait, backup unraid connection? so unraid is connected to the switch twice?
 

Matt0925

New Member
May 13, 2024
6
0
1
wait, backup unraid connection? so unraid is connected to the switch twice?
I have unRaid set up to use two NICs, I believe bonded is the term? It'll run with one or the other and is supposed to work with both as well.

Currently 10 gig NIC is connected to the 7250 through a DAC cable. 1 gig is connected to a regular switch that's also connected between the router and 7250. In the past I did have both connected to the 7250 however
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,780
3,150
113
33
fohdeesha.com
I have unRaid set up to use two NICs, I believe bonded is the term? It'll run with one or the other and is supposed to work with both as well.

Currently 10 gig NIC is connected to the 7250 through a DAC cable. 1 gig is connected to a regular switch that's also connected between the router and 7250. In the past I did have both connected to the 7250 however

if it's a plain bond then you've created a loop by plugging both in and that would be why all the ports are flapping, although I would have expected to see loop detected/stp messages in your logs - I guess stp defaults to off in the l3 image though, so just the broadcast storm probably started taking ports down. In unraid you'd need to configure something aware like failover or lacp or active/passive bonds etc
 

Matt0925

New Member
May 13, 2024
6
0
1
if it's a plain bond then you've created a loop by plugging both in and that would be why all the ports are flapping, although I would have expected to see loop detected/stp messages in your logs - I guess stp defaults to off in the l3 image though, so just the broadcast storm probably started taking ports down. In unraid you'd need to configure something aware like failover or lacp or active/passive bonds etc
I thought I'd followed directions to get it set up to support both being connected but certainly possible I have an error somewhere, I'll check on those settings and adjust though realistically I probably don't need both connections.

Is having the two connections on different switches enough to avoid the issue? I guess I'd have thought I'd still run into the same problem

Edit- So unraid has several options for bonds. Reading through them I'd think my current one would be the right choice? I have Mode 1 (active-backup) selected.

1715811664786.png

Rest of the settings, just in case it helps-
1715811813999.png
 
Last edited:

fohdeesha

Kaini Industries
Nov 20, 2016
2,780
3,150
113
33
fohdeesha.com
I thought I'd followed directions to get it set up to support both being connected but certainly possible I have an error somewhere, I'll check on those settings and adjust though realistically I probably don't need both connections.

Is having the two connections on different switches enough to avoid the issue? I guess I'd have thought I'd still run into the same problem

Edit- So unraid has several options for bonds. Reading through them I'd think my current one would be the right choice? I have Mode 1 (active-backup) selected.

View attachment 36723

Rest of the settings, just in case it helps-
View attachment 36724
the two connections being on different switches wouldn't cause a loop if the other switch has stp enabled (which most do by default). I have never used unraid and know nothing about it, but active/backup like you show wouldn't cause a loop unless something was misconfigured. However "use bridging = yes" might, not sure what unraid means there. I also see three ports in the bond, not two? I would just plug everything back into the icx except for this unraid second/third connection, and see if your link flaps go away
 

Matt0925

New Member
May 13, 2024
6
0
1
the two connections being on different switches wouldn't cause a loop if the other switch has stp enabled (which most do by default). I have never used unraid and know nothing about it, but active/backup like you show wouldn't cause a loop unless something was misconfigured. However "use bridging = yes" might, not sure what unraid means there. I also see three ports in the bond, not two? I would just plug everything back into the icx except for this unraid second/third connection, and see if your link flaps go away
The other switch being an unmanaged switch I have no idea how it handles STP. But as of right now I have (nearly) everything plugged back into the 7250- router and PC though the transceivers and unraid through the DAC. Coming up on an hour now and so far it is stable, about now is typically when I start seeing issues.

Bridging doesn't look like it would be the culprit- "Bridging is a feature which creates a virtual bridge and allows VMs and Docker containers to communicate directly with the physical Ethernet port. Both bonding and bridging can be combined to let VMs or containers communicate over a bonded interface."

The NIC I added for 10 gig has two SFP+ ports on it, then the 1 gig port on the motherboard. I have port 1 on the NIC and the MB ports connected, though the second port on the NIC is also in the bond. I found this post on the unraid forum, it looks like mixing different network ports doesn't always play nice so thinking you are right on the issue. Assuming disconnects don't start up again I'll just disconnect the 1gig line and call it a day
 

Rusty4x4

New Member
Jul 5, 2023
1
0
1
How much of a difference is there in noise between a 6610 and 7250, both being a 48p with PoE+? I have the 6610 and it's too loud for my use, will a 7250 be much quieter?
 

cbarbie

Member
Mar 10, 2011
96
50
18
US-VA
Is there a good tutorial with labs for these switches?

I have a 7250P running in my Prod env. I have a 7250 where I would like to experiment with configuring VLANs. Some VLANs would be routable, some would be isolated.
 

R3Z3N

New Member
Jan 29, 2024
29
6
3
Is there a good tutorial with labs for these switches?

I have a 7250P running in my Prod env. I have a 7250 where I would like to experiment with configuring VLANs. Some VLANs would be routable, some would be isolated.
See Post #1 for videos.

Fan mods are the way.
I have yet to be impressed by any of them. Personally if you want quieter, buy a newer less power hungry switch.
 
  • Like
Reactions: noduck

RoachedCoach

Member
Feb 4, 2020
38
43
18

TonyArrr

Active Member
Sep 22, 2021
141
75
28
Straylia
I have yet to be impressed by any of them. Personally if you want quieter, buy a newer less power hungry switch.
I thought my 7250-24P’s fan mod was pretty good, took about 20 db off it. Needed the 8 SFPs otherwise I would have used a 7150 to spare anyone staying in the spare room the whirring
 

kpfleming

Active Member
Dec 28, 2021
399
206
43
Pelham NY USA
Thanks, I have watched the videos. I learn better with written material.
The FastIron CLI is reasonably similar to Cisco IOS, I think, so if you can find tutorials for that you will be able to learn quite a lot.

Are you already familiar with VLANs in general (tagging, access/trunk ports, etc.)?
 

cbarbie

Member
Mar 10, 2011
96
50
18
US-VA
The FastIron CLI is reasonably similar to Cisco IOS, I think, so if you can find tutorials for that you will be able to learn quite a lot.

Are you already familiar with VLANs in general (tagging, access/trunk ports, etc.)?
I believe I am, but need to want to verify by testing. Thanks for the suggestion on the Cisco IOS. I will look for them.
 

modem_19

New Member
Aug 29, 2022
2
0
1
I hope this isn't a question that has been answered definitively already. If so, I apologize as I have looked ALOT for an answer.

I purchased a Brocade ICX6610-48P recently for $80 (excellent condition) for the amount of 10GB ports I can use on it. The goal is a management network for a ProxMox cluster I'm building / testing. After thoroughly reading the front page of this thread, I decided I could live with the sound (it wasn't that bad in my basement office area). But what I didn't realize was the wattage usage / power draw this switch potentially has.

Because this is in a basement of a home built about 15 years ago, and I want to be conscious about raising my elec bill in these trying economic times, the reports of this switch running upwards of 160 watts at idle is concerning. I would only plan on using 8-10 SFP+ ports and maybe 10 copper RJ45 ports at max so I suspect that would go well over 200 watts of usage 24/7. PoE would *NOT* be used on this switch, only for server connections.

I've also seen some posts within this thread that others report that it only runs around 75-80 watts 24/7.

Is any of this accurate at all??? Has anyone tested this switch with a watt meter under any type of load similar to what I'm looking at?

If this switch will run around 200 watts or higher, I'd rather look into selling this and going with an ICX7250-24P. I could live with the lesser SFP+ ports on a switch that looks to run around 40watts idle.

Any info is GREATLY appreciated.
 

MTFPLEX

New Member
Apr 28, 2024
6
0
1
faulty PoE board
My ICX6450-48P just spams this error over and over again, PoE doesn't work and the PoE firmware is up to date.

Code:
PoE Info: Hard Resetting in slot 1....
PoE Info: Resetting module in slot 1....completed.
PoE Error: Device 0 failed to start on PoE module.
PoE Error: Device 1 failed to start on PoE module.
Resetting module in slot 1 again to recover from dev fault
 

CIR-Engineering

I am a functional adult?
Jan 14, 2021
134
49
28
48
Chicago USA
www.cir-engineering.com
ICX6610 and ICX7450 cooling mods question. I just bought the switch I have been pining over for like +four years, an ICX7450-32ZP-E. I know it will be too loud and I plan to do the cooling mods on it using a pulse generator of some kind. I've read a lot, but there is so much here I am sure I missed more than what I have actually read.

My question is, is there any consensus as to whether it's better to use a simple frequency generator or if an Arduino is actually better. Honestly, a solid-state frequency generator set with my oscilloscope seems the most reliable to me, but in reading some say they can be problematic for various reasons (are not stable, power board errors, etc.). If I get a $5 frequency generator, I will immediately change all the caps (or add caps) to remove the low-quality off brand Chinese ones they all come with.

This generator had been used by may:

But this one looks very nicely built to me as well:

Separate question. I don't need the 40GbE ports at the moment. I bought this switch for the 2.5GbE POE ports. The four 10GbE SFP+ are enough for me. Is it OK to remove the 40GbE ports and run the switch that way? I presume this will save quite a bit of power consumption?

Thanks all. I am so glad to see this thread alive and going after all these years. fohdeesha, this thread is epic!
 
Last edited: