One more thing, how can I completely remove ve? I tried
no int ve 100 but it's not working.
Last edited:
Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)
- Thread starter fohdeesha
- Start date
Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.
I'm royally confused.
I have 8 POE cameras. When I only have the 8 cameras plugged into the ICX-6450-48P along with the NVR and firewall then the cameras are accessible and work as planned. (using 10 out of 48 ports).
I have since used patch cables to hookup the patch panel which is using ~35 ports out of the 48 ports. Of the 35 ports only about 15 are UP. However, 6 of the 8 cameras are showing as up so I cannot access 6 of the 8 cameras. No configuration changes.
I took those two cameras and unplugged them and plugged them back in. The light goes green on the Brocade but cannot ping and in CLI it shows port as down even though show inline power shows consumed power.
I took the 2 no-longer-working cameras and plugged them into a dumb POE switch and they power on.
I took the 2 no-longer working cameras and plugged them into different ports on the Brocade (after setting up vlan and inline power on said ports) and no dice.
How would I go about diagnosing this? The only change from when working to now not working is that I plugged all of the other patch panel items into the Brocade so there are now more UP ports than original (original there were 10 or so UP ports which included 8 cameras working, and now there are 15 or so UP ports which only 6 cameras are now working).
I've never used the Brocade web interface but decided to check it out and it says on the "inline power statistics": "
Power Supply total capacity is 740000 of which 586800 is currently available. Power has been successfully allocated 22 times."
I have 8 POE cameras. When I only have the 8 cameras plugged into the ICX-6450-48P along with the NVR and firewall then the cameras are accessible and work as planned. (using 10 out of 48 ports).
I have since used patch cables to hookup the patch panel which is using ~35 ports out of the 48 ports. Of the 35 ports only about 15 are UP. However, 6 of the 8 cameras are showing as up so I cannot access 6 of the 8 cameras. No configuration changes.
I took those two cameras and unplugged them and plugged them back in. The light goes green on the Brocade but cannot ping and in CLI it shows port as down even though show inline power shows consumed power.
I took the 2 no-longer-working cameras and plugged them into a dumb POE switch and they power on.
I took the 2 no-longer working cameras and plugged them into different ports on the Brocade (after setting up vlan and inline power on said ports) and no dice.
How would I go about diagnosing this? The only change from when working to now not working is that I plugged all of the other patch panel items into the Brocade so there are now more UP ports than original (original there were 10 or so UP ports which included 8 cameras working, and now there are 15 or so UP ports which only 6 cameras are now working).
I've never used the Brocade web interface but decided to check it out and it says on the "inline power statistics": "
Power Supply total capacity is 740000 of which 586800 is currently available. Power has been successfully allocated 22 times."
Router on a stick configuration? Setting up an AP. The vlan would be for cameras utilizing and AP. The vlans are setup on each component of the network. AP, router and switch are all configured for example vlan 30. Tagged and untagged traffic is travelling from the access point to 1/1/7. The router is connected to 1/1/33 and I will assume is going to route both tagged and untagged traffic.
1/1/7 needs to be a member of vlan 30 and is carrying traffic from the AP. Its tagged but needs to also carry the untagged traffic so it req dual mode
1/1/33 also needs to be a member of vlan 30 and is carrying traffic to the router. Its tagged but needs to also carry the untagged traffic so it req dual mode
Is this correct or am i swinging in the dark and giving myself a black eye.
I have attempted to add 1/1/33 to vlan 30 but it errors stating 33 is not part of default vlan. It is a member of another a completely untagged vlan. Maybe its my order of operations?
1/1/7 needs to be a member of vlan 30 and is carrying traffic from the AP. Its tagged but needs to also carry the untagged traffic so it req dual mode
1/1/33 also needs to be a member of vlan 30 and is carrying traffic to the router. Its tagged but needs to also carry the untagged traffic so it req dual mode
Is this correct or am i swinging in the dark and giving myself a black eye.
I have attempted to add 1/1/33 to vlan 30 but it errors stating 33 is not part of default vlan. It is a member of another a completely untagged vlan. Maybe its my order of operations?
Last edited:
I hate quoting myself but this is solved. I narrowed it down to bad patch crimp. I guess POE devices can still get power but not data if it isn't a good connection within the keystone. I haven't tested the other 30+ patch panel ports so this may get interesting!
@fohdeesha I have been trying to get the Systimax SCS InstaPATCH 24-Port Fiber Patch Panel Module 642337970740 | eBay you mentioned but it seems that link is gone now. Can you suggest equivalent as well as 5m 50/125 Standard MTP Multimode Fiber Optic Patch Cable Key-up to Key-down that would work. Thanks(ICX6610) Rear QSFP+ Ports
Describing the rear ports can be a little confusing in text, so below is an extremely professional graphic showing how they break down. 2 of them are 40gbE only ports - for your freenas, hypervisors, whatever. The other 2 are 4x 10gbE breakout (each) only:
To break out those 2x breakout ports, you have many options:
You can use a DAC breakout cable: Dell Networking Cable QSFP+ 40GBE - 4X SFP+ 10GBE 3M 27GG5 | eBay
Or you can use a 40gbE optic to give you an MPO fiber connector: Brocade XBR-000232 QSFP 57-1000267-01 4*16Gb SWL 100m for DCX8510 EMC | eBay
Note: the above optic is a 4x 16gbps fibrechannel optic, which makes them available for super cheap. They work perfectly fine in brocade ethernet switches, as they are not picky and simply clock the optic down to 10gbps per channel. I have been using quite a few for a while now
Then using an optic like above, use MPO fiber like this: 5m 50/125 Standard MTP Multimode Fiber Optic Patch Cable Key-up to Key-down | eBay
To go to an MPO breakout panel like this: Systimax SCS InstaPATCH 24-Port Fiber Patch Panel Module 642337970740 | eBay
A single one of those panels will break out 4x MPO connectors - with 4x 10gbe LC connectors per MPO, that's 16x 10gbe ports - for instance if you had a stack of 2x ICX6610's - that's 4x total QSFP+ breakout ports, to one panel like this.
In each of the above, each broken out 10gbE is totally seperate, and can go to totally different devices. I know this is obvious to most of you, but some here have never had to deal with QSFP+ breakout before
you can see how the above ports (including breakout) show up in the OS as unique ports:
Code:DEV-ICX5#show interface brief ethernet 1/2/1 to 1/2/10 Port Link State Dupl Speed Trunk Tag Pvid Pri 1/2/1 Up Forward Full 40G None No N/A 0 1/2/2 Up Forward Full 10G None No N/A 0 1/2/3 Up Forward Full 10G None No N/A 0 1/2/4 Up Forward Full 10G None No N/A 0 1/2/5 Up Forward Full 10G None No N/A 0 1/2/6 Down None None None None No 1 0 1/2/7 Up Forward Full 10G 1 No 1 0 1/2/8 Up Forward Full 10G 1 No 1 0 1/2/9 Up Forward Full 10G 1 No 1 0 1/2/10 Up Forward Full 10G 1 No 1 0
In case you need rails like I am, this should do the trick: https://www.amazon.com/gp/product/B0CJZP2QWJ/?th=1
Recently got an icx 6450-48 and its fan never spins down. Bought a fan that was supposed to be quieter but its nearly twice as loud leading me to think the oem fan is on its way out. Tried both fans all 3 headers with the same result. Searched the thread and it seems the fan control mosfet is the likely culprit. Has anyone managed to replace it and fix the issue?
I'm going to guess that it is probably cheaper and easier to simply get another used switch. They seem to be going for around $50-75 on eBay right now.
I could return it and get another but if it's just gonna fail in a few years there's not much point. Alternatively I'll just leave it be, it's in an enclosed rack in the basement so noise isn't too much of an issue.
After probing everything near the fan connectors I could test with a multimeter I found no bad components. Doing some googling turned up this command
Code:
dd set_pwrfan_low
Last edited:
Two Questions: Can any ICX run RoCEv1 and/or v2? I've seen lower numbers on wattage than the datasheet, does anyone have a 7450-48p? what is the lowest wattage you were able to achieve?
Im thinking of buying a versatile switch, bonus points if its hackable(ie lets some custom firmware in)
Im thinking of buying a versatile switch, bonus points if its hackable(ie lets some custom firmware in)
Documenting explicitly for future folks, but went on a hunt for a quieter ICX7250-24P and can echo some findings.
Followed the trail paved by https://forums.servethehome.com/ind...erful-10gbe-40gbe-switching.21107/post-256392 and https://forums.servethehome.com/ind...be-40gbe-switching.21107/page-214#post-278605.
Tried out two MR4020X12B1-RSR to replace the Nidec fans that came with, and added a MF60101V3-1000U-A9 to the ASIC. Also removed the fan grills on the rear. New fans made the sound significantly quieter, and removing the grates did as well. However, there was still something to the sound that is not purely pleasing. The switch is in my office with me and it is now entirely acceptable, but does NOT pass the wife test (which is ok since its not in a shared area).
Reviewing the further options laid out by the giants before me, I decided to order up some GDA4028-12BB Comair Rotron. I'd read a variety of posts in this thread mentioning these fans, and saw enough success to pull the trigger (https://forums.servethehome.com/ind...erful-10gbe-40gbe-switching.21107/post-329503). However, I was not careful enough in reading to realize that the success was on 6450s, not 7250s, and had figured it would be essentially the same (Only saw https://forums.servethehome.com/ind...erful-10gbe-40gbe-switching.21107/post-278922 AFTER trying the new fans out). With both fans replaced, I was unable to boot fully, getting back the following error:
FATAL ERROR: At least one good FRU fan should be present in the system
System is shutting down!!! "
In the short time when the fans had spun down to speed 1 instead of speed 2, the switch was very quiet. I am curious if they would cool enough, but not curious enough to invest more time into trying to get them to work with fake tach signals and the like.
I've kept a single MR4020X12B1-RSR alongside a GDA4028-12BB (using one MR4020 vs 2 is slightly more pleasant to my ear), and kept the MF60101V3-1000U-A9 on the ASIC. Comparing no ASIC fan to with: MGMT plane temps went from 80c stable to 55c stable (18c ambient). Temps for air outlet have been below 30c no matter the configuration of fans.
Followed the trail paved by https://forums.servethehome.com/ind...erful-10gbe-40gbe-switching.21107/post-256392 and https://forums.servethehome.com/ind...be-40gbe-switching.21107/page-214#post-278605.
Tried out two MR4020X12B1-RSR to replace the Nidec fans that came with, and added a MF60101V3-1000U-A9 to the ASIC. Also removed the fan grills on the rear. New fans made the sound significantly quieter, and removing the grates did as well. However, there was still something to the sound that is not purely pleasing. The switch is in my office with me and it is now entirely acceptable, but does NOT pass the wife test (which is ok since its not in a shared area).
Reviewing the further options laid out by the giants before me, I decided to order up some GDA4028-12BB Comair Rotron. I'd read a variety of posts in this thread mentioning these fans, and saw enough success to pull the trigger (https://forums.servethehome.com/ind...erful-10gbe-40gbe-switching.21107/post-329503). However, I was not careful enough in reading to realize that the success was on 6450s, not 7250s, and had figured it would be essentially the same (Only saw https://forums.servethehome.com/ind...erful-10gbe-40gbe-switching.21107/post-278922 AFTER trying the new fans out). With both fans replaced, I was unable to boot fully, getting back the following error:
FATAL ERROR: At least one good FRU fan should be present in the system
System is shutting down!!! "
In the short time when the fans had spun down to speed 1 instead of speed 2, the switch was very quiet. I am curious if they would cool enough, but not curious enough to invest more time into trying to get them to work with fake tach signals and the like.
I've kept a single MR4020X12B1-RSR alongside a GDA4028-12BB (using one MR4020 vs 2 is slightly more pleasant to my ear), and kept the MF60101V3-1000U-A9 on the ASIC. Comparing no ASIC fan to with: MGMT plane temps went from 80c stable to 55c stable (18c ambient). Temps for air outlet have been below 30c no matter the configuration of fans.
at this point I think it may be less work for y'all to find new wives who are ok with a little background whirr
Is there no way to search this thread exclusively? Am I an idiot I can select thread only but then it's by member? Seems like there is a wealth of information here that I can't seem to figure out how to nail down. After teaching myself vlans: tagging and untagging, dual mode etc I'm trying to nail down some information on igmp snooping and igmp proxy to quiet down some noisy Sonos.
Will do but these LLM's spout some nonsense sometimes when it comes to the reasoning. I don't expect most of the people here to teach me about igmp proxy/ querier/ snooping etc but going back and forth from different sources and looking at the high level discussion here helps. I'm trying to get some help to help myself lol. Thanks for the reply.
Amen to that. They’re really only good and presenting an answer confidently, not accurately.
Having read the thread from the beginning when I originally settled on a ICX for home, and staying up to date on it since, I can’t recall much discussion of IGMP snooping configuration, aside from maybe as a possible cause of some other problem. Not that I have perfect recall, but it’s something that I’m sure would have sent me on an exploratory tangent too
Tangent Chaser club member also. Eventually comes in handy. The network engineers at Sonos must have vomited when marketing testers told them what they needed to do.Not that I have perfect recall, but it’s something that I’m sure would have sent me on an exploratory tangent too
sure you can, just type igmp in the search box up top, and select "this thread":
edit: images seem completely broken on sth now, either trying to embed a file directly, or even posting an image link?
Reading release notes can help@fohdeesha do you know what the "cdX" suffix means? I was checking the available firmware for a 7150-48zp and there is a "normal" version and then a "cd1" version of 10.0.10f.
And would you say the 10.0.10 (or 09.0.10) branch is okay for "dumb" l2 operations?
"CD" -> "Continuous Deployment"
From the 09.0.10j_cd7 release notes