Drag to reposition cover

Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)

klui

Active Member
Feb 3, 2019
291
123
43
I wish I had the license for the 8x SFP+ 10Gb ports on the front. I did PM @fohdeesha a couple of days ago and I'm hoping he's still able to help.
@fohdeesha probably gets at least 50 messages/day and I'm sure he'll appreciate all inquirers give him leeway to respond as he finds the time. This thread is pretty unwieldy but packed with a lot of great information; make good use of the Search function w/ This Thread option selected.

The 6610 is quite loud and you can't really replace the fans to quiet them down, especially if you have Rev.A or I[ntake] fans/PSUs which have orange filled arrows. Get one with Rev.B/C and E[xhaust] fans which have green filled arrows. Search for RPS16-E and RPS16-I for comparison on eBay. Others have installed additional fans by modifying the lid/insides.
 

Dade49

New Member
Mar 26, 2021
2
0
1
@fohdeesha probably gets at least 50 messages/day and I'm sure he'll appreciate all inquirers give him leeway to respond as he finds the time. This thread is pretty unwieldy but packed with a lot of great information; make good use of the Search function w/ This Thread option selected.

The 6610 is quite loud and you can't really replace the fans to quiet them down, especially if you have Rev.A or I[ntake] fans/PSUs which have orange filled arrows. Get one with Rev.B/C and E[xhaust] fans which have green filled arrows. Search for RPS16-E and RPS16-I for comparison on eBay. Others have installed additional fans by modifying the lid/insides.
Absolutely, no offense intended. I'm sure there are many requests for help with this and I will be patient. In the mean time, I decided to order a QSFP breakout DAC and test that at 10Gb x4. I am also on the hunt for a backup PSU that doesn't cost as much as another switch. I read the info on the Rev B/C PSU's and will be mindful. Thanks for the help.

I've read about 12% of this thread, but clicked all the links in the first few pages and read the last 12 pages or so. It's a long thread for sure, but I'll get there.
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,113
1,976
113
30
fohdeesha.com
Trying to follow @fohdeesha 's guide here on setting up the 7150. Specifically 7150-C12P. These switches have newer versions of firmware 08.0.90BT211 (aka 8090?) and boot code 10.1.15T225. Fohdeesha's instructions are for 8080e.

Am I supposed to downgrade to 8080e? I started the process, but these must have the newer firmware that embeds the boot firmware with the primary image (that i read in this thread) - as I get the error: Invalid input -> bootrom when trying to copy the bootrom image.

When skipping past the firmware, and trying to license them, it says 45-day evaluation period. Searching this thread, I found a post by fohdeesha that said the guide in the first post handles this. For the 7150, there's just the datasheet though.

I am assuming I am supposed to downgrade to 8080e before registering the license?

Or, remain on 8090 and say Yes to the 45-day evaluation license, and it will remain unlocked?

Am I supposed to downgrade? And in doing so, ignore the bootrom option and just flash the .bin file only?

I need to update the fw on the guide but I haven't had the chance yet - don't downgrade - the codetrain I recommend is 8092 - flash whatever the latest in that is (8092e I'm pretty sure). The licenses are still honor only on all the versions, the 45 day thing is just....in spirit. Nothing happens in 45 days
 

vswitchzero

New Member
Nov 17, 2020
2
1
3
Toronto, Canada
vswitchzero.com
Not sure if anyone has done this before, but just wanted to mention that it is possible to run Noctua 40mm fans in the ICX 7250. By default, fan voltage is way too low for them. Even if they continue spinning after startup, they'll be marked as failed (and would not flow enough air to keep the switch cool anyway).



I got around this by pulling +12V off the RPSU board so that the fans would always spin at maximum RPM. The fans continue to report the tach signal to the board via the usual fan headers. At full speed, the switch has no problem with the RPM and considers the fans good. The noise level is SO much better even with the two fans at full speed. Switch temps are about 10'C higher in my case (from low 70s to low 80s now). This breaks fan speed control, obviously, but the switch has no idea.



I soldered two leads to one of the +12V pins on the rear of the RPSU board:


It's a bit ugly, but its on there very well. Here is a closeup of the fan wiring:



The fans I used were 3-pin 40x25mm NF-A4x20FLX models. I may see if I can get some additional cooling into the switch. Maybe a 3rd fan, but this would require a rear cutout. I may also see if a 10mm fan will have enough clearance to be mounted on top of the heatsink.
 
  • Like
Reactions: klui

klui

Active Member
Feb 3, 2019
291
123
43
I need to update the fw on the guide but I haven't had the chance yet - don't downgrade - the codetrain I recommend is 8092 - flash whatever the latest in that is (8092e I'm pretty sure). The licenses are still honor only on all the versions, the 45 day thing is just....in spirit. Nothing happens in 45 days
The Ruckus folks are very busy. The most recent is 8.0.95c. On one of the Ruckus Twitch Live Streams, the host mentioned that 8.0.92d (and I would presume 92d or newer) will automatically try to connect to Ruckus Cloud.
(8092d used in the stream.)
 
  • Like
Reactions: eduncan911

tubs-ffm

Member
Sep 1, 2013
88
26
18
Not sure if anyone has done this before, but just wanted to mention that it is possible to run Noctua 40mm fans in the ICX 7250. By default, fan voltage is way too low for them. Even if they continue spinning after startup, they'll be marked as failed (and would not flow enough air to keep the switch cool anyway).

I got around this by pulling +12V off the RPSU board so that the fans would always spin at maximum RPM. The fans continue to report the tach signal to the board via the usual fan headers. At full speed, the switch has no problem with the RPM and considers the fans good. The noise level is SO much better even with the two fans at full speed. Switch temps are about 10'C higher in my case (from low 70s to low 80s now). This breaks fan speed control, obviously, but the switch has no idea.
Using super silent fans and let it run at 12 V is one possibility. Another possibility is to use fans that already spin-up at the voltage of fan control level 1, provide sufficient air flow at this voltage and run silent. Beside the fact that an installation is much easier without soldering, the advantage is to have a second level of more cooling power in case of overheat. In your case the only fallback level is power down of the complete switch in case of overheat.

In my case it is the PoE version of the 7250 and there also are positive examples of fan mods existing. But please have a look below what could happen in case of wrong fan tuning.

ICX 7250-24P exploded.

The joy with my ICX 7250-24P suddenly came to an end when the PSU exploded yesterday. Smoke, flames and electrical "bzzzz sound" included.

To go back in time. I modified my device by replacing the fans to for noise reasons. There is no heavy load on my device and I used only one PoE device. Temperature of both sensors are fine. See record of last 24 h till crash below. The device is running like this for 3 weeks or so. The up and down is because of changing ambient temperature during day and night. But suddenly an "explosion" and it was over.

I cannot say for sure if it is because of the modification I did or by chance. Theoretically the temperature at the sensor could be fine but not in other areas. In every case I would not recommend to anybody to do this type of modification.

Anybody who wants to exchange my broken ICX 7250-24P to a running ICX 7150-24 or ICX 7150-24P? :)

View attachment 17835
View attachment 17836
 
  • Like
Reactions: vswitchzero

vswitchzero

New Member
Nov 17, 2020
2
1
3
Toronto, Canada
vswitchzero.com
Using super silent fans and let it run at 12 V is one possibility. Another possibility is to use fans that already spin-up at the voltage of fan control level 1, provide sufficient air flow at this voltage and run silent. Beside the fact that an installation is much easier without soldering, the advantage is to have a second level of more cooling power in case of overheat. In your case the only fallback level is power down of the complete switch in case of overheat.

In my case it is the PoE version of the 7250 and there also are positive examples of fan mods existing. But please have a look below what could happen in case of wrong fan tuning.
Good points. My 7250 is a non-PoE model, but I'm sure adequate cooling is even more critical with PoE models and their larger PSUs. Do you have any examples of quieter 40mm fans that fit that criteria? Before I went with the Noctuas, I couldn't find any suitable replacements.
 

richtj99

New Member
Jul 8, 2017
29
0
1
48
Thank you for the detailed write up. I think I am doing something wrong (clearly!).

It is 24port unifi port 6 (all vlans) to unifi 8port 8 (all vlans), I am using port 48 of the 6450 as the 'feed'.

If I plug port 8 from the 8 port into a PC, I can change all Vlan's on the Unifi & the PC follows suit.

If i set that same unifi port 8 to the testvlan group (Vlan 75, 85, 95, and the 'native' vlan is 105) - the same PC when plugged into Unifi port 8, can access all vlans by switching the vlan tag in windows.

When I take port 8 and plug it into port 48 on the ICX 6450 - I have it as port 48 being tagged to vlans 75, 85, 95, and 105. I do not have port 48 as dual mode or untagged - i am expecting that as nothing is untagged, it will not default to any vlan or get an IP?

Next:
Port 47 untagged as vlan 75
Port 46 untagged as vlan 85
Port 45 untagged as vlan 95
Port 44 untagged as vlan 105

If i plug the PC into ports 44-47 I am not getting any IP when I would expect each port to be on a different Vlan with an IP.

Since port 8 from the unifi works fine, I think I am making a mistake somewhere. I think I am close but not quite there. I do NOT have the management vlan on the ICX6450 as would like to deny internet access to the switch (I guess it could be done via firewall).

The ciscos dont have the Manangement vlans - just the vlans it needs.

Thanks,
Rich



@richtj99
Your VLAN + tagged proposals are correct.
Yes, setting a port as untagged strictly limits all traffic through that port on that specific VLAN. Tagged packets are ignored since that port can be considered "unaware" of any VLAN IDs from a client device point of view.

If you want tagged AND untagged traffic (e.g. a tagged VoIP VLAN but default to a VLAN for PCs), you will tag all of the VLANs desired and then go to the interface and set dual-mode <VLAN ID>

Here's an example using all three options:

Code:
vlan 10 name voip
tagged eth 1/1/1 to 1/1/48 eth 1/2/2
untagged eth 1/2/1

vlan 20 name pcs
tagged eth 1/1/1 to 1/1/24 eth 1/2/2

vlan 30 name whatever
tagged eth 1/1/25 to 1/1/48 eth 1/2/2

interface 1/1/1 to 1/1/24
dual-mode 20
voice-vlan 10

interface 1/1/25 to 1/1/48
dual-mode 30
voice-vlan 10

interface 1/2/1
port-name PBX

interface 1/2/2
port-name Link-to-switch2
Don't forget a management VLAN. Use the management VLAN (whatever ID on whatever ports you choose/need) to manage your network devices. For example, my switches use VLAN ID 5 as management. Only network switches, the Unifi Controller, Unifi APs and wireless bridges are on that VLAN on my network - the absolute necessary devices to operate my LAN. I have one port on each switch left as untagged on that VLAN as a simple "management" port (seperate from the factory "Management" port on these switches which I have configured differently).

Example:
Code:
vlan 5 name Management
tagged eth 1/2/1 to 1/2/4
untagged eth 1/1/48
router-interface ve 5

interface ve 5
port-name Management
ip address 10.0.5.1/24

interface eth 1/1/48
port-name Management
 

richtj99

New Member
Jul 8, 2017
29
0
1
48
OK - I have no idea what I did but now it does seem to work as expected - so I guess thats good?

If the switch has an IP on a Wanless vlan, could it somehow still access internet on another vlan which it doesnt have an IP?
 

atomicwrites

New Member
Mar 18, 2021
3
0
1
Hi, is there an list of fans that will work on the ICX 6450? i have a 48p model so that's 3 fans. The fan I've seen recommended is the Sunon
KDE1204PKVX but it seems to be out of stock everywhere except an amazon listing (https://www.amazon.com/Sunon-40x40x20mm-pin-fan-KDE1204PKVX/dp/B006ODM76C) which has it for $10 which is double the regular price. So that would be $30 in fans which is not imposible but I wanted to see if there are other options. I know a lot of fans wont work wih the voltage speed contorll, so that's why I'm asking about known good options. Thanks.
 

nickf1227

Member
Sep 23, 2015
76
46
18
30
Hi all,
Can anyone confirm whether or not plugging an Brocade ICX7400-4X10GF 4x10GbE module in the back of the 7450 switch just shows up as a usable interface 1/3/1, 1/3/2 or 1/4/1, 1/4/2 etc?
 

klui

Active Member
Feb 3, 2019
291
123
43
The manual states on switches that support breakout ethernet, ports are 40G by default, not 4X10G. Try to see if your switch supports show breakout.
 

nickf1227

Member
Sep 23, 2015
76
46
18
30
I'm sorry, I'm not using the 40gb modules as a breakout.. I'm talking about inserting an module that is literally 4 10 gig ports.
 

eduncan911

Active Member
Jul 27, 2015
188
91
28
eduncan911.com
The Ruckus folks are very busy. The most recent is 8.0.95c. On one of the Ruckus Twitch Live Streams, the host mentioned that 8.0.92d (and I would presume 92d or newer) will automatically try to connect to Ruckus Cloud.
(8092d used in the stream.)
Thanks @fohdeesha and @klui !

Humm. We currently have 08.0.90BT211 on the switches at the school. I'm guessing this is "90b", not the "90d" he mentions in the video (and some of the chats show).

I'll look into an upgrade to 90d, and to stay put. Will also check my personal 7250 as well.

I wonder if there were some EULA changes to disclose the cloud talking.
 

Jason Antes

Active Member
Feb 28, 2020
138
27
28
Twin Cities
Anyone have access to the Brocade Network Advisor downloads? I have a license which requires me to install a 12.x.x version (which I have) but when I try to update to 14.x.x on Server 2019 it errors out with issues. Unfortunately at least 14.3.0 and 14.4.0/.1 are SAN only from Brocade. I don't have a Ruckus account to try and get a newer version. I can stay running on 12 but would like a more up to date version if it still supports the ICX/VDX lines.
 

dreamkass

New Member
Aug 14, 2012
20
2
3
Is it possible to configure interface management 1 with its own routing table on a ICX 6610, playing with VRF but looks like that int management 1 wont work, no VRF Forwarding options?

I'm looking at possibly of having a backdoor in case of emergency, workaround is using a jumpbox in that mgmt subnet... but not clean.

ICX 6610
Primary FCXR08030u.bin
SW: Version 08.0.30uT7f3
 

eduncan911

Active Member
Jul 27, 2015
188
91
28
eduncan911.com
Thanks @fohdeesha and @klui !

Humm. We currently have 08.0.90BT211 on the switches at the school. I'm guessing this is "90b", not the "90d" he mentions in the video (and some of the chats show).

I'll look into an upgrade to 90d, and to stay put. Will also check my personal 7250 as well.

I wonder if there were some EULA changes to disclose the cloud talking.
The plot thickens... According to this page, ICX switches 7150, 7550, 7650, 7850 requires firmware 8090d to connect to RUCKUS Cloud.

> * Requires ICX release 8.0.90d and above

I wonder if it's 8092 that does some type of auto-call out - or if it's 8090d and above. I wish I was setup to do network traffic snooping to see; but right now, I need to get this network up for the school. So no time at this moment to play with firmware versions.

I'll stick to 8090b that we already have. We just need some basic VLANs. I'm not even doing InterVLAN routing on these switches, to K.I.S.S. since they don't have a network person there - it's just me, part time, and I may not be around.

EDIT: Well, dammit...

> FastIron Software 08.0.91 delivers Ansible support to all ICX 7000 Series switches.

EDIT2: But on the Ansible download page, it says recommended firmware that Ansible is "applicable" for is 8090j.
 
Last edited: