Drag to reposition cover

Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

kpfleming

Active Member
Dec 28, 2021
459
237
43
Pelham NY USA
Hey Folks, I searched in this thread but I could not find any info about my question, I am about to pull the trigger on a ICX7250 but it is branded Ruckus, I know that Ruckus owns Brocade now, will the process that fohdeesha posted work on the Ruckus branded switches too or is it just for the Brocade models?
Thanks!
Most of us have Ruckus-branded units, and all of the firmware files and manuals come from the Ruckus website, so... yes.

The ownership situation is much more complex... Ruckus is a brand owned by CommScope.
 
  • Like
Reactions: Jason Antes

Aidzer0

New Member
Mar 7, 2024
2
1
3
Most of us have Ruckus-branded units, and all of the firmware files and manuals come from the Ruckus website, so... yes.

The ownership situation is much more complex... Ruckus is a brand owned by CommScope.
Fair enough, thanks for the response! I just wanted to make sure the process would work on them. I figured that was the case but I was not sure if Ruckus Firmware would support it, I barely know anything about these switches.
 

Finbester

Member
Aug 28, 2022
49
34
18
Interesting. Do you think doing this would bring down the overall power draw? I would guess maybe yes? I actually don't need PoE out of this particular switch so I'm wondering if I can lower power cost, heat, etc by removing it.

I may give it a boot with the whole PoE board removed and see how it goes. If it blows up I'll let you guys know.

Someone stop me if I'm going to blow my shit up please lol
I tried this, dropped 7 watts from 63w to 56w. Hasn't blown up yet. As you observed, mine also recognizes itself as a -48.
 

TonyArrr

Active Member
Sep 22, 2021
170
86
28
Straylia
What fans are you using?
First mod was:
2x EFB0412VHD-F00 (Digikey link)
1x MB6010M12B-RSR (Digikey link)

Second mod is:
2x MR4020X12B1-RSR (Digikey link)
1x EFB0612MA (Digikey link)

SSH@ICX7250-24P Router>show chassis <--- just a random point in time taken now
Code:
The stack unit 1 chassis info:

Power supply 1 (AC - PoE) present, status ok
Power supply 2 not present

Fan 1 ok, speed (auto): [[1]]<->2
Fan 2 ok, speed (auto): [[1]]<->2

Fan controlled temperature:
    Rule 1/2 (MGMT THERMAL PLANE): 69.5 deg-C
    Rule 2/2 (AIR OUTLET NEAR PSU): 45.0 deg-C

Fan speed switching temperature thresholds:
    Rule 1/2 (MGMT THERMAL PLANE):
        Speed 1: NM<-----> 93       deg-C
        Speed 2:        82<----->105 deg-C (shutdown)
    Rule 2/2 (AIR OUTLET NEAR PSU):
        Speed 1: NM<-----> 58       deg-C
        Speed 2:        49<----->105 deg-C (shutdown)

Fan 1 Air Flow Direction:  Front to Back
Fan 2 Air Flow Direction:  Front to Back
Slot 1 Current Temperature: 70.0 deg-C (Sensor 1), 45.0 deg-C (Sensor 2)
The more airflow you can guarantee you're moving past the switch, the lower cfm you can afford to go, to a point.
Mine is in a small rack cabinet in the top of a cupboard, with two 7x3cm holes in the roof behind them, so all the hot air can disappear out there into the roof cavity. Before I added that, we typically hung out around 80 and 55-60 respectively, and it still ran fine.

I should mention, when deciding on how comfortable I was with the noise, I was doing that with the cupboard and cabinet doors open and me standing a meter in front of it, since it is in the guest bedroom and I didn't want to keep guests awake all visit :p
 

crab

New Member
Mar 9, 2024
1
1
3
Some info for those looking for quiet fans for their ICX 6450-48P: I've been running three Noctua NF-A4x20 FLX in my Brocade for over a year and haven't run into any problems. I believe the only modification I had to make to the fans was to move the pins in the connector since the Brocade fan header uses a nonstandard pinout.
Code:
The stack unit 1 chassis info:

Power supply 1 (NA - AC - PoE) present, status ok
Power supply 2 not present
Power supply 3 not present

Fan 1 ok, speed (auto): [[1]]<->2
Fan 2 ok, speed (auto): [[1]]<->2
Fan 3 ok, speed (auto): [[1]]<->2

Fan controlled temperature: 59.5 deg-C

Fan speed switching temperature thresholds:
        Speed 1: NM<----->65       deg-C
        Speed 2:       56<-----> 79 deg-C (shutdown)

Sensor B Temperature Readings:
    Current temperature : 54.0 deg-C
Sensor A Temperature Readings:
    Current temperature : 59.5 deg-C
    Warning level.......: 69.0 deg-C
    Shutdown level......: 79.0 deg-C
Boot Prom MAC : cc4e.2475.bd80
Management MAC: cc4e.2475.bd80
 
  • Like
Reactions: TeleFragger

TeleFragger

Active Member
Oct 26, 2016
269
57
28
52
I am excited... just got mine in and i know nothing about switches..
just plugged one machine into it and BOOM 10gb already!!!! sweet!!!
going out with the wife to see a local play... so no play time for me.

1710017353673.png

I havent done anything lol... yes I need to follow instructions from step 1 and through to update firmware, set IP, etc...

Here is what i have so far:

Code:
Chandler_MDF_Sw4>show version
  Copyright (c) 1996-2016 Brocade Communications Systems, Inc. All rights reserved.
    UNIT 1: compiled on May 19 2016 at 01:22:26 labeled as SPS08030h
      (28713156 bytes) from Primary SPS08030h.bin
        SW: Version 08.0.30hT211
      Compressed Boot-Monitor Image size = 786944, Version:10.1.06T215 (spz10106)
  HW: Stackable ICX7250-48-HPOE
==========================================================================
UNIT 1: SL 1: ICX7250-48P POE 48-port Management Module
      Serial  #:DUK3828P11B
      License: BASE_SOFT_PACKAGE   (LID: fwmINHNrGGd)
      P-ASIC  0: type B344, rev 01  Chip BCM56344_A0
==========================================================================
UNIT 1: SL 2: ICX7250-SFP-Plus 8-port 80G Module
==========================================================================
 1000 MHz ARM processor ARMv7 88 MHz bus
 8192 KB boot flash memory
 2048 MB code flash memory
 2048 MB DRAM
STACKID 1  system uptime is 17 minute(s) 34 second(s)
The system : started=cold start
My stack unit ID = 1, bootup role = alone
 

TeleFragger

Active Member
Oct 26, 2016
269
57
28
52
Some info for those looking for quiet fans for their ICX 6450-48P: I've been running three Noctua NF-A4x20 FLX in my Brocade for over a year and haven't run into any problems. I believe the only modification I had to make to the fans was to move the pins in the connector since the Brocade fan header uses a nonstandard pinout.
Code:
The stack unit 1 chassis info:

Power supply 1 (NA - AC - PoE) present, status ok
Power supply 2 not present
Power supply 3 not present

Fan 1 ok, speed (auto): [[1]]<->2
Fan 2 ok, speed (auto): [[1]]<->2
Fan 3 ok, speed (auto): [[1]]<->2

Fan controlled temperature: 59.5 deg-C

Fan speed switching temperature thresholds:
        Speed 1: NM<----->65       deg-C
        Speed 2:       56<-----> 79 deg-C (shutdown)

Sensor B Temperature Readings:
    Current temperature : 54.0 deg-C
Sensor A Temperature Readings:
    Current temperature : 59.5 deg-C
    Warning level.......: 69.0 deg-C
    Shutdown level......: 79.0 deg-C
Boot Prom MAC : cc4e.2475.bd80
Management MAC: cc4e.2475.bd80
here is where my stock just came in...

Code:
The stack unit 1 chassis info:

Power supply 1 (NA - AC - PoE) present, status ok
Power supply 1 Fan Air Flow Direction:  Front to Back
Power supply 2 not present
Power supply 3 not present

Fan 1 ok, speed (auto): [[1]]<->2
Fan 2 ok, speed (auto): [[1]]<->2
Fan 3 ok, speed (auto): [[1]]<->2

Fan controlled temperature:
        Rule 1/2 (MGMT THERMAL PLANE): 63.5 deg-C
        Rule 2/2 (PoE THERMAL PLANE): 25.5 deg-C

Fan speed switching temperature thresholds:
        Rule 1/2 (MGMT THERMAL PLANE):
                Speed 1: NM<----->95       deg-C
                Speed 2:       85<----->105 deg-C (shutdown)
        Rule 2/2 (PoE THERMAL PLANE):
                Speed 1: NM<----->41       deg-C
                Speed 2:       34<----->105 deg-C (shutdown)

Fan 1 Air Flow Direction:  Front to Back
Fan 2 Air Flow Direction:  Front to Back
Fan 3 Air Flow Direction:  Front to Back
Slot 1 Current Temperature: 64.0 deg-C (Sensor 1), 25.5 deg-C (Sensor 2)
Slot 2 Current Temperature: NA
        Warning level.......: 100.0 deg-C
        Shutdown level......: 105.0 deg-C
 

TeleFragger

Active Member
Oct 26, 2016
269
57
28
52
Need some help here...
I am at the part where I will load the latest UFI image... but I cannot even ping back to the tftp.

I even moved the rj45 for the machine running tftp to the brocade and still cant ping..

1710021362245.png
 

Koop

Well-Known Member
Jan 24, 2024
416
316
63
Has anyone has experience with replacing push-pins on the broadcom heatsink at all? I've noticed I am able to get my temps to drop just by pushing a bit on the middle of the heatsink for a while. A decent amount too, dropped like 10C. Was thinking if I could use shorter pins or maybe ones with tenser springs? Or any ideas on how to have the heatsink sit tighter in general.

Also I noticed the large sponge-like thermal pad on the underside of the chip. Any clue as to similar or potentially adding bigger or additional pads on the underside of the board perhaps? Under other places maybe?

I noticed also it specifically states "Fan # Air Flow Direction: Front to Back" - Is there any way or reason to somehow do back to front? I only ask since it specifies it.

Just thinking of anything I can do to ensure temps stay in a good place before I reassemble everything and rack it :)
 

itronin

Well-Known Member
Nov 24, 2018
1,354
898
113
Denver, Colorado
I noticed also it specifically states "Fan # Air Flow Direction: Front to Back" - Is there any way or reason to somehow do back to front? I only ask since it specifies it.

hot aisle.jpg

yes. data centers with hot and cold aisles. Many, many servers have their I/O on the back. shortest cable path using a switch that is front facing to the back of the rack. so the hot aisle would be at the back of the rack.

-- edit pic added

Pic is from the hot aisle at a colo in the middle of nowhere. Pair of ICX6610-24's with back to front airflow.
 
Last edited:

Koop

Well-Known Member
Jan 24, 2024
416
316
63
View attachment 35272

yes. data centers with hot and cold aisles. Many, many servers have their I/O on the back. shortest cable path using a switch that is front facing to the back of the rack. so the hot aisle would be at the back of the rack.

-- edit pic added

Pic is from the hot aisle at a colo in the middle of nowhere. Pair of ICX6610-24's with back to front airflow.
My main question, I suppose, is if it's worded this way because it's something you can change in the actual config? Can I say "actually I want to do back to front" and swap the fan direction and tell the switch I've made that physical change so the CLI output reflects that? I was curious why they specify it specifically in the CLI.

I guess you'd just reverse the switch orientation. And they specify so that you know the fan airflow direction and isn't something you can actually change.

In all my time mounting switches for scale out NAS systems we would always put the switches back facing for ease of cabling to the back of each chassis node. Those were all unmanaged infiniband switches though. I don't even recall it they had fans.

This is just the first time I feel like I've ever seen it specifically specified somewhere in a switch CLI. Not that I've been in many. I was just curious why it's specified in the CLI itself.
 
Last edited:

itronin

Well-Known Member
Nov 24, 2018
1,354
898
113
Denver, Colorado
My main question, I suppose, is if it's worded this way because it's something you can change in the actual config? Can I say "actually I want to do back to front" and swap the fan direction and tell the switch I've made that physical change so the CLI output reflects that? I was curious why they specify it specifically in the CLI.
probably nothing so exotic.

guessing - but most likely common codebase that has continued to be used through the various product lines. I believe there are some 7xxx series (7650 for example) that can have back to front airflow (like the ICX6610 can). I mean the output *is* correct for the 7250 which is only front to back (officially) so the code may default to state front to back and change from that based on sensor input from the psu and fans.
 

Koop

Well-Known Member
Jan 24, 2024
416
316
63
probably nothing so exotic.

guessing - but most likely common codebase that has continued to be used through the various product lines. I believe there are some 7xxx series (7650 for example) that can have back to front airflow (like the ICX6610 can). I mean the output *is* correct for the 7250 which is only front to back (officially) so the code may default to state front to back and change from that based on sensor input from the psu and fans.
Ah true that makes sense. It is the same CLI regardless of switch model I assume, like Cisco IOS (do they even call it that still?).

Makes sense that different hardware may give different info based on how it's designed to be racked.
 

TeleFragger

Active Member
Oct 26, 2016
269
57
28
52
Ran back through the documentation following everything step by step and I think the issue is not that it cant reach the tftp...

Code:
ICX7250-48P Router#copy tftp flash 192.168.1.163 ICX7xxx\SPR08095mufi.bin primary
ICX7250-48P Router#
 !!! Downloading this application image can result in application-boot image mismatch. Please use UFI image.
The code type 0 is not correct for the target hardware, abort!
File Type Check Failed

TFTP to Flash Error - code 8
so I see The code type 0 is not correct for the target hardware, abort!
 

TeleFragger

Active Member
Oct 26, 2016
269
57
28
52
went to their site and downloaded the new zip file...
and it is now taking off!!!

following web said to use copy tftp flash 192.168.1.163 ICX7xxx/SPR08095mufi.bin primary

but new file is now copy tftp flash 192.168.1.163 ICX7xxx/SPR09010j_cdlufi.bin

1710096484585.png
 

TeleFragger

Active Member
Oct 26, 2016
269
57
28
52
definitely more modern than the web interface for ICX-6610!
got 6 of my 8 poe ReoLink 4k connected. switch is too far from where it is supposed to be... other 2 will connect then..
and got 2 more 10gb... but all my 10gb only doin 2.5gb

1710125623217.png
 

frogtech

Well-Known Member
Jan 4, 2016
1,521
304
83
37
so i'm still a huge networking newb, and may be misunderstanding what i'm doing here

for now, i was able to work around the issue to get some 'work' done, but ideally i want to go back and revisit how to set this up

i am using opnsense as my main firewall/"router", and had an interface configured on LAN with a static ip of 192.168.1.1, pretty typical of a default home "user" network

on the 7250, following fohdeesha's initial setup docs i assigned ports 1 through 24 (1 GbE) as untagged ports on VLAN 1 (DEFAULT-VLAN). i was reading that you shouldn't do this, but i only just got there and haven't gone back to 'fix' yet.

i removed all of the 10 GbE ports from this default VLAN 1, and added them to let's say VLAN 3 as untagged ports. this VLAN got a VE of 10.0.6.1.

the 7250 has a default route of 0.0.0.0/0 via 192.168.1.1 next hop.

after configuring 1 or 2 firewall rules on opnsense side, as well as a gateway on opnsense with 192.168.1.2 as the address on LAN interface, with a route towards 10.0.6.0/24 via 192.168.1.2 gateway, i was able to get stuff pinging internally

however, none of the hosts on address 10.0.6.2 through 10.0.6.10 can route or ping out to the internet. i tested a few times with manually created allow any rules from 10.0.6.0/24 network source on LAN interface destination any but this didnt seem to make a difference.

despite not having anything related to "VLANs" configured on opnsense side, am I supposed to set the port that contains the physical cabling between the opnsense hardware and the ICX 7250 to tagged with everything else as untagged? am i supposed to be overlapping port assignments to VLANs? that's where I'm a little lost i think, but this might not even be my problem.