Drag to reposition cover

Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

up-n-atom

Neko
May 30, 2019
31
50
18
Canada
www.eleventwentytwo.com
Who wants to live dangerously?

I gave the FI reversing roughly a 2 year hiatus, but today my ADD got the better of me and FI nostalgia took precedence over work. 2.5Gbps was still on my agenda despite the interfering hardware. A big FU to high quality engineering and the DS100DF410 tucked inside!

I couldn't bother to dust off my Ghidra script FISeek - Pastebin.com to seek hidden commands in newer firmware, nor determine what disassembled firmware version was before me... It's dated and the hardcoded addresses within the script will not work on other versions but who cares (FYI It was 8080b and @fohdeesha has the list buried in their guide if you're interested).

5-10 minutes into it, I had what I needed, Broadcom Shell access! Don't know why it evaded me last time, since it is deadly obvious. I knew the command was tor but I was oblivious to enabling it. Stare at the disassembly for too long and you lose sight of things.

Now that I have the holy grail of switch privileged access, it's a no brainer to try out 2.5G. Guess what? It doesn't work outside of the switch ASIC ;) Obvious, I know... Maybe the 7150 lineup isn't up to the engineering prowess of the 7250? I can only hope it's equal to that of Ubiquiti hardware :p Someone, please run dm i2c or take pictures of your 7150 PCB.

FYI You can replace dm with dd for the commands below.

Anyway, to enable access to Broadcom Shell, run dm device-command tor or the cheeky dm device-command 2762233 (It spells out BROCADE on a touch tone phone).

DANGER!!! YOU CAN ABSOLUTELY BRICK OR DAMAGE YOUR SWITCH! TREAD CAREFULLY!

Run tor help and get intimate with your switch.

For extra help you can view code at src/appl/diag · bcm-6.5.7_yocto-2.5.1 · Kosta Zertsekel / bcm-sdk

Eg. My 2.5G adventure (Yes, the WarpCore phys support 2500) [Internet] Bypassing the HH3K up to 2.5Gbps using a BCM57810S NIC - Bell Canada | DSLReports Forums

Code:
phy 1/2/1
Port xe0 (PHY addr 0xc1): WC-B1/13/0 (Warpcore PHY Driver)
        0x00: 0x0000    0x01: 0x0000    0x02: 0x0000    0x03: 0x0000
        0x04: 0x0000    0x05: 0x0000    0x06: 0x0000    0x07: 0x0000
...
tor phy info
  xe0( 50)   143  bff0    c1    c1              WC-B1/13/0     250000
  xe1( 51)   143  bff0    c1    c1              WC-B1/13/1     250000
  xe2( 52)   143  bff0    c1    c1              WC-B1/13/2     250000
...
Code:
enable
dm device-command tor
tor port xe2 speed=2500
tor port xe2
ping 192.168.1.10

:(
If someone discovers something of interest please do share because I've only played for a few hours.
If you updated to FastIron 09.0.0+ the tor enablement command changed to dm device-command tor enable.
 
Last edited:
  • Like
Reactions: fohdeesha

techknight1

New Member
Jan 29, 2019
6
0
1
If you update ICX 7250 to 09.0.0 are the licensing requirements any different? I am toying with the idea of getting one and wanted to find out as much as I could about the licensing. If anyone could provide information it would greatly be appreciated.
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,828
3,269
113
33
fohdeesha.com
If you update ICX 7250 to 09.0.0 are the licensing requirements any different? I am toying with the idea of getting one and wanted to find out as much as I could about the licensing. If anyone could provide information it would greatly be appreciated.
Nope, same honor based lics. I'd like to emphasize to everyone that the v09000 release is a brand new codetrain entirely and a GA release, not even lettered yet. Expect many quirks and bugs, I've already ran into a handful poking around. The WEB UI is certainly....shinier than the old one, I personally don't care for any web UI but I have a feeling a lot of people here (casual users) would prefer it over the old web UI
 

Ralph_IT

I'm called Ralph
Apr 12, 2021
191
108
43
/home
New owner of a 6450-24 here.
Thanks to all for sharing your knowledge, specially @fohdeesha.
I had to enable L3 capabilities and upgrade the firmware, but the manual is very clear.

Unfortunately fan is loud (for me), even after booting and settle down the rpms a little.
I've seen that is a general consensus to use a Sunon MagLev 40x40x20, but I have one Noctua NF-A4 to spare.
Will it be enough or better use the Sunon?

Also, where do I have to register to access official docs for the switch? Don't know if its Broadcom (since they adquired Brocade) or Ruckus.

Thanks.
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,828
3,269
113
33
fohdeesha.com
New owner of a 6450-24 here.
Thanks to all for sharing your knowledge, specially @fohdeesha.
I had to enable L3 capabilities and upgrade the firmware, but the manual is very clear.

Unfortunately fan is loud (for me), even after booting and settle down the rpms a little.
I've seen that is a general consensus to use a Sunon MagLev 40x40x20, but I have one Noctua NF-A4 to spare.
Will it be enough or better use the Sunon?

Also, where do I have to register to access official docs for the switch? Don't know if its Broadcom (since they adquired Brocade) or Ruckus.

Thanks.
Did you read/use the upgrade and config guide linked in my OP? it contains a ZIP that has all of the official docs. Broadcom only acquired brocades fibrechannel stuff, ruckus acquired the switching line
 
  • Like
Reactions: Ralph_IT

Ralph_IT

I'm called Ralph
Apr 12, 2021
191
108
43
/home
Did you read/use the upgrade and config guide linked in my OP? it contains a ZIP that has all of the official docs. Broadcom only acquired brocades fibrechannel stuff, ruckus acquired the switching line
Yes, I did.
All the process went flawlessly. Just stopped before "Advanced Configuration" (not enough spare time).
As for the registration: didn't realized the ZIP had all the docs. Thanks again.

Just a little search with the right key words and I can reply to myself: Noctuas? Bad idea it seems
 
  • Like
Reactions: fohdeesha

techknight1

New Member
Jan 29, 2019
6
0
1
Nope, same honor based lics. I'd like to emphasize to everyone that the v09000 release is a brand new codetrain entirely and a GA release, not even lettered yet. Expect many quirks and bugs, I've already ran into a handful poking around. The WEB UI is certainly....shinier than the old one, I personally don't care for any web UI but I have a feeling a lot of people here (casual users) would prefer it over the old web UI
I guess I didn't realize that the v09 was that new. I will more than likely stick with a version a bit older and tested.

I didn't know that Brocade had been split up like that. I thought Broadcom got it all. I have only ever used the Fibre Channel and FCoE equipment, which brings me to the next question.

Did Broadcom get the Brocade 8000 series? Or did Ruckus get it? It is a great 10Gb switch, albeit a little power hungry. It is also relatively quiet. Of course after having a Dell M1000e in a home lab everything but Force10 is quiet.
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,828
3,269
113
33
fohdeesha.com
I guess I didn't realize that the v09 was that new. I will more than likely stick with a version a bit older and tested.

I didn't know that Brocade had been split up like that. I thought Broadcom got it all. I have only ever used the Fibre Channel and FCoE equipment, which brings me to the next question.

Did Broadcom get the Brocade 8000 series? Or did Ruckus get it? It is a great 10Gb switch, albeit a little power hungry. It is also relatively quiet. Of course after having a Dell M1000e in a home lab everything but Force10 is quiet.
Broadcom got that series of FC/fcoe switches including the 8000, yes

Brocade was split in a million pieces, the fibrechannel, fcoe and serveriron (adx) stuff all went to Broadcom who then EoLd almost all of it, the fastiron switching line went to ruckus, and the datacenter and routing line went to Extreme (ces/cer/mlx/vdx)
 

anemoiac

New Member
Jan 7, 2021
25
13
3
For my 7250-24P, I started with replacing the rear fans with 2x MF40201V3-1000U-G99. I found that the fans were near silent when running at speed 1, but it would intermittently kick up into speed 2 when the ASIC hit a high enough temp. This sits in a rack right next to me, so I added 1x MF60101V3-1000U-A99 that sits directly on top of the ASIC heatsink and is tapped into the constant 12v to the mainboard, and it never kicks into speed 2 now, even sitting in my rack that runs ~80F inside.
@FozzieBear Do you mind sharing how you tapped into the 12v? I have the same setup, and am trying to get the fan I attached to the ASIC working happily with the others, but am not sure how to go about powering it.
 

JoJoMan

New Member
Jul 19, 2021
10
6
3
I'm having trouble getting POE to work with the ICX-6450-48P

I updated all the firmware using tftp, everything works, I enable POE for the ports I want (1/1/37 to 1/1/48). I confirm that inline power is enabled:
Code:
 1/1/37    On     Off            0      15400  n/a      n/a         1  n/a
 1/1/38 On      Off            0      30000  n/a      n/a         3  n/a
 1/1/39    On     Off            0      30000  n/a      n/a         3  n/a
 1/1/40    On     Off            0      30000  n/a      n/a         3  n/a
 1/1/41    On     Off            0      30000  n/a      n/a         3  n/a
 1/1/42    On     Off            0      30000  n/a      n/a         3  n/a
 1/1/43    On     Off            0      30000  n/a      n/a         3  n/a
 1/1/44    On     Off            0      30000  n/a      n/a         3  n/a
 1/1/45    On     Off            0      30000  n/a      n/a         3  n/a
 1/1/46    On     Off            0      30000  n/a      n/a         3  n/a
 1/1/47    On     Off            0      30000  n/a      n/a         3  n/a
 1/1/48    On     Off            0      30000  n/a      n/a         3  n/a
Then when I plug something in, it gets no power, and all the ports are disabled again. (the something is a pi4b)
Code:
 1/1/37    On     Off            0          0  n/a      n/a         1  n/a
 1/1/38 On      Off            0          0  n/a      n/a         3  n/a
 1/1/39    On     Off            0          0  n/a      n/a         3  n/a
 1/1/40    On     Off            0          0  n/a      n/a         3  n/a
 1/1/41    On     Off            0          0  n/a      n/a         3  n/a
 1/1/42    On     Off            0          0  n/a      n/a         3  n/a
 1/1/43    On     Off            0          0  n/a      n/a         3  n/a
 1/1/44    On     Off            0          0  n/a      n/a         3  n/a
 1/1/45    On     Off            0          0  n/a      n/a         3  n/a
 1/1/46    On     Off            0          0  n/a      n/a         3  n/a
 1/1/47    On     Off            0          0  n/a      n/a         3  n/a
 1/1/48    On     Off            0          0  n/a      n/a         3  n/a
I see this in the log, but no reason/cause:
Code:
Aug 17 20:52:45:I:NTP: System clock is synchronized to 216.239.35.0.
Aug 17 20:52:39:I:System: PoE: Released complete power of 30000 mwatts on port 1/1/48.
Aug 17 20:52:38:I:System: PoE: Released complete power of 30000 mwatts on port 1/1/47.
Aug 17 20:52:38:I:System: PoE: Released complete power of 30000 mwatts on port 1/1/46.
Aug 17 20:52:38:I:System: PoE: Released complete power of 30000 mwatts on port 1/1/45.
Aug 17 20:52:38:I:System: PoE: Released complete power of 30000 mwatts on port 1/1/44.
Aug 17 20:52:37:I:System: PoE: Released complete power of 30000 mwatts on port 1/1/43.
Aug 17 20:52:37:I:System: PoE: Released complete power of 30000 mwatts on port 1/1/42.
Aug 17 20:52:37:I:System: PoE: Released complete power of 30000 mwatts on port 1/1/41.
Aug 17 20:52:37:I:System: PoE: Released complete power of 30000 mwatts on port 1/1/40.
Aug 17 20:52:37:I:System: PoE: Released complete power of 30000 mwatts on port 1/1/39.
Aug 17 20:52:36:I:System: PoE: Released complete power of 30000 mwatts on port 1/1/38.
Aug 17 20:52:36:I:System: PoE: Released complete power of 15400 mwatts on port 1/1/37.
 

techknight1

New Member
Jan 29, 2019
6
0
1
Really? first of this very long thread has all the answers.
Really?! First off, I have not used Brocade networking equipment before other than the Brocade 8000. I was simply trying to find out what licenses are required for what switches. This might seem like a simple and stupid question for someone with experience, but for someone that is inexperienced with a majority of Brocade equipment it is a legitimate question.

I have looked through this very long thread and have found no such list of switch to license requirements.

Last time I looked this site is still Server The Home, which leads me to believe that I have the ability to come here and possibly learn a little bit about all things technology. That also includes asking questions when something specific is not pinned in a certain area.

If you can show me where this very specific list is at I am more than willing to admit that I was wrong.
 

JoJoMan

New Member
Jul 19, 2021
10
6
3
Really?! First off, I have not used Brocade networking equipment before other than the Brocade 8000. I was simply trying to find out what licenses are required for what switches. This might seem like a simple and stupid question for someone with experience, but for someone that is inexperienced with a majority of Brocade equipment it is a legitimate question.

I have looked through this very long thread and have found no such list of switch to license requirements.

Last time I looked this site is still Server The Home, which leads me to believe that I have the ability to come here and possibly learn a little bit about all things technology. That also includes asking questions when something specific is not pinned in a certain area.

If you can show me where this very specific list is at I am more than willing to admit that I was wrong.

some of these models require license unlocks. PM or email me to request one (they are free and no I am not going to run out).
I may not be a network engineer, but im assuming this means that if the model is listed in the OP, you can pm to get a license
 
  • Like
Reactions: Vesalius

fohdeesha

Kaini Industries
Nov 20, 2016
2,828
3,269
113
33
fohdeesha.com
I'm having trouble getting POE to work with the ICX-6450-48P

I updated all the firmware using tftp, everything works, I enable POE for the ports I want (1/1/37 to 1/1/48). I confirm that inline power is enabled:
Code:
 1/1/37    On     Off            0      15400  n/a      n/a         1  n/a
1/1/38 On      Off            0      30000  n/a      n/a         3  n/a
1/1/39    On     Off            0      30000  n/a      n/a         3  n/a
1/1/40    On     Off            0      30000  n/a      n/a         3  n/a
1/1/41    On     Off            0      30000  n/a      n/a         3  n/a
1/1/42    On     Off            0      30000  n/a      n/a         3  n/a
1/1/43    On     Off            0      30000  n/a      n/a         3  n/a
1/1/44    On     Off            0      30000  n/a      n/a         3  n/a
1/1/45    On     Off            0      30000  n/a      n/a         3  n/a
1/1/46    On     Off            0      30000  n/a      n/a         3  n/a
1/1/47    On     Off            0      30000  n/a      n/a         3  n/a
1/1/48    On     Off            0      30000  n/a      n/a         3  n/a
Then when I plug something in, it gets no power, and all the ports are disabled again. (the something is a pi4b)
Code:
1/1/37    On     Off            0          0  n/a      n/a         1  n/a
1/1/38 On      Off            0          0  n/a      n/a         3  n/a
1/1/39    On     Off            0          0  n/a      n/a         3  n/a
1/1/40    On     Off            0          0  n/a      n/a         3  n/a
1/1/41    On     Off            0          0  n/a      n/a         3  n/a
1/1/42    On     Off            0          0  n/a      n/a         3  n/a
1/1/43    On     Off            0          0  n/a      n/a         3  n/a
1/1/44    On     Off            0          0  n/a      n/a         3  n/a
1/1/45    On     Off            0          0  n/a      n/a         3  n/a
1/1/46    On     Off            0          0  n/a      n/a         3  n/a
1/1/47    On     Off            0          0  n/a      n/a         3  n/a
1/1/48    On     Off            0          0  n/a      n/a         3  n/a
I see this in the log, but no reason/cause:
Code:
Aug 17 20:52:45:I:NTP: System clock is synchronized to 216.239.35.0.
Aug 17 20:52:39:I:System: PoE: Released complete power of 30000 mwatts on port 1/1/48.
Aug 17 20:52:38:I:System: PoE: Released complete power of 30000 mwatts on port 1/1/47.
Aug 17 20:52:38:I:System: PoE: Released complete power of 30000 mwatts on port 1/1/46.
Aug 17 20:52:38:I:System: PoE: Released complete power of 30000 mwatts on port 1/1/45.
Aug 17 20:52:38:I:System: PoE: Released complete power of 30000 mwatts on port 1/1/44.
Aug 17 20:52:37:I:System: PoE: Released complete power of 30000 mwatts on port 1/1/43.
Aug 17 20:52:37:I:System: PoE: Released complete power of 30000 mwatts on port 1/1/42.
Aug 17 20:52:37:I:System: PoE: Released complete power of 30000 mwatts on port 1/1/41.
Aug 17 20:52:37:I:System: PoE: Released complete power of 30000 mwatts on port 1/1/40.
Aug 17 20:52:37:I:System: PoE: Released complete power of 30000 mwatts on port 1/1/39.
Aug 17 20:52:36:I:System: PoE: Released complete power of 30000 mwatts on port 1/1/38.
Aug 17 20:52:36:I:System: PoE: Released complete power of 15400 mwatts on port 1/1/37.
seems like some kind of negotiation error, did you update the poe firmware as well? if I recall the highest power class of 30w requires lldp to negotiate fully, can you try running the following then unplug/replug stuff


Code:
enable
conf t
lldp run
 
  • Like
Reactions: NablaSquaredG