Drag to reposition cover

Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

fohdeesha

Kaini Industries
Nov 20, 2016
2,868
3,367
113
34
fohdeesha.com
Many thanks @fohdeesha for all that you've done to help others configure/maintain these switches. This is an amazing gift!

Like @sdyoung, I have a switch (ICX 6450-48P) with an old bootloader. I followed Fohdeesha's advice to work-around this initial hiccup.

Then, using pointers from @sdyoung and @Lone Wolf, I was able to get access to the web GUI using the following;
Code:
>enable
#configure terminal
(config)#ip address 10.1.1.3/24
(config)#username root password MyRootPassword
(config)#username dale privilege 0 password MyPassword
(config)#aaa authentication login default enable local
(config)#aaa authentication web-server default local
(config)#write memory
(I created the non-root user because I could not get 'root' to login on the Web GUI)
Then, rebooting the switch by unplugging and plugging back in.

My understanding from Lone Wolf's post is that I need to update the primary image via the Web GUI.
I successfully
- logged into the Web GUI as the 'dale' user
- scrolled down the left-menu to TFTP configuration
- set TFTP Server: 10.1.1.2 (my computer with TFTPd64 running)
- set Configuration File Name: ICX64xx/ICX64R08030u.bin (from Fohdeesha's instructions)

I have also temporarily disabled my Win10 firewall.

When I click 'Copy from Server to Flash' button in Web GUI, I'm seeing
- the progress bar start on the web gui
- tftpd64 shows bits being transferred for about 5 seconds (500,000-ish bytes)

Then I get an error on the page
Status : TFTP out of buffer space error.

This error shows in the console too
Code:
ICX6450-48P Switch#!!! Flash Task Got unblocked without cause, fd 13, ffp
stack: 015aacc0 015a626c 01777e34

TFTP out of buffer space error.
I don't know if the problem is with TFTPD64 on my windows box or with the config on the switch. Or, maybe I need to figure out why I can't login as root on Web Gui. Any suggestions to troubleshoot and resolve?

Many many thanks to Fohdeesha and all who have contributed on this thread to get me this far. I greatly appreciate it.
glad to help - is there any reason you didn't continue following the guide and instead started trying to boot into the included L2 only firmware and use the web UI? the web UI is super buggy and I would not attempt firmware upgrades from it, especially with tftp file paths including slashes. I would go back and follow the guide from the beginning, I've also added a sub-note right in the guide on how to fix the old bootloader/missing factory command issue: ICX6450 - Fohdeesha Docs
 
  • Like
Reactions: Jason Antes

Lone Wolf

Member
Apr 3, 2022
47
9
8
glad to help - is there any reason you didn't continue following the guide and instead started trying to boot into the included L2 only firmware and use the web UI? the web UI is super buggy and I would not attempt firmware upgrades from it, especially with tftp file paths including slashes. I would go back and follow the guide from the beginning, I've also added a sub-note right in the guide on how to fix the old bootloader/missing factory command issue: ICX6450 - Fohdeesha Docs
I checked out the updated guide and I am assuming you are referring to the sub-note " If you get "factory set-default is not a valid command" ". If so, that won't work on an older firmware, or at least it wouldn't work on mine that had a v7 firmware. Your sub-note assumes we can update the uboot through the cli, which in my case I couldn't. I was unable to update the primary, secondary or uboot through cli. I HAD to go into the webui and update the Primary. Once I did that and rebooted I was able to follow your guide exactly. If daleq has an older v7 firmware and bootloader like I did, he will be unable to update the uboot like me, leaving the webui the only option that I know of.

If the webui is having problems with the slash in the path, could daleq move ICX64R08030u.bin up a folder so that it's not in a sub-folder and then just specify the file name directly?
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,868
3,367
113
34
fohdeesha.com
I checked out the updated guide and I am assuming you are referring to the sub-note " If you get "factory set-default is not a valid command" ". If so, that won't work on an older firmware, or at least it wouldn't work on mine that had a v7 firmware. Your sub-note assumes we can update the uboot through the cli, which in my case I couldn't. I was unable to update the primary, secondary or uboot through cli. I HAD to go into the webui and update the Primary. Once I did that and rebooted I was able to follow your guide exactly. If daleq has an older v7 firmware and bootloader like I did, he will be unable to update the uboot like me, leaving the webui the only option that I know of.

If the webui is having problems with the slash in the path, could daleq move ICX64R08030u.bin up a folder so that it's not in a sub-folder and then just specify the file name directly?
Woah, there's 6450 bootloaders that don't even have update_uboot? I've never seen those, I wonder if I can try to dig one out of old v7 zips and test here. do you happen to remember the version of that bootloader? v7 would have been the OS firmware train, not bootloader
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,868
3,367
113
34
fohdeesha.com
OK, the oldest fastiron release I could find that supports the ICX64xx is 7.4, which has kxz07401 for the bootloader, and it has both update_uboot and update_primary - are you sure you didn't have one of those weird dev bootloaders? did this switch have a black and white QR code sticker on it by chance
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,868
3,367
113
34
fohdeesha.com
OK yeah going back through your original post you definitely had some pre-production/unreleased bootloader not based on u-boot, as you said the "setenv" commands wouldn't even take - if it was the production u-boot loader (even the oldest one they've published), setenv would have worked at a minimum as that's baked into the base u-boot code
 
  • Like
Reactions: Lone Wolf

Lone Wolf

Member
Apr 3, 2022
47
9
8
OK yeah going back through your original post you definitely had some pre-production/unreleased bootloader not based on u-boot, as you said the "setenv" commands wouldn't even take - if it was the production u-boot loader (even the oldest one they've published), setenv would have worked at a minimum as that's baked into the base u-boot code
Ahh okay. I got the switch at the beginning of the year, and I don't know what version of the firmware and bootloader it came with, other than that the firmware was v7.something. I don't have a black and white QR code sticker on it, but that doesn't mean it wasn't removed at some point in the past.

As you saw in my post I was unable to update primary, secondary or uboot through cli. I was able to update the primary through the webui tho, at which point I could follow your guide and successfully update everything through the cli. I wonder if daleq is having this issue as well? If he can update his uboot through the cli then he should be golden, if he can't then going through the webui to update the primary might be his only option.
 
  • Like
Reactions: fohdeesha

kimbo

New Member
Jun 15, 2022
6
0
1
I have two 6450s connected via Brocade branded SFP+ modules. Can I use optical monitoring to check signal strength?
 

daleq

New Member
Mar 11, 2015
16
5
3
60
Thanks @fohdeesha and @Lone Wolf.

I apologize, but I won't be able to investigate further until Monday.

FYI - Here is a photo showing a sticker on the back of the units. This is in addition to the silver sticker with the regulatory marks.
IMG_4749.jpg

And, here is what I see on the console during boot.

Bootloader Version: 07.4.01T310 (Jun 29 2012 - 11:04:25)
Model ID: 1.0.0.1.1.0
SW: Version 07.4.00bT311
Boot-Monitor Image: Version:07.4.01T310 (kxz07401)

Code:
Bootloader Version: 07.4.01T310 (Jun 29 2012 - 11:04:25)


Model ID: 1.0.0.1.1.0

Enter 'b' to stop at boot monitor:  0
bootdelay: ===
Booting image from Primary
## Booting image at 00007fc0 ...
   Created:      2012-10-03  15:43:34 UTC
   Data Size:    10371200 Bytes =  9.9 MB
   Load Address: 00008000
   Entry Point:  00008000
   Verifying Checksum ... OK
OK

Starting kernel in BE mode ...
Uncompressing Image <snip> done, booting the kernel.
Config partition mounted.
*** Crash dump information is available, please collect it using "supportsave" C            LI ***
Starting the FastIron.
OS>Starting Main Task .CPSS DxCh Version: cpss3.4p1 release
        mem_size = 6400 mem_size = 6400Pre Parsing Config Data ...

Parsing Config Data ...
Invalid input -> LINX, LINX
Type ? for a list

  Copyright (c) 1996-2012 Brocade Communications Systems, Inc. All rights reserv                               ed.
    UNIT 1: compiled on Oct  3 2012 at 08:42:29 labeled as ICX64S07400b
                (10371776 bytes) from Primary ICX64S07400b.bin
        SW: Version 07.4.00bT311
  Boot-Monitor Image size = 776680, Version:07.4.01T310 (kxz07401)
  HW: Stackable ICX6450-48-HPOE
==========================================================================
UNIT 1: SL 1: ICX6450-48p POE 48-port Management Module
         Serial  #: BZT3233K04Y
         License: BASE_SOFT_PACKAGE   (LID: dbvIHIImFJa)
         P-ENGINE  0: type DEF0, rev 01
         P-ENGINE  1: type DEF0, rev 01
==========================================================================
UNIT 1: SL 2: ICX6450-SFP-Plus 4port 40G Module
==========================================================================
  800 MHz ARM processor ARMv5TE, 400 MHz bus
65536 KB flash memory
  512 MB DRAM
STACKID 1  system uptime is 16 seconds
The system : started=cold start

..PoD: No license present for port 1/2/2
..PoD: No license present for port 1/2/4
ICX6450-48P Switch>
Stack unit 1 PS 1, Internal Power supply detected and up.
PoE: Stack unit 1 Power supply 1 with 740000 mwatts capacity is up
PoE Info: Adding new 54V capacity of 740000 mW, total capacity is 740000, total                                free capacity is 740000
PoE Info: PoE module detected. Initializing....
PoE Info: PoE module 1 of Unit 1 initialization is done.
Unless someone suggests otherwise, I'll plan to move the .bin file up a directory and try to flash the primary with the web gui.
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,868
3,367
113
34
fohdeesha.com
Thanks @fohdeesha and @Lone Wolf.

I apologize, but I won't be able to investigate further until Monday.

FYI - Here is a photo showing a sticker on the back of the units. This is in addition to the silver sticker with the regulatory marks.
View attachment 23843

And, here is what I see on the console during boot.

Bootloader Version: 07.4.01T310 (Jun 29 2012 - 11:04:25)
Model ID: 1.0.0.1.1.0
SW: Version 07.4.00bT311
Boot-Monitor Image: Version:07.4.01T310 (kxz07401)

Code:
Bootloader Version: 07.4.01T310 (Jun 29 2012 - 11:04:25)


Model ID: 1.0.0.1.1.0

Enter 'b' to stop at boot monitor:  0
bootdelay: ===
Booting image from Primary
## Booting image at 00007fc0 ...
   Created:      2012-10-03  15:43:34 UTC
   Data Size:    10371200 Bytes =  9.9 MB
   Load Address: 00008000
   Entry Point:  00008000
   Verifying Checksum ... OK
OK

Starting kernel in BE mode ...
Uncompressing Image <snip> done, booting the kernel.
Config partition mounted.
*** Crash dump information is available, please collect it using "supportsave" C            LI ***
Starting the FastIron.
OS>Starting Main Task .CPSS DxCh Version: cpss3.4p1 release
        mem_size = 6400 mem_size = 6400Pre Parsing Config Data ...

Parsing Config Data ...
Invalid input -> LINX, LINX
Type ? for a list

  Copyright (c) 1996-2012 Brocade Communications Systems, Inc. All rights reserv                               ed.
    UNIT 1: compiled on Oct  3 2012 at 08:42:29 labeled as ICX64S07400b
                (10371776 bytes) from Primary ICX64S07400b.bin
        SW: Version 07.4.00bT311
  Boot-Monitor Image size = 776680, Version:07.4.01T310 (kxz07401)
  HW: Stackable ICX6450-48-HPOE
==========================================================================
UNIT 1: SL 1: ICX6450-48p POE 48-port Management Module
         Serial  #: BZT3233K04Y
         License: BASE_SOFT_PACKAGE   (LID: dbvIHIImFJa)
         P-ENGINE  0: type DEF0, rev 01
         P-ENGINE  1: type DEF0, rev 01
==========================================================================
UNIT 1: SL 2: ICX6450-SFP-Plus 4port 40G Module
==========================================================================
  800 MHz ARM processor ARMv5TE, 400 MHz bus
65536 KB flash memory
  512 MB DRAM
STACKID 1  system uptime is 16 seconds
The system : started=cold start

..PoD: No license present for port 1/2/2
..PoD: No license present for port 1/2/4
ICX6450-48P Switch>
Stack unit 1 PS 1, Internal Power supply detected and up.
PoE: Stack unit 1 Power supply 1 with 740000 mwatts capacity is up
PoE Info: Adding new 54V capacity of 740000 mW, total capacity is 740000, total                                free capacity is 740000
PoE Info: PoE module detected. Initializing....
PoE Info: PoE module 1 of Unit 1 initialization is done.
Unless someone suggests otherwise, I'll plan to move the .bin file up a directory and try to flash the primary with the web gui.
yeah you have the standard (but old) bootloader, I highly recommend following the actual guide, it's been adjusted to account for these older loaders: ICX6450 - Fohdeesha Docs
 

daleq

New Member
Mar 11, 2015
16
5
3
60
glad to help - is there any reason you didn't continue following the guide and instead started trying to boot into the included L2 only firmware and use the web UI? <snip>. I would go back and follow the guide from the beginning, I've also added a sub-note right in the guide on how to fix the old bootloader/missing factory command issue: ICX6450 - Fohdeesha Docs
<snip> I highly recommend following the actual guide, it's been adjusted to account for these older loaders: ICX6450 - Fohdeesha Docs
Thanks @fohdeesha.

Eventually I caught on and followed the fine documentation. :) Of course it worked perfectly. Thanks!
I've finished the config/upgrade guide and will proceed with the advanced configuration tomorrow.

One small suggestion, my error text for the factory command was
Code:
ICX64XX-boot>> factory set-default
Unknown command 'factory' - try 'help'
So, perhaps change
- From: If you get "factory set-default is not a valid command"
- - - To: If you get "Unknown command 'factory'"

Again, thank you so much for your contribution here. I have appreciated it greatly.
 

kevindd992002

Member
Oct 4, 2021
125
6
18
Based on the icx6450 documentation, without the external psu it only has 24 poe+ capable ports and 48 poe capable ports. Does that mean what it says it means? Only 24 ports can be used as poe+ even if the power budget is not exceeded?
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,868
3,367
113
34
fohdeesha.com
Thanks @fohdeesha.

Eventually I caught on and followed the fine documentation. :) Of course it worked perfectly. Thanks!
I've finished the config/upgrade guide and will proceed with the advanced configuration tomorrow.

One small suggestion, my error text for the factory command was
Code:
ICX64XX-boot>> factory set-default
Unknown command 'factory' - try 'help'
So, perhaps change
- From: If you get "factory set-default is not a valid command"
- - - To: If you get "Unknown command 'factory'"

Again, thank you so much for your contribution here. I have appreciated it greatly.
Thanks @fohdeesha.

Eventually I caught on and followed the fine documentation. :) Of course it worked perfectly. Thanks!
I've finished the config/upgrade guide and will proceed with the advanced configuration tomorrow.

One small suggestion, my error text for the factory command was
Code:
ICX64XX-boot>> factory set-default
Unknown command 'factory' - try 'help'
So, perhaps change
- From: If you get "factory set-default is not a valid command"
- - - To: If you get "Unknown command 'factory'"

Again, thank you so much for your contribution here. I have appreciated it greatly.
Thanks for the error text! I was wondering what it was exactly, didn't have a switch here to test with that old of bootloader. fixed on the guide: fix factory set default error · Fohdeesha/lab-docu@47a5f4a
 
  • Like
Reactions: itronin and daleq

fohdeesha

Kaini Industries
Nov 20, 2016
2,868
3,367
113
34
fohdeesha.com
also pushed a fix for the cases where some users with icx7xxx series experienced it rebooting into an old bootloader (which then couldn't boot the new OS) even though they just flashed a new one. The issue was caused by the fact that the bootloader flashing command only flashes the currently active bootloader slot, for these users that would be "slot secondary". The guide then specified using "boot_primary" to boot into the OS - however this bootloader command turned out to also be specifying which bootloader slot to boot from as well (not just OS slot), so for these users who had just updated the secondary boot slot, booting from the primary boot slot would be an old bootloader. using reset instead of boot_primary always reboots using the currently active boot slot (the one we just updated), then once fastiron fully boots, the UEFI image will update all boot slots

 

kimbo

New Member
Jun 15, 2022
6
0
1
Thank you for the link! :)

Everything is reporting as normal (see below), but the Tx Bias seems high to me. Is there anyway to see what the normal range is? I'm using LC UPC OS2 fibre if that makes a difference.

Code:
 Port  Temperature   Tx Power     Rx Power       Tx Bias Current
+----+-----------+--------------+--------------+---------------+
1/2/3   30.0703 C  -001.5187 dBm -005.5067 dBm   42.718 mA
        Normal      Normal        Normal         Normal
 

pr09

New Member
Jun 21, 2020
10
2
3
ICX 7250 / 08.0.90k / IPv6 neighbor discovery roaming

I have it configured as an L3 switch (ve interfaces, static routes). There are two access points plugged into different ports, both serving the same SSID/VLAN. When a device roams from one AP to the other, the switch updates its MAC table (show mac-address vlan 10) with the new port, but the ND table still binds the IP/mac combo to the old port (show ipv6 neighbor ve 10). This makes the IP address unreachable.

Has anyone else encountered this bug? Do newer software releases fix this (without adding too many other IPv6-related bugs)? Is there a command to work around this? Or do I need to just stop trying to use L3 functionality on this switch?
 

kevindd992002

Member
Oct 4, 2021
125
6
18
Based on the icx6450 documentation, without the external psu it only has 24 poe+ capable ports and 48 poe capable ports. Does that mean what it says it means? Only 24 ports can be used as poe+ even if the power budget is not exceeded?
@fohdeesha any ideas? Can I use more than 24 ports as PoE+ as long as the total power budget of 780W is not exceeded? At least that's what I know about PoE/PoE+ is.
 

kpfleming

Active Member
Dec 28, 2021
432
222
43
Pelham NY USA
Do newer software releases fix this (without adding too many other IPv6-related bugs)?
I had lots of strange IPv6 issues using 08.xx firmware, so I switched to 09.xx as soon as it was released (against advice in this thread, but I knew how to revert if I needed to do so). I haven't had any new problems with 09.xx, and those IPv6 issues went away.

If you don't want to go that far, moving up 08.0.95<current> would be an improvement over what you have now.
 

juju

Member
Sep 29, 2021
36
1
8
I am having connectivity problems hooking up my ICX-7250 to a Dell Poweredge R740 server . The Dell has an Intel X520/I350 daughter card. My connection uses a DAC cable from one of the 10G ports on the Intel card to one 10G port on the ICX-7250.
My connection is very instable , with frequent loss of connectivity. Not sure how to troubleshoot this - change the DAC cable? I previously had stp setup on the brocade, so I turned it off because I thought the Dell Poweredge was bringing down the network with a broadcast storm. The network was rock solid until I included the Dell server. What should I be looking for?
 
Last edited:

fohdeesha

Kaini Industries
Nov 20, 2016
2,868
3,367
113
34
fohdeesha.com
ICX 7250 / 08.0.90k / IPv6 neighbor discovery roaming

I have it configured as an L3 switch (ve interfaces, static routes). There are two access points plugged into different ports, both serving the same SSID/VLAN. When a device roams from one AP to the other, the switch updates its MAC table (show mac-address vlan 10) with the new port, but the ND table still binds the IP/mac combo to the old port (show ipv6 neighbor ve 10). This makes the IP address unreachable.

Has anyone else encountered this bug? Do newer software releases fix this (without adding too many other IPv6-related bugs)? Is there a command to work around this? Or do I need to just stop trying to use L3 functionality on this switch?
this was always an issue for me on the icx6xxx (v8030) series, never tried on the 7 series - I would at least update to the recommended stable from ruckus (8095g, it's what's on the guide in this thread), if that still doesn't fix it you can try the absolute latest (09.0.10c)