Drag to reposition cover

Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

t3m.2

New Member
Jun 21, 2022
1
1
3
Hi All,

I have a ICX-7250-24 switch I followed the Fohdeesha Docs for setup and licensing. I ordered 3 Mikrotik S+RJ10 SFP modules for 10 G connectivity.When I plug the 10G transceivers into the switch they do not light up and when I type show media validation the Type is 1GE M-SX(SFP)
The sticker on the outside says MikroTik S+RJ10 is there anyway I can vailid the transceivers?
brocade.PNG
 
  • Like
Reactions: MelnorMelvin

MelnorMelvin

New Member
Apr 21, 2022
9
2
3
Hello,
I currently own the icx7250-48P but I wanted to plan for a replacement just in case it breaks. The problem is ebay doesn't have as many sellers now for the 7250 which caused the prices to increase significantly. Also the recommended replacement, ICX 7150-48P, also has a similar 'sellers market' situation. What are your recommended alternatives if I can't find a 7250 or 7150 when my switch breaks? I do have a temporary netgear poe switch to keep me running while I search for a replacement. I am willing to drop down to the 6450 if need be, since those are still in the low hundreds. For my use case, the 6610 is too loud and the compact ones don't have enough ports. I would prefer to stick with a brocade/ruckus/commscope switch but I am willing to branch out to other brands with a similar command line if the price is right. Thank you for your help.
I'm jealous of the 7250-48P. I've only got a 7250-24P in my rack. I was late to the game, and couldn't justify the 48P at current prices.

As far as the 6450-48P, I can vouch for that one. Quite a nice switch, and the fans can be modded to be even quieter if required. Only downside, in my humble opinion, is older firmware that still uses the 'dual-mode' for VLANs. And like you say, the price is right. I managed to snag two 6450-48P's recently for ~$100 while I was waiting for 7000 series at the right price.

The 6610-48P isn't terrible as long as you have Rev B/C PSU's in it. About the same Stage 1 fan speed noise as my 4U Supermicro server. That power draw is rough on it, though.
 
  • Like
Reactions: mintchipmadness

adman_c

Active Member
Feb 14, 2016
286
158
43
Chicago
Why is that a downside? I've seen some shade cast against dual-mode but I confess I don't understand why that's bad.
Not sure about MelnorMelvin's opinion, but in mine it's just a little bit awkward is all. I prefer the new approach of just setting one vlan as untagged and then whatever else you want as tagged. Now if they could just increase the things you can do with vlan-config so I could make all vlan changes to a single port without bouncing from vlan to vlan.
 
  • Like
Reactions: MelnorMelvin

mintchipmadness

New Member
Nov 27, 2020
24
6
3
I'm jealous of the 7250-48P. I've only got a 7250-24P in my rack. I was late to the game, and couldn't justify the 48P at current prices.

As far as the 6450-48P, I can vouch for that one. Quite a nice switch, and the fans can be modded to be even quieter if required. Only downside, in my humble opinion, is older firmware that still uses the 'dual-mode' for VLANs. And like you say, the price is right. I managed to snag two 6450-48P's recently for ~$100 while I was waiting for 7000 series at the right price.

The 6610-48P isn't terrible as long as you have Rev B/C PSU's in it. About the same Stage 1 fan speed noise as my 4U Supermicro server. That power draw is rough on it, though.
Thank you for your advice. I'll plan for a 6450 if I can't find a 7250/7150. My setup is fairly simple so the older firmware won't be a problem. This forum definitely got me hooked on the ICX switches. I just wish the 300 dollar 7250s will return to ebay.
 

rootpeer

Member
Oct 19, 2019
86
17
8
Hey guys! I have multiple of these switches and I have an issue.

For some reason, I cannot access the switches either through SSH or the Web UI through OpenVPN. I have to SSH to a device on the same subnet as the switch and then SSH from that device to the Brocade switch.

Is there a setting I can tweak to fix this?
 

kpfleming

Active Member
Dec 28, 2021
459
237
43
Pelham NY USA
It sounds like your ICX devices don't have an IP route to your VPN endpoints through the VPN server/gateway. Are you running OpenVPN on your regular (default) router on the network, or on another machine?
 
  • Like
Reactions: rootpeer

rootpeer

Member
Oct 19, 2019
86
17
8
It sounds like your ICX devices don't have an IP route to your VPN endpoints through the VPN server/gateway. Are you running OpenVPN on your regular (default) router on the network, or on another machine?
I am running OpenVPN on my pfSense firewall(s). Everything else is accessible just fine. This happens at 3 separate locations with 4 separate switches. Every location is running OpenVPN on pfSense.

Edit: I am not using the OOB management port, I am using a veth interface.


Code:
$ ssh -o KexAlgorithms=+diffie-hellman-group1-sha1 -o PreferredAuthentications=password -o PubkeyAuthentication=no root@10.0.10.2 -vvv
OpenSSH_8.9p1, OpenSSL 1.1.1m  14 Dec 2021
debug1: Reading configuration data /etc/ssh/ssh_config
debug2: resolve_canonicalize: hostname 10.0.10.2 is address
debug3: expanded UserKnownHostsFile '~/.ssh/known_hosts' -> '/home/user/.ssh/known_hosts'
debug3: expanded UserKnownHostsFile '~/.ssh/known_hosts2' -> '/home/user/.ssh/known_hosts2'
debug3: ssh_connect_direct: entering
debug1: Connecting to 10.0.10.2 [10.0.10.2] port 22.
debug3: set_sock_tos: set socket 3 IP_TOS 0x48
debug1: connect to address 10.0.10.2 port 22: Connection timed out
ssh: connect to host 10.0.10.2 port 22: Connection timed out
Edit2: OK I fixed it, @kpfleming you were right. I had skipped the Network Configuration Default Route & DNS setup from the guide: ICX6xxx Advanced - Fohdeesha Docs

I can now access the switch from my OpenVPN tunnel.
 
Last edited:
  • Like
Reactions: kpfleming

floydcohen

New Member
Jun 6, 2022
3
0
1
First off, let's just state I'm an idiot. OK, done. I've only made it sequentially to page 60 of this thread, but did a lot of targeted searches in the hopes of finding a solution.

Got an ICX6450-24p from ebay, everything was working great... except a slight fan whine. So, before ordering some of the recommended sunon or noctura fans, I figured I'd tried to see if the switch could run fanless or with the case off.
First, I disconnected both fans with cover off. Seems to run fine with ambient temps for 30 minutes, never even reaching the warning threshold.
So..... next, I covered it back up. Turned on and figured let it cook for a bit, assuming the critical shutdown would protect the switch. Well, I went about and did chores and like 15 minutes later came back to a dead switch.

Dead switch = no lights, no fans. Only a slight relay click/pop near power supply when applying power. Kill-a-watt shows 9 watts. Serial connection shows nothing.

Left it to cool down without power, nothing.
Left it to cool down with power, nothing. Google-fu seems to imply there's a 5 minute restart timer if/when temperature hits critical.

So, now trying to troubleshoot: If I disconnect the 14-pin power connector to intermediate/EPS board, no click when applying power. If I disconnect the 10-pin power from intermediate/EPS to mainboard, no click when applying power. Assuming the board is like a PC power supply, there's a "power button" switch that triggers the click when I apply power. Tried holding down the front reset button for 30+ seconds with and without applying power.

Most likely I fried the mainboard and/or the power supply. Tried removing the POE board/power cables too.

So my last hope for now, is that perhaps there's a jumper, fuse or something physical not letting the power supply (assuming it is working) apply power to the mainboard (led/fans/cpu/ram) because of an overheat event or perhaps broken temp sensor. Already ordered another icx6450-24p, so can at least check power supply swap and see what happens when that arrives.
Also if anyone has diagrams and suggestions on what to test on the plugs with a meter, that would be great! My googlefu hasn't been good at finding info on their proprietary stuff.

ebay for just icx6450-24p replacement power supply comes up empty, but the ICX6400 external power supplies seems like a way to "fix" this, although most items cost almost as much as another switch anyways lol. So if anyone has experience with the ICX6400 EPS being the main/only power supply with a presumably working mainboard, that'd be reassuring to hear.

Editted to add: no obvious burn marks, no burning/burnt smell.
 
Last edited:

c4th4r5y5

New Member
Jun 30, 2022
3
1
3
Hi all,

I am having trouble running the update_primary and update_uboot commands on my newly acquired ICX6450

(sorry if this error was troubleshooted in the past, I failed to see anyone mention this specifically)

Code:
ICX64XX-boot>> update_primary
Using egiga0 device
TFTP from server 10.0.0.192; our IP address is 10.0.0.202
Download Filename 'ICX64xx/ICX64R08030u.bin'.
Load address: 0x3000000
Download to address: 0x3000000
Loading: %#################################################################
         #################################################################
         #################################################################
         #################################################################
         #################################################################
         #################################################################
         #################################################################
         #################################################################
         #################################################################
         #################################################################
         #######################
done
Bytes transferred = 9871112 (969f08 hex)
Error: The data payload crc 1bbc09c2 and the calculated  crc  8a109441 mismatch
I get the same error when I run the update_uboot command (except the payload/calculated crc varies). Its the ICX6450-48p

Code:
ICX64XX-boot>> version

10.1.01T310 (Apr  9 2014 - 18:01:02)
(Apr  9 2014 - 18:01:14)
CPLD version 1.1.0
PoE Software Version: N/A
I do not see any apparent problems with the switch other than this (which is step 1 lol), maybe someone experienced this or has an idea how to fix that?

Thanks for the thread/docs it is very nice!
 
Last edited:

Lone Wolf

Member
Apr 3, 2022
47
9
8
Hi all,

I am having trouble running the update_primary and update_uboot commands on my newly acquired ICX6450

(sorry if this error was troubleshooted in the past, I failed to see anyone mention this specifically)

I get the same error when I run the update_uboot command (except the payload/calculated crc varies). Its the ICX6450-48p


I do not see any apparent problems with the switch other than this (which is step 1 lol), maybe someone experienced this or has an idea how to fix that?

Thanks for the thread/docs it is very nice!
If you type in 'show ver' what does it show?
 

c4th4r5y5

New Member
Jun 30, 2022
3
1
3
If you type in 'show ver' what does it show?

Code:
 Copyright (c) 1996-2015 Brocade Communications Systems, Inc. All rights reserved.
    UNIT 1: compiled on Jan 26 2016 at 22:02:54 labeled as ICX64S08030f
                (8496808 bytes) from Primary ICX64S08030f.bin
        SW: Version 08.0.30fT311
  Boot-Monitor Image size = 786944, Version:10.1.01T310 (kxz10105)
  HW: Stackable ICX6450-48-HPOE
==========================================================================
UNIT 1: SL 1: ICX6450-48P POE 48-port Management Module
         Serial  #: BZT2546H7JE
         License: BASE_SOFT_PACKAGE   (LID: dbvHKJLjMlg)
         P-ENGINE  0: type DEF0, rev 01
         P-ENGINE  1: type DEF0, rev 01
==========================================================================
UNIT 1: SL 2: ICX6450-SFP-Plus 4port 40G Module
==========================================================================
  800 MHz ARM processor ARMv5TE, 400 MHz bus
65536 KB flash memory
  512 MB DRAM
STACKID 1  system uptime is 1 minute(s) 18 second(s)
The system : started=cold start
I tried again today with some network changes and still the same error as my initial attempt

Looking at the values and what I am inputing for the file names, I could assume maybe my switch is already updated?
 

floydcohen

New Member
Jun 6, 2022
3
0
1
Code:
Error: The data payload crc 1bbc09c2 and the calculated  crc  8a109441 mismatch
Sounds like maybe the firmware files got corrupted. Try redownloading the original/extract again. On the really really really off chance, maybe try a different tftp server. Back in the old days, tftp servers would transfer 7-bit by default, not 8-bit.
 

c4th4r5y5

New Member
Jun 30, 2022
3
1
3
Code:
Error: The data payload crc 1bbc09c2 and the calculated  crc  8a109441 mismatch
Sounds like maybe the firmware files got corrupted. Try redownloading the original/extract again. On the really really really off chance, maybe try a different tftp server. Back in the old days, tftp servers would transfer 7-bit by default, not 8-bit.

I just tried again, this time I disabled 'Option Negociation' and made it 'Bind TFTP to address' in tftpd64 and it worked! Hopefully this clears it for future reference


(I downloaded it three time before playing with the options and also changed the way I was unzipping to no avail)
 
  • Like
Reactions: Lone Wolf