Drag to reposition cover

Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

bwahaha

Active Member
Jun 9, 2023
127
97
28
I’ve connected to the TFTP server fine and update_primary without issue, but the uboot update always fails. Was this ever resolved/or how did anyone else fix it?
On mine it says:


Also says,
Seems like there’s something hopefully simple that I’ve missed. I appreciate any help with this!
Shot in the dark, but I think egiga0 is the Management ethernet port (might be wrong). The error says it's not plugged in. Is that the port you've plugged into the tftp server? Cable good?
 

ManoftheSea

Member
Apr 18, 2023
41
16
8
Hey network people.
I've been having some adventures with an ICX6450 and a Ubiquiti AP and a Roku. An old roku stick, if it matters. I had it set up that the ICX6450 has DHCP pools, the AP is connected on a dual-mode port, with untagged traffic for the AP itself and tagged VLANs for the wifi. Alas, I think it was stated a bit ago, and I discovered as well, that the Roku is unwilling to get an address from the ICX6450.

So I set up a DHCP server (Kea) on a host, and I configured dhcp snooping ("ip dhcp snooping vlan N"), while also enabling dhcp trust ("interface eth 1/2/4", "dhcp snooping trust"). And when I set up the helper address ("ip helper-address 1 addr.of.host"), I see WIRED devices able to get IPs from Kea. But... I don't see wireless clients getting addresses (and therefore not finishing the association process). tcpdump from the Kea server shows the DISCOVER and OFFER; tcpdump from a wireless client even showed the REQUEST being sent, but it doesn't arrive.

Does anyone have a suggestion? Maybe something at the ubiquiti AP configuration is causing DHCP to the VLAN's VE to work, but not to get relayed? I'm sure this is a scenario that plenty of people have working, what am I missing?
So it turns out, if I have a DHCP-server pool configured for the address space, then the dhcp relay will not work. I had thought that putting the pool in "pending" status ("no deploy") would be enough. But when I undefined it ("no ip dhcp-server pool guests"), the relay immedately started working.

Friends don't let friends do IPv6
Oof, man. How are we ever going to deploy a 20 year old technology with that attitude?
 
  • Like
Reactions: TonyArrr and gerby

1vivy

New Member
May 8, 2022
3
0
1
Well I upgraded to 09.x branch and I'm still seeing the same issues :(:(:(:(:(:(

I guess i'll just switch to moving the L3 terminations off the switch as it's super annoying to go up and down stairs losing my IPv6 connection (which is favored)
If it's okay, could you share your L3 config on the switch? Do you have a static IPv6 prefix? I'd like to experiment with putting my IPv6 routing on the switch, currently just have IPv4 on the switch and VyOS handling IPv6 routing.
 

rnavarro

Active Member
Feb 14, 2013
197
40
28
If it's okay, could you share your L3 config on the switch? Do you have a static IPv6 prefix? I'd like to experiment with putting my IPv6 routing on the switch, currently just have IPv4 on the switch and VyOS handling IPv6 routing.
My IPv6 prefix was "static" - technically the ISP could renumber me, but they never have.

Here is the config I used prior to removing all the L3 stuff.


I used an upstream OPNSense router to do my WAN routing/firewalling. This was piped down with a transit vlan (vlan 88 in the config)

I don't think there was anything crazy in my config that was preventing the IPv6 neighbor cache from automagically updating, but who knows.

I've already given up on it and I ended up hosting a pair of VyOS instances as my "core" router and doing the same upstream transit to my OPNsense router.

Edit - and yes, all my IP's and domains have been edited to protect the innocent.

The VLAN I was having wifi issues with was "LAN", aKa vlan 5
 

neb50

Member
Aug 28, 2018
74
23
18
Looking for some help. I've been using the brocade6450 as a basic network switch for the past year. Didn't touch any settings at all. Recently upgraded to 3gb internet so wanted to use the 10G SFP slots. I bought two of these from Amazon - https://a.co/d/aFhYnIa

Have this connected to my unraid server which shows a 10000 Mbps eth0 link (previous was 1000 Mbps) so I thought everything was groovy. When I did a speed test though my download and upload fluxuate greatly.


View attachment 33101

This is using a docker tool called speed test tracker does speed tests every 30 mins

My download goes up and down hitting close to max of 2500 (since the router is a 2.5 GB router) but my upload seems to cap below 300.

Wondering if anyone had experience with these trancievers or any thought on what's going on.
The SFP to 10G may not support flow control or something and will cause the packets to drop and get resent.

Try https://www.amazon.com/gp/product/B09ZYGYZ7X/ref=ppx_yo_dt_b_asin_title_o03_s00?ie=UTF8&th=1 or https://www.amazon.com/gp/product/B078SNK1MY/ref=ppx_yo_dt_b_asin_title_o03_s00?ie=UTF8&psc=1

I believe both of those should work but the first one seems to run much cooler.

See this thread for more info. https://forums.servethehome.com/index.php?threads/mix-10g-2-5g-slow-speed-high-retr.33217/
 
  • Like
Reactions: egyptianthemagician

Andydude

New Member
Oct 6, 2023
12
7
3
Good luck, I'm putting 3x in a 7250-48 and 1x in a 6450-48.

Anyone know if just 1x MR4020X12B1-RSR in a 6450-48 will cool it ok? It's not PoE and I'm only probably plugging in 7-8 devices...
The 3x MR4020X12B1-RSR in the 725-48 have made it whisper quiet and it runs great, thanks to @RoachedCoach!

However, I put 1x in the 6450-48 and after powering up the fan never slows down from 100% even with nothing plugged in. I only have one power supply and show chassis all looks fine. Am I missing something or does this fan just not work with 6450-48? Anyone got a recommendation for others that are good that I can buy from the UK?

Code:
The stack unit 1 chassis info:

Power supply 1 (NA - AC - Regular) present, status ok
Power supply 2 not present

Fan ok, speed (auto): [[1]]<->2

Fan speed switching temperature thresholds:
        1 -> 2 @ 69 deg-C
        1 <- 2 @ 64 deg-C

Sensor B Temperature Readings:
        Current temperature : 28.5 deg-C
Sensor A Temperature Readings:
        Current temperature : 36.0 deg-C
        Warning level.......: 66.0 deg-C
        Shutdown level......: 76.0 deg-C
Thanks!
 

joku

New Member
Dec 4, 2023
6
2
3
Does anyone use cisco AP's on these switches? I just migrated over to this switch, and have my vlans setup, all my other wired devices are working.

The 4 APs are using mobility express, and were working prior to migration. Previous configuration was PVID 4, Tagged 100, 200, 300
Current Brocade setup is dual-mode 1/1/3 to 1/1/6, vlan 100, 200, 300 tagged.

Am I missing something else that allows them to self-discover? Thanks
Very generous offer! :) Thanks a lot. Today I received another switch I ordered via eBay due to the issues a faced. The serial connection was successful on the first try. So, here is definitely something wrong with the switch itself. I cannot tell you what it is, but it is the switch.

try these baud rates instead, one at a time: 14400, 19200, 38400, 57600, 115200

on the uboot/linux based models like the 6450, it's possible to change the serial baud rate in the u-boot environment variables, I suppose it's possible someone did this previously. I have only ran into it once though, previous user forced it to 115200
Thank you for the tips! I tried all those baud rates one by one, unfortunately without success. I'll return the switch now.

EDIT: @fohdeesha ... And of course, a thousand thanks for this absolutely awesome documentation – really cool stuff! :) I ran through all the setup/config/licensing steps without any problems.
 
Last edited:
  • Like
Reactions: fohdeesha

Testsubg

New Member
Feb 2, 2022
10
2
3
Shot in the dark, but I think egiga0 is the Management ethernet port (might be wrong). The error says it's not plugged in. Is that the port you've plugged into the tftp server? Cable good?
I had no issues connecting to my TFTP server using the usb —>serial cable. Also was able to update/flash the new OS update_primary but afterwards trying to update the
bootloader: it connects to the TFTP server but seems to be trying to download and gives # or % (I can’t remember exactly which right now) and then the message about exceeeded number of retry’s allowed. I had powered down both units for a few days and when setting up everything it had the correct image names already, and this could be a remembered setting or listing the versions that are updated. Idk.So I need to update or check version number for uboot and then update the firmware for POE.

the It’s the top left corner. Ive assumed it was the management but if it’s as simple as moving it to the top right I’ll try that when I can this afternoon and report back. Not sure that it would have allowed the primary update if it wasn’t management. Thanks
 
Last edited:

Testsubg

New Member
Feb 2, 2022
10
2
3
Just to update this earlier post, the management port is in the top left. And while I repeatedly followed various instructions and was never exactly sure it worked sometimes but after the most recent power cycle and disconnecting the LAN it just looks/presents what I assume is the correct info and versions. Thanks!IMG_2435.jpeg
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,914
3,440
113
34
fohdeesha.com
Just to update this earlier post, the management port is in the top left. And while I repeatedly followed various instructions and was never exactly sure it worked sometimes but after the most recent power cycle and disconnecting the LAN it just looks/presents what I assume is the correct info and versions. Thanks!View attachment 33185
that is an out of date image, and the limited switch-features only image as well. You need to cable the switch properly, then follow the guide from the beginning :) - the ethernet management port, that you need to plug into your network to update properly, is the BOTTOM left. The top left is the serial console port


1702355625614.png
 

richtj99

Member
Jul 8, 2017
70
1
8
52
Hi,

I updated firmware on my router, noticed some connection issues so I logged into my three ICX-7250's, did a wr mem, then reload. Two of the three of them came up fine but the third one somehow did a factory reset. I have the settings written down and was able to reset it up with no real headaches except - this happened to me before on one of the other switches. I am wondering if I did something wrong or why it factory reset itself?

I am running an older firmware from Fohdeesha. I know I can use a newer firmware but am not really sure if it is something I can upgrade or if it requires factory resetting the switches, updating, then reconfiguring so I have held off on it as things work fine except for the occasional unexpected factory reset.

Any help would be great!
Thanks,
Rich

Code:
SSH@Basement#sh ver
  Copyright (c) 2017 Ruckus Wireless, Inc. All rights reserved.
    UNIT 1: compiled on Apr  9 2019 at 03:20:17 labeled as SPR08080e
      (29826604 bytes) from Primary SPR08080e.bin
        SW: Version 08.0.80eT213
      Compressed Boot-Monitor Image size = 786944, Version:10.1.14T215 (spz10114)
       Compiled on Thu Nov 15 08:59:16 2018

  HW: Stackable ICX7250-48-HPOE
==========================================================================
UNIT 1: SL 1: ICX7250-48P POE 48-port Management Module
      Serial  #:DUK2307M0E4
      Software Package: ICX7250_L3_SOFT_PACKAGE   (LID: fwmINFJoFgJ)
      Current License: l3-prem-8X10G
      P-ASIC  0: type B344, rev 01  Chip BCM56344_A0
==========================================================================
UNIT 1: SL 2: ICX7250-SFP-Plus 8-port 80G Module
==========================================================================
 1000 MHz ARM processor ARMv7 88 MHz bus
 8192 KB boot flash memory
 2048 MB code flash memory
 2048 MB DRAM
STACKID 1  system uptime is 11 hour(s) 59 minute(s) 15 second(s)
The system started at 23:08:29 GMT-05 Tue Dec 12 2023

The system : started=warm start   reloaded=by "reload"
 

ManoftheSea

Member
Apr 18, 2023
41
16
8
I have the settings written down... or if it requires factory resetting the switches, updating, then reconfiguring...
You need to set up a tftp server, then do a "copy running-mem tftp add.res.sof.tftp filename.txt". There's no reason to need things "written down" when you can copy the configuration in digital form, and reload it in digital form, in moments.

I can't explain your "factory reset", but the switches do have two firmware slots, maybe you ended up on the other one somehow?
 
  • Like
Reactions: richtj99

richtj99

Member
Jul 8, 2017
70
1
8
52
Thank you - I will give that a try. If I upgrade my switch after backing up the running config - does it keep my info? Meaning will my running config from my 7250 firmware 08.0.80eT213 backup be accepted on the newer 7250 firmware - ?


You need to set up a tftp server, then do a "copy running-mem tftp add.res.sof.tftp filename.txt". There's no reason to need things "written down" when you can copy the configuration in digital form, and reload it in digital form, in moments.

I can't explain your "factory reset", but the switches do have two firmware slots, maybe you ended up on the other one somehow?
 

kpfleming

Active Member
Dec 28, 2021
445
230
43
Pelham NY USA
Thank you - I will give that a try. If I upgrade my switch after backing up the running config - does it keep my info? Meaning will my running config from my 7250 firmware 08.0.80eT213 backup be accepted on the newer 7250 firmware - ?
Yes, and it may even be modified during the upgrade process if changes are required. The upgrade guides for each firmware release will tell you about those things.
 
  • Like
Reactions: richtj99

richtj99

Member
Jul 8, 2017
70
1
8
52
Yes, and it may even be modified during the upgrade process if changes are required. The upgrade guides for each firmware release will tell you about those things.
Just wanted to say i did the upgrade, ran the restore command & i think everything is working perfectly again!

Not really sure how to see if something didnt transfer over but so far so good!
 
  • Like
Reactions: kpfleming

richtj99

Member
Jul 8, 2017
70
1
8
52
This worked out well for me I have one more switch to do. Just a note to others - after you upgrade, then restore your config - DO NOT - wr mem after or you could spend an extra hour reflashing everything multiple times.......

Also curious - can these upgrades be done via usb drive using the disk0?

instead of:
Code:
#Temp IP address of the switch:
setenv ipaddr 192.168.1.50
setenv netmask 255.255.255.0

#IP of your TFTP server:
setenv serverip 192.168.1.8
setenv image_name ICX7xxx/SPR08090mc.bin
setenv uboot ICX7xxx/spz10118.bin
Code:
setenv serverip disk0
setenv image_name ICX7xxx/SPR08090mc.bin
setenv uboot ICX7xxx/spz10118.bin
Code:
copy flash disk0 ICX7xxx/SPR08095kufi.bin primary 
erase flash secondary 
reload
similar to:

Code:
copy disk0 startup-config standard.cfg
I had some network issues due to some usb-c nic card. My last switch is in a shed with a harder upgrade due to 1 cat6 wire.

Thanks,
Rich
 

jei

Active Member
Aug 8, 2021
193
117
43
Finland
Got 7450-24P delivered today from the UK. After shipping and taxes about 400€ total. Not great, not terrible. I want to try 40Gb and 6610 is EOL/even more noisier so.. Seller mentioned only 1x 1X40GQ module, but it came fully stocked, 2x 1X40GQ, 1x 4X10GF and 2x PSUs. Only rack ears are missing, if someone has extras I'm a taker. The noise is not too bad, possibly could work in my closet without any modding. Somehow I recall my old 6450-24P was worse.

edit: Taking ~60W (230V) from the wall idle after boot is complete (1 PSU).

For the console I decided to use existing Cisco FTDI USB-C to RJ45 cable. Materials needed: RJ45 keystone adapter and old miniusb cord.

RJ45USB
3 (tx)3 (tx) (green)
6 (rx)2 (rx) (white)
4-5 (gnd)5 (gnd) (black)

View attachment 33046 View attachment 33047
Tinkered a bit. PSUs are Rev A. People say Rev C is better but Rev A is not even the loudest fan in the switch atm (edit: not 100% sure about this).

show pid-prom:
Date of manufacture at CM: 10/24/18

Tried removing 1X40GQ = saves 1W~ per module, not worth it.

Powering up second PSU added 7W~

Just realized it could make more sense to source ICX7400-4X10GC instead of using fs.com 100€+ adapters. Haven't yet found detailed specs about it. Would need 100m over Cat6.

fs.com DAC didn't work between ConnectX-3 Pro and 1X40GQ (reading back, I'm not the only one with this problem). OTOH Juniper JNP-QSFP-40G-LX4 worked great.

IMG_3270_1.jpg IMG_3272_1.jpg
 
Last edited:

Cirdane

New Member
Mar 18, 2023
3
1
3
Hey all, I could really use some help setting up ACL's. I've been trying to find posts, documentation and guides but I really just don't quite get how this works. Very much an amateur with more advanced networking stuff.

Currently my network config is:

- Home_Main 192.168.0.1/24 (Default VLAN 1)
- Home_IoT 192.168.100.1/24 (VLAN 100)

What I want to achieve is:

- Devices on Home_IoT blocked from accessing any device on Home_Main except 192.168.0.50 (any port). Everything on Home_Main should have access to everything on Home_IoT however.

I'd much appreciate any help in setting this up.
 

NablaSquaredG

Bringing 100G switches to homelabs
Aug 17, 2020
1,806
1,197
113
Tinkered a bit. PSUs are Rev A. People say Rev C is better but Rev A is not even the loudest fan in the switch atm (edit: not 100% sure about this).
iirc it turned out that the Rev thing was only relevant for Emerson PSUs, not for Delta
 
  • Like
Reactions: jei