Drag to reposition cover

Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

Dave Corder

Well-Known Member
Dec 21, 2015
437
336
63
44
I have an ICX-6450-24P that I have been using without issue for a few years. Recently after a power outage I discover that not only was my UPS no longer working, but the switch didn't power itself back up when the power came back on.

After unplugging it, waiting about 5 seconds and then plugging it back in, it will power back up. It has done this several times always following a power loss.

Is this some sort of expected behavior or could there be a power supply issue?
What model of UPS do you have? Is it a pure sine wave model or simulated sine wave? I've had a few weird issues before with some enterprise-y gear on simulated sine models that went away after I upgraded them to pure sine wave models (or just ran them off AC power).
 

tojoski

New Member
Sep 22, 2019
16
1
3
What model of UPS do you have? Is it a pure sine wave model or simulated sine wave? I've had a few weird issues before with some enterprise-y gear on simulated sine models that went away after I upgraded them to pure sine wave models (or just ran them off AC power).
It was on a Cyberpower pure sine wave, but it happened again this morning while directly plugged into the wall.
 

dmitry.n.medvedev

New Member
Jun 25, 2022
17
1
3
good morning, gentlemen.

I am still reading this thread ( rather insightful and overpacked with knowledge ) and the following picture diagrams my fantasies on how I should build a home lab using brocade, some transceivers and cabling.

at the top left corner you will find four tables defining the cables, transceivers and NICs I should purchase for the lab. I tried to color code the entire diagram, checked it twice for correctness, but certain mistakes still are possible.

I would like to ask for your experience in identifying certain types of cables and transceivers -- this is still not quite clear to me. This is the first time I am going to build anything with fibre.

Any help is greatly appreciated!


HomeLabHardwareNetwork.png

many thanks in advance!

best regards,
Dmitry

UPD: not sure if I was right but I went and ordered these guys:
1. Original Brocade Mini-GBIC-Modul 10Gbit SR SFP+ Transceiver -57-0000075-01
2. Avago GBIC 40Gb QSFP+ Transceiver 850nm 21CFR(J)Class1 AFBR-79EQPZ
3. Brocade 40GE SR4 QSFP+ 300m (57-1000296-01), 4x 10GBASE-SR/SW, 40G-QSFP-SR4-INT
4. 0.2M OM3 LC to LC Fibre Optic Patch Cable. Length Options: 0.2 m - 100 m, 10 GB Duplex LC-LC 50/125 um Multimode Fibre Optic Cable LSZH 0.2 m
5. MPO to MPO Fibre Optic Cable 3M EMSECKO 12 Core Female Type B OM3 Multimode Fibre Optic Patch Cable LSZH MPO-MPO Patch Cord for QSFP+ Transceiver MTP Compatible Cabling System, Aqua

...in hope that they are somehow compatible to each other and icx6610 + icx6450
 
Last edited:

BobTB

Member
Jul 19, 2019
82
21
8
Running my ICX 6610 48 for a year straight. Two of my ports stopped responding, port state is BLOCKING, but if I connect the cable, the lights blink. tried enable/disable port, but even with the cable connected the port is still showing BLOCKING

Member of L2 VLAN ID 1000, port is untagged, port state is BLOCKING BPDU guard is Disabled, ROOT protect is Disabled, Designated protect is Disabled Link Error Dampening is Disabled STP configured to ON, priority is level0, mac-learning is enabled

show span gives me Spanning-tree is not configured on port-vlan 1000


What can I do, I for now can not just reset the switch, a lot of things are running on it in my "production"
 

BarronOBeefdip

New Member
Nov 8, 2020
3
0
1
The ICX6610 Doesn't support 2.5gb on the sfp+ ports, right? I stuck some copper transceivers in there and got like 500mbit down and 1700mbit up with a 2.5g NIC
I would expect it to be all or nothing but it actually kind of worked? My computer negotiated a 2.5g connection speed and just worked.
 

NablaSquaredG

Bringing 100G switches to homelabs
Aug 17, 2020
1,900
1,321
113
The ICX6610 Doesn't support 2.5gb on the sfp+ ports, right? I stuck some copper transceivers in there and got like 500mbit down and 1700mbit up with a 2.5g NIC
The SFP+ transceiver negotiates 10G with the switch and 2.5G on the other side (it kinda translates between the speeds).

The downside is that for almost all commercially available transceivers of this type, performance is very bad.
 
  • Like
Reactions: BarronOBeefdip

BarronOBeefdip

New Member
Nov 8, 2020
3
0
1
The SFP+ transceiver negotiates 10G with the switch and 2.5G on the other side (it kinda translates between the speeds).

The downside is that for almost all commercially available transceivers of this type, performance is very bad.
I've got one from FS and one from H!Fiber that are customized for Cisco and Ubiquity switches respectively. That's definitely not the problem?
It would likely be cheaper to get a 10GB capable 2.5g switch than to get the 3 transceivers I need. I'll probably end up going that route.
 

jbrukardt

Active Member
Feb 4, 2016
114
70
28
91
I've got one from FS and one from H!Fiber that are customized for Cisco and Ubiquity switches respectively. That's definitely not the problem?
It would likely be cheaper to get a 10GB capable 2.5g switch than to get the 3 transceivers I need. I'll probably end up going that route.
well.... Brocade/Ruckus is neither Cisco nor Ubiquiti, so...
 

hmw

Well-Known Member
Apr 29, 2019
662
283
63
I've got one from FS and one from H!Fiber that are customized for Cisco and Ubiquity switches respectively. That's definitely not the problem?
It would likely be cheaper to get a 10GB capable 2.5g switch than to get the 3 transceivers I need. I'll probably end up going that route.
If you want symmetric 2.5Gbps performance from such a setup, try getting Aquantia based GBase-T ones. These will give you proper performance. If you get Marvell based ones, you will see asymmetric throughput. Or get a Netgear 2.5/5 Gb switch - it's cheaper and less error prone.
 

BarronOBeefdip

New Member
Nov 8, 2020
3
0
1
If you want symmetric 2.5Gbps performance from such a setup, try getting Aquantia based GBase-T ones. These will give you proper performance. If you get Marvell based ones, you will see asymmetric throughput. Or get a Netgear 2.5/5 Gb switch - it's cheaper and less error prone.
edit: I probably should have read that whole thread before I posted this. The dell transcievers apparently won't go below 5GB

Incidentally, there's someone on ebay right now with a bunch of dell branded WP2PP transceivers for $47 each

This thread seems to indicate they're compatible

Thanks for the info! I'll report back when they get here
 
Last edited:

jexplume

New Member
Jul 25, 2023
1
0
1
I'm in the beginning stages of learning how to operate my icx 6450, its super cool and there's so many features to uncover. Thank you fohdeesha for the comprehensive guide on getting it set up!

One pain so far that I've not been able to overcome: I've been searching this thread and google for a while on how I could either port forward all tcp/udp port 53 communications to my pihole dns service (while excluding the pihole ip to prevent some sort of a redirect loop), or somehow redirect 8.8.8.8 and other public dns ips to my pihole's ip. I haven't been successful in finding the right documentation or the right search terms to learn more about how I might go about that. Could someone point me in the right direction?

A few of my devices, android phone included, have hardcoded DNS ips that bypass my DNS so I can't resolve my local records. The pihole server is also the DHCP server so I assume the DNS ips are set correctly that way and that is the case for most of my devices. I've tried all the hacky suggestions on the device side, but haven't had any luck. The other recommendation seems to be to do it at the router level, which is where I'm currently stuck.
 
Last edited:

Rain

Active Member
May 13, 2013
283
128
43
Anyone know what the deal is with these particular bad blocks in the flash on 7150 / 7250 switches?

Code:
0x05a00000
0x05b00000
There are a few reports of bad blocks, both on 7150-series switches, and they all show these specific blocks:

I recently purchased a ICX 7250-48p the seller indicated had "bad flash." Upon receiving the switch and powering it up, neither primary or secondary would boot. I noticed while trying to boot the secondary image bad sectors were skipped when reading the image from NAND. nand bad showed both 0x05a00000 & 0x05b00000. The switch is seemingly function after re-flashing everything but, of course, the bad sectors remain.

Is this a known issue? It seems odd that multiple people have issues with these specific sectors.

I'm prepared dump the flash and replace the flash chip but I don't want to waste time if it isn't needed (even though it would certainly be fun).
 

Kartoff

Member
Feb 17, 2017
33
7
8
48
Hello,

I bought 3x ICX 7750 switches couple of months ago and 2 of them are working but 1 does not... It shows some errors and do boot loop. I thought update of firmware could do the trick and did it, even exchanged the flash between the switches but without success :(

Here are what console shows during boot :

Code:
Bootloader Version: 10.1.15T205 (Jan 30 2019 - 23:08:02)

SVR: 0x82100120, PVR: 0x80230032
ICX7750:48F,Production-1
SYS CPLD VER: 0xe, Released Ver: 0
Enter 'b' to stop at boot monitor:  0
bootdelay: ===
Booting image from Primary
## Booting kernel from Legacy Image at 86000000 ...
   Created:      2018-07-10  11:03:23 UTC
   Data Size:    473584 Bytes = 462.5 KiB
   Load Address: 00000000
   Entry Point:  00000000
   Verifying Checksum ... OK
## Verifying Application Image ...
    Verifying Checksum ... OK
   Loading Kernel Image ... OK
OK
HV#
 No vsmgr node in config tree
HV# cpu0/0: failover_register() - registering notifiers...
Mounting file system...
^[[0ndefault eusb_infra enabled
ICX7750 eUSB-Infra Called
 Number of eUSB partitions 7 ...
PLATFORM SW
Config partition mounted.
eUSB flash drive is ready  No External USB Drive(s) Mounted . Processing packages from primary partition
Installed packages are up to date
Starting up system statistics daemon...
eth0      Link encap:Ethernet  HWaddr CC:4E:24:D0:41:68
          inet addr:10.11.12.38  Bcast:10.255.255.255  Mask:255.0.0.0
          inet6 addr: fe80::ce4e:24ff:fed0:4168/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:0 (0.0 B)  TX bytes:516 (516.0 B)
          Memory:fe4e0000-fe4e0fff

lo        Link encap:Local Loopback
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

eth0      Link encap:Ethernet  HWaddr CC:4E:24:D0:41:68
          inet addr:10.11.12.38  Bcast:10.255.255.255  Mask:255.0.0.0
          inet6 addr: fe80::ce4e:24ff:fed0:4168/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:0 (0.0 B)  TX bytes:516 (516.0 B)
          Memory:fe4e0000-fe4e0fff

lo        Link encap:Local Loopback
          inet addr:127.0.0.1  Mask:255.255.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

Log Level 7: Daemonized systatsd
Systatsd Logging Env is not set, initializing log level to: D
Setting connection to systemlogger
Starting systatsd done
Starting up poe daemon...
poed Logging Env is not set, initializing log level to: I
Setting connection to systemlogger
Starting poed done
Starting up health monitor daemon...
eth0      Link encap:Ethernet  HWaddr CC:4E:24:D0:41:68
          inet addr:10.11.12.38  Bcast:10.255.255.255  Mask:255.0.0.0
          inet6 addr: fe80::ce4e:24ff:fed0:4168/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:0 (0.0 B)  TX bytes:516 (516.0 B)
          Memory:fe4e0000-fe4e0fff

lo        Link encap:Local Loopback
          inet addr:127.0.0.1  Mask:255.255.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

eth0      Link encap:Ethernet  HWaddr CC:4E:24:D0:41:68
          inet addr:10.11.12.38  Bcast:10.255.255.255  Mask:255.0.0.0
          inet6 addr: fe80::ce4e:24ff:fed0:4168/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:0 (0.0 B)  TX bytes:516 (516.0 B)
          Memory:fe4e0000-fe4e0fff

lo        Link encap:Local Loopback
          inet addr:127.0.0.1  Mask:255.255.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

Hmond Logging Env is not set, initializing log level to: I
Setting connection to systemlogger
Starting hmond done
nohup: appending output to nohup.out
Resources folder check done!
dma_mem_base: 0xf8000000, dma_mem_len: 0x8000000, warm_mem_base: 0xf0200000, warm_mem_len: 0xd00000
Enabling time stamp.
*** Crash dump information is available, please collect it using "supportsave" CLI ***
Starting the FastIron.
USER=root
boot_partition=pri_partition
HOME=/
OLDPWD=/dev
GCOV_PREFIX=/fast_iron
TERM=vt102
PATH=/sbin:/usr/sbin:/bin:/usr/bin
SHELL=/bin/sh
PWD=/
No Shared Library Linked
FIPS Disabled:PORT NOT DISABLED
platform type 61

OS>
Loaded Image SWR08095h from Pri Built on (UTC): Fri Aug 26 08:30:36 2022
Enabling Console Logging

T=0.0: cannot read stacking.boot. The system will be a standalone.
Upgrade from pre 8.0.80 image. Dual mode to VLAN config upgrade needed
Hotplugger Daemon Initialized ..
py_filemgr: py_filemgr_task Message Registration Success
ITC error: message type 9f0005 is being re-registered
set_board_level: gi_board_type = 94[   29.170402] linux-kernel-bde: map phys range 0xf0000000-0xf0040000 to 0x50fb1000-0x50ff1000
[   29.172803] linux-kernel-bde: map phys range 0xf8000000-0x0 to 0x50ff1000-0x58ff1000
DMA pool size: 134217728
                        SOC unit 0 attached to PCI device BCM56852_A2
0:soc_trident2_chip_reset: LCPLL 2 not locked on unit 0 status = 0x00000000
0:soc_do_init: soc_do_init: total cpu and arm cosq 0030 unexpected
0:soc_schan_timeout_check: soc_schan_op: operation attempt timed out
0:_soc_cmicm_schan_op: SchanTimeOut:soc_schan_op operation timed out cmc=0
0:soc_reg_get: soc_reg_get failed for PGW_OBM0_ECC_ENABLE
fdry_system_init: Misc init failed: Operation timed out
ERROR: SOC unit 0 system_init failed

**********  BCM SDK init FAILED  *************

sh: can't create /proc/softlockup/cancel: nonexistent directory
                                                               Failed to cancel WDT

stack: 1074e464 102e2b3c 102d457c 1041c17c 10034df8 13381994 133cc98c
Tuning CFS scheduler parameters...
Compressing Console file
Copying fitrace errorlog file to flash
CORE_PATTERN:PID=1153 UID=0 GID=0 sig=11
Sun Dec 11 00:36:05 UTC 2022: Dumping core file to /tmp.gz, this will take couple of minutes ...
Segmentation fault (core dumped)
Sun Dec 11 00:36:31 UTC 2022: Core file collected as /tmp.gz, processing the core file ...
Sun Dec 11 00:36:31 UTC 2022: Removing the oldest core file:core_1153_FastIron-6_2022-08-29_14-24-46.gz of size 4844 kbytes
seq 7
Sun Dec 11 00:36:31 UTC 2022: Calculating checksum: core_1153_FastIron-8_2022-12-11_00-36-31.gz
Sun Dec 11 00:36:31 UTC 2022: Checking integrity of core_1153_FastIron-8_2022-12-11_00-36-31.gz
Sun Dec 11 00:36:36 UTC 2022: Moving core_1153_FastIron-8_2022-12-11_00-36-31.gz of size 4832 KB to flash, with available space of 655856 KB...
[   68.387304] WDG_INFO: Coredump Task is running, Pid: 1200, Name: coredump_utilit, Probe Time: 1670719003
Sun Dec 11 00:36:55 UTC 2022: Core saved as /fast_iron/cores/core_1153_FastIron-8_2022-12-11_00-36-31.gz.
Moving system log files to persistent memory
Copying SZ log files to persistent memory..
Done.
Core collection and system log collection completed, rebooting the switch ...
Stopping File Manager daemon...
Stopped File Manager daemon
Stopping health monitor daemon...
Stopped health monitor daemon
Stopping poe daemon...
Stopped poe daemon
Stopping system statistics daemon...
Stopped systatsd.
The system is going down NOW!
Sent SIGTERM to all processes
Sent SIGKILL to all processes
Requesting system reboot
[   85.736190] Restarting system.


Bootloader Version: 10.1.15T205 (Jan 30 2019 - 23:08:02)

SVR: 0x82100120, PVR: 0x80230032
Any help would be appreciated :)
 

LodeRunner

Active Member
Apr 27, 2019
568
244
43
Hello,

I bought 3x ICX 7750 switches couple of months ago and 2 of them are working but 1 does not... It shows some errors and do boot loop. I thought update of firmware could do the trick and did it, even exchanged the flash between the switches but without success :(

Any help would be appreciated :)
Quite a bit earlier in this thread another user had a 7750-48f that did the same; never heard if it was fixed or dead. You can try reflashing uboot and the primary following the guide on page 1. I had a 7150 with bad flash that would boot loop, but I forget the error output in that case. I wound up using the nand scrub commands in uboot then reflashing it and that sorted it out. You may have a dead ASIC and the OS times out waiting for a response from it.
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,997
3,621
113
35
fohdeesha.com
Hello,

I bought 3x ICX 7750 switches couple of months ago and 2 of them are working but 1 does not... It shows some errors and do boot loop. I thought update of firmware could do the trick and did it, even exchanged the flash between the switches but without success :(

Here are what console shows during boot :

Code:
Bootloader Version: 10.1.15T205 (Jan 30 2019 - 23:08:02)

SVR: 0x82100120, PVR: 0x80230032
ICX7750:48F,Production-1
SYS CPLD VER: 0xe, Released Ver: 0
Enter 'b' to stop at boot monitor:  0
bootdelay: ===
Booting image from Primary
## Booting kernel from Legacy Image at 86000000 ...
   Created:      2018-07-10  11:03:23 UTC
   Data Size:    473584 Bytes = 462.5 KiB
   Load Address: 00000000
   Entry Point:  00000000
   Verifying Checksum ... OK
## Verifying Application Image ...
    Verifying Checksum ... OK
   Loading Kernel Image ... OK
OK
HV#
No vsmgr node in config tree
HV# cpu0/0: failover_register() - registering notifiers...
Mounting file system...
^[[0ndefault eusb_infra enabled
ICX7750 eUSB-Infra Called
Number of eUSB partitions 7 ...
PLATFORM SW
Config partition mounted.
eUSB flash drive is ready  No External USB Drive(s) Mounted . Processing packages from primary partition
Installed packages are up to date
Starting up system statistics daemon...
eth0      Link encap:Ethernet  HWaddr CC:4E:24:D0:41:68
          inet addr:10.11.12.38  Bcast:10.255.255.255  Mask:255.0.0.0
          inet6 addr: fe80::ce4e:24ff:fed0:4168/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:0 (0.0 B)  TX bytes:516 (516.0 B)
          Memory:fe4e0000-fe4e0fff

lo        Link encap:Local Loopback
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

eth0      Link encap:Ethernet  HWaddr CC:4E:24:D0:41:68
          inet addr:10.11.12.38  Bcast:10.255.255.255  Mask:255.0.0.0
          inet6 addr: fe80::ce4e:24ff:fed0:4168/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:0 (0.0 B)  TX bytes:516 (516.0 B)
          Memory:fe4e0000-fe4e0fff

lo        Link encap:Local Loopback
          inet addr:127.0.0.1  Mask:255.255.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

Log Level 7: Daemonized systatsd
Systatsd Logging Env is not set, initializing log level to: D
Setting connection to systemlogger
Starting systatsd done
Starting up poe daemon...
poed Logging Env is not set, initializing log level to: I
Setting connection to systemlogger
Starting poed done
Starting up health monitor daemon...
eth0      Link encap:Ethernet  HWaddr CC:4E:24:D0:41:68
          inet addr:10.11.12.38  Bcast:10.255.255.255  Mask:255.0.0.0
          inet6 addr: fe80::ce4e:24ff:fed0:4168/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:0 (0.0 B)  TX bytes:516 (516.0 B)
          Memory:fe4e0000-fe4e0fff

lo        Link encap:Local Loopback
          inet addr:127.0.0.1  Mask:255.255.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

eth0      Link encap:Ethernet  HWaddr CC:4E:24:D0:41:68
          inet addr:10.11.12.38  Bcast:10.255.255.255  Mask:255.0.0.0
          inet6 addr: fe80::ce4e:24ff:fed0:4168/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:6 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:0 (0.0 B)  TX bytes:516 (516.0 B)
          Memory:fe4e0000-fe4e0fff

lo        Link encap:Local Loopback
          inet addr:127.0.0.1  Mask:255.255.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

Hmond Logging Env is not set, initializing log level to: I
Setting connection to systemlogger
Starting hmond done
nohup: appending output to nohup.out
Resources folder check done!
dma_mem_base: 0xf8000000, dma_mem_len: 0x8000000, warm_mem_base: 0xf0200000, warm_mem_len: 0xd00000
Enabling time stamp.
*** Crash dump information is available, please collect it using "supportsave" CLI ***
Starting the FastIron.
USER=root
boot_partition=pri_partition
HOME=/
OLDPWD=/dev
GCOV_PREFIX=/fast_iron
TERM=vt102
PATH=/sbin:/usr/sbin:/bin:/usr/bin
SHELL=/bin/sh
PWD=/
No Shared Library Linked
FIPS Disabled:PORT NOT DISABLED
platform type 61

OS>
Loaded Image SWR08095h from Pri Built on (UTC): Fri Aug 26 08:30:36 2022
Enabling Console Logging

T=0.0: cannot read stacking.boot. The system will be a standalone.
Upgrade from pre 8.0.80 image. Dual mode to VLAN config upgrade needed
Hotplugger Daemon Initialized ..
py_filemgr: py_filemgr_task Message Registration Success
ITC error: message type 9f0005 is being re-registered
set_board_level: gi_board_type = 94[   29.170402] linux-kernel-bde: map phys range 0xf0000000-0xf0040000 to 0x50fb1000-0x50ff1000
[   29.172803] linux-kernel-bde: map phys range 0xf8000000-0x0 to 0x50ff1000-0x58ff1000
DMA pool size: 134217728
                        SOC unit 0 attached to PCI device BCM56852_A2
0:soc_trident2_chip_reset: LCPLL 2 not locked on unit 0 status = 0x00000000
0:soc_do_init: soc_do_init: total cpu and arm cosq 0030 unexpected
0:soc_schan_timeout_check: soc_schan_op: operation attempt timed out
0:_soc_cmicm_schan_op: SchanTimeOut:soc_schan_op operation timed out cmc=0
0:soc_reg_get: soc_reg_get failed for PGW_OBM0_ECC_ENABLE
fdry_system_init: Misc init failed: Operation timed out
ERROR: SOC unit 0 system_init failed

**********  BCM SDK init FAILED  *************

sh: can't create /proc/softlockup/cancel: nonexistent directory
                                                               Failed to cancel WDT

stack: 1074e464 102e2b3c 102d457c 1041c17c 10034df8 13381994 133cc98c
Tuning CFS scheduler parameters...
Compressing Console file
Copying fitrace errorlog file to flash
CORE_PATTERN:PID=1153 UID=0 GID=0 sig=11
Sun Dec 11 00:36:05 UTC 2022: Dumping core file to /tmp.gz, this will take couple of minutes ...
Segmentation fault (core dumped)
Sun Dec 11 00:36:31 UTC 2022: Core file collected as /tmp.gz, processing the core file ...
Sun Dec 11 00:36:31 UTC 2022: Removing the oldest core file:core_1153_FastIron-6_2022-08-29_14-24-46.gz of size 4844 kbytes
seq 7
Sun Dec 11 00:36:31 UTC 2022: Calculating checksum: core_1153_FastIron-8_2022-12-11_00-36-31.gz
Sun Dec 11 00:36:31 UTC 2022: Checking integrity of core_1153_FastIron-8_2022-12-11_00-36-31.gz
Sun Dec 11 00:36:36 UTC 2022: Moving core_1153_FastIron-8_2022-12-11_00-36-31.gz of size 4832 KB to flash, with available space of 655856 KB...
[   68.387304] WDG_INFO: Coredump Task is running, Pid: 1200, Name: coredump_utilit, Probe Time: 1670719003
Sun Dec 11 00:36:55 UTC 2022: Core saved as /fast_iron/cores/core_1153_FastIron-8_2022-12-11_00-36-31.gz.
Moving system log files to persistent memory
Copying SZ log files to persistent memory..
Done.
Core collection and system log collection completed, rebooting the switch ...
Stopping File Manager daemon...
Stopped File Manager daemon
Stopping health monitor daemon...
Stopped health monitor daemon
Stopping poe daemon...
Stopped poe daemon
Stopping system statistics daemon...
Stopped systatsd.
The system is going down NOW!
Sent SIGTERM to all processes
Sent SIGKILL to all processes
Requesting system reboot
[   85.736190] Restarting system.


Bootloader Version: 10.1.15T205 (Jan 30 2019 - 23:08:02)

SVR: 0x82100120, PVR: 0x80230032
Any help would be appreciated :)
0:soc_trident2_chip_reset: LCPLL 2 not locked on unit 0 status = 0x00000000
0:soc_do_init: soc_do_init: total cpu and arm cosq 0030 unexpected


smells like dead ASIC
 

Kartoff

Member
Feb 17, 2017
33
7
8
48
0:soc_trident2_chip_reset: LCPLL 2 not locked on unit 0 status = 0x00000000
0:soc_do_init: soc_do_init: total cpu and arm cosq 0030 unexpected


smells like dead ASIC
I had same thoughts :confused: Somebody suggested the problem might be related to that switches were stacked before I got them and this one still expecting another switch to tell him what to do but I doubt it.
I tried to went into base OS to eventually see something extra and succeeded but didn't knew what to do there LOL

At least now I have some spare PSU and fan's :cool:
BTW I realized VDX6740T which I bought month ago have the same PSU as ICX7750 instead of VDX6740 SFP variant.
 

Coach43

New Member
Jan 24, 2023
6
0
1
Hello,

Long-time lurker, now I need some expert assistance. I have TWO ICX-6610's configured and licensed thanks to Fodeesha's docs. They are up and running with a 40G fiber link between them. Now is the time to merge this 'homelab' network into my 'home network', in two phases.

Phase I - Ubiquiti Dream Machine UDM - ICX-6610 Integration
My home network consists of a UDM (as the gateway, router, firewall and network controller) and two Unifi remote access points. My ISP terminates at the UDM. I have 4 subnets (192.168.1.X, 192.168.10.x, 192.168.20.x, 192.168.30.x) defined and ONE wireless SSID that operates via the two wireless AP's. Most of my devices connect wirelessly. These subnets are to reduce broadcast traffic, all other traffic is open between subnets. Future plans include a DMZ and GUEST subnets with isolation...

Now I'd like to physically connect ONE of the 6610's to my UDM. I need to have all the subnets successfully transit from one 6610 to the other via the Stack Trunk. I also need all the devices physically connected to both 6610's (they are in all 4 of the subnets) to gain access to the Internet via the UDM. I'd love to move the subnet-to-subnet routine to the 6610, if that's easy. My confusion rests in migrating my subnets, to VLANs and setting up the appropriate TRUNKS and TAGGING to accomplish my goals. My fun begins once the network is operational, so I'd like to skip the network configuration experimentation.

This seems straightforward, but I'm not a network guy. So I'm looking for a network guy. I'm very comfortable with the Brocade web interface and I can cut/paste CLI instructions as necessary. Be gentle.

Phase 2 - New ISP Transition
After my home network is playing nice at Brocade speed. I'd like to keep my internal network managed by the UDM (DHCP and Network controller) but change my ISP to a fiber terminated in a modem that connects to a port on one of the 6610's. DHCP staying on UDM. 6610's connecting everything together.

Again, something I'm sure experts do all the time. New to me, and just complicated enough that I need expert advice to get it right the first time.

Thanks in advance for the help!
 

NablaSquaredG

Bringing 100G switches to homelabs
Aug 17, 2020
1,900
1,321
113
Now I'd like to physically connect ONE of the 6610's to my UDM. I need to have all the subnets successfully transit from one 6610 to the other via the Stack Trunk
No problem, the stacked ICX6610 will behave as one big virtual switch with centralised management. No extra settings necessary.


I'd love to move the subnet-to-subnet routine to the 6610, if that's easy
Yes, that's relatively simple.


First, you need to create 4 VLANs. Then you create 4 VEs. Those VEs are your gateways for inter-vlan and inter-subnet routing. Those VEs need to be assigned as gateways for the respective subnet in your DHCP server.




but change my ISP to a fiber terminated in a modem that connects to a port on one of the 6610's. DHCP staying on UDM. 6610's connecting everything together.
that'a a bit more challenging, but possible.
 

Coach43

New Member
Jan 24, 2023
6
0
1
No problem, the stacked ICX6610 will behave as one big virtual switch with centralised management. No extra settings necessary.
Great!

Yes, that's relatively simple.

First, you need to create 4 VLANs. Then you create 4 VEs. Those VEs are your gateways for inter-vlan and inter-subnet routing. Those VEs need to be assigned as gateways for the respective subnet in your DHCP server.
I reviewed Patrick Henry's video on VLAN's and another on VLAN Routing with Router-Interface. These explainer series videos are awesome!
Here's my first VLAN, VE and router-interface:
vlan 4
untag e 2/1/12 (port to attach a switch that is all subnet 4)
router-interface ve 4
exit

int ve 4
ip address 192.168.4.1/24

On the UDM this IP address is the gateway for subnet 4. If this looks correct I can repeat for each of the other 4 subnets, although they won't have the untag port assigned, this is the only subnet with it's own switch.

that'a a bit more challenging, but possible.
 
Last edited:

Coach43

New Member
Jan 24, 2023
6
0
1
Update: I have one tagged port where the UDM will connect for the other three VLANS.

Is the VLAN-VLAN traffic allowed by default in the Brocade or is that the purpose of the IP ADDRESS command to move that to the gateway?

Since the UDM is also the DHCP server, is there anything on the Brocade I need to do so that all new devices get their IP from the UDM?