Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)

[coolelectricity]

Thank you for this detailed answer! This is exactly what I was trying to understand.

Also, that is FANTASTIC news, since I've gotten a bit wild with buying up all kinds of different "old but cheap AF" 20/25/40Gbe NICs and breakouts/DACs. I was starting to question my "buy" of this for a brief moment since getting the console up so kind of janky and weird. After 6+ unplug/replugs (power cycles) I finally "got it", and have been off to the races. I'll have to get the hang of making more of these tweaks/edits from the CLI, but once I got the web interface going I sorted out the 10Gbe ports.

This model (un?)fortunately is "all SFP+", and I don't have any 1Gbe DACs or spare Transceivers at the moment, so I'd interested in where I might find "10+ pack deals" on both 1/1.25 DACs and/or Transceivers that are compatible with Brocades, now that I have more confidence I can ditch all the 4, 5, and 8+ port switches I've collected over the years.

So pardon my Brocade/Ruckus noob brain, but I assume (or translate) that this:
"You can define a layer 3 interface and give it an IP address. That will be a gateway so all routing will occur inside the switch without relying on another device."

means that:

Even if I use a "basic retail" 1Gbe router (Linksys, Netgear, Ubiquity, Asus, TP-Link, etc), I could define said Layer 3 interface in the "router config of the switch" and not have the "speed limit" of the 1Gbe "retail router"?
Of course, assuming I use the Gateway Address of the said L3 interface IP as my configuration in my individual NICs and "upstream gateway" address of my vRouters (pfSense, OPNsense, etc)?

Am I understanding that correctly?

Ok so my next step is to "levelup" and work out how to get Wire Speed with a "transit VLAN" configuration
- As I'm coming from loosely knowing enough and Cisco gear, I understand from my initial readings and learnings that the ICX6610 "uses VLAN 1 differently"
- I haven't wrapped my head completely around that aspect yet, but its fine for the moment as I'm still in the "configure it to work, try to tune it, when it breaks, rest and repeat" phases.

But I'm seeing that without configuring a remote NTP server url / domain, I'm losing my clock settings on each "unplug" / poweroff.

I haven't tried to physically "open up" the chassis for the icx6610 (yet?) but I'd rather not, without a good reason.

Is there some kind of a CMOS battery that keeps the clock settings that is replaceable / accessible for the ICX6610 - or is it a "remote only NTP server settings if you want to keep your clock in sync" kind of a situation?

I could do my own NTP server, I guess, but I'd rather not. And I'd rather not have the external dependency, too (privacy, security, etc) - and hosting my own NTP server would potentially create a "chicken an egg problem" as I want to "host" nearly everything on the same network/VLAN/CIDR of the ICX6610. But maybe I could make some exceptions. I'd much prefer just sorting out how to keep the "manual settings" for the ICX6610 clock, for the moment though.

I know its rather trivial, but I'm still learning more about this shiny new ICX6610 / Brocade / 10+Gbe Enterprise gear. Has anyone ever had a similar experience? I'm searching for details on this and I don't see any definitive "there is no CMOS battery" information or any method for "clock/time retention" outside of "configure an external NTP service / url/IP" but "AI search tools" keep suggesting "its probably the CMOS battery-backed settings failing from a dead battery" (paraphrased).

So is it "necessary"for the Brocade ICX6610 to use external NTP? It just seems odd for an Enterprise Switch (given even the oldest Cisco's I've used don't have this issue). If its not a requirement for an external NTP source to be configured for the ICX6610 set on power-on for proper time settings, then what am I missing to retain the clock settings after a power cycle? Because manually setting the time and then writing to memory doesn't seem to be cutting it.

 

[korpo53]

@korpo53 I had the exact same issue with a hacked up mini usb. I could see it, but couldn't type anything in. I ended up using an FTDI usb to com cable and an rs232 to mini usb cable from amazon. I'm in Canada but I assume it should be similarly available in most places. Heres the link for the rs232 to mini usb: https://www.amazon.ca/dp/B09TFGV7Z1?ref=ppx_yo2ov_dt_b_fed_asin_title As for the ftdi usb to com port, I got it years ago for use on a cisco switch so I'm not sure brand or model but I know its FTDI. Also double check the putty/console settings for the communication.

Best of luck!

No dice, a brand new FTDI USB-Serial thing gives the same behavior. That is, perfect output but the switch doesn't register my input. I even tried different ports on my laptop and a reboot just in case, but nothing doing. Any other suggestions (from anyone) before I start harassing the eBay seller?

 

[DangerMc]

Hey, just wanted to make sure I wasn't missing anything.
I have two 7450 that I seem unable to get to talk together over the 40GB qsfp module. (I currently have them connected via 10Gb which works fine.) When I try to connected them using the same cable and two bidi transceivers, there is no link.
I've verified that both modules have power.
Both switches see the transceiver when using the "show media" command.
Currently, one of them are connected to another switch using the other 40GB module though with an MTP cable and transceivers without any issues.
So, just wanted to check if there is some configuration step that I am missing or if there are any steps I can take to further debug the issue?
Thanks

 

[kpfleming]

two bidi transceivers, there is no link.

You've confirmed that those BiDi modules are working properly in another situation?

 

[DangerMc]

I bought multiple ones in a set and all the others worked without any issues. But you're right, I need to go back and double check the transceivers.
In the meantime I connected one of the switches to another using the transceivers and another OM5 cable. The other switch sees the transceivers but there is no connection.
Since one of the 40GB modules are working, I might just remove the transceiver from that module and connect the other to see if that works.

Since it doesn't seem like there are any configuration issues to look for, I guess it's just trial and error.

 

[coolelectricity]

No dice, a brand new FTDI USB-Serial thing gives the same behavior. That is, perfect output but the switch doesn't register my input. I even tried different ports on my laptop and a reboot just in case, but nothing doing. Any other suggestions (from anyone) before I start harassing the eBay seller?

It might be a long shot, but have you tried a few different terminals? Like maybe something other than PuTTY?

Or, it could be the "illusion of emptiness", too.

My ICX6610 is SUPER janky from the console. Sometimes if I wait 10-15 seconds my input will magically show in PuTTY (in both "Console Mode" (COM) and SSH). But *Usually* if I hit Enter a few times, it will "wake up the display of my input keys" for a few seconds. So sometimes I'm "typing blind" (so I type reeeeeeeeeeeeeeallll slooooow to make sure I get it right) and then hit Enter, etc.

Janky, but it *is* actually working. I thought I was having issues with my terminal (PuTTY) at first too, but it turns out it was working, just sort of "delayed feedback" - That said, I've also had issues with some terminals on specific systems where for some reason the input wasn't working and I had to fiddle with some setting(s) that I can't recall off the top of my head. You could probably search for something like "<the name of your terminal app> doesn't register keystrokes fix solved" and find some additional avenues to try out before giving up on the cable you have.

 

[NablaSquaredG]

They've done it again... Leaked the new ICX8100 switch before it's released. I guess the release of the ICX8100 is imminent.

 

[i386]

View attachment 41694

They've done it again... Leaked the new ICX8100 switch before it's released. I guess the release of the ICX8100 is imminent.

ICX8100-24
ICX8100-24P
ICX8100-48
ICX8100-48P
ICX8100-C08PF

Source:https://docs.ruckus.cloud/api/conso...ag/ICX-Switch/operation/AddMultipleSwitches_1

 

[Cheburashka]

Hello everyone,

I have had a ICX 7150-C12P in my homelab for a few months now and periodically I've noticed and issue with the switch locking up.

What I mean is that I cannot ping the IP of the switch anymore nor SSH into it.

Usually a reboot will fix it but it occurs every so often. I have a basic configuration, only added a few (4) vlans. Nothing heavy at all on my network. NAS, AP, Firewall.

Initially I had the switch on FastIron 9.0.10_cd5 but I recently downgraded back to FastIron 08.0.95n (GA) for the recommended release.

I have tried to search for others with the same issue but haven't found anything. Anybody experience this before?

 

[BoGs]

Hello everyone,

I have had a ICX 7150-C12P in my homelab for a few months now and periodically I've noticed and issue with the switch locking up.

What I mean is that I cannot ping the IP of the switch anymore nor SSH into it.

Usually a reboot will fix it but it occurs every so often. I have a basic configuration, only added a few (4) vlans. Nothing heavy at all on my network. NAS, AP, Firewall.

Initially I had the switch on FastIron 9.0.10_cd5 but I recently downgraded back to FastIron 08.0.95n (GA) for the recommended release.

I have tried to search for others with the same issue but haven't found anything. Anybody experience this before?

If you do `show log` does it show anything during startup, I have had that happen to me on an icx7150-24 and it ended up being bad ram or asic as it would lock up randomly and not do anything until restart.

 

[panterateama]

No dice, a brand new FTDI USB-Serial thing gives the same behavior. That is, perfect output but the switch doesn't register my input. I even tried different ports on my laptop and a reboot just in case, but nothing doing. Any other suggestions (from anyone) before I start harassing the eBay seller?

I'm still a noob to this mini USB stupidity, but the only things I could think would be driver issue with the FTDI adapter (unlikely as they are built into Windows 10+), that there might be an issue with the mini usb port on the switch. Don't quote me on that as I'm not fully sure how they are wired up, or that the cable you got (either the FTDI adapter or the rs232 to mini usb has one of the wires in the wrong spot. Sorry I can't send you mine to try out...

I was going to try the one I got and if that didn't work, I was willing to break down and get the actual brocade adapter cable from ebay but not sure how much you want to invest in a possibly working or not working switch and since it's ebay, no idea what the return process is like (I haven't bought anything from ebay myself in over a decade lol)

my only other suggestion would be to contact the seller, ask if they have the actual brocade cable and if they would be willing to ship it to you for you to use the switch you bought

 

[korpo53]

It might be a long shot, but have you tried a few different terminals? Like maybe something other than PuTTY?

Or, it could be the "illusion of emptiness", too.

My ICX6610 is SUPER janky from the console. Sometimes if I wait 10-15 seconds my input will magically show in PuTTY (in both "Console Mode" (COM) and SSH). But *Usually* if I hit Enter a few times, it will "wake up the display of my input keys" for a few seconds. So sometimes I'm "typing blind" (so I type reeeeeeeeeeeeeeallll slooooow to make sure I get it right) and then hit Enter, etc.

Janky, but it *is* actually working. I thought I was having issues with my terminal (PuTTY) at first too, but it turns out it was working, just sort of "delayed feedback" - That said, I've also had issues with some terminals on specific systems where for some reason the input wasn't working and I had to fiddle with some setting(s) that I can't recall off the top of my head. You could probably search for something like "<the name of your terminal app> doesn't register keystrokes fix solved" and find some additional avenues to try out before giving up on the cable you have.

I tried Putty, Royal TS, and Moba XTerm. I tried two different USB ports, on two different computers, for a total of four. Two USB-Serial dongles with a serial to mini-USB cable that supposedly works for Brocade console, plus a Cisco-style USB terminal cable with the hacked up keystone to mini-USB from Reddit. My terminal settings are always 9600-8-1-N. I even tried flashing the firmware on the FTDI ones to flix tx/rx or something, as was recommended on a Reddit post.

The seller was all too happy to take the thing back, and I bought a new one from him, but it's just so wacky since the console ignores me as hard as it can. I even tried setting up a macro for Royal and Moba to have it spam B for me constantly, and it just ignores it.

 

[korpo53]

I'm still a noob to this mini USB stupidity, but the only things I could think would be driver issue with the FTDI adapter (unlikely as they are built into Windows 10+), that there might be an issue with the mini usb port on the switch.

I tried a total of three different USB things, if you count the Cisco cable that has USB built in, and two different computers. I tried this for most of a week and spent $100 on various cables on Amazon to make it work. I'm thinking it's just a cooked console port, but I thought that would just not work at all, not that it would show output and ignore input, which is why I thought it weird.

not sure how much you want to invest in a possibly working or not working switch and since it's ebay, no idea what the return process is like (I haven't bought anything from ebay myself in over a decade lol)

You just contact the seller to say it doesn't work, they send you a FedEx label, you throw stuff in a box and get your money back. In this case I just bought another one from the seller and I'm going to throw this one in the box when it shows up. I asked if they had any info about their refurbishing process so I'd know if the port worked at any time, but the guy said he just buys and sells this stuff and doesn't know the first thing about it. I didn't bother asking if he had a cable to send .
But hey, the switch was $100 shipped so I'm not complaining about some hassle if I get it working eventually.

 

[kapone]

unlikely as they are built into Windows 10+

FTDI drivers are very hit/miss. If I recall correctly (this was years back), I had to go through hoops to find the right FTDI driver for Windows 10, because the inbuilt one didn't quite work.

Edit: I use a Mac now...and things just kinda (not always though...) work...

 

[Cheburashka]

If you do `show log` does it show anything during startup, I have had that happen to me on an icx7150-24 and it ended up being bad ram or asic as it would lock up randomly and not do anything until restart.

I didn't know to do that. My experience with some HP/Aruba switches is that the logs will clear upon reboot.

I will give it a try. What sucks is when this happens, existing network connections work but if my desktop is off and I power it on, the switch won't function and forward traffic (DHCP).

I did try to connect via serial but it was not responsive also.

I will wait for this to re-occur and try to reboot and do show log.

 

[BoGs]

I didn't know to do that. My experience with some HP/Aruba switches is that the logs will clear upon reboot.

I will give it a try. What sucks is when this happens, existing network connections work but if my desktop is off and I power it on, the switch won't function and forward traffic (DHCP).

I did try to connect via serial but it was not responsive also.

I will wait for this to re-occur and try to reboot and do show log.

You can set the log to persist but it does not by default - usually if its ram it will show during the boot around where the bootloader starts and kernel loads from my tries. Mine showed funky characters on boot time and something about snoo checks failing.

 

[Cheburashka]

I am going to wipe my 7150-c12p clean and rebuild it. I did this by running erase flash primary/secondary and clearing the startup config.

I am going through Fohdeesha.com and I've come across his TFTP setup.

setenv image_name ICX7xxx/SPR08090mc.bin
setenv uboot ICX7xxx/mnz10118.bin

In my case, I don't want to use SPR because I don't want routing.

I did download the ICX7150 --> 08095n file and the images files are:

• SPR08095nufi.bin
• SPS08095nufi.bin

I will set my image name to be:

setenv image_name SPS08095nufi.bin

But I am unsure if I need the uboot file. I don't see any files in the Ruckus 08095n folders that start with a mnz.


Edit:

I found another thread that goes over the ICX firmware recovery ( How to: ICX firmware recovery (boot mode) – Habitech Limited ) and they mention the uboot file, which looks to be bootcode (uboot=brocade/ICX7150/bootcode/spz10106b002)

I'm not sure where to source this file when the Brocade-Ruckus download .zip doesn't seem to include it.

 

[i386]

With fastiron 10 ruckus removed the switch image for certain models

 

[Cheburashka]

With fastiron 10 ruckus removed the switch image for certain models

Sorry, I'm still trying to wrap my head around this.

I'm trying to use the FastIron 8.0.95n version, which does have the image.bin files but I'm not sure where to find the uboot/bootcode file.

 

[i386]

I'm trying to use the FastIron 8.0.95n version, which does have the image.bin files but I'm not sure where to find the uboot/bootcode file.

08.0.80f was the last version where the files were all separate, after that version all the firmware comes in the ufi format that contains everything necessary for the upgrade/update