Drag to reposition cover

Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

deeceesth

New Member
Jul 30, 2021
17
4
3
Hello - first time post. Thanks for putting together this wonderful resource.

I got a new 7250 from ebay - everything looks new but seems box was opened because it was missing a few parts - like the included console cable.

Anyway, hooked everything up and followed the install guide. First off, there is no sign of life from the console port. The seller sent me a. new console cable (mini usb) after i inform him it was missing in the box. Also the install guide says:



Connecting the management port to my network assigns the switch an ip address - I am able to see the web interface of the switch but dont know the default username and password to login . Using super and sp-admin doesnt work.

So i am quite confused. I assumed connecting the management port to my network doesnt assign it an ip until i set in via the console? I did not connect it to the regular port on the switch - its connected to the port directly above the usb port.

Also not sure how to get the console working. completely dead. I am hoping its something I am doing wrong vs a bad switch or console cable. could use some pointers to get things up and running. Thanks.
What does the physical connection look like for the console cable. Are you certain it is a serial cable and not just a normal mini USB B cable?
 

juju

Member
Sep 29, 2021
38
1
8
What does the physical connection look like for the console cable. Are you certain it is a serial cable and not just a normal mini USB B cable?
well - not sure i can even tell the difference between the two! I assumed the seller had sent me the correct cable. He sent me the console cable and a db9 adapter, which seems to be what comes with the new switch ? What do you mean by what the physical connection looks like? you mean how its connected? I am connected to my laptops ethernet port on one end and the mini usb on the switch.

also am I supposed to connect the management port to my network at the same time ? wont that get an ip assigned?
 

deeceesth

New Member
Jul 30, 2021
17
4
3
well - not sure i can even tell the difference between the two! I assumed the seller had sent me the correct cable. He sent me the console cable and a db9 adapter, which seems to be what comes with the new switch ? What do you mean by what the physical connection looks like? you mean how its connected? I am connected to my laptops ethernet port on one end and the mini usb on the switch.

also am I supposed to connect the management port to my network at the same time ? wont that get an ip assigned?
so you have a cable with RJ45 on one end and Mini USB B on the other? And then you have that RJ45 connected to your laptop and USB on the switch? If so that doesn't seem correct.

You need a serial interface on your laptop to connect to the mini USB B port. You might have to adapt the RJ45 to a DB9. Does your laptop have a DB9 connector or do you have a USB to Serial adapter?

It would help if you posted a picture of everything you have
 

juju

Member
Sep 29, 2021
38
1
8
so you have a cable with RJ45 on one end and Mini USB B on the other? And then you have that RJ45 connected to your laptop and USB on the switch? If so that doesn't seem correct.

You need a serial interface on your laptop to connect to the mini USB B port. You might have to adapt the RJ45 to a DB9. Does your laptop have a DB9 connector or do you have a USB to Serial adapter?

It would help if you posted a picture of everything you have
I have an RJ45 /db9 adapter which came with the switch. Not a usb to serial. My laptop does not have a db9 connector. It has usb-c and usb-A, plus the usual hdmi and RJ45. ( Lenovo thinkpad x1 carbon )

So, I have the mini-usb connected to the switch and the ethernet connected to my laptop. Which is wrong ( now i know!)


So what do i need to make this work?

mini-usb from 7250 - > ethernet / db9 adapter - > ? -> laptop USB-A?
 

Attachments

cap

New Member
Sep 20, 2021
12
14
3
California
On the subject of interfacing the Brocade ICX to 2.5gbe equipment, I tried out two gadgets, both with successful results.

First is the new Qnap QSW-2104-2S, a very new product, which I purchased new from a large online retailer. This is a fanless consumer-oriented unit, with two 10Gbe SFP+ ports (there is a separate 10GBaseT version), and four 2.5Gbe RJ45 ports. I connected the Brocade to the Qnap with a DAC.

My second solution is that magic SFP+ RJ45 module, the Aquantia AQS-107-B0C2-CX. I paid a fortune for it, second hand, via ebay. This module goes directly into one of the SFP+ ports of my Brocade ICX 7250-24. The Brocade reports the link at 10G, but the RJ45 end is connected to 2.5Gbe equipment.

I did two sorts of tests on each device. First was iperf3 testing through the device under test, between a Solaris server with an Intel x520 card and a Macos laptop with a Plugable 2.5gbe USB dongle.The second test was just running speedtest.net through the device and out to the internet through my Comcast Xfinity XB7 (2.5gbe port, 1400Mbps reported throughput on a good day (maybe not even worth the effort but here we are)).

In the iperf3 testing, I was able to get performance as solid as I ever do through the Plugable dongles. I think they are the weak link. I have two of them, and in direct dongle–dongle testing between two laptops, I see mostly 2.3Gbps, but with occasional dips of a few seconds to under 1Gbps, possibly due to thermal throttling of something, I suspect the Plugable dongle or the laptop (the laptop fans spin up when I do this test -- something that does not happen on the same laptop when iperfing through my Sonnet Solo 10G interface at much higher speeds, so that is interesting in itself). I see about the same behavior between one dongle and the x520 card, passing through either the Aquantia module or the Qnap switch. If I run bidirectional iperf3, I occasionally see > 2Gbps for a few seconds, but then it decreases, and then increases (after cooling, I suppose). Unfortunately, neither of my endpoints (Macos and Solaris) show retransmits through iperf3, so I do not have that information to report.

In the speedtest.net testing, my speeds using either the Qnap switch or the Aquantia SFP+ module were on par with the speeds when I connect the Plugable dongle directly (via Cat6) to the Xfinity XB7 router.

This post is really not supposed to be a review of these other products, especially the dongle, but about how well the Qnap switch and the Aquantia module allow us to interface between our ICX switches at 10G and the 2.5gbe world. So I apologize about the limitations of my test setup, like the overheating whatevers. I hope there remains something of value.
aquantia-aqs-107-b0c2-cx.jpg
 

cap

New Member
Sep 20, 2021
12
14
3
California
When testing the Aquantia AQS-107-B0C2-CX SFP+ module, I noticed that show media reports the slot as empty, even though it is working.

Code:
SSH@b7250#show media e 1/2/7
Port   1/2/7: Type  : EMPTY
I remembered the post about the misformatted I2C EEPROM, so I thought I would read mine out of curiosity. I knew I would need to figure out the address of the slot containing my module, but I got stuck before that mattered. @fohdeesha can you teach me how this should be working on my 7250?
Code:
OS>i2c read 3f 0 256
Syntax error, 'read'

OS>i2c ?
reset            reset i2c bus
stats            statistics
recovery         toggle auto recovery
debug            toggle debug mode
Hexadecimal      bus

OS>show version
Kernel version - 4.4.0

OS>exit
OS>Back to Application console...
b7250>show version
  Copyright (c) Ruckus Networks, Inc. All rights reserved.
    UNIT 1: compiled on May 17 2021 at 06:42:41 labeled as SPR08095d
      (33554432 bytes) from Primary SPR08095d.bin (UFI)
        SW: Version 08.0.95dT213
      Compressed Primary Boot Code size = 786944, Version:10.1.19T215 (spz10119)
       Compiled on Tue Feb  2 03:21:35 2021

  HW: Stackable ICX7250-24
I tried i2c debug to toggle debug mode. That spams the console with some stuff and doesn't make i2c read work.
 

cap

New Member
Sep 20, 2021
12
14
3
California
@zanechua It seems that the modules with the real Aquantia chipset have special capabilities for allowing the intermediate speeds of NBase-T on switches like the Brocade ICX that do not clock at those intermediate speeds. See https://forums.servethehome.com/ind...t-marvell-88x3300-v-s-aquantia-aqs-107.30004/ for a more thorough explanation. Also https://forums.servethehome.com/index.php?threads/mix-10g-2-5g-slow-speed-high-retr.33217/.

Using your HiFiber tranceiver, do you get full 2.xGbps throughput in BOTH directions between a 10Gbe endpoint and a 2.5Gbe endpoint?
 
Last edited:

zanechua

Member
May 6, 2016
78
12
8
31
@zanechua It seems that the modules with the real Aquantia chipset have special capabilities for allowing the intermediate speeds of NBase-T on switches like the Brocade ICX that do not clock at those intermediate speeds. See https://forums.servethehome.com/ind...t-marvell-88x3300-v-s-aquantia-aqs-107.30004/ for a more thorough explanation. Also https://forums.servethehome.com/index.php?threads/mix-10g-2-5g-slow-speed-high-retr.33217/.

Using your HiFiber tranceiver, do you get full 2.xGbps throughput in BOTH directions between a 10Gbe endpoint and a 2.5Gbe endpoint?
I can try it out, need to find where the only 2.5G device I have is.
 

tommybackeast

Active Member
Jun 10, 2018
286
105
43
I have been testing the 09000 release on my personal 7450s. Like @fohdeesha said, the new web GUI is the most visible change. Did not run into any noticeable bugs but I am planning to return my gear to the 0809x codetrain for now.

Earlier today, I stumbled across this notice regarding 08090m:

2 September 2021: RUCKUS has found a defect # FI-247944 due to which we have removed the software image for 08.0.90m from the Support Portal. For more information, please read TSB-2021-005.

I do not have access to the detailed TSB, but it is unusual for a vendor to completely pull a GA release before the patch is available. I would consider downgrading if you deployed the 'm' firmware.

Terry Henry showing the new ICX 9.0 Web GUI
 

tommybackeast

Active Member
Jun 10, 2018
286
105
43
the "hw pid-prom" commands that set the correct license ID, if ran on a stack, will only apply to the master switch, there's no way to make them run on the secondary. it sounds like you ran it on the master, then imported the matching licenses on both switches? that would certainly make the second one go invalid as it no longer has a matching LID

I think you'd have to now unstack the second 6450 and wipe it, then follow the license guide on it to get the LID changed and licenses imported. then once its all valid, and your master is too, re-add it to the stack. this is why it's highly recommended to license all your stuff before stacking it :)

(theoretically, in a stack, you can jump to the console of secondary units by using the "rconsole 2" command, but I've tested this and it won't let you run the "hw pid" commands from that remote console)
---------------------
Also I suppose instead of unstacking it, you could also just use the other hidden method of changing the serial and LID, from the bootloader. console cable to your secondary 6450, reboot it and stop it in the u-boot bootloader, then run:

eeprom clear
eeprom sn 2ax5o2jk68e
reset

it'll reboot and let it boot fully and rejoin the stack like usual. I think you might have to reboot it twice with this method as the first boot after clearing the LID from u-boot has it re-generate one, but not take effect. second reboot has it come up fully changed. then ssh to the stack and import licenses to it, by specifying unit 2:


copy tftp license 192.168.1.8 ICX64xx/1-6450-prem.xml unit 2
copy tftp license 192.168.1.8 ICX64xx/2-6450-ports.xml unit 2



Seeing the Clarkson video - I can now picture you in some DataCenter NOC screaming for more power while taking a large hammer to "bad" Network gear.
 
  • Haha
Reactions: fohdeesha

ZFSZealot

New Member
Aug 16, 2021
29
7
3
@cap

Sorry but why did you have to get that specific Aquantia transceiver?

Aren't the Brocade switches not picky at all and actually will run most transceivers?


I bought the HiFiber Transceiver listed in the above article and it worked fine.
This is a guess but I'm betting it's because that transceiver plugs into a SFP+ port and provides 2.5Gbit/sec connectivity instead of 10Gbit/sec.
 

tommybackeast

Active Member
Jun 10, 2018
286
105
43
How to confirm PoE firmware on 8095d

Brocade 7250-48p. Ran firmware update of 8095d and had minor human glitch.

show version gives
Primary SPR08095d.bin (UFI)
SW: Version 08.0.95dT213


show inline power detail gives
Firmware
Version
----------------
02.1.8 Build 004

is this correct? (screen shot of "show inline power detail" is attached

Phrased a different way, how to determine switch has the "correct" PoE firmware
 

Attachments

OKGolombRuler

New Member
Mar 13, 2020
22
6
3
you have to ensure that 1/3/3 on the 7150-24 and 1/3/1 on the C12P are defined as stacking ports in their respective configs, and *not* part of a stack trunk. can you post the output of show run, the top bit with all the stuff under "stack unit 1"? on top of that make sure the ports are manually set to 1gbps:

enable
conf t
int e 1/3/3
speed-duplex 1000-full

##C12P:
enable
conf t
int e 1/3/1
speed-duplex 1000-full

you should see a valid link up before even running any stacking commands, ensure that's happening by looking at "show int e 1/3/3" for example
Finally, the weekend, so I'm free to break the internet. :)

On the C12:
Current configuration:
!
ver 08.0.95dT213
!
stack unit 1
module 1 icx7150-c12-poe-port-management-module
module 2 icx7150-2-copper-port-2g-module
module 3 icx7150-2-sfp-plus-port-20g-module
!
!

On the 24:

!
ver 08.0.95dT213
!
stack unit 1
module 1 icx7150-24-port-management-module
module 2 icx7150-2-copper-port-2g-module
module 3 icx7150-4-sfp-plus-port-40g-module
priority 250
stack-port 1/3/1
stack-port 1/3/3
stack unit 2
unit-name cadbury
module 1 icx7150-c12-poe-port-management-module
module 2 icx7150-2-copper-port-2g-module
module 3 icx7150-2-sfp-plus-port-20g-module
stack-port 2/3/1

Tried setting the port speed on the C12. When I do, I see:

"Error! 1/3/2 speed is 1G. A stack-port needs at least 10G speed."

So I guess that answers that. I don't suppose we can lie to it/ force override? It makes sense, but it IS annoying for those of us limping it along at home. :)

I may pick up the 10G copper SFPs and try moving the C12 over to the solitary CAT5 run, on the argument that a) it may be good enough to make a 10G link and b) if not, it's actually feasible for me to pull ethernet to that one place. Relegate the C08 to MOCA duty since I can't stack it anyway...
 

tommybackeast

Active Member
Jun 10, 2018
286
105
43
Ruckus Unleashed AP Web GUI - failure to access Brocade 7250 and 7150

One is supposed to be able to login to Ruckus Unleashed AP WebGui and see Brocade Switches on the LAN, aka, "Single Pane of Glass"

Brocade 7150 and 7250 are on firmware 8095d
Ruckus r510 is on 200.10.10.5.246

Question: must i do "something" on the Brocade switch to allow the Ruckus Unleashed to access them?

Note: flat network, all on 192.168.1.0/24 with no VLANS
 

OKGolombRuler

New Member
Mar 13, 2020
22
6
3
Ruckus Unleashed AP Web GUI - failure to access Brocade 7250 and 7150

One is supposed to be able to login to Ruckus Unleashed AP WebGui and see Brocade Switches on the LAN, aka, "Single Pane of Glass"

Brocade 7150 and 7250 are on firmware 8095d
Ruckus r510 is on 200.10.10.5.246

Question: must i do "something" on the Brocade switch to allow the Ruckus Unleashed to access them?

Note: flat network, all on 192.168.1.0/24 with no VLANS
The docs (and the Ruckus Unleashed UI) suggest you should be able to go into the UI > Switches, plug in your admin-privileged user, and it connects. What I see when I do so, FWIW, is:
ICX Switch is Connecting
MAC Address:
(a mac)
IP Address:
(switch IP)
Name:
(switch name)
and it spins. I see failed logins on the switch. I think it's trying to use the default creds (super/sp-admin). Un/fortunately I haven't found a way to re-add those default creds to the switch after you've done the initial config... so adopting configured switches (ETA: without resetting them) is either counterintuitive or impossible. :/ But if you figure it out before I get frustrated enough to wipe-and-serial-console the config back up... please share!
 
  • Like
Reactions: tommybackeast

tommybackeast

Active Member
Jun 10, 2018
286
105
43
The docs (and the Ruckus Unleashed UI) suggest you should be able to go into the UI > Switches, plug in your admin-privileged user, and it connects. What I see when I do so, FWIW, is:
ICX Switch is Connecting
MAC Address:
(a mac)
IP Address:
(switch IP)
Name:
(switch name)
and it spins. I see failed logins on the switch. I think it's trying to use the default creds (super/sp-admin). Un/fortunately I haven't found a way to re-add those default creds to the switch after you've done the initial config... so adopting configured switches (ETA: without resetting them) is either counterintuitive or impossible. :/ But if you figure it out before I get frustrated enough to wipe-and-serial-console the config back up... please share!
Glad to not be alone :( Mine does the exact same thing as you described. It works just fine for Terry Henry on youtube :) but he's not us, lol

I continue to wonder if 'something' must be setup on the switch to allow Ruckus Unleashed to connect to them, perhaps white-listing the Ruckus Unleashed IP address.

PS: my Ruckus and two Brocades use login creds of root and my.own.password with no defaults used.
 
  • Like
Reactions: OKGolombRuler

Vesalius

Active Member
Nov 25, 2019
261
202
43
Glad to not be alone :( Mine does the exact same thing as you described. It works just fine for Terry Henry on youtube :) but he's not us, lol

I continue to wonder if 'something' must be setup on the switch to allow Ruckus Unleashed to connect to them, perhaps white-listing the Ruckus Unleashed IP address.

PS: my Ruckus and two Brocades use login creds of root and my.own.password with no defaults used.
Same here on 8095 and 9000 firmware on icx7150 48zp. I’ve given up. Doesn’t seem worth any more effort at this time for me.
Others are having this issue, seems worse if using router firmware instead of switch. Seems like you need to let the configured unleashed AP connect to the ICX from ground zero with a stock default icx startup/running config.

 
Last edited: