Drag to reposition cover

Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)

cap

New Member
Sep 20, 2021
9
10
3
@zanechua It seems that the modules with the real Aquantia chipset have special capabilities for allowing the intermediate speeds of NBase-T on switches like the Brocade ICX that do not clock at those intermediate speeds. See https://forums.servethehome.com/ind...t-marvell-88x3300-v-s-aquantia-aqs-107.30004/ for a more thorough explanation. Also https://forums.servethehome.com/index.php?threads/mix-10g-2-5g-slow-speed-high-retr.33217/.

Using your HiFiber tranceiver, do you get full 2.xGbps throughput in BOTH directions between a 10Gbe endpoint and a 2.5Gbe endpoint?
 
Last edited:

zanechua

Member
May 6, 2016
73
9
8
28
@zanechua It seems that the modules with the real Aquantia chipset have special capabilities for allowing the intermediate speeds of NBase-T on switches like the Brocade ICX that do not clock at those intermediate speeds. See https://forums.servethehome.com/ind...t-marvell-88x3300-v-s-aquantia-aqs-107.30004/ for a more thorough explanation. Also https://forums.servethehome.com/index.php?threads/mix-10g-2-5g-slow-speed-high-retr.33217/.

Using your HiFiber tranceiver, do you get full 2.xGbps throughput in BOTH directions between a 10Gbe endpoint and a 2.5Gbe endpoint?
I can try it out, need to find where the only 2.5G device I have is.
 

tommybackeast

Active Member
Jun 10, 2018
290
111
43
I have been testing the 09000 release on my personal 7450s. Like @fohdeesha said, the new web GUI is the most visible change. Did not run into any noticeable bugs but I am planning to return my gear to the 0809x codetrain for now.

Earlier today, I stumbled across this notice regarding 08090m:

2 September 2021: RUCKUS has found a defect # FI-247944 due to which we have removed the software image for 08.0.90m from the Support Portal. For more information, please read TSB-2021-005.

I do not have access to the detailed TSB, but it is unusual for a vendor to completely pull a GA release before the patch is available. I would consider downgrading if you deployed the 'm' firmware.

Terry Henry showing the new ICX 9.0 Web GUI
 

tommybackeast

Active Member
Jun 10, 2018
290
111
43
the "hw pid-prom" commands that set the correct license ID, if ran on a stack, will only apply to the master switch, there's no way to make them run on the secondary. it sounds like you ran it on the master, then imported the matching licenses on both switches? that would certainly make the second one go invalid as it no longer has a matching LID

I think you'd have to now unstack the second 6450 and wipe it, then follow the license guide on it to get the LID changed and licenses imported. then once its all valid, and your master is too, re-add it to the stack. this is why it's highly recommended to license all your stuff before stacking it :)

(theoretically, in a stack, you can jump to the console of secondary units by using the "rconsole 2" command, but I've tested this and it won't let you run the "hw pid" commands from that remote console)
---------------------
Also I suppose instead of unstacking it, you could also just use the other hidden method of changing the serial and LID, from the bootloader. console cable to your secondary 6450, reboot it and stop it in the u-boot bootloader, then run:

eeprom clear
eeprom sn 2ax5o2jk68e
reset

it'll reboot and let it boot fully and rejoin the stack like usual. I think you might have to reboot it twice with this method as the first boot after clearing the LID from u-boot has it re-generate one, but not take effect. second reboot has it come up fully changed. then ssh to the stack and import licenses to it, by specifying unit 2:


copy tftp license 192.168.1.8 ICX64xx/1-6450-prem.xml unit 2
copy tftp license 192.168.1.8 ICX64xx/2-6450-ports.xml unit 2



Seeing the Clarkson video - I can now picture you in some DataCenter NOC screaming for more power while taking a large hammer to "bad" Network gear.
 
  • Haha
Reactions: fohdeesha

ZFSZealot

New Member
Aug 16, 2021
20
3
3
@cap

Sorry but why did you have to get that specific Aquantia transceiver?

Aren't the Brocade switches not picky at all and actually will run most transceivers?


I bought the HiFiber Transceiver listed in the above article and it worked fine.
This is a guess but I'm betting it's because that transceiver plugs into a SFP+ port and provides 2.5Gbit/sec connectivity instead of 10Gbit/sec.
 

tommybackeast

Active Member
Jun 10, 2018
290
111
43
How to confirm PoE firmware on 8095d

Brocade 7250-48p. Ran firmware update of 8095d and had minor human glitch.

show version gives
Primary SPR08095d.bin (UFI)
SW: Version 08.0.95dT213


show inline power detail gives
Firmware
Version
----------------
02.1.8 Build 004

is this correct? (screen shot of "show inline power detail" is attached

Phrased a different way, how to determine switch has the "correct" PoE firmware
 

Attachments

OKGolombRuler

New Member
Mar 13, 2020
15
6
3
you have to ensure that 1/3/3 on the 7150-24 and 1/3/1 on the C12P are defined as stacking ports in their respective configs, and *not* part of a stack trunk. can you post the output of show run, the top bit with all the stuff under "stack unit 1"? on top of that make sure the ports are manually set to 1gbps:

enable
conf t
int e 1/3/3
speed-duplex 1000-full

##C12P:
enable
conf t
int e 1/3/1
speed-duplex 1000-full

you should see a valid link up before even running any stacking commands, ensure that's happening by looking at "show int e 1/3/3" for example
Finally, the weekend, so I'm free to break the internet. :)

On the C12:
Current configuration:
!
ver 08.0.95dT213
!
stack unit 1
module 1 icx7150-c12-poe-port-management-module
module 2 icx7150-2-copper-port-2g-module
module 3 icx7150-2-sfp-plus-port-20g-module
!
!

On the 24:

!
ver 08.0.95dT213
!
stack unit 1
module 1 icx7150-24-port-management-module
module 2 icx7150-2-copper-port-2g-module
module 3 icx7150-4-sfp-plus-port-40g-module
priority 250
stack-port 1/3/1
stack-port 1/3/3
stack unit 2
unit-name cadbury
module 1 icx7150-c12-poe-port-management-module
module 2 icx7150-2-copper-port-2g-module
module 3 icx7150-2-sfp-plus-port-20g-module
stack-port 2/3/1

Tried setting the port speed on the C12. When I do, I see:

"Error! 1/3/2 speed is 1G. A stack-port needs at least 10G speed."

So I guess that answers that. I don't suppose we can lie to it/ force override? It makes sense, but it IS annoying for those of us limping it along at home. :)

I may pick up the 10G copper SFPs and try moving the C12 over to the solitary CAT5 run, on the argument that a) it may be good enough to make a 10G link and b) if not, it's actually feasible for me to pull ethernet to that one place. Relegate the C08 to MOCA duty since I can't stack it anyway...
 

tommybackeast

Active Member
Jun 10, 2018
290
111
43
Ruckus Unleashed AP Web GUI - failure to access Brocade 7250 and 7150

One is supposed to be able to login to Ruckus Unleashed AP WebGui and see Brocade Switches on the LAN, aka, "Single Pane of Glass"

Brocade 7150 and 7250 are on firmware 8095d
Ruckus r510 is on 200.10.10.5.246

Question: must i do "something" on the Brocade switch to allow the Ruckus Unleashed to access them?

Note: flat network, all on 192.168.1.0/24 with no VLANS
 

OKGolombRuler

New Member
Mar 13, 2020
15
6
3
Ruckus Unleashed AP Web GUI - failure to access Brocade 7250 and 7150

One is supposed to be able to login to Ruckus Unleashed AP WebGui and see Brocade Switches on the LAN, aka, "Single Pane of Glass"

Brocade 7150 and 7250 are on firmware 8095d
Ruckus r510 is on 200.10.10.5.246

Question: must i do "something" on the Brocade switch to allow the Ruckus Unleashed to access them?

Note: flat network, all on 192.168.1.0/24 with no VLANS
The docs (and the Ruckus Unleashed UI) suggest you should be able to go into the UI > Switches, plug in your admin-privileged user, and it connects. What I see when I do so, FWIW, is:
ICX Switch is Connecting
MAC Address:
(a mac)
IP Address:
(switch IP)
Name:
(switch name)
and it spins. I see failed logins on the switch. I think it's trying to use the default creds (super/sp-admin). Un/fortunately I haven't found a way to re-add those default creds to the switch after you've done the initial config... so adopting configured switches (ETA: without resetting them) is either counterintuitive or impossible. :/ But if you figure it out before I get frustrated enough to wipe-and-serial-console the config back up... please share!
 
  • Like
Reactions: tommybackeast

tommybackeast

Active Member
Jun 10, 2018
290
111
43
The docs (and the Ruckus Unleashed UI) suggest you should be able to go into the UI > Switches, plug in your admin-privileged user, and it connects. What I see when I do so, FWIW, is:
ICX Switch is Connecting
MAC Address:
(a mac)
IP Address:
(switch IP)
Name:
(switch name)
and it spins. I see failed logins on the switch. I think it's trying to use the default creds (super/sp-admin). Un/fortunately I haven't found a way to re-add those default creds to the switch after you've done the initial config... so adopting configured switches (ETA: without resetting them) is either counterintuitive or impossible. :/ But if you figure it out before I get frustrated enough to wipe-and-serial-console the config back up... please share!
Glad to not be alone :( Mine does the exact same thing as you described. It works just fine for Terry Henry on youtube :) but he's not us, lol

I continue to wonder if 'something' must be setup on the switch to allow Ruckus Unleashed to connect to them, perhaps white-listing the Ruckus Unleashed IP address.

PS: my Ruckus and two Brocades use login creds of root and my.own.password with no defaults used.
 
  • Like
Reactions: OKGolombRuler

Vesalius

Active Member
Nov 25, 2019
155
123
43
Glad to not be alone :( Mine does the exact same thing as you described. It works just fine for Terry Henry on youtube :) but he's not us, lol

I continue to wonder if 'something' must be setup on the switch to allow Ruckus Unleashed to connect to them, perhaps white-listing the Ruckus Unleashed IP address.

PS: my Ruckus and two Brocades use login creds of root and my.own.password with no defaults used.
Same here on 8095 and 9000 firmware on icx7150 48zp. I’ve given up. Doesn’t seem worth any more effort at this time for me.
Others are having this issue, seems worse if using router firmware instead of switch. Seems like you need to let the configured unleashed AP connect to the ICX from ground zero with a stock default icx startup/running config.

 
Last edited:

happydaisy

New Member
Oct 15, 2021
1
2
3
Unleashed is working for me on 9000a. Wasn't working on 9000.
Needed to add the community string for SNMP v1. It can be found in the unleashed config by typing show config from an ssh terminal on the unleashed ap.

I had also previously had unleashed integration on firmware 8090. 7250-24p.

Now i just need to figure out if aftermarket fans are safe for this thing. Been reading mixed reports in this thread
 
Last edited:

Vesalius

Active Member
Nov 25, 2019
155
123
43
Unleashed is working for me on 9000a. Wasn't working on 9000.
Needed to add the community string for SNMP v1. It can be found in the unleashed config by typing show config from an ssh terminal on the unleashed ap.

I had also previously had unleashed integration on firmware 8090.
Ok, good to know. I guess the ruckus employee I quoted stating 9000 would not receive updates was wrong. Thanks, I was waiting for 9010.
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,300
2,400
113
30
fohdeesha.com
so, from what I remember digging through the scripts in the ruckus unleashed AP firmware, the ICX "integration" is just a bunch of "expect" bash scripts. I specifically recall they expect to be able to ssh to the switch IP with the credentials you provide, and then blindly "enable" and "conf t" from there. so if you have an "enable" authentication line in your switch config that makes users log in again when they issue "enable", it'll barf. check your icx config and make sure you don't have a:
Code:
aaa authentication enable default local
the v9000 thing is another issue, the initial GA release of 9000 didn't have support if I remember right, 9000a should though. And if your switch is succesfully added in the unleashed UI, it will automatically create the snmp entries and other required things in your switch config so those "shouldn't" need to be done manually. here's the master script from Unleashed 200.9, ICX stuff starts around line 5240
 

Attachments

Last edited:

Cncjerry

New Member
Oct 16, 2021
19
3
3
Hey peoples, thanks for allowing me to join.

I'm a long-time networking person but might have made a mistake. I'm deploying 10GBe optical around my house for 6 servers. I bought a mikrotik 5 port forgetting I had 6 machines, duh. So I found an ICX6610-48p on ebay for a decent 'make an offer' price and then found that I had to license the 10Gb ports. What the heck? Talk about a ripoff. I took a scan of some of the text in this thread, will read more, but before I dig in too deeply, can I get around the licensing somehow?

I saw the note on the QSFP stacking ports, my engineer already told me that would probably work. Another question was one of the stacking ports was a 4x10 and I was wondering if a splitter cable would work on it? I thought we used splitters on the switches that are TOR on Exadata servers (I work for Oracle). This is a new area for me.

So is there an easy or not very expensive way to recover the 10Gb ports on the switch? My plan was to get rid of the 2 x 16 port GigE switches I am using and collect all that plus my small subnet of 6 x 10Gb servers into one switch.

Thanks again. great board.

Jerry
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,300
2,400
113
30
fohdeesha.com
Hey peoples, thanks for allowing me to join.

I'm a long-time networking person but might have made a mistake. I'm deploying 10GBe optical around my house for 6 servers. I bought a mikrotik 5 port forgetting I had 6 machines, duh. So I found an ICX6610-48p on ebay for a decent 'make an offer' price and then found that I had to license the 10Gb ports. What the heck? Talk about a ripoff. I took a scan of some of the text in this thread, will read more, but before I dig in too deeply, can I get around the licensing somehow?

I saw the note on the QSFP stacking ports, my engineer already told me that would probably work. Another question was one of the stacking ports was a 4x10 and I was wondering if a splitter cable would work on it? I thought we used splitters on the switches that are TOR on Exadata servers (I work for Oracle). This is a new area for me.

So is there an easy or not very expensive way to recover the 10Gb ports on the switch? My plan was to get rid of the 2 x 16 port GigE switches I am using and collect all that plus my small subnet of 6 x 10Gb servers into one switch.

Thanks again. great board.

Jerry
second sentence of the entire thread, first post
 

EngChiSTH

Member
Jun 27, 2018
93
32
18
Chicago
Any way to check the health of the management port on 7250 (or what I am doing wrong)

I am going from 6450 that is working fine to newly purchased from bay 7250 and following @fohdeesha instructions , I am getting nothing in Putty returned back to me on boot (fan spin up) or after boot.

Same workstation and Putty, connected to 6450 management port over same exact cable is getting me the prompt I would expect.
Anything I am missing? the Putty screen is just black, no data returned

Thank you
 

itronin

Well-Known Member
Nov 24, 2018
742
428
63
Denver, Colorado
Any way to check the health of the management port on 7250 (or what I am doing wrong)

I am going from 6450 that is working fine to newly purchased from bay 7250 and following @fohdeesha instructions , I am getting nothing in Putty returned back to me on boot (fan spin up) or after boot.

Same workstation and Putty, connected to 6450 management port over same exact cable is getting me the prompt I would expect.
Anything I am missing? the Putty screen is just black, no data returned

Thank you
If you are using the exact same RJ45 serial cable you used on the 6450 on a port on the 7250 you will NOT get any serial output.

6450 has an RJ45 serial console connection.
7250 has a micro USB connection that is wired as a serial port. DO NOT plug in a standard "A to micro USB cable" betweeen the 7250 and a laptop or dekstop. If you do magic smoke may escape the 7250 and perhaps your computing device.