Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)
- Thread starter fohdeesha
- Start date
Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.
Not in any meaningful way that I'm aware of. Fohdeesha's guides assume SPR since it has you assign an IP to a VE. I haven't had to reference it in a while, so I don't recall if he has the L2 only steps in there as well. Probably does, it's pretty thorough.
Not sure if the other switches are different but the 7250 has the following pinout for the miniusb port.
So it looks like you are missing a ground wire?
90000 git commits this week, new docs build with cool new secrets should be pushed out soon(tm)
I still think you are missing a ground which could cause you issues. It probably works because you have an electrical ground through your home that commons up the 2 devices but I wouldn't count on it and could even cause damage if you get too much of a differential between the devices.
Picked up a 7150-24p and got it updated and licensed using your guide! Thanks!
I also managed to get Brocade Network Advisor installed on linux (centos 7). Turns out that all the config files/scripts were written on a Windows system with DOS line endings, which linux does NOT like. Luckily there is a handy command to convert them.
Run install.bin, but when you reach the end, choose not to run the Configuration Wizard. Once that is done, install dos2unix from the standard repo (yum install dos2unix). Next, cd to /opt/Network_Advisor_IP14_2_12 and run "find . -type f -print0 | xargs -0 dos2unix" which will search through the entire directory and convert all text files to the correct Unix format.
Once that completes, run "bin/configwizard" and follow the instructions to configure BNA!
If you want to run it as a server, you'll need to modify the firewall to allow access.
I also managed to get Brocade Network Advisor installed on linux (centos 7). Turns out that all the config files/scripts were written on a Windows system with DOS line endings, which linux does NOT like. Luckily there is a handy command to convert them.
Run install.bin, but when you reach the end, choose not to run the Configuration Wizard. Once that is done, install dos2unix from the standard repo (yum install dos2unix). Next, cd to /opt/Network_Advisor_IP14_2_12 and run "find . -type f -print0 | xargs -0 dos2unix" which will search through the entire directory and convert all text files to the correct Unix format.
Once that completes, run "bin/configwizard" and follow the instructions to configure BNA!
If you want to run it as a server, you'll need to modify the firewall to allow access.
When I got home today my entire network was down and my ICX 6610 had the fans at 100%, so I unplugged and replugged it into power; the fans still stuck at full bore, and the activity lights on the SFP ports are solid green. I cannot see it on the network anymore and I tried using a console cable but it's no longer working either.
Anyone have any troubleshooting suggestions? I feel like it may just be a noisy brick now.
Anyone have any troubleshooting suggestions? I feel like it may just be a noisy brick now.
If you power cycle it with console cable active, do you even see the boot loader?
I am having issues with the 40G breakout ports, where only the 4th port in each group (1/2/5 and 1/2/10) will link when using a QSFP-to-4xSFP+ breakout DAC (specific cable is a FS Brocade 40G-QSFP-4SFP-C-0201).
My Setup:
Switch - ICX 6610-48P with licenses, breakout QSFP plugged into XL2-5
Server 1 - Intel X520 PCIe NIC - ports 1 and 2 connected to breakout SFP+ transceivers 1 and 2 (1/2/2 and 1/2/3)
Server 2 - Intel 82599ES daughter card - ports 1 and 2 connected to breakout SFP+ transceivers 3 and 4 (1/2/4 and 1/2/5)
The successful link follows the switch port (changing the order of transceivers in a NIC, and trying different NICs results in 1/2/5 always linking). Plugging only one SFP+ breakout at a time into a NIC does not change the behavior, only the 1/2/5 or 1/2/10 ports will link up. Using a new cable (of the same model) does not resolve this, using XL7-10 (the second QSFP breakout port) also does not resolve (only 1/2/10 links up).
Any help figuring this out would be appreciated!
ETA: I did a fair bit of googling and keyword searching this thread and found the combined stacking + breakout config instructions, but my setup is not stacking, just 100% data. The XL1 and XL6 ports are connected directly to a 40G NIC in another box.
My Setup:
Switch - ICX 6610-48P with licenses, breakout QSFP plugged into XL2-5
Server 1 - Intel X520 PCIe NIC - ports 1 and 2 connected to breakout SFP+ transceivers 1 and 2 (1/2/2 and 1/2/3)
Server 2 - Intel 82599ES daughter card - ports 1 and 2 connected to breakout SFP+ transceivers 3 and 4 (1/2/4 and 1/2/5)
The successful link follows the switch port (changing the order of transceivers in a NIC, and trying different NICs results in 1/2/5 always linking). Plugging only one SFP+ breakout at a time into a NIC does not change the behavior, only the 1/2/5 or 1/2/10 ports will link up. Using a new cable (of the same model) does not resolve this, using XL7-10 (the second QSFP breakout port) also does not resolve (only 1/2/10 links up).
Any help figuring this out would be appreciated!
show interface brief ethernet 1/2/1 to 1/2/5
Code:
Port Link State Dupl Speed Trunk Tag Pvid Pri MAC Name
1/2/1 Up Forward Full 40G 13 Yes N/A 0 redacted redacted
1/2/2 Down None None None None No 1 0 redacted redacted
1/2/3 Down None None None None No 1 0 redacted redacted
1/2/4 Down None None None None No 1 0 redacted redacted
1/2/5 Up Forward Full 10G None No 1 0 redactedshow stack
Code:
***** Warning! stack is not enabled. *****
T=22d20h53m31.8: alone: standalone, D: dynamic cfg, S: static
ID Type Role Mac Address Pri State Comment
1 S ICX6610-48P alone redacted 0 local None:0
+---+
2/1| 1 |2/6
+---+
Current stack management MAC is redactedshow run
Code:
stack unit 1
module 1 icx6610-48p-poe-port-management-module
module 2 icx6610-qsfp-10-port-160g-module
module 3 icx6610-8-port-10g-dual-mode-module
Last edited:
You could by any of several of the ICX line that are fairly cheap to do that.
Would you mind sharing how you secured the 3rd fan on top of the ASIC heatsink? I'm looking to do something similar, but am unsure of the best way to more forward.
It sounds janky, but honestly, just drive the screws right into the heat sink. Well-sized and threaded will grip right to the fins very securely. That's how I did it.
I am green to switch stacking and have some probably stupid questions here. I have been reading the stacking documentation for 08.0.90(k) firmware running on 2x 7250. I just want to make sure I am understanding correctly because I haven't seen definitive answers. I am using a single 10G port on each switch 1/2/1 and 2/2/1 for stacking, do I need to make a trunk or can I just use a single port on each like this? Can I reclaim the use of 1/2/3 and 2/2/3 as a data ports? Do I need to provide additional uplink ports between the switches or is all data transferred between using the stack ports?
Code:
ICX7250-24P Router>show stack
T=19h39m5.5: alone: standalone, D: dynamic cfg, S: static
ID Type Role Mac Address Pri State Comment
1 S ICX7250-24P active mmmm.aaaa.cccc 0 local Ready
2 S ICX7250-24 standby mmmm.aaaa.cccc 0 remote Ready
active standby
+---+ +---+
2/3| 1 |2/1--2/1| 2 |2/3
+---+ +---+
Standby u2 - sent role but not acked
Role history: N: standalone, A: active, S: standby, M: member
U1: N->A, U2: M->S->N->M->S
Last edited:
I don't know if it makes a difference... but do you have 'stack disable' in your setup? Like this:
Code:
stack unit 1
module 1 icx6610-48p-poe-port-management-module
module 2 icx6610-qsfp-10-port-160g-module
module 3 icx6610-8-port-10g-dual-mode-module
stack disableThat's odd, sounds like it is indeed bricked, which in my experience is usually a bad/incomplete bootloader, but it typically doesn't happen for no reason - could be a bad bootloader flash/upgrade from a while back and it just hadn't been rebooted yet or similar. Depending on how invested you are and how close to indiana you are, I might be able to mail you my jtag unit if you want to flash a fresh bootloader via jtag and see if that's the issue