Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)
- Thread starter fohdeesha
- Start date
Hey so, picked up an ICX 6450 (why have one ICX when you can have two, right?). Got the licence and instructions, reset switch to factory, updated, installed licences, set the AFP+ ports at 10g, but they won't route/pass traffic. My 10g ports on my test machines are set to a different subnet The switch is in layer3 mode, but it should still pass traffic via layer2 on the same vlan correct? Stacking is disabled, not sure what else to check.
I can hit the web gui via ethernet port, I'm seeing TX packets on the 10G ports but no RX packets, so the cables and all transceivers are working well enough for packets to make it to the switch. If I direct connect my 2 test machines they can establish a 10g connection.
Edit: Well thats... new, looks like I found a transceiver Brocade doesn't like maybe? Swappedthe optics on the switch and it's working. These came from my bin of optic so A) they both failed B) I tossed some in I didn't test C)these Cisco optics don't work on brocade.
Need to dig out my mellanox cards as these solarflares I'm using/testing are sometimes picky (low power use and cost however so it's a tradeoff)
I can hit the web gui via ethernet port, I'm seeing TX packets on the 10G ports but no RX packets, so the cables and all transceivers are working well enough for packets to make it to the switch. If I direct connect my 2 test machines they can establish a 10g connection.
Edit: Well thats... new, looks like I found a transceiver Brocade doesn't like maybe? Swappedthe optics on the switch and it's working. These came from my bin of optic so A) they both failed B) I tossed some in I didn't test C)these Cisco optics don't work on brocade.
Need to dig out my mellanox cards as these solarflares I'm using/testing are sometimes picky (low power use and cost however so it's a tradeoff)
Last edited:
Been reading through a lot of VLAN posts trying to figure out what to do with my 6610. It is running the router version of firmware on 8030t. At any rate, I have 2 VLAN's setup from a while ago that was just to segregate the ports into wired vs wireless with each having a physical port off my OPNSense firewall. Now that I've gotten more comfortable with this switch and OPNSense stuff in general, I want to go further with it. Currently I do not have VLAN's setup on the firewall since it was 2 separate physical interfaces anyway. Now I want to have 5 VLAN's going out those same 2 interfaces as follows:
ix1 -> Internal wired LAN and wireless (vlan 10 and 20)
ix2 -> DMZ, IOT, and Guest (vlan 30, 40, 50)
These are 2 10Gb ports on 1/3/7 and 1/3/8. OPNSense is handling DHCP and routing currently for all interfaces. The wireless is an Uni nano-HD so it supports VLAN's without issue. What I don't know, being a FC SAN guru and not an Ethernet guru, is what I want all setup on the 6610. Do I want RIP enabled? Per vlan STP? Set a router interface for the vlan? 802.1W? I know I can get it working myself just creating vlans with the correct ID's and putting in ports that need to be tagged and ones that are untagged. I just don't know the fine details so that not only does it work, but it is set up correctly and works properly. I probably also need to look into how to trunk the 2 10Gb ports on the switch to pass the needed vlans.
ix1 -> Internal wired LAN and wireless (vlan 10 and 20)
ix2 -> DMZ, IOT, and Guest (vlan 30, 40, 50)
These are 2 10Gb ports on 1/3/7 and 1/3/8. OPNSense is handling DHCP and routing currently for all interfaces. The wireless is an Uni nano-HD so it supports VLAN's without issue. What I don't know, being a FC SAN guru and not an Ethernet guru, is what I want all setup on the 6610. Do I want RIP enabled? Per vlan STP? Set a router interface for the vlan? 802.1W? I know I can get it working myself just creating vlans with the correct ID's and putting in ports that need to be tagged and ones that are untagged. I just don't know the fine details so that not only does it work, but it is set up correctly and works properly. I probably also need to look into how to trunk the 2 10Gb ports on the switch to pass the needed vlans.
@fohdeesha - took me nearly 18mths to piece together power supplies and fans to a barebone ICX7750-48C...
Question, did you manage to mod the fans? they are pretty damn loud - louder than icx6610.
Thanks in advance
Question, did you manage to mod the fans? they are pretty damn loud - louder than icx6610.
Thanks in advance
Where did I say I wanted to put it in my living room? I saw that fan mentioned earlier in this thread and someone said it works good. I'll check out the fans you mentioned. Thanks
Do you happen to know how many db those fans put out?
that will upgrade all stack members, and no new bootloader or PoE firmware for the last couple years
nope, the 7750 is a huge datacenter switch with a power sucking trident II asic, even if you could figure out a way to mod the fans to make it quieter, you'd probably cook the chip as a result
does the switch have a route installed to know how to get back out to the internet over the management port? for instance if your transit providers gateway on the other side of that /28 is xxx.1, your switch is gunna need a route telling it to use that as a next-hop for any traffic you want going out that oob connection. or if you have the whole /28 and it's given to you over some other /31 transit subnet, replace the example gateway with the providers gateway in that subnet etc
I've read 27.5dB, but this can be misleading as the switch keeps the fan at ~40% of the rated voltage at speed 1, and they are inside an enclosure.
I can say that there's an apreciabile difference between those and the stock Foxconn, but I don't have any measurement, sorry. And I can tell you that now it's bearable to be beside the switch, but it isn't silent.
What is the easiest way to replace an existing 7250 with a replacement 7250 with the exact same config?
Store a backup of the running config on current 7250
Restore that backup onto the new 7250
Maybe fix passwords?
Maybe change IP so that it doesn't conflict as I move ports?
Unplug existing 7250 ports and move to new 7250 ports
Or power off exiting 7250 before connecting to new to remove any IP/routing conflicts?
Or is there an easy way to run both for a short time as I move the ports from existing to new before removing the existing switch?
I am using vlan's and the switch is doing the routing for those vlan's which is why I am unsure about having both running at the same time without stacking (which would be removed since I am using 7 of the 10G ports as uplinks.)
The existing 7250-48p that I am using must have got some water damage or something since around 5-6 of the 1G ports are either dead or only link at 100Mbps and one of the 10G ports is giving some input and CRC errors. I am not currently using any of "bad" 1G ports and can move off the 10G port that is accumulating the errors, but got a replacement off ebay for ~$160 shipped that appears to be 100% functional and will use it instead and keep the old one as a spare.
Store a backup of the running config on current 7250
Restore that backup onto the new 7250
Maybe fix passwords?
Maybe change IP so that it doesn't conflict as I move ports?
Unplug existing 7250 ports and move to new 7250 ports
Or power off exiting 7250 before connecting to new to remove any IP/routing conflicts?
Or is there an easy way to run both for a short time as I move the ports from existing to new before removing the existing switch?
I am using vlan's and the switch is doing the routing for those vlan's which is why I am unsure about having both running at the same time without stacking (which would be removed since I am using 7 of the 10G ports as uplinks.)
The existing 7250-48p that I am using must have got some water damage or something since around 5-6 of the 1G ports are either dead or only link at 100Mbps and one of the 10G ports is giving some input and CRC errors. I am not currently using any of "bad" 1G ports and can move off the 10G port that is accumulating the errors, but got a replacement off ebay for ~$160 shipped that appears to be 100% functional and will use it instead and keep the old one as a spare.
If you're shooting for no downtime, then backup/restore config, change IP, fix password, connect the two switches, then move ports over.
If you can tolerate downtime, restore the config over serial or with a laptop and TFTP, correct the password (as exported config replaces it with dots), then just move your cables over without bridging the switches.
If you can tolerate downtime, restore the config over serial or with a laptop and TFTP, correct the password (as exported config replaces it with dots), then just move your cables over without bridging the switches.
I have already got the switch mostly setup using the serial port and the instructions at the beginning (by passing a serial port from my R720 into a VM and doing the setup from there) and can probably just do the unplug the first one and move the ports with a couple minutes of downtime.
I didn't know if there was an easy way to setup a stack between the two switches, mirror the config, and then just move the ports and turn the old one off.
I didn't know if there was an easy way to setup a stack between the two switches, mirror the config, and then just move the ports and turn the old one off.
Unstacking a switch will remove the config, IIRC.
You want to to copy the config from the original switch:
copy startup-config <destination here>
Load it onto your target:
copy <source here> startup-config<source options here>
You want to to copy the config from the original switch:
copy startup-config <destination here>
Load it onto your target:
copy <source here> startup-config<source options here>
Already did the
copy run-config disk0 run-config7250
thought I could do
copy disk0 run-config run-config7250
set passwords
write term
if that doesn't work, I will grab the startup-config from the existing and load it to the new one
And thanks for the help since I am not a networking guru and the documents all expect you to know something about how it is expected to work.
Yes, load the config from your USB (guessing that's disk0), then update the password and issue "wr me" should do it, then just start moving connections over.
Loaded from disk0 (USB) to running config. Got an error about only having one ip for an interface and had to fix the ve 1 ip to match old switch.
The passwords appeared to be correct from the config loaded or were kept from my original setup on the new switch.
There were also a couple other settings that appeared to stay from the new switch that didn't match the old config and I just manually updated them to match.
Moved the port over and everything appears to be working.
Sorry if this has been mentioned before, as I haven't gone through the entire thread. It seems like some of the "full size" 7150s are down to affordable prices now. I just picked up a 7150-24 for $140 after shipping. Going to be my first foray into Brocade and 10gb at the same time!
Ruckus ICX 6610 Campus Switches | Products | Ruckus Wireless Support
support.ruckuswireless.com
Ruckus ICX FastIron 08.0.30u Software Release (.zip) | Software Downloads | Ruckus Wireless Support
support.ruckuswireless.com