The PSU in my ICX7150-C12P died Is the "SL Power LB130S56K 56V 2.32 130W" still the recommended replacement?
Had the same problem! I suggest a GlobalTek PSU, details available in my earlier post here:The PSU in my ICX7150-C12P died Is the "SL Power LB130S56K 56V 2.32 130W" still the recommended replacement?
Would you be interested in a fully licensed VDX6740-48-F? Updated with the help of Fohdeesha ealier in the year. Had to replace the CF card in it. Also have a bunch of Brocade Gb SFP's for it.I have an LB6M that if flashed to the Brocade firmware awhile back. The switch has been working good for me, but I am looking to “upgrade”. – I’d really like to have activity lights on my switch. I have 18 10 SFP+ network devices, so the Brocade ICX6650 seems the most logical choice. I see a few on eBay, but none in the US, for less than $1,400. Is there anything else I should be looking at, or just wait to see something cheaper comes along?
no lldp enable ports ethe 1/1/1 to 1/1/2 ethe 1/2/1 to 1/2/4
- just... REALLY?!mac filter 1 permit any 589c.fc44.0000 ffff.ffff.0000
mac filter 2 permit any 589c.fc46.0000 ffff.ffff.0000
mac filter 3 permit any 0001.5c00.0000 ffff.ff00.0000
mac filter 32 deny any any
interface ethernet 1/1/1
mac filter-group 1 to 3 32
mac-learn-disable
spanning-tree root-protect
trust dscp
interface ethernet 1/1/2
mac filter-group 1 to 3 32
mac-learn-disable
spanning-tree root-protect
trust dscp
no lldp enable ports ethe 1/1/1 to 1/1/2
This is the experience you will get with one of the largest cable overbuilders in the United States. I've TOLD them I don't know HOW many times that their entire provisioning setup is just wrong and that is not how provisioning is supposed to work. Because the way they have it misconfigured means that it is literally IMPOSSIBLE for pretty much ANY CPE to NOT be capable of creating a misbalance. They are, idiotically, trying to combine a static MAC configuration (strict lease permit) with a dynamic MAC configuration (CPE MAC authentication) without understanding either or configuring either one even remotely correctly. Disclaimer: I am grossly oversimplifying and leaving out so many moving pieces.I have to ask - WTF service are you using that is forcing you to do this? I'd like to have a word with their engineers. However you're correct, this isn't really what fastiron was built for. There's some similar-ish mechanisms like what @ske4za posted above, but it's only going to get you 70% of the way there in your application. The proper router/service provider line (NetIron) will do complex MAC filtering and assignment like this quite happily, but obviously we're not running NetIron. That's one of my biggest pet peeves with brocade was the harsh market segmentation between fastiron and netiron - stuff like this is missing from fastiron not because the ASICs aren't capable of it, but because they didn't bother to think their "access switch" line would ever need it. Juniper is *much* better about this
lag neutron-10G-LAG dynamic id 6
ports ethernet 1/2/5 ethernet 1/2/10
primary-port 1/2/5
lacp-timeout short
deploy
port-name "neutron 10G LAG" ethernet 1/2/5
port-name "neutron 10G LAG" ethernet 1/2/10
!
lag neutron-mgmt dynamic id 10
ports ethernet 1/1/17 ethernet 1/1/19
primary-port 1/1/17
lacp-timeout short
deploy
port-name "neutron Management" ethernet 1/1/17
port-name "neutron Management" ethernet 1/1/19
!
lag proton-10G-LAG dynamic id 5
ports ethernet 1/2/4 ethernet 1/2/9
primary-port 1/2/4
lacp-timeout short
deploy
port-name "proton 10G LAG" ethernet 1/2/4
port-name "proton 10G LAG" ethernet 1/2/9
!
lag proton-mgmt dynamic id 9
ports ethernet 1/1/13 ethernet 1/1/15
primary-port 1/1/13
lacp-timeout short
deploy
port-name "proton Management" ethernet 1/1/13
port-name "proton Management" ethernet 1/1/15
SSH@brocore(config)#show lag proton-10G-LAG
Total number of LAGs: 11
Total number of deployed LAGs: 11
Total number of trunks created:11 (109 available)
LACP System Priority / ID: 1 / 748e.f8e7.b4b0
LACP Long timeout: 120, default: 120
LACP Short timeout: 3, default: 3
=== LAG "proton-10G-LAG" ID 5 (dynamic Deployed) ===
LAG Configuration:
Ports: e 1/2/4 e 1/2/9
Port Count: 2
Primary Port: 1/2/4
Trunk Type: hash-based
LACP Key: 20005
LACP Timeout: short
Deployment: HW Trunk ID 2
Port Link State Dupl Speed Trunk Tag Pvid Pri MAC Name
1/2/4 Up Blocked Full 10G 5 No 4 0 748e.f8e7.b4e4 proton 10G LAG
1/2/9 Up Forward Full 10G 5 No 4 0 748e.f8e7.b4e4 proton 10G LAG
Port [Sys P] [Port P] [ Key ] [Act][Tio][Agg][Syn][Col][Dis][Def][Exp][Ope]
1/2/4 1 1 20005 Yes S Agg Syn Col Dis Def No Ina
1/2/9 1 1 20005 Yes S Agg Syn Col Dis No No Ope
Partner Info and PDU Statistics
Port Partner Partner LACP LACP
System ID Key Rx Count Tx Count
1/2/4 1-0000.0000.0000 67 310800 8773259
1/2/9 65535-0002.c93b.6130 15 337450 8772796
# Start bonding driver with 2 bonds in LACP mode
modprobe bonding max_bonds=2 mode=4 lacp_rate=1 xmit_hash_policy=1
# Management network (1 Gig)
ip link set bond0 up
ifenslave bond0 enp10s0f0 enp10s0f1
# SAN VLAN network (10 Gig)
ip link set bond1 up
ifenslave bond1 enp9s0 enp9s0d1
ip addr add 10.1.4.3/24 dev bond1
ip link set dev bond1 mtu 9000
rich@proton ~ $ cat /proc/net/bonding/bond1
Ethernet Channel Bonding Driver: v5.8.8_1
Bonding Mode: IEEE 802.3ad Dynamic link aggregation
Transmit Hash Policy: layer3+4 (1)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0
802.3ad info
LACP rate: fast
Min links: 0
Aggregator selection policy (ad_select): stable
Slave Interface: enp9s0
MII Status: down
Speed: Unknown
Duplex: Unknown
Link Failure Count: 0
Permanent HW addr: 00:02:c9:3b:61:30
Slave queue ID: 0
Aggregator ID: 1
Actor Churn State: churned
Partner Churn State: churned
Actor Churned Count: 1
Partner Churned Count: 1
Slave Interface: enp9s0d1
MII Status: up
Speed: 10000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: 00:02:c9:3b:61:31
Slave queue ID: 0
Aggregator ID: 2
Actor Churn State: none
Partner Churn State: none
Actor Churned Count: 1
Partner Churned Count: 1
bond1: flags=5187<UP,BROADCAST,RUNNING,MASTER,MULTICAST> mtu 9000
inet 10.1.4.3 netmask 255.255.255.0 broadcast 0.0.0.0
inet6 fe80::202:c9ff:fe3b:6130 prefixlen 64 scopeid 0x20<link>
ether 00:02:c9:3b:61:30 txqueuelen 1000 (Ethernet)
RX packets 13347485 bytes 98321391464 (91.5 GiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 7774116 bytes 2785512572 (2.5 GiB)
TX errors 0 dropped 4 overruns 0 carrier 0 collisions 0
enp9s0: flags=6147<UP,BROADCAST,SLAVE,MULTICAST> mtu 9000
ether 00:02:c9:3b:61:30 txqueuelen 1000 (Ethernet)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 0 bytes 0 (0.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
enp9s0d1: flags=6211<UP,BROADCAST,RUNNING,SLAVE,MULTICAST> mtu 9000
ether 00:02:c9:3b:61:30 txqueuelen 1000 (Ethernet)
RX packets 13347485 bytes 98321391464 (91.5 GiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 7774116 bytes 2785512572 (2.5 GiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
SSH@brocore(config-if-e10000-1/2/4)#disable
SSH@brocore(config-if-e10000-1/2/4)#show int eth 1/2/4
10GigabitEthernet 1/2/4 is disabled, line protocol is down
Port down for 5 second(s)
Hardware is 10GigabitEthernet , address is 748e.f8e7.b4e4 (bia 748e.f8e7.b4e4)
Configured speed 10Gbit, actual unknown, configured duplex fdx, actual unknown
Configured mdi mode AUTO, actual unknown
Member of L2 VLAN ID 4, port is untagged, port state is DISABLED
BPDU guard is Disabled, ROOT protect is Disabled, Designated protect is Disabled
Link Error Dampening is Disabled
STP configured to ON, priority is level0, mac-learning is enabled
Openflow is Disabled, Openflow Hybrid mode is Disabled, Flow Control is config disabled, oper disabled
Mirror disabled, Monitor disabled
Mac-notification is disabled
Member of active trunk ports 1/2/4,1/2/9, primary port is 1/2/4
Member of configured trunk ports 1/2/4,1/2/9, primary port is 1/2/4
Port name is proton 10G LAG
MTU 10200 bytes, encapsulation ethernet
300 second input rate: 0 bits/sec, 0 packets/sec, 0.00% utilization
300 second output rate: 0 bits/sec, 0 packets/sec, 0.00% utilization
440558812 packets input, 645249133300 bytes, 0 no buffer
Received 13 broadcasts, 310855 multicasts, 440247944 unicasts
0 input errors, 0 CRC, 0 frame, 0 ignored
0 runts, 0 giants
474219943 packets output, 2764246386949 bytes, 0 underruns
Transmitted 2570307 broadcasts, 13721883 multicasts, 457927753 unicasts
0 output errors, 0 collisions
Relay Agent Information option: Disabled
Egress queues:
Queue counters Queued packets Dropped Packets
0 460711139 0
1 0 0
2 0 0
3 0 0
4 0 0
5 42 0
6 0 0
7 13508762 0
SSH@brocore(config-if-e10000-1/2/4)#no disable
SSH@brocore(config-if-e10000-1/2/4)#exit
SSH@brocore(config)#show lag proton-10G-LAG
Total number of LAGs: 11
Total number of deployed LAGs: 11
Total number of trunks created:11 (109 available)
LACP System Priority / ID: 1 / 748e.f8e7.b4b0
LACP Long timeout: 120, default: 120
LACP Short timeout: 3, default: 3
=== LAG "proton-10G-LAG" ID 5 (dynamic Deployed) ===
LAG Configuration:
Ports: e 1/2/4 e 1/2/9
Port Count: 2
Primary Port: 1/2/4
Trunk Type: hash-based
LACP Key: 20005
LACP Timeout: short
Deployment: HW Trunk ID 2
Port Link State Dupl Speed Trunk Tag Pvid Pri MAC Name
1/2/4 Up Blocked Full 10G 5 No 4 0 748e.f8e7.b4e4 proton 10G LAG
1/2/9 Up Blocked Full 10G 5 No 4 0 748e.f8e7.b4e4 proton 10G LAG
Port [Sys P] [Port P] [ Key ] [Act][Tio][Agg][Syn][Col][Dis][Def][Exp][Ope]
1/2/4 1 1 20005 Yes S Agg Syn Col Dis Def No Ina
1/2/9 1 1 20005 Yes S Agg Syn Col Dis Def No Ina
Partner Info and PDU Statistics
Port Partner Partner LACP LACP
System ID Key Rx Count Tx Count
1/2/4 1-0000.0000.0000 67 310800 8774191
1/2/9 1-0000.0000.0000 72 338405 8773725
SSH@brocore(config)#show int eth 1/2/4
10GigabitEthernet 1/2/4 is up, line protocol is down (LACP-BLOCKED)
Port down (LACP-BLOCKED) for 1 minute(s) 10 second(s)
Hardware is 10GigabitEthernet , address is 748e.f8e7.b4e4 (bia 748e.f8e7.b4e4)
Configured speed 10Gbit, actual 10Gbit, configured duplex fdx, actual fdx
Configured mdi mode AUTO, actual none
Member of L2 VLAN ID 4, port is untagged, port state is BLOCKING
BPDU guard is Disabled, ROOT protect is Disabled, Designated protect is Disabled
Link Error Dampening is Disabled
STP configured to ON, priority is level0, mac-learning is enabled
Openflow is Disabled, Openflow Hybrid mode is Disabled, Flow Control is config disabled, oper disabled
Mirror disabled, Monitor disabled
Mac-notification is disabled
Member of active trunk ports 1/2/4,1/2/9, primary port is 1/2/4
Member of configured trunk ports 1/2/4,1/2/9, primary port is 1/2/4
Port name is proton 10G LAG
MTU 10200 bytes, encapsulation ethernet
300 second input rate: 0 bits/sec, 0 packets/sec, 0.00% utilization
300 second output rate: 888 bits/sec, 0 packets/sec, 0.00% utilization
440558812 packets input, 645249133300 bytes, 0 no buffer
Received 13 broadcasts, 310855 multicasts, 440247944 unicasts
0 input errors, 0 CRC, 0 frame, 0 ignored
0 runts, 0 giants
474220007 packets output, 2764246395141 bytes, 0 underruns
Transmitted 2570307 broadcasts, 13721947 multicasts, 457927753 unicasts
0 output errors, 0 collisions
Relay Agent Information option: Disabled
Egress queues:
Queue counters Queued packets Dropped Packets
0 460711139 0
1 0 0
2 0 0
3 0 0
4 0 0
5 42 0
6 0 0
7 13508826 0
SSH@brocore(config)#show int eth 1/2/9
10GigabitEthernet 1/2/9 is up, line protocol is down (LACP-BLOCKED)
Port down (LACP-BLOCKED) for 1 minute(s) 13 second(s)
Hardware is 10GigabitEthernet , address is 748e.f8e7.b4e4 (bia 748e.f8e7.b4e9)
Configured speed 10Gbit, actual 10Gbit, configured duplex fdx, actual fdx
Configured mdi mode AUTO, actual none
Member of L2 VLAN ID 4, port is untagged, port state is BLOCKING
BPDU guard is Disabled, ROOT protect is Disabled, Designated protect is Disabled
Link Error Dampening is Disabled
STP configured to ON, priority is level0, mac-learning is enabled
Openflow is Disabled, Openflow Hybrid mode is Disabled, Flow Control is config disabled, oper disabled
Mirror disabled, Monitor disabled
Mac-notification is disabled
Member of active trunk ports 1/2/4,1/2/9, primary port is 1/2/4
Member of configured trunk ports 1/2/4,1/2/9, primary port is 1/2/4
Port name is proton 10G LAG
MTU 10200 bytes, encapsulation ethernet
300 second input rate: 0 bits/sec, 0 packets/sec, 0.00% utilization
300 second output rate: 872 bits/sec, 0 packets/sec, 0.00% utilization
268988020 packets input, 546972198876 bytes, 0 no buffer
Received 865724 broadcasts, 341082 multicasts, 267781214 unicasts
0 input errors, 0 CRC, 0 frame, 0 ignored
0 runts, 0 giants
485536726 packets output, 2720495805565 bytes, 0 underruns
Transmitted 532846 broadcasts, 8922831 multicasts, 476081049 unicasts
0 output errors, 0 collisions
Relay Agent Information option: Disabled
Egress queues:
Queue counters Queued packets Dropped Packets
0 476744109 0
1 0 0
2 0 0
3 0 0
4 0 0
5 138 0
6 0 0
7 8792479 0
SSH@brocore(config)#lag proton-10G-LAG
SSH@brocore(config-lag-proton-10G-LAG)#no deploy
Secondary port 1/2/9 disabled automatically upon LAG un-deploy to avoid potential loop
LAG proton-10G-LAG un-deployed successfully!
SSH@brocore(config-lag-proton-10G-LAG)#deploy
LAG proton-10G-LAG deployed successfully!
SSH@brocore(config-lag-proton-10G-LAG)#show lag proton-10G-LAG
Total number of LAGs: 11
Total number of deployed LAGs: 11
Total number of trunks created:11 (109 available)
LACP System Priority / ID: 1 / 748e.f8e7.b4b0
LACP Long timeout: 120, default: 120
LACP Short timeout: 3, default: 3
=== LAG "proton-10G-LAG" ID 5 (dynamic Deployed) ===
LAG Configuration:
Ports: e 1/2/4 e 1/2/9
Port Count: 2
Primary Port: 1/2/4
Trunk Type: hash-based
LACP Key: 20005
LACP Timeout: short
Deployment: HW Trunk ID 2
Port Link State Dupl Speed Trunk Tag Pvid Pri MAC Name
1/2/4 Up Blocked Full 10G 5 No 4 0 748e.f8e7.b4e4 proton 10G LAG
1/2/9 Up Forward Full 10G 5 No 4 0 748e.f8e7.b4e4 proton 10G LAG
Port [Sys P] [Port P] [ Key ] [Act][Tio][Agg][Syn][Col][Dis][Def][Exp][Ope]
1/2/4 1 1 20005 Yes S Agg Syn Col Dis Def No Ina
1/2/9 1 1 20005 Yes S Agg Syn Col Dis No No Ope
Partner Info and PDU Statistics
Port Partner Partner LACP LACP
System ID Key Rx Count Tx Count
1/2/4 1-0000.0000.0000 67 310800 8774919
1/2/9 65535-0002.c93b.6130 15 338598 8774452
Pay close attention on the show lagg: the disabled port is in "Default" state.Code:Port [Sys P] [Port P] [ Key ] [Act][Tio][Agg][Syn][Col][Dis][Def][Exp][Ope] 1/2/4 1 1 20005 Yes S Agg Syn Col Dis Def No Ina 1/2/9 1 1 20005 Yes S Agg Syn Col Dis No No Ope
To me it looks as there is a problem on the linux side.. The two intefaces have a different Aggregator ID, and one of the two is marked as "Churned"...
Def Indicates whether the port is using default link aggregation values. The port uses default values if it has not received link aggregation information through LACP from the port at the remote end of the link. This field can have one of the following values:
- Def - The port has not received link aggregation values from the port at the other end of the link and is therefore using its default link aggregation LACP settings.
Correct; this is a known bug due to (drumroll please) systemd having terminally broken behavior. I'm sure everyone is so very shocked by this.To me it looks as there is a problem on the linux side.. The two intefaces have a different Aggregator ID, and one of the two is marked as "Churned"...
Looking around, it seems a problem with Systemd: systemd LACP bond mess up aggregation ID for NICs but it has no solution provided.
No, there is no IOS-style dynamic neighbor support. Brocade/Arris' routing engine basically mirrors Quagga capabilities. (Might even just be Quagga, frankly, because...) If you have a set of known IP addresses you can configure them as a peer-group. i.e.I haven't been able to find anything like BGP Peer Groups for a subnet, but does fastiron support anything like BGP Dynamic Neighbors in IOS? Or does every BGP neighbor need to be a known IP configured ahead of time?
neighbor group1 peer-group; neighbor 10.10.10.10 peer-group group1; neighbor 10.10.10.11 peer-group group 1
.I am in envy at your powers of "The Insult"until I can get somebody there who doesn't struggle to operate velcro
I haven't tried to see the actual max on a 6450, but on all the other ICX's I've used it's a system setting, and 32 is just the default limit. Looks like the 6610 will let you configure the limit up to 512:
- Brocade developers, if you are reading this, you are idiots. And I mean that. The 6450 supports a maximum of 32 MAC filters. Not 1024. Not 128. 32. That means you do not even have enough filters for the ports on the switch. It's lazy, sloppy, and stupid.
ICX1#show default values | inc (mac-filter|Current)
System Parameters Default Maximum Current Configured
mac-filter-port 16 256 16 16
mac-filter-sys 32 512 32 32
So, this comes down to understanding the actual OS code as opposed to all the kids out there acting like they're the smartest ones in the room when they don't even know how to compile a kernel. When Linux spins up LAGs, it breaks the rules, period. Linux, because self-important basement dwelling children, does a lot of very stupid things which are all very wrong. And then demands everyone change for them.@infoMatt @rootwyrm
Unfortunately I do not have systemd on this Linux (Void Linux) and my LAGS, VLANs, etc. are configured entirely via a shell script (posted in my first problem post). It is just extremely odd that two identical systems (hardware and software) are acting completely differently, and they both worked fine for over a year on this and longer on other switches.
I am very much going to stand by my statement, because it's an absolutely idiotic default value by any measure. But yes, I missed where it can be bumped to 512. Which of course, is not what Brocade's documentation says, but at least it's closer to truth than Cisco's. According to Brocade's documentation, the 6250, 6450, and 6610 should all have a system limit of 1024. (Nevermind that it's deeply unusual to have to change system maximums off defaults...)I haven't tried to see the actual max on a 6450, but on all the other ICX's I've used it's a system setting, and 32 is just the default limit. Looks like the 6610 will let you configure the limit up to 512:
to change it would just be `system-max mac-filter-sys 512` in conf t modeCode:ICX1#show default values | inc (mac-filter|Current) System Parameters Default Maximum Current Configured mac-filter-port 16 256 16 16 mac-filter-sys 32 512 32 32
Why don't you just open a case with Ruckus and get it replaced? It has a lifetime warranty. I would try at least and worst case it will be denied.The PSU in my ICX7150-C12P died Is the "SL Power LB130S56K 56V 2.32 130W" still the recommended replacement?
Sadly, only if somebody figured out a way to get versions above 08.0.30u to run on 6450's.@rootwyrm: 08.0.95 is introducing MAC ACLs instead of MAC filters. Maybe that helps you a bit with your issue?