Drag to reposition cover

Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)

custom90gt

Active Member
Nov 17, 2016
104
35
28
38
I believe this was discussed earlier in this thread and it turned out that the PoE and non-PoE versions use different components and the non-PoE boards miss some headers
Appreciate it, I tried searching this thread but didn't come up with an answer to that or the other question. Either way I figure it's a good switch for a great deal, especially since I plan on doing more 10GB.
 

Kartoff

New Member
Feb 17, 2017
22
5
3
44
Hello, I found some ICX7750 and thinking about to buy some... They look pretty good with 48x SFP+ and 6x QSFP instead of usually 4x :)
I have some VDX switches but no ICX so I have no experience with them... Will be nice to hear some impressions. Are they SFP capricious ? As I know ICX does not have locked ports right ? What is the normal power draw ?
BTW I already managed to download firmware from Ruckus site :)
Also I hope they can manage to handle like 7 Gbit multicast without problems... I am not so familiar with multicast and what I know from network admins who deal with it, not every switch is suitable for this purpose :)
Last but not least, what price to chase ?

Thank you :)
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,585
2,775
113
31
fohdeesha.com
Version 5.2 of tftpd-hpa (appears to be the current version for Ubuntu LTS 20.04, and potentially others) does not like having directory names with spaces in them, even when they are properly enclosed in quotes. It treats a directory with spaces in it as being 2 (or more) directories, and then throws an error. This is because it's just piping the Directory variable through a "wc -w" command, which is dumb, but whatever. Easily fixed. I removed the space in the "TFTP Content" directory and presto-magico everything works.

Thanks again to everyone who has contributed to this massive thread! Getting my 7250-24p up and running now.
thanks for the heads up, fixed: remove spaces from tftp dir name · Fohdeesha/lab-docu@2d24adc
 
  • Like
Reactions: NablaSquaredG

bpye

New Member
Apr 13, 2021
10
0
1
I know the ICX6450 has pretty limited IPv6 support, but is the DHCPv6 relay expected to work fully? I was wondering if I could use it to have a routed WAN -> ICX6450 -> Gateway by relaying the DHCP requests from the gateway to the WAN - but it looks like these packets are getting swallowed?

1/1/37 is the connection to the gateway, and 1/2/1 is the WAN. Would I need to add some additional route to make this work, or is the issue that PD requests are getting filtered? I see that 'Prefix Delegation Information' is included in 'show ipv6 dhcp-relay' - and I see a number of PD related DHCP relay commands in the command reference, however these commands don't actually appear to exist, for example 'ipv6 dhcp-relay maximum-delegated-prefixes'.

Code:
SSH@ICX6450-48P Router(config-if-e1000-1/1/37)#show ipv6 dhcp-relay                                                   
Current DHCPv6 Relay Agent State: Enabled
DHCPv6 enabled interface(s): e 1/1/37 
DHCPv6 Relay Agent Statistics:
 Total DHCPv6 Packets, Received:12, Transmitted:0 
 Received DHCPv6 Packets: RELEASE:0,RELAY_FORWARD:0,RELAY_REPLY:0 
                          OtherServertoClient:0,OtherClinettoServer:12
DHCPv6 Relay Prefix Delegation Notification:
 Maximum Delegated Prefixes Allowed:0 Current Delegated Prefixes:0
SSH@ICX6450-48P Router(config-if-e1000-1/1/37)#show ipv6 dhcp-relay interface ethernet 1/1/37
DHCPv6 Relay Information for interface e 1/1/37: 
Destinations:
 Destination                    OutgoingInterface 
 ff05::1:3                      e 1/2/1
 ff02::1:2                      e 1/2/1
Options:
 Interface-Id: No     Remote-Id:No
Prefix Delegation Information:
 Current:0 Maximum:0 AdminDistance:10
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,585
2,775
113
31
fohdeesha.com
I know the ICX6450 has pretty limited IPv6 support, but is the DHCPv6 relay expected to work fully? I was wondering if I could use it to have a routed WAN -> ICX6450 -> Gateway by relaying the DHCP requests from the gateway to the WAN - but it looks like these packets are getting swallowed?

1/1/37 is the connection to the gateway, and 1/2/1 is the WAN. Would I need to add some additional route to make this work, or is the issue that PD requests are getting filtered? I see that 'Prefix Delegation Information' is included in 'show ipv6 dhcp-relay' - and I see a number of PD related DHCP relay commands in the command reference, however these commands don't actually appear to exist, for example 'ipv6 dhcp-relay maximum-delegated-prefixes'.

Code:
SSH@ICX6450-48P Router(config-if-e1000-1/1/37)#show ipv6 dhcp-relay                                                 
Current DHCPv6 Relay Agent State: Enabled
DHCPv6 enabled interface(s): e 1/1/37
DHCPv6 Relay Agent Statistics:
Total DHCPv6 Packets, Received:12, Transmitted:0
Received DHCPv6 Packets: RELEASE:0,RELAY_FORWARD:0,RELAY_REPLY:0
                          OtherServertoClient:0,OtherClinettoServer:12
DHCPv6 Relay Prefix Delegation Notification:
Maximum Delegated Prefixes Allowed:0 Current Delegated Prefixes:0
SSH@ICX6450-48P Router(config-if-e1000-1/1/37)#show ipv6 dhcp-relay interface ethernet 1/1/37
DHCPv6 Relay Information for interface e 1/1/37:
Destinations:
Destination                    OutgoingInterface
ff05::1:3                      e 1/2/1
ff02::1:2                      e 1/2/1
Options:
Interface-Id: No     Remote-Id:No
Prefix Delegation Information:
Current:0 Maximum:0 AdminDistance:10
Is there a reason you're doing it on raw l2 ports and not on an addressed VE? How have you specified the relay destination? can't help much unless you share the config. I've been using dhcpv6 relay on a 6 series for years (to redundant dhcpd servers as well) without issue, but I'm not doing prefix delegation:

Code:
interface ve 10
ip address 192.168.1.1 255.255.255.0
ip helper-address 1 172.16.110.2
ip helper-address 2 172.16.110.3
ipv6 address xxx:xxx/64
ipv6 enable
ipv6 dhcp-relay destination zzz:xxx::2
ipv6 dhcp-relay destination zzz:xxx::3
ipv6 dhcp-relay include-options interface-id remote-id
ipv6 nd managed-config-flag
you're also showing 0 transmitted dhcpv6 packets, I dunno if this is part of the cause, or just a symptom of your ICX getting PD requests and intentionally not forwarding them for some config issue reason

Code:
telnet@ICX1(config-vif-10)#show ipv6 dhcp-rela
Current DHCPv6 Relay Agent State: Enabled
DHCPv6 enabled interface(s): ve 10
DHCPv6 Relay Agent Statistics:
Total DHCPv6 Packets, Received:23352, Transmitted:32847
Received DHCPv6 Packets: RELEASE:3,RELAY_FORWARD:0,RELAY_REPLY:11607
                          OtherServertoClient:0,OtherClinettoServer:11742
DHCPv6 Relay Prefix Delegation Notification:
Maximum Delegated Prefixes Allowed:512 Current Delegated Prefixes:0
on my 6610 the maximum delegated seems to default to 512, but yeah I can't change it at first glance, from any config level:

Code:
telnet@ICX1(config)#ipv6 dhcp-relay maximum-delegated-prefixes 50
Invalid input -> dhcp-relay maximum-delegated-prefixes 50
Type ? for a list
my guess is the command was only introduced to 7 series switches so the command won't work on the 6 series fw builds, the limit seems hardcoded (but indeed strange it would be limited to 0 on the 6450, not sure why they would include it as a configurable feature in that case)
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,585
2,775
113
31
fohdeesha.com
OK yeah, it's fastiron 6 series bug ****ery. The command exists and works on my lab FCX, which runs **the exact same bootloader and fw image as the 6610**:

Code:
telnet@ORAN-FCX(config)#ipv6 dhcp-relay maximum-delegated-prefixes
  DECIMAL   Maximum delegated prefixes, <0-512>
telnet@ORAN-FCX(config)#ipv6 dhcp-relay maximum-delegated-prefixes 50
telnet@ORAN-FCX(config)#
On a 6610 next to it with the bit-identical fw image booted:

Code:
telnet@ICX1(config)#ipv6 dhcp-relay maximum-delegated-prefixes 50
Invalid input -> dhcp-relay maximum-delegated-prefixes 50
Type ? for a list
probably worth reporting to ruckus on their user forum at least so it's documented, but who knows if it'll ever be addressed (I think they have one more bug & security release in them before these are officially End-Of-Support in Nov 2023). At the very least their documentation should be updated to state the command only works on the FCX (I've ran into a couple other commands like this, that exist in the base firmware but only become active when booted on an FCX, namely "ip ssh key-exchange-method dh-group14-sha1", which is completely nonsensical to me as the FCX runs an identical management plane vs the 6610, exact PPC part number, although less RAM I suppose )
 

bpye

New Member
Apr 13, 2021
10
0
1
My bad - relevant config:

Code:
vlan 1 name DEFAULT-VLAN by port
 router-interface ve 1
!
vlan 100 name wan by port
 untagged ethe 1/2/1 
!
vlan 101 by port
 untagged ethe 1/1/37 
!
ipv6 unicast-routing
interface ethernet 1/1/1
 inline power
!
interface ethernet 1/1/37
 ipv6 enable
 ipv6 dhcp-relay destination ff02::1:2 outgoing-interface ethernet 1/2/1
 ipv6 dhcp-relay destination ff05::1:3 outgoing-interface ethernet 1/2/1
 ipv6 dhcp-relay include-options interface-id remote-id           
 ipv6 nd managed-config-flag
!
interface ethernet 1/2/1
 ipv6 enable
 ipv6 nd suppress-ra
 speed-duplex 1000-full-master
!
interface ve 1
 ip address 192.168.1.10 255.255.255.0
No real reason I'm using the L2 interfaces...
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,585
2,775
113
31
fohdeesha.com
My bad - relevant config:

Code:
vlan 1 name DEFAULT-VLAN by port
router-interface ve 1
!
vlan 100 name wan by port
untagged ethe 1/2/1
!
vlan 101 by port
untagged ethe 1/1/37
!
ipv6 unicast-routing
interface ethernet 1/1/1
inline power
!
interface ethernet 1/1/37
ipv6 enable
ipv6 dhcp-relay destination ff02::1:2 outgoing-interface ethernet 1/2/1
ipv6 dhcp-relay destination ff05::1:3 outgoing-interface ethernet 1/2/1
ipv6 dhcp-relay include-options interface-id remote-id          
ipv6 nd managed-config-flag
!
interface ethernet 1/2/1
ipv6 enable
ipv6 nd suppress-ra
speed-duplex 1000-full-master
!
interface ve 1
ip address 192.168.1.10 255.255.255.0
No real reason I'm using the L2 interfaces...
Does your icx6450 have an ipv6 address it can source traffic from to these ff02::1:2/3 destinations? eg can you run a v6 ping from the 6450 to those addresses and get a reply? guess in the dark here, but maybe because you're doing dhcpv6 relay on an interface with no IPv6 address? (well, other than the local link). maybe try assigning an ipv6 address to 1/1/37 just to test, then se if the delegation limit increases, if you're relying on link-local addresses for relay source and destination perhaps it doesn't like that (although technically in a perfect world it shouldn't matter)
 

bpye

New Member
Apr 13, 2021
10
0
1
Does your icx6450 have an ipv6 address it can source traffic from to these ff02::1:2/3 destinations? eg can you run a v6 ping from the 6450 to those addresses and get a reply? guess in the dark here, but maybe because you're doing dhcpv6 relay on an interface with no IPv6 address? (well, other than the local link). maybe try assigning an ipv6 address to 1/1/37 just to test, then se if the delegation limit increases, if you're relying on link-local addresses for relay source and destination perhaps it doesn't like that (although technically in a perfect world it shouldn't matter)
I'll give that a try later today after work, I am thinking I should maybe try and find a 7250, or ideally a 7150 for the fanless mode but I don't see many. The 6450 was cheap and does do the basic stuff I need, and whilst I knew it didn't have full IPv6 support I missed that it didn't support PBR, which is more annoying...
 

tochnia

New Member
Mar 5, 2022
15
2
3
Not sure if anyone have tested noise levels before, but I got calibrated Audio Analyser and measured noise from my 6610 with B revision Power supplies.
With only one Power Supply connected to power noise measurement are:

56dB at 1 meter distance
50dB at 2 meter distance

This is too much noise for me to stay permanently in the same room with switch..

66dB at 1 meter distance - Boot noise
60dB at 2 meter distance - Boot noise

Also Power Consumption measured on my 6610-48P is between 100-116W with no PoE enabled ports.
 
Last edited:
  • Like
Reactions: MelnorMelvin

Rain

Active Member
May 13, 2013
266
104
43
I've still been playing around and trying to get stacking working with 10GBASE-T transceivers between two 7250-48p switches. Nothing I've tried seems to work. ...
I meant to follow up on my attempts to stack with 10GBASE-T transceivers a while back but I've been busy.

To anyone else thinking of stacking with 10GBASE-T transceivers: It doesn't appear to be possible on the ICX 7250 switches (and likely all other ICX switches as well). I imagine the desire to stack over CAT6 is rather limited, but hopefully this saves someone a headache.

It isn't a design limitation with the switches, it's an issue with the transceivers. The 10GBASE-T transceivers can only send/receive ethernet data/frames (IEEE 802.3) whereas fiber transceivers and/or DACs are raw data connections that can be used for other, non-ethernet connections (Fiber Channel, for example). As far as I can tell, this is true of every current 10GBASE-T transceiver on the market (understandably; they're RJ45 adapters, after all).

The ICX switches appear to negotiate via ethernet and then switch to communicating between stack members via a raw connection. This is why the interfaces appear to flap when attempting to stack with 10GBASE-T transceivers. The switches bring the stacking interfaces up, figure out who's on the other end, and then switch to a raw data connection. Since the transceivers don't support non-802.3 operation, they promptly disconnect. The switch the resets the interfaces and the cycle repeats.

One of my searches while trying to figure this out rendered this internal Brocade slide-deck on stacking: stack-unit - Brocade Community Forums (edit: Despite the title, this isn't a link to the Brocade forums; it's to "studylib.net") -- Notable slides that support this theory are 30 & 31.
 

MelnorMelvin

New Member
Apr 21, 2022
9
2
3
One more question. I am needing to pick up 2x ICX-FAN10-E for my ICX6610-48P-PE, and was hoping not to spend a fortune on fans.

Pretty much as cheap as I can find for an item actually tagged as ICX-FAN10-E is ~$49.50, some with a P/N of 80-1008308-02 on the factory box.

However, I did come across an item which looks physically identical with part number 60-1002274-03 (sticker on the bottom of the fans) at a much more reasonable ~$14.99, with bulk discounts (qty 2 at $13.49/ea).

Does anyone know if these two items are actually the same?
 

MelnorMelvin

New Member
Apr 21, 2022
9
2
3
I’ll be honest, I already bought two because I was afraid of missing out on the price. I’m just hoping they will work for the ICX6610.
 

eduncan911

The New James Dean
Jul 27, 2015
651
509
93
eduncan911.com
One more question. I am needing to pick up 2x ICX-FAN10-E for my ICX6610-48P-PE, and was hoping not to spend a fortune on fans.

Pretty much as cheap as I can find for an item actually tagged as ICX-FAN10-E is ~$49.50, some with a P/N of 80-1008308-02 on the factory box.

However, I did come across an item which looks physically identical with part number 60-1002274-03 (sticker on the bottom of the fans) at a much more reasonable ~$14.99, with bulk discounts (qty 2 at $13.49/ea).

Does anyone know if these two items are actually the same?
If you could remember to ping, ping us (or me) when you get the fans and let us know. I am in need of 1 or 2 as well.
 
  • Like
Reactions: MelnorMelvin

Mithril

Active Member
Sep 13, 2019
317
96
28
For the 6450 I seem to recall someone having instructions on how to change the PWM values used for low and high fan speed, but I can't find the post again :(
 

sdyoung

New Member
Apr 10, 2022
12
5
3
Assign one. That's the way I set up my switch, with a desktop plugged directly into the management port of the switch.

In Windows 11, type the start button and search for "view network connections". Right click Ethernet and double-click "Internet Protocol Version 4 (TCP/IPv4). You can then "Use the following IP address" and set whatever address you want there. Say 10.1.1.50 with a subnet mask of 255.255.255.0. Then follow fodheesas guide EXACTLY, setting a compatible IP:

factory set-default
setenv ipaddr 10.1.1.99
setenv netmask 255.255.255.0

#tell the switch the IP of your tftp server:
setenv serverip 10.1.1.50
setenv image_name ICX64xx/ICX64R08
...

Once you are done following the guide, set Win 11 back to "Obtain an IP Address automatically" and plug it back into your network.
@Lone Wolf, plugging the switch directly into my desktop, instead of another switch on my network, and manually assigning a new IP to the desktop did the trick. Was able to run update_uboot with no issues and am now on my way through the rest of the guide! Thanks again for the help man!