Drag to reposition cover

Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

danringer

New Member
Sep 2, 2022
1
0
1
First, thank you. Amazing info and great howtos at FCX / ICX6610 - Fohdeesha Docs

I'm hell bent on using the rear qsfp 4x10gbe to "stack" a 6610 to a 6450. I'd like to save the front 8x10gbe for lan use.

I can make it work by LAGP dynamic with 1/2/2-5 and since their mixed stacking really only extends the ports and doesn't do anything but aid in configuration, is there any harm in doing it this way over mixed stacking them properly?

Apologies if I botched any nomenclature, I'm rather new to managed switches.

Thank you,
-Dan
 

snausages

New Member
Sep 29, 2022
6
0
1
It's amateur hour at my place again...

So I picked up a 2nd power supply for the 7450 I'm using, but failed to notice the minor details of AC vs DC versions. When putting in the new (DC) psu, it seems to work fine and shows as healthy, but the syslog shows that mismatched power supplies are not supported (one AC and one DC).

Anyone know if it's "ok" and just not supported or are there other limitations with a DC vs AC? I can always just use it as a cold spare, but would rather have both in use if possible.

The interesting thing is the switch shows them both as AC units, but #1 is the DC model.

Code:
Power supply 1 (AC - PoE) present, status ok
        Model Number:   23-0000142-04
        Serial Number:  BLD2M49PJDT
        Firmware Ver:   32.65
Power supply 1 Fan Air Flow Direction:  Front to Back
Power supply 2 (AC - PoE) present, status ok
        Model Number:   23-0000142-02
        Serial Number:  BLD2M04MX87
        Firmware Ver:   32.67
Power supply 2 Fan Air Flow Direction:  Front to Back


Oct 05 18:55:34:I:System: Stack unit 1 POE  Power supply 1  with 748000 mwatts capacity is up
Oct 05 15:07:02:I:System: Stack unit 1 POE  Power supply 2  with 748000 mwatts capacity is up
Oct 05 15:07:01:I:System: Stack unit 1 have AC and DC PSUs, this is not supported
 

EK701

New Member
Feb 7, 2020
10
0
1
Does the ICX6610 support MPLS/VPLS? I’m not seeing anything that indicates that it does, but I’m just trying to confirm.

Thanks!
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,727
3,075
113
33
fohdeesha.com
It's amateur hour at my place again...

So I picked up a 2nd power supply for the 7450 I'm using, but failed to notice the minor details of AC vs DC versions. When putting in the new (DC) psu, it seems to work fine and shows as healthy, but the syslog shows that mismatched power supplies are not supported (one AC and one DC).

Anyone know if it's "ok" and just not supported or are there other limitations with a DC vs AC? I can always just use it as a cold spare, but would rather have both in use if possible.

The interesting thing is the switch shows them both as AC units, but #1 is the DC model.

Code:
Power supply 1 (AC - PoE) present, status ok
        Model Number:   23-0000142-04
        Serial Number:  BLD2M49PJDT
        Firmware Ver:   32.65
Power supply 1 Fan Air Flow Direction:  Front to Back
Power supply 2 (AC - PoE) present, status ok
        Model Number:   23-0000142-02
        Serial Number:  BLD2M04MX87
        Firmware Ver:   32.67
Power supply 2 Fan Air Flow Direction:  Front to Back


Oct 05 18:55:34:I:System: Stack unit 1 POE  Power supply 1  with 748000 mwatts capacity is up
Oct 05 15:07:02:I:System: Stack unit 1 POE  Power supply 2  with 748000 mwatts capacity is up
Oct 05 15:07:01:I:System: Stack unit 1 have AC and DC PSUs, this is not supported
well DC versus AC isn't a minor detail lol, the DC version only takes hardwired 48v DC input. If you've plugged it into the wall with a regular power cable it's not a DC supply
 

snausages

New Member
Sep 29, 2022
6
0
1
well DC versus AC isn't a minor detail lol, the DC version only takes hardwired 48v DC input. If you've plugged it into the wall with a regular power cable it's not a DC supply
Yeah, that's why I'm confused...unless the switch log reporting it is not supported is just a bug. Physically they are AC units.
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,727
3,075
113
33
fohdeesha.com
Yeah, that's why I'm confused...unless the switch log reporting it is not supported is just a bug. Physically they are AC units.
sounds like the eeprom data inside the PSU is corrupted, that's how the switch identifies them. if you're curious you can dump and paste here the eeprom data from each psu, when the switch is running and booted fully, over the serial port, press ctrl+y, let go, then press m, then enter. you should get an OS> console. run the following two commands

i2c read 32 0 256
i2c read 33 0 256

edit: jk, you're on a 7450 not a 6610. Dunno the i2c addresses for the 7450, they run full linux so the OS console is gunna be totally different. In the os console you can try "i2c dev" but I don't think it has any i2c commands
 
  • Like
Reactions: snausages

iamwardicus

New Member
Aug 2, 2019
8
8
3
fohdeesha - Thank you for the guide and all the help you provide for everyone! Got my 6610 switch up and running from a testing perspective. I LOVE the License ID you've setup for us to use XD. Once I get to modding fans so it's at an acceptable volume to have in my living room I'll work on setting up my opnSense PC with a 10g card and finishing up the homelab upgrade.
 
  • Like
Reactions: fohdeesha

kuleinc

New Member
Oct 1, 2022
3
0
1
Alright. Its been a hella long time since I took cisco classes in college. I did however manage to follow and get through the setup guide, very well done, thank you so much. This 24Port POE 6610 switch would have been a $160 brick without your help.

That being said I have an edge router mikrotik 305 upstairs for 10G connectivity and breakout for another 1G POE switch for cameras and a pc with a DAC cable. I am using mikrotik S+Rj10 SFP+ adapters to connect the cat 5e run in my wall from the brocade in my garage to my mikrotik upstairs. No dice unless I use a 1G port on the brocade, then it links up likity split at 1G speeds. I cannot get any auto negotiation when I plug the cable from the 1G port on brocade to a sfp+ port with an S+RJ10 adapter. These SFP+ adapters can only use auto negotiate according to their wiki. Am I missing something dumb on the brocade? Do I need to turn on auto negotiate speed for the front SFP+ ports? I do have my unraid server down there in the same rack plugged into one of the front brocade SFP+ ports with a 2 meter DAC cable and it just works at 10G speed when I plug it in automagically...

I cannot run a DAC or fiber cable from my garage where the rack and brocade and server are up to the third floor. I only have the CAT 5e cable in the wall. Its not an easy pull, the previous owner cut a lot of sheetrock holes to wire up the house. I wish I could just use a fiber cable, seems like they give better signal?

Also I may be doing something wrong on the mikrotik switch, in order to get it to link up to the 1G port on the brocade I have to first plug the FSP+ adapter into the 1G dumb switch that is next to it, and get it to link to that. then if I swap wires to the wire going down to the brocade they will connect at 1G speed. If I don't do the cable switcheroo they wont link up, and according to the wiki for these FSP+ adapters you can't just force set them to a lower speed like say 5G or 2.5G, in case they wont talk at 10G speeds. I would hope they just auto negotiate down, but I've waited for minutes with no link up. I also can't deffinitively find out the maximum distance for these FSP+ adapters but if they are 30 meters I should be ok, as its only 40-50 foot distance of cat 5e cable...
I was able to fix my problem with some SFP+ adapters for RJ45 that are rated at 80 meters, the ones I had were 30 meter units, which should work for the distance, but didn't.
 

jei

Active Member
Aug 8, 2021
150
77
28
Finland
I was able to fix my problem with some SFP+ adapters for RJ45 that are rated at 80 meters, the ones I had were 30 meter units, which should work for the distance, but didn't.
Same story. 30m adapters did not work between floors, got 2x 80m ones from fs.com and now it's full 10Gb over CAT6 (not CAT6A).
 

mach3.2

Active Member
Feb 7, 2022
128
84
28
Same story. 30m adapters did not work between floors, got 2x 80m ones from fs.com and now it's full 10Gb over CAT6 (not CAT6A).
Does the fs.com 80m SFP+ modules do NBASE-T?

I got a 10GTek 80m module that only support 1Gbps and 10Gbps, no in between.
 

kuleinc

New Member
Oct 1, 2022
3
0
1
I was able to get the 80meter adapters to work over cat 5e at 10gb speed. I just got the cheapest 80 meter modules for sfp rj45 I could find on amazon that listed multiple speed auto negotiation, worked right away at 10gb when I plugged them into the brocade and a mikrotik 305. The mikrotik 30meter modules wouldn’t work.

Heres a link to the cheap adapters I bought on amazon that did work:
cheap SFP 80m adapter on amazon
 
Last edited:

Craig Curtin

Member
Jun 18, 2017
101
20
18
59
Guys - anyone had issues with the 1/3 SFP+ ports on the front and Intel 540T (10G - 10BaseT) adapter ?

I am using a Dell SFP+ adapter in the Brocade and it is recognized and works on one of units - but on the other unit i have 3 of the SFP+ adapter going into the Intel 540Ts and they will not come online in ESXi 7 - just shows disconnected



Craig
 

JacobRhea

New Member
Feb 1, 2019
18
2
3
I've had a Brocade ICX-6610 for a couple years now and just recently bought a Ruckus R710. I'm running VyOS and am having issues assigning an IP to the R710 that is in the correct VLAN.
Code:
show conf
!
Startup-config data location is flash memory
!
Startup configuration:
!
ver 08.0.30tT7f3
!
stack unit 1
  module 1 icx6610-48p-poe-port-management-module
  module 2 icx6610-qsfp-10-port-160g-module
  module 3 icx6610-8-port-10g-dual-mode-module
!
!
!
!
vlan 1 name DEFAULT-VLAN by port
!
vlan 10 name Home by port
tagged ethe 1/1/48
untagged ethe 1/1/1
router-interface ve 10
!
vlan 20 name Servers by port
untagged ethe 1/1/25 to 1/1/32
router-interface ve 20
!
vlan 30 name Media by port
untagged ethe 1/1/33 to 1/1/34 ethe 1/3/1 to 1/3/4
router-interface ve 30
!
vlan 40 name Storage by port
untagged ethe 1/1/35 to 1/1/36 ethe 1/2/6
router-interface ve 40
!
vlan 99 name Management by port
untagged ethe 1/1/13 to 1/1/24
router-interface ve 99
!
vlan 100 name Guest by port
tagged ethe 1/1/48
router-interface ve 100
!
vlan 101 name IoT by port
tagged ethe 1/1/48
router-interface ve 101
!
!
!
!
!
aaa authentication web-server default local
aaa authentication enable default local
aaa authentication login default local
enable telnet authentication
enable aaa console
hostname invidia
ip dhcp-client disable
ip dns server-address 10.0.0.1
ip route 0.0.0.0/0 10.0.0.1
!
no telnet server
username user1 password .....
!
!
clock summer-time
clock timezone gmt GMT-05
!
!
ntp
disable serve
server 216.239.35.0
server 216.239.35.4
!
!
!
!
!
!
!
!
!
interface ethernet 1/1/47
route-only
ip address 10.0.0.2 255.255.255.252
!
interface ethernet 1/1/48
dual-mode  10
inline power
!
interface ve 10
ip address 10.0.10.1 255.255.255.0
ip helper-address 1 10.0.0.1
!
interface ve 20
ip address 10.0.20.1 255.255.255.0
ip helper-address 1 10.0.0.1
!
interface ve 30
ip address 10.0.30.1 255.255.255.0
ip helper-address 1 10.0.0.1
!
interface ve 40
ip address 10.0.40.1 255.255.255.0
ip helper-address 1 10.0.0.1
!
interface ve 99
ip address 10.0.99.1 255.255.255.0
ip helper-address 1 10.0.0.1
!
interface ve 100
ip address 10.0.100.1 255.255.255.0
ip helper-address 1 10.0.0.1
!
interface ve 101
ip address 10.0.101.1 255.255.255.0
ip helper-address 1 10.0.0.1
!
!
!
!
!
!
!
!
!
end
My modem is connect on port 1/1/47, and the R710 is on port 1/1/48. I would like for the R710 to have an IP of 10.0.0.3/24 but anything within that range will work. Currently I can not assign it an IP in that range at all. If I do it becomes no longer accessible.
 

kpfleming

Active Member
Dec 28, 2021
383
205
43
Pelham NY USA
10.0.0.3 is the broadcast address for your 10.0.0.2/255.255.255.252 subnet, which is in the routing table as reachable via 1/1/47. You've also set 1/1/47 as 'route-only' so it is not part of VLAN 1.

You will need to assign an address outside of that subnet to the R710, but then you'll also need a VE for VLAN 1 which makes that other subnet known to the ICX, or some other device outside of the ICX will have to do it.
 
Last edited:
  • Like
Reactions: fohdeesha

sleziak

New Member
Oct 13, 2022
1
0
1
I've recently bought a second-hand VDX6740 from eBay which was advertised as 48x10G and 4x40G ports, only to realize upon arrival that I need a license to use the 40G ports, I was really eager to play around with 40G in my home rack :confused:
Are licenses still being sold for this switch? What I found online was either out of stock or came with a massive price tag

Thank you in advance!