Drag to reposition cover

Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

jd.developer

New Member
Jan 12, 2020
8
2
3
that message happens when the RPM reported by the PSU fan is not within the normal operating threshold, so it's either failing and spinning too slow, or it's RPM reporting/wire is busted altogether
Thank you. I ended up getting another PSU from the seller and it worked fine. Can the fan be repaired on a defective PSU?
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,728
3,076
113
33
fohdeesha.com
Thank you. I ended up getting another PSU from the seller and it worked fine. Can the fan be repaired on a defective PSU?
yeah just open up the PSU and remove the fan, get the part number off of it and buy another one, should be about $10. you'll have to splice the wires as it's not a standard pinout/connector if I remember right
 

iotapi322

Member
Sep 8, 2017
66
14
8
48
Ugh I hate to ask this question, but.... are there any special commands to enable the sfp+ ports on the front of the ICX 6610-48P? Just got a 6610 off of ebay and I went through the guide and updated the firmware and the Poe Firmware to the latest versions - setup the system just like the guide suggested.

However when I connect any of my dac cables I don't get any link light. They are connected to a Intel dual port sfp+ card. I'm using a cisco DAC cable but I've also tried this DAC cable from AWS ( 10Gtek 10G SFP+ DAC Cable - 10GBASE-CU Passive Direct Attach Copper Twinax SFP Cable for Cisco SFP-H10GB-CU3M, Ubiquiti, D-link, Supermicro, Netgear, Mikrotik, ZTE Devices, 3m, 1pack)

The cisco DAC cable seemed to work with other switches.... I am a newbie when it comes to 10G networking so this could clearly be a problem I've created.

running the show media command

Code:
Port 1/2/1:  Type : EMPTY
Port 1/2/2:  Type : EMPTY
Port 1/2/3:  Type : EMPTY
Port 1/2/4:  Type : EMPTY
Port 1/2/5:  Type : EMPTY
Port 1/2/6:  Type : EMPTY
Port 1/2/7:  Type : EMPTY
Port 1/2/8:  Type : EMPTY
Port 1/2/9:  Type : EMPTY
Port 1/2/10:  Type : EMPTY
Port 1/3/1:  Type : 10GE Twinax   3m (SFP +)
Port 1/3/2:  Type : EMPTY
Port 1/3/3:  Type : EMPTY
Port 1/3/4:  Type : EMPTY
Port 1/3/5:  Type : EMPTY
Port 1/3/6:  Type : EMPTY
Port 1/3/7:  Type : EMPTY
Port 1/3/8:  Type : 10GE Twinax   5m (SFP +)
seems to show something is plugged in.

Now running the command
Code:
show media validation
Code:
SSH@brocade01#show media validation

Port       Supported Vendor               Type
----------------------------------------------------------------------
1/3/1      Yes       OEM                   Type  : 10GE  Passive Twinax  3m (SFP +) (Not supported)
1/3/8      Yes       CISCO-TYCO            Type  : 10GE  Passive Twinax  5m (SFP +) (Not supported)
Is this telling me the DAC cables I have are not compatible?
 

kapone

Well-Known Member
May 23, 2015
1,095
642
113
yeah just open up the PSU and remove the fan, get the part number off of it and buy another one, should be about $10. you'll have to splice the wires as it's not a standard pinout/connector if I remember right
You remember right. It's not.
 
  • Like
Reactions: fohdeesha

fohdeesha

Kaini Industries
Nov 20, 2016
2,728
3,076
113
33
fohdeesha.com
Ugh I hate to ask this question, but.... are there any special commands to enable the sfp+ ports on the front of the ICX 6610-48P? Just got a 6610 off of ebay and I went through the guide and updated the firmware and the Poe Firmware to the latest versions - setup the system just like the guide suggested.

However when I connect any of my dac cables I don't get any link light. They are connected to a Intel dual port sfp+ card. I'm using a cisco DAC cable but I've also tried this DAC cable from AWS ( 10Gtek 10G SFP+ DAC Cable - 10GBASE-CU Passive Direct Attach Copper Twinax SFP Cable for Cisco SFP-H10GB-CU3M, Ubiquiti, D-link, Supermicro, Netgear, Mikrotik, ZTE Devices, 3m, 1pack)

The cisco DAC cable seemed to work with other switches.... I am a newbie when it comes to 10G networking so this could clearly be a problem I've created.

running the show media command

Code:
Port 1/2/1:  Type : EMPTY
Port 1/2/2:  Type : EMPTY
Port 1/2/3:  Type : EMPTY
Port 1/2/4:  Type : EMPTY
Port 1/2/5:  Type : EMPTY
Port 1/2/6:  Type : EMPTY
Port 1/2/7:  Type : EMPTY
Port 1/2/8:  Type : EMPTY
Port 1/2/9:  Type : EMPTY
Port 1/2/10:  Type : EMPTY
Port 1/3/1:  Type : 10GE Twinax   3m (SFP +)
Port 1/3/2:  Type : EMPTY
Port 1/3/3:  Type : EMPTY
Port 1/3/4:  Type : EMPTY
Port 1/3/5:  Type : EMPTY
Port 1/3/6:  Type : EMPTY
Port 1/3/7:  Type : EMPTY
Port 1/3/8:  Type : 10GE Twinax   5m (SFP +)
seems to show something is plugged in.

Now running the command
Code:
show media validation
Code:
SSH@brocade01#show media validation

Port       Supported Vendor               Type
----------------------------------------------------------------------
1/3/1      Yes       OEM                   Type  : 10GE  Passive Twinax  3m (SFP +) (Not supported)
1/3/8      Yes       CISCO-TYCO            Type  : 10GE  Passive Twinax  5m (SFP +) (Not supported)
Is this telling me the DAC cables I have are not compatible?

it's probably not licensed, 6th post in the thread https://forums.servethehome.com/ind...rful-10gbe-40gbe-switching.21107/#post-196476
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,728
3,076
113
33
fohdeesha.com
Thank you for the feedback. Thought I was doing something wrong or I missed something. I know this is an enterprise switch so I shouldn't expect it to be quiet. :)

you can unplug all but one of the fans internally if you want it quieter (or replace the fans). If I recall correctly the 48 port PoE has THREE fans, intended to cool it if it's putting out hundreds of watts of PoE load, which you won't be doing
 

infoMatt

Active Member
Apr 16, 2019
222
100
43
Yes, I think I just came up with that hypothesis.
Code:
SSH@brocade01#show license
License record empty
You can verify it by forcing the interface (on both ends!!) at 1000-fd, so it shouldn't require any licence...

EDIT: I've verified on the datasheed posted on the first page... yes, 1000-fd is free, 10000-fd requires an extra licence; for the purpose of testing the cables, you can go ahead, albeit at a "mere" 1G. ;)
 

iotapi322

Member
Sep 8, 2017
66
14
8
48
ok so i am licensed now... and all the licenses now say Status as Active.
The ports on the switch are lit now as well...
however the show media validation still shows the "not supported" at the end of the line

Code:
SSH@brocade01>show media validation

Port       Supported Vendor               Type
----------------------------------------------------------------------
1/3/1      Yes       OEM                   Type  : 10GE  Passive Twinax  3m (SFP +) (Not supported)
1/3/8      Yes       CISCO-TYCO            Type  : 10GE  Passive Twinax  5m (SFP +) (Not supported)

the ubuntu computer (running 20.04 beta... i know iknow) is running a cisco dual VIC card



Code:
      resources: irq:17 memory:f0700000-f0707fff memory:f0708000-f0709fff
  *-network
       description: Ethernet interface
       product: VIC Ethernet NIC
       vendor: Cisco Systems Inc
       physical id: 0
       bus info: pci@0000:0b:00.0
       logical name: enp11s0
       version: a2
       serial: 00:22:bd:ea:9a:cd
       capacity: 10Gbit/s
       width: 64 bits
       clock: 33MHz
       capabilities: msi msix pm pciexpress bus_master cap_list ethernet physical fibre 10000bt-fd
       configuration: autonegotiation=off broadcast=yes driver=enic driverversion=2.3.0.53 firmware=4.1(0.333) latency=0 link=no multicast=yes port=fibre
       resources: irq:18 memory:f0600000-f0607fff memory:f0608000-f0609fff

even when i try to set the interface up it comes back with no carrier

Code:
ubuntutest:~$ sudo ip link set dev enp10s0 up

ubuntutest:~$ ip address show dev enp10s0
3: enp10s0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN group default qlen 1000
    link/ether 00:22:bd:ea:9a:cc brd ff:ff:ff:ff:ff:ff
Once again, I'm a newbie at this 10G network stuff, so it's probably the interface between the chair and the keyboard causing the issue.
 

camper8080

New Member
Jul 2, 2019
5
0
1
you can unplug all but one of the fans internally if you want it quieter (or replace the fans). If I recall correctly the 48 port PoE has THREE fans, intended to cool it if it's putting out hundreds of watts of PoE load, which you won't be doing
I did remove two fans but the management thermal plane reached 80C. The fan threshold was still in speed 1 but I stopped and went back to 3 fans. Maybe it would've stabilized if I gave it a little more time. Only activity was console access to monitor temps. The ambient temp in the room was around 70F. I plan on keeping it in the basement which is cooler but summers are hot and humid and forced to run a dehumidifier so I'm a little worried. I also have a SuperMicro E300-9D-4CN8TP with 3 fans that are louder than I want.

If I replace the fans, is there a particular brand/model everyone is using?

Thank you!
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,728
3,076
113
33
fohdeesha.com
the "not supported" thing just means officially, so support has something to blame if you file an issue under a support contract. These things will link up up with literally anything, I've even stuck in fibrechannel optics and it just clocked them down and ran happily. I suspect you have a configuration issue somewhere. Can you post the output of "show run?"

edit: also the output of show int br e 1/3/1 and show int br e 1/3/8
 

iotapi322

Member
Sep 8, 2017
66
14
8
48
I tried moving to ports 1/3/1 and 1/3/2


show run

Code:
SSH@brocade01>show run
Current configuration:
!
ver 08.0.30tT7f3
!
stack unit 1
  module 1 icx6610-48p-poe-port-management-module
  module 2 icx6610-qsfp-10-port-160g-module
  module 3 icx6610-8-port-10g-dual-mode-module
!
!
!
!
vlan 1 name DEFAULT-VLAN by port
 router-interface ve 1
!
!
!
!
!
aaa authentication web-server default local
aaa authentication enable default local
aaa authentication login default local
hostname brocade01
ip dhcp-client disable
ip dns server-address 10.0.0.131
!
no telnet server
username snoby password .....
snmp-server community ..... ro
!
!
clock summer-time
clock timezone gmt GMT-05
!
!
ntp
 disable serve
 server 10.0.0.1
!
!
!
!
!
!
!
!
!
interface ethernet 1/3/1
 speed-duplex 10G-full
!
interface ethernet 1/3/2
 speed-duplex 10G-full
!
interface ethernet 1/3/3
 speed-duplex 10G-full
!
interface ethernet 1/3/4
 speed-duplex 10G-full
!
interface ethernet 1/3/5
 speed-duplex 10G-full
!
interface ethernet 1/3/6
 speed-duplex 10G-full
!
interface ethernet 1/3/7
 speed-duplex 10G-full
!
interface ethernet 1/3/8
 speed-duplex 10G-full
!
interface ve 1
 ip address 10.0.0.3 255.255.255.0
!
!
!
!
!
!
!
!
!
end
commands outputs from show int br e 1/3/x


Code:
SSH@brocade01>show int br e 1/3/1

Port       Link    State   Dupl Speed Trunk Tag Pvid Pri MAC             Name
1/3/1      Up      Forward Full 10G   None  No  1    0   748e.f893.efb0
SSH@brocade01>show int br e 1/3/2

Port       Link    State   Dupl Speed Trunk Tag Pvid Pri MAC             Name
1/3/2      Up      Forward Full 10G   None  No  1    0   748e.f893.efb0
Maybe i need to change the cisco card ...
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,728
3,076
113
33
fohdeesha.com
OK yeah, the brocade is perfectly fine, your ubuntu install just doesn't like the card or isn't configured properly, no clue which. never seen or touched those cisco cards, I keep it simple with mellanox
 

csementuh

Member
Oct 7, 2019
36
10
8
Pittsburgh, PA
Anyone have a dead 6450 that still had working POE? My 48 port 6450P has a burnt POE board and I need a replacement.

Or I'll sell this 48P switch OR trade for a 24P with working POE. I replaced my main switch with a ICX7250-48P but need something with POE for my garage. Thanks!
 

Wolfstar

Active Member
Nov 28, 2015
159
83
28
48
Anyone have a dead 6450 that still had working POE? My 48 port 6450P has a burnt POE board and I need a replacement.

Or I'll sell this 48P switch OR trade for a 24P with working POE. I replaced my main switch with a ICX7250-48P but need something with POE for my garage. Thanks!
Do you strictly speaking need the 10G uplink for the garage, or could you get away with gigabit? 6430s are absurdly cheap these days, so that might be a option. I don't know as I'd try getting one for just the PoE board as they likely don't match up right, but if all you need is power and not throughput...
 
  • Like
Reactions: fohdeesha

Roelf Zomerman

Active Member
Jan 10, 2019
147
27
28
blog.azureinfra.com
I plan on keeping it in the basement which is cooler but summers are hot and humid and forced to run a dehumidifier so I'm a little worried.
If I replace the fans, is there a particular brand/model everyone is using?
I run the Sunon KDE1204PKV3-MS ones, I have all 3 in there, and I live in Dubai. It survived last summer where the ambient 100+ F room temp was no problem at all for the switch..
 
  • Like
Reactions: fohdeesha

fohdeesha

Kaini Industries
Nov 20, 2016
2,728
3,076
113
33
fohdeesha.com
Great post! Thanks for sharing. I've been racking my brain over what switch to get for my new homelab and your post really helped.

I meant to pick up an ICX-7250, but in my tiredness I accidentally bought (and paid for) an ICX-7450-48 for $200 shipped... is this going to be a problem for some reason?

edit: link to the actual switch Brocade ICX 7450-48 48-Port Gigabit Switch ICX7450-48 | eBay
it's a nice switch, but compared to the icx7250 you meant to buy it will be louder, draw more power, and currently only has half the 10gbE ports (4). if you want the 8 ports of 10gbe the 7250 has, you'll have to buy another 10gb module Brocade ICX7400-4X10GF ICX 7450 4-port 10-Gigabit SFP SFP+ Module | eBay
 
  • Like
Reactions: Noppadet