Drag to reposition cover

Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

NablaSquaredG

Bringing 100G switches to homelabs
Aug 17, 2020
1,827
1,206
113
I still hope that @fohdeesha will do some magic and come up with a guide that allows the third scenario (stacking only with the 40G breakout ports) :D
 

DerTom

New Member
Mar 30, 2021
13
1
3
Hi!

During configuration of my new ICX6610 I do get the following error:

ICX Boot Code Version 10.1.00 (grz10100)
Enter 'a' to stop at memory test
Enter 'b' to stop at boot monitor
.$
ICX Boot Code Version 10.1.00 (grz10100)
Enter 'a' to stop at memory test
Enter 'b' to stop at boot monitor
BOOT INFO: load monitor from boot flash, cksum = 71f1
BOOT INFO: verify flash files.........
error in reading i2c device 1
eeprom_read: reading i2c device 1 failed
error in writing i2c device 1, error code: 5
eeprom_write: writing i2c device 1 failed
error in reading i2c device 1
ONBOARD_EEPROM read failure 1.
Backplane MAC address is not configured.
Use default 0004.80a0.4000
BOOT INFO: load image from primary copy...

error in reading i2c device 1, error code 7
eeprom_read: reading i2c device 1 failed
error in writing i2c device 1, error code: 5
eeprom_write: writing i2c device 1 failed
platform type = 12
PCIE-1 LTSSM status: 22
PCIE Switch status: 0
..............................
Firmware integrity checksum passed
.......
Starting Main Task .------------------------------------------------------------------
M:9 L:0 - chow_led_ch_mux_enable, error in seting up mux
------------------------------------------------------------------
M:9 L:0 - chow_led_ch_mux_enable, error in seting up mux
..CPSS DxCh Version: cpss3.4p1 release
------------------------------------------------------------------
M:9 L:0 - PS EEPROM I2C Open: i2c cmd failed, error 7, ps 1
------------------------------------------------------------------
M:9 L:0 - PS EEPROM Offset Read: eeprom mux open error, ps 2
Fatal Error: No FANTRAY fan is present or fan has failed
System is shutting down!!!
Rebooting(0)...
The device is on a bootloop...

The led of the power supply is on but the fan is still 'spinning'!? As there is the message 'No FANTRAY fan present' I assume there is something wrong with the fan... Is this correct?

And most of all which way do I get the device to boot properly?

Kind regards,

tom
 

frogtech

Well-Known Member
Jan 4, 2016
1,520
299
83
36
Checking in after a while, has anyone made a final determination on the best fans for icx7250 24 port poe? I've tried a couple diff but they're still the loudest item in my rack. The hard part is keeping the switch below 60c still. I think the best solution someone posted was using a heat pipe and some extra heatsink attached.
 
  • Like
Reactions: kpfleming

MannyLNJ

New Member
Mar 19, 2023
22
9
3
I recently acquired a FCX648S-HPOE and need to know what is the correct part to get to add a QSFP+ Port so I can add 2.5GB Ethernet ports? I already purchased a XFP module which I believe is the wrong item
 

DerTom

New Member
Mar 30, 2021
13
1
3
Hi!

During configuration of my new ICX6610 I do get the following error:



The device is on a bootloop...

The led of the power supply is on but the fan is still 'spinning'!? As there is the message 'No FANTRAY fan present' I assume there is something wrong with the fan... Is this correct?

And most of all which way do I get the device to boot properly?

Kind regards,

tom
I do have replaced the power supply but there is still this error and the device on a bootloop... Mr. Google doesn't seem to know how to get rid of this.

If you have any hints, let me know, please.
 

msg7086

Active Member
May 2, 2017
428
150
43
37
Just bought a 6450-48p on ebay with a $100 offer. They seem to have more than 100 units available. I'm not linking to it to reduce STH effect but it should be very easy to find. In case anyone is looking to buy one.
 
  • Like
Reactions: itronin

oxoyoz

New Member
Aug 20, 2021
1
0
1
Hi I got an ICX6610-48 recently and want to know:

1. Is it beneficial to upgrade its DDR2 memory from 512M to 1G/2G stick? These memory sell for 5 bucks on Ebay including shipping. But I am not sure it’s better used for a beer instead.

2. How much idle power can it reduce if I remove its 40gbps QSFP module on its back? I don’t have a use case for it yet. Granted I would lose the MGMT ports too but after initial setup I can SSH on the front ports to access it. Trying to save on utility bills a bit.

Thanks.
 

NablaSquaredG

Bringing 100G switches to homelabs
Aug 17, 2020
1,827
1,206
113
These memory sell for 5 bucks on Ebay including shipping.
Are you sure? iirc the DIMMs are ECC SODIMMs and they're very hard to come by (I contemplated a memory upgrade for my SX6036)
NVM, according to @fohdeesha they're RDIMMs, and some pages ago he posted a link to this offer Centon Lot of 2 RD703G01 2GB PC2-5300 Reg ECC CL5 DDR2 667Mhz 1 Rank SODIMM 6-2 | eBay


2. How much idle power can it reduce if I remove its 40gbps QSFP module on its back? I don’t have a use case for it yet. Granted I would lose the MGMT ports too but after initial setup I can SSH on the front ports to access it. Trying to save on utility bills a bit.
Just a wild guess, but probably not much (if any power saving at all). Maybe it would make more sense to get an ICX6450-48 and sell the ICX6610?
 
Last edited:

juju

Member
Sep 29, 2021
38
2
8
I'd like to start hosting a website from my homelab. I am planning to put all publicly available websites into a separate vlan, then block it off using acl rules. Is this the right approach ? I'd like help with the acl rules . What should it be? I am also looking at using tailscale but want to get the vlan segmented off first. I have an icx7250.

Thanks
 

msg7086

Active Member
May 2, 2017
428
150
43
37
I'd like to start hosting a website from my homelab. I am planning to put all publicly available websites into a separate vlan, then block it off using acl rules. Is this the right approach ? I'd like help with the acl rules . What should it be? I am also looking at using tailscale but want to get the vlan segmented off first. I have an icx7250.

Thanks
I wouldn't do this as this sounds a bit overkill, but you definitely can. I would rather put all websites (assuming VMs) behind a front end gateway, and do ACL/proxy on the gateway.
 

juju

Member
Sep 29, 2021
38
2
8
I wouldn't do this as this sounds a bit overkill, but you definitely can. I would rather put all websites (assuming VMs) behind a front end gateway, and do ACL/proxy on the gateway.
Can you elaborate a bit? What do you mean by a front end gateway? Traefik? HAProxy? Jump server? It seem rather cleaner to just put them all in their own vlan and block them off from the rest of the home network, no? Happy to learn the merits of what you are proposing.
 

msg7086

Active Member
May 2, 2017
428
150
43
37
HAProxy or something like that (I use nginx). Do you announce static IP range through your ISP? Because if you only have 1 IP and serve multiple websites I imagine you'd use some kind of front end proxy to route traffic?
 

Marc_

Chief breaker of switches
Jul 22, 2022
97
16
8
Morning all. Have a strange issue with a 6450-48P. Powering a few things via PoE but I'm having random disconnects.

PoE: Power disabled on port 2/1/38 because of PD disconnection.

PoE: Power enabled on port 2/1/38.

PoE: Power disabled on port 2/1/38 because of PD disconnection.

PoE: Power disabled on port 2/1/40 because of PD disconnection.

PoE: Power enabled on port 2/1/38.

PoE: Power enabled on port 2/1/40.

Anyone seen this before?
 

MikeSpears

New Member
Feb 8, 2016
14
1
3
31
If anyone needs one of the Dell 40G QSFP+ to 4x10G SFP+ 3M DAC Splitter Cable DAC-QSFP-4SFP-10G-3M 27GG5 cables let me know, I've got one I don't need and am willing to let it go for $50 shipped anywhere in the US. Ended up swapping it with some shorter ones purchased off Amazon.
 

gr2659

New Member
Feb 14, 2020
15
10
3
So... I'm struggling trying to use my ICX6610s with some 40G Cisco NICs. Hoping someone has gone through this and can help?

I have (2) ICX6610s on 08.0.30uT7f3. They were stacked. I just broke the stack as part of my troubleshooting.

I'm trying get a 40G link up between ports 1/2/1 or 1/2/6 of my ICX6610s and my Cisco 40G NICs (I have both an mlom and vic version of the 40G NICs.) on a couple of C240-M4 servers. I have tried both NICs on (2) servers and cannot get a link to come up. The server shows the NICs and shows that it recognizes the optics and they show as "supported". They being (3) different QSFP setups... I have a Brocade branded 40G QSFP, a Cisco branded 40G QSFP and a handful of the KAIAM QSFPs connected with fiber. I've used both DACs to stack my 6610s using those same ports so I know the ports and DACs work.

Not being able to get these to come up on either switch, I pulled the 2nd out of the stack, reset the config on one to factory settings and removed the stacking configuration. The results are the same...

Code:
telnet@brocade48-1#sh int eth 1/2/6
40GigabitEthernet1/2/6 is down, line protocol is down
  Port down for 8 minute(s) 49 second(s)
  Hardware is 40GigabitEthernet, address is 748e.f893.efe6 (bia 748e.f893.efe6)
  Interface type is 40Gig Fiber
  Configured speed 40Gbit, actual unknown, configured duplex fdx, actual unknown
  Configured mdi mode AUTO, actual unknown
  Member of 3 L2 VLANs, port is tagged, port state is BLOCKING
  BPDU guard is Disabled, ROOT protect is Disabled, Designated protect is Disabled
  Link Error Dampening is Disabled
  STP configured to ON, priority is level0, mac-learning is enabled
  Openflow is Disabled, Openflow Hybrid mode is Disabled,  Flow Control is enabled
  Mirror disabled, Monitor disabled
  Mac-notification is disabled
  Not member of any active trunks
  Not member of any configured trunks
  No port name
  MTU 1500 bytes, encapsulation ethernet
  300 second input rate: 0 bits/sec, 0 packets/sec, 0.00% utilization
  300 second output rate: 0 bits/sec, 0 packets/sec, 0.00% utilization
  0 packets input, 0 bytes, 0 no buffer
  Received 0 broadcasts, 0 multicasts, 0 unicasts
  0 input errors, 0 CRC, 0 frame, 0 ignored
  0 runts, 0 giants
  0 packets output, 0 bytes, 0 underruns                         
  Transmitted 0 broadcasts, 0 multicasts, 0 unicasts
  0 output errors, 0 collisions
  Relay Agent Information option: Disabled
Screen Shot 2023-04-06 at 2.41.08 PM.png

Anyone have any thoughts on what I might be missing?
 

thegardentool

New Member
May 20, 2016
2
0
1
39
Could anybody direct me to some good resources to guide me on best practices of using an L3 switch along with a firewall appliance? My Asus N router is finally starting to give me some trouble and for the short term my plan is to use the J6413 box I ordered earlier this week to branch out into something a bit more advanced with OPNsense while using the router in AP mode. Longer term I've been debating on just taking the plunge on a C12P along with a Ruckus AP so I could also expand out to some security cameras later. I had looked at the switch and AP a couple years ago it just wasn't priority and was hopeful that UBNT would have a bit more friendly SOHO non rack solutions come out as I liked the idea of having network and video integrated into one place, but alas the Dream Router and Dream Wall just weren't the solutions for me.
 

juju

Member
Sep 29, 2021
38
2
8
HAProxy or something like that (I use nginx). Do you announce static IP range through your ISP? Because if you only have 1 IP and serve multiple websites I imagine you'd use some kind of front end proxy to route traffic?
I am not asking about how to route external traffic to the internal webserver. I am asking if it makes sense to isolate that webserver into its own vlan ( and all other web facing servers ), and use acls to block traffic to other internal parts. I wanted advice on how to structure that acl. I am not sure how to setup that acl.
 

CHANABRA

Member
Dec 26, 2021
37
8
8
Hello all just dropping a line, thank you all for all the posts and information I can absorb... I appreciate it!!
Also, I just sent a message requesting license keys

Grabbed a ICX6610-24E for $150 fully functional....seemed like a nobrainer compared to the CRS328-24P when I need full L3....and then some.
hoping I can figure a way between replacing thermal paste and optimizing cooling to get this thing a bit more silent