Drag to reposition cover

Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)

fohdeesha

Kaini Industries
Nov 20, 2016
2,139
2,045
113
30
fohdeesha.com
(emphasis mine)

I plan on stacking two ICX6610s in some form of extended/ring mode (not failover). As I understand it, I can only use PoE ports on one device if not in failover/master-slave mode.

Could someone use two ICX6610 in this configuration, with a single ICX6450 as part of the stack?

Had the idea that I could use an ICX6450 in the office, and possibly stack it across 2x10G ports - one to each ICX6610. But if one 6610 reboots, I wouldn't want everything go offline. Would the ICX6450 use the other 6610?
just stack them like they're supposed to be using the 40gb ports on the back, and you'll have seamless failover. You can stack/connect the 6450 to the two 6610s, and yes the 6610s will be the "brains" for the 6450 routing wise. However if you lose the master 6610, the second one will take over the master role and still perform the routing brains for the 6450

also not sure what you mean about not being able to use poe ports on other units, poe functionality is unchanged during stacking and you can use poe on any stack member
 
  • Like
Reactions: eduncan911

fohdeesha

Kaini Industries
Nov 20, 2016
2,139
2,045
113
30
fohdeesha.com
im poking around the linux portion of the switch - where would i find where this is hard coded? It sticks after a factory reset:

OS>show remote
IP address : 10.14.234.82
subnet mask : 255.255.255.0
default gateway : 10.14.234.1
OS>
yes these are just debug variables that aren't even used unless you go in and enable remote GDB debugging among other things, they are normal to be populated from factory
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,139
2,045
113
30
fohdeesha.com
OT: I've never considered this. Are you running the primary PSUs across your devices directly off of your line AC or another PDU connected to AC outlets (switches, servers, etc)? IOW, is there no UPS to the primary PSUs?

If so, what's the reason? To save the UPS battery? Never even considered this but could that potentially lengthen the life of UPS batteries?

Unfortunately here in our home, we have dirty (and low) voltage. So I have to use a sign wave UPS to get a clean signal to everything. Then again, I could get a PSU that cleans up the signal with caps.
That's the pretty typical setup (one feed directly on utility power, one feed off UPS). This way if/when the UPS fails or is replaced, the devices are unaffected and remain powered. if it's devices (like our switches) that support load splitting between PSUs, then it does take some load off the UPS transformer (or inverter & rectifier if it's an online double conversion UPS). Won't make any change for battery lifespan, the only time the batteries are pulled from is when utility power is lost, so there's not going to be any load sharing on the PSUs during that event
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,139
2,045
113
30
fohdeesha.com
My 7450 is showing this series of events every now and then:
Code:
Apr 20 17:30:13:I:System: Stack unit 1 POE  Power supply 2  with 748000 mwatts capacity is up 
Apr 20 17:30:12:I:System: Stack unit 1 have AC and DC PSUs, this is not supported
Apr 20 17:30:11:I:System: Stack unit 1 have AC and DC PSUs, this is not supported
Apr 20 17:30:10:I:System: Stack unit 1 have AC and DC PSUs, this is not supported
Apr 20 17:30:09:C:System: Stack unit 1 POE  Power supply 2  with 748000 mwatts capacity is down
Is this a sign PSU2 is dying or a possible board/internal power distribution issue?
There's no PoE load on this switch right now as I haven't re-run the cables from my APs.
PSU 2 is fed from a UPS protected PDU, the cord is secure at both ends, and nothing else on the PDU is reporting any power issues.
I was about to say (looks like you already pinpointed it), to rule out the PSU itself, connect both PSUs to the "good" UPS. If the PSU2 faults stop, then it's not getting along with the older UPS
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,139
2,045
113
30
fohdeesha.com
I purchased a 6610 recently and apparently in it's previous life it was id 2 in a stack. Is there a way to change this stack id to 1? I tried stack secure-setup but it just reports there are no neighbors and exits. More of an annoyance than impactful but I thought I'd ask.

I flashed bootloader and os per fohdeesha's guide, factory reset, reprovision modules to slot 1-3 (denied, switch is active), unconfigure and stack secure-setup.

TIA
So you did run the following? " stack unconfigure clean " and hit yes at the prompt?
to nuke it you can do over serial:

press ctrl+y then let go, then press m, then enter. you should drop to an "OS>" prompt. run the following commands

del stacking.boot
del startup-config
del startup-config.backup

then type "dir" and on the output you should *not* see those three files now. now you can run "reset" to reboot it
 

richtj99

Member
Jul 8, 2017
38
0
6
48
That's probably being read from the uBoot environment. In uBoot, what's the output of printenv?
Here it is - I get I am being paranoid but I want to make sure I am not putting something on my network that can phone home to the last owner. I thought a factory reset would get rid of this but it seems hard coded?

Thanks!

Code:
Ruckus Wireless Bootloader: 10.1.14T215 (Nov 15 2018 - 04:59:10)

Validate Shmoo parameters stored in flash ..... OK
Restoring Shmoo parameters from flash .....
Running simple memory test ..... OK

Uboot is running in Diagnostic mode...

 soc_pcie_hw_init : port->reg_base = 0x18012000 , its value = 0x1
PCIe port 402726912 in End-Point mode - ignored

**************
 port 0 is not active!!
**************
In:    serial
Out:   serial
Err:   serial
UBOOT: BE Mode
ICX7250-48 Copper (POE), PVT1
SYS CPLD VER: 0x6, Released Ver: 0
arm_clk=1000MHz, axi_clk=499MHz, apb_clk=124MHz, arm_periph_clk=500MHz
Access set to PRIMARY FL..
SF: Detected MX25L6405D with page size 4 KiB, total 8 MiB
Put the USB HUB in Reset.
phy ctrl 01d36440
Initial usb2h clock is: 000003fc
Initial usb2h clock is: 000003fd
iClk = 00000078, USBClk = 01536440

Bring usb2h_out of reset.......
usb2_reset_state is set and now it is: 00000000
Take the USB HUB out of Reset.
Net:   Registering eth
Broadcom BCM IPROC Ethernet driver 0.1
Using GMAC0 (0x18022000)
et0: ethHw_chipAttach: Chip ID: 0xdc14; phyaddr: 0x1
et0: gmac_serdes_init() serdes_status0: 0xf100ff00; serdes_status1: 0xf00
et0: gmac_serdes_init() PLL ready brought up exit
serdes_reset_core pbyaddr(0x1) id2(0xf)
ethHw_portLinkUp: Retrying link status
ethHw_portLinkUp: Retrying link status
ethHw_portLinkUp: Retrying link status
ethHw_portLinkUp: Retrying link status
ETH LINK UP: 1000FD
bcmiproc_eth-0
Access set to PRIMARY FL..
SF: Detected MX25L6405D with page size 4 KiB, total 8 MiB
Access set to PRIMARY FL..
SF: Detected MX25L6405D with page size 4 KiB, total 8 MiB
Erasing SPI flash...Writing to SPI flash...Flash set to SECONDARY FL
SF: Detected MX25L6405D with page size 4 KiB, total 8 MiB
done
Valid environment: 1
Booted From: Uboot partition 1
Enter 'b' to stop at boot monitor:  0
ICX7250-Boot> printenv
baudrate=9600
bootargs=console=ttyS0,9600n8 maxcpus=1 mem=1930M
bootcmd=run defbootcmd
bootdelay=3
bootfile=uImage
config_name=conf@3
cons_log=true
consoledev=ttyS0
defbootcmd=u_imi; sf probe 0;  setenv bootargs ip=${ipaddr}:${serverip}:${gatewayip}:${netmask}:${hostname}:${netdev}:off console=${consoledev},${baudrate},${extra_bootargs},${fips_reset} maxcpus=1 mem=2021M ethaddr=${ethaddr}? ${quiet}; nand read 0x70000000 0x0 0x2000000;bootm 70000200#${config_name}
diag_mode_enable=1
ethact=bcmiproc_eth-0
ethaddr=78:a6:e1:0c:e5:a7
fdt_high=0xffffffff
fileaddr=1000000
filesize=1B620C4
flash_addr=200
gatewayip=10.14.234.1
hostname=SI
image_name=SPS08030h.bin
initrd_high=0xffffffff
ipaddr=10.14.234.82
loadaddr=0x61007dc0
maxcpus=1
netdev=eth0
netmask=255.255.255.0
quiet=quiet
serverip=10.14.202.36
stderr=serial
stdin=serial
stdout=serial
uboot=spz10114
uboot_1_ver=10.1.14T215 (Nov 15 2018 - 04:59:15)
uboot_2_ver=10.1.14T215
uboot_size=786432
ver=10.1.14T215 (Nov 15 2018 - 04:59:15)

Environment size: 1063/16379 bytes
ICX7250-Boot>
 

eduncan911

The New James Dean
Jul 27, 2015
229
122
43
eduncan911.com
Quick question. In the 6610, can the non-PoE PSUs be used in a PoE version of the switch?

Obviously only like 60-90 watts could be used for PoE since it's 250W and not 1000W. Or maybe no PoE at all.

Just wondering if there would be errors or anything to prevent the switch from booting.
 

fohdeesha

Kaini Industries
Nov 20, 2016
2,139
2,045
113
30
fohdeesha.com
Quick question. In the 6610, can the non-PoE PSUs be used in a PoE version of the switch?

Obviously only like 60-90 watts could be used for PoE since it's 250W and not 1000W. Or maybe no PoE at all.

Just wondering if there would be errors or anything to prevent the switch from booting.
The nonpoe psus can be used but poe will be completely nonfunctional, the poe system uses a 54v power rail that the nonpoe psus do not have
 
  • Like
Reactions: eduncan911

infoMatt

Active Member
Apr 16, 2019
212
92
28
Won't make any change for battery lifespan
But it will impact the projected battery lifespan in the event of a blackout. Or if someone thinks that "there's plenty of power available" and proceeds to connect other things to the UPS it could cause an overload when the mains will go effectively out, causing a cascade failure also of the backup power.
 
  • Like
Reactions: fohdeesha

DanBerk

New Member
Apr 6, 2020
3
0
1
Sorry if this was already asked but I tried to search and haven't found a answer, do the 10gb SFP+ ports on the ICX7150-12P support a RJ45 10gb SFP+?
 

Jason Antes

Active Member
Feb 28, 2020
146
34
28
Twin Cities
Not really, no. However, the Dell ones linked to on the front page are still $95 each.

It's just the latency factor and remaining 100% fiber everywhere - for the hell of it. I mean, I ran a 75ft fiber just to connect my little-used desktop on the other side of the house - as I don't have any Cat6a cables, ends, etc. Everything is fiber through the switches and DMZ, all the way to the pfsense router via IOMMU passthrough - and then goes to RJ45 to the ISP (ugh). Pinging in gaming servers are still quiet low!

But you are right. Those DACs are a bit cheaper at about 1/2 the cost. And again, there are $35 ones in China... But then again, it's China.
I have some Brocade brand breakout cables that I'm willing to sell. I had a for sale thread with them a while ago. The FC ones are brand new and I have DAC's that are used. FC is 10m and DAC is 5m. PM me for price since this isn't a FS thread or create a WTB thread and I'll respond there with prices.
 

Attachments

  • Like
Reactions: eduncan911

JacobRhea

New Member
Feb 1, 2019
13
1
3
I know pfSense can't be used for DHCP when using the Brocade ICX-6610 as a layer 3 switch with VLANs.

Can anyone tell me if VyOS is capable of handling DHCP in a similar setup?
 

dennisp

New Member
Apr 1, 2021
14
8
3
I ran a UPS test this weekend and my 6610 Rev A PoE power supplies won't run on simulated sine wave power. I have the PSUs plugged into a pair of Cyberpower CP1500AVR units. Anyone here have the same experience? Do Rev B or C run on simulated sine wave?