Drag to reposition cover

Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)

jasonwc

Member
Dec 31, 2018
49
18
8
  • Like
Reactions: Damo

itronin

Well-Known Member
Nov 24, 2018
931
601
93
Denver, Colorado
Hi!
ICX 6450 here.
Stupid question:
IP address assigned to ve interface becomes unreachable once all Ethernet ports are down in given VLAN (as ve itself becomes down).
Is it possible to alter this behavior and make ve interface always up regardless is something connected to Ethernet ports or not?
Thank you!
what you are describing is the defined "normal" behavior. If all ports in a vlan are down then where would a ve belonging to that vlan send traffic destined for that vlan?

now... If this switch is connected to another port, say using a trunk and that trunk is always up you *could* assign the vlan in question to that trunk and the ve will stay up.

Not knowing your reasoning for the question I can also offer this (of which you may already be aware): If your need/reason for the ve is to source say routing information, tracerts, pings, or just plain serve as a monitored or management interface then consider creating loopback interface on the switch and either advertising via routing protocol the switche's ip address or statically defining the switches ip address in your core or an upstream switch. From a management/sourcing standpoint loopback is my preferred method.
 
  • Like
Reactions: fohdeesha

godlike

New Member
Sep 12, 2022
3
0
1
what you are describing is the defined "normal" behavior. If all ports in a vlan are down then where would a ve belonging to that vlan send traffic destined for that vlan?

now... If this switch is connected to another port, say using a trunk and that trunk is always up you *could* assign the vlan in question to that trunk and the ve will stay up.

Not knowing your reasoning for the question I can also offer this (of which you may already be aware): If your need/reason for the ve is to source say routing information, tracerts, pings, or just plain serve as a monitored or management interface then consider creating loopback interface on the switch and either advertising via routing protocol the switche's ip address or statically defining the switches ip address in your core or an upstream switch. From a management/sourcing standpoint loopback is my preferred method.
Thank you for the reply.
My reasoning is exactly as you've described - routing information, tracerts, pings, etc.
Yeah, I know about loopback addresses, however my switch is gateway for mentioned vlans so I need to set ip addresses there (to not enable such things as proxy arp if it is supported at all).

I completely understand that this is normal behavior but I used other hardware which treated virtual interfaces as belonging to device itselfso they we not going down and I found this behavior convenient for me.

Very simple example - let's imagine I have switch without CPE connecting _so far_. I've set up ACL and want ping from one vlan another. Considering I assume the only alive IP in that new Vlan is ip address attached to VE. Now, no ping will not give me understanding - is it mistake in ACL or interface is just down. Slightly inconvenient.

But again, I can live with this :).
 

itronin

Well-Known Member
Nov 24, 2018
931
601
93
Denver, Colorado
But again, I can live with this :).
a quick google shows

caveat emptor: I have just skimmed through this 'cause I figured you might be able to throw a port into loopback. Whether that will bring up the VE for a port defined in that vlan or not IDK. I don't have a 6450 so I can't test and only offer the outcome of my curiosity which may help you or may do something completely different that is of no help at all! o_O
 
  • Like
Reactions: godlike

kpfleming

Active Member
Dec 28, 2021
195
77
28
Pelham NY USA
Anyone got suggestions for cheap QSFP+ breakout port (ICX6610) found Brocade 40G-QSFP-4SFP-C-0301 Compatible 40G QSFP to 4x10G SFP+ DAC Cable

What do I need to look for the second PSU on ebay?
And is there anything I can do to reduce power? This is my first switch, disabling ports maybe?
Disabling ports will not reduce idle power consumption. You've got an enterprise-grade 10G/40G switch that is a few generations behind the state-of-the-art, it's going to consume a noticeable amount of power.
 
  • Like
Reactions: fohdeesha and Damo

LodeRunner

Active Member
Apr 27, 2019
427
178
43
Anyone got suggestions for cheap QSFP+ breakout port (ICX6610) found Brocade 40G-QSFP-4SFP-C-0301 Compatible 40G QSFP to 4x10G SFP+ DAC Cable

What do I need to look for the second PSU on ebay?
And is there anything I can do to reduce power? This is my first switch, disabling ports maybe?
Power consumption in high-end switches comes from 3 main areas: cooling, the actual switching ASIC and management CPU, and connected ports. Switch ports that are not connected don't consume enough power to be worth trying to save.

Being blunt, if you're looking for power efficiency, 10G/40G switching is the wrong place to be looking. My Arista 7050QX-32S that's quite a bit newer than than the 6610, with 3 optics and 8 DACs connected draws a fairly constant 82W approximately; it has 500W PSUs. My ICX7450-48P, with 16 ethernet and 2 QSFP attached and up (but no PoE devices at the moment) draws an estimated 100-120W based on the UPS load when I've taken it down; it doesn't have internal power monitoring to report PSU output. My 7450 has 1000W PSUs.

The PSU part number depends on if it's for a PoE or non-PoE model. In either case, I believe you'll want to look for Rev C power supplies, they are allegedly quieter. I don't have a 6610 and that particular discussion is way back up-thread. The 1000W PoE model is the RPS16-E/I (exhaust or intake, depending on the airflow direction of your switch.
 

mutatedmonkey

New Member
Sep 20, 2022
1
0
1
Is there a general consensus on what model fan is a good replacement for the ICX-6450-48P? I won't be running more than 4-8 POE devices and would like it to be quieter. I was going to use Noctua's, but read in this thread that they don't push enough air to keep things cool. Sorry if this has been asked/answered before, but the thread is 384 pages long at this point!
 

LiamWJBlom

New Member
Sep 15, 2022
3
0
1
not possible to disable the serial port, they could have changed/disabled it in the uboot bootloader but then fastiron would still have output when it finishes booting. It's possible to change the baudrate in uboot, I doubt that's the case but worth a try, try fresh booting it with your terminal set to the following (reboot it each time you change): 38400, 57600, 115200
Turns out my 2 USB-to-Serial adapters were faulty. Got another one and is working with a mikrotik but still not on these brocade? Tried the reboot on other baud rates as well. Any other way to get into these switches?
 

frogtech

Well-Known Member
Jan 4, 2016
1,433
242
63
34
I've got two 7250-24P switches but even with fan mods they're still noisier than I like, and it's hard to find good fans for them that don't cause temperatures to increase by 15 to 20 degrees.

Felt like this would be a good place to ask: any 7250 vets who have sense moved on to other 10 gig switches that are as feature rich? Basically fully layer 3? Don't really need any additional fancy features like DCB, PFC, etc. Ideally 4 or more SFP+ ports.
 

frogtech

Well-Known Member
Jan 4, 2016
1,433
242
63
34
Because I don’t have a slim fan. Those two heat pipes pair with 0.1a delta 8020 fan made the temperature 61.7 degree, with a Foxconn 0.16a 8028 fan is 60 degree. Room temperature around 22 degree.
Can you post the parts / components (heatpipe and secondary heatsinks) and the adhesive you used for that? That's actually a brilliant solution.
 

up3up4

Member
Jun 10, 2018
69
19
8
Can you post the parts / components (heatpipe and secondary heatsinks) and the adhesive you used for that? That's actually a brilliant solution.
Those heatpipes are 140mm long 11mm height and 3mm thickness from AliExpress. Small heat sinks are from vintage ATI video card and north bridge chips. I put thermal paste on the heatsink fin’s bottom then use silicon rtv to bonding them together.
 
  • Like
Reactions: frogtech

AgentCrimson

Member
Apr 5, 2021
44
13
8
I bought these breakout cables and QSFP transceivers and wanted to confirm these work with Brocades

 
  • Like
Reactions: fohdeesha

madmatt71

New Member
Sep 18, 2022
4
2
3
Checking in, just received a 7250-24P and am putting it through its paces - trying out different cooling options (I don't need it super silent, but I would like it to be a little less noisy, we will see....)
The switch will replace a CRS312-4C + 8XG-RM and a cisco sg200-26, and a passive POE injector, and just wanted to report that all existing 10G cabling/transceivers that I was using with the Mikrotik works flawlessly with the 7250:

  • 10GBaseT Transceiver: ipolex 10Gb/s SFP+ RJ45 Module , 55EUR new from Amazon
  • DAC Cables: QSFPTEK 10G SFP+ DAC Copper Twinax (18EUR - 1M , 25EUR 2M New)
  • 10Gtek 10G SFP+ SR Multimode 10Base-SR, SFP-10G-SR - 37EUR/Pair new on Amazon
Code:
SSH@brocade-sottotetto#sh media
Port 1/1/1:  Type  : 1G M-C (Gig-Copper)
Port 1/1/2:  Type  : 1G M-C (Gig-Copper)
Port 1/1/3:  Type  : 1G M-C (Gig-Copper)
Port 1/1/4:  Type  : 1G M-C (Gig-Copper)
Port 1/1/5:  Type  : 1G M-C (Gig-Copper)
Port 1/1/6:  Type  : 1G M-C (Gig-Copper)
Port 1/1/7:  Type  : 1G M-C (Gig-Copper)
Port 1/1/8:  Type  : 1G M-C (Gig-Copper)
Port 1/1/9:  Type  : 1G M-C (Gig-Copper)
Port 1/1/10:  Type  : 1G M-C (Gig-Copper)
Port 1/1/11:  Type  : 1G M-C (Gig-Copper)
Port 1/1/12:  Type  : 1G M-C (Gig-Copper)
Port 1/1/13:  Type  : 1G M-C (Gig-Copper)
Port 1/1/14:  Type  : 1G M-C (Gig-Copper)
Port 1/1/15:  Type  : 1G M-C (Gig-Copper)
Port 1/1/16:  Type  : 1G M-C (Gig-Copper)
Port 1/1/17:  Type  : 1G M-C (Gig-Copper)
Port 1/1/18:  Type  : 1G M-C (Gig-Copper)
Port 1/1/19:  Type  : 1G M-C (Gig-Copper)
Port 1/1/20:  Type  : 1G M-C (Gig-Copper)
Port 1/1/21:  Type  : 1G M-C (Gig-Copper)
Port 1/1/22:  Type  : 1G M-C (Gig-Copper)
Port 1/1/23:  Type  : 1G M-C (Gig-Copper)
Port 1/1/24:  Type  : 1G M-C (Gig-Copper)
Port 1/2/1:  Type  : 10GE Passive Twinax  2m (SFP+)
Port 1/2/2:  Type  : 10GE Passive Twinax  2m (SFP+)
Port 1/2/3:  Type  : 10GE SR 300m (SFP+)
Port 1/2/4:  Type  : 10GE SR 300m (SFP+)
Port 1/2/5:  Type  : 10GE Passive Twinax 2m (SFP+)
Port 1/2/6:  Type  : 10GE Passive Twinax 2m (SFP+)
Port 1/2/7:  Type  : 10GE SR 300m (SFP+)

Followed the guide without major issues, I only had trouble doing the tftp uefi firmware upgrade if using a tftp server not directly connected to the switch .... the transfer would stall and then timeout after 50 of the 60MB of the firmware were transferred


The only hiccup was a hardware one, one of the three POE modules is busted, so I will have POE only on 16 of the 24 ports, it looks like a common 'misunderstanding' with units purchased on ebay, and given that the seller was international, we agreed on a partial refund, so the switch ended up costing me 400USD plus shipping

So far so good, thanks for all the info that this thread provided I was able to hit the ground running with VLAN configurations, POE settings and such

Code:
SSH@brocade-sottotetto#sh inline power

Power Capacity:        Total is 370000 mWatts. Current Free is 340000 mWatts.

Power Allocations:     Requests Honored 16 times


 Port    Admin     Oper    ---Power(mWatts)---  PD Type  PD Class     Pri  Fault/
         State     State   Consumed  Allocated                             Error
-----------------------------------------------------------------------------
  1/1/1    On     Off            0          0  n/a      n/a            3  n/a
  1/1/2    On     Off            0          0  n/a      n/a            3  n/a
  1/1/3    On     Off            0          0  n/a      n/a            3  n/a
  1/1/4    On     Off            0          0  n/a      n/a            3  n/a
  1/1/5    On     Off            0          0  n/a      n/a            3  n/a
  1/1/6    On     Off            0          0  n/a      n/a            3  n/a
  1/1/7    On     Off            0          0  n/a      n/a            3  n/a
  1/1/8    On     Off            0          0  n/a      n/a            3  n/a
  1/1/9    On     Off            0          0  n/a      n/a            3  n/a
 1/1/10    On     Off            0          0  n/a      n/a            3  n/a
 1/1/11    On     Off            0          0  n/a      n/a            3  n/a
 1/1/12    On     On          3300      30000  2P-IEEE  Class 4        3  n/a
 1/1/13    On     Non-PD         0          0  n/a      n/a            3  n/a
 1/1/14    On     Off            0          0  n/a      n/a            1  n/a
 1/1/15 On      Off            0          0  n/a      n/a            3  n/a
 1/1/16    On     Off            0          0  n/a      n/a            3  n/a
 1/1/17    Off    Off            0          0  n/a      n/a            3  n/a
 1/1/18    Off    Off            0          0  n/a      n/a            3  n/a
 1/1/19    Off    Off            0          0  n/a      n/a            3  n/a
 1/1/20    Off    Off            0          0  n/a      n/a            3  n/a
 1/1/21    Off    Off            0          0  n/a      n/a            3  n/a
 1/1/22    Off    Off            0          0  n/a      n/a            3  n/a
 1/1/23    Off    Off            0          0  n/a      n/a            3  n/a
 1/1/24    Off    Off            0          0  n/a      n/a            3  n/a
-----------------------------------------------------------------------------
 Total                          3300      30000
 
  • Like
Reactions: kpfleming

Craig Curtin

New Member
Jun 18, 2017
6
1
3
57
Guys - anyone got any experience with ESXI 7 and these switches ? (6610 enabled using the excellent guide in this thread - latest firmware and all ports licensed) I am trying to setup two of the 1Gb/s copper ports in a LAG to the server - during initial installation and commissioning. i.e. i want to have the ports enabled in a static LAG and when it comes time to select the VMware Management interface i want to select the two NICs that are in the LAG.

I have the LAG configured and working fine - however when i select both ports then the server is not contactable ? The server is a Dell 730 series and using the 4 onboard ports - the idea is to use two of them for management in a LAG and the other two for VM Traffic with an add in 10GB adapter for Storage traffic.

Craig
 

rocketpanda40

Member
Dec 12, 2019
39
24
8
any 7250 vets who have sense moved on to other 10 gig switches that are as feature rich? Basically fully layer 3?
I've moved to a Juniper core with ex3300, but it's pretty much the same noise level as the 7250. Still got a few fanless icx switches kicking around though.
 

epicurean

Active Member
Sep 29, 2014
744
61
28
I enabled a dual mode on a 6450 switch for vlan 80 on a port that links to a 7150-c12 switch. How do I set the port on the 7150 (that connects to the 6450) as I dont think there is dual mode on the 7150?
Does this mean every port on the 7150 will be on vlan 80 or only the ones I set so?

much thanks
 

rocketpanda40

Member
Dec 12, 2019
39
24
8
I enabled a dual mode on a 6450 switch for vlan 80 on a port that links to a 7150-c12 switch. How do I set the port on the 7150 (that connects to the 6450) as I dont think there is dual mode on the 7150?
Does this mean every port on the 7150 will be on vlan 80 or only the ones I set so?

much thanks
On the 7150 you can configure tagged and untagged vlans on the same port directly, as you discovered it no longer uses dual mode.