Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)

[grenskul]

There is SNMP

Can I configure ports trough snmp? Or would I have to reload a complete config (if you can even do this)?

 

[hmw]

$1,040.00

There is one seller currently selling a lot of ICX7650-48ZP-E2 for $1200 + $70 shipping within USA. -E2 means: Two power supplies, two fans.

I think that's pretty solid price.. A couple of weeks (or months? but I think max 3 months) they went for $2000 - $2500 in auctions and that was considered a good price...

I was bidding on that auction but decided to get a new-in-box one instead

Until recently there were quite a few eBay snipers/scalpers who purchased these at $1500 or $2000 and then turned around and listed them for $5000. Yeah I know it's how some folks make a living but there's nothing moral about scalping

Thanks to the recent economic downturn you can now see the 7650's at $1200 and Ruckus R750s at $400.

 

[NablaSquaredG]

I was bidding on that auction but decided to get a new-in-box one instead

Yeah I was also considering this, but the new-in-box is almost 25% more expensive ($1300 vs $1040) than the used one, so I'm taking the risk

 

[custom90gt]

I was bidding on that auction but decided to get a new-in-box one instead

Until recently there were quite a few eBay snipers/scalpers who purchased these at $1500 or $2000 and then turned around and listed them for $5000. Yeah I know it's how some folks make a living but there's nothing moral about scalping

Thanks to the recent economic downturn you can now see the 7650's at $1200 and Ruckus R750s at $400.

I guess I dunno where they got the switches so cheap to begin with. Isn't the MSRP like 16k on them?

 

[hmw]

I guess I dunno where they got the switches so cheap to begin with. Isn't the MSRP like 16k on them?

Maybe the Twitter offices ? But jokes aside - when companies move or are acquired or liquidated they can often just ask someone to haul away stuff. I worked for a startup that got acquired by a *very* large company. We had a data closet with many servers, switches and UPSes. The large company was disinterested in taking on any of the hardware or inventory. And so they had me smash and drill holes in disks - and had folks haul away brand new servers and switches for scrap. Including boxed items.

 

[nexox]

The large company was disinterested in taking on any of the hardware or inventory. And so they had me smash and drill holes in disks - and had folks haul away brand new servers and switches for scrap. Including boxed items.

Can confirm - I have positively identified items on eBay which came from one of my startup employer's e-waste piles after acquisition, and I have carried boxes of power supplies and cables out of my friends' acquired startups to save them the e-waste fees.

 

[hmw]

I guess I dunno where they got the switches so cheap to begin with. Isn't the MSRP like 16k on them?

I actually found some refurb R750s cheapish - like $400 - so definitely a good time to buy Brocade stuff. Or then maybe they will be cheaper in the coming weeks. One never knows

 

[custom90gt]

Maybe the Twitter offices ? But jokes aside - when companies move or are acquired or liquidated they can often just ask someone to haul away stuff. I worked for a startup that got acquired by a *very* large company. We had a data closet with many servers, switches and UPSes. The large company was disinterested in taking on any of the hardware or inventory. And so they had me smash and drill holes in disks - and had folks haul away brand new servers and switches for scrap. Including boxed items.

I couldn't even imagine wasting stuff like that. I hope those servers made it on to the used market or something instead of being "recycled" which typically looks like put in a landfill. On the other hand, I would be excited to help them recycle things like that, lol.

 

[grenskul]

There is SNMP

Ended up just using expect and that works fine.

 

[hmw]

I couldn't even imagine wasting stuff like that. I hope those servers made it on to the used market or something instead of being "recycled" which typically looks like put in a landfill. On the other hand, I would be excited to help them recycle things like that, lol.

I'm not IT or Ops so have no clue on how this all works. But I did ask and was told that if the company didn't have a clear chain of custody for anything (including even passive things like power cables) it would not be allowed in their data centers.

So CPUs, memory, NVDIMMs and drives were shredded or rendered useless. And everything else was given to folks who handled e-waste.

Apple devices always presented a problem as many folks got let go during the acquisition and it's not easy to get control back on Apple devices. We had dozens of iPads as meeting room controls and Mac Minis as display drivers - I really wonder what the people who handled the e-waste did with them

 

[ManoftheSea]

Can I configure ports trough snmp? Or would I have to reload a complete config (if you can even do this)?

It is possible to load a complete configuration over TFTP, and you can kick the process off over SSH or console connection.

copy tftp running-config X.X.X.X path/to/configuration

 

[eptesicus]

Alright, I'm beating my head against the wall on this one.

I want to access my switch from a LAN IP and an IP on VLAN 50, but I'm not able to. I have ports 1/2/1 and 1/2/2 as uplinks to my core switches. I want these to be trunks.

Anything on an interface with a single untagged port (such as vlan 130 on int eth 1/1/21) works fine. Same with vlan 50 on int eth 1/1/10. However, I can't ping/ssh/access the web GUI on either of the IPs I set, 10.0.0.93 or 10.0.50.4. I also moved my second floor Unifi AP (10.0.0.112) on int eth 1/1/2 to this switch and devices can connect to it and work fine, but the AP itself shows offline in the Unifi controller, and I can't ping its IP.

My upstream switch is a Ubiquiti ES-16-XG and the switch port connected to the Brocade is a trunk port (1 is untagged, all other vlans are tagged). This will be replaced with my 2x 40GbE Arista switches that I have yet to configure.

I'm used to Cisco and Ubiquiti EdgeSwitch configs, and this is my first Brocade. What is wrong with my config below with the mentioned issues?

Current configuration:
!
ver 08.0.30uT313
!
stack unit 1
  module 1 icx6450-48p-poe-port-management-module
  module 2 icx6450-sfp-plus-4port-40g-module
!
!
!
!
vlan 1 name DEFAULT-VLAN by port
 router-interface ve 1
!
vlan 50 name v50_MGMTPhysical by port
 tagged ethe 1/2/1 to 1/2/2
 untagged ethe 1/1/7 to 1/1/10 ethe 1/1/13 to 1/1/16
 uplink-switch ethe 1/2/1 to 1/2/2
 router-interface ve 50
!
vlan 60 name v60_MGMTUser by port
 tagged ethe 1/1/1 to 1/1/2 ethe 1/2/1 to 1/2/2
 untagged ethe 1/1/31 to 1/1/36
 uplink-switch ethe 1/2/1 to 1/2/2
!
vlan 100 name v100_Guest by port
 tagged ethe 1/1/1 to 1/1/2 ethe 1/2/1 to 1/2/2
 uplink-switch ethe 1/2/1 to 1/2/2
!
vlan 110 name v110_Wiferino by port
 tagged ethe 1/1/1 to 1/1/2 ethe 1/2/1 to 1/2/2
 uplink-switch ethe 1/2/1 to 1/2/2
!
vlan 120 name v120_IOT by port
 tagged ethe 1/1/1 to 1/1/2 ethe 1/2/1 to 1/2/2
 uplink-switch ethe 1/2/1 to 1/2/2
!
vlan 130 name v130_Cams by port
 tagged ethe 1/1/1 to 1/1/2 ethe 1/2/1 to 1/2/2
 untagged ethe 1/1/21 to 1/1/30
 uplink-switch ethe 1/2/1 to 1/2/2
!
!
!
!
!
aaa authentication web-server default local
aaa authentication login default local
hostname VII-SW48P01
ip dhcp-client disable
ip dns domain-list example.local
ip dns server-address 10.0.51.11 10.0.51.12
ip route 0.0.0.0/0 10.0.0.1
!
no telnet server
username root password .....
snmp-server community ..... ro
!
!
clock timezone us Central
!
!
ntp
 disable serve
 server 10.0.51.11
!
!
web-management https
!
!
!
interface ethernet 1/1/1
 port-name Wireless AP First Floor
 inline power
!
interface ethernet 1/1/2
 port-name Wireless AP Second Floor
 inline power
!
interface ethernet 1/1/7
 port-name MX7000 MGMT
!
interface ethernet 1/1/8
 port-name MX7000 MGMT
!
interface ethernet 1/1/9
 port-name NAS01 IPMI
!
interface ethernet 1/1/10
 port-name NAS02 IPMI
!
interface ethernet 1/1/13
 port-name APC UPS MGMT
!
interface ethernet 1/1/15
 port-name APC PDU 1
!
interface ethernet 1/1/16
 port-name APC PDU 2
!
interface ethernet 1/1/21
 port-name Surveillance Camera
 inline power
!
interface ethernet 1/1/22
 port-name Surveillance Camera
 inline power
!
interface ethernet 1/1/23
 port-name Surveillance Camera
 inline power
!
interface ethernet 1/1/24
 port-name Surveillance Camera
 inline power
!
interface ethernet 1/1/25
 port-name Surveillance Camera
 inline power
!
interface ethernet 1/1/26
 port-name Surveillance Camera
 inline power
!
interface ethernet 1/1/27
 port-name Surveillance Camera
 inline power
!
interface ethernet 1/1/28
 port-name Surveillance Camera
 inline power
!
interface ethernet 1/1/29
 port-name Surveillance Camera
 inline power
!
interface ethernet 1/1/30
 port-name Surveillance Camera
 inline power
!
interface ethernet 1/1/31
 port-name Mike's Office
!
interface ethernet 1/1/32
 port-name Mike's Office
!
interface ethernet 1/1/33
 port-name Mike's Office
!
interface ethernet 1/1/34
 port-name Mike's Office
!
interface ethernet 1/1/35
 port-name Mike's Office
!
interface ethernet 1/1/36
 port-name Mike's Office
!
interface ethernet 1/2/1
 port-name Uplink to Core
!
interface ethernet 1/2/2
 port-name Uplink to Core
 disable
!
interface ve 1
 ip address 10.0.0.93 255.255.255.0
!
interface ve 50
 ip address 10.0.50.4 255.255.255.0
!
!
!
!
!
!
!
!
!
end

 

[u4096]

It's a bit unclear what VLAN you are trying to access the management IPs and the AP from. Is it the default (VLAN 1) or VLAN 50/60?

I think the AP issue is because it appears you don't have a native VLAN for the AP port (show vlanwould help), unless you want it to be the default VLAN. UBNT APs need to be reachable via untagged traffic for management. In other words, the AP port will have 1 untagged VLAN (let's say 60) + 4 tagged (VLANs 100/110/120/130). If the AP gets the IP via DHCP, you want to make sure it can reach out to a DHCP server.

I believe the 6450 run the old dual mode command. I don't have one but if you want it to be in the VLAN 60 subnet my understanding is you need to run.:

> conf t
> vlan 60
> no tagged ethernet 1/1/2
> untagged ethernet 1/1/2
> exit
> int eth 1/1/2
> dual mode 60
> exit
> wr m

See this for reference. I might have gotten the order wrong as I don't have a way to test it. If you just want VLAN 1 traffic untagged, then I think you just need dual mode without specifying a VLAN id.

In the 7xxx switch series, there is no dual mode , so the following would suffice:

> conf t
> vlan 60
> no tagged eth 1/1/2
> untagged eth 1/1/2
> exit
> wr m

 

[u4096]

Alright, I'm beating my head against the wall on this one.

I want to access my switch from a LAN IP and an IP on VLAN 50, but I'm not able to. I have ports 1/2/1 and 1/2/2 as uplinks to my core switches. I want these to be trunks.

Anything on an interface with a single untagged port (such as vlan 130 on int eth 1/1/21) works fine. Same with vlan 50 on int eth 1/1/10. However, I can't ping/ssh/access the web GUI on either of the IPs I set, 10.0.0.93 or 10.0.50.4. I also moved my second floor Unifi AP (10.0.0.112) on int eth 1/1/2 to this switch and devices can connect to it and work fine, but the AP itself shows offline in the Unifi controller, and I can't ping its IP.

My upstream switch is a Ubiquiti ES-16-XG and the switch port connected to the Brocade is a trunk port (1 is untagged, all other vlans are tagged). This will be replaced with my 2x 40GbE Arista switches that I have yet to configure.

Can you post the output of:

> show vlan
> show int bri wi

 

[selta]

The order of operations for getting dual-mode always messes me up when I come back to it after being away for awhile. I really wish the ICX-6610s I had supported newer FastIron. I've started an internal debate with myself if the server being on a 40Gbps port is good enough reason to keep the ICX around, or if I should just get a Mikrotik in place for my TOR. I already use Mikrotiks everywhere else now in my home network infra. It works though, just annoying/frustrating to have to "relearn" that part each time I want to make a minor and trivial change.

 

[eptesicus]

It's a bit unclear what VLAN you are trying to access the management IPs and the AP from. Is it the default (VLAN 1) or VLAN 50/60?

I think the AP issue is because it appears you don't have a native VLAN for the AP port (show vlanwould help), unless you want it to be the default VLAN. UBNT APs need to be reachable via untagged traffic for management. In other words, the AP port will have 1 untagged VLAN (let's say 60) + 4 tagged (VLANs 100/110/120/130). If the AP gets the IP via DHCP, you want to make sure it can reach out to a DHCP server.

I believe the 6450 run the old dual mode command. I don't have one but if you want it to be in the VLAN 60 subnet my understanding is you need to run.:

> conf t
> vlan 60
> no tagged ethernet 1/1/2
> untagged ethernet 1/1/2
> exit
> int eth 1/1/2
> dual mode 60
> exit
> wr m

See this for reference. I might have gotten the order wrong as I don't have a way to test it. If you just want VLAN 1 traffic untagged, then I think you just need dual mode without specifying a VLAN id.

In the 7xxx switch series, there is no dual mode , so the following would suffice:

> conf t
> vlan 60
> no tagged eth 1/1/2
> untagged eth 1/1/2
> exit
> wr m

I'll check that out now. The default VLAN is 1, however, I'd prefer it to be 50, since that's my physical hardware management subnet. Since the AP's management is on VLAN 1, I keep reading that its native on all ports automatically, and I can't set VLAN 1 as untagged to any interfaces. I suppose if I re-IP my APs to be on VLAN 50, it should work... That said, as shown below, the link for ve 1 is showing as Down, and I can't figure out how to get that to change it's link state to Up.

Can you post the output of:

> show vlan
> show int bri wi

VII-SW48P01(config)#show vlan
Total PORT-VLAN entries: 7
Maximum PORT-VLAN entries: 64

Legend: [Stk=Stack-Id, S=Slot]

PORT-VLAN 1, Name DEFAULT-VLAN, Priority level0, Spanning tree Off
 Untagged Ports: (U1/M1)   3   4   5   6  11  12  17  18  19  20  37  38
 Untagged Ports: (U1/M1)  39  40  41  42  43  44  45  46  47  48
 Untagged Ports: (U1/M2)   3   4
   Tagged Ports: None
   Uplink Ports: None
 DualMode Ports: None
 Mac-Vlan Ports: None
     Monitoring: Disabled
    
PORT-VLAN 50, Name v50_MGMTPhysical, Priority level0, Spanning tree Off
 Untagged Ports: (U1/M1)   7   8   9  10  13  14  15  16
   Tagged Ports: (U1/M2)   1   2
   Uplink Ports: (U1/M2)   1   2
 DualMode Ports: None
 Mac-Vlan Ports: None
     Monitoring: Disabled
    
PORT-VLAN 60, Name v60_MGMTUser, Priority level0, Spanning tree Off
 Untagged Ports: (U1/M1)  31  32  33  34  35  36
   Tagged Ports: (U1/M1)   1   2
   Tagged Ports: (U1/M2)   1   2
   Uplink Ports: (U1/M2)   1   2
 DualMode Ports: None
 Mac-Vlan Ports: None
     Monitoring: Disabled
    
PORT-VLAN 100, Name v100_Guest, Priority level0, Spanning tree Off
 Untagged Ports: None
   Tagged Ports: (U1/M1)   1   2
   Tagged Ports: (U1/M2)   1   2
   Uplink Ports: (U1/M2)   1   2
 DualMode Ports: None
 Mac-Vlan Ports: None
     Monitoring: Disabled
    
PORT-VLAN 110, Name v110_Wiferino, Priority level0, Spanning tree Off
 Untagged Ports: None
   Tagged Ports: (U1/M1)   1   2
   Tagged Ports: (U1/M2)   1   2
   Uplink Ports: (U1/M2)   1   2
 DualMode Ports: None
 Mac-Vlan Ports: None
     Monitoring: Disabled
    
PORT-VLAN 120, Name v120_IOT, Priority level0, Spanning tree Off
 Untagged Ports: None
   Tagged Ports: (U1/M1)   1   2
   Tagged Ports: (U1/M2)   1   2
   Uplink Ports: (U1/M2)   1   2
 DualMode Ports: None
 Mac-Vlan Ports: None
     Monitoring: Disabled
    
PORT-VLAN 130, Name v130_Cams, Priority level0, Spanning tree Off
 Untagged Ports: (U1/M1)  21  22  23  24  25  26  27  28  29  30
   Tagged Ports: (U1/M1)   1   2
   Tagged Ports: (U1/M2)   1   2
   Uplink Ports: (U1/M2)   1   2
 DualMode Ports: None
 Mac-Vlan Ports: None
     Monitoring: Disabled

VII-SW48P01(config)#sh int brief wide

Port       Link    State   Dupl Speed Trunk Tag Pvid Pri MAC             Name
1/1/1      Down    None    None None  None  Yes N/A  0   748e.f8d3.c340  Wireless AP First Floor
1/1/2      Up      Forward Full 1G    None  Yes N/A  0   748e.f8d3.c341  Wireless AP Second Floor
1/1/3      Down    None    None None  None  No  1    0   748e.f8d3.c340
1/1/4      Down    None    None None  None  No  1    0   748e.f8d3.c340
1/1/5      Down    None    None None  None  No  1    0   748e.f8d3.c340
1/1/6      Down    None    None None  None  No  1    0   748e.f8d3.c340
1/1/7      Down    None    None None  None  No  50   0   748e.f8d3.c340  MX7000 MGMT
1/1/8      Down    None    None None  None  No  50   0   748e.f8d3.c340  MX7000 MGMT
1/1/9      Up      Forward Full 1G    None  No  50   0   748e.f8d3.c340  NAS01 IPMI
1/1/10     Up      Forward Full 1G    None  No  50   0   748e.f8d3.c340  NAS02 IPMI
1/1/11     Down    None    None None  None  No  1    0   748e.f8d3.c340
1/1/12     Down    None    None None  None  No  1    0   748e.f8d3.c340
1/1/13     Down    None    None None  None  No  50   0   748e.f8d3.c340  APC UPS MGMT
1/1/14     Down    None    None None  None  No  50   0   748e.f8d3.c340
1/1/15     Down    None    None None  None  No  50   0   748e.f8d3.c340  APC PDU 1
1/1/16     Down    None    None None  None  No  50   0   748e.f8d3.c340  APC PDU 2
1/1/17     Down    None    None None  None  No  1    0   748e.f8d3.c340
1/1/18     Down    None    None None  None  No  1    0   748e.f8d3.c340
1/1/19     Down    None    None None  None  No  1    0   748e.f8d3.c340
1/1/20     Down    None    None None  None  No  1    0   748e.f8d3.c340
1/1/21     Up      Forward Full 100M  None  No  130  0   748e.f8d3.c354  Surveillance Camera
1/1/22     Up      Forward Full 100M  None  No  130  0   748e.f8d3.c355  Surveillance Camera
1/1/23     Up      Forward Full 100M  None  No  130  0   748e.f8d3.c356  Surveillance Camera
1/1/24     Up      Forward Full 100M  None  No  130  0   748e.f8d3.c357  Surveillance Camera
1/1/25     Up      Forward Full 100M  None  No  130  0   748e.f8d3.c358  Surveillance Camera
1/1/26     Up      Forward Full 100M  None  No  130  0   748e.f8d3.c359  Surveillance Camera
1/1/27     Down    None    None None  None  No  130  0   748e.f8d3.c35a  Surveillance Camera
1/1/28     Down    None    None None  None  No  130  0   748e.f8d3.c35b  Surveillance Camera
1/1/29     Down    None    None None  None  No  130  0   748e.f8d3.c35c  Surveillance Camera
1/1/30     Down    None    None None  None  No  130  0   748e.f8d3.c35d  Surveillance Camera
1/1/31     Down    None    None None  None  No  60   0   748e.f8d3.c35e  Mike's Office
1/1/32     Down    None    None None  None  No  60   0   748e.f8d3.c35f  Mike's Office
1/1/33     Down    None    None None  None  No  60   0   748e.f8d3.c360  Mike's Office
1/1/34     Down    None    None None  None  No  60   0   748e.f8d3.c361  Mike's Office
1/1/35     Down    None    None None  None  No  60   0   748e.f8d3.c362  Mike's Office
1/1/36     Down    None    None None  None  No  60   0   748e.f8d3.c363  Mike's Office
1/1/37     Down    None    None None  None  No  1    0   748e.f8d3.c340
1/1/38     Down    None    None None  None  No  1    0   748e.f8d3.c340
1/1/39     Down    None    None None  None  No  1    0   748e.f8d3.c340
1/1/40     Down    None    None None  None  No  1    0   748e.f8d3.c340
1/1/41     Down    None    None None  None  No  1    0   748e.f8d3.c340
1/1/42     Down    None    None None  None  No  1    0   748e.f8d3.c340
1/1/43     Down    None    None None  None  No  1    0   748e.f8d3.c340
1/1/44     Down    None    None None  None  No  1    0   748e.f8d3.c340
1/1/45     Down    None    None None  None  No  1    0   748e.f8d3.c340
1/1/46     Down    None    None None  None  No  1    0   748e.f8d3.c340
1/1/47     Down    None    None None  None  No  1    0   748e.f8d3.c340
1/1/48     Down    None    None None  None  No  1    0   748e.f8d3.c340
1/2/1      Up      Forward Full 10G   None  Yes N/A  0   748e.f8d3.c340  Uplink to Core
1/2/2      Disable None    None None  None  Yes N/A  0   748e.f8d3.c340  Uplink to Core
1/2/3      Down    None    None None  None  No  1    0   748e.f8d3.c340
1/2/4      Down    None    None None  None  No  1    0   748e.f8d3.c340
mgmt1      Down    None    None None  None  No  None 0   748e.f8d3.c340
Port       Link    State   Dupl Speed Trunk Tag Pvid Pri MAC             Name
ve1        Down    N/A     N/A  N/A   None  N/A N/A  N/A 748e.f8d3.c340
ve50       Up      N/A     N/A  N/A   None  N/A N/A  N/A 748e.f8d3.c340

 

[bitbckt]

There are no physical ports in ve1 which are Up - the ve won’t come up until at least one does.

 

[hmw]

I will make sure to report.

Damn this ICX7650 is LOUD. My Apple watch shows 63dB ~ 70 dB when near the switch. It was new in box but came with two Rev A PSUs ! On the other hand, I have like 3 Rev C and one Rev B RPS-16 PSU so it's not a problem.

But the noise ! I do need to soundproof my rack - thinking of getting some MLV (mass loaded vinyl) and putting in on the rack insides. The problem is that it is heavy - 20 sq ft of these would weight 40 lbs

@fohdeesha - the switch came with FastIron 08.0.90j - would you recommend upgrading to 10.0.0 ? Other than dropping switch & router images, is there anything worthwhile in 10.0.0? or conversely - is anything else (for example the honor based licensing) dropped in 10.0.0?

 

[NablaSquaredG]

It was new in box but came with two Rev A PSUs !

Weird... I assumed that Rev B and Rev C superseded Rev A and no Rev A are produced anymore. Can't imagine that they're shipping new ICX7650 with years old Rev A PSUs

 

[itronin]

Damn this ICX7650 is LOUD. My Apple watch shows 63dB ~ 70 dB when near the switch. It was new in box but came with two Rev A PSUs ! On the other hand, I have like 3 Rev C and one Rev B RPS-16 PSU so it's not a problem.

weird mine doesn't sound any louder than my icx6610-48p. I should check what psu's are in mine.