Yeah, I’m seeing about that wattage displayed on a Kill-a-Watt for my 6450-48p running on 120V - sounds like a wonky power meter
Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)
- Thread starter fohdeesha
- Start date
Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.
Stupid question.. is it possible to bridge two ports on the 6610... I'm trying to simplify my network a little.. my primary gateway uses a dual gig card passed through via pci-passthrough. I am trying to migrate off that vmware server, so I want to connect my incoming gig connection (FIOS) to the switch, and then pass that through to a host which has a new gateway but uses virtual interfaces, on a private vlan.
I take the Ethernet handoff from my ISP straight to my switch in a L2 VLAN that's trunked to my hosts. I haven't used PVLAN, so can't help you there.
Yep, use a spare VLAN without a router interface defined on it, use it as the native/untagged VLAN (if your ethernet handoff doesn't require a tagged VLAN, I don't know the details of the FiOS offer) on a port connected to the ISP and as a tagged VLAN on the router-on-a-stick
Tossed this in its own thread but realized I should probably of just just it here..
Snagged an ICX6610 last year due to the popular thread here and my passing familiarity with them at a previous job. I'm using all but 1 of my 10g SFP+ ports up front, so when I bought another pair of ESXi nodes I wanted to use one of the QSFP+ breakout ports on the rear, but I'm running into some oddities. I'm using 1/2/6 as a 40g port to TrueNAS with no issues and had used 1/2/1 previously without trouble.
I've got 2 Cisco QSFP+ to SFP+ breakout cables, I believe they're passive but I'm not 100% sure on the model number, but can probably dig it up if that's helpful.
When I plug into the top QSFP+ it'll link up port 1/2/5 but not 1/2/2 - 1/2/4, only port 5. When I plug into the bottom QSFP+ port none of the ports 1/2/7 to 1/2/10 light up. They did briefly earlier today for a little bit but stopped seemingly after I added them to a VLAN, but I couldn't get them back up even after reverting the changes. I swapped between the 2 breakout cables and the behavior was the same. Also tried plugging the SFP+ ports 1-3 into known good hosts and they didn't link, but they work fine when connected to the front SFP+ ports.
I'm curious if it's likely an issue with the cable or I'm missing something else. I did order a 10gTek QSFP+ to SFP+ breakout cable that'll be in tomorrow.
Here's snippets of my running config for the pertinent ports:
It looks like it's being detected in show media:
Snagged an ICX6610 last year due to the popular thread here and my passing familiarity with them at a previous job. I'm using all but 1 of my 10g SFP+ ports up front, so when I bought another pair of ESXi nodes I wanted to use one of the QSFP+ breakout ports on the rear, but I'm running into some oddities. I'm using 1/2/6 as a 40g port to TrueNAS with no issues and had used 1/2/1 previously without trouble.
I've got 2 Cisco QSFP+ to SFP+ breakout cables, I believe they're passive but I'm not 100% sure on the model number, but can probably dig it up if that's helpful.
When I plug into the top QSFP+ it'll link up port 1/2/5 but not 1/2/2 - 1/2/4, only port 5. When I plug into the bottom QSFP+ port none of the ports 1/2/7 to 1/2/10 light up. They did briefly earlier today for a little bit but stopped seemingly after I added them to a VLAN, but I couldn't get them back up even after reverting the changes. I swapped between the 2 breakout cables and the behavior was the same. Also tried plugging the SFP+ ports 1-3 into known good hosts and they didn't link, but they work fine when connected to the front SFP+ ports.
I'm curious if it's likely an issue with the cable or I'm missing something else. I did order a 10gTek QSFP+ to SFP+ breakout cable that'll be in tomorrow.
Here's snippets of my running config for the pertinent ports:
Current configuration:
!
ver 08.0.30tT7f3
!
stack unit 1
module 1 icx6610-48p-poe-port-management-module
module 2 icx6610-qsfp-10-port-160g-module
module 3 icx6610-8-port-10g-dual-mode-module
!
global-stp
...
interface ethernet 1/1/48
port-name Uplink to Firewall
dual-mode 1001
!
interface ethernet 1/2/6
dual-mode
!
interface ethernet 1/3/1
port-name Ravager ESXi VM Uplink
dual-mode
speed-duplex 10G-fullIt looks like it's being detected in show media:
Port 1/2/1: Type : EMPTY
Port 1/2/2: Type : EMPTY
Port 1/2/3: Type : EMPTY
Port 1/2/4: Type : EMPTY
Port 1/2/5: Type : EMPTY
Port 1/2/6: Type : 40GE-Passive Copper
Port 1/2/7: Type : 40GBASE-Passive Copper
Port 1/2/8: Type : 40GBASE-Passive Copper
Port 1/2/9: Type : 40GBASE-Passive Copper
Port 1/2/10: Type : 40GBASE-Passive Copper@infoMatt - I'm trying to do something like this....Yep, use a spare VLAN without a router interface defined on it, use it as the native/untagged VLAN (if your ethernet handoff doesn't require a tagged VLAN, I don't know the details of the FiOS offer) on a port connected to the ISP and as a tagged VLAN on the router-on-a-stick
I have the SB8200 cable modem that supports a static link aggregation and I want to send those two ports to cable modem, then have the "output" of that going to a VLAN on one of my 10GB ports.
Any tutorial on the internet for the brocade to help set that up?
Does it support LACP?
If so, probably something like this:
#Create lag
LAG "WAN" dynamic id 1
ports eth 1/1/47 to 48
primary-port 1/1/47
deploy
#Create VLAN 1003 for WAN
vlan 1003 name "WAN"
#Set modem ports to untag
untag eth 1/1/47 to 48
#Tag ports to 10g
tag eth 1/3/8That looks like it will work, but try changing the lag to static if it won't come up with dynamic. Also check to see if you want the 10g port to be tagged or untagged to the new gateway
No it doesn't support dynamic has to be static....
This is the part i don't understand...
How do you 'route' all the data from 47/48 to 1/2/4 ( 10G port). Do i just tag ports 1/1/47 - 1/1/48 and port 1/2/4 with the VLAN ?
This is the part i don't understand...
Code:
#Tag ports to 10g
tag eth 1/3/8How do you 'route' all the data from 47/48 to 1/2/4 ( 10G port). Do i just tag ports 1/1/47 - 1/1/48 and port 1/2/4 with the VLAN ?
You'd have to pipe that traffic somewhere, I assumed the 10g port uplinks to a PFsense box / VM or something of that nature which would actually route.
Depending on what you're using for a firewall and how it's setup will change if it's tagged or untagged.
Yes I have the pfsense setup to have the WAN interface to be ix0.10 and the LAN to be ix0
I'm just not clear on how to segregate the cable modem traffic on ports 47 / 48 from being on the rest of the switch.
In that case it sounds like ix0.10 is VLAN10 on the WAN port, so you'd want to do a
vlan 10
tag eth 1/1/47 to 1/1/48to add those to VLAN 10.
A VLAN is a virtual LAN, like carving out ports on the switch. Anything in VLAN10 would be on the same layer 2 network as your modem, but only devices in that VLAN would see that traffic.
Do you have other ports on VLAN10 in the switch? Additionally, what's the topology for the LAN interface?
Everything is flat right now, I'm setting up the VLAN because I want to only have one interface card in my router, but I have to have the link aggregation in the cable modem to get the full 1.2 GB/s
So I've run the following
Code:
vlan 10 name "CM_WAN"
untag eth 1/1/47 to 1/1/48
show vlan
Total PORT-VLAN entries: 2
Maximum PORT-VLAN entries: 64
Legend: [Stk=Stack-Id, S=Slot]
PORT-VLAN 1, Name DEFAULT-VLAN, Priority level0, Spanning tree Off
Untagged Ports: (U1/M1) 1 2 3 4 5 6 7 8 9 10 11 12
Untagged Ports: (U1/M1) 13 14 15 16 17 18 19 20 21 22 23 24
Untagged Ports: (U1/M1) 25 26 27 28 29 30 31 32 33 34 35 36
Untagged Ports: (U1/M1) 37 38 39 40 41 42 43 44 45 46
Untagged Ports: (U1/M2) 1 2 3 4
Tagged Ports: None
Uplink Ports: None
DualMode Ports: None
Mac-Vlan Ports: None
Monitoring: Disabled
PORT-VLAN 10, Name CM_WAN, Priority level0, Spanning tree Off
Untagged Ports: (U1/M1) 47 48
Tagged Ports: None
Uplink Ports: None
DualMode Ports: None
Mac-Vlan Ports: None
Monitoring: DisabledThat'd depend on the modem, here's the SB8200 config, looks like it's LACP.
You'd want to tag your 10g port as well, something like
vlan 10
tag eth 1/3/1That would get your WAN link online for PFsense. It looks like your LAN is untagged, are you intending to have the WAN/LAN share the same 10g port?
Yes, that's the plan... so the ix0 interface should do all the LAN port stuff and ix0.10 should do all the WAN stuff.
Code:
SSH@switchpoe(config)#show vlan
Total PORT-VLAN entries: 2
Maximum PORT-VLAN entries: 64
Legend: [Stk=Stack-Id, S=Slot]
PORT-VLAN 1, Name DEFAULT-VLAN, Priority level0, Spanning tree Off
Untagged Ports: (U1/M1) 1 2 3 4 5 6 7 8 9 10 11 12
Untagged Ports: (U1/M1) 13 14 15 16 17 18 19 20 21 22 23 24
Untagged Ports: (U1/M1) 25 26 27 28 29 30 31 32 33 34 35 36
Untagged Ports: (U1/M1) 37 38 39 40 41 42 43 44 45 46
Untagged Ports: (U1/M2) 1 2 3
Tagged Ports: None
Uplink Ports: None
DualMode Ports: (U1/M2) 4
Mac-Vlan Ports: None
Monitoring: Disabled
PORT-VLAN 10, Name CM_WAN, Priority level0, Spanning tree Off
Untagged Ports: (U1/M1) 47 48
Tagged Ports: (U1/M2) 4
Uplink Ports: None
DualMode Ports: None
Mac-Vlan Ports: None
Monitoring: DisabledI had the dual-mode config typed out but noticed you have that already. They looks like it should probably be working.
Ok I Finally got it working....
A lot of fickle stuff going on here. I DID in fact have to use dynamic lag not static and I had to reboot the modem and restart pfsense lots of times. Also had a lot of problems getting DNS working for some crazy reason... very strange. I haven't turned on any buffer bloat settings. I've been using IPFIRE as my firewall router, but i'm going to play around with pfsense to see if they fixed their QoS controls.
A lot of fickle stuff going on here. I DID in fact have to use dynamic lag not static and I had to reboot the modem and restart pfsense lots of times. Also had a lot of problems getting DNS working for some crazy reason... very strange. I haven't turned on any buffer bloat settings. I've been using IPFIRE as my firewall router, but i'm going to play around with pfsense to see if they fixed their QoS controls.
Attachments
Rebooting a bunch makes sense, I know my modem won't hand out an IP to another MAC address without a reboot.
For what it's worth, I think OPNsense is a bit better virtualized and you can get various tools like XCP-NG's and VMware's as packages. Might be worth looking into if you're not sold on PFsense.
The DNS bit is strange, can't say I've seen that before.
Based on the breakdown of the switches, it looks like you need the ICX6610 to do BGP.