LACP Omnios and C3750

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

wildchild

Active Member
Feb 4, 2014
389
57
28
Guys,
been having a odd issue with my Omnios box and c3750
the omnios box has 6 interfaces ( 2 e1000g and 4 igb)
somehow the LACP bonding between the igb's and my cisco's will not stay in sync, while the same lacp config runs fine over the e1000's :
channel 5 = e1000g's channel 6 and 7 are the igb's :
Channel group 5 neighbors
Partner's information:
LACP port Admin Oper Port Port
Port Flags Priority Dev ID Age key Key Number State
Gi1/0/14 FA 4096 0030.48d5.ec94 23s 0x0 0x3E8 0x2 0x3F
Gi2/0/14 FA 4096 0030.48d5.ec94 23s 0x0 0x3E8 0x1 0x3F
Channel group 6 neighbors
Partner's information:
LACP port Admin Oper Port Port
Port Flags Priority Dev ID Age key Key Number State
Gi1/0/10 FA 4096 a036.9f02.c13a 0s 0x0 0x3EA 0x6 0x47
Gi1/0/12 FA 4096 a036.9f02.c13a 0s 0x0 0x3EA 0x5 0x47
Channel group 7 neighbors
Partner's information:
LACP port Admin Oper Port Port
Port Flags Priority Dev ID Age key Key Number State
Gi2/0/10 FA 4096 a036.9f02.c138 0s 0x0 0x3E9 0x4 0x47
Gi2/0/11 FA 4096 a036.9f02.c138 0s 0x0 0x3E9 0x3 0x47
LINK POLICY ADDRPOLICY LACPACTIVITY LACPTIMER FLAGS
aggr0 L4 auto active short -----
aggr1 L4 auto active short -----
aggr2 L4 auto active short -----
aggr0 -- up 1000Mb full static x.x.x.x 255.255.255.0 x:x:x:x:x:x 1500
e1000g0 attached up 1000Mb full - - - x:x:x:x:x:x 1500
e1000g1 attached up 1000Mb full - - - x:x:x:x:x:x 1500
aggr1 -- up 1000Mb full static x.x.x.x 255.255.255.0 x:x:x:x:x:x 1500
igb0 attached up 1000Mb full - - - x:x:x:x:x:x 1500
igb1 attached up 1000Mb full - - - x:x:x:x:x:x 1500
aggr2 -- up 1000Mb full static x.x.x.x 255.255.255.0 x:x:x:x:x:x 1500
igb2 attached up 1000Mb full - - - x:x:x:x:x:x 1500
igb3 attached up 1000Mb full - - - x:x:x:x:x:x 1500
058673: Dec 8 22:15:51.593: lacp_mux Gi2/0/10 - mux: during state WAITING, got event 1(selected)
058674: Dec 8 22:15:51.593: @@@ lacp_mux Gi2/0/10 - mux: WAITING -> WAITING
058675: Dec 8 22:15:51.593: LACP: Gi2/0/10 lacp_action_mx_waiting entered
058676: Dec 8 22:15:51.593: LACP: timer lacp_w(Gi2/0/10) started with interval 2000.
058677: Dec 8 22:15:51.895: LACP :lacp_bugpak: Receive LACP-PDU packet via Gi2/0/10
058678: Dec 8 22:15:51.895: LACP : packet size: 124
058679: Dec 8 22:15:51.895: LACP: pdu: subtype: 1, version: 1
058680: Dec 8 22:15:51.895: LACP: Act: tlv:1, tlv-len:20, key:0x3E9, p-pri:0x1000, p:0x4, p-state:0x47,
s-pri:0x1000, s-mac:a036.9f02.c138
058681: Dec 8 22:15:51.895: LACP: Part: tlv:2, tlv-len:20, key:0x0, p-pri:0x0, p:0x0, p-state:0xA,
s-pri:0x0, s-mac:0000.0000.0000
058682: Dec 8 22:15:51.895: LACP: col-tlv:3, col-tlv-len:16, col-max-d:0xA
058683: Dec 8 22:15:51.895: LACP: term-tlv:0 termr-tlv-len:0
058684: Dec 8 22:15:51.895: LACP: Gi2/0/10 LACP packet received, processing
058685: Dec 8 22:15:51.895: lacp_rx Gi2/0/10 - rx: during state CURRENT, got event 5(recv_lacpdu)
058686: Dec 8 22:15:51.895: @@@ lacp_rx Gi2/0/10 - rx: CURRENT -> CURRENT
058687: Dec 8 22:15:51.895: LACP: Gi2/0/10 lacp_action_rx_current entered
058688: Dec 8 22:15:51.895: LACP: Gi2/0/10 set to UNSELECTED
058689: Dec 8 22:15:51.895: lacp_mux Gi2/0/10 - mux: during state WAITING, got event 3(unselected)
058690: Dec 8 22:15:51.895: @@@ lacp_mux Gi2/0/10 - mux: WAITING -> DETACHED
058691: Dec 8 22:15:51.895: LACP: Gi2/0/10 lacp_action_mx_detached entered
058692: Dec 8 22:15:51.895: LACP: Gi2/0/10 Resetting hw_sw constraints
058693: Dec 8 22:15:51.895: LACP: lacp_insert_partner_cd_inhibitor: didn't change sync flag.
058694: Dec 8 22:15:51.895: LACP: lacp_send_lacpdu: (Gi2/0/10) About to send the 110 LACPDU
058695: Dec 8 22:15:51.895: LACP :lacp_bugpak: Send LACP-PDU packet via Gi2/0/10
058696: Dec 8 22:15:51.895: LACP : packet size: 124
058697: Dec 8 22:15:51.895: LACP: pdu: subtype: 1, version: 1
058698: Dec 8 22:15:51.895: LACP: Act: tlv:1, tlv-len:20, key:0x7, p-pri:0x8000, p:0x20B, p-state:0x5,
s-pri:0x8000, s-mac:0019.aa89.b580
058699: Dec 8 22:15:51.895: LACP: Part: tlv:2, tlv-len:20, key:0x3E9, p-pri:0x1000, p:0x4, p-state:0x47,
s-pri:0x1000, s-mac:a036.9f02.c138
058700: Dec 8 22:15:51.895: LACP: col-tlv:3, col-tlv-len:16, col-max-d:0x8000
058701: Dec 8 22:15:51.895: LACP: term-tlv:0 termr-tlv-len:0
058702: Dec 8 22:15:51.895: LACP: lacp_write: LACP 124 bytes out Gi2/0/10
058703: Dec 8 22:15:51.895: lacp_handle_standby_port_internal called, depth = 1
058704: Dec 8 22:15:51.895: LACP: recordPDU Gi2/0/10 LACP PDU Rcvd. Partners oper state is hex 47
058705: Dec 8 22:15:51.895: LACP: recordPDU Gi2/0/10 Partner out of sync
058706: Dec 8 22:15:51.895: LACP: Gi2/0/10 Partners oper state is hex 47
058707: Dec 8 22:15:51.895: LACP: timer lacp_c_l(Gi2/0/10) started with interval 90000.
058708: Dec 8 22:15:51.895: LACP: Gi2/0/10 LAG_PARTNER_UP.
058709: Dec 8 22:15:51.895: LACP: Gi2/0/10 LAG unchanged
058710: Dec 8 22:15:51.903: LACP: Gi2/0/10 STANDBY aggregator hex address is 5FB71A4
058711: Dec 8 22:15:51.903: LACP: Gi2/0/10 set to STANDBY
058712: Dec 8 22:15:51.903: lacp_mux Gi2/0/10 - mux: during state DETACHED, got event 2(standby)
058713: Dec 8 22:15:51.903: @@@ lacp_mux Gi2/0/10 - mux: DETACHED -> WAITING
058714: Dec 8 22:15:51.903: LACP: Gi2/0/10 lacp_action_mx_waiting entered
058715: Dec 8 22:15:51.903: @@@ lacp_mux Gi2/0/10 - mux: WAITING -> WAITING
058716: Dec 8 22:15:51.903: lacp_mux Gi2/0/10 - mux: during state WAITING, got event 6(outof_sync) (ignored)
058717: Dec 8 22:15:51.903: LACP :lacp_bugpak: Receive LACP-PDU packet via Gi2/0/11
058718: Dec 8 22:15:51.903: LACP : packet size: 124
058719: Dec 8 22:15:51.903: LACP: pdu: subtype: 1, version: 1
058720: Dec 8 22:15:51.903: LACP: Act: tlv:1, tlv-len:20, key:0x3E9, p-pri:0x1000, p:0x3, p-state:0x47,
s-pri:0x1000, s-mac:a036.9f02.c138
058721: Dec 8 22:15:51.903: LACP: Part: tlv:2, tlv-len:20, key:0x0, p-pri:0x0, p:0x0, p-state:0xA,
s-pri:0x0, s-mac:0000.0000.0000
058722: Dec 8 22:15:51.903: LACP: col-tlv:3, col-tlv-len:16, col-max-d:0xA
058723: Dec 8 22:15:51.903: LACP: term-tlv:0 termr-tlv-len:0
058724: Dec 8 22:15:51.903: LACP: Gi2/0/11 LACP packet received, processing
058725: Dec 8 22:15:51.903: lacp_rx Gi2/0/11 - rx: during state CURRENT, got event 5(recv_lacpdu)
058726: Dec 8 22:15:51.903: @@@ lacp_rx Gi2/0/11 - rx: CURRENT -> CURRENT
058727: Dec 8 22:15:51.903: LACP: Gi2/0/11 lacp_action_rx_current entered
058728: Dec 8 22:15:51.903: LACP: Gi2/0/11 set to UNSELECTED
058729: Dec 8 22:15:51.903: lacp_mux Gi2/0/11 - mux: during state WAITING, got event 3(unselected)
058730: Dec 8 22:15:51.903: @@@ lacp_mux Gi2/0/11 - mux: WAITING -> DETACHED
058731: Dec 8 22:15:51.903: LACP: Gi2/0/11 lacp_action_mx_detached entered
058732: Dec 8 22:15:51.903: LACP: Gi2/0/11 Resetting hw_sw constraints
058733: Dec 8 22:15:51.903: LACP: lacp_insert_partner_cd_inhibitor: didn't change sync flag.
058734: Dec 8 22:15:51.903: LACP: lacp_send_lacpdu: (Gi2/0/11) About to send the 110 LACPDU
058735: Dec 8 22:15:51.903: LACP :lacp_bugpak: Send LACP-PDU packet via Gi2/0/11
058736: Dec 8 22:15:51.903: LACP : packet size: 124
058737: Dec 8 22:15:51.903: LACP: pdu: subtype: 1, version: 1
058738: Dec 8 22:15:51.903: LACP: Act: tlv:1, tlv-len:20, key:0x7, p-pri:0x8000, p:0x20C, p-state:0x5,
s-pri:0x8000, s-mac:0019.aa89.b580
058739: Dec 8 22:15:51.903: LACP: Part: tlv:2, tlv-len:20, key:0x3E9, p-pri:0x1000, p:0x3, p-state:0x47,
s-pri:0x1000, s-mac:a036.9f02.c138


so in short, i see it comming up, shows out of sync, and down it goes...
have tried short times, long times active , passive... nothing will work
 

sag

Member
Apr 26, 2013
34
6
8
can you provide the show run int config for each of the interfaces that you used in the channel groups?
 

wildchild

Active Member
Feb 4, 2014
389
57
28
config on switch side is 100% same for all 6 ports .
also channel port are configured the same between the e1000g's and igb's... will post them a little later
 

wildchild

Active Member
Feb 4, 2014
389
57
28
interface Port-channel6
!
interface Port-channel7
!
interface GigabitEthernet1/0/10
description PSD01-IGB0
switchport mode access
duplex full
channel-group 6 mode active
spanning-tree link-type point-to-point
!
interface GigabitEthernet1/0/12
description PSD01-IGB1
switchport mode access
duplex full
channel-group 6 mode active
spanning-tree link-type point-to-point
!
interface GigabitEthernet2/0/10
description PSD01-IGB2
switchport mode access
duplex full
channel-group 7 mode active
spanning-tree link-type point-to-point
!
interface GigabitEthernet2/0/11
description PSD02-IGB3
switchport mode access
duplex full
channel-group 7 mode active
spanning-tree portfast
spanning-tree link-type point-to-point
!

i think this would nothing special..
 

wildchild

Active Member
Feb 4, 2014
389
57
28
this just keeps getting stranger by the minute.
after removing the aggr's and setting a static ip on each interface,
i can ping from the host itself, but not through a wire, direct or through a switch.
plugged in a new intel i350, same deal...
when looking at the driver, i see that the is a update date of november 6....