Arista 7050QX-32 - no link in ports 1-24

[DangerMc]

Hoping someone could assist as I am having issues getting a connection between the Arista and a brocade switch.
Both switches accept generic transceivers (followed the instructions here to make the arista switch accept other vendors transceivers)

From what I can see, the ports from 1-24 supports 4x10GB and also 40GB.
Ports from 25-32 supports 40GB.

When I connect the setup to a port in the 25-32 range, it is recognized and successfully connects to the brocade switch.
However, when I move it to any port from 1-24, I get no connection/link. I have configured the port to force 40GB but still no connection.

So I am assuming I am missing some configuration, unless the Arista only supports breakouts in ports from 1-24?

Any help or suggestions, debugging tips etc would be greatly appreciated.

Thanks

 

[i386]

Did you try
Shutdown
No shutdown
?

 

[DangerMc]

Yes, tried that just now.
Here is (part) of the configuration of the interface

Ethernet19/1 is down, line protocol is down (notconnect)
  Hardware is Ethernet, address is xxxx.xxxx.xxxx (bia xxxx.xxxx.xxxx)
  Ethernet MTU 9214 bytes , BW 40000000 kbit
  Full-duplex, 40Gb/s, auto negotiation: off, uni-link: n/a
  Down 85 days, 18 hours, 3 minutes, 39 seconds
  Loopback Mode : None

And the running config :

   speed forced 40gfull
   switchport trunk allowed vlan 1,150
   switchport mode trunk

 

[NablaSquaredG]

Which EOS version? Can you post the full output of show run?
Can you post the full output of show interfaces status?

 

[DangerMc]

! Command: show running-config
! device: serverswitch (DCS-7050QX-32, EOS-4.24.11M-2GB)
!
! boot system flash:/EOS-4.24.11.swi
!
transceiver qsfp default-mode 4x10G
!
service routing protocols model ribd
!
hostname serverswitch
!
snmp-server engineID
snmp-server view
snmp-server view
snmp-server view
snmp-server group
snmp-server user
snmp-server host 192.168.xxx.xxx version 3 auth librenms
!
spanning-tree mode mstp
!
service unsupported-transceiver EMC 677096c7
!
no aaa root
!
username super secret sha512 superduper
!
vlan 50
!
vlan 150
   name DNSVlan
!
interface Ethernet1/1
   speed forced 40gfull
   switchport trunk allowed vlan 1,150
   switchport mode trunk
!
interface Ethernet1/2
   speed forced 40gfull
!
interface Ethernet1/3
   speed forced 40gfull
!
interface Ethernet1/4
   speed forced 40gfull
!
interface Ethernet2/1
!
interface Ethernet2/2
!
interface Ethernet2/3
!
interface Ethernet2/4
!
interface Ethernet3/1
!
interface Ethernet3/2
!
interface Ethernet3/3
!
interface Ethernet3/4
!
interface Ethernet4/1
!
interface Ethernet4/2
!
interface Ethernet4/3
!
interface Ethernet4/4
!
interface Ethernet5/1
!
interface Ethernet5/2
!
interface Ethernet5/3
!
interface Ethernet5/4
!
interface Ethernet6/1
!
interface Ethernet6/2
!
interface Ethernet6/3
!
interface Ethernet6/4
!
interface Ethernet7/1
!
interface Ethernet7/2
interface Ethernet7/3
!
interface Ethernet7/4
!
interface Ethernet8/1
!
interface Ethernet8/2
!
interface Ethernet8/3
!
interface Ethernet8/4
!
interface Ethernet9/1
!
interface Ethernet9/2
!
interface Ethernet9/3
!
interface Ethernet9/4
!
interface Ethernet10/1
!
interface Ethernet10/2
!
interface Ethernet10/3
!
interface Ethernet10/4
!
interface Ethernet11/1
!
interface Ethernet11/2
!
interface Ethernet11/3
!
interface Ethernet11/4
!
interface Ethernet12/1
!
interface Ethernet12/2
!
interface Ethernet12/3
!
interface Ethernet12/4
!
interface Ethernet13/1
interface Ethernet13/2
!
interface Ethernet13/3
!
interface Ethernet13/4
!
interface Ethernet14/1
!
interface Ethernet14/2
!
interface Ethernet14/3
!
interface Ethernet14/4
!
interface Ethernet15/1
!
interface Ethernet15/2
!
interface Ethernet15/3
!
interface Ethernet15/4
!
interface Ethernet16/1
!
interface Ethernet16/2
!
interface Ethernet16/3
!
interface Ethernet16/4
!
interface Ethernet17/1
!
interface Ethernet17/2
!
interface Ethernet17/3
!
interface Ethernet17/4
!
interface Ethernet18/1
!
interface Ethernet18/2
!
interface Ethernet18/3
interface Ethernet18/4
!
interface Ethernet19/1
   speed forced 40gfull
   switchport trunk allowed vlan 1,150
   switchport mode trunk
!
interface Ethernet20/1
!
interface Ethernet20/2
!
interface Ethernet20/3
!
interface Ethernet20/4
!
interface Ethernet21/1
   speed forced 40gfull
!
interface Ethernet22/1
!
interface Ethernet22/2
!
interface Ethernet22/3
!
interface Ethernet22/4
!
interface Ethernet23/1
!
interface Ethernet23/2
!
interface Ethernet23/3
!
interface Ethernet23/4
!
interface Ethernet24/1
!
interface Ethernet24/2
!
interface Ethernet24/3
!
interface Ethernet24/4
!
interface Ethernet25
   speed forced 40gfull
interface Ethernet24/4
!
interface Ethernet25
   speed forced 40gfull
   switchport trunk allowed vlan 1,50,150
   switchport mode trunk
!
interface Ethernet26
   speed forced 40gfull
   switchport trunk allowed vlan 1,150
   switchport mode trunk
!
interface Ethernet27
   switchport trunk allowed vlan 1,150
   switchport mode trunk
!
interface Ethernet28
   switchport trunk allowed vlan 1,150
   switchport mode trunk
!
interface Ethernet29
   speed forced 40gfull
   switchport trunk allowed vlan 1,150
   switchport mode trunk
!
interface Ethernet30
   switchport trunk allowed vlan 1,150
   switchport mode trunk
!
interface Ethernet31
   speed forced 40gfull
   switchport mode trunk
!
interface Ethernet32
   switchport trunk allowed vlan 1,150
   switchport mode trunk
!
interface Management1
   ip address 192.168.xxx.xxx/24
!
no ip routing
!
ip route 0.0.0.0/0 192.168.xxx.xxx
!
end

Port       Name   Status       Vlan     Duplex Speed  Type         Flags Encapsulation
Et1/1             notconnect   trunk    full   40G    40GBASE-SRBD
Et2/1             notconnect   1        full   10G    Not Present
Et2/2             notconnect   1        full   10G    Not Present
Et2/3             notconnect   1        full   10G    Not Present
Et2/4             notconnect   1        full   10G    Not Present
Et3/1             notconnect   1        full   10G    Not Present
Et3/2             notconnect   1        full   10G    Not Present
Et3/3             notconnect   1        full   10G    Not Present
Et3/4             notconnect   1        full   10G    Not Present
Et4/1             notconnect   1        full   10G    Not Present
Et4/2             notconnect   1        full   10G    Not Present
Et4/3             notconnect   1        full   10G    Not Present
Et4/4             notconnect   1        full   10G    Not Present
Et5/1             notconnect   1        full   10G    Not Present
Et5/2             notconnect   1        full   10G    Not Present
Et5/3             notconnect   1        full   10G    Not Present
Et5/4             notconnect   1        full   10G    Not Present
Et6/1             notconnect   1        full   10G    Not Present
Et6/2             notconnect   1        full   10G    Not Present
Et6/3             notconnect   1        full   10G    Not Present
Et6/4             notconnect   1        full   10G    Not Present
Et7/1             notconnect   1        full   10G    Not Present
Et7/2             notconnect   1        full   10G    Not Present
Et7/3             notconnect   1        full   10G    Not Present
Et7/4             notconnect   1        full   10G    Not Present
Et8/1             notconnect   1        full   10G    Not Present
Et8/2             notconnect   1        full   10G    Not Present
Et8/3             notconnect   1        full   10G    Not Present
Et8/4             notconnect   1        full   10G    Not Present
Et9/1             notconnect   1        full   10G    Not Present
Et9/2             notconnect   1        full   10G    Not Present
Et9/3             notconnect   1        full   10G    Not Present
Et9/4             notconnect   1        full   10G    Not Present
Et10/1            notconnect   1        full   10G    Not Present
Et10/2            notconnect   1        full   10G    Not Present
Et10/3            notconnect   1        full   10G    Not Present
Et10/4            notconnect   1        full   10G    Not Present
Et11/1            notconnect   1        full   10G    Not Present
Et11/2            notconnect   1        full   10G    Not Present
Et11/3            notconnect   1        full   10G    Not Present
Et11/4            notconnect   1        full   10G    Not Present
Et12/1            notconnect   1        full   10G    Not Present
Et12/2            notconnect   1        full   10G    Not Present
Et12/3            notconnect   1        full   10G    Not Present
Et12/4            notconnect   1        full   10G    Not Present
Et13/1            notconnect   1        full   10G    Not Present
Et13/2            notconnect   1        full   10G    Not Present
Et13/3            notconnect   1        full   10G    Not Present
Et13/4            notconnect   1        full   10G    Not Present
Et14/1            notconnect   1        full   10G    Not Present
Et14/2            notconnect   1        full   10G    Not Present
Et14/3            notconnect   1        full   10G    Not Present
Et14/4            notconnect   1        full   10G    Not Present
Et15/1            notconnect   1        full   10G    Not Present
Et15/2            notconnect   1        full   10G    Not Present
Et15/3            notconnect   1        full   10G    Not Present
Et15/4            notconnect   1        full   10G    Not Present
Et16/1            notconnect   1        full   10G    Not Present
Et16/2            notconnect   1        full   10G    Not Present
Et16/3            notconnect   1        full   10G    Not Present
Et16/4            notconnect   1        full   10G    Not Present
Et17/1            notconnect   1        full   10G    Not Present
Et17/2            notconnect   1        full   10G    Not Present
Et17/3            notconnect   1        full   10G    Not Present
Et17/4            notconnect   1        full   10G    Not Present
Et18/1            notconnect   1        full   10G    Not Present
Et18/2            notconnect   1        full   10G    Not Present
Et18/3            notconnect   1        full   10G    Not Present
Et18/4            notconnect   1        full   10G    Not Present
Et19/1            notconnect   trunk    full   40G    40GBASE-SRBD
Et20/1            notconnect   1        full   10G    Not Present
Et20/2            notconnect   1        full   10G    Not Present
Et20/3            notconnect   1        full   10G    Not Present
Et20/4            notconnect   1        full   10G    Not Present
Et21/1            notconnect   1        full   40G    Not Present
Et22/1            notconnect   1        full   10G    Not Present
Et22/2            notconnect   1        full   10G    Not Present
Et22/3            notconnect   1        full   10G    Not Present
Et22/4            notconnect   1        full   10G    Not Present
Et23/1            notconnect   1        full   10G    Not Present
Et23/2            notconnect   1        full   10G    Not Present
Et23/3            notconnect   1        full   10G    Not Present
Et23/4            notconnect   1        full   10G    Not Present
Et24/1            notconnect   1        full   10G    Not Present
Et24/2            notconnect   1        full   10G    Not Present
Et24/3            notconnect   1        full   10G    Not Present
Et24/4            notconnect   1        full   10G    Not Present
Et25              connected    trunk    full   40G    40GBASE-SR4
Et26              connected    trunk    full   40G    40GBASE-XSR4
Et25              connected    trunk    full   40G    40GBASE-SR4
Et26              connected    trunk    full   40G    40GBASE-XSR4
Et27              connected    trunk    full   40G    40GBASE-SR4
Et28              connected    trunk    full   40G    40GBASE-SR4
Et29              connected    trunk    full   40G    40GBASE-SR4
Et30              connected    trunk    full   40G    40GBASE-XSR4
Et31              notconnect   trunk    full   40G    Not Present
Et32              connected    trunk    full   40G    40GBASE-SR4
Ma1               connected    routed   a-full a-1G   10/100/1000

 

[NablaSquaredG]

!
interface Ethernet1/1
   speed forced 40gfull
   switchport trunk allowed vlan 1,150
   switchport mode trunk
!
interface Ethernet1/2
   speed forced 40gfull
!
interface Ethernet1/3
   speed forced 40gfull
!
interface Ethernet1/4
   speed forced 40gfull

that's wrong, speed forced 40gfull only on the X/1 interfaces

it's not set on most of your interfaces, you're aware of that?

Only 19/1 and 21/1 look good so far.


What's the output of show interfaces status and show interfaces status errdisabled?

 

[DangerMc]

!
interface Ethernet1/1
   speed forced 40gfull
   switchport trunk allowed vlan 1,150
   switchport mode trunk
!
interface Ethernet1/2
   speed forced 40gfull
!
interface Ethernet1/3
   speed forced 40gfull
!
interface Ethernet1/4
   speed forced 40gfull

that's wrong, speed forced 40gfull only on the X/1 interfaces

it's not set on most of your interfaces, you're aware of that?

Only 19/1 and 21/1 look good so far.


What's the output of show interfaces status and show interfaces status errdisabled?

19 is the port that I have the brocade connected to. I haven't managed to connect up the others yet, until I figure out what I have done wrong.

show interfaces status errdisabled

returns empty/nothing.

 

[NablaSquaredG]

19 is the port that I have the brocade connected to. I haven't managed to connect up the others yet, until I figure out what I have done wrong.

The only thing I'm noticing:

All your "good" ports (25-32) use 40GBASE-SR4 / 40GBASE-XSR4

Port 1 and 19 which don't work use 40GBASE-SRBD. Maybe try a different transceiver type?

 

[DangerMc]

Yes, I did try the Bidi transceivers (setup) in one of the 25-32 ports and they work.
I could maybe just swap one in port 25 or 26 for the one in port 19 and see if that works. If so, then I should be set.

 

[DangerMc]

Some quick testing, it certainly looks like either brocade or arista does not like bidi transceivers.
I tried different bidi manufacturer (some manufacturer on both sides) but none of them shows connected on any port...

 

[DangerMc]

Some quick testing, it certainly looks like either brocade or arista does not like bidi transceivers.
I tried different bidi manufacturer (some manufacturer on both sides) but none of them shows connected on any port...

3 different transceiver manufacturer (Avego, Brocade and Cisco), two different cables, and three different devices, still no connection between any (Tried one of the test servers that was connected to the Arista switch)..

 

[DangerMc]

Does anyone know if there are any issues with using an OM3 Multimode cable?
From what I gather, there shouldn't be an issue but after some googling I am not so sure anymore...

 

[NablaSquaredG]

Some quick testing, it certainly looks like either brocade or arista does not like bidi transceivers.

Have you tried a simple loopback on the Arista and the Brocade (just make sure you don't get any loops and broadcast storm)?

This should rule out quite quickly which switch is the issue.

Does anyone know if there are any issues with using an OM3 Multimode cable?

Nope, shouldn't be an issue.

 

[DangerMc]

Have you tried a simple loopback on the Arista and the Brocade (just make sure you don't get any loops and broadcast storm)?

This should rule out quite quickly which switch is the issue.


Nope, shouldn't be an issue.

No, I haven't tried that. Not sure how I go about doing that though.

I did however try to connect each switch to one of my servers and then to both the brocade and arista switch without any luck. Once I unplugged the bidi transceiver(s) and plugged the original SR4 transceiver back in, the link was reestablished.