Hi,
Simple LAB test of RoCE with Arista 7150 not working as expected.
When querying DCBX status from Arista is says no "0 application priorities configured". See below for config applied.
Goal is to sync DCBX to windows servers, but it only sync the traffic class, not the port/application defined in the class, obviously, since Arista switch says no application priorities configured.
Layout;
Server 2019 with Mellanox ConnectX-4Lx <---> Arista 7150 <---> Server 2019 with Mellanox ConnectX-4Lx
One cable to one port.
Latest firmware on switch and NICs
All prerequisites enabled; LLDP, DCBX, VLAN
Set port 445 as traffic class 6 on the switch
Set traffic class 6 on priority level 6 on the switch
When checking the DCBX settings on the port on the switch it shows that traffic class 6 is set/defined, but no application/port is shown.
Below are the commands used
This is the result of the "Show DCBX" command on the switch
Result of the check on the Windows server
*Only one port on the connectx is connected to the switch. The other is disabled.
Simple LAB test of RoCE with Arista 7150 not working as expected.
When querying DCBX status from Arista is says no "0 application priorities configured". See below for config applied.
Goal is to sync DCBX to windows servers, but it only sync the traffic class, not the port/application defined in the class, obviously, since Arista switch says no application priorities configured.
Layout;
Server 2019 with Mellanox ConnectX-4Lx <---> Arista 7150 <---> Server 2019 with Mellanox ConnectX-4Lx
One cable to one port.
Latest firmware on switch and NICs
All prerequisites enabled; LLDP, DCBX, VLAN
Set port 445 as traffic class 6 on the switch
Set traffic class 6 on priority level 6 on the switch
When checking the DCBX settings on the port on the switch it shows that traffic class 6 is set/defined, but no application/port is shown.
Below are the commands used
Code:
#Set DCB Priority Rank to the Traffic Class
SW2(config)#dcbx application tcp-sctp 445 priority 6
#Set enhanced transmission selection (ETS) to the specified QoS group
SW2(config)#dcbx ets qos map cos 6 traffic-class 6
#Enable DCBX.
SW2(config)#interface ethernet 2-3
SW2(config-if-Et2-23)#dcbx mode ieee
#Enable PFC on all port/interfaces
SW2(config)#interface ethernet 2-3
SW2(config-if-Et2-3)#priority-flow-control mode on
SW2(config-if-Et2-3)#priority-flow-control priority 6 no-drop #Says that no packets are going to be droped by PFC on traffic class 6 when the network is congested
#Show DCB settings
show dcbxThis is the result of the "Show DCBX" command on the switch
Code:
Ethernet2:
IEEE DCBX is enabled and active
Last LLDPDU received on Tue May 7 08:49:54 2019
- PFC configuration: willing
capable of bypassing MACsec
supports PFC on up to 8 traffic classes
PFC enabled on priorities: 6
- Application priority configuration:
0 application priorities configured
Ethernet3:
IEEE DCBX is enabled and active
Last LLDPDU received on Tue May 7 08:49:39 2019
- PFC configuration: willing
capable of bypassing MACsec
supports PFC on up to 8 traffic classes
PFC enabled on priorities: 6
- Application priority configuration:
0 application priorities configured
SW2(config-if-Et2-3)#show vlan
VLAN Name Status Ports
----- -------------------------------- --------- -------------------------------
1 default active Et1, Et2, Et3, Et4, Et5, Et11
Et12, Et13, Et21, Et23
100 RoCE active Et2, Et3Result of the check on the Windows server
*Only one port on the connectx is connected to the switch. The other is disabled.
Code:
Set-NetAdapter -Name "ConnectX-4Lx-Port2" -VlanID 100
Get-NetAdapter | select interfacealias,vlanid
InterfaceAlias vlanid
-------------- ------
ConnectX-4Lx-Port1 0 (DISABLED)
ConnectX-4Lx-Port2 100
Get-NetAdapterQos
Name : ConnectX-4Lx-Port2
Enabled : True
Capabilities : Hardware Current
-------- -------
MacSecBypass : NotSupported NotSupported
DcbxSupport : IEEE IEEE
NumTCs(Max/ETS/PFC) : 8/8/8 8/8/8
OperationalTrafficClasses : TC TSA Bandwidth Priorities
-- --- --------- ----------
0 ETS 100% 0-7
OperationalFlowControl : Priority 6 Enabled
OperationalClassifications : Not Available