Need help debugging strange network speeds

graytonio

New Member
Jan 30, 2022
1
0
1
Setup:
Dell R620 with 10Gb RJ45 running proxmox (Kratos)
Custom Server with 10Gb SFP+ LC Fiber Connection (Notch)
Synology RS1221 with Synology 10Gb RJ45 NIC (Vault)

Iperf3 Tests Summary
Kratos -> Notch or Vault | 10Gb
Notch -> Vault | 10Gb
Vault -> Notch | 10Gb
Notch or Vault -> Kratos | 4Gb?

I've tried using different cables moving ports chaning the transceiver for kratos but nothing seems to work. I would appreciate anything that would help.

Iperf3 Tests
Kratos (Client) -> Notch (Server)
Code:
ansible@kratos:~$ iperf3 -c 10.0.0.62
Connecting to host 10.0.0.62, port 5201
[  5] local 10.0.0.61 port 44990 connected to 10.0.0.62 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  1007 MBytes  8.44 Gbits/sec    0    650 KBytes
[  5]   1.00-2.00   sec  1.02 GBytes  8.80 Gbits/sec    0    772 KBytes
[  5]   2.00-3.00   sec  1.04 GBytes  8.96 Gbits/sec    0   1.77 MBytes
[  5]   3.00-4.00   sec  1.06 GBytes  9.08 Gbits/sec    0   1.77 MBytes
[  5]   4.00-5.00   sec  1.05 GBytes  9.01 Gbits/sec    0   1.77 MBytes
[  5]   5.00-6.00   sec  1.03 GBytes  8.89 Gbits/sec    0   1.77 MBytes
[  5]   6.00-7.00   sec  1.08 GBytes  9.26 Gbits/sec    0   1.77 MBytes
[  5]   7.00-8.00   sec  1.08 GBytes  9.23 Gbits/sec    0   1.85 MBytes
[  5]   8.00-9.00   sec  1.07 GBytes  9.17 Gbits/sec    0   1.85 MBytes
[  5]   9.00-10.00  sec  1.10 GBytes  9.41 Gbits/sec    0   1.85 MBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  10.5 GBytes  9.03 Gbits/sec    0             sender
[  5]   0.00-10.00  sec  10.5 GBytes  9.02 Gbits/sec                  receiver

iperf Done.
Notch (Client) -> Kratos (Server)
Code:
ansible@kratos:~$ iperf3 -s
-----------------------------------------------------------
Server listening on 5201
-----------------------------------------------------------
Accepted connection from 10.0.0.62, port 32996
[  5] local 10.0.0.61 port 5201 connected to 10.0.0.62 port 32998
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec   448 MBytes  3.75 Gbits/sec
[  5]   1.00-2.00   sec   448 MBytes  3.76 Gbits/sec
[  5]   2.00-3.00   sec   454 MBytes  3.81 Gbits/sec
[  5]   3.00-4.00   sec   458 MBytes  3.84 Gbits/sec
[  5]   4.00-5.00   sec   446 MBytes  3.74 Gbits/sec
[  5]   5.00-6.00   sec   447 MBytes  3.75 Gbits/sec
[  5]   6.00-7.00   sec   447 MBytes  3.75 Gbits/sec
[  5]   7.00-8.00   sec   456 MBytes  3.83 Gbits/sec
[  5]   8.00-9.00   sec   458 MBytes  3.83 Gbits/sec
[  5]   9.00-10.00  sec   458 MBytes  3.84 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-10.00  sec  4.41 GBytes  3.79 Gbits/sec                  receiver
-----------------------------------------------------------
Server listening on 5201
-----------------------------------------------------------
Ethtool For Kratos 10Gb Interface
Code:
ansible@kratos:~$ sudo ethtool vmbr0
Settings for vmbr0:
        Supported ports: [  ]
        Supported link modes:   Not reported
        Supported pause frame use: No
        Supports auto-negotiation: No
        Supported FEC modes: Not reported
        Advertised link modes:  Not reported
        Advertised pause frame use: No
        Advertised auto-negotiation: No
        Advertised FEC modes: Not reported
        Speed: 10000Mb/s
        Duplex: Unknown! (255)
        Auto-negotiation: off
        Port: Other
        PHYAD: 0
        Transceiver: internal
        Link detected: yes