Cabling definitely not the issue here. I'm using brand new CAT8 . 10 Gbps works perfectly and I get full line rate with 2+ TCP stream between two machines running Aquantia NICs connected to the TEG-7080ES. Full line rate with 1 Gbps too.I'm not so sure Realtek is the problem at all. I just tested two machines
Machine A: Intel NUC 8i7 BEH, connected to a Pluggable USB 2.5
Machine B: MacBook Pro 2017 connected to an Asustor USB 2.5
And I tested with two switches: ICX 6610 and Netgear MS510TX
And in reverseCode:MBP:$ ./iperf3 -c machine_a Connecting to host machine_a, port 5201 [ 4] local machine_b port 63491 connected to machine_a port 5201 [ ID] Interval Transfer Bandwidth [ 4] 0.00-1.00 sec 282 MBytes 2.36 Gbits/sec [ 4] 1.00-2.00 sec 283 MBytes 2.37 Gbits/sec [ 4] 2.00-3.00 sec 282 MBytes 2.37 Gbits/sec [ 4] 3.00-4.00 sec 283 MBytes 2.37 Gbits/sec [ 4] 4.00-5.00 sec 283 MBytes 2.37 Gbits/sec [ 4] 5.00-6.00 sec 283 MBytes 2.37 Gbits/sec [ 4] 6.00-7.00 sec 283 MBytes 2.37 Gbits/sec [ 4] 7.00-8.00 sec 282 MBytes 2.37 Gbits/sec [ 4] 8.00-9.00 sec 282 MBytes 2.37 Gbits/sec [ 4] 9.00-10.00 sec 283 MBytes 2.37 Gbits/sec - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth [ 4] 0.00-10.00 sec 2.76 GBytes 2.37 Gbits/sec sender [ 4] 0.00-10.00 sec 2.76 GBytes 2.37 Gbits/sec receiver
This is with the ICX6610 (with Ipolex 10GbaseT transceivers). Even with the Netgear, the results are the same. I would suggest you get a proper switch and also make sure your cabling and termination is up to spec. I've also had the Asustor connected to a Windows server 24/7 for 2 months and it's been fine, never had drop outs or anything. The USB adapters do get considerably warm hence need to be cooled or provided with adequate ventilation.Code:MBP:$ ./iperf3 -c machine_a -R Connecting to host machine_a, port 5201 Reverse mode, remote host machine_a is sending [ 4] local machine_b port 63675 connected to machine_a port 5201 [ ID] Interval Transfer Bandwidth [ 4] 0.00-1.00 sec 279 MBytes 2.34 Gbits/sec [ 4] 1.00-2.00 sec 282 MBytes 2.37 Gbits/sec [ 4] 2.00-3.00 sec 282 MBytes 2.37 Gbits/sec [ 4] 3.00-4.00 sec 282 MBytes 2.37 Gbits/sec [ 4] 4.00-5.00 sec 279 MBytes 2.34 Gbits/sec [ 4] 5.00-6.00 sec 281 MBytes 2.36 Gbits/sec [ 4] 6.00-7.00 sec 281 MBytes 2.36 Gbits/sec [ 4] 7.00-8.00 sec 282 MBytes 2.37 Gbits/sec [ 4] 8.00-9.00 sec 281 MBytes 2.36 Gbits/sec [ 4] 9.00-10.00 sec 280 MBytes 2.35 Gbits/sec - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth [ 4] 0.00-10.00 sec 2.74 GBytes 2.36 Gbits/sec sender [ 4] 0.00-10.00 sec 2.74 GBytes 2.36 Gbits/sec receiver
btw - I am using very good quality Cat5E (and can get 10 GbE on it, with one run being 80 feet) and recently redid my patch panel termination to make sure the wires were twisted right upto the insertion points. I'm also redoing the wall jacks slowly - you'd be surprised when you look at the way some of the wiring is done. When you get to 2.5 GbE, you need just that little bit better quality.
Things go bad at 2.5 Gbps and 5 Gbps, apparently regardless of NIC.
Here are some single-stream results from today. This is info I sent to Trendnet also.
In the tests below, client is Win10 / r2004 . i7-5820k OC at 4.3 GHz and 32 GB of RAM.
Server is Ubuntu 18.02 / i5-6600k OC at 4.4 GHz and 32GB RAM.
Both with Aquantia AQN-107, hooked up to Trendnet TEG-7080ES with CAT8 of 6ft each.
Client NIC left on autonegotiation, at 10 Gbps:
C:\Users\Julien Pierre\Desktop\iperf3>iperf3.exe -N -c server10g -R
Connecting to host server10g, port 5201
Reverse mode, remote host server10g is sending
[ 4] local 192.168.1.26 port 63330 connected to 192.168.1.27 port 5201
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 874 MBytes 7.33 Gbits/sec
[ 4] 1.00-2.00 sec 892 MBytes 7.48 Gbits/sec
[ 4] 2.00-3.00 sec 914 MBytes 7.66 Gbits/sec
[ 4] 3.00-4.00 sec 942 MBytes 7.90 Gbits/sec
[ 4] 4.00-5.00 sec 943 MBytes 7.91 Gbits/sec
[ 4] 5.00-6.00 sec 940 MBytes 7.89 Gbits/sec
[ 4] 6.00-7.00 sec 955 MBytes 8.01 Gbits/sec
[ 4] 7.00-8.00 sec 955 MBytes 8.01 Gbits/sec
[ 4] 8.00-9.00 sec 958 MBytes 8.03 Gbits/sec
[ 4] 9.00-10.00 sec 958 MBytes 8.04 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 9.11 GBytes 7.83 Gbits/sec 0 sender
[ 4] 0.00-10.00 sec 9.11 GBytes 7.83 Gbits/sec receiver
iperf Done.
Client NIC forced down to 5 Gbps in device manager :
C:\Users\Julien Pierre\Desktop\iperf3>iperf3.exe -N -c server10g -R
Connecting to host server10g, port 5201
Reverse mode, remote host server10g is sending
[ 4] local 192.168.1.26 port 63365 connected to 192.168.1.27 port 5201
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 185 MBytes 1.55 Gbits/sec
[ 4] 1.00-2.00 sec 190 MBytes 1.60 Gbits/sec
[ 4] 2.00-3.00 sec 191 MBytes 1.61 Gbits/sec
[ 4] 3.00-4.00 sec 193 MBytes 1.62 Gbits/sec
[ 4] 4.00-5.00 sec 193 MBytes 1.62 Gbits/sec
[ 4] 5.00-6.00 sec 195 MBytes 1.63 Gbits/sec
[ 4] 6.00-7.00 sec 191 MBytes 1.60 Gbits/sec
[ 4] 7.00-8.00 sec 193 MBytes 1.62 Gbits/sec
[ 4] 8.00-9.00 sec 194 MBytes 1.62 Gbits/sec
[ 4] 9.00-10.00 sec 194 MBytes 1.63 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 1.87 GBytes 1.61 Gbits/sec 12364 sender
[ 4] 0.00-10.00 sec 1.87 GBytes 1.61 Gbits/sec receiver
iperf Done.
Client NIC forced down to 2.5 Gbps in device manager :
C:\Users\Julien Pierre\Desktop\iperf3>iperf3.exe -N -c server10g -R
Connecting to host server10g, port 5201
Reverse mode, remote host server10g is sending
[ 4] local 192.168.1.26 port 63496 connected to 192.168.1.27 port 5201
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 107 MBytes 895 Mbits/sec
[ 4] 1.00-2.00 sec 105 MBytes 882 Mbits/sec
[ 4] 2.00-3.00 sec 106 MBytes 887 Mbits/sec
[ 4] 3.00-4.00 sec 105 MBytes 878 Mbits/sec
[ 4] 4.00-5.00 sec 106 MBytes 885 Mbits/sec
[ 4] 5.00-6.00 sec 105 MBytes 881 Mbits/sec
[ 4] 6.00-7.00 sec 107 MBytes 894 Mbits/sec
[ 4] 7.00-8.00 sec 105 MBytes 884 Mbits/sec
[ 4] 8.00-9.00 sec 107 MBytes 898 Mbits/sec
[ 4] 9.00-10.00 sec 105 MBytes 879 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 1.03 GBytes 887 Mbits/sec 5409 sender
[ 4] 0.00-10.00 sec 1.03 GBytes 886 Mbits/sec receiver
iperf Done.
Client NIC forced down to 1 Gbps in device manager :
C:\Users\Julien Pierre\Desktop\iperf3>iperf3.exe -N -c server10g -R
Connecting to host server10g, port 5201
Reverse mode, remote host server10g is sending
[ 4] local 192.168.1.26 port 63577 connected to 192.168.1.27 port 5201
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 113 MBytes 950 Mbits/sec
[ 4] 1.00-2.00 sec 113 MBytes 947 Mbits/sec
[ 4] 2.00-3.00 sec 113 MBytes 948 Mbits/sec
[ 4] 3.00-4.00 sec 113 MBytes 948 Mbits/sec
[ 4] 4.00-5.00 sec 113 MBytes 949 Mbits/sec
[ 4] 5.00-6.00 sec 113 MBytes 949 Mbits/sec
[ 4] 6.00-7.00 sec 113 MBytes 949 Mbits/sec
[ 4] 7.00-8.00 sec 113 MBytes 949 Mbits/sec
[ 4] 8.00-9.00 sec 113 MBytes 949 Mbits/sec
[ 4] 9.00-10.00 sec 113 MBytes 949 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 1.11 GBytes 950 Mbits/sec 0 sender
[ 4] 0.00-10.00 sec 1.10 GBytes 949 Mbits/sec receiver
As you can see, everything is fine when the client NIC is set to 1 or 10 Gbps.
But there are problems when it is set to 2.5 Gbps or 5 Gbps.
2.5 Gbps actually performs slower than 1 Gbps ...
So, the problem is not limited to the Realtek RTL8156 NIC. It appears there are some issues in the NBASE-T implementation at 2.5 and 5 Gbps in the Trendnet TEG-7080ES switch.
Tests I did previously with the Netgear GS110MX showed it working fine at 2.5 Gbps with the RTL8156 NIC, which I no longer have.
Didn't try yet to force the Aquantia NIC on my HTPC down to 5 or 2.5 Gbps. But I expect it would work properly.
You can see a more complete description of all my network and cabling at :
10 GBASE-T Ethernet performance in my home network
Tests Client,Server,Mode,Streams,Gbps,Gbps,Gbps,Gbps,Gbps,Gbps,Gbps,Gbps,Gbps,Gbps,Slowest,Fastest EEE,off,off,off,off,on,on,off,off,on,on Jumbo frames,off,off,4KB,4KB,4KB,4KB,9KB,9KB,off,9KB Notes,Run #1,Run #2,Run #1,Run #2,Run #1,Run #2,Run #1,Run #2 HIGGS,BUMBLEBEE,Receiving,1,7.16,7.53,7.16...
docs.google.com
All is perfectly fine at 10 Gbps with this whole infrastructure. Things only fail if something negotiated at 2.5 or 5 Gbps on the Trendnet switch.
With the Cable Creation RTL8156 NIC, 2.5 is the max it could negotiate. That NIC worked fine at 2.5 Gbps worked fine when plugged to my HTPC and attached to the Netgear switch. Just didn't work in my home office on the Trendnet switch ...