I got a new 10GBE switch from Santa.. ( ICX 7250P) in hopes it would speed up my VM performance (ESXi 7) and general large file copying..
well golly gee, was I shocked,, when I saw on how slow things were... I'm usually very smart... great with Wi-Fi ...
I am at a loss here.. as to why I have such poor Iperf performance..
maybe I can't see the forest because of the trees..
both the iperf client and server are on 10gb sfp+ ports
Iperf results
C:\stuff\iperf>iperf3 -c 192.168.1.254
Connecting to host 192.168.1.254, port 5201
[ 4] local 192.168.1.205 port 49951 connected to 192.168.1.254 port 5201
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 57.5 MBytes 482 Mbits/sec
[ 4] 1.00-2.00 sec 36.1 MBytes 303 Mbits/sec
[ 4] 2.00-3.00 sec 48.2 MBytes 405 Mbits/sec
[ 4] 3.00-4.00 sec 38.1 MBytes 320 Mbits/sec
[ 4] 4.00-5.00 sec 56.1 MBytes 471 Mbits/sec
[ 4] 5.00-6.00 sec 38.9 MBytes 326 Mbits/sec
[ 4] 6.00-7.00 sec 49.1 MBytes 412 Mbits/sec
[ 4] 7.00-8.00 sec 78.9 MBytes 662 Mbits/sec
[ 4] 8.00-9.00 sec 39.1 MBytes 328 Mbits/sec
[ 4] 9.00-10.00 sec 38.5 MBytes 323 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-10.00 sec 481 MBytes 403 Mbits/sec sender
[ 4] 0.00-10.00 sec 480 MBytes 403 Mbits/sec receiver
iperf Done.
My PC has Intel Xeon 14 Core Processor E5-2683v3 2.0ghz 35mb Smart Cache
(4x16gb sticks) for a total 64 gb ddr4 ram
samsung 970 m.2 512gb
Asrock x99 extreme 4
OS
Microsoft Windows [Version 10.0.19042.746]
Edition Windows 10 Pro
Version 20H2
Installed on 6/29/2020
OS build 19042.746
Experience Windows Feature Experience Pack 120.2212.551.0
Mellanox ConnectX-2 Ethernet Adapter installed in slot 1 which is a pci-e 3.0 x16 slot
driver provider microsoft
driver date 6/19/2019
driver version 5.50.14695.0
packet size from advanced tab of driver 1514
client iperf3 software on windows
iPerf 3.1.3
iperf server on synology 918+ NAS
DSM 6.2.3-25426 Update 3
4 x 8tb drives with a intel 3700 800gb SSD as read cache
NAS NIC Intel X520-DA1 INTEL 10GB PCIE SFP+
running docker image
connected with finisar 850nm ftlx8571d3bcl sfp+
optical fiber cable this is on the cable its blue "mm 50 /125um om4 lszh 01086m"
MY Switch
Brocade ICX 7250p
SSH@brocade#sh ver
Copyright (c) Ruckus Networks, Inc. All rights reserved.
UNIT 1: compiled on Nov 4 2019 at 10:30:28 labeled as SPR08092
(32121708 bytes) from Primary SPR08092.bin (UFI)
SW: Version 08.0.92T213
Compressed Primary Boot Code size = 786944, Version:10.1.17T215 (spz10117)
Compiled on Wed Oct 9 04:08:27 2019
HW: Stackable ICX7250-24-HPOE
==========================================================================
UNIT 1: SL 1: ICX7250-24P POE 24-port Management Module
Serial #
Software Package: ICX7250_L3_SOFT_PACKAGE (LID: fwkINHMnFJe)
Current License: l3-prem-8X10G
P-ASIC 0: type B344, rev 01 Chip BCM56344_A0
==========================================================================
UNIT 1: SL 2: ICX7250-SFP-Plus 8-port 80G Module
==========================================================================
1000 MHz ARM processor ARMv7 88 MHz bus
8192 KB boot flash memory
2048 MB code flash memory
2048 MB DRAM
STACKID 1 system uptime is 1 day(s) 14 hour(s) 8 minute(s) 6 second(s)
The system started at 22:33:14 GMT-05 Mon Jan 18 2021
The system : started=cold star
Happy to provide any other details if necessary
I know very little about Iperf, so happy to find out that its user error.. (lol)
well golly gee, was I shocked,, when I saw on how slow things were... I'm usually very smart... great with Wi-Fi ...
I am at a loss here.. as to why I have such poor Iperf performance..
maybe I can't see the forest because of the trees..
both the iperf client and server are on 10gb sfp+ ports
Iperf results
C:\stuff\iperf>iperf3 -c 192.168.1.254
Connecting to host 192.168.1.254, port 5201
[ 4] local 192.168.1.205 port 49951 connected to 192.168.1.254 port 5201
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 57.5 MBytes 482 Mbits/sec
[ 4] 1.00-2.00 sec 36.1 MBytes 303 Mbits/sec
[ 4] 2.00-3.00 sec 48.2 MBytes 405 Mbits/sec
[ 4] 3.00-4.00 sec 38.1 MBytes 320 Mbits/sec
[ 4] 4.00-5.00 sec 56.1 MBytes 471 Mbits/sec
[ 4] 5.00-6.00 sec 38.9 MBytes 326 Mbits/sec
[ 4] 6.00-7.00 sec 49.1 MBytes 412 Mbits/sec
[ 4] 7.00-8.00 sec 78.9 MBytes 662 Mbits/sec
[ 4] 8.00-9.00 sec 39.1 MBytes 328 Mbits/sec
[ 4] 9.00-10.00 sec 38.5 MBytes 323 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-10.00 sec 481 MBytes 403 Mbits/sec sender
[ 4] 0.00-10.00 sec 480 MBytes 403 Mbits/sec receiver
iperf Done.
My PC has Intel Xeon 14 Core Processor E5-2683v3 2.0ghz 35mb Smart Cache
(4x16gb sticks) for a total 64 gb ddr4 ram
samsung 970 m.2 512gb
Asrock x99 extreme 4
OS
Microsoft Windows [Version 10.0.19042.746]
Edition Windows 10 Pro
Version 20H2
Installed on 6/29/2020
OS build 19042.746
Experience Windows Feature Experience Pack 120.2212.551.0
Mellanox ConnectX-2 Ethernet Adapter installed in slot 1 which is a pci-e 3.0 x16 slot
driver provider microsoft
driver date 6/19/2019
driver version 5.50.14695.0
packet size from advanced tab of driver 1514
client iperf3 software on windows
iPerf 3.1.3
iperf server on synology 918+ NAS
DSM 6.2.3-25426 Update 3
4 x 8tb drives with a intel 3700 800gb SSD as read cache
NAS NIC Intel X520-DA1 INTEL 10GB PCIE SFP+
running docker image
connected with finisar 850nm ftlx8571d3bcl sfp+
optical fiber cable this is on the cable its blue "mm 50 /125um om4 lszh 01086m"
MY Switch
Brocade ICX 7250p
SSH@brocade#sh ver
Copyright (c) Ruckus Networks, Inc. All rights reserved.
UNIT 1: compiled on Nov 4 2019 at 10:30:28 labeled as SPR08092
(32121708 bytes) from Primary SPR08092.bin (UFI)
SW: Version 08.0.92T213
Compressed Primary Boot Code size = 786944, Version:10.1.17T215 (spz10117)
Compiled on Wed Oct 9 04:08:27 2019
HW: Stackable ICX7250-24-HPOE
==========================================================================
UNIT 1: SL 1: ICX7250-24P POE 24-port Management Module
Serial #
Software Package: ICX7250_L3_SOFT_PACKAGE (LID: fwkINHMnFJe)
Current License: l3-prem-8X10G
P-ASIC 0: type B344, rev 01 Chip BCM56344_A0
==========================================================================
UNIT 1: SL 2: ICX7250-SFP-Plus 8-port 80G Module
==========================================================================
1000 MHz ARM processor ARMv7 88 MHz bus
8192 KB boot flash memory
2048 MB code flash memory
2048 MB DRAM
STACKID 1 system uptime is 1 day(s) 14 hour(s) 8 minute(s) 6 second(s)
The system started at 22:33:14 GMT-05 Mon Jan 18 2021
The system : started=cold star
Happy to provide any other details if necessary
I know very little about Iperf, so happy to find out that its user error.. (lol)
Last edited: