So I've recently installed 10Gb Ethernet in the homelab and I'm having some issues with a receive side bottleneck which looks to be caused by the CPU.
The card in the PC is the Supermicro AOC-STG-i2T X540 based card and I'm using the latest drivers from Intels website. The PC is using the x99 Asus rampage V extreme with an 5960X clocked at 4.4Ghz so not very new but still a decent powerful CPU.
When copying a large file to the server I get the full 1.12Gbytes per second transfer speed however when copying down to the local computer I get about 700Mbytes and a single core is pegged at 100% load. I've tried using applications like robocopy and simulating traffic using NTttp but I see exactly the same behavior.
So onto my question. Is this normal and the CPU just isn't up to the task or is there something I should be looking at to optimise the configuration? I've tried playing with receive side scaling but that's had no effect. I've also got jumbo frames set at 4000 at the moment which got me to the current speeds I'm at as it was horrendous at 1500.
Lastly if it is just CPU bound do the newer 10Gb cards make things any better on that front e.g would swapping it our with an X550 make any difference (I don't know if they provide any better offloading)
The card in the PC is the Supermicro AOC-STG-i2T X540 based card and I'm using the latest drivers from Intels website. The PC is using the x99 Asus rampage V extreme with an 5960X clocked at 4.4Ghz so not very new but still a decent powerful CPU.
When copying a large file to the server I get the full 1.12Gbytes per second transfer speed however when copying down to the local computer I get about 700Mbytes and a single core is pegged at 100% load. I've tried using applications like robocopy and simulating traffic using NTttp but I see exactly the same behavior.
So onto my question. Is this normal and the CPU just isn't up to the task or is there something I should be looking at to optimise the configuration? I've tried playing with receive side scaling but that's had no effect. I've also got jumbo frames set at 4000 at the moment which got me to the current speeds I'm at as it was horrendous at 1500.
Lastly if it is just CPU bound do the newer 10Gb cards make things any better on that front e.g would swapping it our with an X550 make any difference (I don't know if they provide any better offloading)
In regards to the potential software raid i'm copying the large file to a single Samsung 970 Evo plus which I've tested at 3.2Gb per sec so it's not a raid or throughput bottleneck at the storage layer.