file transfer speed Windows 10 Enterprise and Ubuntu 20.04

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.
ari2asem

ari2asem

Active Member
Dec 26, 2018
745
128
43
The Netherlands, Groningen
my setup:
- dual socket epyc 7551 (total of 64 cores / 128 threads)
- 16 * 32 GB ecc-reg ddr4 2666 mhz Ram ( total of 512 GB)
- HBA card is LSI 9400-16i
- backplane is gooxi 36 v1.0 (with sas expander)
- 24 bay SAS-2 internal hdd ports
- backplane and LSI are connected with 2 cables (i think to get aggregated and higher transfer speed)
- 10 TB sata-600 7200 rpm seagate iron wolf pro
- 4* Dell 900 GB SAS-2 10k rpm (configured as STRIPED = raid 0 volume under Windows 10 enterprise)

now the odd thing.....
......when transfering chia-plot files from 4* dell raid0 to 10 tb sata-600 (size of 101 gb big files) under Windows 10 i get transfer speed of 30 MB/s
..... when transfering the same file from 4* dell raid0 to 10 TB sata-600 under Ubuntu 20.04 i get transfer speed of 130 MB/s
in Ubuntu 20.04 all drives are mounted as NTFS paritions, using the latest ntfs-3g available from ubuntu repositories.


one would expect on native platform (Windows 10 and NTFS) to get faster transfer speed then in non-native platform (i.e. NTFS in Ubuntu)......this is odd....

does anyone have any explanations to these odd difference between Windows and Ubuntu, regarding transfer speed?

i dont care about chia plots and speeds of it, but i am very curious how this situation can be explained.
 
tinfoil3d

tinfoil3d

QSFP28
May 11, 2020
876
403
63
Japan
That speed in windows, is it from explorer or some other tool? Or also confirmed by calculation of time taken to complete the transfer?
 
ari2asem

ari2asem

Active Member
Dec 26, 2018
745
128
43
The Netherlands, Groningen
yes, it is the speed of Windows file explorer.

also tried with xplorer² (from zabkat) and the speed is around 25 MB/s.

and....enabling or disabling write cach back in Windows has no any effec on transfer speed.
 
cesmith9999

cesmith9999

Well-Known Member
Mar 26, 2013
1,420
470
83
You have never used richcopy before...

social.technet.microsoft.com

Microsoft Richcopy

social.technet.microsoft.com

you can do parallel file copy -or- parallel block copy (same file multiple threads). don't do both at the same time.

Chris
 
cesmith9999

cesmith9999

Well-Known Member
Mar 26, 2013
1,420
470
83
The biggest speed up is to restrict screen output. Either log the output or do not display it.

Chris
 
ari2asem

ari2asem

Active Member
Dec 26, 2018
745
128
43
The Netherlands, Groningen
using robocopy with 32 threads gives me around 100 MB/s transfer speed in Windows 10 when copying 1 big file (101 GB plot file).

still slower than ubuntu (130 MB/s)
 
Last edited:
cesmith9999

cesmith9999

Well-Known Member
Mar 26, 2013
1,420
470
83
I use the following parameters:

<src> <dest> /mt:[equal to the number of threads the procs have] /e /nfl /ndl /r:1 /w:1

and are you copying large files? small files? or a mix?

Chris
 
ari2asem

ari2asem

Active Member
Dec 26, 2018
745
128
43
The Netherlands, Groningen
cppying only large files (101 GB size).
my test was only for 1 file with /MT:32 ( i have 128 cpu threads available)

/e = i dont have empty folders
/r = i dont need retry, because i dont have problems with reading and writing of the files
/w = see /r
/nfl and /ndl haven't yet tried. this could give me much more speed.

tomorrow is my next test run with /nfl and /ndl.
 
cesmith9999

cesmith9999

Well-Known Member
Mar 26, 2013
1,420
470
83
if you are only copying 1 file, /MT does not help.

what happens when you copy more than 1 large file? are the speeds any faster.

Chris
 
K

kapone

Well-Known Member
May 23, 2015
1,095
642
113
Is Windows disabling the write cache on the 10TB drive, while Ubuntu is not?
 
You must log in or register to reply here.
Top Bottom