Best NAS setup/OS for SMB share only?

[sultan.of.swing]

you said yourself that altho you have SMB direct, your explorer caps out at 2gb/s ???

No my explorer caps at 2.8 on a 25gbe connection.
Small files will run 2.8GB/s without problem.
Files over 50GB the speed will slow down some but in general I can maintain over 2.4GB/s until my basic m.2 drives either run out of cache or start to warm up.

 

[bugacha]

No my explorer caps at 2.8 on a 25gbe connection.
Small files will run 2.8GB/s without problem.
Files over 50GB the speed will slow down some but in general I can maintain over 2.4GB/s until my basic m.2 drives either run out of cache or start to warm up.

Right. Anyway, I'm on win11 pro with smb direct installed from optional features

 

[pimposh]

One may want to read and see if this makes sense.

 

[gea]

Some infos I have found for SMB Direct (NAS with up to 10GByte/s)

- cheap Server 2019 with SMB Direct server
- Howto setup 25-100G SMB Direct with or without switch

https://forums.servethehome.com/index.php?threads/zfs-on-osx-and-windows.43829/page-5#post-495171

and infos about NVMe tuning on Windows

This neat Windows 11 registry trick offers higher NVMe SSD performance—but it's not for everyone

Random 4K performance is looking good with a native NVMe implementation.

www.pcgamer.com

 

[PaxRoma]

I have two machines run on Windows Server 2025 and dual Connect-X5 to dual Connect-X7. I can get 98Gbps RDMA using the MlxNdPerf command but when transfer 100GB file via SMB Direct using Windows file transfer, it is a bysmal 2.0GB/s. SSD is nvme SanDisk SN8100 14,900MB/s and max temp at 55 Celsius. I'm not sure how to fix this..

 

[i386]

SanDisk SN8100

That's a m.2 SSD with DDR Cache, once you fill that you write with the "real" speed.
In your Screenshot the First Seconds it's fast and then slows down