Reviving this old thread now that we have some affordable Optane from Intel
- System: Custom Built Supermicro
- RAM: 96GB RAM
- CPU: 1x Xeon Silver 4114
- OS: Debian Stretch 9.2 (Proxmox 5.1)
- OS Drives: 1 x Intel 600p 128GB
- Drives being tested: 2x Intel 280 AIC Optane SSDs
- Capacity being tested: 560GB
- Acquire date: 11/ 2017
- Approximate Cost: $3,700
Results
- Tool Used: FIO
- 4K Random IOPS: 1.17 million
Config:
[global]
thread
ioengine=libaio
direct=1
buffered=0
group_reporting=1
rw=randread
bs=4k
iodepth=64
numjobs=2
size=50%
[job1]
filename=/dev/nvme1n1
[job2]
filename=/dev/nvme2n1
Output:
job1: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=64
...
job2: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=64
...
fio-2.16
Starting 4 threads
Jobs: 4 (f=4): [r(4)] [100.0% done] [4587MB/0KB/0KB /s] [1174K/0/0 iops] [eta 00m:00s]
job1: (groupid=0, jobs=4): err= 0: pid=122712: Tue Nov 7 12:59:32 2017
read : io=534182MB, bw=4582.8MB/s, iops=1173.2K, runt=116564msec
slat (usec): min=0, max=85, avg= 1.90, stdev= 0.74
clat (usec): min=9, max=424, avg=215.80, stdev= 9.02
lat (usec): min=10, max=425, avg=217.74, stdev= 8.98
clat percentiles (usec):
| 1.00th=[ 201], 5.00th=[ 205], 10.00th=[ 207], 20.00th=[ 209],
| 30.00th=[ 211], 40.00th=[ 215], 50.00th=[ 217], 60.00th=[ 219],
| 70.00th=[ 219], 80.00th=[ 221], 90.00th=[ 223], 95.00th=[ 235],
| 99.00th=[ 249], 99.50th=[ 251], 99.90th=[ 258], 99.95th=[ 270],
| 99.99th=[ 278]
lat (usec) : 10=0.01%, 20=0.01%, 50=0.01%, 100=0.01%, 250=99.19%
lat (usec) : 500=0.81%
cpu : usr=20.83%, sys=66.71%, ctx=31934106, majf=0, minf=260
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued : total=r=136750572/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: io=534182MB, aggrb=4582.8MB/s, minb=4582.8MB/s, maxb=4582.8MB/s, mint=116564msec, maxt=116564msec
Disk stats (read/write):
nvme1n1: ios=68335281/0, merge=0/0, ticks=14676432/0, in_queue=15530816, util=100.00%
nvme2n1: ios=68298772/0, merge=0/0, ticks=14674828/0, in_queue=15676884, util=100.00%