fio --filename=/dev/nvme1n1 --direct=1 --rw=randrw --refill_buffers --norandommap --randrepeat=0 --ioengine=libaio --bs=4k --rwmixread=100 --iodepth=16 --numjobs=16 --runtime=60 --group_reporting --name=4ktest
4ktest: (groupid=0, jobs=16): err= 0: pid=26217: Wed May 1 14:02:21 2019
read: IOPS=1075k, BW=4199MiB/s (4403MB/s)(128GiB/31187msec)
slat (nsec): min=1360, max=44117k, avg=2873.53, stdev=45201.30
clat (usec): min=13, max=47185, avg=232.32, stdev=185.59
lat (usec): min=16, max=47188, avg=235.54, stdev=190.99
clat percentiles (usec):
| 1.00th=[ 139], 5.00th=[ 151], 10.00th=[ 153], 20.00th=[ 163],
| 30.00th=[ 233], 40.00th=[ 251], 50.00th=[ 255], 60.00th=[ 258],
| 70.00th=[ 258], 80.00th=[ 260], 90.00th=[ 262], 95.00th=[ 265],
| 99.00th=[ 273], 99.50th=[ 289], 99.90th=[ 465], 99.95th=[ 627],
| 99.99th=[ 3032]
bw ( KiB/s): min=218400, max=276024, per=6.30%, avg=270689.97, stdev=4749.32, samples=984
iops : min=54600, max=69006, avg=67672.44, stdev=1187.32, samples=984
lat (usec) : 20=0.01%, 50=0.01%, 100=0.15%, 250=36.53%, 500=63.23%
lat (usec) : 750=0.05%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%
cpu : usr=10.97%, sys=33.34%, ctx=17386180, majf=0, minf=193
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=100.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.1%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=33521664,0,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
Run status group 0 (all jobs):
READ: bw=4199MiB/s (4403MB/s), 4199MiB/s-4199MiB/s (4403MB/s-4403MB/s), io=128GiB (137GB), run=31187-31187msec
Disk stats (read/write):
nvme1n1: ios=33511793/0, merge=0/0, ticks=7615258/0, in_queue=0, util=99.73%
fio --filename=/dev/nvme1n1 --direct=1 --rw=randrw --refill_buffers --norandommap --randrepeat=0 --ioengine=libaio --bs=4k --rwmixread=0 --iodepth=16 --numjobs=16 --runtime=60 --group_reporting --name=4ktest
4ktest: (groupid=0, jobs=16): err= 0: pid=26639: Wed May 1 14:03:49 2019
write: IOPS=1196k, BW=4672MiB/s (4899MB/s)(128GiB/28025msec)
slat (nsec): min=1380, max=33235k, avg=2907.74, stdev=37783.53
clat (usec): min=13, max=33387, avg=207.07, stdev=155.30
lat (usec): min=17, max=33393, avg=210.34, stdev=159.82
clat percentiles (usec):
| 1.00th=[ 147], 5.00th=[ 163], 10.00th=[ 172], 20.00th=[ 186],
| 30.00th=[ 200], 40.00th=[ 206], 50.00th=[ 212], 60.00th=[ 215],
| 70.00th=[ 219], 80.00th=[ 223], 90.00th=[ 227], 95.00th=[ 233],
| 99.00th=[ 253], 99.50th=[ 281], 99.90th=[ 465], 99.95th=[ 627],
| 99.99th=[ 3228]
bw ( KiB/s): min=287752, max=308584, per=6.31%, avg=302014.60, stdev=2526.42, samples=880
iops : min=71938, max=77146, avg=75503.64, stdev=631.60, samples=880
lat (usec) : 20=0.01%, 50=0.01%, 100=0.12%, 250=98.79%, 500=1.01%
lat (usec) : 750=0.04%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%
cpu : usr=19.55%, sys=35.26%, ctx=13866882, majf=0, minf=166
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=100.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.1%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwt: total=0,33521664,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16
Run status group 0 (all jobs):
WRITE: bw=4672MiB/s (4899MB/s), 4672MiB/s-4672MiB/s (4899MB/s-4899MB/s), io=128GiB (137GB), run=28025-28025msec
Disk stats (read/write):
nvme1n1: ios=258/33496332, merge=0/0, ticks=19/6686278, in_queue=0, util=99.68%
ubuntu 18.04.2
Partition and contents retained after a power dump (pulled cord)
Shit I think we just made the price go up on those
See if you can format it 4k byte sizeI got mine on order right now, I will do some testing with freebsd, for my zfs needs.
think i can live CD it and do the test you want?I got mine on order right now, I will do some testing with freebsd, for my zfs needs.
Damn nvme support is broken yet again with freebsd could be live cd issue... but most likely the nvme driver yet again. Thanks might have to work on it when I get mine.
Synchronous random writes:
0.5 kbytes: 26.9 usec/IO = 18.1 Mbytes/s
1 kbytes: 27.2 usec/IO = 35.9 Mbytes/s
2 kbytes: 27.7 usec/IO = 70.6 Mbytes/s
4 kbytes: 28.6 usec/IO = 136.6 Mbytes/s
8 kbytes: 30.1 usec/IO = 259.6 Mbytes/s
16 kbytes: 36.3 usec/IO = 431.0 Mbytes/s
32 kbytes: 44.1 usec/IO = 708.0 Mbytes/s
64 kbytes: 59.4 usec/IO = 1052.2 Mbytes/s
128 kbytes: 91.5 usec/IO = 1366.5 Mbytes/s
256 kbytes: 129.8 usec/IO = 1925.6 Mbytes/s
512 kbytes: 206.6 usec/IO = 2419.7 Mbytes/s
1024 kbytes: 363.8 usec/IO = 2748.5 Mbytes/s
2048 kbytes: 681.1 usec/IO = 2936.6 Mbytes/s
4096 kbytes: 1323.2 usec/IO = 3022.9 Mbytes/s
8192 kbytes: 2620.3 usec/IO = 3053.1 Mbytes
Good luck spoke to them on Monday... maybe if you have a job that relates to the field they will listen but they told me they only sold those to oem and such... kinda like my quest with pmc...ahh. got ya.
Well, my use will be ZOL. I've got an email in with the manufacture about a NDA documentation they offer, we'll see how that turns out