sudo fio --filename=/dev/sdi --direct=1 --rw=randread --bs=4k --ioengine=libaio --iodepth=256 --runtime=120 --numjobs=4 --time_based --group_reporting --name=iops-test-job --eta-newline=1 --readonly
iops-test-job: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=256
...
fio-3.33
Starting 4 processes
Jobs: 4 (f=4): [r(4)][2.5%][r=314MiB/s][r=80.4k IOPS][eta 01m:57s]
Jobs: 4 (f=4): [r(4)][4.2%][r=320MiB/s][r=81.8k IOPS][eta 01m:55s]
Jobs: 4 (f=4): [r(4)][5.8%][r=320MiB/s][r=82.0k IOPS][eta 01m:53s]
Jobs: 4 (f=4): [r(4)][7.5%][r=320MiB/s][r=81.9k IOPS][eta 01m:51s]
Jobs: 4 (f=4): [r(4)][9.2%][r=320MiB/s][r=81.9k IOPS][eta 01m:49s]
^Cbs: 4 (f=4): [r(4)][10.8%][r=322MiB/s][r=82.4k IOPS][eta 01m:47s]
fio: terminating on signal 2
iops-test-job: (groupid=0, jobs=4): err= 0: pid=385030: Thu Jul 20 22:53:29 2023
read: IOPS=81.5k, BW=318MiB/s (334MB/s)(4343MiB/13644msec)
slat (nsec): min=1227, max=2019.7k, avg=47687.13, stdev=126115.15
clat (usec): min=419, max=21590, avg=12505.40, stdev=1492.51
lat (usec): min=671, max=21592, avg=12553.09, stdev=1499.67
clat percentiles (usec):
| 1.00th=[ 9372], 5.00th=[10159], 10.00th=[10683], 20.00th=[11207],
| 30.00th=[11731], 40.00th=[12125], 50.00th=[12387], 60.00th=[12780],
| 70.00th=[13173], 80.00th=[13698], 90.00th=[14484], 95.00th=[15008],
| 99.00th=[16319], 99.50th=[16712], 99.90th=[17695], 99.95th=[17957],
| 99.99th=[18744]
bw ( KiB/s): min=297944, max=339128, per=100.00%, avg=326004.44, stdev=2026.27, samples=108
iops : min=74486, max=84782, avg=81501.11, stdev=506.57, samples=108
lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2=0.01%, 4=0.01%, 10=3.57%, 20=96.40%, 50=0.01%
cpu : usr=2.79%, sys=11.24%, ctx=760217, majf=0, minf=1064
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1%
issued rwts: total=1111754,0,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=256
Run status group 0 (all jobs):
READ: bw=318MiB/s (334MB/s), 318MiB/s-318MiB/s (334MB/s-334MB/s), io=4343MiB (4554MB), run=13644-13644msec
Disk stats (read/write):
sdi: ios=1109785/0, merge=0/0, ticks=821296/0, in_queue=821297, util=99.23%