labby@lobon:~$ fio -filename=/testfio/testfio.file -direct=1 -rw=randwrite -bs=4k -size=1G -name=randwrite -runtime=60 randwrite: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1 fio-3.16 Starting 1 process Jobs: 1 (f=1): [w(1)][100.0%][w=97.8MiB/s][w=25.0k IOPS][eta 00m:00s] randwrite: (groupid=0, jobs=1): err= 0: pid=1626014: Mon Apr 11 14:43:02 2022 write: IOPS=25.0k, BW=97.7MiB/s (102MB/s)(1024MiB/10480msec); 0 zone resets clat (usec): min=22, max=1641, avg=37.67, stdev=11.56 lat (usec): min=22, max=1642, avg=37.96, stdev=11.59 clat percentiles (usec): | 1.00th=[ 24], 5.00th=[ 26], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 35], 40.00th=[ 36], 50.00th=[ 37], 60.00th=[ 38], | 70.00th=[ 40], 80.00th=[ 42], 90.00th=[ 47], 95.00th=[ 52], | 99.00th=[ 77], 99.50th=[ 101], 99.90th=[ 139], 99.95th=[ 159], | 99.99th=[ 212] bw ( KiB/s): min=87560, max=110003, per=100.00%, avg=100114.85, stdev=5031.11, samples=20 iops : min=21890, max=27500, avg=25028.65, stdev=1257.70, samples=20 lat (usec) : 50=93.72%, 100=5.77%, 250=0.50%, 500=0.01%, 1000=0.01% lat (msec) : 2=0.01% cpu : usr=10.56%, sys=58.21%, ctx=262496, majf=0, minf=44 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,262144,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 Run status group 0 (all jobs): WRITE: bw=97.7MiB/s (102MB/s), 97.7MiB/s-97.7MiB/s (102MB/s-102MB/s), io=1024MiB (1074MB), run=10480-10480msec Disk stats (read/write): md2: ios=1/260601, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=0/262401, aggrmerge=0/794, aggrticks=0/3882, aggrin_queue=0, aggrutil=98.99% nvme0n1: ios=0/262401, merge=0/794, ticks=0/3463, in_queue=0, util=98.99% nvme1n1: ios=1/262401, merge=0/794, ticks=0/4301, in_queue=0, util=98.99%