128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 32 processes
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)

128m: (groupid=0, jobs=32): err= 0: pid=23627
  read : io=3539.4MB, bw=362359KB/s, iops=90589 , runt= 10002msec
    clat (usec): min=153 , max=17798 , avg=350.15, stdev=230.71
     lat (usec): min=153 , max=17798 , avg=350.33, stdev=230.73
    clat percentiles (usec):
     |  1.00th=[  185],  5.00th=[  201], 10.00th=[  215], 20.00th=[  241],
     | 30.00th=[  266], 40.00th=[  290], 50.00th=[  314], 60.00th=[  342],
     | 70.00th=[  378], 80.00th=[  422], 90.00th=[  498], 95.00th=[  572],
     | 99.00th=[  796], 99.50th=[ 1048], 99.90th=[ 3984], 99.95th=[ 4768],
     | 99.99th=[ 5856]
    bw (KB/s)  : min=10576, max=12184, per=3.13%, avg=11331.75, stdev=314.51
    lat (usec) : 250=23.88%, 500=66.24%, 750=8.64%, 1000=0.68%
    lat (msec) : 2=0.25%, 4=0.21%, 10=0.10%, 20=0.01%
  cpu          : usr=1.04%, sys=5.07%, ctx=909395, majf=0, minf=946
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=906078/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=3539.4MB, aggrb=362358KB/s, minb=362358KB/s, maxb=362358KB/s, mint=10002msec, maxt=10002msec
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 32 processes

128m: (groupid=0, jobs=32): err= 0: pid=23701
  read : io=3469.4MB, bw=355191KB/s, iops=88797 , runt= 10002msec
    clat (usec): min=139 , max=24224 , avg=357.25, stdev=154.31
     lat (usec): min=140 , max=24224 , avg=357.43, stdev=154.34
    clat percentiles (usec):
     |  1.00th=[  187],  5.00th=[  207], 10.00th=[  223], 20.00th=[  251],
     | 30.00th=[  278], 40.00th=[  302], 50.00th=[  330], 60.00th=[  362],
     | 70.00th=[  394], 80.00th=[  442], 90.00th=[  516], 95.00th=[  580],
     | 99.00th=[  772], 99.50th=[  924], 99.90th=[ 2008], 99.95th=[ 2480],
     | 99.99th=[ 3728]
    bw (KB/s)  : min= 9728, max=12160, per=3.13%, avg=11103.36, stdev=418.90
    lat (usec) : 250=19.55%, 500=68.77%, 750=10.53%, 1000=0.75%
    lat (msec) : 2=0.29%, 4=0.09%, 10=0.01%, 50=0.01%
  cpu          : usr=1.02%, sys=4.98%, ctx=891364, majf=0, minf=981
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=888156/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=3469.4MB, aggrb=355191KB/s, minb=355191KB/s, maxb=355191KB/s, mint=10002msec, maxt=10002msec
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 32 processes

128m: (groupid=0, jobs=32): err= 0: pid=23777
  read : io=3457.8MB, bw=354004KB/s, iops=88500 , runt= 10002msec
    clat (usec): min=139 , max=16956 , avg=358.50, stdev=184.59
     lat (usec): min=139 , max=16956 , avg=358.68, stdev=184.62
    clat percentiles (usec):
     |  1.00th=[  187],  5.00th=[  205], 10.00th=[  221], 20.00th=[  251],
     | 30.00th=[  278], 40.00th=[  302], 50.00th=[  330], 60.00th=[  362],
     | 70.00th=[  394], 80.00th=[  442], 90.00th=[  516], 95.00th=[  588],
     | 99.00th=[  772], 99.50th=[  916], 99.90th=[ 2192], 99.95th=[ 2864],
     | 99.99th=[ 4192]
    bw (KB/s)  : min= 9440, max=12072, per=3.13%, avg=11063.12, stdev=442.17
    lat (usec) : 250=19.72%, 500=68.43%, 750=10.69%, 1000=0.75%
    lat (msec) : 2=0.27%, 4=0.12%, 10=0.01%, 20=0.01%
  cpu          : usr=1.03%, sys=4.94%, ctx=888466, majf=0, minf=981
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=885187/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=3457.8MB, aggrb=354003KB/s, minb=354003KB/s, maxb=354003KB/s, mint=10002msec, maxt=10002msec
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 32 processes

128m: (groupid=0, jobs=32): err= 0: pid=23851
  read : io=3455.8MB, bw=353792KB/s, iops=88448 , runt= 10002msec
    clat (usec): min=143 , max=27499 , avg=358.69, stdev=160.26
     lat (usec): min=143 , max=27499 , avg=358.87, stdev=160.29
    clat percentiles (usec):
     |  1.00th=[  187],  5.00th=[  207], 10.00th=[  223], 20.00th=[  253],
     | 30.00th=[  278], 40.00th=[  306], 50.00th=[  330], 60.00th=[  362],
     | 70.00th=[  398], 80.00th=[  442], 90.00th=[  516], 95.00th=[  588],
     | 99.00th=[  788], 99.50th=[  948], 99.90th=[ 2040], 99.95th=[ 2576],
     | 99.99th=[ 3824]
    bw (KB/s)  : min= 9712, max=12352, per=3.12%, avg=11053.59, stdev=457.48
    lat (usec) : 250=19.26%, 500=68.85%, 750=10.64%, 1000=0.81%
    lat (msec) : 2=0.32%, 4=0.10%, 10=0.01%, 20=0.01%, 50=0.01%
  cpu          : usr=1.05%, sys=4.90%, ctx=887931, majf=0, minf=980
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=884658/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=3455.8MB, aggrb=353792KB/s, minb=353792KB/s, maxb=353792KB/s, mint=10002msec, maxt=10002msec
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 32 processes

128m: (groupid=0, jobs=32): err= 0: pid=23925
  read : io=3455.5MB, bw=353769KB/s, iops=88442 , runt= 10002msec
    clat (usec): min=139 , max=22671 , avg=358.75, stdev=145.54
     lat (usec): min=139 , max=22671 , avg=358.93, stdev=145.57
    clat percentiles (usec):
     |  1.00th=[  187],  5.00th=[  207], 10.00th=[  223], 20.00th=[  253],
     | 30.00th=[  278], 40.00th=[  306], 50.00th=[  334], 60.00th=[  362],
     | 70.00th=[  398], 80.00th=[  446], 90.00th=[  524], 95.00th=[  588],
     | 99.00th=[  772], 99.50th=[  900], 99.90th=[ 1656], 99.95th=[ 2160],
     | 99.99th=[ 2928]
    bw (KB/s)  : min= 9432, max=12336, per=3.12%, avg=11052.39, stdev=461.12
    lat (usec) : 250=19.00%, 500=68.77%, 750=11.07%, 1000=0.81%
    lat (msec) : 2=0.28%, 4=0.06%, 10=0.01%, 20=0.01%, 50=0.01%
  cpu          : usr=1.02%, sys=4.93%, ctx=887772, majf=0, minf=979
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=884600/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=3455.5MB, aggrb=353769KB/s, minb=353769KB/s, maxb=353769KB/s, mint=10002msec, maxt=10002msec
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 32 processes

128m: (groupid=0, jobs=32): err= 0: pid=23999
  read : io=3445.1MB, bw=352826KB/s, iops=88206 , runt= 10001msec
    clat (usec): min=142 , max=50998 , avg=359.74, stdev=153.82
     lat (usec): min=142 , max=50999 , avg=359.93, stdev=153.86
    clat percentiles (usec):
     |  1.00th=[  187],  5.00th=[  207], 10.00th=[  223], 20.00th=[  253],
     | 30.00th=[  278], 40.00th=[  306], 50.00th=[  334], 60.00th=[  362],
     | 70.00th=[  398], 80.00th=[  446], 90.00th=[  524], 95.00th=[  596],
     | 99.00th=[  820], 99.50th=[  980], 99.90th=[ 1432], 99.95th=[ 1832],
     | 99.99th=[ 2640]
    bw (KB/s)  : min= 9656, max=12200, per=3.12%, avg=11025.08, stdev=420.28
    lat (usec) : 250=19.24%, 500=68.40%, 750=10.92%, 1000=0.98%
    lat (msec) : 2=0.42%, 4=0.04%, 10=0.01%, 50=0.01%, 100=0.01%
  cpu          : usr=1.02%, sys=4.92%, ctx=885305, majf=0, minf=980
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=882153/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=3445.1MB, aggrb=352825KB/s, minb=352825KB/s, maxb=352825KB/s, mint=10001msec, maxt=10001msec
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 32 processes

128m: (groupid=0, jobs=32): err= 0: pid=24073
  read : io=3427.3MB, bw=350914KB/s, iops=87728 , runt= 10001msec
    clat (usec): min=140 , max=56975 , avg=361.73, stdev=168.78
     lat (usec): min=140 , max=56975 , avg=361.92, stdev=168.80
    clat percentiles (usec):
     |  1.00th=[  187],  5.00th=[  207], 10.00th=[  223], 20.00th=[  253],
     | 30.00th=[  278], 40.00th=[  306], 50.00th=[  334], 60.00th=[  366],
     | 70.00th=[  402], 80.00th=[  446], 90.00th=[  524], 95.00th=[  596],
     | 99.00th=[  844], 99.50th=[ 1020], 99.90th=[ 1480], 99.95th=[ 2040],
     | 99.99th=[ 3056]
    bw (KB/s)  : min= 8928, max=12088, per=3.12%, avg=10961.80, stdev=430.07
    lat (usec) : 250=19.21%, 500=68.11%, 750=11.09%, 1000=1.04%
    lat (msec) : 2=0.49%, 4=0.05%, 10=0.01%, 20=0.01%, 50=0.01%
    lat (msec) : 100=0.01%
  cpu          : usr=1.02%, sys=4.86%, ctx=880746, majf=0, minf=980
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=877372/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=3427.3MB, aggrb=350913KB/s, minb=350913KB/s, maxb=350913KB/s, mint=10001msec, maxt=10001msec
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 32 processes

128m: (groupid=0, jobs=32): err= 0: pid=24147
  read : io=3418.1MB, bw=350033KB/s, iops=87508 , runt= 10002msec
    clat (usec): min=138 , max=42181 , avg=362.59, stdev=198.54
     lat (usec): min=139 , max=42181 , avg=362.78, stdev=198.56
    clat percentiles (usec):
     |  1.00th=[  185],  5.00th=[  207], 10.00th=[  223], 20.00th=[  253],
     | 30.00th=[  278], 40.00th=[  306], 50.00th=[  334], 60.00th=[  366],
     | 70.00th=[  402], 80.00th=[  446], 90.00th=[  524], 95.00th=[  596],
     | 99.00th=[  820], 99.50th=[  996], 99.90th=[ 1624], 99.95th=[ 2096],
     | 99.99th=[ 6688]
    bw (KB/s)  : min= 8672, max=11936, per=3.12%, avg=10935.15, stdev=466.95
    lat (usec) : 250=18.94%, 500=68.43%, 750=11.13%, 1000=1.01%
    lat (msec) : 2=0.43%, 4=0.04%, 10=0.01%, 20=0.01%, 50=0.01%
  cpu          : usr=1.03%, sys=4.86%, ctx=878618, majf=0, minf=983
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=875257/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=3418.1MB, aggrb=350032KB/s, minb=350032KB/s, maxb=350032KB/s, mint=10002msec, maxt=10002msec
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 32 processes

128m: (groupid=0, jobs=32): err= 0: pid=24221
  read : io=3441.1MB, bw=352386KB/s, iops=88096 , runt= 10002msec
    clat (usec): min=145 , max=20726 , avg=360.16, stdev=166.93
     lat (usec): min=146 , max=20726 , avg=360.35, stdev=166.96
    clat percentiles (usec):
     |  1.00th=[  187],  5.00th=[  207], 10.00th=[  223], 20.00th=[  253],
     | 30.00th=[  278], 40.00th=[  306], 50.00th=[  334], 60.00th=[  362],
     | 70.00th=[  398], 80.00th=[  446], 90.00th=[  524], 95.00th=[  588],
     | 99.00th=[  780], 99.50th=[  924], 99.90th=[ 1640], 99.95th=[ 2192],
     | 99.99th=[ 5536]
    bw (KB/s)  : min= 9840, max=12504, per=3.12%, avg=11008.13, stdev=461.96
    lat (usec) : 250=19.03%, 500=68.66%, 750=11.08%, 1000=0.84%
    lat (msec) : 2=0.32%, 4=0.05%, 10=0.01%, 20=0.01%, 50=0.01%
  cpu          : usr=1.00%, sys=4.92%, ctx=884377, majf=0, minf=982
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=881141/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=3441.1MB, aggrb=352385KB/s, minb=352385KB/s, maxb=352385KB/s, mint=10002msec, maxt=10002msec
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 32 processes

128m: (groupid=0, jobs=32): err= 0: pid=24295
  read : io=3460.2MB, bw=354286KB/s, iops=88571 , runt= 10001msec
    clat (usec): min=149 , max=34974 , avg=358.25, stdev=150.25
     lat (usec): min=149 , max=34974 , avg=358.43, stdev=150.28
    clat percentiles (usec):
     |  1.00th=[  187],  5.00th=[  207], 10.00th=[  223], 20.00th=[  253],
     | 30.00th=[  278], 40.00th=[  306], 50.00th=[  334], 60.00th=[  362],
     | 70.00th=[  398], 80.00th=[  446], 90.00th=[  516], 95.00th=[  588],
     | 99.00th=[  764], 99.50th=[  884], 99.90th=[ 1656], 99.95th=[ 2192],
     | 99.99th=[ 3024]
    bw (KB/s)  : min= 8864, max=12336, per=3.12%, avg=11061.79, stdev=431.05
    lat (usec) : 250=18.96%, 500=69.02%, 750=10.92%, 1000=0.77%
    lat (msec) : 2=0.27%, 4=0.06%, 10=0.01%, 20=0.01%, 50=0.01%
  cpu          : usr=1.04%, sys=4.92%, ctx=889060, majf=0, minf=980
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=885803/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=3460.2MB, aggrb=354285KB/s, minb=354285KB/s, maxb=354285KB/s, mint=10001msec, maxt=10001msec
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 32 processes

128m: (groupid=0, jobs=32): err= 0: pid=24371
  read : io=3439.2MB, bw=352185KB/s, iops=88046 , runt= 10002msec
    clat (usec): min=141 , max=22707 , avg=360.39, stdev=154.67
     lat (usec): min=141 , max=22707 , avg=360.57, stdev=154.70
    clat percentiles (usec):
     |  1.00th=[  187],  5.00th=[  207], 10.00th=[  223], 20.00th=[  253],
     | 30.00th=[  278], 40.00th=[  306], 50.00th=[  334], 60.00th=[  366],
     | 70.00th=[  402], 80.00th=[  446], 90.00th=[  524], 95.00th=[  588],
     | 99.00th=[  780], 99.50th=[  924], 99.90th=[ 1832], 99.95th=[ 2352],
     | 99.99th=[ 3568]
    bw (KB/s)  : min= 9952, max=12232, per=3.12%, avg=11000.50, stdev=456.36
    lat (usec) : 250=18.98%, 500=68.63%, 750=11.19%, 1000=0.81%
    lat (msec) : 2=0.30%, 4=0.07%, 10=0.01%, 20=0.01%, 50=0.01%
  cpu          : usr=1.04%, sys=4.87%, ctx=884041, majf=0, minf=979
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=880639/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=3439.2MB, aggrb=352185KB/s, minb=352185KB/s, maxb=352185KB/s, mint=10002msec, maxt=10002msec
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 32 processes

128m: (groupid=0, jobs=32): err= 0: pid=24445
  read : io=3465.7MB, bw=354841KB/s, iops=88710 , runt= 10001msec
    clat (usec): min=138 , max=36206 , avg=357.65, stdev=159.56
     lat (usec): min=138 , max=36206 , avg=357.84, stdev=159.60
    clat percentiles (usec):
     |  1.00th=[  187],  5.00th=[  205], 10.00th=[  223], 20.00th=[  251],
     | 30.00th=[  278], 40.00th=[  302], 50.00th=[  330], 60.00th=[  362],
     | 70.00th=[  398], 80.00th=[  442], 90.00th=[  516], 95.00th=[  588],
     | 99.00th=[  780], 99.50th=[  924], 99.90th=[ 1736], 99.95th=[ 2480],
     | 99.99th=[ 4448]
    bw (KB/s)  : min= 9824, max=12112, per=3.12%, avg=11084.07, stdev=425.90
    lat (usec) : 250=19.67%, 500=68.45%, 750=10.66%, 1000=0.83%
    lat (msec) : 2=0.31%, 4=0.06%, 10=0.02%, 20=0.01%, 50=0.01%
  cpu          : usr=1.04%, sys=4.94%, ctx=890416, majf=0, minf=978
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=887192/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=3465.7MB, aggrb=354841KB/s, minb=354841KB/s, maxb=354841KB/s, mint=10001msec, maxt=10001msec
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 32 processes

128m: (groupid=0, jobs=32): err= 0: pid=24519
  read : io=3447.8MB, bw=353016KB/s, iops=88254 , runt= 10001msec
    clat (usec): min=136 , max=23410 , avg=359.56, stdev=144.09
     lat (usec): min=136 , max=23410 , avg=359.74, stdev=144.12
    clat percentiles (usec):
     |  1.00th=[  185],  5.00th=[  207], 10.00th=[  223], 20.00th=[  253],
     | 30.00th=[  278], 40.00th=[  306], 50.00th=[  334], 60.00th=[  362],
     | 70.00th=[  398], 80.00th=[  446], 90.00th=[  524], 95.00th=[  588],
     | 99.00th=[  788], 99.50th=[  948], 99.90th=[ 1400], 99.95th=[ 1944],
     | 99.99th=[ 2992]
    bw (KB/s)  : min= 9784, max=12080, per=3.12%, avg=11027.28, stdev=438.46
    lat (usec) : 250=19.03%, 500=68.60%, 750=11.08%, 1000=0.88%
    lat (msec) : 2=0.37%, 4=0.04%, 10=0.01%, 20=0.01%, 50=0.01%
  cpu          : usr=1.00%, sys=4.93%, ctx=885849, majf=0, minf=979
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=882629/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=3447.8MB, aggrb=353016KB/s, minb=353016KB/s, maxb=353016KB/s, mint=10001msec, maxt=10001msec
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 32 processes

128m: (groupid=0, jobs=32): err= 0: pid=24593
  read : io=3461.3MB, bw=354392KB/s, iops=88598 , runt= 10001msec
    clat (usec): min=138 , max=25894 , avg=358.17, stdev=147.25
     lat (usec): min=138 , max=25894 , avg=358.35, stdev=147.27
    clat percentiles (usec):
     |  1.00th=[  187],  5.00th=[  207], 10.00th=[  223], 20.00th=[  251],
     | 30.00th=[  278], 40.00th=[  306], 50.00th=[  330], 60.00th=[  362],
     | 70.00th=[  398], 80.00th=[  446], 90.00th=[  524], 95.00th=[  588],
     | 99.00th=[  796], 99.50th=[  964], 99.90th=[ 1416], 99.95th=[ 1880],
     | 99.99th=[ 3312]
    bw (KB/s)  : min= 9784, max=12120, per=3.13%, avg=11074.93, stdev=407.14
    lat (usec) : 250=19.47%, 500=68.40%, 750=10.83%, 1000=0.87%
    lat (msec) : 2=0.39%, 4=0.04%, 10=0.01%, 20=0.01%, 50=0.01%
  cpu          : usr=1.03%, sys=4.92%, ctx=889150, majf=0, minf=978
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=886069/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=3461.3MB, aggrb=354392KB/s, minb=354392KB/s, maxb=354392KB/s, mint=10001msec, maxt=10001msec
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 32 processes

128m: (groupid=0, jobs=32): err= 0: pid=24667
  read : io=3477.9MB, bw=356059KB/s, iops=89014 , runt= 10002msec
    clat (usec): min=138 , max=32062 , avg=356.40, stdev=149.26
     lat (usec): min=139 , max=32062 , avg=356.59, stdev=149.29
    clat percentiles (usec):
     |  1.00th=[  187],  5.00th=[  205], 10.00th=[  221], 20.00th=[  249],
     | 30.00th=[  274], 40.00th=[  302], 50.00th=[  330], 60.00th=[  358],
     | 70.00th=[  394], 80.00th=[  442], 90.00th=[  516], 95.00th=[  588],
     | 99.00th=[  804], 99.50th=[  972], 99.90th=[ 1432], 99.95th=[ 1880],
     | 99.99th=[ 2864]
    bw (KB/s)  : min=10296, max=11960, per=3.13%, avg=11130.18, stdev=345.64
    lat (usec) : 250=20.14%, 500=67.97%, 750=10.54%, 1000=0.91%
    lat (msec) : 2=0.42%, 4=0.03%, 10=0.01%, 20=0.01%, 50=0.01%
  cpu          : usr=1.03%, sys=4.96%, ctx=893625, majf=0, minf=980
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=890326/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=3477.9MB, aggrb=356059KB/s, minb=356059KB/s, maxb=356059KB/s, mint=10002msec, maxt=10002msec
