128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 16 processes
128m: Laying out IO file(s) (1 file(s) / 32MB)
128m: Laying out IO file(s) (1 file(s) / 32MB)
128m: Laying out IO file(s) (1 file(s) / 32MB)
128m: Laying out IO file(s) (1 file(s) / 32MB)
128m: Laying out IO file(s) (1 file(s) / 32MB)
128m: Laying out IO file(s) (1 file(s) / 32MB)
128m: Laying out IO file(s) (1 file(s) / 32MB)
128m: Laying out IO file(s) (1 file(s) / 32MB)
128m: Laying out IO file(s) (1 file(s) / 32MB)
128m: Laying out IO file(s) (1 file(s) / 32MB)
128m: Laying out IO file(s) (1 file(s) / 32MB)
128m: Laying out IO file(s) (1 file(s) / 32MB)
128m: Laying out IO file(s) (1 file(s) / 32MB)
128m: Laying out IO file(s) (1 file(s) / 32MB)
128m: Laying out IO file(s) (1 file(s) / 32MB)
128m: Laying out IO file(s) (1 file(s) / 32MB)

128m: (groupid=0, jobs=16): err= 0: pid=7170
  read : io=93472KB, bw=9337.9KB/s, iops=2334 , runt= 10010msec
    clat (usec): min=169 , max=1661.2K, avg=6839.58, stdev=94026.52
     lat (usec): min=170 , max=1661.2K, avg=6840.44, stdev=94026.53
    clat percentiles (usec):
     |  1.00th=[  266],  5.00th=[  310], 10.00th=[  338], 20.00th=[  358],
     | 30.00th=[  366], 40.00th=[  378], 50.00th=[  394], 60.00th=[  410],
     | 70.00th=[  426], 80.00th=[  442], 90.00th=[  474], 95.00th=[  516],
     | 99.00th=[  700], 99.50th=[305152], 99.90th=[1548288], 99.95th=[1564672],
     | 99.99th=[1597440]
    bw (KB/s)  : min=    2, max= 2048, per=6.39%, avg=596.73, stdev=413.74
    lat (usec) : 250=0.95%, 500=93.04%, 750=5.11%, 1000=0.10%
    lat (msec) : 2=0.06%, 4=0.03%, 10=0.19%, 50=0.01%, 250=0.01%
    lat (msec) : 500=0.02%, 750=0.06%, 1000=0.04%, 2000=0.38%
  cpu          : usr=0.15%, sys=1.93%, ctx=23437, majf=0, minf=502
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=23368/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=93472KB, aggrb=9337KB/s, minb=9337KB/s, maxb=9337KB/s, mint=10010msec, maxt=10010msec

Disk stats (read/write):
  hda: ios=23016/2, merge=0/1, ticks=142449/1853, in_queue=156708, util=99.14%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 16 processes

128m: (groupid=0, jobs=16): err= 0: pid=9323
  read : io=133484KB, bw=13336KB/s, iops=3334 , runt= 10009msec
    clat (usec): min=79 , max=2229.3K, avg=4790.96, stdev=79716.08
     lat (usec): min=79 , max=2229.3K, avg=4791.45, stdev=79716.13
    clat percentiles (usec):
     |  1.00th=[   97],  5.00th=[  187], 10.00th=[  201], 20.00th=[  213],
     | 30.00th=[  241], 40.00th=[  258], 50.00th=[  270], 60.00th=[  286],
     | 70.00th=[  322], 80.00th=[  366], 90.00th=[  410], 95.00th=[  450],
     | 99.00th=[  644], 99.50th=[  804], 99.90th=[1515520], 99.95th=[1515520],
     | 99.99th=[1925120]
    bw (KB/s)  : min=    2, max= 4383, per=6.44%, avg=858.96, stdev=742.42
    lat (usec) : 100=1.07%, 250=32.74%, 500=63.25%, 750=2.37%, 1000=0.14%
    lat (msec) : 2=0.02%, 4=0.01%, 10=0.02%, 250=0.04%, 500=0.02%
    lat (msec) : 750=0.03%, 1000=0.02%, 2000=0.26%, >=2000=0.01%
  cpu          : usr=0.13%, sys=1.47%, ctx=33571, majf=0, minf=502
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=33371/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=133484KB, aggrb=13336KB/s, minb=13336KB/s, maxb=13336KB/s, mint=10009msec, maxt=10009msec

Disk stats (read/write):
  hda: ios=33447/4, merge=0/14, ticks=143282/3143, in_queue=160574, util=99.66%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 16 processes

128m: (groupid=0, jobs=16): err= 0: pid=28176
  read : io=148996KB, bw=14892KB/s, iops=3723 , runt= 10005msec
    clat (usec): min=81 , max=1730.8K, avg=4290.88, stdev=74071.67
     lat (usec): min=81 , max=1730.8K, avg=4291.28, stdev=74071.68
    clat percentiles (usec):
     |  1.00th=[   92],  5.00th=[  181], 10.00th=[  197], 20.00th=[  211],
     | 30.00th=[  225], 40.00th=[  245], 50.00th=[  258], 60.00th=[  266],
     | 70.00th=[  278], 80.00th=[  290], 90.00th=[  330], 95.00th=[  410],
     | 99.00th=[  580], 99.50th=[  684], 99.90th=[1515520], 99.95th=[1515520],
     | 99.99th=[1515520]
    bw (KB/s)  : min=    2, max= 3111, per=6.25%, avg=930.61, stdev=626.16
    lat (usec) : 100=1.42%, 250=42.18%, 500=54.07%, 750=1.93%, 1000=0.04%
    lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 50=0.01%, 100=0.01%
    lat (msec) : 250=0.02%, 500=0.02%, 750=0.03%, 1000=0.03%, 2000=0.24%
  cpu          : usr=0.13%, sys=1.39%, ctx=37443, majf=5, minf=497
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=37249/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=148996KB, aggrb=14892KB/s, minb=14892KB/s, maxb=14892KB/s, mint=10005msec, maxt=10005msec

Disk stats (read/write):
  hda: ios=37234/4, merge=16/24, ticks=150361/3241, in_queue=167881, util=99.45%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 16 processes

128m: (groupid=0, jobs=16): err= 0: pid=5842
  read : io=148716KB, bw=14864KB/s, iops=3716 , runt= 10005msec
    clat (usec): min=81 , max=2138.5K, avg=4299.63, stdev=74362.15
     lat (usec): min=81 , max=2138.5K, avg=4300.02, stdev=74362.15
    clat percentiles (usec):
     |  1.00th=[   89],  5.00th=[  179], 10.00th=[  193], 20.00th=[  209],
     | 30.00th=[  227], 40.00th=[  249], 50.00th=[  262], 60.00th=[  270],
     | 70.00th=[  278], 80.00th=[  294], 90.00th=[  334], 95.00th=[  414],
     | 99.00th=[  580], 99.50th=[  684], 99.90th=[1515520], 99.95th=[1515520],
     | 99.99th=[1859584]
    bw (KB/s)  : min=    2, max= 5488, per=6.84%, avg=1016.97, stdev=1010.24
    lat (usec) : 100=1.68%, 250=38.93%, 500=57.15%, 750=1.85%, 1000=0.03%
    lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 50=0.01%, 250=0.02%
    lat (msec) : 500=0.04%, 750=0.02%, 1000=0.02%, 2000=0.24%, >=2000=0.01%
  cpu          : usr=0.12%, sys=1.25%, ctx=37375, majf=6, minf=496
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=37179/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=148716KB, aggrb=14864KB/s, minb=14864KB/s, maxb=14864KB/s, mint=10005msec, maxt=10005msec

Disk stats (read/write):
  hda: ios=37256/4, merge=16/21, ticks=145423/3244, in_queue=162361, util=99.32%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 16 processes

128m: (groupid=0, jobs=16): err= 0: pid=9901
  read : io=103960KB, bw=10387KB/s, iops=2596 , runt= 10009msec
    clat (usec): min=88 , max=1713.8K, avg=6147.39, stdev=88612.70
     lat (usec): min=88 , max=1713.8K, avg=6148.24, stdev=88612.74
    clat percentiles (usec):
     |  1.00th=[  211],  5.00th=[  294], 10.00th=[  302], 20.00th=[  314],
     | 30.00th=[  334], 40.00th=[  350], 50.00th=[  362], 60.00th=[  370],
     | 70.00th=[  386], 80.00th=[  406], 90.00th=[  438], 95.00th=[  532],
     | 99.00th=[  780], 99.50th=[ 2384], 99.90th=[1515520], 99.95th=[1515520],
     | 99.99th=[1515520]
    bw (KB/s)  : min=    2, max= 2096, per=6.29%, avg=653.25, stdev=414.77
    lat (usec) : 100=0.01%, 250=1.65%, 500=92.81%, 750=4.31%, 1000=0.62%
    lat (msec) : 2=0.10%, 4=0.01%, 10=0.01%, 50=0.01%, 100=0.01%
    lat (msec) : 250=0.03%, 500=0.03%, 750=0.04%, 1000=0.03%, 2000=0.35%
  cpu          : usr=0.18%, sys=2.04%, ctx=26222, majf=0, minf=502
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=25990/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=103960KB, aggrb=10386KB/s, minb=10386KB/s, maxb=10386KB/s, mint=10009msec, maxt=10009msec

Disk stats (read/write):
  hda: ios=26060/4, merge=16/23, ticks=149839/3240, in_queue=167595, util=99.42%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 16 processes

128m: (groupid=0, jobs=16): err= 0: pid=21083
  read : io=146372KB, bw=14628KB/s, iops=3657 , runt= 10006msec
    clat (usec): min=79 , max=1533.5K, avg=4368.51, stdev=76480.77
     lat (usec): min=79 , max=1533.5K, avg=4368.92, stdev=76480.77
    clat percentiles (usec):
     |  1.00th=[   91],  5.00th=[  179], 10.00th=[  193], 20.00th=[  209],
     | 30.00th=[  227], 40.00th=[  251], 50.00th=[  262], 60.00th=[  270],
     | 70.00th=[  282], 80.00th=[  302], 90.00th=[  354], 95.00th=[  426],
     | 99.00th=[  588], 99.50th=[  692], 99.90th=[1515520], 99.95th=[1515520],
     | 99.99th=[1515520]
    bw (KB/s)  : min=    2, max= 3152, per=6.08%, avg=889.51, stdev=437.49
    lat (usec) : 100=1.56%, 250=38.19%, 500=57.81%, 750=2.04%, 1000=0.07%
    lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 100=0.03%, 250=0.01%
    lat (msec) : 500=0.01%, 750=0.02%, 1000=0.01%, 2000=0.26%
  cpu          : usr=0.11%, sys=1.35%, ctx=36786, majf=0, minf=502
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=36593/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=146372KB, aggrb=14628KB/s, minb=14628KB/s, maxb=14628KB/s, mint=10006msec, maxt=10006msec

Disk stats (read/write):
  hda: ios=36629/4, merge=0/9, ticks=157384/4533, in_queue=164265, util=99.20%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 16 processes

128m: (groupid=0, jobs=16): err= 0: pid=21127
  read : io=103576KB, bw=10348KB/s, iops=2587 , runt= 10009msec
    clat (usec): min=168 , max=1530.9K, avg=6170.63, stdev=90926.92
     lat (usec): min=168 , max=1530.9K, avg=6171.47, stdev=90926.93
    clat percentiles (usec):
     |  1.00th=[  219],  5.00th=[  290], 10.00th=[  298], 20.00th=[  310],
     | 30.00th=[  330], 40.00th=[  350], 50.00th=[  362], 60.00th=[  374],
     | 70.00th=[  390], 80.00th=[  410], 90.00th=[  446], 95.00th=[  572],
     | 99.00th=[  788], 99.50th=[ 1096], 99.90th=[1515520], 99.95th=[1515520],
     | 99.99th=[1515520]
    bw (KB/s)  : min=    2, max= 1948, per=6.18%, avg=639.86, stdev=314.62
    lat (usec) : 250=1.37%, 500=92.23%, 750=5.06%, 1000=0.78%
    lat (msec) : 2=0.10%, 4=0.01%, 10=0.01%, 100=0.02%, 250=0.02%
    lat (msec) : 500=0.02%, 750=0.02%, 1000=0.02%, 2000=0.37%
  cpu          : usr=0.18%, sys=2.11%, ctx=26095, majf=0, minf=502
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=25894/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=103576KB, aggrb=10348KB/s, minb=10348KB/s, maxb=10348KB/s, mint=10009msec, maxt=10009msec

Disk stats (read/write):
  hda: ios=25935/4, merge=0/7, ticks=152361/4042, in_queue=161800, util=99.18%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 16 processes

128m: (groupid=0, jobs=16): err= 0: pid=21169
  read : io=103012KB, bw=10292KB/s, iops=2572 , runt= 10009msec
    clat (usec): min=170 , max=1535.1K, avg=6204.96, stdev=91052.50
     lat (usec): min=170 , max=1535.1K, avg=6205.82, stdev=91052.51
    clat percentiles (usec):
     |  1.00th=[  215],  5.00th=[  290], 10.00th=[  298], 20.00th=[  314],
     | 30.00th=[  334], 40.00th=[  350], 50.00th=[  362], 60.00th=[  374],
     | 70.00th=[  390], 80.00th=[  410], 90.00th=[  454], 95.00th=[  572],
     | 99.00th=[  804], 99.50th=[ 1304], 99.90th=[1515520], 99.95th=[1515520],
     | 99.99th=[1515520]
    bw (KB/s)  : min=    2, max= 1996, per=6.24%, avg=641.83, stdev=327.94
    lat (usec) : 250=1.36%, 500=92.09%, 750=5.20%, 1000=0.75%
    lat (msec) : 2=0.10%, 4=0.01%, 10=0.01%, 100=0.04%, 250=0.02%
    lat (msec) : 500=0.02%, 750=0.03%, 1000=0.02%, 2000=0.37%
  cpu          : usr=0.16%, sys=2.12%, ctx=25942, majf=0, minf=502
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=25753/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=103012KB, aggrb=10291KB/s, minb=10291KB/s, maxb=10291KB/s, mint=10009msec, maxt=10009msec

Disk stats (read/write):
  hda: ios=25739/4, merge=0/7, ticks=155891/4653, in_queue=161977, util=99.22%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 16 processes

128m: (groupid=0, jobs=16): err= 0: pid=21212
  read : io=102164KB, bw=10208KB/s, iops=2552 , runt= 10008msec
    clat (usec): min=170 , max=1617.1K, avg=6255.44, stdev=91795.19
     lat (usec): min=171 , max=1617.1K, avg=6256.30, stdev=91795.20
    clat percentiles (usec):
     |  1.00th=[  217],  5.00th=[  298], 10.00th=[  302], 20.00th=[  314],
     | 30.00th=[  338], 40.00th=[  354], 50.00th=[  366], 60.00th=[  378],
     | 70.00th=[  394], 80.00th=[  414], 90.00th=[  458], 95.00th=[  580],
     | 99.00th=[  796], 99.50th=[ 1080], 99.90th=[1515520], 99.95th=[1515520],
     | 99.99th=[1515520]
    bw (KB/s)  : min=    2, max= 1872, per=6.16%, avg=629.00, stdev=308.26
    lat (usec) : 250=1.51%, 500=91.36%, 750=5.72%, 1000=0.87%
    lat (msec) : 2=0.09%, 4=0.01%, 10=0.01%, 250=0.02%, 500=0.02%
    lat (msec) : 750=0.02%, 1000=0.02%, 2000=0.37%
  cpu          : usr=0.17%, sys=2.03%, ctx=25747, majf=0, minf=502
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=25541/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=102164KB, aggrb=10208KB/s, minb=10208KB/s, maxb=10208KB/s, mint=10008msec, maxt=10008msec

Disk stats (read/write):
  hda: ios=25567/3, merge=0/7, ticks=153993/4483, in_queue=161804, util=99.17%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 16 processes

128m: (groupid=0, jobs=16): err= 0: pid=21255
  read : io=103104KB, bw=10301KB/s, iops=2575 , runt= 10009msec
    clat (usec): min=166 , max=1525.5K, avg=6198.95, stdev=91113.94
     lat (usec): min=167 , max=1525.5K, avg=6199.80, stdev=91113.95
    clat percentiles (usec):
     |  1.00th=[  213],  5.00th=[  294], 10.00th=[  302], 20.00th=[  314],
     | 30.00th=[  334], 40.00th=[  350], 50.00th=[  362], 60.00th=[  374],
     | 70.00th=[  390], 80.00th=[  414], 90.00th=[  454], 95.00th=[  580],
     | 99.00th=[  788], 99.50th=[ 1192], 99.90th=[1515520], 99.95th=[1515520],
     | 99.99th=[1515520]
    bw (KB/s)  : min=    2, max= 1960, per=6.18%, avg=636.41, stdev=315.57
    lat (usec) : 250=1.56%, 500=91.60%, 750=5.58%, 1000=0.67%
    lat (msec) : 2=0.11%, 4=0.01%, 10=0.01%, 100=0.02%, 250=0.02%
    lat (msec) : 500=0.02%, 750=0.02%, 1000=0.02%, 2000=0.37%
  cpu          : usr=0.17%, sys=2.08%, ctx=25988, majf=0, minf=502
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=25776/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=103104KB, aggrb=10301KB/s, minb=10301KB/s, maxb=10301KB/s, mint=10009msec, maxt=10009msec

Disk stats (read/write):
  hda: ios=25775/4, merge=0/7, ticks=152210/4141, in_queue=161566, util=99.17%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 16 processes

128m: (groupid=0, jobs=16): err= 0: pid=21303
  read : io=138708KB, bw=13860KB/s, iops=3464 , runt= 10008msec
    clat (usec): min=80 , max=1521.9K, avg=4609.79, stdev=78568.44
     lat (usec): min=81 , max=1521.1K, avg=4610.24, stdev=78568.45
    clat percentiles (usec):
     |  1.00th=[   90],  5.00th=[  181], 10.00th=[  197], 20.00th=[  211],
     | 30.00th=[  233], 40.00th=[  253], 50.00th=[  266], 60.00th=[  274],
     | 70.00th=[  294], 80.00th=[  338], 90.00th=[  410], 95.00th=[  466],
     | 99.00th=[  644], 99.50th=[  772], 99.90th=[1515520], 99.95th=[1515520],
     | 99.99th=[1515520]
    bw (KB/s)  : min=    2, max= 2912, per=6.06%, avg=839.45, stdev=379.26
    lat (usec) : 100=1.91%, 250=35.41%, 500=59.36%, 750=2.77%, 1000=0.19%
    lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 50=0.01%, 250=0.01%
    lat (msec) : 500=0.01%, 750=0.01%, 1000=0.01%, 2000=0.27%
  cpu          : usr=0.13%, sys=1.41%, ctx=34856, majf=0, minf=502
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=34677/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=138708KB, aggrb=13859KB/s, minb=13859KB/s, maxb=13859KB/s, mint=10008msec, maxt=10008msec

Disk stats (read/write):
  hda: ios=34733/4, merge=0/7, ticks=150765/3878, in_queue=162661, util=99.18%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 16 processes

128m: (groupid=0, jobs=16): err= 0: pid=21346
  read : io=100196KB, bw=10011KB/s, iops=2502 , runt= 10009msec
    clat (usec): min=172 , max=1535.3K, avg=6378.50, stdev=92629.54
     lat (usec): min=173 , max=1535.3K, avg=6379.36, stdev=92629.55
    clat percentiles (usec):
     |  1.00th=[  219],  5.00th=[  298], 10.00th=[  306], 20.00th=[  318],
     | 30.00th=[  342], 40.00th=[  358], 50.00th=[  370], 60.00th=[  382],
     | 70.00th=[  398], 80.00th=[  422], 90.00th=[  474], 95.00th=[  588],
     | 99.00th=[  836], 99.50th=[ 2008], 99.90th=[1515520], 99.95th=[1515520],
     | 99.99th=[1531904]
    bw (KB/s)  : min=    2, max= 1668, per=6.06%, avg=606.38, stdev=280.25
    lat (usec) : 250=1.44%, 500=90.45%, 750=6.53%, 1000=0.94%
    lat (msec) : 2=0.13%, 4=0.01%, 10=0.04%, 100=0.01%, 250=0.01%
    lat (msec) : 500=0.02%, 750=0.02%, 1000=0.02%, 2000=0.38%
  cpu          : usr=0.16%, sys=2.08%, ctx=25254, majf=0, minf=502
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=25049/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=100196KB, aggrb=10010KB/s, minb=10010KB/s, maxb=10010KB/s, mint=10009msec, maxt=10009msec

Disk stats (read/write):
  hda: ios=25071/4, merge=0/7, ticks=149221/3756, in_queue=161336, util=99.18%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 16 processes

128m: (groupid=0, jobs=16): err= 0: pid=21390
  read : io=99888KB, bw=9979.9KB/s, iops=2494 , runt= 10009msec
    clat (usec): min=175 , max=1528.8K, avg=6398.14, stdev=92689.02
     lat (usec): min=176 , max=1528.8K, avg=6399.02, stdev=92689.07
    clat percentiles (usec):
     |  1.00th=[  215],  5.00th=[  298], 10.00th=[  302], 20.00th=[  318],
     | 30.00th=[  342], 40.00th=[  358], 50.00th=[  370], 60.00th=[  382],
     | 70.00th=[  402], 80.00th=[  426], 90.00th=[  482], 95.00th=[  596],
     | 99.00th=[  820], 99.50th=[ 2224], 99.90th=[1515520], 99.95th=[1515520],
     | 99.99th=[1515520]
    bw (KB/s)  : min=    2, max= 1878, per=6.15%, avg=613.80, stdev=294.04
    lat (usec) : 250=1.63%, 500=89.85%, 750=7.04%, 1000=0.84%
    lat (msec) : 2=0.14%, 4=0.01%, 10=0.03%, 100=0.01%, 250=0.02%
    lat (msec) : 500=0.02%, 750=0.02%, 1000=0.02%, 2000=0.38%
  cpu          : usr=0.19%, sys=2.04%, ctx=25177, majf=0, minf=502
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=24972/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=99888KB, aggrb=9979KB/s, minb=9979KB/s, maxb=9979KB/s, mint=10009msec, maxt=10009msec

Disk stats (read/write):
  hda: ios=24963/4, merge=0/7, ticks=148902/3838, in_queue=161198, util=99.14%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 16 processes

128m: (groupid=0, jobs=16): err= 0: pid=21432
  read : io=101204KB, bw=10111KB/s, iops=2527 , runt= 10009msec
    clat (usec): min=171 , max=1524.3K, avg=6314.91, stdev=92088.38
     lat (usec): min=171 , max=1524.3K, avg=6315.79, stdev=92088.40
    clat percentiles (usec):
     |  1.00th=[  211],  5.00th=[  298], 10.00th=[  302], 20.00th=[  318],
     | 30.00th=[  342], 40.00th=[  358], 50.00th=[  366], 60.00th=[  378],
     | 70.00th=[  398], 80.00th=[  418], 90.00th=[  466], 95.00th=[  596],
     | 99.00th=[  804], 99.50th=[ 1160], 99.90th=[1515520], 99.95th=[1515520],
     | 99.99th=[1515520]
    bw (KB/s)  : min=    2, max= 1925, per=6.16%, avg=622.75, stdev=307.81
    lat (usec) : 250=1.48%, 500=91.01%, 750=6.01%, 1000=0.91%
    lat (msec) : 2=0.11%, 4=0.01%, 10=0.02%, 100=0.01%, 250=0.02%
    lat (msec) : 500=0.02%, 750=0.02%, 1000=0.02%, 2000=0.38%
  cpu          : usr=0.19%, sys=2.00%, ctx=25508, majf=0, minf=502
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=25301/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=101204KB, aggrb=10111KB/s, minb=10111KB/s, maxb=10111KB/s, mint=10009msec, maxt=10009msec

Disk stats (read/write):
  hda: ios=25349/4, merge=0/9, ticks=150431/3831, in_queue=163079, util=99.18%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 16 processes

128m: (groupid=0, jobs=16): err= 0: pid=21475
  read : io=100432KB, bw=10035KB/s, iops=2508 , runt= 10008msec
    clat (usec): min=177 , max=1531.2K, avg=6363.70, stdev=92388.64
     lat (usec): min=178 , max=1531.2K, avg=6364.56, stdev=92388.66
    clat percentiles (usec):
     |  1.00th=[  215],  5.00th=[  298], 10.00th=[  306], 20.00th=[  322],
     | 30.00th=[  342], 40.00th=[  358], 50.00th=[  370], 60.00th=[  382],
     | 70.00th=[  398], 80.00th=[  422], 90.00th=[  470], 95.00th=[  580],
     | 99.00th=[  812], 99.50th=[ 4128], 99.90th=[1515520], 99.95th=[1515520],
     | 99.99th=[1515520]
    bw (KB/s)  : min=    2, max= 1940, per=6.18%, avg=620.51, stdev=315.33
    lat (usec) : 250=1.62%, 500=90.77%, 750=6.18%, 1000=0.80%
    lat (msec) : 2=0.12%, 4=0.01%, 10=0.04%, 100=0.02%, 250=0.01%
    lat (msec) : 500=0.02%, 750=0.02%, 1000=0.02%, 2000=0.38%
  cpu          : usr=0.16%, sys=2.03%, ctx=25295, majf=0, minf=502
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=25108/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=100432KB, aggrb=10035KB/s, minb=10035KB/s, maxb=10035KB/s, mint=10008msec, maxt=10008msec

Disk stats (read/write):
  hda: ios=25101/4, merge=0/7, ticks=151397/4045, in_queue=161541, util=99.23%
