128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)
128m: Laying out IO file(s) (1 file(s) / 8MB)

128m: (groupid=0, jobs=64): err= 0: pid=21558
  read : io=110148KB, bw=10860KB/s, iops=2714 , runt= 10143msec
    clat (usec): min=169 , max=4842.5K, avg=23341.43, stdev=286945.01
     lat (usec): min=170 , max=4842.5K, avg=23342.60, stdev=286945.12
    clat percentiles (usec):
     |  1.00th=[  189],  5.00th=[  221], 10.00th=[  294], 20.00th=[  314],
     | 30.00th=[  346], 40.00th=[  378], 50.00th=[  462], 60.00th=[  588],
     | 70.00th=[  652], 80.00th=[  700], 90.00th=[  780], 95.00th=[  900],
     | 99.00th=[ 1368], 99.50th=[2244608], 99.90th=[4489216], 99.95th=[4554752],
     | 99.99th=[4751360]
    bw (KB/s)  : min=    0, max= 1790, per=1.87%, avg=203.07, stdev=272.18
    lat (usec) : 250=6.61%, 500=45.83%, 750=35.15%, 1000=10.20%
    lat (msec) : 2=1.29%, 4=0.03%, 10=0.08%, 20=0.01%, 50=0.02%
    lat (msec) : 250=0.03%, 500=0.03%, 750=0.03%, 1000=0.02%, 2000=0.13%
    lat (msec) : >=2000=0.54%
  cpu          : usr=0.06%, sys=0.36%, ctx=28480, majf=0, minf=2095
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=27537/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=110148KB, aggrb=10859KB/s, minb=10859KB/s, maxb=10859KB/s, mint=10143msec, maxt=10143msec

Disk stats (read/write):
  hda: ios=27517/2, merge=0/6, ticks=626721/4999, in_queue=642592, util=99.03%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=21697
  read : io=104844KB, bw=10441KB/s, iops=2610 , runt= 10042msec
    clat (usec): min=163 , max=5055.5K, avg=24433.89, stdev=292586.02
     lat (usec): min=164 , max=5055.5K, avg=24435.07, stdev=292586.01
    clat percentiles (usec):
     |  1.00th=[  189],  5.00th=[  225], 10.00th=[  302], 20.00th=[  346],
     | 30.00th=[  378], 40.00th=[  426], 50.00th=[  540], 60.00th=[  628],
     | 70.00th=[  676], 80.00th=[  732], 90.00th=[  836], 95.00th=[  956],
     | 99.00th=[ 5792], 99.50th=[2605056], 99.90th=[4227072], 99.95th=[4292608],
     | 99.99th=[4947968]
    bw (KB/s)  : min=    0, max= 2512, per=1.89%, avg=197.22, stdev=291.92
    lat (usec) : 250=6.25%, 500=40.56%, 750=36.25%, 1000=13.21%
    lat (msec) : 2=2.61%, 4=0.10%, 10=0.17%, 20=0.01%, 50=0.01%
    lat (msec) : 100=0.02%, 250=0.02%, 500=0.04%, 750=0.03%, 1000=0.03%
    lat (msec) : 2000=0.12%, >=2000=0.58%
  cpu          : usr=0.05%, sys=0.32%, ctx=27494, majf=0, minf=2096
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=26211/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=104844KB, aggrb=10440KB/s, minb=10440KB/s, maxb=10440KB/s, mint=10042msec, maxt=10042msec

Disk stats (read/write):
  hda: ios=26162/1, merge=0/8, ticks=478152/4969, in_queue=638853, util=99.05%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=21837
  read : io=104360KB, bw=10284KB/s, iops=2570 , runt= 10148msec
    clat (usec): min=165 , max=5715.9K, avg=24698.94, stdev=282742.51
     lat (usec): min=165 , max=5715.9K, avg=24700.18, stdev=282742.71
    clat percentiles (usec):
     |  1.00th=[  183],  5.00th=[  209], 10.00th=[  286], 20.00th=[  322],
     | 30.00th=[  358], 40.00th=[  390], 50.00th=[  466], 60.00th=[  580],
     | 70.00th=[  660], 80.00th=[  716], 90.00th=[  820], 95.00th=[  964],
     | 99.00th=[ 8640], 99.50th=[2310144], 99.90th=[4554752], 99.95th=[4882432],
     | 99.99th=[5603328]
    bw (KB/s)  : min=    0, max= 2098, per=2.15%, avg=221.25, stdev=386.63
    lat (usec) : 250=8.01%, 500=44.60%, 750=32.27%, 1000=11.05%
    lat (msec) : 2=2.95%, 4=0.10%, 10=0.07%, 20=0.01%, 50=0.01%
    lat (msec) : 250=0.02%, 500=0.02%, 750=0.06%, 1000=0.03%, 2000=0.26%
    lat (msec) : >=2000=0.55%
  cpu          : usr=0.05%, sys=0.35%, ctx=27487, majf=0, minf=2096
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=26090/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=104360KB, aggrb=10283KB/s, minb=10283KB/s, maxb=10283KB/s, mint=10148msec, maxt=10148msec

Disk stats (read/write):
  hda: ios=26112/2, merge=22/8, ticks=465344/2616, in_queue=591858, util=99.06%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=21976
  read : io=103644KB, bw=10223KB/s, iops=2555 , runt= 10138msec
    clat (usec): min=164 , max=5824.8K, avg=24864.95, stdev=282162.13
     lat (usec): min=165 , max=5824.8K, avg=24866.29, stdev=282162.09
    clat percentiles (usec):
     |  1.00th=[  189],  5.00th=[  221], 10.00th=[  302], 20.00th=[  350],
     | 30.00th=[  386], 40.00th=[  454], 50.00th=[  564], 60.00th=[  636],
     | 70.00th=[  692], 80.00th=[  748], 90.00th=[  884], 95.00th=[ 1012],
     | 99.00th=[ 9024], 99.50th=[2342912], 99.90th=[4423680], 99.95th=[5013504],
     | 99.99th=[5734400]
    bw (KB/s)  : min=    0, max= 1940, per=2.03%, avg=207.59, stdev=318.28
    lat (usec) : 250=6.67%, 500=37.54%, 750=36.02%, 1000=14.33%
    lat (msec) : 2=4.19%, 4=0.14%, 10=0.12%, 20=0.01%, 50=0.01%
    lat (msec) : 100=0.02%, 250=0.03%, 500=0.02%, 750=0.03%, 1000=0.04%
    lat (msec) : 2000=0.29%, >=2000=0.54%
  cpu          : usr=0.05%, sys=0.32%, ctx=27816, majf=0, minf=2095
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=25911/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=103644KB, aggrb=10223KB/s, minb=10223KB/s, maxb=10223KB/s, mint=10138msec, maxt=10138msec

Disk stats (read/write):
  hda: ios=25888/2, merge=0/11, ticks=454865/2574, in_queue=581382, util=99.08%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=22115
  read : io=102540KB, bw=10081KB/s, iops=2520 , runt= 10172msec
    clat (usec): min=163 , max=5547.6K, avg=25187.24, stdev=283555.77
     lat (usec): min=164 , max=5547.6K, avg=25188.44, stdev=283555.75
    clat percentiles (usec):
     |  1.00th=[  189],  5.00th=[  213], 10.00th=[  294], 20.00th=[  334],
     | 30.00th=[  366], 40.00th=[  402], 50.00th=[  474], 60.00th=[  588],
     | 70.00th=[  668], 80.00th=[  724], 90.00th=[  836], 95.00th=[  980],
     | 99.00th=[ 8768], 99.50th=[2375680], 99.90th=[4423680], 99.95th=[4751360],
     | 99.99th=[5472256]
    bw (KB/s)  : min=    0, max= 3305, per=2.15%, avg=217.16, stdev=383.68
    lat (usec) : 250=8.28%, 500=43.88%, 750=30.92%, 1000=12.49%
    lat (msec) : 2=3.25%, 4=0.11%, 10=0.11%, 20=0.01%, 50=0.01%
    lat (msec) : 100=0.01%, 250=0.02%, 500=0.02%, 750=0.04%, 1000=0.04%
    lat (msec) : 2000=0.24%, >=2000=0.59%
  cpu          : usr=0.05%, sys=0.35%, ctx=27153, majf=0, minf=2096
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=25635/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=102540KB, aggrb=10080KB/s, minb=10080KB/s, maxb=10080KB/s, mint=10172msec, maxt=10172msec

Disk stats (read/write):
  hda: ios=25588/2, merge=0/8, ticks=464810/2452, in_queue=593836, util=99.08%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=22254
  read : io=105340KB, bw=10496KB/s, iops=2624 , runt= 10036msec
    clat (usec): min=164 , max=4933.8K, avg=24310.54, stdev=292992.52
     lat (usec): min=165 , max=4933.9K, avg=24311.79, stdev=292992.57
    clat percentiles (usec):
     |  1.00th=[  189],  5.00th=[  215], 10.00th=[  298], 20.00th=[  342],
     | 30.00th=[  370], 40.00th=[  418], 50.00th=[  516], 60.00th=[  604],
     | 70.00th=[  668], 80.00th=[  716], 90.00th=[  836], 95.00th=[  980],
     | 99.00th=[ 2288], 99.50th=[2703360], 99.90th=[4358144], 99.95th=[4423680],
     | 99.99th=[4816896]
    bw (KB/s)  : min=    0, max= 1904, per=1.89%, avg=198.68, stdev=286.63
    lat (usec) : 250=7.39%, 500=41.41%, 750=35.68%, 1000=11.10%
    lat (msec) : 2=3.40%, 4=0.11%, 10=0.08%, 20=0.01%, 50=0.01%
    lat (msec) : 100=0.01%, 250=0.02%, 500=0.04%, 750=0.04%, 1000=0.02%
    lat (msec) : 2000=0.13%, >=2000=0.57%
  cpu          : usr=0.05%, sys=0.33%, ctx=27783, majf=0, minf=2095
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=26335/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=105340KB, aggrb=10496KB/s, minb=10496KB/s, maxb=10496KB/s, mint=10036msec, maxt=10036msec

Disk stats (read/write):
  hda: ios=26348/1, merge=0/8, ticks=484394/4936, in_queue=638221, util=99.07%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=22393
  read : io=105264KB, bw=10490KB/s, iops=2622 , runt= 10035msec
    clat (usec): min=163 , max=4888.5K, avg=24328.01, stdev=288945.90
     lat (usec): min=164 , max=4888.5K, avg=24329.21, stdev=288945.97
    clat percentiles (usec):
     |  1.00th=[  189],  5.00th=[  213], 10.00th=[  298], 20.00th=[  342],
     | 30.00th=[  374], 40.00th=[  422], 50.00th=[  532], 60.00th=[  620],
     | 70.00th=[  676], 80.00th=[  732], 90.00th=[  868], 95.00th=[  996],
     | 99.00th=[ 2352], 99.50th=[2473984], 99.90th=[4227072], 99.95th=[4423680],
     | 99.99th=[4882432]
    bw (KB/s)  : min=    0, max= 1450, per=1.77%, avg=185.18, stdev=246.90
    lat (usec) : 250=7.86%, 500=39.31%, 750=35.21%, 1000=12.69%
    lat (msec) : 2=3.88%, 4=0.12%, 10=0.07%, 20=0.02%, 100=0.01%
    lat (msec) : 250=0.03%, 500=0.03%, 750=0.03%, 1000=0.02%, 2000=0.14%
    lat (msec) : >=2000=0.57%
  cpu          : usr=0.05%, sys=0.34%, ctx=27808, majf=0, minf=2096
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=26316/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=105264KB, aggrb=10489KB/s, minb=10489KB/s, maxb=10489KB/s, mint=10035msec, maxt=10035msec

Disk stats (read/write):
  hda: ios=26257/1, merge=0/8, ticks=477987/4735, in_queue=636752, util=99.03%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=22534
  read : io=102472KB, bw=10066KB/s, iops=2516 , runt= 10180msec
    clat (usec): min=163 , max=5467.6K, avg=25219.04, stdev=279090.20
     lat (usec): min=163 , max=5467.6K, avg=25220.21, stdev=279090.19
    clat percentiles (usec):
     |  1.00th=[  189],  5.00th=[  213], 10.00th=[  286], 20.00th=[  342],
     | 30.00th=[  374], 40.00th=[  422], 50.00th=[  516], 60.00th=[  620],
     | 70.00th=[  676], 80.00th=[  732], 90.00th=[  868], 95.00th=[  996],
     | 99.00th=[ 8640], 99.50th=[2277376], 99.90th=[4177920], 99.95th=[4751360],
     | 99.99th=[5341184]
    bw (KB/s)  : min=    0, max= 1719, per=1.99%, avg=200.46, stdev=296.85
    lat (usec) : 250=7.99%, 500=40.49%, 750=33.57%, 1000=13.10%
    lat (msec) : 2=3.64%, 4=0.11%, 10=0.10%, 50=0.01%, 250=0.02%
    lat (msec) : 500=0.03%, 750=0.06%, 1000=0.04%, 2000=0.29%, >=2000=0.57%
  cpu          : usr=0.05%, sys=0.33%, ctx=26922, majf=0, minf=2096
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=25618/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=102472KB, aggrb=10066KB/s, minb=10066KB/s, maxb=10066KB/s, mint=10180msec, maxt=10180msec

Disk stats (read/write):
  hda: ios=25624/2, merge=0/8, ticks=452374/2279, in_queue=587781, util=99.06%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=22676
  read : io=103880KB, bw=10166KB/s, iops=2541 , runt= 10218msec
    clat (usec): min=168 , max=4774.8K, avg=25004.40, stdev=284375.68
     lat (usec): min=169 , max=4774.8K, avg=25005.64, stdev=284375.68
    clat percentiles (usec):
     |  1.00th=[  189],  5.00th=[  207], 10.00th=[  286], 20.00th=[  326],
     | 30.00th=[  362], 40.00th=[  390], 50.00th=[  438], 60.00th=[  548],
     | 70.00th=[  636], 80.00th=[  700], 90.00th=[  812], 95.00th=[  972],
     | 99.00th=[ 8384], 99.50th=[2441216], 99.90th=[4554752], 99.95th=[4685824],
     | 99.99th=[4751360]
    bw (KB/s)  : min=    0, max= 2104, per=2.34%, avg=237.92, stdev=377.40
    lat (usec) : 250=9.24%, 500=46.45%, 750=30.15%, 1000=10.05%
    lat (msec) : 2=2.93%, 4=0.13%, 10=0.06%, 20=0.01%, 100=0.01%
    lat (msec) : 250=0.03%, 500=0.05%, 750=0.07%, 1000=0.03%, 2000=0.20%
    lat (msec) : >=2000=0.58%
  cpu          : usr=0.04%, sys=0.36%, ctx=27559, majf=0, minf=2096
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=25970/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=103880KB, aggrb=10166KB/s, minb=10166KB/s, maxb=10166KB/s, mint=10218msec, maxt=10218msec

Disk stats (read/write):
  hda: ios=26157/3, merge=0/11, ticks=619834/5216, in_queue=630188, util=99.09%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=22814
  read : io=103656KB, bw=10146KB/s, iops=2536 , runt= 10216msec
    clat (usec): min=160 , max=4749.8K, avg=25082.98, stdev=283566.99
     lat (usec): min=161 , max=4749.8K, avg=25084.35, stdev=283567.30
    clat percentiles (usec):
     |  1.00th=[  189],  5.00th=[  211], 10.00th=[  294], 20.00th=[  334],
     | 30.00th=[  366], 40.00th=[  402], 50.00th=[  486], 60.00th=[  588],
     | 70.00th=[  660], 80.00th=[  724], 90.00th=[  852], 95.00th=[  996],
     | 99.00th=[ 8640], 99.50th=[2441216], 99.90th=[4489216], 99.95th=[4620288],
     | 99.99th=[4685824]
    bw (KB/s)  : min=    0, max= 2632, per=2.52%, avg=255.17, stdev=446.85
    lat (usec) : 250=8.00%, 500=43.25%, 750=32.11%, 1000=11.73%
    lat (msec) : 2=3.78%, 4=0.10%, 10=0.04%, 50=0.01%, 100=0.01%
    lat (msec) : 250=0.03%, 500=0.06%, 750=0.05%, 1000=0.05%, 2000=0.22%
    lat (msec) : >=2000=0.57%
  cpu          : usr=0.04%, sys=0.35%, ctx=27701, majf=0, minf=2096
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=25914/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=103656KB, aggrb=10146KB/s, minb=10146KB/s, maxb=10146KB/s, mint=10216msec, maxt=10216msec

Disk stats (read/write):
  hda: ios=26098/3, merge=0/11, ticks=612048/5223, in_queue=625127, util=99.09%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=22954
  read : io=168132KB, bw=16557KB/s, iops=4139 , runt= 10155msec
    clat (usec): min=78 , max=6240.9K, avg=15325.14, stdev=227153.49
     lat (usec): min=78 , max=6240.9K, avg=15326.01, stdev=227153.51
    clat percentiles (usec):
     |  1.00th=[   87],  5.00th=[   90], 10.00th=[   94], 20.00th=[  173],
     | 30.00th=[  227], 40.00th=[  266], 50.00th=[  306], 60.00th=[  366],
     | 70.00th=[  446], 80.00th=[  506], 90.00th=[  596], 95.00th=[  700],
     | 99.00th=[  972], 99.50th=[995328], 99.90th=[4292608], 99.95th=[4947968],
     | 99.99th=[6062080]
    bw (KB/s)  : min=    0, max= 3608, per=2.18%, avg=361.20, stdev=627.98
    lat (usec) : 100=12.35%, 250=21.63%, 500=44.75%, 750=17.78%, 1000=2.59%
    lat (msec) : 2=0.25%, 4=0.01%, 10=0.04%, 20=0.01%, 50=0.01%
    lat (msec) : 100=0.01%, 250=0.01%, 500=0.02%, 750=0.03%, 1000=0.04%
    lat (msec) : 2000=0.17%, >=2000=0.32%
  cpu          : usr=0.03%, sys=0.27%, ctx=46788, majf=0, minf=2096
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=42033/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=168132KB, aggrb=16556KB/s, minb=16556KB/s, maxb=16556KB/s, mint=10155msec, maxt=10155msec

Disk stats (read/write):
  hda: ios=42010/2, merge=0/10, ticks=465877/2976, in_queue=580576, util=99.12%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=23092
  read : io=163260KB, bw=16121KB/s, iops=4030 , runt= 10127msec
    clat (usec): min=78 , max=5946.9K, avg=15773.49, stdev=225916.03
     lat (usec): min=78 , max=5946.9K, avg=15774.30, stdev=225916.10
    clat percentiles (usec):
     |  1.00th=[   86],  5.00th=[   88], 10.00th=[   93], 20.00th=[  185],
     | 30.00th=[  243], 40.00th=[  274], 50.00th=[  318], 60.00th=[  386],
     | 70.00th=[  458], 80.00th=[  516], 90.00th=[  604], 95.00th=[  724],
     | 99.00th=[ 1032], 99.50th=[1171456], 99.90th=[4177920], 99.95th=[4751360],
     | 99.99th=[5734400]
    bw (KB/s)  : min=    0, max= 3356, per=2.13%, avg=343.33, stdev=561.99
    lat (usec) : 100=12.71%, 250=18.96%, 500=44.88%, 750=19.21%, 1000=3.18%
    lat (msec) : 2=0.36%, 4=0.03%, 10=0.03%, 20=0.01%, 50=0.01%
    lat (msec) : 250=0.01%, 500=0.01%, 750=0.05%, 1000=0.03%, 2000=0.18%
    lat (msec) : >=2000=0.34%
  cpu          : usr=0.03%, sys=0.25%, ctx=44177, majf=0, minf=2096
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=40815/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=163260KB, aggrb=16121KB/s, minb=16121KB/s, maxb=16121KB/s, mint=10127msec, maxt=10127msec

Disk stats (read/write):
  hda: ios=40721/2, merge=0/8, ticks=453124/2686, in_queue=578825, util=99.14%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=23232
  read : io=104668KB, bw=10288KB/s, iops=2571 , runt= 10174msec
    clat (usec): min=164 , max=5560.2K, avg=24677.52, stdev=281890.22
     lat (usec): min=165 , max=5560.2K, avg=24678.70, stdev=281890.29
    clat percentiles (usec):
     |  1.00th=[  181],  5.00th=[  195], 10.00th=[  227], 20.00th=[  314],
     | 30.00th=[  358], 40.00th=[  390], 50.00th=[  450], 60.00th=[  556],
     | 70.00th=[  636], 80.00th=[  708], 90.00th=[  844], 95.00th=[  980],
     | 99.00th=[ 4512], 99.50th=[2310144], 99.90th=[4489216], 99.95th=[4751360],
     | 99.99th=[5472256]
    bw (KB/s)  : min=    0, max= 1976, per=1.97%, avg=202.14, stdev=305.61
    lat (usec) : 250=12.33%, 500=42.60%, 750=29.60%, 1000=10.97%
    lat (msec) : 2=3.40%, 4=0.09%, 10=0.06%, 20=0.01%, 50=0.01%
    lat (msec) : 100=0.01%, 250=0.02%, 500=0.02%, 750=0.05%, 1000=0.02%
    lat (msec) : 2000=0.24%, >=2000=0.58%
  cpu          : usr=0.04%, sys=0.38%, ctx=27866, majf=0, minf=2096
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=26167/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=104668KB, aggrb=10287KB/s, minb=10287KB/s, maxb=10287KB/s, mint=10174msec, maxt=10174msec

Disk stats (read/write):
  hda: ios=26166/2, merge=0/8, ticks=463960/2360, in_queue=598996, util=99.08%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=23370
  read : io=105232KB, bw=10490KB/s, iops=2622 , runt= 10032msec
    clat (usec): min=164 , max=5140.8K, avg=24332.91, stdev=287861.07
     lat (usec): min=165 , max=5140.8K, avg=24334.27, stdev=287861.07
    clat percentiles (usec):
     |  1.00th=[  191],  5.00th=[  213], 10.00th=[  294], 20.00th=[  346],
     | 30.00th=[  378], 40.00th=[  434], 50.00th=[  532], 60.00th=[  612],
     | 70.00th=[  676], 80.00th=[  732], 90.00th=[  876], 95.00th=[ 1012],
     | 99.00th=[ 2256], 99.50th=[2670592], 99.90th=[4145152], 99.95th=[4292608],
     | 99.99th=[5079040]
    bw (KB/s)  : min=    0, max= 1874, per=1.79%, avg=187.54, stdev=264.00
    lat (usec) : 250=8.56%, 500=38.27%, 750=34.81%, 1000=13.03%
    lat (msec) : 2=4.31%, 4=0.10%, 10=0.07%, 20=0.01%, 50=0.01%
    lat (msec) : 100=0.01%, 250=0.02%, 500=0.04%, 750=0.03%, 1000=0.03%
    lat (msec) : 2000=0.13%, >=2000=0.59%
  cpu          : usr=0.05%, sys=0.33%, ctx=28290, majf=0, minf=2096
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=26308/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=105232KB, aggrb=10489KB/s, minb=10489KB/s, maxb=10489KB/s, mint=10032msec, maxt=10032msec

Disk stats (read/write):
  hda: ios=26327/1, merge=0/10, ticks=480303/5078, in_queue=638260, util=99.09%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=23509
  read : io=105996KB, bw=10418KB/s, iops=2604 , runt= 10174msec
    clat (usec): min=167 , max=4818.9K, avg=24427.61, stdev=280136.95
     lat (usec): min=168 , max=4818.9K, avg=24428.89, stdev=280136.97
    clat percentiles (usec):
     |  1.00th=[  187],  5.00th=[  195], 10.00th=[  227], 20.00th=[  310],
     | 30.00th=[  350], 40.00th=[  382], 50.00th=[  438], 60.00th=[  532],
     | 70.00th=[  620], 80.00th=[  700], 90.00th=[  820], 95.00th=[  972],
     | 99.00th=[ 5600], 99.50th=[2375680], 99.90th=[4423680], 99.95th=[4751360],
     | 99.99th=[4751360]
    bw (KB/s)  : min=    0, max= 3256, per=2.41%, avg=250.73, stdev=428.58
    lat (usec) : 250=12.25%, 500=44.35%, 750=29.10%, 1000=10.02%
    lat (msec) : 2=3.18%, 4=0.10%, 10=0.03%, 20=0.01%, 50=0.01%
    lat (msec) : 100=0.01%, 250=0.03%, 500=0.05%, 750=0.06%, 1000=0.05%
    lat (msec) : 2000=0.20%, >=2000=0.57%
  cpu          : usr=0.05%, sys=0.39%, ctx=28574, majf=0, minf=2096
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=26499/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=105996KB, aggrb=10418KB/s, minb=10418KB/s, maxb=10418KB/s, mint=10174msec, maxt=10174msec

Disk stats (read/write):
  hda: ios=26433/2, merge=0/8, ticks=444524/450, in_queue=624981, util=99.10%
