128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 32 processes
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)

128m: (groupid=0, jobs=32): err= 0: pid=1320
  read : io=1066.5MB, bw=528583KB/s, iops=132145 , runt= 10001msec
    clat (usec): min=17 , max=13375 , avg=237.37, stdev=269.59
     lat (usec): min=18 , max=13376 , avg=238.06, stdev=269.94
    clat percentiles (usec):
     |  1.00th=[   41],  5.00th=[   57], 10.00th=[   70], 20.00th=[   93],
     | 30.00th=[  115], 40.00th=[  137], 50.00th=[  161], 60.00th=[  193],
     | 70.00th=[  237], 80.00th=[  310], 90.00th=[  462], 95.00th=[  660],
     | 99.00th=[ 1368], 99.50th=[ 1784], 99.90th=[ 2896], 99.95th=[ 3472],
     | 99.99th=[ 4832]
    bw (KB/s)  : min=13976, max=19192, per=3.12%, avg=16500.31, stdev=687.48
    lat (usec) : 20=0.01%, 50=2.91%, 100=20.00%, 250=49.52%, 500=18.89%
    lat (usec) : 750=4.94%, 1000=1.75%
    lat (msec) : 2=1.62%, 4=0.33%, 10=0.03%, 20=0.01%
  cpu          : usr=1.73%, sys=10.17%, ctx=1345049, majf=0, minf=0
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=1321590/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=5162.5MB, aggrb=528583KB/s, minb=528583KB/s, maxb=528583KB/s, mint=10001msec, maxt=10001msec

Disk stats (read/write):
  vda: ios=1293218/4, merge=9/2, ticks=80469/2, in_queue=75361, util=97.15%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 32 processes

128m: (groupid=0, jobs=32): err= 0: pid=1394
  read : io=1036.8MB, bw=525420KB/s, iops=131354 , runt= 10002msec
    clat (usec): min=16 , max=16708 , avg=238.74, stdev=266.54
     lat (usec): min=16 , max=16709 , avg=239.44, stdev=266.94
    clat percentiles (usec):
     |  1.00th=[   41],  5.00th=[   57], 10.00th=[   71], 20.00th=[   95],
     | 30.00th=[  117], 40.00th=[  139], 50.00th=[  165], 60.00th=[  195],
     | 70.00th=[  239], 80.00th=[  310], 90.00th=[  462], 95.00th=[  652],
     | 99.00th=[ 1368], 99.50th=[ 1800], 99.90th=[ 2896], 99.95th=[ 3376],
     | 99.99th=[ 4704]
    bw (KB/s)  : min=14728, max=18640, per=3.12%, avg=16406.35, stdev=622.83
    lat (usec) : 20=0.01%, 50=2.89%, 100=19.14%, 250=49.89%, 500=19.45%
    lat (usec) : 750=4.98%, 1000=1.70%
    lat (msec) : 2=1.58%, 4=0.34%, 10=0.02%, 20=0.01%
  cpu          : usr=1.73%, sys=10.16%, ctx=1342467, majf=0, minf=0
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=1313812/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=5132.8MB, aggrb=525419KB/s, minb=525419KB/s, maxb=525419KB/s, mint=10002msec, maxt=10002msec

Disk stats (read/write):
  vda: ios=1299391/4, merge=7/3, ticks=79655/2, in_queue=74435, util=97.17%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 32 processes

128m: (groupid=0, jobs=32): err= 0: pid=1468
  read : io=1061.8MB, bw=528102KB/s, iops=132025 , runt= 10001msec
    clat (usec): min=18 , max=9943 , avg=237.54, stdev=264.62
     lat (usec): min=18 , max=9943 , avg=238.23, stdev=264.95
    clat percentiles (usec):
     |  1.00th=[   41],  5.00th=[   57], 10.00th=[   71], 20.00th=[   94],
     | 30.00th=[  116], 40.00th=[  139], 50.00th=[  163], 60.00th=[  195],
     | 70.00th=[  239], 80.00th=[  310], 90.00th=[  462], 95.00th=[  652],
     | 99.00th=[ 1352], 99.50th=[ 1784], 99.90th=[ 2864], 99.95th=[ 3376],
     | 99.99th=[ 4704]
    bw (KB/s)  : min=14528, max=18440, per=3.12%, avg=16487.20, stdev=677.25
    lat (usec) : 20=0.01%, 50=2.87%, 100=19.43%, 250=49.86%, 500=19.27%
    lat (usec) : 750=4.91%, 1000=1.73%
    lat (msec) : 2=1.58%, 4=0.33%, 10=0.02%
  cpu          : usr=1.74%, sys=10.13%, ctx=1348503, majf=0, minf=0
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=1320388/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=5157.8MB, aggrb=528102KB/s, minb=528102KB/s, maxb=528102KB/s, mint=10001msec, maxt=10001msec

Disk stats (read/write):
  vda: ios=1305997/5, merge=0/2, ticks=80786/2, in_queue=75708, util=97.16%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 32 processes

128m: (groupid=0, jobs=32): err= 0: pid=1542
  read : io=1199.5MB, bw=542147KB/s, iops=135536 , runt= 10002msec
    clat (usec): min=18 , max=9491 , avg=231.41, stdev=241.06
     lat (usec): min=18 , max=9491 , avg=232.08, stdev=241.36
    clat percentiles (usec):
     |  1.00th=[   42],  5.00th=[   59], 10.00th=[   74], 20.00th=[   98],
     | 30.00th=[  118], 40.00th=[  141], 50.00th=[  165], 60.00th=[  199],
     | 70.00th=[  237], 80.00th=[  302], 90.00th=[  438], 95.00th=[  612],
     | 99.00th=[ 1224], 99.50th=[ 1624], 99.90th=[ 2608], 99.95th=[ 3088],
     | 99.99th=[ 4128]
    bw (KB/s)  : min=14640, max=18920, per=3.12%, avg=16923.02, stdev=699.38
    lat (usec) : 20=0.01%, 50=2.42%, 100=18.36%, 250=51.94%, 500=19.59%
    lat (usec) : 750=4.61%, 1000=1.51%
    lat (msec) : 2=1.30%, 4=0.26%, 10=0.01%
  cpu          : usr=1.73%, sys=10.05%, ctx=1382000, majf=0, minf=0
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=1355639/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=5295.5MB, aggrb=542147KB/s, minb=542147KB/s, maxb=542147KB/s, mint=10002msec, maxt=10002msec

Disk stats (read/write):
  vda: ios=1340383/6, merge=11/1, ticks=91957/3, in_queue=86884, util=97.04%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 32 processes

128m: (groupid=0, jobs=32): err= 0: pid=1616
  read : io=1014.3MB, bw=523241KB/s, iops=130810 , runt= 10001msec
    clat (usec): min=17 , max=19435 , avg=239.70, stdev=278.33
     lat (usec): min=18 , max=19436 , avg=240.43, stdev=279.02
    clat percentiles (usec):
     |  1.00th=[   41],  5.00th=[   56], 10.00th=[   70], 20.00th=[   94],
     | 30.00th=[  116], 40.00th=[  139], 50.00th=[  163], 60.00th=[  195],
     | 70.00th=[  239], 80.00th=[  310], 90.00th=[  466], 95.00th=[  652],
     | 99.00th=[ 1400], 99.50th=[ 1848], 99.90th=[ 3024], 99.95th=[ 3664],
     | 99.99th=[ 5344]
    bw (KB/s)  : min=14328, max=18776, per=3.13%, avg=16373.47, stdev=689.72
    lat (usec) : 20=0.01%, 50=3.09%, 100=19.44%, 250=49.51%, 500=19.20%
    lat (usec) : 750=4.99%, 1000=1.74%
    lat (msec) : 2=1.62%, 4=0.36%, 10=0.03%, 20=0.01%
  cpu          : usr=1.72%, sys=10.19%, ctx=1337454, majf=0, minf=0
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=1308233/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=5110.3MB, aggrb=523240KB/s, minb=523240KB/s, maxb=523240KB/s, mint=10001msec, maxt=10001msec

Disk stats (read/write):
  vda: ios=1294918/6, merge=27/1, ticks=76584/2, in_queue=71422, util=97.41%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 32 processes

128m: (groupid=0, jobs=32): err= 0: pid=1690
  read : io=1106.3MB, bw=532608KB/s, iops=133151 , runt= 10002msec
    clat (usec): min=17 , max=21214 , avg=235.57, stdev=290.83
     lat (usec): min=17 , max=21214 , avg=236.25, stdev=291.13
    clat percentiles (usec):
     |  1.00th=[   42],  5.00th=[   58], 10.00th=[   72], 20.00th=[   95],
     | 30.00th=[  116], 40.00th=[  139], 50.00th=[  163], 60.00th=[  195],
     | 70.00th=[  235], 80.00th=[  302], 90.00th=[  450], 95.00th=[  628],
     | 99.00th=[ 1304], 99.50th=[ 1752], 99.90th=[ 3024], 99.95th=[ 3792],
     | 99.99th=[ 6368]
    bw (KB/s)  : min=13032, max=18536, per=3.13%, avg=16681.06, stdev=795.22
    lat (usec) : 20=0.01%, 50=2.66%, 100=19.44%, 250=50.59%, 500=19.17%
    lat (usec) : 750=4.75%, 1000=1.59%
    lat (msec) : 2=1.44%, 4=0.31%, 10=0.04%, 20=0.01%, 50=0.01%
  cpu          : usr=1.71%, sys=10.06%, ctx=1359683, majf=0, minf=0
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=1331786/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=5202.3MB, aggrb=532607KB/s, minb=532607KB/s, maxb=532607KB/s, mint=10002msec, maxt=10002msec

Disk stats (read/write):
  vda: ios=1317228/6, merge=0/1, ticks=84445/2, in_queue=79357, util=97.02%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 32 processes

128m: (groupid=0, jobs=32): err= 0: pid=1764
  read : io=1133.3MB, bw=535418KB/s, iops=133854 , runt= 10001msec
    clat (usec): min=17 , max=17062 , avg=234.29, stdev=258.40
     lat (usec): min=17 , max=17063 , avg=234.97, stdev=258.80
    clat percentiles (usec):
     |  1.00th=[   42],  5.00th=[   58], 10.00th=[   72], 20.00th=[   95],
     | 30.00th=[  116], 40.00th=[  139], 50.00th=[  163], 60.00th=[  195],
     | 70.00th=[  237], 80.00th=[  306], 90.00th=[  450], 95.00th=[  628],
     | 99.00th=[ 1288], 99.50th=[ 1736], 99.90th=[ 2864], 99.95th=[ 3376],
     | 99.99th=[ 4576]
    bw (KB/s)  : min=14664, max=18864, per=3.12%, avg=16731.65, stdev=663.44
    lat (usec) : 20=0.01%, 50=2.67%, 100=19.48%, 250=50.35%, 500=19.39%
    lat (usec) : 750=4.75%, 1000=1.60%
    lat (msec) : 2=1.43%, 4=0.32%, 10=0.02%, 20=0.01%
  cpu          : usr=1.75%, sys=10.10%, ctx=1366661, majf=0, minf=0
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=1338679/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=5229.3MB, aggrb=535418KB/s, minb=535418KB/s, maxb=535418KB/s, mint=10001msec, maxt=10001msec

Disk stats (read/write):
  vda: ios=1323660/7, merge=0/0, ticks=84210/2, in_queue=79191, util=97.03%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 32 processes

128m: (groupid=0, jobs=32): err= 0: pid=1838
  read : io=1106.1MB, bw=532642KB/s, iops=133160 , runt= 10001msec
    clat (usec): min=17 , max=15152 , avg=235.53, stdev=263.35
     lat (usec): min=18 , max=15152 , avg=236.21, stdev=263.66
    clat percentiles (usec):
     |  1.00th=[   41],  5.00th=[   58], 10.00th=[   72], 20.00th=[   95],
     | 30.00th=[  116], 40.00th=[  139], 50.00th=[  163], 60.00th=[  195],
     | 70.00th=[  237], 80.00th=[  306], 90.00th=[  454], 95.00th=[  636],
     | 99.00th=[ 1304], 99.50th=[ 1752], 99.90th=[ 2864], 99.95th=[ 3440],
     | 99.99th=[ 5216]
    bw (KB/s)  : min=13664, max=18712, per=3.13%, avg=16658.65, stdev=766.74
    lat (usec) : 20=0.01%, 50=2.76%, 100=19.31%, 250=50.37%, 500=19.28%
    lat (usec) : 750=4.79%, 1000=1.65%
    lat (msec) : 2=1.49%, 4=0.31%, 10=0.03%, 20=0.01%
  cpu          : usr=1.75%, sys=10.12%, ctx=1360049, majf=0, minf=0
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=1331737/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=5202.1MB, aggrb=532641KB/s, minb=532641KB/s, maxb=532641KB/s, mint=10001msec, maxt=10001msec

Disk stats (read/write):
  vda: ios=1317207/7, merge=0/0, ticks=83718/2, in_queue=78612, util=97.24%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 32 processes

128m: (groupid=0, jobs=32): err= 0: pid=1912
  read : io=1128.1MB, bw=534977KB/s, iops=133744 , runt= 10001msec
    clat (usec): min=17 , max=8123 , avg=234.52, stdev=255.38
     lat (usec): min=17 , max=8124 , avg=235.20, stdev=255.67
    clat percentiles (usec):
     |  1.00th=[   41],  5.00th=[   58], 10.00th=[   72], 20.00th=[   95],
     | 30.00th=[  117], 40.00th=[  139], 50.00th=[  165], 60.00th=[  197],
     | 70.00th=[  237], 80.00th=[  306], 90.00th=[  450], 95.00th=[  636],
     | 99.00th=[ 1288], 99.50th=[ 1720], 99.90th=[ 2768], 99.95th=[ 3280],
     | 99.99th=[ 4576]
    bw (KB/s)  : min=14832, max=18560, per=3.13%, avg=16718.59, stdev=669.17
    lat (usec) : 20=0.01%, 50=2.72%, 100=19.27%, 250=50.59%, 500=19.23%
    lat (usec) : 750=4.76%, 1000=1.65%
    lat (msec) : 2=1.46%, 4=0.30%, 10=0.02%
  cpu          : usr=1.70%, sys=10.10%, ctx=1364698, majf=0, minf=0
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=1337575/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=5224.1MB, aggrb=534976KB/s, minb=534976KB/s, maxb=534976KB/s, mint=10001msec, maxt=10001msec

Disk stats (read/write):
  vda: ios=1323796/7, merge=3/1, ticks=83544/3, in_queue=78415, util=96.87%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 32 processes

128m: (groupid=0, jobs=32): err= 0: pid=1986
  read : io=1131.6MB, bw=535197KB/s, iops=133799 , runt= 10001msec
    clat (usec): min=17 , max=8693 , avg=234.43, stdev=253.25
     lat (usec): min=17 , max=8694 , avg=235.10, stdev=253.54
    clat percentiles (usec):
     |  1.00th=[   42],  5.00th=[   59], 10.00th=[   73], 20.00th=[   96],
     | 30.00th=[  117], 40.00th=[  139], 50.00th=[  165], 60.00th=[  197],
     | 70.00th=[  237], 80.00th=[  306], 90.00th=[  450], 95.00th=[  628],
     | 99.00th=[ 1272], 99.50th=[ 1704], 99.90th=[ 2768], 99.95th=[ 3216],
     | 99.99th=[ 4576]
    bw (KB/s)  : min=14376, max=18832, per=3.12%, avg=16716.98, stdev=667.12
    lat (usec) : 20=0.01%, 50=2.54%, 100=19.07%, 250=50.71%, 500=19.56%
    lat (usec) : 750=4.79%, 1000=1.60%
    lat (msec) : 2=1.41%, 4=0.30%, 10=0.02%
  cpu          : usr=1.76%, sys=10.07%, ctx=1365933, majf=0, minf=0
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=1338126/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=5227.6MB, aggrb=535196KB/s, minb=535196KB/s, maxb=535196KB/s, mint=10001msec, maxt=10001msec

Disk stats (read/write):
  vda: ios=1322737/7, merge=0/0, ticks=83893/2, in_queue=78676, util=97.37%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 32 processes

128m: (groupid=0, jobs=32): err= 0: pid=2061
  read : io=1098.8MB, bw=531884KB/s, iops=132971 , runt= 10001msec
    clat (usec): min=18 , max=15230 , avg=235.82, stdev=262.55
     lat (usec): min=18 , max=15230 , avg=236.52, stdev=263.03
    clat percentiles (usec):
     |  1.00th=[   41],  5.00th=[   58], 10.00th=[   72], 20.00th=[   95],
     | 30.00th=[  117], 40.00th=[  139], 50.00th=[  163], 60.00th=[  195],
     | 70.00th=[  237], 80.00th=[  306], 90.00th=[  454], 95.00th=[  636],
     | 99.00th=[ 1320], 99.50th=[ 1752], 99.90th=[ 2896], 99.95th=[ 3408],
     | 99.99th=[ 4640]
    bw (KB/s)  : min=14264, max=18448, per=3.12%, avg=16597.01, stdev=686.83
    lat (usec) : 20=0.01%, 50=2.73%, 100=19.27%, 250=50.41%, 500=19.29%
    lat (usec) : 750=4.81%, 1000=1.67%
    lat (msec) : 2=1.49%, 4=0.32%, 10=0.03%, 20=0.01%
  cpu          : usr=1.76%, sys=10.11%, ctx=1357625, majf=0, minf=0
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=1329843/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=5194.8MB, aggrb=531884KB/s, minb=531884KB/s, maxb=531884KB/s, mint=10001msec, maxt=10001msec

Disk stats (read/write):
  vda: ios=1315078/7, merge=0/0, ticks=81647/3, in_queue=76597, util=97.13%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 32 processes

128m: (groupid=0, jobs=32): err= 0: pid=2135
  read : io=1103.1MB, bw=532368KB/s, iops=133091 , runt= 10002msec
    clat (usec): min=18 , max=8152 , avg=235.63, stdev=256.72
     lat (usec): min=18 , max=8153 , avg=236.32, stdev=257.07
    clat percentiles (usec):
     |  1.00th=[   41],  5.00th=[   58], 10.00th=[   72], 20.00th=[   95],
     | 30.00th=[  117], 40.00th=[  139], 50.00th=[  163], 60.00th=[  195],
     | 70.00th=[  237], 80.00th=[  306], 90.00th=[  454], 95.00th=[  636],
     | 99.00th=[ 1304], 99.50th=[ 1736], 99.90th=[ 2800], 99.95th=[ 3248],
     | 99.99th=[ 4320]
    bw (KB/s)  : min=14584, max=18616, per=3.12%, avg=16618.11, stdev=647.08
    lat (usec) : 20=0.01%, 50=2.78%, 100=19.16%, 250=50.32%, 500=19.40%
    lat (usec) : 750=4.86%, 1000=1.65%
    lat (msec) : 2=1.48%, 4=0.32%, 10=0.02%
  cpu          : usr=1.76%, sys=10.14%, ctx=1358639, majf=0, minf=0
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=1331185/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=5199.1MB, aggrb=532367KB/s, minb=532367KB/s, maxb=532367KB/s, mint=10002msec, maxt=10002msec

Disk stats (read/write):
  vda: ios=1315867/5, merge=0/2, ticks=81893/2, in_queue=76821, util=97.14%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 32 processes

128m: (groupid=0, jobs=32): err= 0: pid=2209
  read : io=1125.1MB, bw=534623KB/s, iops=133655 , runt= 10002msec
    clat (usec): min=18 , max=17994 , avg=234.62, stdev=260.15
     lat (usec): min=19 , max=17995 , avg=235.29, stdev=260.55
    clat percentiles (usec):
     |  1.00th=[   41],  5.00th=[   58], 10.00th=[   72], 20.00th=[   95],
     | 30.00th=[  116], 40.00th=[  139], 50.00th=[  163], 60.00th=[  195],
     | 70.00th=[  237], 80.00th=[  306], 90.00th=[  450], 95.00th=[  636],
     | 99.00th=[ 1304], 99.50th=[ 1736], 99.90th=[ 2832], 99.95th=[ 3408],
     | 99.99th=[ 4832]
    bw (KB/s)  : min=14728, max=18936, per=3.13%, avg=16708.12, stdev=656.32
    lat (usec) : 20=0.01%, 50=2.71%, 100=19.44%, 250=50.36%, 500=19.28%
    lat (usec) : 750=4.78%, 1000=1.63%
    lat (msec) : 2=1.46%, 4=0.31%, 10=0.03%, 20=0.01%
  cpu          : usr=1.78%, sys=10.07%, ctx=1364936, majf=0, minf=0
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=1336826/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=5221.1MB, aggrb=534623KB/s, minb=534623KB/s, maxb=534623KB/s, mint=10002msec, maxt=10002msec

Disk stats (read/write):
  vda: ios=1321750/7, merge=0/0, ticks=84045/2, in_queue=79052, util=97.38%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 32 processes

128m: (groupid=0, jobs=32): err= 0: pid=2283
  read : io=1124.1MB, bw=534570KB/s, iops=133642 , runt= 10001msec
    clat (usec): min=18 , max=11736 , avg=234.69, stdev=256.64
     lat (usec): min=18 , max=11737 , avg=235.37, stdev=256.97
    clat percentiles (usec):
     |  1.00th=[   41],  5.00th=[   57], 10.00th=[   71], 20.00th=[   95],
     | 30.00th=[  116], 40.00th=[  139], 50.00th=[  163], 60.00th=[  195],
     | 70.00th=[  237], 80.00th=[  306], 90.00th=[  454], 95.00th=[  636],
     | 99.00th=[ 1304], 99.50th=[ 1720], 99.90th=[ 2768], 99.95th=[ 3216],
     | 99.99th=[ 4512]
    bw (KB/s)  : min=14936, max=18472, per=3.12%, avg=16696.60, stdev=607.53
    lat (usec) : 20=0.01%, 50=2.80%, 100=19.45%, 250=50.27%, 500=19.17%
    lat (usec) : 750=4.82%, 1000=1.66%
    lat (msec) : 2=1.50%, 4=0.31%, 10=0.02%, 20=0.01%
  cpu          : usr=1.73%, sys=10.16%, ctx=1363757, majf=0, minf=0
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=1336558/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=5220.1MB, aggrb=534569KB/s, minb=534569KB/s, maxb=534569KB/s, mint=10001msec, maxt=10001msec

Disk stats (read/write):
  vda: ios=1321356/6, merge=0/1, ticks=82873/2, in_queue=77799, util=97.37%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 32 processes

128m: (groupid=0, jobs=32): err= 0: pid=2357
  read : io=1021.2MB, bw=523930KB/s, iops=130982 , runt= 10001msec
    clat (usec): min=18 , max=10139 , avg=239.43, stdev=268.35
     lat (usec): min=18 , max=10139 , avg=240.14, stdev=268.70
    clat percentiles (usec):
     |  1.00th=[   41],  5.00th=[   56], 10.00th=[   71], 20.00th=[   95],
     | 30.00th=[  117], 40.00th=[  139], 50.00th=[  165], 60.00th=[  195],
     | 70.00th=[  239], 80.00th=[  310], 90.00th=[  466], 95.00th=[  652],
     | 99.00th=[ 1384], 99.50th=[ 1832], 99.90th=[ 2928], 99.95th=[ 3376],
     | 99.99th=[ 4512]
    bw (KB/s)  : min=14216, max=18232, per=3.13%, avg=16383.44, stdev=619.28
    lat (usec) : 20=0.01%, 50=3.07%, 100=19.00%, 250=49.86%, 500=19.35%
    lat (usec) : 750=4.99%, 1000=1.73%
    lat (msec) : 2=1.62%, 4=0.37%, 10=0.02%, 20=0.01%
  cpu          : usr=1.71%, sys=10.22%, ctx=1338197, majf=0, minf=0
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=1309957/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=5117.2MB, aggrb=523930KB/s, minb=523930KB/s, maxb=523930KB/s, mint=10001msec, maxt=10001msec

Disk stats (read/write):
  vda: ios=1295042/6, merge=0/1, ticks=76597/2, in_queue=71414, util=97.37%
