128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)
128m: Laying out IO file(s) (1 file(s) / 128MB)

128m: (groupid=0, jobs=64): err= 0: pid=1993
  read : io=1407.3MB, bw=144071KB/s, iops=36017 , runt= 10002msec
    clat (usec): min=33 , max=101258 , avg=1773.67, stdev=2292.69
     lat (usec): min=34 , max=101258 , avg=1773.88, stdev=2292.69
    clat percentiles (usec):
     |  1.00th=[   42],  5.00th=[   54], 10.00th=[   83], 20.00th=[  143],
     | 30.00th=[  262], 40.00th=[  684], 50.00th=[ 1256], 60.00th=[ 1912],
     | 70.00th=[ 2544], 80.00th=[ 2992], 90.00th=[ 4192], 95.00th=[ 5280],
     | 99.00th=[ 7328], 99.50th=[ 8384], 99.90th=[10688], 99.95th=[23168],
     | 99.99th=[87552]
    bw (KB/s)  : min= 1299, max=38064, per=1.57%, avg=2268.00, stdev=3892.46
    lat (usec) : 50=2.80%, 100=10.10%, 250=16.79%, 500=5.79%, 750=6.05%
    lat (usec) : 1000=4.30%
    lat (msec) : 2=15.56%, 4=27.68%, 10=10.79%, 20=0.08%, 50=0.02%
    lat (msec) : 100=0.03%, 250=0.01%
  cpu          : usr=0.27%, sys=1.36%, ctx=362505, majf=0, minf=2095
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=360249/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=1407.3MB, aggrb=144070KB/s, minb=144070KB/s, maxb=144070KB/s, mint=10002msec, maxt=10002msec

Disk stats (read/write):
  sdc: ios=356588/0, merge=0/0, ticks=623462/0, in_queue=623239, util=98.96%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=2132
  read : io=1399.5MB, bw=143261KB/s, iops=35815 , runt= 10003msec
    clat (usec): min=69 , max=5118 , avg=1783.74, stdev=877.62
     lat (usec): min=70 , max=5118 , avg=1783.96, stdev=877.62
    clat percentiles (usec):
     |  1.00th=[  358],  5.00th=[  470], 10.00th=[  596], 20.00th=[  836],
     | 30.00th=[ 1128], 40.00th=[ 1448], 50.00th=[ 1784], 60.00th=[ 2128],
     | 70.00th=[ 2448], 80.00th=[ 2736], 90.00th=[ 2960], 95.00th=[ 3088],
     | 99.00th=[ 3248], 99.50th=[ 3312], 99.90th=[ 3472], 99.95th=[ 3568],
     | 99.99th=[ 4192]
    bw (KB/s)  : min= 2000, max= 2592, per=1.56%, avg=2241.18, stdev=75.31
    lat (usec) : 100=0.01%, 250=0.07%, 500=6.38%, 750=10.40%, 1000=9.04%
    lat (msec) : 2=30.53%, 4=43.55%, 10=0.03%
  cpu          : usr=0.28%, sys=1.34%, ctx=358297, majf=0, minf=2141
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=358259/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=1399.5MB, aggrb=143260KB/s, minb=143260KB/s, maxb=143260KB/s, mint=10003msec, maxt=10003msec

Disk stats (read/write):
  sdc: ios=354313/0, merge=0/0, ticks=623245/0, in_queue=623009, util=98.97%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=2271
  read : io=1425.8MB, bw=145953KB/s, iops=36488 , runt= 10003msec
    clat (usec): min=0 , max=6023 , avg=1750.74, stdev=906.45
     lat (usec): min=0 , max=6023 , avg=1750.94, stdev=906.46
    clat percentiles (usec):
     |  1.00th=[    0],  5.00th=[  430], 10.00th=[  548], 20.00th=[  796],
     | 30.00th=[ 1080], 40.00th=[ 1384], 50.00th=[ 1752], 60.00th=[ 2128],
     | 70.00th=[ 2448], 80.00th=[ 2736], 90.00th=[ 2960], 95.00th=[ 3088],
     | 99.00th=[ 3248], 99.50th=[ 3312], 99.90th=[ 3440], 99.95th=[ 3472],
     | 99.99th=[ 3600]
    bw (KB/s)  : min= 2027, max= 3272, per=1.57%, avg=2285.15, stdev=204.12
    lat (usec) : 2=1.87%, 20=0.01%, 50=0.01%, 100=0.01%, 250=0.09%
    lat (usec) : 500=6.08%, 750=10.20%, 1000=9.22%
    lat (msec) : 2=29.21%, 4=43.32%, 10=0.01%
  cpu          : usr=0.28%, sys=1.37%, ctx=365022, majf=0, minf=2143
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=364992/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=1425.8MB, aggrb=145953KB/s, minb=145953KB/s, maxb=145953KB/s, mint=10003msec, maxt=10003msec

Disk stats (read/write):
  sdc: ios=363121/0, merge=0/0, ticks=638732/0, in_queue=638548, util=100.00%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=2410
  read : io=1399.9MB, bw=143319KB/s, iops=35829 , runt= 10002msec
    clat (usec): min=54 , max=4835 , avg=1783.00, stdev=882.09
     lat (usec): min=54 , max=4835 , avg=1783.21, stdev=882.08
    clat percentiles (usec):
     |  1.00th=[  358],  5.00th=[  474], 10.00th=[  604], 20.00th=[  844],
     | 30.00th=[ 1096], 40.00th=[ 1416], 50.00th=[ 1784], 60.00th=[ 2160],
     | 70.00th=[ 2480], 80.00th=[ 2736], 90.00th=[ 2960], 95.00th=[ 3088],
     | 99.00th=[ 3248], 99.50th=[ 3312], 99.90th=[ 3440], 99.95th=[ 3472],
     | 99.99th=[ 3600]
    bw (KB/s)  : min= 2047, max= 2621, per=1.56%, avg=2242.03, stdev=71.99
    lat (usec) : 100=0.01%, 250=0.07%, 500=6.09%, 750=10.35%, 1000=9.85%
    lat (msec) : 2=29.57%, 4=44.06%, 10=0.01%
  cpu          : usr=0.28%, sys=1.35%, ctx=358401, majf=0, minf=2142
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=358369/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=1399.9MB, aggrb=143318KB/s, minb=143318KB/s, maxb=143318KB/s, mint=10002msec, maxt=10002msec

Disk stats (read/write):
  sdc: ios=354461/0, merge=0/0, ticks=622977/0, in_queue=622753, util=98.97%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=2550
  read : io=1400.4MB, bw=143351KB/s, iops=35837 , runt= 10003msec
    clat (usec): min=51 , max=4623 , avg=1782.59, stdev=854.91
     lat (usec): min=51 , max=4623 , avg=1782.80, stdev=854.91
    clat percentiles (usec):
     |  1.00th=[  358],  5.00th=[  478], 10.00th=[  620], 20.00th=[  884],
     | 30.00th=[ 1160], 40.00th=[ 1464], 50.00th=[ 1784], 60.00th=[ 2096],
     | 70.00th=[ 2416], 80.00th=[ 2704], 90.00th=[ 2928], 95.00th=[ 3056],
     | 99.00th=[ 3248], 99.50th=[ 3312], 99.90th=[ 3408], 99.95th=[ 3472],
     | 99.99th=[ 3600]
    bw (KB/s)  : min= 2007, max= 2640, per=1.56%, avg=2242.06, stdev=73.17
    lat (usec) : 100=0.01%, 250=0.07%, 500=5.88%, 750=9.42%, 1000=8.97%
    lat (msec) : 2=32.31%, 4=43.34%, 10=0.01%
  cpu          : usr=0.27%, sys=1.37%, ctx=358516, majf=0, minf=2142
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=358484/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=1400.4MB, aggrb=143350KB/s, minb=143350KB/s, maxb=143350KB/s, mint=10003msec, maxt=10003msec

Disk stats (read/write):
  sdc: ios=354577/0, merge=0/0, ticks=623254/0, in_queue=623044, util=98.99%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=2688
  read : io=1400.6MB, bw=143377KB/s, iops=35844 , runt= 10003msec
    clat (usec): min=60 , max=4425 , avg=1782.24, stdev=877.81
     lat (usec): min=60 , max=4425 , avg=1782.45, stdev=877.81
    clat percentiles (usec):
     |  1.00th=[  358],  5.00th=[  474], 10.00th=[  604], 20.00th=[  836],
     | 30.00th=[ 1128], 40.00th=[ 1432], 50.00th=[ 1784], 60.00th=[ 2128],
     | 70.00th=[ 2448], 80.00th=[ 2736], 90.00th=[ 2960], 95.00th=[ 3056],
     | 99.00th=[ 3248], 99.50th=[ 3312], 99.90th=[ 3440], 99.95th=[ 3472],
     | 99.99th=[ 3600]
    bw (KB/s)  : min= 2016, max= 2578, per=1.56%, avg=2242.84, stdev=74.83
    lat (usec) : 100=0.01%, 250=0.06%, 500=6.17%, 750=10.65%, 1000=9.34%
    lat (msec) : 2=29.93%, 4=43.85%, 10=0.01%
  cpu          : usr=0.27%, sys=1.37%, ctx=358569, majf=0, minf=2141
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=358550/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=1400.6MB, aggrb=143376KB/s, minb=143376KB/s, maxb=143376KB/s, mint=10003msec, maxt=10003msec

Disk stats (read/write):
  sdc: ios=354658/0, merge=0/0, ticks=623160/0, in_queue=622928, util=98.98%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=2827
  read : io=1400.9MB, bw=143404KB/s, iops=35850 , runt= 10003msec
    clat (usec): min=62 , max=4109 , avg=1781.92, stdev=881.32
     lat (usec): min=62 , max=4109 , avg=1782.13, stdev=881.32
    clat percentiles (usec):
     |  1.00th=[  358],  5.00th=[  470], 10.00th=[  596], 20.00th=[  836],
     | 30.00th=[ 1112], 40.00th=[ 1416], 50.00th=[ 1784], 60.00th=[ 2128],
     | 70.00th=[ 2480], 80.00th=[ 2736], 90.00th=[ 2960], 95.00th=[ 3056],
     | 99.00th=[ 3248], 99.50th=[ 3312], 99.90th=[ 3440], 99.95th=[ 3472],
     | 99.99th=[ 3600]
    bw (KB/s)  : min= 2043, max= 2573, per=1.56%, avg=2243.06, stdev=75.52
    lat (usec) : 100=0.01%, 250=0.07%, 500=6.31%, 750=10.39%, 1000=9.50%
    lat (msec) : 2=29.80%, 4=43.92%, 10=0.01%
  cpu          : usr=0.26%, sys=1.38%, ctx=358636, majf=0, minf=2141
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=358617/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=1400.9MB, aggrb=143403KB/s, minb=143403KB/s, maxb=143403KB/s, mint=10003msec, maxt=10003msec

Disk stats (read/write):
  sdc: ios=354711/0, merge=0/0, ticks=623346/0, in_queue=623146, util=99.00%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=2965
  read : io=1399.4MB, bw=143255KB/s, iops=35813 , runt= 10003msec
    clat (usec): min=53 , max=4069 , avg=1783.79, stdev=868.32
     lat (usec): min=53 , max=4069 , avg=1784.00, stdev=868.32
    clat percentiles (usec):
     |  1.00th=[  358],  5.00th=[  470], 10.00th=[  604], 20.00th=[  868],
     | 30.00th=[ 1144], 40.00th=[ 1464], 50.00th=[ 1784], 60.00th=[ 2096],
     | 70.00th=[ 2416], 80.00th=[ 2704], 90.00th=[ 2960], 95.00th=[ 3088],
     | 99.00th=[ 3248], 99.50th=[ 3312], 99.90th=[ 3440], 99.95th=[ 3472],
     | 99.99th=[ 3568]
    bw (KB/s)  : min= 2007, max= 2605, per=1.56%, avg=2240.95, stdev=72.64
    lat (usec) : 100=0.01%, 250=0.06%, 500=6.27%, 750=9.83%, 1000=8.90%
    lat (msec) : 2=31.66%, 4=43.27%, 10=0.01%
  cpu          : usr=0.27%, sys=1.35%, ctx=358293, majf=0, minf=2143
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=358244/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=1399.4MB, aggrb=143254KB/s, minb=143254KB/s, maxb=143254KB/s, mint=10003msec, maxt=10003msec

Disk stats (read/write):
  sdc: ios=354268/0, merge=0/0, ticks=622998/0, in_queue=622796, util=98.96%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=3104
  read : io=1396.8MB, bw=142982KB/s, iops=35745 , runt= 10003msec
    clat (usec): min=53 , max=3745 , avg=1787.20, stdev=844.51
     lat (usec): min=53 , max=3745 , avg=1787.41, stdev=844.51
    clat percentiles (usec):
     |  1.00th=[  362],  5.00th=[  486], 10.00th=[  636], 20.00th=[  908],
     | 30.00th=[ 1176], 40.00th=[ 1480], 50.00th=[ 1784], 60.00th=[ 2096],
     | 70.00th=[ 2384], 80.00th=[ 2672], 90.00th=[ 2928], 95.00th=[ 3056],
     | 99.00th=[ 3248], 99.50th=[ 3312], 99.90th=[ 3440], 99.95th=[ 3472],
     | 99.99th=[ 3600]
    bw (KB/s)  : min= 2024, max= 2640, per=1.56%, avg=2236.44, stdev=73.30
    lat (usec) : 100=0.01%, 250=0.08%, 500=5.42%, 750=9.12%, 1000=8.94%
    lat (msec) : 2=33.40%, 4=43.03%
  cpu          : usr=0.27%, sys=1.34%, ctx=357592, majf=0, minf=2141
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=357563/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=1396.8MB, aggrb=142982KB/s, minb=142982KB/s, maxb=142982KB/s, mint=10003msec, maxt=10003msec

Disk stats (read/write):
  sdc: ios=353636/0, merge=0/0, ticks=623408/0, in_queue=623215, util=98.98%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=3245
  read : io=1399.4MB, bw=143266KB/s, iops=35816 , runt= 10002msec
    clat (usec): min=50 , max=4367 , avg=1783.78, stdev=882.87
     lat (usec): min=50 , max=4367 , avg=1783.99, stdev=882.87
    clat percentiles (usec):
     |  1.00th=[  358],  5.00th=[  470], 10.00th=[  588], 20.00th=[  836],
     | 30.00th=[ 1112], 40.00th=[ 1432], 50.00th=[ 1784], 60.00th=[ 2128],
     | 70.00th=[ 2448], 80.00th=[ 2736], 90.00th=[ 2960], 95.00th=[ 3088],
     | 99.00th=[ 3248], 99.50th=[ 3312], 99.90th=[ 3408], 99.95th=[ 3472],
     | 99.99th=[ 3632]
    bw (KB/s)  : min= 2019, max= 2616, per=1.56%, avg=2240.74, stdev=72.25
    lat (usec) : 100=0.01%, 250=0.08%, 500=6.44%, 750=10.35%, 1000=9.35%
    lat (msec) : 2=29.66%, 4=44.11%, 10=0.01%
  cpu          : usr=0.26%, sys=1.37%, ctx=358263, majf=0, minf=2142
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=358236/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=1399.4MB, aggrb=143265KB/s, minb=143265KB/s, maxb=143265KB/s, mint=10002msec, maxt=10002msec

Disk stats (read/write):
  sdc: ios=354303/0, merge=0/0, ticks=623156/0, in_queue=622986, util=98.98%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=3384
  read : io=1399.1MB, bw=143312KB/s, iops=35828 , runt= 10003msec
    clat (usec): min=53 , max=3698 , avg=1783.07, stdev=875.46
     lat (usec): min=53 , max=3698 , avg=1783.29, stdev=875.46
    clat percentiles (usec):
     |  1.00th=[  358],  5.00th=[  474], 10.00th=[  612], 20.00th=[  852],
     | 30.00th=[ 1112], 40.00th=[ 1432], 50.00th=[ 1784], 60.00th=[ 2128],
     | 70.00th=[ 2480], 80.00th=[ 2736], 90.00th=[ 2960], 95.00th=[ 3056],
     | 99.00th=[ 3248], 99.50th=[ 3312], 99.90th=[ 3408], 99.95th=[ 3472],
     | 99.99th=[ 3536]
    bw (KB/s)  : min= 1964, max= 2592, per=1.56%, avg=2241.48, stdev=73.44
    lat (usec) : 100=0.01%, 250=0.06%, 500=6.03%, 750=10.21%, 1000=9.92%
    lat (msec) : 2=29.80%, 4=43.98%
  cpu          : usr=0.27%, sys=1.35%, ctx=358419, majf=0, minf=2141
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=358388/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=1399.1MB, aggrb=143312KB/s, minb=143312KB/s, maxb=143312KB/s, mint=10003msec, maxt=10003msec

Disk stats (read/write):
  sdc: ios=354465/0, merge=0/0, ticks=623238/0, in_queue=623006, util=98.97%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=3522
  read : io=1399.1MB, bw=143320KB/s, iops=35830 , runt= 10002msec
    clat (usec): min=53 , max=4243 , avg=1783.14, stdev=882.45
     lat (usec): min=53 , max=4243 , avg=1783.37, stdev=882.45
    clat percentiles (usec):
     |  1.00th=[  354],  5.00th=[  466], 10.00th=[  588], 20.00th=[  836],
     | 30.00th=[ 1112], 40.00th=[ 1432], 50.00th=[ 1784], 60.00th=[ 2128],
     | 70.00th=[ 2480], 80.00th=[ 2736], 90.00th=[ 2960], 95.00th=[ 3088],
     | 99.00th=[ 3248], 99.50th=[ 3312], 99.90th=[ 3408], 99.95th=[ 3472],
     | 99.99th=[ 3600]
    bw (KB/s)  : min= 2039, max= 2640, per=1.56%, avg=2241.62, stdev=74.95
    lat (usec) : 100=0.01%, 250=0.08%, 500=6.50%, 750=10.39%, 1000=9.18%
    lat (msec) : 2=29.92%, 4=43.92%, 10=0.01%
  cpu          : usr=0.27%, sys=1.35%, ctx=358398, majf=0, minf=2142
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=358372/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=1399.1MB, aggrb=143320KB/s, minb=143320KB/s, maxb=143320KB/s, mint=10002msec, maxt=10002msec

Disk stats (read/write):
  sdc: ios=354405/0, merge=0/0, ticks=623250/0, in_queue=623084, util=98.98%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=3661
  read : io=1400.2MB, bw=143329KB/s, iops=35832 , runt= 10003msec
    clat (usec): min=53 , max=4080 , avg=1782.88, stdev=854.18
     lat (usec): min=53 , max=4080 , avg=1783.08, stdev=854.18
    clat percentiles (usec):
     |  1.00th=[  362],  5.00th=[  478], 10.00th=[  620], 20.00th=[  876],
     | 30.00th=[ 1160], 40.00th=[ 1480], 50.00th=[ 1784], 60.00th=[ 2096],
     | 70.00th=[ 2416], 80.00th=[ 2704], 90.00th=[ 2928], 95.00th=[ 3056],
     | 99.00th=[ 3248], 99.50th=[ 3312], 99.90th=[ 3408], 99.95th=[ 3472],
     | 99.99th=[ 3568]
    bw (KB/s)  : min= 2032, max= 2664, per=1.56%, avg=2241.92, stdev=71.90
    lat (usec) : 100=0.01%, 250=0.07%, 500=5.78%, 750=9.71%, 1000=9.00%
    lat (msec) : 2=32.44%, 4=43.00%, 10=0.01%
  cpu          : usr=0.27%, sys=1.34%, ctx=358453, majf=0, minf=2206
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=358431/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=1400.2MB, aggrb=143329KB/s, minb=143329KB/s, maxb=143329KB/s, mint=10003msec, maxt=10003msec

Disk stats (read/write):
  sdc: ios=354503/0, merge=0/0, ticks=623246/0, in_queue=623076, util=98.98%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=3801
  read : io=1400.5MB, bw=143379KB/s, iops=35844 , runt= 10002msec
    clat (usec): min=50 , max=4493 , avg=1782.32, stdev=875.65
     lat (usec): min=51 , max=4493 , avg=1782.54, stdev=875.65
    clat percentiles (usec):
     |  1.00th=[  362],  5.00th=[  478], 10.00th=[  612], 20.00th=[  852],
     | 30.00th=[ 1112], 40.00th=[ 1416], 50.00th=[ 1784], 60.00th=[ 2160],
     | 70.00th=[ 2480], 80.00th=[ 2736], 90.00th=[ 2928], 95.00th=[ 3056],
     | 99.00th=[ 3248], 99.50th=[ 3312], 99.90th=[ 3408], 99.95th=[ 3472],
     | 99.99th=[ 3632]
    bw (KB/s)  : min= 2016, max= 2602, per=1.56%, avg=2242.89, stdev=74.96
    lat (usec) : 100=0.01%, 250=0.06%, 500=5.96%, 750=10.27%, 1000=9.88%
    lat (msec) : 2=29.58%, 4=44.24%, 10=0.01%
  cpu          : usr=0.27%, sys=1.36%, ctx=358545, majf=0, minf=2141
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=358520/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=1400.5MB, aggrb=143379KB/s, minb=143379KB/s, maxb=143379KB/s, mint=10002msec, maxt=10002msec

Disk stats (read/write):
  sdc: ios=354557/0, merge=0/0, ticks=623337/0, in_queue=623137, util=98.96%
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=3939
  read : io=1400.9MB, bw=143325KB/s, iops=35831 , runt= 10003msec
    clat (usec): min=53 , max=5440 , avg=1782.86, stdev=872.30
     lat (usec): min=53 , max=5440 , avg=1783.07, stdev=872.30
    clat percentiles (usec):
     |  1.00th=[  358],  5.00th=[  474], 10.00th=[  604], 20.00th=[  860],
     | 30.00th=[ 1128], 40.00th=[ 1432], 50.00th=[ 1784], 60.00th=[ 2128],
     | 70.00th=[ 2448], 80.00th=[ 2704], 90.00th=[ 2960], 95.00th=[ 3088],
     | 99.00th=[ 3248], 99.50th=[ 3312], 99.90th=[ 3440], 99.95th=[ 3472],
     | 99.99th=[ 3760]
    bw (KB/s)  : min= 2051, max= 2562, per=1.56%, avg=2241.66, stdev=72.85
    lat (usec) : 100=0.01%, 250=0.11%, 500=6.10%, 750=9.93%, 1000=9.22%
    lat (msec) : 2=30.51%, 4=44.11%, 10=0.01%
  cpu          : usr=0.28%, sys=1.35%, ctx=358454, majf=0, minf=2140
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=358421/w=0/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
   READ: io=1400.9MB, aggrb=143325KB/s, minb=143325KB/s, maxb=143325KB/s, mint=10003msec, maxt=10003msec

Disk stats (read/write):
  sdc: ios=354441/0, merge=0/0, ticks=623038/0, in_queue=622860, util=98.96%
