128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 16 processes

128m: (groupid=0, jobs=16): err= 0: pid=7191
  write: io=61256KB, bw=6117.7KB/s, iops=1529 , runt= 10013msec
    clat (usec): min=340 , max=1516.9K, avg=10443.28, stdev=117719.81
     lat (usec): min=341 , max=1516.9K, avg=10444.27, stdev=117719.82
    clat percentiles (usec):
     |  1.00th=[  490],  5.00th=[  532], 10.00th=[  556], 20.00th=[  580],
     | 30.00th=[  596], 40.00th=[  604], 50.00th=[  620], 60.00th=[  636],
     | 70.00th=[  660], 80.00th=[  684], 90.00th=[  740], 95.00th=[  812],
     | 99.00th=[ 2288], 99.50th=[1515520], 99.90th=[1515520], 99.95th=[1515520],
     | 99.99th=[1515520]
    bw (KB/s)  : min=    2, max= 1186, per=6.23%, avg=380.90, stdev=194.41
    lat (usec) : 500=1.40%, 750=89.43%, 1000=7.51%
    lat (msec) : 2=0.62%, 4=0.24%, 10=0.01%, 20=0.01%, 100=0.01%
    lat (msec) : 250=0.07%, 500=0.03%, 750=0.04%, 1000=0.04%, 2000=0.61%
  cpu          : usr=0.11%, sys=1.28%, ctx=15508, majf=0, minf=453
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=15314/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=61256KB, aggrb=6117KB/s, minb=6117KB/s, maxb=6117KB/s, mint=10013msec, maxt=10013msec

Disk stats (read/write):
  hda: ios=145/15224, merge=0/12, ticks=12190/145408, in_queue=162330, util=99.18%
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 16 processes

128m: (groupid=0, jobs=16): err= 0: pid=19244
  write: io=70244KB, bw=7017.4KB/s, iops=1754 , runt= 10010msec
    clat (usec): min=313 , max=1537.9K, avg=9107.68, stdev=106971.04
     lat (usec): min=313 , max=1537.9K, avg=9108.22, stdev=106971.05
    clat percentiles (usec):
     |  1.00th=[  366],  5.00th=[  390], 10.00th=[  402], 20.00th=[  426],
     | 30.00th=[  454], 40.00th=[  482], 50.00th=[  524], 60.00th=[  588],
     | 70.00th=[  628], 80.00th=[  660], 90.00th=[  716], 95.00th=[  812],
     | 99.00th=[ 2288], 99.50th=[1036288], 99.90th=[1515520], 99.95th=[1531904],
     | 99.99th=[1531904]
    bw (KB/s)  : min=    2, max= 1448, per=6.32%, avg=443.44, stdev=300.03
    lat (usec) : 500=44.56%, 750=47.87%, 1000=6.11%
    lat (msec) : 2=0.34%, 4=0.34%, 10=0.03%, 20=0.01%, 50=0.01%
    lat (msec) : 100=0.01%, 250=0.03%, 500=0.04%, 750=0.09%, 1000=0.05%
    lat (msec) : 2000=0.51%
  cpu          : usr=0.06%, sys=0.80%, ctx=17756, majf=16, minf=438
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=17561/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=70244KB, aggrb=7017KB/s, minb=7017KB/s, maxb=7017KB/s, mint=10010msec, maxt=10010msec

Disk stats (read/write):
  hda: ios=213/17442, merge=16/17, ticks=18609/133425, in_queue=166721, util=99.45%
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 16 processes

128m: (groupid=0, jobs=16): err= 0: pid=29106
  write: io=64908KB, bw=6479.2KB/s, iops=1619 , runt= 10018msec
    clat (usec): min=311 , max=1521.2K, avg=9861.62, stdev=114508.34
     lat (usec): min=312 , max=1521.2K, avg=9862.43, stdev=114508.38
    clat percentiles (usec):
     |  1.00th=[  374],  5.00th=[  406], 10.00th=[  438], 20.00th=[  506],
     | 30.00th=[  540], 40.00th=[  564], 50.00th=[  588], 60.00th=[  612],
     | 70.00th=[  644], 80.00th=[  684], 90.00th=[  772], 95.00th=[  836],
     | 99.00th=[ 2224], 99.50th=[1515520], 99.90th=[1515520], 99.95th=[1515520],
     | 99.99th=[1515520]
    bw (KB/s)  : min=    2, max= 1280, per=6.26%, avg=405.73, stdev=209.07
    lat (usec) : 500=18.47%, 750=69.29%, 1000=10.61%
    lat (msec) : 2=0.59%, 4=0.23%, 10=0.03%, 20=0.01%, 100=0.08%
    lat (msec) : 250=0.04%, 500=0.02%, 750=0.04%, 1000=0.02%, 2000=0.58%
  cpu          : usr=0.09%, sys=1.08%, ctx=16434, majf=0, minf=454
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=16227/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=64908KB, aggrb=6479KB/s, minb=6479KB/s, maxb=6479KB/s, mint=10018msec, maxt=10018msec

Disk stats (read/write):
  hda: ios=184/16158, merge=0/20, ticks=18368/151552, in_queue=173767, util=99.37%
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 16 processes

128m: (groupid=0, jobs=16): err= 0: pid=5978
  write: io=65116KB, bw=6501.3KB/s, iops=1625 , runt= 10016msec
    clat (usec): min=312 , max=1526.3K, avg=9825.54, stdev=110966.59
     lat (usec): min=313 , max=1526.3K, avg=9826.41, stdev=110966.62
    clat percentiles (usec):
     |  1.00th=[  374],  5.00th=[  406], 10.00th=[  442], 20.00th=[  506],
     | 30.00th=[  532], 40.00th=[  564], 50.00th=[  588], 60.00th=[  612],
     | 70.00th=[  636], 80.00th=[  684], 90.00th=[  764], 95.00th=[  828],
     | 99.00th=[ 2512], 99.50th=[1138688], 99.90th=[1515520], 99.95th=[1515520],
     | 99.99th=[1515520]
    bw (KB/s)  : min=    2, max= 1384, per=6.32%, avg=410.69, stdev=282.55
    lat (usec) : 500=18.31%, 750=70.30%, 1000=9.93%
    lat (msec) : 2=0.34%, 4=0.31%, 10=0.01%, 20=0.01%, 100=0.01%
    lat (msec) : 250=0.02%, 500=0.05%, 750=0.09%, 1000=0.06%, 2000=0.55%
  cpu          : usr=0.09%, sys=1.12%, ctx=16491, majf=7, minf=447
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=16279/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=65116KB, aggrb=6501KB/s, minb=6501KB/s, maxb=6501KB/s, mint=10016msec, maxt=10016msec

Disk stats (read/write):
  hda: ios=202/16160, merge=16/22, ticks=17454/134339, in_queue=167049, util=99.38%
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 16 processes

128m: (groupid=0, jobs=16): err= 0: pid=15072
  write: io=62608KB, bw=6252.5KB/s, iops=1563 , runt= 10014msec
    clat (usec): min=323 , max=1539.7K, avg=10216.97, stdev=113967.51
     lat (usec): min=324 , max=1539.7K, avg=10217.88, stdev=113967.53
    clat percentiles (usec):
     |  1.00th=[  402],  5.00th=[  470], 10.00th=[  502], 20.00th=[  532],
     | 30.00th=[  548], 40.00th=[  572], 50.00th=[  596], 60.00th=[  612],
     | 70.00th=[  644], 80.00th=[  684], 90.00th=[  764], 95.00th=[  828],
     | 99.00th=[ 2576], 99.50th=[1236992], 99.90th=[1515520], 99.95th=[1531904],
     | 99.99th=[1531904]
    bw (KB/s)  : min=    2, max= 1408, per=6.22%, avg=388.92, stdev=253.63
    lat (usec) : 500=9.38%, 750=78.69%, 1000=10.22%
    lat (msec) : 2=0.53%, 4=0.29%, 10=0.04%, 20=0.01%, 50=0.03%
    lat (msec) : 250=0.05%, 500=0.05%, 750=0.08%, 1000=0.05%, 2000=0.58%
  cpu          : usr=0.10%, sys=1.16%, ctx=15854, majf=7, minf=447
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=15652/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=62608KB, aggrb=6252KB/s, minb=6252KB/s, maxb=6252KB/s, mint=10014msec, maxt=10014msec

Disk stats (read/write):
  hda: ios=198/15563, merge=16/20, ticks=17323/135545, in_queue=167946, util=99.28%
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 16 processes

128m: (groupid=0, jobs=16): err= 0: pid=21104
  write: io=62280KB, bw=6219.1KB/s, iops=1554 , runt= 10013msec
    clat (usec): min=352 , max=1518.8K, avg=10270.81, stdev=117127.48
     lat (usec): min=353 , max=1518.8K, avg=10271.78, stdev=117127.50
    clat percentiles (usec):
     |  1.00th=[  466],  5.00th=[  510], 10.00th=[  524], 20.00th=[  540],
     | 30.00th=[  564], 40.00th=[  580], 50.00th=[  596], 60.00th=[  620],
     | 70.00th=[  644], 80.00th=[  692], 90.00th=[  780], 95.00th=[  836],
     | 99.00th=[ 2416], 99.50th=[1515520], 99.90th=[1515520], 99.95th=[1515520],
     | 99.99th=[1515520]
    bw (KB/s)  : min=    2, max= 1280, per=6.20%, avg=385.41, stdev=200.22
    lat (usec) : 500=2.78%, 750=84.07%, 1000=11.45%
    lat (msec) : 2=0.64%, 4=0.30%, 10=0.01%, 20=0.01%, 50=0.01%
    lat (msec) : 250=0.05%, 500=0.03%, 750=0.04%, 1000=0.03%, 2000=0.61%
  cpu          : usr=0.11%, sys=1.29%, ctx=15750, majf=0, minf=453
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=15570/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=62280KB, aggrb=6219KB/s, minb=6219KB/s, maxb=6219KB/s, mint=10013msec, maxt=10013msec

Disk stats (read/write):
  hda: ios=145/15466, merge=0/7, ticks=12195/143687, in_queue=161967, util=99.20%
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 16 processes

128m: (groupid=0, jobs=16): err= 0: pid=21148
  write: io=63084KB, bw=6300.3KB/s, iops=1575 , runt= 10013msec
    clat (usec): min=343 , max=1520.7K, avg=10140.89, stdev=115711.88
     lat (usec): min=344 , max=1520.7K, avg=10141.87, stdev=115711.89
    clat percentiles (usec):
     |  1.00th=[  458],  5.00th=[  498], 10.00th=[  510], 20.00th=[  532],
     | 30.00th=[  556], 40.00th=[  572], 50.00th=[  596], 60.00th=[  612],
     | 70.00th=[  644], 80.00th=[  684], 90.00th=[  764], 95.00th=[  828],
     | 99.00th=[ 2480], 99.50th=[1466368], 99.90th=[1515520], 99.95th=[1515520],
     | 99.99th=[1515520]
    bw (KB/s)  : min=    2, max= 1208, per=6.23%, avg=392.27, stdev=207.14
    lat (usec) : 500=5.95%, 750=82.06%, 1000=10.21%
    lat (msec) : 2=0.69%, 4=0.26%, 10=0.02%, 20=0.02%, 50=0.01%
    lat (msec) : 250=0.08%, 500=0.03%, 750=0.04%, 1000=0.03%, 2000=0.60%
  cpu          : usr=0.12%, sys=1.31%, ctx=15966, majf=0, minf=453
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=15771/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=63084KB, aggrb=6300KB/s, minb=6300KB/s, maxb=6300KB/s, mint=10013msec, maxt=10013msec

Disk stats (read/write):
  hda: ios=153/15704, merge=0/11, ticks=12910/147476, in_queue=163441, util=99.14%
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 16 processes

128m: (groupid=0, jobs=16): err= 0: pid=21190
  write: io=62940KB, bw=6287.9KB/s, iops=1571 , runt= 10011msec
    clat (usec): min=336 , max=1518.9K, avg=10162.29, stdev=116503.33
     lat (usec): min=336 , max=1518.9K, avg=10163.26, stdev=116503.34
    clat percentiles (usec):
     |  1.00th=[  458],  5.00th=[  506], 10.00th=[  516], 20.00th=[  540],
     | 30.00th=[  556], 40.00th=[  580], 50.00th=[  596], 60.00th=[  612],
     | 70.00th=[  644], 80.00th=[  684], 90.00th=[  772], 95.00th=[  828],
     | 99.00th=[ 1928], 99.50th=[1515520], 99.90th=[1515520], 99.95th=[1515520],
     | 99.99th=[1515520]
    bw (KB/s)  : min=    2, max= 1320, per=6.21%, avg=390.35, stdev=207.45
    lat (usec) : 500=4.10%, 750=83.56%, 1000=10.65%
    lat (msec) : 2=0.71%, 4=0.20%, 10=0.04%, 100=0.01%, 250=0.04%
    lat (msec) : 500=0.03%, 750=0.04%, 1000=0.03%, 2000=0.60%
  cpu          : usr=0.13%, sys=1.27%, ctx=15920, majf=0, minf=453
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=15735/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=62940KB, aggrb=6287KB/s, minb=6287KB/s, maxb=6287KB/s, mint=10011msec, maxt=10011msec

Disk stats (read/write):
  hda: ios=146/15651, merge=0/7, ticks=12205/143581, in_queue=162127, util=99.18%
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 16 processes

128m: (groupid=0, jobs=16): err= 0: pid=21234
  write: io=62400KB, bw=6232.6KB/s, iops=1558 , runt= 10012msec
    clat (usec): min=339 , max=1518.2K, avg=10250.42, stdev=116277.23
     lat (usec): min=339 , max=1518.2K, avg=10251.39, stdev=116277.25
    clat percentiles (usec):
     |  1.00th=[  458],  5.00th=[  490], 10.00th=[  510], 20.00th=[  532],
     | 30.00th=[  556], 40.00th=[  572], 50.00th=[  596], 60.00th=[  620],
     | 70.00th=[  644], 80.00th=[  684], 90.00th=[  772], 95.00th=[  836],
     | 99.00th=[ 2512], 99.50th=[1335296], 99.90th=[1515520], 99.95th=[1515520],
     | 99.99th=[1515520]
    bw (KB/s)  : min=    2, max= 1100, per=6.08%, avg=379.07, stdev=189.12
    lat (usec) : 500=7.40%, 750=80.57%, 1000=10.08%
    lat (msec) : 2=0.88%, 4=0.29%, 10=0.02%, 20=0.01%, 50=0.01%
    lat (msec) : 100=0.01%, 250=0.02%, 500=0.03%, 750=0.03%, 1000=0.03%
    lat (msec) : 2000=0.62%
  cpu          : usr=0.10%, sys=1.30%, ctx=15774, majf=0, minf=469
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=15600/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=62400KB, aggrb=6232KB/s, minb=6232KB/s, maxb=6232KB/s, mint=10012msec, maxt=10012msec

Disk stats (read/write):
  hda: ios=147/15536, merge=0/9, ticks=12193/138717, in_queue=162119, util=99.18%
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 16 processes

128m: (groupid=0, jobs=16): err= 0: pid=21281
  write: io=71236KB, bw=7115.8KB/s, iops=1778 , runt= 10011msec
    clat (usec): min=294 , max=1517.9K, avg=8982.16, stdev=109794.25
     lat (usec): min=295 , max=1517.9K, avg=8982.69, stdev=109794.26
    clat percentiles (usec):
     |  1.00th=[  362],  5.00th=[  386], 10.00th=[  402], 20.00th=[  422],
     | 30.00th=[  446], 40.00th=[  474], 50.00th=[  524], 60.00th=[  580],
     | 70.00th=[  620], 80.00th=[  652], 90.00th=[  708], 95.00th=[  796],
     | 99.00th=[ 2008], 99.50th=[1220608], 99.90th=[1515520], 99.95th=[1515520],
     | 99.99th=[1515520]
    bw (KB/s)  : min=    2, max= 1349, per=6.19%, avg=440.21, stdev=223.38
    lat (usec) : 500=46.06%, 750=47.10%, 1000=5.45%
    lat (msec) : 2=0.39%, 4=0.33%, 10=0.02%, 20=0.01%, 50=0.01%
    lat (msec) : 250=0.02%, 500=0.02%, 750=0.03%, 1000=0.02%, 2000=0.53%
  cpu          : usr=0.07%, sys=0.81%, ctx=17977, majf=0, minf=454
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=17809/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=71236KB, aggrb=7115KB/s, minb=7115KB/s, maxb=7115KB/s, mint=10011msec, maxt=10011msec

Disk stats (read/write):
  hda: ios=146/17730, merge=0/7, ticks=12193/139329, in_queue=163051, util=99.19%
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 16 processes

128m: (groupid=0, jobs=16): err= 0: pid=21325
  write: io=61860KB, bw=6178.6KB/s, iops=1544 , runt= 10012msec
    clat (usec): min=353 , max=1517.4K, avg=10341.30, stdev=117289.07
     lat (usec): min=354 , max=1517.4K, avg=10342.29, stdev=117289.09
    clat percentiles (usec):
     |  1.00th=[  470],  5.00th=[  506], 10.00th=[  524], 20.00th=[  548],
     | 30.00th=[  564], 40.00th=[  588], 50.00th=[  604], 60.00th=[  628],
     | 70.00th=[  660], 80.00th=[  700], 90.00th=[  780], 95.00th=[  836],
     | 99.00th=[ 2448], 99.50th=[1515520], 99.90th=[1515520], 99.95th=[1515520],
     | 99.99th=[1515520]
    bw (KB/s)  : min=    2, max= 1262, per=6.23%, avg=384.95, stdev=199.89
    lat (usec) : 500=3.32%, 750=82.30%, 1000=12.62%
    lat (msec) : 2=0.65%, 4=0.32%, 10=0.01%, 20=0.01%, 100=0.03%
    lat (msec) : 250=0.05%, 500=0.03%, 750=0.05%, 1000=0.03%, 2000=0.61%
  cpu          : usr=0.11%, sys=1.28%, ctx=15648, majf=0, minf=453
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=15465/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=61860KB, aggrb=6178KB/s, minb=6178KB/s, maxb=6178KB/s, mint=10012msec, maxt=10012msec

Disk stats (read/write):
  hda: ios=146/15357, merge=0/7, ticks=12193/148244, in_queue=162343, util=99.15%
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 16 processes

128m: (groupid=0, jobs=16): err= 0: pid=21367
  write: io=60796KB, bw=6070.6KB/s, iops=1517 , runt= 10015msec
    clat (usec): min=353 , max=1533.8K, avg=10523.41, stdev=117140.38
     lat (usec): min=354 , max=1533.8K, avg=10524.40, stdev=117140.40
    clat percentiles (usec):
     |  1.00th=[  462],  5.00th=[  506], 10.00th=[  524], 20.00th=[  540],
     | 30.00th=[  564], 40.00th=[  580], 50.00th=[  604], 60.00th=[  620],
     | 70.00th=[  652], 80.00th=[  692], 90.00th=[  780], 95.00th=[  836],
     | 99.00th=[ 2640], 99.50th=[1384448], 99.90th=[1515520], 99.95th=[1515520],
     | 99.99th=[1515520]
    bw (KB/s)  : min=    2, max= 1220, per=6.15%, avg=373.57, stdev=203.95
    lat (usec) : 500=3.99%, 750=82.54%, 1000=11.44%
    lat (msec) : 2=0.84%, 4=0.26%, 10=0.08%, 20=0.09%, 250=0.03%
    lat (msec) : 500=0.03%, 750=0.05%, 1000=0.03%, 2000=0.64%
  cpu          : usr=0.12%, sys=1.31%, ctx=15383, majf=0, minf=453
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=15199/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=60796KB, aggrb=6070KB/s, minb=6070KB/s, maxb=6070KB/s, mint=10015msec, maxt=10015msec

Disk stats (read/write):
  hda: ios=146/15140, merge=0/7, ticks=11484/138917, in_queue=162164, util=99.17%
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 16 processes

128m: (groupid=0, jobs=16): err= 0: pid=21411
  write: io=61296KB, bw=6121.7KB/s, iops=1530 , runt= 10013msec
    clat (usec): min=358 , max=1524.7K, avg=10435.70, stdev=118163.43
     lat (usec): min=359 , max=1524.7K, avg=10436.69, stdev=118163.46
    clat percentiles (usec):
     |  1.00th=[  462],  5.00th=[  516], 10.00th=[  524], 20.00th=[  548],
     | 30.00th=[  572], 40.00th=[  588], 50.00th=[  604], 60.00th=[  628],
     | 70.00th=[  652], 80.00th=[  692], 90.00th=[  780], 95.00th=[  836],
     | 99.00th=[ 2480], 99.50th=[1515520], 99.90th=[1515520], 99.95th=[1531904],
     | 99.99th=[1531904]
    bw (KB/s)  : min=    2, max= 1211, per=6.17%, avg=377.88, stdev=195.35
    lat (usec) : 500=2.98%, 750=83.43%, 1000=11.71%
    lat (msec) : 2=0.78%, 4=0.27%, 10=0.06%, 20=0.02%, 100=0.01%
    lat (msec) : 250=0.03%, 500=0.03%, 750=0.04%, 1000=0.03%, 2000=0.62%
  cpu          : usr=0.10%, sys=1.27%, ctx=15504, majf=0, minf=453
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=15324/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=61296KB, aggrb=6121KB/s, minb=6121KB/s, maxb=6121KB/s, mint=10013msec, maxt=10013msec

Disk stats (read/write):
  hda: ios=146/15244, merge=0/7, ticks=12182/142496, in_queue=162059, util=99.19%
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 16 processes

128m: (groupid=0, jobs=16): err= 0: pid=21453
  write: io=67504KB, bw=6741.7KB/s, iops=1685 , runt= 10013msec
    clat (usec): min=319 , max=1542.3K, avg=9479.52, stdev=112580.68
     lat (usec): min=319 , max=1542.3K, avg=9480.17, stdev=112580.70
    clat percentiles (usec):
     |  1.00th=[  362],  5.00th=[  390], 10.00th=[  406], 20.00th=[  434],
     | 30.00th=[  470], 40.00th=[  516], 50.00th=[  556], 60.00th=[  596],
     | 70.00th=[  628], 80.00th=[  660], 90.00th=[  732], 95.00th=[  820],
     | 99.00th=[ 2480], 99.50th=[1417216], 99.90th=[1515520], 99.95th=[1531904],
     | 99.99th=[1531904]
    bw (KB/s)  : min=    2, max= 1155, per=6.12%, avg=412.55, stdev=202.44
    lat (usec) : 500=36.62%, 750=54.35%, 1000=7.22%
    lat (msec) : 2=0.68%, 4=0.33%, 10=0.03%, 20=0.02%, 50=0.02%
    lat (msec) : 100=0.06%, 250=0.02%, 500=0.03%, 750=0.04%, 1000=0.02%
    lat (msec) : 2000=0.56%
  cpu          : usr=0.08%, sys=0.95%, ctx=17054, majf=0, minf=454
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=16876/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=67504KB, aggrb=6741KB/s, minb=6741KB/s, maxb=6741KB/s, mint=10013msec, maxt=10013msec

Disk stats (read/write):
  hda: ios=146/16777, merge=0/7, ticks=12218/148943, in_queue=162843, util=99.17%
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 16 processes

128m: (groupid=0, jobs=16): err= 0: pid=21497
  write: io=61916KB, bw=6184.2KB/s, iops=1546 , runt= 10012msec
    clat (usec): min=337 , max=1528.2K, avg=10331.79, stdev=117412.88
     lat (usec): min=338 , max=1528.2K, avg=10332.77, stdev=117412.89
    clat percentiles (usec):
     |  1.00th=[  450],  5.00th=[  490], 10.00th=[  510], 20.00th=[  532],
     | 30.00th=[  556], 40.00th=[  580], 50.00th=[  596], 60.00th=[  620],
     | 70.00th=[  652], 80.00th=[  692], 90.00th=[  780], 95.00th=[  836],
     | 99.00th=[ 2544], 99.50th=[1515520], 99.90th=[1515520], 99.95th=[1515520],
     | 99.99th=[1531904]
    bw (KB/s)  : min=    2, max= 1136, per=6.09%, avg=376.38, stdev=183.11
    lat (usec) : 500=7.24%, 750=79.50%, 1000=11.32%
    lat (msec) : 2=0.78%, 4=0.28%, 10=0.06%, 20=0.03%, 50=0.03%
    lat (msec) : 100=0.05%, 250=0.02%, 500=0.03%, 750=0.03%, 1000=0.03%
    lat (msec) : 2000=0.61%
  cpu          : usr=0.11%, sys=1.23%, ctx=15662, majf=0, minf=453
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=15479/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=61916KB, aggrb=6184KB/s, minb=6184KB/s, maxb=6184KB/s, mint=10012msec, maxt=10012msec

Disk stats (read/write):
  hda: ios=153/15403, merge=0/9, ticks=13534/146388, in_queue=164060, util=99.21%
