128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=21628
  write: io=62296KB, bw=6158.2KB/s, iops=1539 , runt= 10116msec
    clat (usec): min=352 , max=4522.3K, avg=41417.41, stdev=356204.48
     lat (usec): min=353 , max=4522.3K, avg=41418.57, stdev=356204.50
    clat percentiles (usec):
     |  1.00th=[  462],  5.00th=[  516], 10.00th=[  540], 20.00th=[  572],
     | 30.00th=[  604], 40.00th=[  652], 50.00th=[  756], 60.00th=[ 1080],
     | 70.00th=[ 1160], 80.00th=[ 1224], 90.00th=[ 1320], 95.00th=[ 1432],
     | 99.00th=[1908736], 99.50th=[3489792], 99.90th=[4423680], 99.95th=[4423680],
     | 99.99th=[4489216]
    bw (KB/s)  : min=    0, max= 1808, per=2.28%, avg=140.64, stdev=235.09
    lat (usec) : 500=2.21%, 750=47.58%, 1000=5.28%
    lat (msec) : 2=42.43%, 4=0.73%, 10=0.09%, 20=0.05%, 50=0.04%
    lat (msec) : 100=0.01%, 250=0.03%, 500=0.07%, 750=0.04%, 1000=0.06%
    lat (msec) : 2000=0.42%, >=2000=0.96%
  cpu          : usr=0.03%, sys=0.19%, ctx=15857, majf=0, minf=1893
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=15574/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=62296KB, aggrb=6158KB/s, minb=6158KB/s, maxb=6158KB/s, mint=10116msec, maxt=10116msec

Disk stats (read/write):
  hda: ios=198/15369, merge=0/13, ticks=128445/343549, in_queue=600965, util=99.05%
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=21767
  write: io=65492KB, bw=6512.8KB/s, iops=1628 , runt= 10056msec
    clat (usec): min=324 , max=4865.8K, avg=39187.93, stdev=376937.29
     lat (usec): min=324 , max=4865.8K, avg=39188.97, stdev=376937.31
    clat percentiles (usec):
     |  1.00th=[  390],  5.00th=[  466], 10.00th=[  524], 20.00th=[  556],
     | 30.00th=[  596], 40.00th=[  644], 50.00th=[  780], 60.00th=[  988],
     | 70.00th=[ 1096], 80.00th=[ 1176], 90.00th=[ 1304], 95.00th=[ 1416],
     | 99.00th=[1433600], 99.50th=[3948544], 99.90th=[4816896], 99.95th=[4816896],
     | 99.99th=[4882432]
    bw (KB/s)  : min=    0, max= 1136, per=1.91%, avg=124.70, stdev=180.52
    lat (usec) : 500=6.89%, 750=41.50%, 1000=12.48%
    lat (msec) : 2=36.82%, 4=0.79%, 10=0.12%, 20=0.05%, 50=0.04%
    lat (msec) : 100=0.01%, 250=0.04%, 500=0.05%, 750=0.04%, 1000=0.05%
    lat (msec) : 2000=0.24%, >=2000=0.87%
  cpu          : usr=0.02%, sys=0.20%, ctx=16663, majf=0, minf=1892
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=16373/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=65492KB, aggrb=6512KB/s, minb=6512KB/s, maxb=6512KB/s, mint=10056msec, maxt=10056msec

Disk stats (read/write):
  hda: ios=195/16224, merge=0/8, ticks=106466/365017, in_queue=605154, util=99.06%
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=21907
  write: io=64456KB, bw=6423.8KB/s, iops=1605 , runt= 10034msec
    clat (usec): min=345 , max=5051.4K, avg=39762.14, stdev=372145.88
     lat (usec): min=346 , max=5051.4K, avg=39763.30, stdev=372145.89
    clat percentiles (usec):
     |  1.00th=[  438],  5.00th=[  510], 10.00th=[  532], 20.00th=[  564],
     | 30.00th=[  604], 40.00th=[  676], 50.00th=[  948], 60.00th=[ 1080],
     | 70.00th=[ 1144], 80.00th=[ 1224], 90.00th=[ 1320], 95.00th=[ 1448],
     | 99.00th=[1662976], 99.50th=[3981312], 99.90th=[4489216], 99.95th=[4489216],
     | 99.99th=[5013504]
    bw (KB/s)  : min=    0, max=  868, per=1.82%, avg=117.21, stdev=150.91
    lat (usec) : 500=3.79%, 750=40.57%, 1000=8.00%
    lat (msec) : 2=45.17%, 4=0.94%, 10=0.12%, 20=0.04%, 50=0.01%
    lat (msec) : 100=0.01%, 250=0.04%, 500=0.06%, 750=0.07%, 1000=0.04%
    lat (msec) : 2000=0.19%, >=2000=0.95%
  cpu          : usr=0.03%, sys=0.19%, ctx=16363, majf=0, minf=1893
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=16114/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=64456KB, aggrb=6423KB/s, minb=6423KB/s, maxb=6423KB/s, mint=10034msec, maxt=10034msec

Disk stats (read/write):
  hda: ios=193/15970, merge=0/8, ticks=122312/369994, in_queue=638854, util=99.07%
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=22046
  write: io=63828KB, bw=6347.1KB/s, iops=1586 , runt= 10055msec
    clat (usec): min=323 , max=4927.2K, avg=40179.50, stdev=381307.60
     lat (usec): min=324 , max=4927.2K, avg=40180.60, stdev=381307.62
    clat percentiles (usec):
     |  1.00th=[  434],  5.00th=[  494], 10.00th=[  524], 20.00th=[  564],
     | 30.00th=[  596], 40.00th=[  644], 50.00th=[  732], 60.00th=[  996],
     | 70.00th=[ 1096], 80.00th=[ 1192], 90.00th=[ 1304], 95.00th=[ 1432],
     | 99.00th=[1548288], 99.50th=[3981312], 99.90th=[4882432], 99.95th=[4882432],
     | 99.99th=[4947968]
    bw (KB/s)  : min=    0, max= 1197, per=1.84%, avg=117.02, stdev=166.48
    lat (usec) : 500=5.58%, 750=45.35%, 1000=9.36%
    lat (msec) : 2=37.38%, 4=0.81%, 10=0.11%, 20=0.03%, 50=0.03%
    lat (msec) : 100=0.02%, 250=0.04%, 500=0.05%, 750=0.06%, 1000=0.04%
    lat (msec) : 2000=0.24%, >=2000=0.90%
  cpu          : usr=0.03%, sys=0.21%, ctx=16285, majf=0, minf=1893
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=15957/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=63828KB, aggrb=6347KB/s, minb=6347KB/s, maxb=6347KB/s, mint=10055msec, maxt=10055msec

Disk stats (read/write):
  hda: ios=195/15807, merge=0/8, ticks=102338/368072, in_queue=601653, util=99.08%
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=22185
  write: io=63824KB, bw=6344.1KB/s, iops=1586 , runt= 10059msec
    clat (usec): min=330 , max=4650.3K, avg=40235.19, stdev=374620.76
     lat (usec): min=331 , max=4650.3K, avg=40236.32, stdev=374620.77
    clat percentiles (usec):
     |  1.00th=[  430],  5.00th=[  494], 10.00th=[  524], 20.00th=[  564],
     | 30.00th=[  596], 40.00th=[  644], 50.00th=[  788], 60.00th=[ 1048],
     | 70.00th=[ 1128], 80.00th=[ 1208], 90.00th=[ 1320], 95.00th=[ 1448],
     | 99.00th=[1712128], 99.50th=[4046848], 99.90th=[4554752], 99.95th=[4554752],
     | 99.99th=[4620288]
    bw (KB/s)  : min=    0, max= 1168, per=1.91%, avg=121.02, stdev=187.87
    lat (usec) : 500=5.68%, 750=42.29%, 1000=7.52%
    lat (msec) : 2=41.92%, 4=1.02%, 10=0.13%, 20=0.03%, 50=0.04%
    lat (msec) : 100=0.01%, 250=0.04%, 500=0.04%, 750=0.08%, 1000=0.06%
    lat (msec) : 2000=0.22%, >=2000=0.93%
  cpu          : usr=0.03%, sys=0.19%, ctx=16255, majf=0, minf=1894
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=15956/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=63824KB, aggrb=6344KB/s, minb=6344KB/s, maxb=6344KB/s, mint=10059msec, maxt=10059msec

Disk stats (read/write):
  hda: ios=196/15765, merge=0/8, ticks=109937/373028, in_queue=610033, util=99.08%
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=22323
  write: io=63504KB, bw=6316.1KB/s, iops=1579 , runt= 10053msec
    clat (usec): min=331 , max=4818.2K, avg=40403.20, stdev=381514.05
     lat (usec): min=332 , max=4818.2K, avg=40404.37, stdev=381514.05
    clat percentiles (usec):
     |  1.00th=[  442],  5.00th=[  506], 10.00th=[  532], 20.00th=[  564],
     | 30.00th=[  604], 40.00th=[  652], 50.00th=[  804], 60.00th=[ 1064],
     | 70.00th=[ 1128], 80.00th=[ 1208], 90.00th=[ 1320], 95.00th=[ 1432],
     | 99.00th=[1581056], 99.50th=[4112384], 99.90th=[4751360], 99.95th=[4751360],
     | 99.99th=[4816896]
    bw (KB/s)  : min=    0, max=  890, per=1.92%, avg=120.98, stdev=163.23
    lat (usec) : 500=4.54%, 750=43.58%, 1000=7.38%
    lat (msec) : 2=41.98%, 4=0.96%, 10=0.07%, 20=0.07%, 50=0.06%
    lat (msec) : 100=0.02%, 250=0.04%, 500=0.06%, 750=0.06%, 1000=0.04%
    lat (msec) : 2000=0.24%, >=2000=0.91%
  cpu          : usr=0.03%, sys=0.19%, ctx=16164, majf=0, minf=1893
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=15876/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=63504KB, aggrb=6316KB/s, minb=6316KB/s, maxb=6316KB/s, mint=10053msec, maxt=10053msec

Disk stats (read/write):
  hda: ios=196/15721, merge=0/8, ticks=103923/367260, in_queue=601056, util=99.06%
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=22463
  write: io=64844KB, bw=6450.3KB/s, iops=1612 , runt= 10053msec
    clat (usec): min=325 , max=4679.9K, avg=39566.40, stdev=377725.89
     lat (usec): min=326 , max=4679.9K, avg=39567.51, stdev=377725.91
    clat percentiles (usec):
     |  1.00th=[  422],  5.00th=[  486], 10.00th=[  524], 20.00th=[  556],
     | 30.00th=[  596], 40.00th=[  644], 50.00th=[  780], 60.00th=[ 1048],
     | 70.00th=[ 1112], 80.00th=[ 1192], 90.00th=[ 1304], 95.00th=[ 1416],
     | 99.00th=[1531904], 99.50th=[4046848], 99.90th=[4620288], 99.95th=[4685824],
     | 99.99th=[4685824]
    bw (KB/s)  : min=    0, max= 1066, per=1.87%, avg=120.39, stdev=165.86
    lat (usec) : 500=6.33%, 750=42.53%, 1000=7.35%
    lat (msec) : 2=41.36%, 4=0.92%, 10=0.12%, 20=0.06%, 50=0.02%
    lat (msec) : 250=0.04%, 500=0.05%, 750=0.05%, 1000=0.06%, 2000=0.22%
    lat (msec) : >=2000=0.88%
  cpu          : usr=0.03%, sys=0.20%, ctx=16495, majf=0, minf=1894
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=16211/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=64844KB, aggrb=6450KB/s, minb=6450KB/s, maxb=6450KB/s, mint=10053msec, maxt=10053msec

Disk stats (read/write):
  hda: ios=196/16054, merge=0/8, ticks=112395/361997, in_queue=604850, util=99.12%
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=22604
  write: io=64948KB, bw=6456.7KB/s, iops=1614 , runt= 10060msec
    clat (usec): min=315 , max=4901.2K, avg=39533.20, stdev=377112.68
     lat (usec): min=316 , max=4901.2K, avg=39534.34, stdev=377112.68
    clat percentiles (usec):
     |  1.00th=[  414],  5.00th=[  478], 10.00th=[  510], 20.00th=[  548],
     | 30.00th=[  588], 40.00th=[  636], 50.00th=[  764], 60.00th=[ 1020],
     | 70.00th=[ 1112], 80.00th=[ 1192], 90.00th=[ 1304], 95.00th=[ 1416],
     | 99.00th=[1466368], 99.50th=[4014080], 99.90th=[4816896], 99.95th=[4882432],
     | 99.99th=[4882432]
    bw (KB/s)  : min=    0, max=  902, per=1.96%, avg=126.30, stdev=172.82
    lat (usec) : 500=8.04%, 750=41.30%, 1000=9.07%
    lat (msec) : 2=39.23%, 4=0.83%, 10=0.11%, 20=0.07%, 50=0.02%
    lat (msec) : 100=0.01%, 250=0.02%, 500=0.04%, 750=0.06%, 1000=0.06%
    lat (msec) : 2000=0.25%, >=2000=0.88%
  cpu          : usr=0.02%, sys=0.20%, ctx=16530, majf=0, minf=1894
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=16237/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=64948KB, aggrb=6456KB/s, minb=6456KB/s, maxb=6456KB/s, mint=10060msec, maxt=10060msec

Disk stats (read/write):
  hda: ios=196/16057, merge=0/8, ticks=116703/357042, in_queue=612578, util=99.07%
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=22745
  write: io=63204KB, bw=6285.9KB/s, iops=1571 , runt= 10055msec
    clat (usec): min=344 , max=4721.3K, avg=40589.26, stdev=381622.77
     lat (usec): min=345 , max=4721.3K, avg=40590.39, stdev=381622.79
    clat percentiles (usec):
     |  1.00th=[  442],  5.00th=[  506], 10.00th=[  532], 20.00th=[  564],
     | 30.00th=[  596], 40.00th=[  644], 50.00th=[  764], 60.00th=[ 1032],
     | 70.00th=[ 1128], 80.00th=[ 1208], 90.00th=[ 1304], 95.00th=[ 1416],
     | 99.00th=[1499136], 99.50th=[3981312], 99.90th=[4685824], 99.95th=[4685824],
     | 99.99th=[4751360]
    bw (KB/s)  : min=    0, max=  894, per=1.93%, avg=121.31, stdev=172.71
    lat (usec) : 500=4.21%, 750=45.19%, 1000=7.40%
    lat (msec) : 2=40.74%, 4=0.83%, 10=0.11%, 20=0.09%, 50=0.05%
    lat (msec) : 250=0.04%, 500=0.05%, 750=0.08%, 1000=0.06%, 2000=0.22%
    lat (msec) : >=2000=0.92%
  cpu          : usr=0.03%, sys=0.21%, ctx=16092, majf=0, minf=1892
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=15801/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=63204KB, aggrb=6285KB/s, minb=6285KB/s, maxb=6285KB/s, mint=10055msec, maxt=10055msec

Disk stats (read/write):
  hda: ios=196/15653, merge=0/8, ticks=97250/375587, in_queue=601664, util=99.09%
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=22883
  write: io=64756KB, bw=6440.9KB/s, iops=1610 , runt= 10054msec
    clat (usec): min=330 , max=4531.2K, avg=39630.00, stdev=373669.82
     lat (usec): min=331 , max=4531.2K, avg=39631.14, stdev=373669.90
    clat percentiles (usec):
     |  1.00th=[  422],  5.00th=[  486], 10.00th=[  516], 20.00th=[  556],
     | 30.00th=[  588], 40.00th=[  628], 50.00th=[  700], 60.00th=[  980],
     | 70.00th=[ 1096], 80.00th=[ 1176], 90.00th=[ 1288], 95.00th=[ 1400],
     | 99.00th=[1613824], 99.50th=[4079616], 99.90th=[4423680], 99.95th=[4423680],
     | 99.99th=[4489216]
    bw (KB/s)  : min=    0, max= 1245, per=1.90%, avg=122.08, stdev=184.14
    lat (usec) : 500=7.02%, 750=45.92%, 1000=8.08%
    lat (msec) : 2=36.63%, 4=0.84%, 10=0.13%, 20=0.04%, 50=0.03%
    lat (msec) : 250=0.04%, 500=0.04%, 750=0.06%, 1000=0.03%, 2000=0.22%
    lat (msec) : >=2000=0.92%
  cpu          : usr=0.03%, sys=0.21%, ctx=16485, majf=0, minf=1894
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=16189/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=64756KB, aggrb=6440KB/s, minb=6440KB/s, maxb=6440KB/s, mint=10054msec, maxt=10054msec

Disk stats (read/write):
  hda: ios=196/16009, merge=0/8, ticks=112664/363237, in_queue=604218, util=99.04%
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=23023
  write: io=73144KB, bw=7286.8KB/s, iops=1821 , runt= 10038msec
    clat (usec): min=309 , max=4781.3K, avg=35050.18, stdev=357436.94
     lat (usec): min=309 , max=4781.3K, avg=35050.78, stdev=357436.95
    clat percentiles (usec):
     |  1.00th=[  358],  5.00th=[  390], 10.00th=[  410], 20.00th=[  454],
     | 30.00th=[  524], 40.00th=[  628], 50.00th=[  788], 60.00th=[  876],
     | 70.00th=[ 1012], 80.00th=[ 1096], 90.00th=[ 1240], 95.00th=[ 1368],
     | 99.00th=[929792], 99.50th=[3784704], 99.90th=[4685824], 99.95th=[4751360],
     | 99.99th=[4751360]
    bw (KB/s)  : min=    0, max= 1359, per=1.96%, avg=142.60, stdev=204.60
    lat (usec) : 500=27.37%, 750=21.22%, 1000=20.51%
    lat (msec) : 2=28.72%, 4=0.80%, 10=0.13%, 20=0.04%, 50=0.03%
    lat (msec) : 100=0.02%, 250=0.04%, 500=0.05%, 750=0.05%, 1000=0.05%
    lat (msec) : 2000=0.20%, >=2000=0.78%
  cpu          : usr=0.01%, sys=0.11%, ctx=18573, majf=0, minf=1895
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=18286/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=73144KB, aggrb=7286KB/s, minb=7286KB/s, maxb=7286KB/s, mint=10038msec, maxt=10038msec

Disk stats (read/write):
  hda: ios=196/18120, merge=0/8, ticks=125373/378559, in_queue=620785, util=99.12%
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=23161
  write: io=64008KB, bw=6363.1KB/s, iops=1590 , runt= 10058msec
    clat (usec): min=345 , max=4844.9K, avg=40088.22, stdev=381718.85
     lat (usec): min=346 , max=4844.9K, avg=40089.33, stdev=381718.88
    clat percentiles (usec):
     |  1.00th=[  434],  5.00th=[  490], 10.00th=[  524], 20.00th=[  556],
     | 30.00th=[  588], 40.00th=[  628], 50.00th=[  700], 60.00th=[  980],
     | 70.00th=[ 1096], 80.00th=[ 1176], 90.00th=[ 1288], 95.00th=[ 1400],
     | 99.00th=[1400832], 99.50th=[3883008], 99.90th=[4816896], 99.95th=[4816896],
     | 99.99th=[4816896]
    bw (KB/s)  : min=    0, max= 1251, per=1.85%, avg=117.99, stdev=168.05
    lat (usec) : 500=5.70%, 750=47.51%, 1000=7.59%
    lat (msec) : 2=36.73%, 4=0.92%, 10=0.09%, 20=0.07%, 50=0.05%
    lat (msec) : 100=0.01%, 250=0.04%, 500=0.05%, 750=0.06%, 1000=0.06%
    lat (msec) : 2000=0.22%, >=2000=0.91%
  cpu          : usr=0.03%, sys=0.21%, ctx=16278, majf=0, minf=1958
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=16002/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=64008KB, aggrb=6363KB/s, minb=6363KB/s, maxb=6363KB/s, mint=10058msec, maxt=10058msec

Disk stats (read/write):
  hda: ios=196/15855, merge=0/8, ticks=104937/367404, in_queue=605165, util=99.08%
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=23301
  write: io=64724KB, bw=6437.7KB/s, iops=1609 , runt= 10054msec
    clat (usec): min=320 , max=4577.5K, avg=39653.91, stdev=371245.93
     lat (usec): min=321 , max=4577.5K, avg=39655.06, stdev=371245.94
    clat percentiles (usec):
     |  1.00th=[  418],  5.00th=[  486], 10.00th=[  516], 20.00th=[  556],
     | 30.00th=[  596], 40.00th=[  660], 50.00th=[  900], 60.00th=[ 1048],
     | 70.00th=[ 1128], 80.00th=[ 1192], 90.00th=[ 1304], 95.00th=[ 1416],
     | 99.00th=[1630208], 99.50th=[3981312], 99.90th=[4358144], 99.95th=[4489216],
     | 99.99th=[4489216]
    bw (KB/s)  : min=    0, max= 1291, per=1.93%, avg=124.43, stdev=185.53
    lat (usec) : 500=6.83%, 750=38.92%, 1000=8.70%
    lat (msec) : 2=43.12%, 4=0.82%, 10=0.14%, 20=0.07%, 50=0.06%
    lat (msec) : 100=0.02%, 250=0.02%, 500=0.06%, 750=0.06%, 1000=0.06%
    lat (msec) : 2000=0.19%, >=2000=0.93%
  cpu          : usr=0.03%, sys=0.19%, ctx=16484, majf=0, minf=1894
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=16181/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=64724KB, aggrb=6437KB/s, minb=6437KB/s, maxb=6437KB/s, mint=10054msec, maxt=10054msec

Disk stats (read/write):
  hda: ios=196/15991, merge=0/8, ticks=109650/356236, in_queue=600722, util=99.08%
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=23440
  write: io=65732KB, bw=6533.4KB/s, iops=1633 , runt= 10061msec
    clat (usec): min=337 , max=4790.4K, avg=39066.73, stdev=368402.84
     lat (usec): min=338 , max=4790.4K, avg=39067.92, stdev=368402.86
    clat percentiles (usec):
     |  1.00th=[  426],  5.00th=[  490], 10.00th=[  516], 20.00th=[  556],
     | 30.00th=[  596], 40.00th=[  644], 50.00th=[  820], 60.00th=[ 1032],
     | 70.00th=[ 1112], 80.00th=[ 1192], 90.00th=[ 1288], 95.00th=[ 1400],
     | 99.00th=[1515520], 99.50th=[3850240], 99.90th=[4685824], 99.95th=[4685824],
     | 99.99th=[4816896]
    bw (KB/s)  : min=    0, max= 1131, per=1.90%, avg=124.09, stdev=172.69
    lat (usec) : 500=6.09%, 750=41.63%, 1000=8.56%
    lat (msec) : 2=41.37%, 4=0.85%, 10=0.10%, 20=0.02%, 50=0.03%
    lat (msec) : 100=0.01%, 250=0.03%, 500=0.05%, 750=0.06%, 1000=0.05%
    lat (msec) : 2000=0.27%, >=2000=0.88%
  cpu          : usr=0.04%, sys=0.20%, ctx=16746, majf=0, minf=1895
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=16433/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=65732KB, aggrb=6533KB/s, minb=6533KB/s, maxb=6533KB/s, mint=10061msec, maxt=10061msec

Disk stats (read/write):
  hda: ios=196/16267, merge=0/8, ticks=104219/382606, in_queue=605384, util=99.08%
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
...
128m: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
fio 2.0.7
Starting 64 processes

128m: (groupid=0, jobs=64): err= 0: pid=23579
  write: io=64840KB, bw=6449.9KB/s, iops=1612 , runt= 10053msec
    clat (usec): min=335 , max=4632.8K, avg=39578.47, stdev=375190.58
     lat (usec): min=336 , max=4632.8K, avg=39579.60, stdev=375190.59
    clat percentiles (usec):
     |  1.00th=[  426],  5.00th=[  482], 10.00th=[  516], 20.00th=[  548],
     | 30.00th=[  588], 40.00th=[  620], 50.00th=[  700], 60.00th=[ 1004],
     | 70.00th=[ 1096], 80.00th=[ 1176], 90.00th=[ 1288], 95.00th=[ 1400],
     | 99.00th=[1449984], 99.50th=[4145152], 99.90th=[4489216], 99.95th=[4554752],
     | 99.99th=[4554752]
    bw (KB/s)  : min=    0, max= 1341, per=1.95%, avg=126.02, stdev=179.69
    lat (usec) : 500=6.95%, 750=45.50%, 1000=7.31%
    lat (msec) : 2=37.84%, 4=0.88%, 10=0.13%, 20=0.04%, 50=0.04%
    lat (msec) : 100=0.01%, 250=0.03%, 500=0.03%, 750=0.08%, 1000=0.04%
    lat (msec) : 2000=0.23%, >=2000=0.89%
  cpu          : usr=0.03%, sys=0.20%, ctx=16494, majf=0, minf=1892
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=16210/d=0, short=r=0/w=0/d=0

Run status group 0 (all jobs):
  WRITE: io=64840KB, aggrb=6449KB/s, minb=6449KB/s, maxb=6449KB/s, mint=10053msec, maxt=10053msec

Disk stats (read/write):
  hda: ios=196/16021, merge=0/10, ticks=114269/366313, in_queue=599901, util=99.09%
