顺序读：
# fio -ioengine=libaio -direct=1 -thread -norandommap -filename=/dev/nvme0n1p1 -stonewall -group_reporting -bs=128k -rw=read -numjobs=1 -iodepth 64 -ramp_time=5 -runtime=60 -name=mytest
mytest: (g=0): rw=read, bs=128K-128K/128K-128K/128K-128K, ioengine=libaio, iodepth=64
fio-2.9
Starting 1 thread
Jobs: 1 (f=1): [R(1)] [100.0% done] [5087MB/0KB/0KB /s] [40.7K/0/0 iops] [eta 00m:00s]
mytest: (groupid=0, jobs=1): err= 0: pid=187860: Thu Jun 14 08:14:30 2018
read : io=300341MB, bw=5005.6MB/s, iops=40043, runt= 60002msec
slat (usec): min=5, max=628, avg=12.93, stdev= 5.94
clat (usec): min=183, max=9266, avg=1584.89, stdev=618.16
lat (usec): min=195, max=9282, avg=1597.89, stdev=618.15
clat percentiles (usec):
| 1.00th=[ 502], 5.00th=[ 724], 10.00th=[ 876], 20.00th=[ 1064],
| 30.00th=[ 1224], 40.00th=[ 1368], 50.00th=[ 1496], 60.00th=[ 1656],
| 70.00th=[ 1832], 80.00th=[ 2064], 90.00th=[ 2416], 95.00th=[ 2704],
| 99.00th=[ 3344], 99.50th=[ 3632], 99.90th=[ 4512], 99.95th=[ 4960],
| 99.99th=[ 6048]
bw (MB /s): min= 0, max= 5197, per=99.17%, avg=4964.15, stdev=493.84
lat (usec) : 250=0.01%, 500=0.96%, 750=4.66%, 1000=10.49%
lat (msec) : 2=61.55%, 4=22.09%, 10=0.24%
cpu : usr=2.68%, sys=54.73%, ctx=734114, majf=0, minf=0
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=106.6%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued : total=r=2402662/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: io=300341MB, aggrb=5005.6MB/s, minb=5005.6MB/s, maxb=5005.6MB/s, mint=60002msec, maxt=60002msec
Disk stats (read/write):
nvme0n1: ios=2560393/2, merge=0/0, ticks=4038142/0, in_queue=4037737, util=99.91%
顺序写：
# fio -ioengine=libaio -direct=1 -thread -norandommap -filename=/data/test -stonewall -group_reporting -bs=128k -rw=write -numjobs=1 -iodepth 64 -ramp_time=5 -runtime=60 -name=mytest
mytest: (g=0): rw=write, bs=128K-128K/128K-128K/128K-128K, ioengine=libaio, iodepth=64
fio-2.9
Starting 1 thread
Jobs: 1 (f=1): [W(1)] [100.0% done] [0KB/2684MB/0KB /s] [0/21.5K/0 iops] [eta 00m:00s]
mytest: (groupid=0, jobs=1): err= 0: pid=187159: Thu Jun 14 08:09:46 2018
write: io=160806MB, bw=2679.1MB/s, iops=21438, runt= 60003msec
slat (usec): min=6, max=327, avg=24.64, stdev=13.02
clat (usec): min=159, max=27258, avg=2959.86, stdev=1832.90
lat (usec): min=179, max=27280, avg=2984.50, stdev=1832.65
clat percentiles (usec):
| 1.00th=[ 516], 5.00th=[ 788], 10.00th=[ 1012], 20.00th=[ 1384],
| 30.00th=[ 1736], 40.00th=[ 2160], 50.00th=[ 2640], 60.00th=[ 3184],
| 70.00th=[ 3728], 80.00th=[ 4384], 90.00th=[ 5280], 95.00th=[ 6048],
| 99.00th=[ 7648], 99.50th=[ 9024], 99.90th=[17536], 99.95th=[19072],
| 99.99th=[22144]
bw (MB /s): min= 0, max= 2811, per=99.21%, avg=2658.72, stdev=252.84
lat (usec) : 250=0.05%, 500=0.84%, 750=3.34%, 1000=5.44%
lat (msec) : 2=26.80%, 4=38.16%, 10=24.95%, 20=0.38%, 50=0.03%
cpu : usr=8.85%, sys=48.58%, ctx=229774, majf=0, minf=0
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=108.4%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued : total=r=0/w=1286386/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
WRITE: io=160806MB, aggrb=2679.1MB/s, minb=2679.1MB/s, maxb=2679.1MB/s, mint=60003msec, maxt=60003msec
Disk stats (read/write):
nvme0n1: ios=0/1393588, merge=0/0, ticks=0/3874905, in_queue=3874675, util=99.91%
随机读
$ fio --filename=/dev/nvme0n1p1 --direct=1 --iodepth 64 --thread --rw=randread --ioengine=libaio --bs=4k --size=20G --numjobs=20 --runtime=1000 --group_reporting --name=mytest
mytest: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=64
...
fio-2.9
Starting 20 threads
^Cbs: 18 (f=18): [r(1),_(1),r(17),_(1)] [33.9% done] [1749MB/0KB/0KB /s] [448K/0/0 iops] [eta 05m:08s]
fio: terminating on signal 2
mytest: (groupid=0, jobs=20): err= 0: pid=168100: Thu Jun 14 05:59:39 2018
read : io=266177MB, bw=1690.2MB/s, iops=432676, runt=157488msec
slat (usec): min=1, max=7848, avg= 3.65, stdev= 3.68
clat (usec): min=87, max=814160, avg=2949.84, stdev=5308.23
lat (usec): min=93, max=814162, avg=2953.60, stdev=5308.73
clat percentiles (usec):
| 1.00th=[ 310], 5.00th=[ 462], 10.00th=[ 612], 20.00th=[ 860],
| 30.00th=[ 1048], 40.00th=[ 1208], 50.00th=[ 1384], 60.00th=[ 1592],
| 70.00th=[ 1912], 80.00th=[ 2480], 90.00th=[ 6176], 95.00th=[15424],
| 99.00th=[25472], 99.50th=[33024], 99.90th=[39680], 99.95th=[44288],
| 99.99th=[54528]
bw (KB /s): min= 2, max=186176, per=5.01%, avg=86647.40, stdev=43067.81
lat (usec) : 100=0.01%, 250=0.19%, 500=6.05%, 750=8.86%, 1000=12.32%
lat (msec) : 2=44.73%, 4=15.36%, 10=4.59%, 20=6.40%, 50=1.47%
lat (msec) : 100=0.02%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
cpu : usr=3.74%, sys=12.97%, ctx=51119362, majf=0, minf=1310
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued : total=r=68141360/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: io=266177MB, aggrb=1690.2MB/s, minb=1690.2MB/s, maxb=1690.2MB/s, mint=157488msec, maxt=157488msec
Disk stats (read/write):
nvme0n1: ios=68063283/5, merge=0/0, ticks=200519809/0, in_queue=203712757, util=100.00%
随机写
$ fio --filename=/data/test --direct=1 --iodepth 64 --thread --rw=randwrite --ioengine=libaio --bs=4k --size=20G --numjobs=20 --runtime=1000 --group_reporting --name=mytest
mytest: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=64
...
fio-2.9
Starting 20 threads
mytest: Laying out IO file(s) (1 file(s) / 20480MB)
Jobs: 2 (f=2): [_(3),w(1),_(9),w(1),_(6)] [91.3% done] [0KB/298.9MB/0KB /s] [0/76.5K/0 iops] [eta 01m:35s]
mytest: (groupid=0, jobs=20): err= 0: pid=175107: Thu Jun 14 03:59:52 2018
write: io=407641MB, bw=417422KB/s, iops=104355, runt=1000006msec
slat (usec): min=2, max=139120, avg=55.93, stdev=132.11
clat (usec): min=0, max=251126, avg=11612.57, stdev=17983.59
lat (usec): min=9, max=251150, avg=11668.70, stdev=18003.75
clat percentiles (usec):
| 1.00th=[ 73], 5.00th=[ 197], 10.00th=[ 354], 20.00th=[ 916],
| 30.00th=[ 2128], 40.00th=[ 3728], 50.00th=[ 5024], 60.00th=[ 6880],
| 70.00th=[ 9664], 80.00th=[16064], 90.00th=[33024], 95.00th=[52480],
| 99.00th=[87552], 99.50th=[97792], 99.90th=[121344], 99.95th=[136192],
| 99.99th=[160768]
bw (KB /s): min= 4166, max=170168, per=5.26%, avg=21946.57, stdev=9724.28
lat (usec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.05%, 50=0.44%
lat (usec) : 100=1.16%, 250=5.14%, 500=6.80%, 750=4.26%, 1000=3.06%
lat (msec) : 2=8.24%, 4=12.82%, 10=28.96%, 20=12.74%, 50=11.04%
lat (msec) : 100=4.87%, 250=0.40%, 500=0.01%
cpu : usr=1.33%, sys=8.67%, ctx=187069324, majf=0, minf=30
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued : total=r=0/w=104356161/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
WRITE: io=407641MB, aggrb=417422KB/s, minb=417422KB/s, maxb=417422KB/s, mint=1000006msec, maxt=1000006msec
Disk stats (read/write):
nvme0n1: ios=0/104367313, merge=0/4964, ticks=0/1004448358, in_queue=1013838499, util=90.64%
网友评论