ZFS-on-LinuxTest


ZFS-Server:Xeon E5640,Mem24G,HDD:ST3250310NS x4
ext4/mdadm-server:Core2Quad E6600,Mem4G
Version 1.96 Sequential Output Sequential Input Random
Seeks		 Sequential Create Random Create
Size Per Char Block Rewrite Per Char Block Num Files Create Read Delete Create Read Delete
K/sec % CPU K/sec % CPU K/sec % CPU K/sec % CPU K/sec % CPU /sec % CPU /sec % CPU /sec % CPU /sec % CPU /sec % CPU /sec % CPU /sec % CPU
ext4(HDDx1) 1G 440 97 105532 68 121050 13 4370 96 +++++ +++ 1983 3 16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
Latency 18253us 551us 1677us 2012us 38us 29577us Latency 627us 334us 362us 295us 12us 173us
ZFS(HDDx4-raidz) 1G 188 99 184525 47 113893 25 480 99 +++++ +++ +++++ +++ 16 19484 86 +++++ +++ 32490 90 18200 97 +++++ +++ 32650 89
Latency 44151us 6666us 1310ms 35431us 186us 162ms Latency 11625us 252us 286us 22129us 8us 87us
ZFS-fuse(RAIDz) 1G 51 15 69073 3 32891 2 +++++ +++ +++++ +++ 764.5 1 16 12911 16 +++++ +++ 18930 13 13382 15 +++++ +++ 21793 12
Latency 244ms 651ms 625ms 1204us 9us 758ms Latency 8635us 324us 488us 17245us 39us 145us
ext4+mdadm-raid10(HDDx6) 1G 260 99 208165 44 215911 37 2904 98 +++++ +++ 9213 104 16 4530 8 +++++ +++ 24115 32 +++++ +++ +++++ +++ +++++ +++
Latency 34797us 29795us 24304us 4141us 49us 7745us Latency 762us 725us 530us 413us 26us 55us
cat rand.fio
[random-rw]
rw=randrw
size=4G
directory=/zfs1/


root@debian:/# fio rand.fio
random-read: (g=0): rw=randrw, bs=4K-4K/4K-4K, ioengine=sync, iodepth=1
Starting 1 process
Jobs: 1 (f=1): [m] [100.0% done] [11902K/11739K /s] [2906/2866 iops] [eta 00m:00s]
random-rw: (groupid=0, jobs=1): err= 0: pid=21428
  read : io=2048MB, bw=6317KB/s, iops=1579, runt=331927msec
    clat (usec): min=2, max=7607, avg=12.59, stdev=62.07
    bw (KB/s) : min= 4248, max=17496, per=100.88%, avg=6372.51, stdev=1032.93
  write: io=2048MB, bw=6319KB/s, iops=1579, runt=331927msec
    clat (usec): min=6, max=1831K, avg=618.44, stdev=26667.55
    bw (KB/s) : min= 4206, max=17186, per=100.88%, avg=6373.74, stdev=992.05
  cpu          : usr=0.32%, sys=6.10%, ctx=1388, majf=0, minf=221
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued r/w: total=524223/524353, short=0/0
     lat (usec): 4=3.57%, 10=72.31%, 20=15.76%, 50=0.44%, 100=0.06%
     lat (usec): 250=7.64%, 500=0.01%, 750=0.02%, 1000=0.07%
     lat (msec): 2=0.09%, 4=0.01%, 10=0.02%, 1000=0.01%, 2000=0.02%

Run status group 0 (all jobs):
   READ: io=2048MB, aggrb=6317KB/s, minb=6468KB/s, maxb=6468KB/s, mint=331927msec, maxt=331927msec
  WRITE: io=2048MB, aggrb=6318KB/s, minb=6470KB/s, maxb=6470KB/s, mint=331927msec, maxt=331927msec