Linux 3.10 ZFS File-System

ZFS file-system benchmarks on the Linux 3.10 kernel. Benchmarks by Michael Larabel for a future Phoronix article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1308038-SO-ZFSLINUX328
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
EXT4
July 31 2013
 
Btrfs
July 31 2013
 
ZFS
August 01 2013
 
Invert Hiding All Results Option
 

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

EXT4

Processor: Intel Core i7 720Q @ 1.60GHz (8 Cores), Motherboard: LENOVO 4318CTO, Chipset: Intel Core DMI, Memory: 2 x 2048 MB DDR3-1066MHz, Disk: 160GB INTEL SSDSA2M160, Graphics: NVIDIA Quadro FX 880M 1024MB (405/324MHz), Audio: Conexant CX20585, Network: Intel 82577LM Gigabit Connection + Intel Centrino Ultimate-N 6300

OS: Ubuntu 13.10, Kernel: 3.10.4+ (x86_64), Desktop: Xfce 4.10, Display Server: X Server 1.14.2, Display Driver: nouveau 1.0.8, OpenGL: 3.0 Mesa 9.1.4 Gallium 0.4, Compiler: GCC 4.8, File-System: ext4, Screen Resolution: 1600x900

Compiler Notes: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64/jre --with-jvm-jar-dir=/usr/lib/jvm-exports/java-1.5.0-gcj-4.8-amd64 --with-jvm-root-dir=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v
Disk Notes: DEADLINE / data=ordered,relatime,rw
System Notes: Disk Scheduler: DEADLINE. Python 2.7.5+.

Btrfs

OS: Ubuntu 13.10, Kernel: 3.10.4+ (x86_64), Desktop: Xfce 4.10, Display Server: X Server 1.14.2, Display Driver: nouveau 1.0.8, OpenGL: 3.0 Mesa 9.1.4 Gallium 0.4, Compiler: GCC 4.8, File-System: btrfs, Screen Resolution: 1600x900

Compiler Notes: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64/jre --with-jvm-jar-dir=/usr/lib/jvm-exports/java-1.5.0-gcj-4.8-amd64 --with-jvm-root-dir=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v
Disk Notes: DEADLINE / relatime,rw,space_cache,ssd
System Notes: Disk Scheduler: DEADLINE. Python 2.7.5+.

ZFS

OS: Ubuntu 13.10, Kernel: 3.10.4+ (x86_64), Desktop: Xfce 4.10, Display Server: X Server 1.14.2, Display Driver: nouveau 1.0.8, OpenGL: 3.0 Mesa 9.1.4 Gallium 0.4, Compiler: GCC 4.8, File-System: zfs, Screen Resolution: 1600x900

Compiler Notes: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64/jre --with-jvm-jar-dir=/usr/lib/jvm-exports/java-1.5.0-gcj-4.8-amd64 --with-jvm-root-dir=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v
System Notes: Python 2.7.5+.

Linux 3.10 ZFS File-SystemOpenBenchmarking.orgPhoronix Test SuiteIntel Core i7 720Q @ 1.60GHz (8 Cores)LENOVO 4318CTOIntel Core DMI2 x 2048 MB DDR3-1066MHz160GB INTEL SSDSA2M160NVIDIA Quadro FX 880M 1024MB (405/324MHz)Conexant CX20585Intel 82577LM Gigabit Connection + Intel Centrino Ultimate-N 6300Ubuntu 13.103.10.4+ (x86_64)Xfce 4.10X Server 1.14.2nouveau 1.0.83.0 Mesa 9.1.4 Gallium 0.4GCC 4.8ext4btrfszfs1600x900ProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemsScreen ResolutionLinux 3.10 ZFS File-System BenchmarksSystem Logs- --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64/jre --with-jvm-jar-dir=/usr/lib/jvm-exports/java-1.5.0-gcj-4.8-amd64 --with-jvm-root-dir=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - EXT4: DEADLINE / data=ordered,relatime,rw- Btrfs: DEADLINE / relatime,rw,space_cache,ssd- EXT4: Disk Scheduler: DEADLINE. Python 2.7.5+.- Btrfs: Disk Scheduler: DEADLINE. Python 2.7.5+.- ZFS: Python 2.7.5+.

EXT4BtrfsZFSLogarithmic Result OverviewPhoronix Test SuiteFlexible IO TesterFS-MarkFS-MarkCompile BenchFS-MarkCompile BenchDbenchI.I.F.S.A.P5.F.1.S.4.T4.F.3.S.D.1.SInitial Create1.F.1.SCompile1

Linux 3.10 ZFS File-Systemfio: Intel IOMeter File Server Access Patternfs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizedbench: 1compilebench: Compilecompilebench: Initial CreateEXT4BtrfsZFS105.0377.3396.6775.23185.02127.58110.89671.1583.3397.0081.43226.11106.6863.53120.2847.9041.9239.50185.5088.4758.40OpenBenchmarking.org

Flexible IO Tester

OpenBenchmarking.orgSeconds (Run Time), Fewer Is BetterFlexible IO Tester 1.57Test: Intel IOMeter File Server Access PatternEXT4BtrfsZFS140280420560700SE +/- 0.15, N = 3SE +/- 2.91, N = 3SE +/- 0.52, N = 3105.03671.15120.281. (CC) gcc options: -std=gnu99 -O2 -rdynamic -lm -lpthread -ldl -lrt -laio
OpenBenchmarking.orgSeconds (Run Time), Fewer Is BetterFlexible IO Tester 1.57Test: Intel IOMeter File Server Access PatternEXT4BtrfsZFS120240360480600Min: 104.72 / Avg: 105.03 / Max: 105.19Min: 665.34 / Avg: 671.15 / Max: 674.4Min: 119.74 / Avg: 120.28 / Max: 121.311. (CC) gcc options: -std=gnu99 -O2 -rdynamic -lm -lpthread -ldl -lrt -laio

FS-Mark

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeEXT4BtrfsZFS20406080100SE +/- 0.43, N = 3SE +/- 1.34, N = 3SE +/- 0.80, N = 377.3383.3347.901. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeEXT4BtrfsZFS1632486480Min: 76.9 / Avg: 77.33 / Max: 78.2Min: 81.8 / Avg: 83.33 / Max: 86Min: 46.3 / Avg: 47.9 / Max: 48.81. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsEXT4BtrfsZFS20406080100SE +/- 0.13, N = 3SE +/- 0.12, N = 3SE +/- 1.43, N = 696.6797.0041.921. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsEXT4BtrfsZFS20406080100Min: 96.4 / Avg: 96.67 / Max: 96.8Min: 96.8 / Avg: 97 / Max: 97.2Min: 39.7 / Avg: 41.92 / Max: 48.81. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeEXT4BtrfsZFS20406080100SE +/- 0.07, N = 3SE +/- 0.73, N = 3SE +/- 0.86, N = 675.2381.4339.501. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeEXT4BtrfsZFS1632486480Min: 75.1 / Avg: 75.23 / Max: 75.3Min: 80.3 / Avg: 81.43 / Max: 82.8Min: 37.5 / Avg: 39.5 / Max: 43.21. (CC) gcc options: -static

Dbench

Dbench is a benchmark designed by the Samba project as a free alternative to netbench, but dbench contains only file-system calls for testing the disk performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 1EXT4BtrfsZFS50100150200250SE +/- 0.08, N = 3SE +/- 0.22, N = 3SE +/- 1.73, N = 3185.02226.11185.501. (CC) gcc options: -lpopt -O2
OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 1EXT4BtrfsZFS4080120160200Min: 184.87 / Avg: 185.02 / Max: 185.1Min: 225.67 / Avg: 226.11 / Max: 226.38Min: 183.14 / Avg: 185.5 / Max: 188.871. (CC) gcc options: -lpopt -O2

Compile Bench

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileEXT4BtrfsZFS306090120150SE +/- 0.84, N = 3SE +/- 2.61, N = 6SE +/- 1.85, N = 6127.58106.6888.47
OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileEXT4BtrfsZFS20406080100Min: 126.06 / Avg: 127.58 / Max: 128.95Min: 100.1 / Avg: 106.68 / Max: 116.12Min: 79.36 / Avg: 88.47 / Max: 91.64

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateEXT4BtrfsZFS20406080100SE +/- 0.89, N = 3SE +/- 0.36, N = 3SE +/- 0.30, N = 3110.8963.5358.40
OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateEXT4BtrfsZFS20406080100Min: 109.22 / Avg: 110.89 / Max: 112.24Min: 63.02 / Avg: 63.53 / Max: 64.22Min: 57.86 / Avg: 58.4 / Max: 58.89

EXT4

Processor: Intel Core i7 720Q @ 1.60GHz (8 Cores), Motherboard: LENOVO 4318CTO, Chipset: Intel Core DMI, Memory: 2 x 2048 MB DDR3-1066MHz, Disk: 160GB INTEL SSDSA2M160, Graphics: NVIDIA Quadro FX 880M 1024MB (405/324MHz), Audio: Conexant CX20585, Network: Intel 82577LM Gigabit Connection + Intel Centrino Ultimate-N 6300

OS: Ubuntu 13.10, Kernel: 3.10.4+ (x86_64), Desktop: Xfce 4.10, Display Server: X Server 1.14.2, Display Driver: nouveau 1.0.8, OpenGL: 3.0 Mesa 9.1.4 Gallium 0.4, Compiler: GCC 4.8, File-System: ext4, Screen Resolution: 1600x900

Compiler Notes: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64/jre --with-jvm-jar-dir=/usr/lib/jvm-exports/java-1.5.0-gcj-4.8-amd64 --with-jvm-root-dir=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v
Disk Notes: DEADLINE / data=ordered,relatime,rw
System Notes: Disk Scheduler: DEADLINE. Python 2.7.5+.

Testing initiated at 31 July 2013 10:03 by user root.

Btrfs

Processor: Intel Core i7 720Q @ 1.60GHz (8 Cores), Motherboard: LENOVO 4318CTO, Chipset: Intel Core DMI, Memory: 2 x 2048 MB DDR3-1066MHz, Disk: 160GB INTEL SSDSA2M160, Graphics: NVIDIA Quadro FX 880M 1024MB (405/324MHz), Audio: Conexant CX20585, Network: Intel 82577LM Gigabit Connection + Intel Centrino Ultimate-N 6300

OS: Ubuntu 13.10, Kernel: 3.10.4+ (x86_64), Desktop: Xfce 4.10, Display Server: X Server 1.14.2, Display Driver: nouveau 1.0.8, OpenGL: 3.0 Mesa 9.1.4 Gallium 0.4, Compiler: GCC 4.8, File-System: btrfs, Screen Resolution: 1600x900

Compiler Notes: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64/jre --with-jvm-jar-dir=/usr/lib/jvm-exports/java-1.5.0-gcj-4.8-amd64 --with-jvm-root-dir=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v
Disk Notes: DEADLINE / relatime,rw,space_cache,ssd
System Notes: Disk Scheduler: DEADLINE. Python 2.7.5+.

Testing initiated at 31 July 2013 11:12 by user root.

ZFS

Processor: Intel Core i7 720Q @ 1.60GHz (8 Cores), Motherboard: LENOVO 4318CTO, Chipset: Intel Core DMI, Memory: 2 x 2048 MB DDR3-1066MHz, Disk: 160GB INTEL SSDSA2M160, Graphics: NVIDIA Quadro FX 880M 1024MB (405/324MHz), Audio: Conexant CX20585, Network: Intel 82577LM Gigabit Connection + Intel Centrino Ultimate-N 6300

OS: Ubuntu 13.10, Kernel: 3.10.4+ (x86_64), Desktop: Xfce 4.10, Display Server: X Server 1.14.2, Display Driver: nouveau 1.0.8, OpenGL: 3.0 Mesa 9.1.4 Gallium 0.4, Compiler: GCC 4.8, File-System: zfs, Screen Resolution: 1600x900

Compiler Notes: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64/jre --with-jvm-jar-dir=/usr/lib/jvm-exports/java-1.5.0-gcj-4.8-amd64 --with-jvm-root-dir=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v
System Notes: Python 2.7.5+.

Testing initiated at 1 August 2013 20:17 by user root.