ZFS System76 Tests

ZFS On Linux 0.6.2 tests by Michael Larabel for a future article on Phoronix.com. Native ZFS Linux kernel module compared to EXT4 and Btrfs on Linux 3.11 kernel with Intel Core i7 Haswell CPU and high-end Intel SSD drive.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1308261-SO-ZFSSYSTEM18
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
Btrfs
August 26 2013
 
EXT4
August 26 2013
 
ZFS On Linux 0.6.2
August 26 2013
 
Invert Hiding All Results Option
 

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

Btrfs

Processor: Intel Core i7-4900MQ @ 2.80GHz (8 Cores), Motherboard: System76 Gazelle Professional, Chipset: Intel Xeon E3-1200 v3/4th, Memory: 8192MB, Disk: 120GB INTEL SSDSC2CW12, Graphics: Intel 4th Gen Core IGP (1300MHz), Audio: Intel Haswell HDMI, Network: Realtek RTL8111/8168/8411 + Intel Centrino Advanced-N 6235

OS: Ubuntu 13.10, Kernel: 3.11.0-3-generic (x86_64), Desktop: Xfce 4.10, Display Server: X Server 1.14.2.901 (1.14.3 RC 1), Display Driver: intel 2.21.14, OpenGL: 3.1 Mesa 9.1.6, Compiler: GCC 4.8, File-System: btrfs, Screen Resolution: 1920x1080

Compiler Notes: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64/jre --with-jvm-jar-dir=/usr/lib/jvm-exports/java-1.5.0-gcj-4.8-amd64 --with-jvm-root-dir=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v
Disk Notes: DEADLINE / relatime,rw,space_cache,ssd
System Notes: Disk Scheduler: DEADLINE. Python 2.7.5+.

EXT4

OS: Ubuntu 13.10, Kernel: 3.11.0-3-generic (x86_64), Desktop: Xfce 4.10, Display Server: X Server 1.14.2.901 (1.14.3 RC 1), Display Driver: intel 2.21.14, OpenGL: 3.1 Mesa 9.1.6, Compiler: GCC 4.8, File-System: ext4, Screen Resolution: 1920x1080

Compiler Notes: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64/jre --with-jvm-jar-dir=/usr/lib/jvm-exports/java-1.5.0-gcj-4.8-amd64 --with-jvm-root-dir=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v
Disk Notes: DEADLINE / data=ordered,relatime,rw
System Notes: Disk Scheduler: DEADLINE. Python 2.7.5+.

ZFS On Linux 0.6.2

OS: Ubuntu 13.10, Kernel: 3.11.0-3-generic (x86_64), Desktop: Xfce 4.10, Display Server: X Server 1.14.2.901 (1.14.3 RC 1), Display Driver: intel 2.21.14, OpenGL: 3.1 Mesa 9.1.6, Compiler: GCC 4.8, File-System: zfs, Screen Resolution: 1920x1080

Compiler Notes: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64/jre --with-jvm-jar-dir=/usr/lib/jvm-exports/java-1.5.0-gcj-4.8-amd64 --with-jvm-root-dir=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v
System Notes: Python 2.7.5+.

ZFS System76 TestsOpenBenchmarking.orgPhoronix Test SuiteIntel Core i7-4900MQ @ 2.80GHz (8 Cores)System76 Gazelle ProfessionalIntel Xeon E3-1200 v3/4th8192MB120GB INTEL SSDSC2CW12Intel 4th Gen Core IGP (1300MHz)Intel Haswell HDMIRealtek RTL8111/8168/8411 + Intel Centrino Advanced-N 6235Ubuntu 13.103.11.0-3-generic (x86_64)Xfce 4.10X Server 1.14.2.901 (1.14.3 RC 1)intel 2.21.143.1 Mesa 9.1.6GCC 4.8btrfsext4zfs1920x1080ProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemsScreen ResolutionZFS System76 Tests PerformanceSystem Logs- --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64/jre --with-jvm-jar-dir=/usr/lib/jvm-exports/java-1.5.0-gcj-4.8-amd64 --with-jvm-root-dir=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Btrfs: DEADLINE / relatime,rw,space_cache,ssd- EXT4: DEADLINE / data=ordered,relatime,rw- Btrfs: Disk Scheduler: DEADLINE. Python 2.7.5+.- EXT4: Disk Scheduler: DEADLINE. Python 2.7.5+.- ZFS On Linux 0.6.2: Python 2.7.5+.

BtrfsEXT4ZFS On Linux 0.6.2Result OverviewPhoronix Test Suite100%190%279%369%458%Flexible IO TesterPostMarkCompile BenchFS-MarkCompile BenchFS-MarkFS-MarkDbenchI.I.F.S.A.PD.T.PInitial Create5.F.1.S.4.TCompile4.F.3.S.D.1.S1.F.1.S1

ZFS System76 Testsfio: Intel IOMeter File Server Access Patternfs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizedbench: 1compilebench: Compilecompilebench: Initial Createpostmark: Disk Transaction PerformanceBtrfsEXT4ZFS On Linux 0.6.2169.58216.37392.83218.50327.85454.35236.21531962.57257.50408.93248.48322.31726.13374.66520837.02203.03208.53187.93282.88531.58139.461663OpenBenchmarking.org

Flexible IO Tester

OpenBenchmarking.orgSeconds (Run Time), Fewer Is BetterFlexible IO Tester 1.57Test: Intel IOMeter File Server Access PatternBtrfsEXT4ZFS On Linux 0.6.24080120160200SE +/- 1.33, N = 3SE +/- 0.48, N = 3SE +/- 0.22, N = 3169.5862.5737.021. (CC) gcc options: -std=gnu99 -O2 -rdynamic -lm -lpthread -ldl -lrt -laio
OpenBenchmarking.orgSeconds (Run Time), Fewer Is BetterFlexible IO Tester 1.57Test: Intel IOMeter File Server Access PatternBtrfsEXT4ZFS On Linux 0.6.2306090120150Min: 167.76 / Avg: 169.58 / Max: 172.17Min: 61.66 / Avg: 62.57 / Max: 63.28Min: 36.62 / Avg: 37.02 / Max: 37.391. (CC) gcc options: -std=gnu99 -O2 -rdynamic -lm -lpthread -ldl -lrt -laio

FS-Mark

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeBtrfsEXT4ZFS On Linux 0.6.260120180240300SE +/- 7.27, N = 6SE +/- 0.74, N = 3SE +/- 3.47, N = 3216.37257.50203.031. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeBtrfsEXT4ZFS On Linux 0.6.250100150200250Min: 200.6 / Avg: 216.37 / Max: 248.4Min: 256.1 / Avg: 257.5 / Max: 258.6Min: 198.7 / Avg: 203.03 / Max: 209.91. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsBtrfsEXT4ZFS On Linux 0.6.290180270360450SE +/- 0.23, N = 3SE +/- 1.09, N = 3SE +/- 0.29, N = 3392.83408.93208.531. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsBtrfsEXT4ZFS On Linux 0.6.270140210280350Min: 392.4 / Avg: 392.83 / Max: 393.2Min: 406.8 / Avg: 408.93 / Max: 410.4Min: 208 / Avg: 208.53 / Max: 2091. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeBtrfsEXT4ZFS On Linux 0.6.250100150200250SE +/- 4.59, N = 6SE +/- 3.86, N = 4SE +/- 0.35, N = 3218.50248.48187.931. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeBtrfsEXT4ZFS On Linux 0.6.24080120160200Min: 205.9 / Avg: 218.5 / Max: 236.1Min: 239.3 / Avg: 248.48 / Max: 255.9Min: 187.4 / Avg: 187.93 / Max: 188.61. (CC) gcc options: -static

Dbench

Dbench is a benchmark designed by the Samba project as a free alternative to netbench, but dbench contains only file-system calls for testing the disk performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 1BtrfsEXT4ZFS On Linux 0.6.270140210280350SE +/- 0.45, N = 3SE +/- 1.05, N = 3SE +/- 1.40, N = 3327.85322.31282.881. (CC) gcc options: -lpopt -O2
OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 1BtrfsEXT4ZFS On Linux 0.6.260120180240300Min: 327.28 / Avg: 327.85 / Max: 328.75Min: 320.4 / Avg: 322.31 / Max: 324.02Min: 280.62 / Avg: 282.88 / Max: 285.441. (CC) gcc options: -lpopt -O2

Compile Bench

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileBtrfsEXT4ZFS On Linux 0.6.2160320480640800SE +/- 0.72, N = 3SE +/- 5.09, N = 3SE +/- 3.95, N = 3454.35726.13531.58
OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileBtrfsEXT4ZFS On Linux 0.6.2130260390520650Min: 453.23 / Avg: 454.35 / Max: 455.69Min: 717.09 / Avg: 726.13 / Max: 734.71Min: 523.9 / Avg: 531.58 / Max: 536.99

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateBtrfsEXT4ZFS On Linux 0.6.280160240320400SE +/- 3.16, N = 3SE +/- 7.81, N = 3SE +/- 1.93, N = 3236.21374.66139.46
OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateBtrfsEXT4ZFS On Linux 0.6.270140210280350Min: 231.26 / Avg: 236.21 / Max: 242.08Min: 360.17 / Avg: 374.66 / Max: 386.95Min: 135.72 / Avg: 139.46 / Max: 142.17

PostMark

This is a test of NetApp's PostMark benchmark designed to simulate small-file testing similar to the tasks endured by web and mail servers. This test profile will set PostMark to perform 25,000 transactions with 500 files simultaneously with the file sizes ranging between 5 and 512 kilobytes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceBtrfsEXT4ZFS On Linux 0.6.211002200330044005500SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 37.61, N = 65319520816631. (CC) gcc options: -O3
OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceBtrfsEXT4ZFS On Linux 0.6.29001800270036004500Min: 5319 / Avg: 5319 / Max: 5319Min: 5208 / Avg: 5208 / Max: 5208Min: 1506 / Avg: 1663.17 / Max: 17601. (CC) gcc options: -O3

Btrfs

Processor: Intel Core i7-4900MQ @ 2.80GHz (8 Cores), Motherboard: System76 Gazelle Professional, Chipset: Intel Xeon E3-1200 v3/4th, Memory: 8192MB, Disk: 120GB INTEL SSDSC2CW12, Graphics: Intel 4th Gen Core IGP (1300MHz), Audio: Intel Haswell HDMI, Network: Realtek RTL8111/8168/8411 + Intel Centrino Advanced-N 6235

OS: Ubuntu 13.10, Kernel: 3.11.0-3-generic (x86_64), Desktop: Xfce 4.10, Display Server: X Server 1.14.2.901 (1.14.3 RC 1), Display Driver: intel 2.21.14, OpenGL: 3.1 Mesa 9.1.6, Compiler: GCC 4.8, File-System: btrfs, Screen Resolution: 1920x1080

Compiler Notes: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64/jre --with-jvm-jar-dir=/usr/lib/jvm-exports/java-1.5.0-gcj-4.8-amd64 --with-jvm-root-dir=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v
Disk Notes: DEADLINE / relatime,rw,space_cache,ssd
System Notes: Disk Scheduler: DEADLINE. Python 2.7.5+.

Testing initiated at 26 August 2013 09:12 by user phoronix.

EXT4

Processor: Intel Core i7-4900MQ @ 2.80GHz (8 Cores), Motherboard: System76 Gazelle Professional, Chipset: Intel Xeon E3-1200 v3/4th, Memory: 8192MB, Disk: 120GB INTEL SSDSC2CW12, Graphics: Intel 4th Gen Core IGP (1300MHz), Audio: Intel Haswell HDMI, Network: Realtek RTL8111/8168/8411 + Intel Centrino Advanced-N 6235

OS: Ubuntu 13.10, Kernel: 3.11.0-3-generic (x86_64), Desktop: Xfce 4.10, Display Server: X Server 1.14.2.901 (1.14.3 RC 1), Display Driver: intel 2.21.14, OpenGL: 3.1 Mesa 9.1.6, Compiler: GCC 4.8, File-System: ext4, Screen Resolution: 1920x1080

Compiler Notes: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64/jre --with-jvm-jar-dir=/usr/lib/jvm-exports/java-1.5.0-gcj-4.8-amd64 --with-jvm-root-dir=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v
Disk Notes: DEADLINE / data=ordered,relatime,rw
System Notes: Disk Scheduler: DEADLINE. Python 2.7.5+.

Testing initiated at 26 August 2013 10:17 by user phoronix.

ZFS On Linux 0.6.2

Processor: Intel Core i7-4900MQ @ 2.80GHz (8 Cores), Motherboard: System76 Gazelle Professional, Chipset: Intel Xeon E3-1200 v3/4th, Memory: 8192MB, Disk: 120GB INTEL SSDSC2CW12, Graphics: Intel 4th Gen Core IGP (1300MHz), Audio: Intel Haswell HDMI, Network: Realtek RTL8111/8168/8411 + Intel Centrino Advanced-N 6235

OS: Ubuntu 13.10, Kernel: 3.11.0-3-generic (x86_64), Desktop: Xfce 4.10, Display Server: X Server 1.14.2.901 (1.14.3 RC 1), Display Driver: intel 2.21.14, OpenGL: 3.1 Mesa 9.1.6, Compiler: GCC 4.8, File-System: zfs, Screen Resolution: 1920x1080

Compiler Notes: --build=x86_64-linux-gnu --disable-browser-plugin --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64/jre --with-jvm-jar-dir=/usr/lib/jvm-exports/java-1.5.0-gcj-4.8-amd64 --with-jvm-root-dir=/usr/lib/jvm/java-1.5.0-gcj-4.8-amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v
System Notes: Python 2.7.5+.

Testing initiated at 26 August 2013 15:39 by user phoronix.