ZFS Ubuntu 16.04 Testing

ZFS benchmarking on Ubuntu 16.04 LTS by Michael Larabel.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1604237-HA-ZFSUBUNTU89
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Limit displaying results to tests within:

CPU Massive 2 Tests
Disk Test Suite 4 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
ZFS
April 22 2016
 
EXT4
April 22 2016
 
Btrfs
April 22 2016
 
XFS
April 22 2016
 
Invert Hiding All Results Option
 

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

ZFS

Processor: Intel Xeon E5-2687W v3 @ 3.50GHz (20 Cores), Motherboard: MSI X99S SLI PLUS (MS-7885) v1.0, Chipset: Intel Xeon E7 v3/Xeon, Memory: 16384MB, Disk: PNY CS1211 120GB + 80GB INTEL SSDSCKGW08, Graphics: AMD FirePro V7900 2048MB, Audio: Realtek ALC892, Monitor: ASUS PB278, Network: Intel Connection

OS: Ubuntu 16.04, Kernel: 4.4.0-21-generic (x86_64), Desktop: Unity 7.4.0, Display Server: X Server 1.18.3, Display Driver: modesetting 1.18.3, OpenGL: 4.1 Mesa 11.2.0 Gallium 0.4, Compiler: GCC 5.3.1 20160413, File-System: zfs, Screen Resolution: 2560x1440

Compiler Notes: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v
Processor Notes: Scaling Governor: intel_pstate powersave
System Notes: Python 2.7.11+.
Disk Scheduler Notes: DEADLINE

EXT4

OS: Ubuntu 16.04, Kernel: 4.4.0-21-generic (x86_64), Desktop: Unity 7.4.0, Display Server: X Server 1.18.3, Display Driver: modesetting 1.18.3, OpenGL: 4.1 Mesa 11.2.0 Gallium 0.4, Compiler: GCC 5.3.1 20160413, File-System: ext4, Screen Resolution: 2560x1440

Compiler Notes: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v
Disk Notes: NOOP / data=ordered,relatime,rw
Processor Notes: Scaling Governor: intel_pstate powersave
System Notes: Python 2.7.11+.

Btrfs

OS: Ubuntu 16.04, Kernel: 4.4.0-21-generic (x86_64), Desktop: Unity 7.4.0, Display Server: X Server 1.18.3, Display Driver: modesetting 1.18.3, OpenGL: 4.1 Mesa 11.2.0 Gallium 0.4, Compiler: GCC 5.3.1 20160413, File-System: btrfs, Screen Resolution: 2560x1440

Compiler Notes: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v
Disk Notes: NOOP / relatime,rw,space_cache,ssd,subvol=/,subvolid=5
Processor Notes: Scaling Governor: intel_pstate powersave
System Notes: Python 2.7.11+.

XFS

OS: Ubuntu 16.04, Kernel: 4.4.0-21-generic (x86_64), Desktop: Unity 7.4.0, Display Server: X Server 1.18.3, Display Driver: modesetting 1.18.3, OpenGL: 4.1 Mesa 11.2.0 Gallium 0.4, Compiler: GCC 5.3.1 20160413, File-System: xfs, Screen Resolution: 2560x1440

Compiler Notes: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v
Disk Notes: NOOP / attr2,inode64,noquota,relatime,rw
Processor Notes: Scaling Governor: intel_pstate powersave
System Notes: Python 2.7.11+.

ZFS Ubuntu 16.04 TestingOpenBenchmarking.orgPhoronix Test SuiteIntel Xeon E5-2687W v3 @ 3.50GHz (20 Cores)MSI X99S SLI PLUS (MS-7885) v1.0Intel Xeon E7 v3/Xeon16384MBPNY CS1211 120GB + 80GB INTEL SSDSCKGW08AMD FirePro V7900 2048MBRealtek ALC892ASUS PB278Intel ConnectionUbuntu 16.044.4.0-21-generic (x86_64)Unity 7.4.0X Server 1.18.3modesetting 1.18.34.1 Mesa 11.2.0 Gallium 0.4GCC 5.3.1 20160413zfsext4btrfsxfs2560x1440ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemsScreen ResolutionZFS Ubuntu 16.04 Testing BenchmarksSystem Logs- --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Scaling Governor: intel_pstate powersave- Python 2.7.11+.- ZFS: DEADLINE- EXT4: NOOP / data=ordered,relatime,rw- Btrfs: NOOP / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 - XFS: NOOP / attr2,inode64,noquota,relatime,rw

ZFSEXT4BtrfsXFSLogarithmic Result OverviewPhoronix Test SuiteIOzoneIOzoneCompile BenchBlogBenchBlogBenchFS-MarkDbenchFS-MarkFS-Mark4Kb - 8GB - Read Performance4Kb - 8GB - Write PerformanceInitial CreateWriteRead5.F.1.S.4.T61.F.1.S4.F.3.S.D.1.S

ZFS Ubuntu 16.04 Testingblogbench: Readblogbench: Writecompilebench: Initial Createdbench: 6fs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizeiozone: 4Kb - 8GB - Read Performanceiozone: 4Kb - 8GB - Write PerformanceZFSEXT4BtrfsXFS358165906178.3359.1237.7359.4736.101130.74201.3456281013086372.3060.6834.83111.6034.936271.71463.5127189427602191.0451.7535.4067.3334.606225.31478.0636879735382252.3760.4534.3769.3034.976137.84463.90OpenBenchmarking.org

BlogBench

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: ReadZFSXFSEXT4Btrfs800K1600K2400K3200K4000KSE +/- 35942.46, N = 6SE +/- 18345.90, N = 3SE +/- 30591.01, N = 6SE +/- 26532.61, N = 3358165368797356281027189421. (CC) gcc options: -O2 -pthread

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: WriteZFSXFSEXT4Btrfs3K6K9K12K15KSE +/- 283.14, N = 3SE +/- 37.60, N = 3SE +/- 307.91, N = 3SE +/- 60.84, N = 390653821308676021. (CC) gcc options: -O2 -pthread

Compile Bench

Compilebench tries to age a filesystem by simulating some of the disk IO common in creating, compiling, patching, stating and reading kernel trees. It indirectly measures how well filesystems can maintain directory locality as the disk fills up and directories age. This current test is setup to use the makej mode with 10 initial directories Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateZFSXFSEXT4Btrfs80160240320400SE +/- 1.52, N = 3SE +/- 3.86, N = 5SE +/- 7.19, N = 3SE +/- 0.93, N = 3178.33252.37372.30191.04

Dbench

Dbench is a benchmark designed by the Samba project as a free alternative to netbench, but dbench contains only file-system calls for testing the disk performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 6ZFSXFSEXT4Btrfs1428425670SE +/- 0.01, N = 3SE +/- 0.17, N = 3SE +/- 2.03, N = 6SE +/- 0.17, N = 359.1260.4560.6851.751. (CC) gcc options: -lpopt -O2

FS-Mark

FS_Mark is designed to test a system's file-system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeZFSXFSEXT4Btrfs918273645SE +/- 0.43, N = 3SE +/- 0.47, N = 3SE +/- 0.19, N = 3SE +/- 0.10, N = 337.7334.3734.8335.401. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsZFSXFSEXT4Btrfs20406080100SE +/- 0.27, N = 3SE +/- 0.92, N = 3SE +/- 1.01, N = 3SE +/- 0.13, N = 359.4769.30111.6067.331. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeZFSXFSEXT4Btrfs816243240SE +/- 0.06, N = 3SE +/- 0.38, N = 3SE +/- 0.12, N = 3SE +/- 0.12, N = 336.1034.9734.9334.601. (CC) gcc options: -static

IOzone

The IOzone benchmark tests the hard disk drive / file-system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.405Record Size: 4Kb - File Size: 8GB - Disk Test: Read PerformanceZFSXFSEXT4Btrfs13002600390052006500SE +/- 47.83, N = 6SE +/- 10.03, N = 3SE +/- 17.66, N = 3SE +/- 35.02, N = 31130.746137.846271.716225.311. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.405Record Size: 4Kb - File Size: 8GB - Disk Test: Write PerformanceZFSXFSEXT4Btrfs100200300400500SE +/- 2.58, N = 3SE +/- 0.50, N = 3SE +/- 2.02, N = 3SE +/- 0.72, N = 3201.34463.90463.51478.061. (CC) gcc options: -O3

ZFS

Processor: Intel Xeon E5-2687W v3 @ 3.50GHz (20 Cores), Motherboard: MSI X99S SLI PLUS (MS-7885) v1.0, Chipset: Intel Xeon E7 v3/Xeon, Memory: 16384MB, Disk: PNY CS1211 120GB + 80GB INTEL SSDSCKGW08, Graphics: AMD FirePro V7900 2048MB, Audio: Realtek ALC892, Monitor: ASUS PB278, Network: Intel Connection

OS: Ubuntu 16.04, Kernel: 4.4.0-21-generic (x86_64), Desktop: Unity 7.4.0, Display Server: X Server 1.18.3, Display Driver: modesetting 1.18.3, OpenGL: 4.1 Mesa 11.2.0 Gallium 0.4, Compiler: GCC 5.3.1 20160413, File-System: zfs, Screen Resolution: 2560x1440

Compiler Notes: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v
Processor Notes: Scaling Governor: intel_pstate powersave
System Notes: Python 2.7.11+.
Disk Scheduler Notes: DEADLINE

Testing initiated at 22 April 2016 08:06 by user phoronix.

EXT4

Processor: Intel Xeon E5-2687W v3 @ 3.50GHz (20 Cores), Motherboard: MSI X99S SLI PLUS (MS-7885) v1.0, Chipset: Intel Xeon E7 v3/Xeon, Memory: 16384MB, Disk: PNY CS1211 120GB + 80GB INTEL SSDSCKGW08, Graphics: AMD FirePro V7900 2048MB, Audio: Realtek ALC892, Monitor: ASUS PB278, Network: Intel Connection

OS: Ubuntu 16.04, Kernel: 4.4.0-21-generic (x86_64), Desktop: Unity 7.4.0, Display Server: X Server 1.18.3, Display Driver: modesetting 1.18.3, OpenGL: 4.1 Mesa 11.2.0 Gallium 0.4, Compiler: GCC 5.3.1 20160413, File-System: ext4, Screen Resolution: 2560x1440

Compiler Notes: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v
Disk Notes: NOOP / data=ordered,relatime,rw
Processor Notes: Scaling Governor: intel_pstate powersave
System Notes: Python 2.7.11+.

Testing initiated at 22 April 2016 10:09 by user phoronix.

Btrfs

Processor: Intel Xeon E5-2687W v3 @ 3.50GHz (20 Cores), Motherboard: MSI X99S SLI PLUS (MS-7885) v1.0, Chipset: Intel Xeon E7 v3/Xeon, Memory: 16384MB, Disk: PNY CS1211 120GB + 80GB INTEL SSDSCKGW08, Graphics: AMD FirePro V7900 2048MB, Audio: Realtek ALC892, Monitor: ASUS PB278, Network: Intel Connection

OS: Ubuntu 16.04, Kernel: 4.4.0-21-generic (x86_64), Desktop: Unity 7.4.0, Display Server: X Server 1.18.3, Display Driver: modesetting 1.18.3, OpenGL: 4.1 Mesa 11.2.0 Gallium 0.4, Compiler: GCC 5.3.1 20160413, File-System: btrfs, Screen Resolution: 2560x1440

Compiler Notes: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v
Disk Notes: NOOP / relatime,rw,space_cache,ssd,subvol=/,subvolid=5
Processor Notes: Scaling Governor: intel_pstate powersave
System Notes: Python 2.7.11+.

Testing initiated at 22 April 2016 12:21 by user phoronix.

XFS

Processor: Intel Xeon E5-2687W v3 @ 3.50GHz (20 Cores), Motherboard: MSI X99S SLI PLUS (MS-7885) v1.0, Chipset: Intel Xeon E7 v3/Xeon, Memory: 16384MB, Disk: PNY CS1211 120GB + 80GB INTEL SSDSCKGW08, Graphics: AMD FirePro V7900 2048MB, Audio: Realtek ALC892, Monitor: ASUS PB278, Network: Intel Connection

OS: Ubuntu 16.04, Kernel: 4.4.0-21-generic (x86_64), Desktop: Unity 7.4.0, Display Server: X Server 1.18.3, Display Driver: modesetting 1.18.3, OpenGL: 4.1 Mesa 11.2.0 Gallium 0.4, Compiler: GCC 5.3.1 20160413, File-System: xfs, Screen Resolution: 2560x1440

Compiler Notes: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v
Disk Notes: NOOP / attr2,inode64,noquota,relatime,rw
Processor Notes: Scaling Governor: intel_pstate powersave
System Notes: Python 2.7.11+.

Testing initiated at 22 April 2016 14:15 by user phoronix.