ZFS Ubuntu 16.04 Testing

ZFS benchmarking on Ubuntu 16.04 LTS by Michael Larabel.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1604237-HA-ZFSUBUNTU89
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

CPU Massive 2 Tests
Disk Test Suite 4 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
ZFS
April 22 2016
 
EXT4
April 22 2016
 
Btrfs
April 22 2016
 
XFS
April 22 2016
 
Invert Hiding All Results Option
 

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


ZFS Ubuntu 16.04 TestingOpenBenchmarking.orgPhoronix Test SuiteIntel Xeon E5-2687W v3 @ 3.50GHz (20 Cores)MSI X99S SLI PLUS (MS-7885) v1.0Intel Xeon E7 v3/Xeon16384MBPNY CS1211 120GB + 80GB INTEL SSDSCKGW08AMD FirePro V7900 2048MBRealtek ALC892ASUS PB278Intel ConnectionUbuntu 16.044.4.0-21-generic (x86_64)Unity 7.4.0X Server 1.18.3modesetting 1.18.34.1 Mesa 11.2.0 Gallium 0.4GCC 5.3.1 20160413zfsext4btrfsxfs2560x1440ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemsScreen ResolutionZFS Ubuntu 16.04 Testing BenchmarksSystem Logs- --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Scaling Governor: intel_pstate powersave- Python 2.7.11+.- ZFS: DEADLINE- EXT4: NOOP / data=ordered,relatime,rw- Btrfs: NOOP / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 - XFS: NOOP / attr2,inode64,noquota,relatime,rw

ZFSEXT4BtrfsXFSLogarithmic Result OverviewPhoronix Test SuiteIOzoneIOzoneCompile BenchBlogBenchBlogBenchFS-MarkDbenchFS-MarkFS-Mark4Kb - 8GB - Read Performance4Kb - 8GB - Write PerformanceInitial CreateWriteRead5.F.1.S.4.T61.F.1.S4.F.3.S.D.1.S

ZFS Ubuntu 16.04 Testingfs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizeblogbench: Readblogbench: Writedbench: 6iozone: 4Kb - 8GB - Read Performanceiozone: 4Kb - 8GB - Write Performancecompilebench: Initial CreateZFSEXT4BtrfsXFS37.7359.4736.1035816590659.121130.74201.34178.3334.83111.6034.935628101308660.686271.71463.51372.3035.4067.3334.602718942760251.756225.31478.06191.0434.3769.3034.973687973538260.456137.84463.90252.37OpenBenchmarking.org

FS-Mark

FS_Mark is designed to test a system's file-system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeZFSEXT4BtrfsXFS918273645SE +/- 0.43, N = 3SE +/- 0.19, N = 3SE +/- 0.10, N = 3SE +/- 0.47, N = 337.7334.8335.4034.371. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeZFSEXT4BtrfsXFS816243240Min: 36.9 / Avg: 37.73 / Max: 38.3Min: 34.6 / Avg: 34.83 / Max: 35.2Min: 35.2 / Avg: 35.4 / Max: 35.5Min: 33.9 / Avg: 34.37 / Max: 35.31. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsZFSEXT4BtrfsXFS20406080100SE +/- 0.27, N = 3SE +/- 1.01, N = 3SE +/- 0.13, N = 3SE +/- 0.92, N = 359.47111.6067.3369.301. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsZFSEXT4BtrfsXFS20406080100Min: 59.2 / Avg: 59.47 / Max: 60Min: 109.6 / Avg: 111.6 / Max: 112.8Min: 67.2 / Avg: 67.33 / Max: 67.6Min: 68.1 / Avg: 69.3 / Max: 71.11. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeZFSEXT4BtrfsXFS816243240SE +/- 0.06, N = 3SE +/- 0.12, N = 3SE +/- 0.12, N = 3SE +/- 0.38, N = 336.1034.9334.6034.971. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeZFSEXT4BtrfsXFS816243240Min: 36 / Avg: 36.1 / Max: 36.2Min: 34.7 / Avg: 34.93 / Max: 35.1Min: 34.4 / Avg: 34.6 / Max: 34.8Min: 34.2 / Avg: 34.97 / Max: 35.41. (CC) gcc options: -static

BlogBench

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: ReadZFSEXT4BtrfsXFS800K1600K2400K3200K4000KSE +/- 35942.46, N = 6SE +/- 30591.01, N = 6SE +/- 26532.61, N = 3SE +/- 18345.90, N = 3358165562810271894236879731. (CC) gcc options: -O2 -pthread
OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: ReadZFSEXT4BtrfsXFS600K1200K1800K2400K3000KMin: 288203 / Avg: 358165.17 / Max: 531670Min: 513400 / Avg: 562809.83 / Max: 713421Min: 2666774 / Avg: 2718942.33 / Max: 2753440Min: 3651737 / Avg: 3687973 / Max: 37110841. (CC) gcc options: -O2 -pthread

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: WriteZFSEXT4BtrfsXFS3K6K9K12K15KSE +/- 283.14, N = 3SE +/- 307.91, N = 3SE +/- 60.84, N = 3SE +/- 37.60, N = 390613086760253821. (CC) gcc options: -O2 -pthread
OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: WriteZFSEXT4BtrfsXFS2K4K6K8K10KMin: 538 / Avg: 906.33 / Max: 1463Min: 12670 / Avg: 13085.67 / Max: 13687Min: 7505 / Avg: 7601.67 / Max: 7714Min: 5323 / Avg: 5382.33 / Max: 54521. (CC) gcc options: -O2 -pthread

Dbench

Dbench is a benchmark designed by the Samba project as a free alternative to netbench, but dbench contains only file-system calls for testing the disk performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 6ZFSEXT4BtrfsXFS1428425670SE +/- 0.01, N = 3SE +/- 2.03, N = 6SE +/- 0.17, N = 3SE +/- 0.17, N = 359.1260.6851.7560.451. (CC) gcc options: -lpopt -O2
OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 6ZFSEXT4BtrfsXFS1224364860Min: 59.11 / Avg: 59.12 / Max: 59.15Min: 55.58 / Avg: 60.68 / Max: 67.29Min: 51.53 / Avg: 51.75 / Max: 52.1Min: 60.12 / Avg: 60.45 / Max: 60.671. (CC) gcc options: -lpopt -O2

IOzone

The IOzone benchmark tests the hard disk drive / file-system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.405Record Size: 4Kb - File Size: 8GB - Disk Test: Read PerformanceZFSEXT4BtrfsXFS13002600390052006500SE +/- 47.83, N = 6SE +/- 17.66, N = 3SE +/- 35.02, N = 3SE +/- 10.03, N = 31130.746271.716225.316137.841. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.405Record Size: 4Kb - File Size: 8GB - Disk Test: Read PerformanceZFSEXT4BtrfsXFS11002200330044005500Min: 947.61 / Avg: 1130.74 / Max: 1287.9Min: 6242.97 / Avg: 6271.71 / Max: 6303.86Min: 6161.48 / Avg: 6225.31 / Max: 6282.2Min: 6119.93 / Avg: 6137.84 / Max: 6154.61. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.405Record Size: 4Kb - File Size: 8GB - Disk Test: Write PerformanceZFSEXT4BtrfsXFS100200300400500SE +/- 2.58, N = 3SE +/- 2.02, N = 3SE +/- 0.72, N = 3SE +/- 0.50, N = 3201.34463.51478.06463.901. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.405Record Size: 4Kb - File Size: 8GB - Disk Test: Write PerformanceZFSEXT4BtrfsXFS80160240320400Min: 196.3 / Avg: 201.34 / Max: 204.83Min: 461.04 / Avg: 463.51 / Max: 467.51Min: 477.33 / Avg: 478.06 / Max: 479.5Min: 463.33 / Avg: 463.9 / Max: 464.891. (CC) gcc options: -O3

Compile Bench

Compilebench tries to age a filesystem by simulating some of the disk IO common in creating, compiling, patching, stating and reading kernel trees. It indirectly measures how well filesystems can maintain directory locality as the disk fills up and directories age. This current test is setup to use the makej mode with 10 initial directories Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateZFSEXT4BtrfsXFS80160240320400SE +/- 1.52, N = 3SE +/- 7.19, N = 3SE +/- 0.93, N = 3SE +/- 3.86, N = 5178.33372.30191.04252.37
OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateZFSEXT4BtrfsXFS70140210280350Min: 175.3 / Avg: 178.33 / Max: 180.1Min: 358.45 / Avg: 372.3 / Max: 382.55Min: 189.28 / Avg: 191.04 / Max: 192.45Min: 246.44 / Avg: 252.37 / Max: 267.33