FreeBSD 12.0 ZFS vs. ZoL Benchmarks

FreeBSD 12.0 ZFS benchmarks for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1904234-HV-FREEBSDZF72
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

Disk Test Suite 3 Tests
Server 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable
Show Perf Per Clock Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
FreeBSD iX ZoL
April 22 2019
  2 Hours, 3 Minutes
FreeBSD ZFS
April 22 2019
  2 Hours, 13 Minutes
FreeBSD UFS
April 22 2019
  2 Hours, 15 Minutes
Ubuntu 18.04 EXT4
April 23 2019
  3 Hours, 22 Minutes
Ubuntu 18.04 ZoL
April 23 2019
  2 Hours, 13 Minutes
Invert Hiding All Results Option
  2 Hours, 26 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


FreeBSD 12.0 ZFS vs. ZoL BenchmarksProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelCompilerFile-SystemScreen ResolutionDesktopDisplay ServerDisplay DriverOpenGLFreeBSD iX ZoLFreeBSD ZFSFreeBSD UFSUbuntu 18.04 EXT4Ubuntu 18.04 ZoLIntel Xeon E3-1275 v6 @ 3.80GHz (8 Cores)ASUS P10S-M WSIntel Xeon E3-1200 v6/7th Gen Core Registers16384MBSamsung SSD 970 EVO Plus 500GBIntel HD P630Intel Sunrise Point HDAFreeBSD12.0-STABLE (x86_64)Clang 8.0.0 (SVN 356365)zfs800x60012.0-RELEASE (x86_64)Clang 6.0.1 (SVN 335540)ufsIntel Xeon E3-1275 v6 @ 4.20GHz (4 Cores / 8 Threads)ASUS P10S-M WS (4401 BIOS)Intel Xeon E3-1200 v6/7thIntel HD P630 3GB (1150MHz)Realtek ALC1150Acer B286HK + DELL P2415Q2 x Intel I210Ubuntu 18.044.18.0-17-generic (x86_64)GNOME Shell 3.28.3X Server 1.20.1modesetting 1.20.14.5 Mesa 18.2.8GCC 7.3.0ext41920x1080zfsOpenBenchmarking.orgPython Details- FreeBSD iX ZoL: Python 3.6.8Security Details- FreeBSD iX ZoL: KPTI- FreeBSD ZFS: KPTI- FreeBSD UFS: KPTI- Ubuntu 18.04 EXT4: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW STIBP + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable - Ubuntu 18.04 ZoL: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW STIBP + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable Compiler Details- Ubuntu 18.04 EXT4, Ubuntu 18.04 ZoL: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v Disk Details- Ubuntu 18.04 EXT4: NONE / errors=remount-ro,relatime,rwProcessor Details- Ubuntu 18.04 EXT4, Ubuntu 18.04 ZoL: Scaling Governor: intel_pstate powersaveDisk Scheduler Details- Ubuntu 18.04 ZoL: NONE

FreeBSD iX ZoLFreeBSD ZFSFreeBSD UFSUbuntu 18.04 EXT4Ubuntu 18.04 ZoLResult OverviewPhoronix Test Suite100%421%743%1064%1386%BlogBenchIOzoneDbenchBlogBenchDbenchIOzonePostMarkRead4Kb - 512MB - Read Performance1Write64Kb - 512MB - Write PerformanceD.T.P

FreeBSD 12.0 ZFS vs. ZoL Benchmarkssqlite: Timed SQLite Insertionsblogbench: Readblogbench: Writeiozone: 4Kb - 512MB - Read Performanceiozone: 4Kb - 512MB - Write Performancedbench: 1dbench: 6postmark: Disk Transaction PerformanceFreeBSD iX ZoLFreeBSD ZFSFreeBSD UFSUbuntu 18.04 EXT4Ubuntu 18.04 ZoL22.38137813541782489911132423707627.21131384634172514855252490694712556592665406016728452843379639.35585358358735644131360.99226669727.04332905189322237893100.663123886OpenBenchmarking.org

SQLite

This is a simple benchmark of SQLite. At present this test profile just measures the time to perform a pre-defined number of insertions on an indexed database. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite InsertionsFreeBSD iX ZoLUbuntu 18.04 ZoLFreeBSD ZFSUbuntu 18.04 EXT4918273645SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 322.3827.0427.2139.35
OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite InsertionsFreeBSD iX ZoLUbuntu 18.04 ZoLFreeBSD ZFSUbuntu 18.04 EXT4816243240Min: 22.3 / Avg: 22.38 / Max: 22.48Min: 26.91 / Avg: 27.04 / Max: 27.13Min: 27.17 / Avg: 27.21 / Max: 27.3Min: 39.29 / Avg: 39.35 / Max: 39.39

BlogBench

BlogBench is designed to replicate the load of a real-world busy file server by stressing the file-system with multiple threads of random reads, writes, and rewrites. The behavior is mimicked of that of a blog by creating blogs with content and pictures, modifying blog posts, adding comments to these blogs, and then reading the content of the blogs. All of these blogs generated are created locally with fake content and pictures. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.1Test: ReadFreeBSD iX ZoLFreeBSD ZFSFreeBSD UFSUbuntu 18.04 EXT4Ubuntu 18.04 ZoL300K600K900K1200K1500KSE +/- 24290.33, N = 9SE +/- 12811.27, N = 9SE +/- 59738.49, N = 9SE +/- 14788.62, N = 9SE +/- 6586.79, N = 9137813513138461255659585358332905clangclangclanggccgcc
OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.1Test: ReadFreeBSD iX ZoLFreeBSD ZFSFreeBSD UFSUbuntu 18.04 EXT4Ubuntu 18.04 ZoL200K400K600K800K1000KMin: 1275731 / Avg: 1378135.11 / Max: 1510057Min: 1245463 / Avg: 1313846 / Max: 1350556Min: 1010614 / Avg: 1255658.78 / Max: 1592100Min: 537035 / Avg: 585357.56 / Max: 684003Min: 318462 / Avg: 332904.89 / Max: 383790

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.1Test: WriteUbuntu 18.04 EXT4Ubuntu 18.04 ZoLFreeBSD iX ZoLFreeBSD ZFSFreeBSD UFS8K16K24K32K40KSE +/- 845.64, N = 3SE +/- 2614.11, N = 3SE +/- 358.54, N = 3SE +/- 494.73, N = 3SE +/- 581.92, N = 33587318932417834172665gccgccclangclang
OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.1Test: WriteUbuntu 18.04 EXT4Ubuntu 18.04 ZoLFreeBSD iX ZoLFreeBSD ZFSFreeBSD UFS6K12K18K24K30KMin: 34395 / Avg: 35873.33 / Max: 37324Min: 13715 / Avg: 18932 / Max: 21837Min: 3650 / Avg: 4177.67 / Max: 4862Min: 2436 / Avg: 3416.67 / Max: 4021Min: 1841 / Avg: 2665.33 / Max: 3789

IOzone

The IOzone benchmark tests the hard disk drive / file-system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 512MB - Disk Test: Read PerformanceUbuntu 18.04 EXT4FreeBSD UFSFreeBSD ZFSFreeBSD iX ZoLUbuntu 18.04 ZoL12002400360048006000SE +/- 92.53, N = 12SE +/- 3.91, N = 3SE +/- 22.22, N = 11SE +/- 22.05, N = 3SE +/- 18.29, N = 356444060251424892237
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 512MB - Disk Test: Read PerformanceUbuntu 18.04 EXT4FreeBSD UFSFreeBSD ZFSFreeBSD iX ZoLUbuntu 18.04 ZoL10002000300040005000Min: 4630.17 / Avg: 5644.03 / Max: 5779.83Min: 4052.69 / Avg: 4060.22 / Max: 4065.78Min: 2463.36 / Avg: 2514.01 / Max: 2681.95Min: 2452.11 / Avg: 2488.67 / Max: 2528.3Min: 2211.15 / Avg: 2236.9 / Max: 2272.26

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 512MB - Disk Test: Write PerformanceFreeBSD UFSUbuntu 18.04 EXT4FreeBSD iX ZoLUbuntu 18.04 ZoLFreeBSD ZFS400800120016002000SE +/- 8.99, N = 3SE +/- 18.66, N = 3SE +/- 1.30, N = 3SE +/- 4.04, N = 3SE +/- 13.24, N = 316721313911893855
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 512MB - Disk Test: Write PerformanceFreeBSD UFSUbuntu 18.04 EXT4FreeBSD iX ZoLUbuntu 18.04 ZoLFreeBSD ZFS30060090012001500Min: 1661.4 / Avg: 1672.46 / Max: 1690.25Min: 1275.8 / Avg: 1312.62 / Max: 1336.32Min: 908.88 / Avg: 910.55 / Max: 913.11Min: 884.89 / Avg: 892.97 / Max: 897.33Min: 830.7 / Avg: 855.14 / Max: 876.19

Dbench

Dbench is a benchmark designed by the Samba project as a free alternative to netbench, but dbench contains only file-system calls for testing the disk performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 1FreeBSD UFSFreeBSD ZFSFreeBSD iX ZoLUbuntu 18.04 ZoLUbuntu 18.04 EXT42004006008001000SE +/- 0.70, N = 3SE +/- 0.15, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.83, N = 9845.00252.00132.00100.6660.99
OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 1FreeBSD UFSFreeBSD ZFSFreeBSD iX ZoLUbuntu 18.04 ZoLUbuntu 18.04 EXT4150300450600750Min: 844.08 / Avg: 845.39 / Max: 846.46Min: 252 / Avg: 252.23 / Max: 252.51Min: 131.68 / Avg: 131.84 / Max: 132.01Min: 100.56 / Avg: 100.66 / Max: 100.79Min: 57.99 / Avg: 60.99 / Max: 65.59

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 6FreeBSD UFSFreeBSD ZFSFreeBSD iX ZoLUbuntu 18.04 ZoLUbuntu 18.04 EXT46001200180024003000SE +/- 13.00, N = 3SE +/- 0.52, N = 3SE +/- 2.00, N = 3SE +/- 0.34, N = 3SE +/- 3.63, N = 32843490423312226
OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 6FreeBSD UFSFreeBSD ZFSFreeBSD iX ZoLUbuntu 18.04 ZoLUbuntu 18.04 EXT45001000150020002500Min: 2818 / Avg: 2842.57 / Max: 2862.22Min: 488.95 / Avg: 489.83 / Max: 490.75Min: 421.39 / Avg: 423.49 / Max: 427.48Min: 311.75 / Avg: 312.12 / Max: 312.8Min: 219.36 / Avg: 226.08 / Max: 231.82

PostMark

This is a test of NetApp's PostMark benchmark designed to simulate small-file testing similar to the tasks endured by web and mail servers. This test profile will set PostMark to perform 25,000 transactions with 500 files simultaneously with the file sizes ranging between 5 and 512 kilobytes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceFreeBSD iX ZoLFreeBSD ZFSUbuntu 18.04 EXT4Ubuntu 18.04 ZoLFreeBSD UFS15003000450060007500SE +/- 66.00, N = 3SE +/- 111.44, N = 3SE +/- 59.33, N = 3SE +/- 20.00, N = 3SE +/- 57.70, N = 1570766947669738863796clangclanggccgccclang
OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceFreeBSD iX ZoLFreeBSD ZFSUbuntu 18.04 EXT4Ubuntu 18.04 ZoLFreeBSD UFS12002400360048006000Min: 6944 / Avg: 7076 / Max: 7142Min: 6756 / Avg: 6947.33 / Max: 7142Min: 6578 / Avg: 6696.67 / Max: 6756Min: 3846 / Avg: 3886 / Max: 3906Min: 3424 / Avg: 3796 / Max: 4166

8 Results Shown

SQLite
BlogBench:
  Read
  Write
IOzone:
  4Kb - 512MB - Read Performance
  4Kb - 512MB - Write Performance
Dbench:
  1
  6
PostMark