TrueOS ZoF vs. FreeBSD ZFS vs. ZFS On Linux, Etc

Intel Xeon E3-1280 v5 testing of ZFS on BSDs and Linux among other OS file-system tests by Michael Larabel.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1901268-SP-ZFSBSDLIN95
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

CPU Massive 3 Tests
Database Test Suite 2 Tests
Disk Test Suite 4 Tests
Server 3 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable
Show Perf Per Clock Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
TrueOS ZoF
January 24 2019
  1 Hour, 46 Minutes
FreeBSD 12 ZFS
January 25 2019
  1 Hour
DragonFlyBSD 5.4 HAMMER2
January 25 2019
  1 Hour, 4 Minutes
Ubuntu 19.04 EXT4
January 25 2019
  47 Minutes
Ubuntu 19.04 ZOL
January 25 2019
  42 Minutes
Ubuntu 19.04 F2FS
January 25 2019
  53 Minutes
Clear Linux 27460 EXT4
January 26 2019
  1 Hour, 28 Minutes
Invert Hiding All Results Option
  1 Hour, 6 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


TrueOS ZoF vs. FreeBSD ZFS vs. ZFS On Linux, EtcProcessorMotherboardChipsetMemoryDiskAudioNetworkGraphicsMonitorOSKernelCompilerFile-SystemScreen ResolutionDesktopDisplay ServerDisplay DriverTrueOS ZoFFreeBSD 12 ZFSDragonFlyBSD 5.4 HAMMER2Ubuntu 19.04 EXT4Ubuntu 19.04 ZOLUbuntu 19.04 F2FSClear Linux 27460 EXT4Intel Xeon E3-1280 v5 @ 3.70GHz (8 Cores)MSI MS-7998 1.0Intel Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Registers32768MBGeneric NVMe DeviceIntel Sunrise Point HDAIntel PRO/1000 ConnectionFreeBSD13.0-CURRENT (x86_64)Clang 7.0.1 (SVN 349250)zfs12.0-RELEASE (x86_64)Clang 6.0.1 (SVN 335540)1024x768Intel Xeon E3-1280 v5 @ 3.70GHz (4 Cores / 8 Threads)NVME-PCIeIntel PRO/1000 Connection PCH_SPT_I219_V2 7.6.2DragonFly5.4-RELEASE (x86_64)GCC 8.1hammer2Intel Xeon E3-1280 v5 @ 4.00GHz (4 Cores / 8 Threads)MSI Z170A SLI PLUS (MS-7998) v1.0 (2.90 BIOS)Intel Xeon E3-1200 v5/E3-1500256GB TOSHIBA-RD400ASUS AMD Radeon HD 7850 / R7 265 R9 270 1024SPRealtek ALC1150VE228Intel I219-VUbuntu 19.044.18.0-11-generic (x86_64)GNOME Shell 3.30.2X Server 1.20.3modesetting 1.20.3GCC 8.2.0ext41920x1080zfsf2fsClear Linux OS 274604.20.4-686.native (x86_64)GCC 8.2.1 20180502 + Clang 7.0.1 + LLVM 7.0.1ext4OpenBenchmarking.orgPython Details- TrueOS ZoF: Python 2.7.15 + Python 3.6.8- FreeBSD 12 ZFS: Python 2.7.15 + Python 3.6.7- DragonFlyBSD 5.4 HAMMER2: Python 2.7.15 + Python 3.6.7- Ubuntu 19.04 EXT4: Python 2.7.15+ + Python 3.7.2rc1- Ubuntu 19.04 ZOL: Python 2.7.15+ + Python 3.7.2rc1- Ubuntu 19.04 F2FS: Python 2.7.15+ + Python 3.7.2rc1- Clear Linux 27460 EXT4: Python 3.7.2Security Details- TrueOS ZoF: KPTI- FreeBSD 12 ZFS: KPTI- DragonFlyBSD 5.4 HAMMER2: Meltdown Mitigation- Ubuntu 19.04 EXT4: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable- Ubuntu 19.04 ZOL: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable- Ubuntu 19.04 F2FS: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable- Clear Linux 27460 EXT4: KPTI + __user pointer sanitization + Full generic retpoline STIBP: disabled RSB filling + PTE Inversion; VMX: conditional cache flushes SMT vulnerableCompiler Details- Ubuntu 19.04 EXT4: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - Ubuntu 19.04 ZOL: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - Ubuntu 19.04 F2FS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - Clear Linux 27460 EXT4: --build=x86_64-generic-linux --disable-libmpx --disable-libunwind-exceptions --disable-multiarch --disable-vtable-verify --enable-__cxa_atexit --enable-bootstrap --enable-clocale=gnu --enable-gnu-indirect-function --enable-languages=c,c++,fortran,go --enable-ld=default --enable-libstdcxx-pch --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --exec-prefix=/usr --includedir=/usr/include --target=x86_64-generic-linux --with-arch=westmere --with-glibc-version=2.19 --with-gnu-ld --with-isl --with-ppl=yes --with-tune=haswell Disk Details- Ubuntu 19.04 EXT4: NONE / errors=remount-ro,relatime,rw- Ubuntu 19.04 F2FS: NONE / acl,active_logs=6,alloc_mode=default,background_gc=on,extent_cache,flush_merge,fsync_mode=posix,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr- Clear Linux 27460 EXT4: MQ-DEADLINE / relatime,rw,stripe=256Processor Details- Ubuntu 19.04 EXT4: Scaling Governor: intel_pstate powersave- Ubuntu 19.04 ZOL: Scaling Governor: intel_pstate powersave- Ubuntu 19.04 F2FS: Scaling Governor: intel_pstate powersave- Clear Linux 27460 EXT4: Scaling Governor: intel_pstate performanceDisk Scheduler Details- Ubuntu 19.04 ZOL: NONEEnvironment Details- Clear Linux 27460 EXT4: CFFLAGS=-g-O3-feliminate-unused-debug-types-pipe-Wall-Wp-D_FORTIFY_SOURCE=2-fexceptions-fstack-protector--param=ssp-buffer-size=32-Wl--copy-dt-needed-entries-m64-fasynchronous-unwind-tables-Wp-D_REENTRANT-ftree-loop-distribute-patterns-Wl-z-Wl now-Wl-z-Wl relro-malign-data=abi-fno-semantic-interposition-ftree-vectorize-ftree-loop-vectorize-Wl-sort-common-Wl--enable-new-dtags FFLAGS=-g-O3-feliminate-unused-debug-types-pipe-Wall-Wp-D_FORTIFY_SOURCE=2-fexceptions-fstack-protector--param=ssp-buffer-size=32-Wl--copy-dt-needed-entries-m64-fasynchronous-unwind-tables-Wp-D_REENTRANT-ftree-loop-distribute-patterns-Wl-z-Wl relro-malign-data=abi-fno-semantic-interposition-ftree-vectorize-ftree-loop-vectorize-Wl--enable-new-dtags CXXFLAGS=-g-O3-feliminate-unused-debug-types-pipe-Wall-Wp-D_FORTIFY_SOURCE=2-fexceptions-fstack-protector--param=ssp-buffer-size=32-Wformat-Wformat-security-Wl--copy-dt-needed-entries-m64-fasynchronous-unwind-tables-Wp-D_REENTRANT-ftree-loop-distribute-patterns-Wl-z-Wl relro-fno-semantic-interposition-ffat-lto-objects-fno-signed-zeros-fno-trapping-math-fassociative-math-Wl-sort-common-Wl--enable-new-dtags-mtune=skylake-fvisibility-inlines-hidden-Wl--enable-new-dtags CFLAGS=-g-O3-feliminate-unused-debug-types-pipe-Wall-Wp-D_FORTIFY_SOURCE=2-fexceptions-fstack-protector--param=ssp-buffer-size=32-Wformat-Wformat-security-Wl--copy-dt-needed-entries-m64-fasynchronous-unwind-tables-Wp-D_REENTRANT-ftree-loop-distribute-patterns-Wl-z-Wl relro-fno-semantic-interposition-ffat-lto-objects-fno-signed-zeros-fno-trapping-math-fassociative-math-Wl-sort-common-Wl--enable-new-dtags-mtune=skylake THEANO_FLAGS=floatX=float32 openmp=true gcc.cxxflags="-ftree-vectorize-mavx"

TrueOS ZoFFreeBSD 12 ZFSDragonFlyBSD 5.4 HAMMER2Ubuntu 19.04 EXT4Ubuntu 19.04 ZOLUbuntu 19.04 F2FSClear Linux 27460 EXT4Result OverviewPhoronix Test Suite100%665%1230%1794%2359%IOzoneCompile BenchPostgreSQL pgbenchSQLiteBlogBench

TrueOS ZoF vs. FreeBSD ZFS vs. ZFS On Linux, Etcsqlite: Timed SQLite Insertionsfio: Rand Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryiozone: 1MB - 8GB - Write Performancecompilebench: Compilecompilebench: Initial Createcompilebench: Read Compiled Treepgbench: Buffer Test - Normal Load - Read Onlypgbench: Buffer Test - Normal Load - Read Writeblogbench: Readblogbench: WriteTrueOS ZoFFreeBSD 12 ZFSDragonFlyBSD 5.4 HAMMER2Ubuntu 19.04 EXT4Ubuntu 19.04 ZOLUbuntu 19.04 F2FSClear Linux 27460 EXT459.101116285667209883.78214423751881225667226310627000167973982.0231536555233354769712350.21157140233362791018260667523714563730006345104926866759332601271.191212838142451136305336334.061447661102.14961952447473617430550664.2237.83100123459867647315805331088250641009572100556.602928111396347713372232360468.887181136234.931391400701235516671521995.7537.50998222565006593077860011062586610010392828621.133152110731334214473291341166.1725.437511644200065741.6010667781165422678621958505.5630221158503083128372515249OpenBenchmarking.org

SQLite

This is a simple benchmark of SQLite. At present this test profile just measures the time to perform a pre-defined number of insertions on an indexed database. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite InsertionsTrueOS ZoFFreeBSD 12 ZFSDragonFlyBSD 5.4 HAMMER2Ubuntu 19.04 EXT4Ubuntu 19.04 ZOLUbuntu 19.04 F2FSClear Linux 27460 EXT420406080100SE +/- 0.06, N = 3SE +/- 0.33, N = 3SE +/- 0.07, N = 12SE +/- 0.09, N = 3SE +/- 0.22, N = 3SE +/- 0.06, N = 3SE +/- 0.27, N = 359.1050.214.0664.2268.8895.7566.17clangclanggccgccgccgcc
OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite InsertionsTrueOS ZoFFreeBSD 12 ZFSDragonFlyBSD 5.4 HAMMER2Ubuntu 19.04 EXT4Ubuntu 19.04 ZOLUbuntu 19.04 F2FSClear Linux 27460 EXT420406080100Min: 58.98 / Avg: 59.1 / Max: 59.19Min: 49.69 / Avg: 50.21 / Max: 50.81Min: 3.59 / Avg: 4.06 / Max: 4.5Min: 64.06 / Avg: 64.22 / Max: 64.37Min: 68.65 / Avg: 68.88 / Max: 69.32Min: 95.66 / Avg: 95.75 / Max: 95.85Min: 65.88 / Avg: 66.17 / Max: 66.71

Flexible IO Tester

Fio is an advanced disk benchmark that depends upon the kernel's AIO access library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryTrueOS ZoFFreeBSD 12 ZFSUbuntu 19.04 EXT4Ubuntu 19.04 F2FSClear Linux 27460 EXT430060090012001500SE +/- 1.45, N = 3SE +/- 1.53, N = 3SE +/- 0.47, N = 3SE +/- 0.52, N = 3SE +/- 0.07, N = 31116.001571.0037.7337.0325.37
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryTrueOS ZoFFreeBSD 12 ZFSUbuntu 19.04 EXT4Ubuntu 19.04 F2FSClear Linux 27460 EXT430060090012001500Min: 1114 / Avg: 1116.33 / Max: 1119Min: 1569 / Avg: 1571 / Max: 1574Min: 36.8 / Avg: 37.73 / Max: 38.3Min: 36 / Avg: 37.03 / Max: 37.7Min: 25.3 / Avg: 25.37 / Max: 25.5

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryTrueOS ZoFFreeBSD 12 ZFS90K180K270K360K450KSE +/- 333.33, N = 3SE +/- 333.33, N = 32856674023331. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryTrueOS ZoFFreeBSD 12 ZFS70K140K210K280K350KMin: 285000 / Avg: 285666.67 / Max: 286000Min: 402000 / Avg: 402333.33 / Max: 4030001. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryTrueOS ZoFFreeBSD 12 ZFSUbuntu 19.04 EXT4Ubuntu 19.04 F2FSClear Linux 27460 EXT413002600390052006500SE +/- 63.71, N = 9SE +/- 27.47, N = 3SE +/- 6.96, N = 3SE +/- 4.70, N = 3SE +/- 2.08, N = 3209862791001998751
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryTrueOS ZoFFreeBSD 12 ZFSUbuntu 19.04 EXT4Ubuntu 19.04 F2FSClear Linux 27460 EXT411002200330044005500Min: 1837 / Avg: 2097.67 / Max: 2445Min: 6233 / Avg: 6279 / Max: 6328Min: 988 / Avg: 1000.67 / Max: 1012Min: 989 / Avg: 998.33 / Max: 1004Min: 747 / Avg: 751 / Max: 754

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryTrueOS ZoFFreeBSD 12 ZFSUbuntu 19.04 EXT4Ubuntu 19.04 F2FSClear Linux 27460 EXT42004006008001000SE +/- 2.22, N = 12SE +/- 6.77, N = 3SE +/- 4.33, N = 3SE +/- 1.00, N = 383.781018.00234.00222.00164.00
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryTrueOS ZoFFreeBSD 12 ZFSUbuntu 19.04 EXT4Ubuntu 19.04 F2FSClear Linux 27460 EXT42004006008001000Min: 70 / Avg: 83.78 / Max: 96.1Min: 1005 / Avg: 1018.33 / Max: 1027Min: 225 / Avg: 233.67 / Max: 238Min: 163 / Avg: 164 / Max: 166

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryTrueOS ZoFFreeBSD 12 ZFSUbuntu 19.04 EXT4Ubuntu 19.04 F2FSClear Linux 27460 EXT460K120K180K240K300KSE +/- 569.35, N = 12SE +/- 1855.92, N = 3SE +/- 1083.72, N = 3SE +/- 264.58, N = 3SE +/- 200.00, N = 321442260667598675650042000
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryTrueOS ZoFFreeBSD 12 ZFSUbuntu 19.04 EXT4Ubuntu 19.04 F2FSClear Linux 27460 EXT450K100K150K200K250KMin: 17900 / Avg: 21441.67 / Max: 24600Min: 257000 / Avg: 260666.67 / Max: 263000Min: 57700 / Avg: 59866.67 / Max: 61000Min: 56000 / Avg: 56500 / Max: 56900Min: 41800 / Avg: 42000 / Max: 42400

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryTrueOS ZoFFreeBSD 12 ZFSUbuntu 19.04 EXT4Ubuntu 19.04 F2FSClear Linux 27460 EXT411002200330044005500SE +/- 2.52, N = 3SE +/- 6.89, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 337515237647659657
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryTrueOS ZoFFreeBSD 12 ZFSUbuntu 19.04 EXT4Ubuntu 19.04 F2FSClear Linux 27460 EXT49001800270036004500Min: 3748 / Avg: 3751 / Max: 3756Min: 5227 / Avg: 5236.67 / Max: 5250Min: 659 / Avg: 659.33 / Max: 660Min: 657 / Avg: 657.33 / Max: 658

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryTrueOS ZoFFreeBSD 12 ZFSUbuntu 19.04 EXT4Ubuntu 19.04 F2FSClear Linux 27460 EXT430060090012001500SE +/- 0.58, N = 3SE +/- 0.67, N = 3SE +/- 1.86, N = 3SE +/- 2.89, N = 3SE +/- 0.10, N = 3881.001456.00315.00307.0041.60
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryTrueOS ZoFFreeBSD 12 ZFSUbuntu 19.04 EXT4Ubuntu 19.04 F2FSClear Linux 27460 EXT430060090012001500Min: 880 / Avg: 881 / Max: 882Min: 1455 / Avg: 1456.33 / Max: 1457Min: 311 / Avg: 314.67 / Max: 317Min: 302 / Avg: 307 / Max: 312Min: 41.4 / Avg: 41.6 / Max: 41.7

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryTrueOS ZoFFreeBSD 12 ZFSUbuntu 19.04 EXT4Ubuntu 19.04 F2FSClear Linux 27460 EXT480K160K240K320K400KSE +/- 333.33, N = 3SE +/- 470.22, N = 3SE +/- 723.42, N = 3SE +/- 33.33, N = 3225667373000805337860010667
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryTrueOS ZoFFreeBSD 12 ZFSUbuntu 19.04 EXT4Ubuntu 19.04 F2FSClear Linux 27460 EXT460K120K180K240K300KMin: 225000 / Avg: 225666.67 / Max: 226000Min: 79600 / Avg: 80533.33 / Max: 81100Min: 77300 / Avg: 78600 / Max: 79800Min: 10600 / Avg: 10666.67 / Max: 10700

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryTrueOS ZoFFreeBSD 12 ZFSUbuntu 19.04 EXT4Ubuntu 19.04 F2FSClear Linux 27460 EXT414002800420056007000SE +/- 53.96, N = 9SE +/- 61.49, N = 3SE +/- 10.54, N = 3SE +/- 3.00, N = 3SE +/- 5.13, N = 32263634510881106781
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryTrueOS ZoFFreeBSD 12 ZFSUbuntu 19.04 EXT4Ubuntu 19.04 F2FSClear Linux 27460 EXT411002200330044005500Min: 1989 / Avg: 2262.89 / Max: 2472Min: 6239 / Avg: 6345.33 / Max: 6452Min: 1067 / Avg: 1088 / Max: 1100Min: 1103 / Avg: 1106 / Max: 1112Min: 774 / Avg: 781 / Max: 791

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryTrueOS ZoFFreeBSD 12 ZFSUbuntu 19.04 EXT4Ubuntu 19.04 F2FSClear Linux 27460 EXT42004006008001000SE +/- 5.17, N = 3SE +/- 3.38, N = 3SE +/- 1.73, N = 3SE +/- 0.33, N = 31061049250258165
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryTrueOS ZoFFreeBSD 12 ZFSUbuntu 19.04 EXT4Ubuntu 19.04 F2FSClear Linux 27460 EXT42004006008001000Min: 1039 / Avg: 1049.33 / Max: 1055Min: 246 / Avg: 250.33 / Max: 257Min: 255 / Avg: 258 / Max: 261Min: 164 / Avg: 164.67 / Max: 165

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryTrueOS ZoFFreeBSD 12 ZFSUbuntu 19.04 EXT4Ubuntu 19.04 F2FSClear Linux 27460 EXT460K120K180K240K300KSE +/- 57.74, N = 3SE +/- 1333.33, N = 3SE +/- 862.17, N = 3SE +/- 435.89, N = 3SE +/- 88.19, N = 327000268667641006610042267
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryTrueOS ZoFFreeBSD 12 ZFSUbuntu 19.04 EXT4Ubuntu 19.04 F2FSClear Linux 27460 EXT450K100K150K200K250KMin: 26900 / Avg: 27000 / Max: 27100Min: 266000 / Avg: 268666.67 / Max: 270000Min: 63000 / Avg: 64100 / Max: 65800Min: 65400 / Avg: 66100 / Max: 66900Min: 42100 / Avg: 42266.67 / Max: 42400

IOzone

The IOzone benchmark tests the hard disk drive / file-system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Write PerformanceTrueOS ZoFFreeBSD 12 ZFSDragonFlyBSD 5.4 HAMMER2Ubuntu 19.04 EXT4Ubuntu 19.04 ZOLUbuntu 19.04 F2FSClear Linux 27460 EXT413002600390052006500SE +/- 3.92, N = 3SE +/- 245.95, N = 12SE +/- 66.13, N = 12SE +/- 5.22, N = 3SE +/- 29.87, N = 10SE +/- 5.42, N = 3SE +/- 11.69, N = 121679593314479577181039862clangclanggccgccgccgccgcc
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Write PerformanceTrueOS ZoFFreeBSD 12 ZFSDragonFlyBSD 5.4 HAMMER2Ubuntu 19.04 EXT4Ubuntu 19.04 ZOLUbuntu 19.04 F2FSClear Linux 27460 EXT410002000300040005000Min: 1671.26 / Avg: 1679.09 / Max: 1683.08Min: 4702.85 / Avg: 5932.73 / Max: 6982.46Min: 1199.78 / Avg: 1446.55 / Max: 1807.9Min: 946.75 / Avg: 957.05 / Max: 963.64Min: 564.4 / Avg: 717.98 / Max: 848.91Min: 1028.33 / Avg: 1038.72 / Max: 1046.58Min: 774.81 / Avg: 862.31 / Max: 895.67

Compile Bench

Compilebench tries to age a filesystem by simulating some of the disk IO common in creating, compiling, patching, stating and reading kernel trees. It indirectly measures how well filesystems can maintain directory locality as the disk fills up and directories age. This current test is setup to use the makej mode with 10 initial directories Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileTrueOS ZoFFreeBSD 12 ZFSDragonFlyBSD 5.4 HAMMER2Ubuntu 19.04 EXT4Ubuntu 19.04 ZOLUbuntu 19.04 F2FSClear Linux 27460 EXT46001200180024003000SE +/- 1.21, N = 3SE +/- 6.36, N = 3SE +/- 31.67, N = 9SE +/- 13.86, N = 3SE +/- 36.05, N = 12SE +/- 1.42, N = 3SE +/- 27.67, N = 1273926016612100113628281958
OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileTrueOS ZoFFreeBSD 12 ZFSDragonFlyBSD 5.4 HAMMER2Ubuntu 19.04 EXT4Ubuntu 19.04 ZOLUbuntu 19.04 F2FSClear Linux 27460 EXT45001000150020002500Min: 737.16 / Avg: 739.02 / Max: 741.3Min: 2588.92 / Avg: 2600.99 / Max: 2610.48Min: 494.06 / Avg: 661.19 / Max: 807.16Min: 2073.02 / Avg: 2100.1 / Max: 2118.79Min: 943.55 / Avg: 1136.34 / Max: 1319.78Min: 2825.54 / Avg: 2828.33 / Max: 2830.14Min: 1662.79 / Avg: 1958.27 / Max: 2009.73

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateTrueOS ZoFFreeBSD 12 ZFSDragonFlyBSD 5.4 HAMMER2Ubuntu 19.04 EXT4Ubuntu 19.04 ZOLUbuntu 19.04 F2FSClear Linux 27460 EXT4130260390520650SE +/- 0.38, N = 3SE +/- 0.89, N = 3SE +/- 1.51, N = 3SE +/- 4.86, N = 3SE +/- 0.31, N = 3SE +/- 3.29, N = 3SE +/- 8.40, N = 382.02271.19102.14556.60234.93621.13505.56
OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateTrueOS ZoFFreeBSD 12 ZFSDragonFlyBSD 5.4 HAMMER2Ubuntu 19.04 EXT4Ubuntu 19.04 ZOLUbuntu 19.04 F2FSClear Linux 27460 EXT4110220330440550Min: 81.31 / Avg: 82.02 / Max: 82.6Min: 269.57 / Avg: 271.19 / Max: 272.65Min: 99.11 / Avg: 102.14 / Max: 103.77Min: 547.8 / Avg: 556.6 / Max: 564.56Min: 234.38 / Avg: 234.93 / Max: 235.46Min: 617.1 / Avg: 621.13 / Max: 627.66Min: 488.98 / Avg: 505.56 / Max: 516.17

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Read Compiled TreeTrueOS ZoFFreeBSD 12 ZFSDragonFlyBSD 5.4 HAMMER2Ubuntu 19.04 EXT4Ubuntu 19.04 ZOLUbuntu 19.04 F2FSClear Linux 27460 EXT47001400210028003500SE +/- 0.44, N = 3SE +/- 1.38, N = 3SE +/- 5.42, N = 3SE +/- 17.77, N = 3SE +/- 38.37, N = 3SE +/- 20.69, N = 3SE +/- 22.32, N = 331512129612928139131523022
OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Read Compiled TreeTrueOS ZoFFreeBSD 12 ZFSDragonFlyBSD 5.4 HAMMER2Ubuntu 19.04 EXT4Ubuntu 19.04 ZOLUbuntu 19.04 F2FSClear Linux 27460 EXT45001000150020002500Min: 314.04 / Avg: 314.88 / Max: 315.54Min: 1211.06 / Avg: 1212.44 / Max: 1215.2Min: 955.29 / Avg: 960.88 / Max: 971.72Min: 2891.99 / Avg: 2927.53 / Max: 2945.3Min: 1327.19 / Avg: 1391.1 / Max: 1459.83Min: 3116.29 / Avg: 3151.71 / Max: 3187.96Min: 2977.66 / Avg: 3022.31 / Max: 3044.63

PostgreSQL pgbench

This is a simple benchmark of PostgreSQL using pgbench. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Buffer Test - Test: Normal Load - Mode: Read OnlyTrueOS ZoFFreeBSD 12 ZFSDragonFlyBSD 5.4 HAMMER2Ubuntu 19.04 EXT4Ubuntu 19.04 ZOLUbuntu 19.04 F2FSClear Linux 27460 EXT420K40K60K80K100KSE +/- 508.37, N = 6SE +/- 42.26, N = 3SE +/- 85.28, N = 3SE +/- 89.21, N = 3SE +/- 43.59, N = 3SE +/- 131.63, N = 3SE +/- 65.73, N = 336555838149524411139640070110731115850
OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Buffer Test - Test: Normal Load - Mode: Read OnlyTrueOS ZoFFreeBSD 12 ZFSDragonFlyBSD 5.4 HAMMER2Ubuntu 19.04 EXT4Ubuntu 19.04 ZOLUbuntu 19.04 F2FSClear Linux 27460 EXT420K40K60K80K100KMin: 35936.49 / Avg: 36554.84 / Max: 39085.46Min: 83768.88 / Avg: 83814.24 / Max: 83898.69Min: 95077.72 / Avg: 95244.36 / Max: 95359.18Min: 111218.42 / Avg: 111396.41 / Max: 111496.18Min: 39993.87 / Avg: 40069.62 / Max: 40144.88Min: 110467.72 / Avg: 110730.97 / Max: 110864.01Min: 115721.85 / Avg: 115849.57 / Max: 115940.42

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Buffer Test - Test: Normal Load - Mode: Read WriteTrueOS ZoFFreeBSD 12 ZFSDragonFlyBSD 5.4 HAMMER2Ubuntu 19.04 EXT4Ubuntu 19.04 ZOLUbuntu 19.04 F2FSClear Linux 27460 EXT416003200480064008000SE +/- 13.58, N = 3SE +/- 19.40, N = 3SE +/- 137.30, N = 3SE +/- 27.49, N = 3SE +/- 3.23, N = 3SE +/- 41.73, N = 3SE +/- 42.06, N = 32333245174733477123533423083
OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Buffer Test - Test: Normal Load - Mode: Read WriteTrueOS ZoFFreeBSD 12 ZFSDragonFlyBSD 5.4 HAMMER2Ubuntu 19.04 EXT4Ubuntu 19.04 ZOLUbuntu 19.04 F2FSClear Linux 27460 EXT413002600390052006500Min: 2311.64 / Avg: 2332.62 / Max: 2358.04Min: 2428.55 / Avg: 2451.27 / Max: 2489.86Min: 7294.39 / Avg: 7473.02 / Max: 7742.95Min: 3423.31 / Avg: 3476.65 / Max: 3514.84Min: 1231.41 / Avg: 1235.16 / Max: 1241.6Min: 3258.71 / Avg: 3342.16 / Max: 3385.17Min: 2999.36 / Avg: 3082.76 / Max: 3133.92

BlogBench

BlogBench is designed to replicate the load of a real-world busy file server by stressing the file-system with multiple threads of random reads, writes, and rewrites. The behavior is mimicked of that of a blog by creating blogs with content and pictures, modifying blog posts, adding comments to these blogs, and then reading the content of the blogs. All of these blogs generated are created locally with fake content and pictures. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.1Test: ReadTrueOS ZoFFreeBSD 12 ZFSDragonFlyBSD 5.4 HAMMER2Ubuntu 19.04 EXT4Ubuntu 19.04 ZOLUbuntu 19.04 F2FSClear Linux 27460 EXT4300K600K900K1200K1500KSE +/- 14594.06, N = 9SE +/- 21303.73, N = 4SE +/- 7428.31, N = 8SE +/- 17459.15, N = 3SE +/- 8876.49, N = 3SE +/- 5193.61, N = 3SE +/- 18609.44, N = 95476971363053617430133722351667114473291283725clangclanggccgccgccgccgcc
OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.1Test: ReadTrueOS ZoFFreeBSD 12 ZFSDragonFlyBSD 5.4 HAMMER2Ubuntu 19.04 EXT4Ubuntu 19.04 ZOLUbuntu 19.04 F2FSClear Linux 27460 EXT4300K600K900K1200K1500KMin: 487961 / Avg: 547697.33 / Max: 607661Min: 1322703 / Avg: 1363053.25 / Max: 1422578Min: 597648 / Avg: 617429.88 / Max: 664379Min: 1306310 / Avg: 1337223.33 / Max: 1366742Min: 500008 / Avg: 516670.67 / Max: 530307Min: 1439070 / Avg: 1447329 / Max: 1456914Min: 1245459 / Avg: 1283724.67 / Max: 1425050

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.1Test: WriteTrueOS ZoFFreeBSD 12 ZFSDragonFlyBSD 5.4 HAMMER2Ubuntu 19.04 EXT4Ubuntu 19.04 ZOLUbuntu 19.04 F2FSClear Linux 27460 EXT45K10K15K20K25KSE +/- 6.33, N = 3SE +/- 672.01, N = 3SE +/- 54.93, N = 3SE +/- 403.09, N = 3SE +/- 1126.04, N = 3SE +/- 70.77, N = 3SE +/- 1029.63, N = 3123363355062360452191341115249clanggccgccgccgccgcc
OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.1Test: WriteTrueOS ZoFFreeBSD 12 ZFSDragonFlyBSD 5.4 HAMMER2Ubuntu 19.04 EXT4Ubuntu 19.04 ZOLUbuntu 19.04 F2FSClear Linux 27460 EXT44K8K12K16K20KMin: 117 / Avg: 123.33 / Max: 136Min: 2307 / Avg: 3633 / Max: 4486Min: 5428 / Avg: 5506 / Max: 5612Min: 22818 / Avg: 23603.67 / Max: 24153Min: 3374 / Avg: 5219.33 / Max: 7260Min: 13301 / Avg: 13410.67 / Max: 13543Min: 13270 / Avg: 15249.33 / Max: 16731

20 Results Shown

SQLite
Flexible IO Tester:
  Rand Read - POSIX AIO - No - Yes - 4KB - Default Test Directory:
    MB/s
    IOPS
  Rand Write - POSIX AIO - No - Yes - 2MB - Default Test Directory:
    MB/s
  Rand Write - POSIX AIO - No - Yes - 4KB - Default Test Directory:
    MB/s
    IOPS
  Seq Read - POSIX AIO - No - Yes - 2MB - Default Test Directory:
    MB/s
  Seq Read - POSIX AIO - No - Yes - 4KB - Default Test Directory:
    MB/s
    IOPS
  Seq Write - POSIX AIO - No - Yes - 2MB - Default Test Directory:
    MB/s
  Seq Write - POSIX AIO - No - Yes - 4KB - Default Test Directory:
    MB/s
    IOPS
IOzone
Compile Bench:
  Compile
  Initial Create
  Read Compiled Tree
PostgreSQL pgbench:
  Buffer Test - Normal Load - Read Only
  Buffer Test - Normal Load - Read Write
BlogBench:
  Read
  Write