TrueOS ZoF vs. FreeBSD ZFS vs. ZFS On Linux, Etc

Intel Xeon E3-1280 v5 testing of ZFS on BSDs and Linux among other OS file-system tests by Michael Larabel.

HTML result view exported from: https://openbenchmarking.org/result/1901268-SP-ZFSBSDLIN95&grt&sor.

TrueOS ZoF vs. FreeBSD ZFS vs. ZFS On Linux, EtcProcessorMotherboardChipsetMemoryDiskAudioNetworkGraphicsMonitorOSKernelCompilerFile-SystemScreen ResolutionDesktopDisplay ServerDisplay DriverTrueOS ZoFFreeBSD 12 ZFSDragonFlyBSD 5.4 HAMMER2Ubuntu 19.04 EXT4Ubuntu 19.04 ZOLUbuntu 19.04 F2FSClear Linux 27460 EXT4Intel Xeon E3-1280 v5 @ 3.70GHz (8 Cores)MSI MS-7998 1.0Intel Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Registers32768MBGeneric NVMe DeviceIntel Sunrise Point HDAIntel PRO/1000 ConnectionFreeBSD13.0-CURRENT (x86_64)Clang 7.0.1 (SVN 349250)zfs12.0-RELEASE (x86_64)Clang 6.0.1 (SVN 335540)1024x768Intel Xeon E3-1280 v5 @ 3.70GHz (4 Cores / 8 Threads)NVME-PCIeIntel PRO/1000 Connection PCH_SPT_I219_V2 7.6.2DragonFly5.4-RELEASE (x86_64)GCC 8.1hammer2Intel Xeon E3-1280 v5 @ 4.00GHz (4 Cores / 8 Threads)MSI Z170A SLI PLUS (MS-7998) v1.0 (2.90 BIOS)Intel Xeon E3-1200 v5/E3-1500256GB TOSHIBA-RD400ASUS AMD Radeon HD 7850 / R7 265 R9 270 1024SPRealtek ALC1150VE228Intel I219-VUbuntu 19.044.18.0-11-generic (x86_64)GNOME Shell 3.30.2X Server 1.20.3modesetting 1.20.3GCC 8.2.0ext41920x1080zfsf2fsClear Linux OS 274604.20.4-686.native (x86_64)GCC 8.2.1 20180502 + Clang 7.0.1 + LLVM 7.0.1ext4OpenBenchmarking.orgPython Details- TrueOS ZoF: Python 2.7.15 + Python 3.6.8- FreeBSD 12 ZFS: Python 2.7.15 + Python 3.6.7- DragonFlyBSD 5.4 HAMMER2: Python 2.7.15 + Python 3.6.7- Ubuntu 19.04 EXT4: Python 2.7.15+ + Python 3.7.2rc1- Ubuntu 19.04 ZOL: Python 2.7.15+ + Python 3.7.2rc1- Ubuntu 19.04 F2FS: Python 2.7.15+ + Python 3.7.2rc1- Clear Linux 27460 EXT4: Python 3.7.2Security Details- TrueOS ZoF: KPTI- FreeBSD 12 ZFS: KPTI- DragonFlyBSD 5.4 HAMMER2: Meltdown Mitigation- Ubuntu 19.04 EXT4: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable- Ubuntu 19.04 ZOL: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable- Ubuntu 19.04 F2FS: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable- Clear Linux 27460 EXT4: KPTI + __user pointer sanitization + Full generic retpoline STIBP: disabled RSB filling + PTE Inversion; VMX: conditional cache flushes SMT vulnerableCompiler Details- Ubuntu 19.04 EXT4: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - Ubuntu 19.04 ZOL: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - Ubuntu 19.04 F2FS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v - Clear Linux 27460 EXT4: --build=x86_64-generic-linux --disable-libmpx --disable-libunwind-exceptions --disable-multiarch --disable-vtable-verify --enable-__cxa_atexit --enable-bootstrap --enable-clocale=gnu --enable-gnu-indirect-function --enable-languages=c,c++,fortran,go --enable-ld=default --enable-libstdcxx-pch --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --exec-prefix=/usr --includedir=/usr/include --target=x86_64-generic-linux --with-arch=westmere --with-glibc-version=2.19 --with-gnu-ld --with-isl --with-ppl=yes --with-tune=haswell Disk Details- Ubuntu 19.04 EXT4: NONE / errors=remount-ro,relatime,rw- Ubuntu 19.04 F2FS: NONE / acl,active_logs=6,alloc_mode=default,background_gc=on,extent_cache,flush_merge,fsync_mode=posix,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr- Clear Linux 27460 EXT4: MQ-DEADLINE / relatime,rw,stripe=256Processor Details- Ubuntu 19.04 EXT4: Scaling Governor: intel_pstate powersave- Ubuntu 19.04 ZOL: Scaling Governor: intel_pstate powersave- Ubuntu 19.04 F2FS: Scaling Governor: intel_pstate powersave- Clear Linux 27460 EXT4: Scaling Governor: intel_pstate performanceDisk Scheduler Details- Ubuntu 19.04 ZOL: NONEEnvironment Details- Clear Linux 27460 EXT4: CFFLAGS=-g-O3-feliminate-unused-debug-types-pipe-Wall-Wp-D_FORTIFY_SOURCE=2-fexceptions-fstack-protector--param=ssp-buffer-size=32-Wl--copy-dt-needed-entries-m64-fasynchronous-unwind-tables-Wp-D_REENTRANT-ftree-loop-distribute-patterns-Wl-z-Wl now-Wl-z-Wl relro-malign-data=abi-fno-semantic-interposition-ftree-vectorize-ftree-loop-vectorize-Wl-sort-common-Wl--enable-new-dtags FFLAGS=-g-O3-feliminate-unused-debug-types-pipe-Wall-Wp-D_FORTIFY_SOURCE=2-fexceptions-fstack-protector--param=ssp-buffer-size=32-Wl--copy-dt-needed-entries-m64-fasynchronous-unwind-tables-Wp-D_REENTRANT-ftree-loop-distribute-patterns-Wl-z-Wl relro-malign-data=abi-fno-semantic-interposition-ftree-vectorize-ftree-loop-vectorize-Wl--enable-new-dtags CXXFLAGS=-g-O3-feliminate-unused-debug-types-pipe-Wall-Wp-D_FORTIFY_SOURCE=2-fexceptions-fstack-protector--param=ssp-buffer-size=32-Wformat-Wformat-security-Wl--copy-dt-needed-entries-m64-fasynchronous-unwind-tables-Wp-D_REENTRANT-ftree-loop-distribute-patterns-Wl-z-Wl relro-fno-semantic-interposition-ffat-lto-objects-fno-signed-zeros-fno-trapping-math-fassociative-math-Wl-sort-common-Wl--enable-new-dtags-mtune=skylake-fvisibility-inlines-hidden-Wl--enable-new-dtags CFLAGS=-g-O3-feliminate-unused-debug-types-pipe-Wall-Wp-D_FORTIFY_SOURCE=2-fexceptions-fstack-protector--param=ssp-buffer-size=32-Wformat-Wformat-security-Wl--copy-dt-needed-entries-m64-fasynchronous-unwind-tables-Wp-D_REENTRANT-ftree-loop-distribute-patterns-Wl-z-Wl relro-fno-semantic-interposition-ffat-lto-objects-fno-signed-zeros-fno-trapping-math-fassociative-math-Wl-sort-common-Wl--enable-new-dtags-mtune=skylake THEANO_FLAGS=floatX=float32 openmp=true gcc.cxxflags="-ftree-vectorize-mavx"

TrueOS ZoF vs. FreeBSD ZFS vs. ZFS On Linux, Etcblogbench: Readblogbench: Writecompilebench: Compilecompilebench: Initial Createcompilebench: Read Compiled Treefio: Rand Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryiozone: 1MB - 8GB - Write Performancepgbench: Buffer Test - Normal Load - Read Onlypgbench: Buffer Test - Normal Load - Read Writesqlite: Timed SQLite InsertionsTrueOS ZoFFreeBSD 12 ZFSDragonFlyBSD 5.4 HAMMER2Ubuntu 19.04 EXT4Ubuntu 19.04 ZOLUbuntu 19.04 F2FSClear Linux 27460 EXT454769712373982.023151116285667209883.78214423751881225667226310627000167936555233359.10136305336332601271.1912121571402333627910182606675237145637300063451049268667593383814245150.216174305506661102.1496114479524474734.061337223236042100556.60292837.8310012345986764731580533108825064100957111396347764.2251667152191136234.93139171840070123568.881447329134112828621.13315237.5099822256500659307786001106258661001039110731334295.751283725152491958505.56302225.437511644200065741.601066778116542267862115850308366.17OpenBenchmarking.org

BlogBench

Test: Read

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.1Test: ReadUbuntu 19.04 F2FSFreeBSD 12 ZFSUbuntu 19.04 EXT4Clear Linux 27460 EXT4DragonFlyBSD 5.4 HAMMER2TrueOS ZoFUbuntu 19.04 ZOL300K600K900K1200K1500KSE +/- 5193.61, N = 3SE +/- 21303.73, N = 4SE +/- 17459.15, N = 3SE +/- 18609.44, N = 9SE +/- 7428.31, N = 8SE +/- 14594.06, N = 9SE +/- 8876.49, N = 31447329136305313372231283725617430547697516671

BlogBench

Test: Write

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.1Test: WriteUbuntu 19.04 EXT4Clear Linux 27460 EXT4Ubuntu 19.04 F2FSDragonFlyBSD 5.4 HAMMER2Ubuntu 19.04 ZOLFreeBSD 12 ZFSTrueOS ZoF5K10K15K20K25KSE +/- 403.09, N = 3SE +/- 1029.63, N = 3SE +/- 70.77, N = 3SE +/- 54.93, N = 3SE +/- 1126.04, N = 3SE +/- 672.01, N = 3SE +/- 6.33, N = 3236041524913411550652193633123

Compile Bench

Test: Compile

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileUbuntu 19.04 F2FSFreeBSD 12 ZFSUbuntu 19.04 EXT4Clear Linux 27460 EXT4Ubuntu 19.04 ZOLTrueOS ZoFDragonFlyBSD 5.4 HAMMER26001200180024003000SE +/- 1.42, N = 3SE +/- 6.36, N = 3SE +/- 13.86, N = 3SE +/- 27.67, N = 12SE +/- 36.05, N = 12SE +/- 1.21, N = 3SE +/- 31.67, N = 928282601210019581136739661

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateUbuntu 19.04 F2FSUbuntu 19.04 EXT4Clear Linux 27460 EXT4FreeBSD 12 ZFSUbuntu 19.04 ZOLDragonFlyBSD 5.4 HAMMER2TrueOS ZoF130260390520650SE +/- 3.29, N = 3SE +/- 4.86, N = 3SE +/- 8.40, N = 3SE +/- 0.89, N = 3SE +/- 0.31, N = 3SE +/- 1.51, N = 3SE +/- 0.38, N = 3621.13556.60505.56271.19234.93102.1482.02

Compile Bench

Test: Read Compiled Tree

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Read Compiled TreeUbuntu 19.04 F2FSClear Linux 27460 EXT4Ubuntu 19.04 EXT4Ubuntu 19.04 ZOLFreeBSD 12 ZFSDragonFlyBSD 5.4 HAMMER2TrueOS ZoF7001400210028003500SE +/- 20.69, N = 3SE +/- 22.32, N = 3SE +/- 17.77, N = 3SE +/- 38.37, N = 3SE +/- 1.38, N = 3SE +/- 5.42, N = 3SE +/- 0.44, N = 331523022292813911212961315

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryFreeBSD 12 ZFSTrueOS ZoFUbuntu 19.04 EXT4Ubuntu 19.04 F2FSClear Linux 27460 EXT430060090012001500SE +/- 1.53, N = 3SE +/- 1.45, N = 3SE +/- 0.15, N = 3SE +/- 0.25, N = 3SE +/- 0.15, N = 31571.001116.0037.8337.5025.43

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryFreeBSD 12 ZFSTrueOS ZoF90K180K270K360K450KSE +/- 333.33, N = 3SE +/- 333.33, N = 34023332856671. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryFreeBSD 12 ZFSTrueOS ZoFUbuntu 19.04 EXT4Ubuntu 19.04 F2FSClear Linux 27460 EXT413002600390052006500SE +/- 27.47, N = 3SE +/- 63.71, N = 9SE +/- 6.96, N = 3SE +/- 4.70, N = 3SE +/- 2.08, N = 3627920981001998751

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryFreeBSD 12 ZFSUbuntu 19.04 EXT4Ubuntu 19.04 F2FSClear Linux 27460 EXT4TrueOS ZoF2004006008001000SE +/- 6.77, N = 3SE +/- 4.33, N = 3SE +/- 1.00, N = 3SE +/- 2.22, N = 121018.00234.00222.00164.0083.78

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryFreeBSD 12 ZFSUbuntu 19.04 EXT4Ubuntu 19.04 F2FSClear Linux 27460 EXT4TrueOS ZoF60K120K180K240K300KSE +/- 1855.92, N = 3SE +/- 1083.72, N = 3SE +/- 264.58, N = 3SE +/- 200.00, N = 3SE +/- 569.35, N = 1226066759867565004200021442

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryFreeBSD 12 ZFSTrueOS ZoFUbuntu 19.04 F2FSClear Linux 27460 EXT4Ubuntu 19.04 EXT411002200330044005500SE +/- 6.89, N = 3SE +/- 2.52, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 352373751659657647

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryFreeBSD 12 ZFSTrueOS ZoFUbuntu 19.04 EXT4Ubuntu 19.04 F2FSClear Linux 27460 EXT430060090012001500SE +/- 0.67, N = 3SE +/- 0.58, N = 3SE +/- 1.86, N = 3SE +/- 2.89, N = 3SE +/- 0.10, N = 31456.00881.00315.00307.0041.60

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryFreeBSD 12 ZFSTrueOS ZoFUbuntu 19.04 EXT4Ubuntu 19.04 F2FSClear Linux 27460 EXT480K160K240K320K400KSE +/- 333.33, N = 3SE +/- 470.22, N = 3SE +/- 723.42, N = 3SE +/- 33.33, N = 3373000225667805337860010667

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryFreeBSD 12 ZFSTrueOS ZoFUbuntu 19.04 F2FSUbuntu 19.04 EXT4Clear Linux 27460 EXT414002800420056007000SE +/- 61.49, N = 3SE +/- 53.96, N = 9SE +/- 3.00, N = 3SE +/- 10.54, N = 3SE +/- 5.13, N = 36345226311061088781

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryFreeBSD 12 ZFSUbuntu 19.04 F2FSUbuntu 19.04 EXT4Clear Linux 27460 EXT4TrueOS ZoF2004006008001000SE +/- 5.17, N = 3SE +/- 1.73, N = 3SE +/- 3.38, N = 3SE +/- 0.33, N = 31049258250165106

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryFreeBSD 12 ZFSUbuntu 19.04 F2FSUbuntu 19.04 EXT4Clear Linux 27460 EXT4TrueOS ZoF60K120K180K240K300KSE +/- 1333.33, N = 3SE +/- 435.89, N = 3SE +/- 862.17, N = 3SE +/- 88.19, N = 3SE +/- 57.74, N = 326866766100641004226727000

IOzone

Record Size: 1MB - File Size: 8GB - Disk Test: Write Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Write PerformanceFreeBSD 12 ZFSTrueOS ZoFDragonFlyBSD 5.4 HAMMER2Ubuntu 19.04 F2FSUbuntu 19.04 EXT4Clear Linux 27460 EXT4Ubuntu 19.04 ZOL13002600390052006500SE +/- 245.95, N = 12SE +/- 3.92, N = 3SE +/- 66.13, N = 12SE +/- 5.42, N = 3SE +/- 5.22, N = 3SE +/- 11.69, N = 12SE +/- 29.87, N = 105933167914471039957862718clangclanggccgccgccgccgcc

PostgreSQL pgbench

Scaling: Buffer Test - Test: Normal Load - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Buffer Test - Test: Normal Load - Mode: Read OnlyClear Linux 27460 EXT4Ubuntu 19.04 EXT4Ubuntu 19.04 F2FSDragonFlyBSD 5.4 HAMMER2FreeBSD 12 ZFSUbuntu 19.04 ZOLTrueOS ZoF20K40K60K80K100KSE +/- 65.73, N = 3SE +/- 89.21, N = 3SE +/- 131.63, N = 3SE +/- 85.28, N = 3SE +/- 42.26, N = 3SE +/- 43.59, N = 3SE +/- 508.37, N = 611585011139611073195244838144007036555-O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math -mtune=skylake -lpgcommon -lpgport -lpq -lrt -lcrypt -ldl -lm-O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm-O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm-O2 -fPIC -shared-O2 -fPIC -lpgport -shared-O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm-O2 -fPIC -lpgport -shared1. (CC) gcc options: -fno-strict-aliasing -fwrapv

PostgreSQL pgbench

Scaling: Buffer Test - Test: Normal Load - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Buffer Test - Test: Normal Load - Mode: Read WriteDragonFlyBSD 5.4 HAMMER2Ubuntu 19.04 EXT4Ubuntu 19.04 F2FSClear Linux 27460 EXT4FreeBSD 12 ZFSTrueOS ZoFUbuntu 19.04 ZOL16003200480064008000SE +/- 137.30, N = 3SE +/- 27.49, N = 3SE +/- 41.73, N = 3SE +/- 42.06, N = 3SE +/- 19.40, N = 3SE +/- 13.58, N = 3SE +/- 3.23, N = 37473347733423083245123331235-O2 -fPIC -shared-O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm-O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm-O3 -pipe -fexceptions -fstack-protector -m64 -ffat-lto-objects -fno-signed-zeros -fno-trapping-math -fassociative-math -mtune=skylake -lpgcommon -lpgport -lpq -lrt -lcrypt -ldl -lm-O2 -fPIC -lpgport -shared-O2 -fPIC -lpgport -shared-O2 -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm1. (CC) gcc options: -fno-strict-aliasing -fwrapv

SQLite

Timed SQLite Insertions

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite InsertionsDragonFlyBSD 5.4 HAMMER2FreeBSD 12 ZFSTrueOS ZoFUbuntu 19.04 EXT4Clear Linux 27460 EXT4Ubuntu 19.04 ZOLUbuntu 19.04 F2FS20406080100SE +/- 0.07, N = 12SE +/- 0.33, N = 3SE +/- 0.06, N = 3SE +/- 0.09, N = 3SE +/- 0.27, N = 3SE +/- 0.22, N = 3SE +/- 0.06, N = 34.0650.2159.1064.2266.1768.8895.75

Phoronix Test Suite v10.8.4