FreeBSD 12.0 ZFS vs. ZoL Benchmarks

FreeBSD 12.0 ZFS benchmarks for a future article.

HTML result view exported from: https://openbenchmarking.org/result/1904258-SP-1904234HV78&grw.

FreeBSD 12.0 ZFS vs. ZoL BenchmarksProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelCompilerFile-SystemScreen ResolutionDesktopDisplay ServerDisplay DriverOpenGLFreeBSD iX ZoLFreeBSD ZFSFreeBSD UFSUbuntu 18.04 EXT4Ubuntu 18.04 ZoLDebian Stretch ZoLIntel Xeon E3-1275 v6 @ 3.80GHz (8 Cores)ASUS P10S-M WSIntel Xeon E3-1200 v6/7th Gen Core Registers16384MBSamsung SSD 970 EVO Plus 500GBIntel HD P630Intel Sunrise Point HDAFreeBSD12.0-STABLE (x86_64)Clang 8.0.0 (SVN 356365)zfs800x60012.0-RELEASE (x86_64)Clang 6.0.1 (SVN 335540)ufsIntel Xeon E3-1275 v6 @ 4.20GHz (4 Cores / 8 Threads)ASUS P10S-M WS (4401 BIOS)Intel Xeon E3-1200 v6/7thIntel HD P630 3GB (1150MHz)Realtek ALC1150Acer B286HK + DELL P2415Q2 x Intel I210Ubuntu 18.044.18.0-17-generic (x86_64)GNOME Shell 3.28.3X Server 1.20.1modesetting 1.20.14.5 Mesa 18.2.8GCC 7.3.0ext41920x1080zfsAMD Ryzen Threadripper 2950X 16-Core @ 3.50GHz (16 Cores / 32 Threads)ASRock X399 Taichi (P3.30 BIOS)AMD Device 14504 x 16384 MB DDR4-1200MHz3 x 4001GB TOSHIBA MD04ACA4 + 2 x 4001GB Western Digital WD40EZRZ-00G + 4001GB HGST HDS724040AL + 4001GB Seagate ST4000VN008-2DR1 + 4001GB Western Digital WD40EZRX-00S + 512GB SPCC Solid State + 60GB Corsair Force LS + 4001GB TOSHIBA HDWE140 + 3 x 128GB ADATA SP900NS38amdgpudrmfb (1206/1750MHz)AMD Device aae02 x Intel I211 + Mellanox MT26448 + Intel Device 24fbDebian 9.84.19.0-0.bpo.4-amd64 (x86_64)GCC 6.3.0 20170516OpenBenchmarking.orgPython Details- FreeBSD iX ZoL: Python 3.6.8Security Details- FreeBSD iX ZoL: KPTI- FreeBSD ZFS: KPTI- FreeBSD UFS: KPTI- Ubuntu 18.04 EXT4: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW STIBP + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable- Ubuntu 18.04 ZoL: KPTI + __user pointer sanitization + Full generic retpoline IBPB IBRS_FW STIBP + SSB disabled via prctl and seccomp + PTE Inversion; VMX: conditional cache flushes SMT vulnerable- Debian Stretch ZoL: __user pointer sanitization + Full AMD retpoline IBPB: conditional STIBP: disabled RSB filling + SSB disabled via prctl and seccompCompiler Details- Ubuntu 18.04 EXT4: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- Ubuntu 18.04 ZoL: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic --without-cuda-driver -v- Debian Stretch ZoL: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -vDisk Details- Ubuntu 18.04 EXT4: NONE / errors=remount-ro,relatime,rwProcessor Details- Ubuntu 18.04 EXT4: Scaling Governor: intel_pstate powersave- Ubuntu 18.04 ZoL: Scaling Governor: intel_pstate powersave- Debian Stretch ZoL: Scaling Governor: acpi-cpufreq conservativeDisk Scheduler Details- Ubuntu 18.04 ZoL: NONE

FreeBSD 12.0 ZFS vs. ZoL Benchmarksdbench: 1dbench: 6iozone: 4Kb - 512MB - Read Performanceiozone: 4Kb - 512MB - Write Performancepostmark: Disk Transaction Performanceblogbench: Readblogbench: Writesqlite: Timed SQLite InsertionsFreeBSD iX ZoLFreeBSD ZFSFreeBSD UFSUbuntu 18.04 EXT4Ubuntu 18.04 ZoLDebian Stretch ZoL132423248991170761378135417822.38252490251485569471313846341727.2184528434060167237961255659266560.992265644131366975853583587339.35100.66312223789338863329051893227.04207.58283192064.121083568999422613.82OpenBenchmarking.org

Dbench

Client Count: 1

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 1FreeBSD iX ZoLFreeBSD ZFSFreeBSD UFSUbuntu 18.04 EXT4Ubuntu 18.04 ZoLDebian Stretch ZoL2004006008001000SE +/- 0.09, N = 3SE +/- 0.15, N = 3SE +/- 0.70, N = 3SE +/- 0.83, N = 9SE +/- 0.07, N = 3SE +/- 1.58, N = 3132.00252.00845.0060.99100.66207.58

Dbench

Client Count: 6

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 6FreeBSD iX ZoLFreeBSD ZFSFreeBSD UFSUbuntu 18.04 EXT4Ubuntu 18.04 ZoLDebian Stretch ZoL6001200180024003000SE +/- 2.00, N = 3SE +/- 0.52, N = 3SE +/- 13.00, N = 3SE +/- 3.63, N = 3SE +/- 0.34, N = 3SE +/- 2.54, N = 34234902843226312283

IOzone

Record Size: 4Kb - File Size: 512MB - Disk Test: Read Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 512MB - Disk Test: Read PerformanceFreeBSD iX ZoLFreeBSD ZFSFreeBSD UFSUbuntu 18.04 EXT4Ubuntu 18.04 ZoLDebian Stretch ZoL12002400360048006000SE +/- 22.05, N = 3SE +/- 22.22, N = 11SE +/- 3.91, N = 3SE +/- 92.53, N = 12SE +/- 18.29, N = 3SE +/- 299.08, N = 9248925144060564422371920

IOzone

Record Size: 4Kb - File Size: 512MB - Disk Test: Write Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 512MB - Disk Test: Write PerformanceFreeBSD iX ZoLFreeBSD ZFSFreeBSD UFSUbuntu 18.04 EXT4Ubuntu 18.04 ZoLDebian Stretch ZoL400800120016002000SE +/- 1.30, N = 3SE +/- 13.24, N = 3SE +/- 8.99, N = 3SE +/- 18.66, N = 3SE +/- 4.04, N = 3SE +/- 13.46, N = 9911.00855.001672.001313.00893.0064.12

PostMark

Disk Transaction Performance

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceFreeBSD iX ZoLFreeBSD ZFSFreeBSD UFSUbuntu 18.04 EXT4Ubuntu 18.04 ZoLDebian Stretch ZoL15003000450060007500SE +/- 66.00, N = 3SE +/- 111.44, N = 3SE +/- 57.70, N = 15SE +/- 59.33, N = 3SE +/- 20.00, N = 3SE +/- 4.10, N = 3707669473796669738861083clangclangclanggccgccgcc

BlogBench

Test: Read

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.1Test: ReadFreeBSD iX ZoLFreeBSD ZFSFreeBSD UFSUbuntu 18.04 EXT4Ubuntu 18.04 ZoLDebian Stretch ZoL300K600K900K1200K1500KSE +/- 24290.33, N = 9SE +/- 12811.27, N = 9SE +/- 59738.49, N = 9SE +/- 14788.62, N = 9SE +/- 6586.79, N = 9SE +/- 66989.71, N = 9137813513138461255659585358332905568999clangclangclanggccgccgcc

BlogBench

Test: Write

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.1Test: WriteFreeBSD iX ZoLFreeBSD ZFSFreeBSD UFSUbuntu 18.04 EXT4Ubuntu 18.04 ZoLDebian Stretch ZoL8K16K24K32K40KSE +/- 358.54, N = 3SE +/- 494.73, N = 3SE +/- 581.92, N = 3SE +/- 845.64, N = 3SE +/- 2614.11, N = 3SE +/- 800.94, N = 341783417266535873189324226clangclanggccgccgcc

SQLite

Timed SQLite Insertions

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite InsertionsFreeBSD iX ZoLFreeBSD ZFSUbuntu 18.04 EXT4Ubuntu 18.04 ZoLDebian Stretch ZoL918273645SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.22, N = 322.3827.2139.3527.0413.82

Phoronix Test Suite v10.8.4