pts-disk-different-nvmes

AMD Ryzen Threadripper 1900X 8-Core testing with a Gigabyte X399 DESIGNARE EX-CF (F13a BIOS) and NVIDIA Quadro P400 on Debian 11 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2211135-NE-PTSDISKDI63&grs.

pts-disk-different-nvmesProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelCompilerFile-SystemScreen ResolutionZFS zraid1 4xNVME Poolext4 mdadm raid5 4xNVMEext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no CompressionAMD Ryzen Threadripper 1900X 8-Core @ 3.80GHz (8 Cores / 16 Threads)Gigabyte X399 DESIGNARE EX-CF (F13a BIOS)AMD 17h64GBSamsung SSD 960 EVO 500GB + 8 x 2000GB Western Digital WD_BLACK SN770 2TB + 1000GB CT1000P5PSSD8NVIDIA Quadro P400NVIDIA GP107GL HD AudioDELL S2340T4 x Intel I350 + Intel 8265 / 8275Debian 115.10.0-19-amd64 (x86_64)GCC 10.2.1 20210110zfs1920x1080ext4zfsOpenBenchmarking.orgKernel Details- Transparent Huge Pages: alwaysCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0x8001137Disk Scheduler Details- ZFS zraid1 4xNVME Pool, ZFS zraid1 8xNVME Pool, ZFS zraid1 8xNVME Pool no Compression: NONEPython Details- Python 3.9.2Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT vulnerable + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected Disk Details- ext4 mdadm raid5 4xNVME: NONE / relatime,rw,stripe=384 / raid5 nvme4n1p1[4] nvme3n1p1[2] nvme2n1p1[1] nvme1n1p1[0] Block Size: 4096- ext4 Crucial P5 Plus 1TB NVME: NONE / relatime,rw / Block Size: 4096

pts-disk-different-nvmesfio: Rand Read - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 4KB - Default Test Directorydbench: 1 Clientsdbench: 12 Clientsfio: Seq Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Write - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Write - Linux AIO - No - Yes - 2MB - Default Test Directorycompilebench: Read Compiled Treecompilebench: Initial Createfio: Seq Write - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Write - Linux AIO - No - Yes - 4KB - Default Test Directorysqlite: 8postmark: Disk Transaction Performancefs-mark: 1000 Files, 1MB Size, No Sync/FSyncfio: Seq Read - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - No - Yes - 4KB - Default Test Directorysqlite: 32sqlite: 128sqlite: 64fio: Rand Read - Linux AIO - No - Yes - 2MB - Default Test Directorycompilebench: Compilefio: Seq Read - Linux AIO - No - Yes - 2MB - Default Test Directorysqlite: 1fs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 1000 Files, 1MB SizeZFS zraid1 4xNVME Poolext4 mdadm raid5 4xNVMEext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no Compression4956719416241500410.1712626.032034211912252458102920651212.73222.0467017133311.26732891359.3329333128723.19176.08837.44842451398.5740757.852684.21632.7646.5306667119932482967453.1702484.856706666647695865013082642.03411.0744911500020.00550681733.322133386531.79380.14545.7201478.008.810284.7537.9254.03296671286878224667102.985658.7941765176516233252161432362747.01423.6789122800015.76751371791.6335667131127.57859.89040.97935381483.0735388.367435.0522.1584.15743322417745367380.3542472.421999201513272661118623811217.80221.8366517066712.85732751340.7326333127526.99978.15340.30140371390.7140058.380644.71655.6646.75616721918848200458.9132783.641995208113372681122024461694.75206.7768217466712.82732751160.9331000129426.89277.04740.00341701247.3639988.379592.11240.0589.7OpenBenchmarking.org

Flexible IO Tester

Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryZFS zraid1 4xNVME Poolext4 mdadm raid5 4xNVMEext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no Compression70K140K210K280K350KSE +/- 185.59, N = 3SE +/- 1333.33, N = 3SE +/- 881.92, N = 3SE +/- 176.38, N = 3SE +/- 633.33, N = 34956730666732966757433561671. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryZFS zraid1 4xNVME Poolext4 mdadm raid5 4xNVMEext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no Compression30060090012001500SE +/- 0.88, N = 3SE +/- 5.17, N = 3SE +/- 3.48, N = 3SE +/- 0.67, N = 3SE +/- 2.67, N = 3194119912862242191. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryZFS zraid1 4xNVME Poolext4 mdadm raid5 4xNVMEext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no Compression2004006008001000SE +/- 2.00, N = 3SE +/- 2.67, N = 31623248781771881. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryZFS zraid1 4xNVME Poolext4 mdadm raid5 4xNVMEext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no Compression50K100K150K200K250KSE +/- 57.74, N = 3SE +/- 569.60, N = 3SE +/- 666.67, N = 3SE +/- 33.33, N = 3SE +/- 57.74, N = 3415008296722466745367482001. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Dbench

1 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.01 ClientsZFS zraid1 4xNVME Poolext4 mdadm raid5 4xNVMEext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no Compression100200300400500SE +/- 0.85, N = 3SE +/- 0.61, N = 3SE +/- 0.03, N = 3SE +/- 0.25, N = 3SE +/- 1.41, N = 3410.17453.17102.99380.35458.911. (CC) gcc options: -lpopt -O2

Dbench

12 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.012 ClientsZFS zraid1 4xNVME Poolext4 mdadm raid5 4xNVMEext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no Compression6001200180024003000SE +/- 5.07, N = 3SE +/- 21.52, N = 3SE +/- 1.20, N = 3SE +/- 2.03, N = 3SE +/- 16.46, N = 32626.032484.85658.792472.422783.641. (CC) gcc options: -lpopt -O2

Flexible IO Tester

Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryZFS zraid1 4xNVME Poolext4 mdadm raid5 4xNVMEext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no Compression14002800420056007000SE +/- 18.75, N = 3SE +/- 3.61, N = 3SE +/- 25.32, N = 3SE +/- 23.68, N = 3203467061765199919951. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryZFS zraid1 4xNVME Poolext4 mdadm raid5 4xNVMEext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no Compression14002800420056007000SE +/- 29.49, N = 3SE +/- 14.99, N = 3SE +/- 6.57, N = 3SE +/- 20.66, N = 3211966661765201520811. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryZFS zraid1 4xNVME Poolext4 mdadm raid5 4xNVMEext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no Compression30060090012001500SE +/- 8.99, N = 3SE +/- 1.76, N = 3SE +/- 4.91, N = 312254761623132713371. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryZFS zraid1 4xNVME Poolext4 mdadm raid5 4xNVMEext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no Compression7001400210028003500SE +/- 17.98, N = 3SE +/- 3.53, N = 3SE +/- 10.27, N = 3SE +/- 6.39, N = 324589583252266126811. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryZFS zraid1 4xNVME Poolext4 mdadm raid5 4xNVMEext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no Compression30060090012001500SE +/- 2.91, N = 3SE +/- 0.88, N = 3SE +/- 2.85, N = 3SE +/- 2.33, N = 3SE +/- 11.98, N = 1510296501614118612201. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryZFS zraid1 4xNVME Poolext4 mdadm raid5 4xNVMEext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no Compression7001400210028003500SE +/- 6.36, N = 3SE +/- 1.73, N = 3SE +/- 5.70, N = 3SE +/- 4.67, N = 3SE +/- 23.91, N = 15206513083236238124461. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Compile Bench

Test: Read Compiled Tree

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Read Compiled TreeZFS zraid1 4xNVME Poolext4 mdadm raid5 4xNVMEext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no Compression6001200180024003000SE +/- 8.00, N = 3SE +/- 42.24, N = 3SE +/- 8.94, N = 3SE +/- 8.89, N = 3SE +/- 19.98, N = 31212.732642.032747.011217.801694.75

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateZFS zraid1 4xNVME Poolext4 mdadm raid5 4xNVMEext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no Compression90180270360450SE +/- 1.57, N = 3SE +/- 0.77, N = 3SE +/- 1.23, N = 3SE +/- 0.50, N = 3SE +/- 1.46, N = 3222.04411.07423.67221.83206.77

Flexible IO Tester

Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryZFS zraid1 4xNVME Poolext4 mdadm raid5 4xNVMEext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no Compression2004006008001000SE +/- 1.86, N = 3SE +/- 1.15, N = 3SE +/- 3.93, N = 3SE +/- 1.67, N = 3SE +/- 2.08, N = 36704498916656821. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryZFS zraid1 4xNVME Poolext4 mdadm raid5 4xNVMEext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no Compression50K100K150K200K250KSE +/- 666.67, N = 3SE +/- 577.35, N = 3SE +/- 1000.00, N = 3SE +/- 333.33, N = 3SE +/- 333.33, N = 31713331150002280001706671746671. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

SQLite

Threads / Copies: 8

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Threads / Copies: 8ZFS zraid1 4xNVME Poolext4 mdadm raid5 4xNVMEext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no Compression510152025SE +/- 0.08, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.17, N = 3SE +/- 0.17, N = 311.2720.0115.7712.8612.831. (CC) gcc options: -O2 -lz -lm -ldl -lpthread

PostMark

Disk Transaction Performance

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceZFS zraid1 4xNVME Poolext4 mdadm raid5 4xNVMEext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no Compression11002200330044005500SE +/- 34.00, N = 3SE +/- 35.33, N = 3SE +/- 29.00, N = 3SE +/- 14.33, N = 3328950685137327532751. (CC) gcc options: -O3

FS-Mark

Test: 1000 Files, 1MB Size, No Sync/FSync

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size, No Sync/FSyncZFS zraid1 4xNVME Poolext4 mdadm raid5 4xNVMEext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no Compression400800120016002000SE +/- 12.01, N = 15SE +/- 19.84, N = 4SE +/- 16.52, N = 3SE +/- 10.88, N = 15SE +/- 13.85, N = 41359.31733.31791.61340.71160.9

Flexible IO Tester

Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryZFS zraid1 4xNVME Poolext4 mdadm raid5 4xNVMEext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no Compression70K140K210K280K350KSE +/- 1855.92, N = 3SE +/- 2728.45, N = 3SE +/- 4666.67, N = 3SE +/- 3382.96, N = 3SE +/- 1000.00, N = 33293332213333356673263333310001. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Flexible IO Tester

Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryZFS zraid1 4xNVME Poolext4 mdadm raid5 4xNVMEext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no Compression30060090012001500SE +/- 7.09, N = 3SE +/- 11.46, N = 3SE +/- 17.89, N = 3SE +/- 13.25, N = 3SE +/- 4.84, N = 312878651311127512941. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

SQLite

Threads / Copies: 32

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Threads / Copies: 32ZFS zraid1 4xNVME Poolext4 mdadm raid5 4xNVMEext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no Compression714212835SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 323.1931.7927.5827.0026.891. (CC) gcc options: -O2 -lz -lm -ldl -lpthread

SQLite

Threads / Copies: 128

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Threads / Copies: 128ZFS zraid1 4xNVME Poolext4 mdadm raid5 4xNVMEext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no Compression20406080100SE +/- 0.10, N = 3SE +/- 0.28, N = 3SE +/- 0.03, N = 3SE +/- 0.10, N = 3SE +/- 0.27, N = 376.0980.1559.8978.1577.051. (CC) gcc options: -O2 -lz -lm -ldl -lpthread

SQLite

Threads / Copies: 64

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Threads / Copies: 64ZFS zraid1 4xNVME Poolext4 mdadm raid5 4xNVMEext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no Compression1020304050SE +/- 0.01, N = 3SE +/- 0.13, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 337.4545.7240.9840.3040.001. (CC) gcc options: -O2 -lz -lm -ldl -lpthread

Flexible IO Tester

Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryZFS zraid1 4xNVME Poolext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no Compression9001800270036004500SE +/- 58.64, N = 3SE +/- 13.37, N = 3SE +/- 41.66, N = 342453538403741701. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

Compile Bench

Test: Compile

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileZFS zraid1 4xNVME Poolext4 mdadm raid5 4xNVMEext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no Compression30060090012001500SE +/- 6.06, N = 3SE +/- 11.73, N = 3SE +/- 0.00, N = 3SE +/- 7.47, N = 3SE +/- 3.89, N = 31398.571478.001483.071390.711247.36

Flexible IO Tester

Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryZFS zraid1 4xNVME Poolext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no Compression9001800270036004500SE +/- 37.36, N = 3SE +/- 50.44, N = 3SE +/- 47.58, N = 340753538400539981. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

SQLite

Threads / Copies: 1

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Threads / Copies: 1ZFS zraid1 4xNVME Poolext4 mdadm raid5 4xNVMEext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no Compression246810SE +/- 0.071, N = 7SE +/- 0.069, N = 10SE +/- 0.067, N = 3SE +/- 0.096, N = 3SE +/- 0.104, N = 37.8528.8108.3678.3808.3791. (CC) gcc options: -O2 -lz -lm -ldl -lpthread

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeZFS zraid1 4xNVME Poolext4 mdadm raid5 4xNVMEext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no Compression150300450600750SE +/- 7.90, N = 3SE +/- 2.79, N = 3SE +/- 16.63, N = 12SE +/- 3.56, N = 3SE +/- 3.57, N = 3684.2284.7435.0644.7592.1

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsZFS zraid1 4xNVME Poolext4 mdadm raid5 4xNVMEext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no Compression400800120016002000SE +/- 4.95, N = 3SE +/- 4.55, N = 12SE +/- 125.73, N = 9SE +/- 6.18, N = 3SE +/- 2.97, N = 31632.7537.9522.11655.61240.0

FS-Mark

Test: 1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeZFS zraid1 4xNVME Poolext4 mdadm raid5 4xNVMEext4 Crucial P5 Plus 1TB NVMEZFS zraid1 8xNVME PoolZFS zraid1 8xNVME Pool no Compression140280420560700SE +/- 5.49, N = 15SE +/- 9.50, N = 15SE +/- 13.64, N = 12SE +/- 1.87, N = 3SE +/- 6.13, N = 3646.5254.0584.1646.7589.7


Phoronix Test Suite v10.8.5