3 x 3001GB Western Digital WD30EFRX-68E Processor: Intel Pentium Silver J5005 @ 2.80GHz (4 Cores), Motherboard: ASRock J5005-ITX (P1.40 BIOS), Memory: 16GB, Disk: 3 x 3001GB Western Digital WD30EFRX-68E + 240GB CT240BX500SSD1 + 500GB Samsung SSD 860, Graphics: (800MHz)
OS: Ubuntu 22.04.1 LTS, Kernel: 5.15.79 (x86_64), Compiler: GCC 11.3.0, File-System: zfs, System Layer: Docker
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x3cDisk Scheduler Notes: MQ-DEADLINEPython Notes: Python 3.10.6Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Mitigation of PTI + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F Processor: Intel Core i5-12400 @ 5.60GHz (6 Cores / 12 Threads) , Motherboard: ASRock B660M-ITX/ac (1.25 BIOS) , Memory: 64GB , Disk: 512GB KINGSTON SKC3000S512G , Graphics: EFI VGA , Audio: Realtek ALC897
OS: Ubuntu 22.04.1 LTS, Kernel: 5.15.79 (x86_64), Compiler: GCC 11.3.0, File-System: zfs, Screen Resolution: 800x600, System Layer: Docker
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vDisk Notes: NONE / attr2,inode64,logbsize=64k,logbufs=8,noquota,nouuid,relatime,rw,sunit=128,swidth=128 / Block Size: 131072Processor Notes: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x22Python Notes: Python 3.10.6Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
2022-11-26-2247 Processor Motherboard Memory Disk Graphics Audio OS Kernel Compiler File-System System Layer Screen Resolution 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F Intel Pentium Silver J5005 @ 2.80GHz (4 Cores) ASRock J5005-ITX (P1.40 BIOS) 16GB 3 x 3001GB Western Digital WD30EFRX-68E + 240GB CT240BX500SSD1 + 500GB Samsung SSD 860 (800MHz) Ubuntu 22.04.1 LTS 5.15.79 (x86_64) GCC 11.3.0 zfs Docker Intel Core i5-12400 @ 5.60GHz (6 Cores / 12 Threads) ASRock B660M-ITX/ac (1.25 BIOS) 64GB 512GB KINGSTON SKC3000S512G EFI VGA Realtek ALC897 800x600 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - 3 x 3001GB Western Digital WD30EFRX-68E: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x3c - ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x22 Disk Scheduler Details - 3 x 3001GB Western Digital WD30EFRX-68E: MQ-DEADLINE Python Details - Python 3.10.6 Security Details - 3 x 3001GB Western Digital WD30EFRX-68E: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Mitigation of PTI + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected Disk Details - ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F: NONE / attr2,inode64,logbsize=64k,logbufs=8,noquota,nouuid,relatime,rw,sunit=128,swidth=128 / Block Size: 131072
3 x 3001GB Western Digital WD30EFRX-68E vs. ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F Comparison Phoronix Test Suite Baseline +2189% +2189% +4378% +4378% +6567% +6567% 857.2% 8755.8% 702.3% 701.8% 7192.4% 7163.9% 697.1% 696.8% 614.6% 6633.4% 559.1% 5395.4% 5297.6% 4716.9% 4245.5% 4151.1% 3673.4% 3569.2% 3415.3% 3359% 3232% 3050.1% 3019.3% 249.5% 249.3% 2789.1% 2708.8% 2649.6% 2319% 2233.9% 2198.2% 2132.3% 2004.8% 163.8% 163.7% 163.2% 163.2% 143.6% 132.8% 131.3% 123.3% 101.2% 1897.1% 1648.7% 1077.3% 78.5% 57.8% 52.3% 50.4% D.T.P 5.F.1.S.4.T Seq Write - Linux AIO - No - Yes - 4KB Seq Write - Linux AIO - No - Yes - 4KB Rand Write - Linux AIO - No - Yes - 4KB Rand Write - Linux AIO - No - Yes - 4KB Seq Read - Linux AIO - No - Yes - 4KB Seq Read - Linux AIO - No - Yes - 4KB 1.F.1.S.N.S.F 12 Clients Initial Create 4.F.3.S.D.1.S 512MB 1.F.1.S 1024MB 2MB 128 4MB 1 Clients 8MB 16MB 256MB 32MB Rand Read - Linux AIO - No - Yes - 4KB Rand Read - Linux AIO - No - Yes - 4KB 64 64MB 32 Seq Write - Linux AIO - No - Yes - 2MB Seq Write - Linux AIO - No - Yes - 2MB Rand Write - Linux AIO - No - Yes - 2MB Rand Write - Linux AIO - No - Yes - 2MB Compile Seq Read - Linux AIO - No - Yes - 2MB Rand Read - Linux AIO - No - Yes - 2MB Seq Read - Linux AIO - No - Yes - 2MB Rand Read - Linux AIO - No - Yes - 2MB 1024MB - /pts_data 256MB - /pts_data 512MB - /pts_data 64MB - /pts_data 32MB - /pts_data 1 8 Read Compiled Tree 16MB - /pts_data 8MB - /pts_data 4MB - /pts_data 2MB - /pts_data PostMark FS-Mark Flexible IO Tester Flexible IO Tester Flexible IO Tester Flexible IO Tester Flexible IO Tester Flexible IO Tester FS-Mark Dbench Compile Bench FS-Mark IOR FS-Mark IOR IOR SQLite IOR Dbench IOR IOR IOR IOR Flexible IO Tester Flexible IO Tester SQLite IOR SQLite Flexible IO Tester Flexible IO Tester Flexible IO Tester Flexible IO Tester Compile Bench Flexible IO Tester Flexible IO Tester Flexible IO Tester Flexible IO Tester IOR IOR IOR IOR IOR SQLite SQLite Compile Bench IOR IOR IOR IOR 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F
IOR IOR is a parallel I/O storage benchmark making use of MPI with a particular focus on HPC (High Performance Computing) systems. IOR is developed at the Lawrence Livermore National Laboratory (LLNL). Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org MB/s, More Is Better IOR 3.3.0 Block Size: 512MB - Disk Target: Default Test Directory 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 700 1400 2100 2800 3500 SE +/- 0.53, N = 9 SE +/- 39.51, N = 3 58.43 3153.81 MIN: 2408.94 / MAX: 3905.29 1. (CC) gcc options: -O2 -lm -lmpi
SQLite This is a simple benchmark of SQLite. At present this test profile just measures the time to perform a pre-defined number of insertions on an indexed database. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better SQLite 3.30.1 Threads / Copies: 128 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 600 1200 1800 2400 3000 SE +/- 35.97, N = 9 SE +/- 0.24, N = 3 2952.14 78.24 1. (CC) gcc options: -O2 -lz -lm
OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 5000 Files, 1MB Size, 4 Threads 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 300 600 900 1200 1500 SE +/- 0.23, N = 3 SE +/- 19.65, N = 3 15.6 1381.5
OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 1000 Files, 1MB Size, No Sync/FSync 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 800 1600 2400 3200 4000 SE +/- 13.73, N = 9 SE +/- 37.56, N = 5 497.8 3557.4
IOR IOR is a parallel I/O storage benchmark making use of MPI with a particular focus on HPC (High Performance Computing) systems. IOR is developed at the Lawrence Livermore National Laboratory (LLNL). Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org MB/s, More Is Better IOR 3.3.0 Block Size: 1024MB - Disk Target: Default Test Directory 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 800 1600 2400 3200 4000 SE +/- 1.60, N = 3 SE +/- 7.11, N = 3 84.74 3682.34 MIN: 2971.22 / MAX: 4109.02 1. (CC) gcc options: -O2 -lm -lmpi
SQLite This is a simple benchmark of SQLite. At present this test profile just measures the time to perform a pre-defined number of insertions on an indexed database. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better SQLite 3.30.1 Threads / Copies: 32 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 200 400 600 800 1000 SE +/- 25.83, N = 9 SE +/- 0.09, N = 3 1144.91 41.64 1. (CC) gcc options: -O2 -lz -lm
Dbench Dbench is a benchmark designed by the Samba project as a free alternative to netbench, but dbench contains only file-system calls for testing the disk performance. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 1 Clients 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 140 280 420 560 700 SE +/- 0.32, N = 9 SE +/- 0.57, N = 3 18.24 641.22 1. (CC) gcc options: -lpopt -O2
IOR IOR is a parallel I/O storage benchmark making use of MPI with a particular focus on HPC (High Performance Computing) systems. IOR is developed at the Lawrence Livermore National Laboratory (LLNL). Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org MB/s, More Is Better IOR 3.3.0 Block Size: 1024MB - Disk Target: /pts_data 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 160 320 480 640 800 SE +/- 0.35, N = 3 SE +/- 1.06, N = 3 295.80 720.64 MIN: 242.36 / MAX: 298.14 MIN: 573.53 / MAX: 773.96 1. (CC) gcc options: -O2 -lm -lmpi
SQLite This is a simple benchmark of SQLite. At present this test profile just measures the time to perform a pre-defined number of insertions on an indexed database. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better SQLite 3.30.1 Threads / Copies: 64 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 300 600 900 1200 1500 SE +/- 21.45, N = 3 SE +/- 0.72, N = 3 1604.81 55.55 1. (CC) gcc options: -O2 -lz -lm
OpenBenchmarking.org Seconds, Fewer Is Better SQLite 3.30.1 Threads / Copies: 8 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 110 220 330 440 550 SE +/- 34.61, N = 9 SE +/- 0.99, N = 12 497.14 28.43 1. (CC) gcc options: -O2 -lz -lm
Dbench Dbench is a benchmark designed by the Samba project as a free alternative to netbench, but dbench contains only file-system calls for testing the disk performance. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 12 Clients 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 600 1200 1800 2400 3000 SE +/- 0.42, N = 3 SE +/- 23.16, N = 3 40.66 2737.96 1. (CC) gcc options: -lpopt -O2
IOR IOR is a parallel I/O storage benchmark making use of MPI with a particular focus on HPC (High Performance Computing) systems. IOR is developed at the Lawrence Livermore National Laboratory (LLNL). Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org MB/s, More Is Better IOR 3.3.0 Block Size: 512MB - Disk Target: /pts_data 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 140 280 420 560 700 SE +/- 0.30, N = 3 SE +/- 2.60, N = 3 274.83 635.69 MIN: 209.31 / MAX: 278.3 MIN: 546.93 / MAX: 717.18 1. (CC) gcc options: -O2 -lm -lmpi
OpenBenchmarking.org MB/s, More Is Better IOR 3.3.0 Block Size: 256MB - Disk Target: Default Test Directory 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 700 1400 2100 2800 3500 SE +/- 0.87, N = 3 SE +/- 12.78, N = 3 100.98 3180.94 MIN: 2465.8 / MAX: 3597.78 1. (CC) gcc options: -O2 -lm -lmpi
OpenBenchmarking.org MB/s, More Is Better IOR 3.3.0 Block Size: 256MB - Disk Target: /pts_data 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 130 260 390 520 650 SE +/- 1.22, N = 3 SE +/- 2.09, N = 3 261.52 608.92 MIN: 143.56 / MAX: 269.26 MIN: 537.53 / MAX: 683.61 1. (CC) gcc options: -O2 -lm -lmpi
PostMark This is a test of NetApp's PostMark benchmark designed to simulate small-file testing similar to the tasks endured by web and mail servers. This test profile will set PostMark to perform 25,000 transactions with 500 files simultaneously with the file sizes ranging between 5 and 512 kilobytes. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org TPS, More Is Better PostMark 1.51 Disk Transaction Performance 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 1300 2600 3900 5200 6500 SE +/- 7.62, N = 3 SE +/- 81.99, N = 3 622 5954 1. (CC) gcc options: -O3
Compile Bench Compilebench tries to age a filesystem by simulating some of the disk IO common in creating, compiling, patching, stating and reading kernel trees. It indirectly measures how well filesystems can maintain directory locality as the disk fills up and directories age. This current test is setup to use the makej mode with 10 initial directories Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org MB/s, More Is Better Compile Bench 0.6 Test: Compile 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 800 1600 2400 3200 4000 SE +/- 0.45, N = 3 SE +/- 28.05, N = 3 174.14 3665.29
SQLite This is a simple benchmark of SQLite. At present this test profile just measures the time to perform a pre-defined number of insertions on an indexed database. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better SQLite 3.30.1 Threads / Copies: 1 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 60 120 180 240 300 SE +/- 1.08, N = 3 SE +/- 0.11, N = 3 273.91 13.72 1. (CC) gcc options: -O2 -lz -lm
IOR IOR is a parallel I/O storage benchmark making use of MPI with a particular focus on HPC (High Performance Computing) systems. IOR is developed at the Lawrence Livermore National Laboratory (LLNL). Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org MB/s, More Is Better IOR 3.3.0 Block Size: 64MB - Disk Target: Default Test Directory 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 700 1400 2100 2800 3500 SE +/- 0.49, N = 3 SE +/- 5.58, N = 3 109.65 3079.90 MIN: 2311.68 / MAX: 3312.43 1. (CC) gcc options: -O2 -lm -lmpi
Flexible IO Tester FIO, the Flexible I/O Tester, is an advanced Linux disk benchmark supporting multiple I/O engines and a wealth of options. FIO was written by Jens Axboe for testing of the Linux I/O subsystem and schedulers. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.29 Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 600 1200 1800 2400 3000 SE +/- 3.40, N = 15 SE +/- 34.59, N = 3 114 2620 -lnuma 1. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.29 Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 1100 2200 3300 4400 5500 SE +/- 6.89, N = 15 SE +/- 69.49, N = 3 235 5246 -lnuma 1. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.29 Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 500 1000 1500 2000 2500 SE +/- 2.89, N = 15 SE +/- 14.90, N = 3 105 2540 -lnuma 1. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.29 Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 1100 2200 3300 4400 5500 SE +/- 5.84, N = 15 SE +/- 30.00, N = 3 218 5088 -lnuma 1. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
IOR IOR is a parallel I/O storage benchmark making use of MPI with a particular focus on HPC (High Performance Computing) systems. IOR is developed at the Lawrence Livermore National Laboratory (LLNL). Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org MB/s, More Is Better IOR 3.3.0 Block Size: 64MB - Disk Target: /pts_data 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 120 240 360 480 600 SE +/- 0.27, N = 3 SE +/- 5.48, N = 3 258.73 577.63 MIN: 242.92 / MAX: 276.17 MIN: 492.3 / MAX: 922.51 1. (CC) gcc options: -O2 -lm -lmpi
Flexible IO Tester FIO, the Flexible I/O Tester, is an advanced Linux disk benchmark supporting multiple I/O engines and a wealth of options. FIO was written by Jens Axboe for testing of the Linux I/O subsystem and schedulers. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.29 Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 50K 100K 150K 200K 250K SE +/- 128.50, N = 12 SE +/- 333.33, N = 3 2898 211333 -lnuma 1. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.29 Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 200 400 600 800 1000 SE +/- 0.48, N = 12 SE +/- 1.20, N = 3 11.39 827.00 -lnuma 1. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
IOR IOR is a parallel I/O storage benchmark making use of MPI with a particular focus on HPC (High Performance Computing) systems. IOR is developed at the Lawrence Livermore National Laboratory (LLNL). Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org MB/s, More Is Better IOR 3.3.0 Block Size: 32MB - Disk Target: Default Test Directory 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 600 1200 1800 2400 3000 SE +/- 0.12, N = 3 SE +/- 21.93, N = 3 94.26 2940.27 MIN: 1530.46 / MAX: 3270.75 1. (CC) gcc options: -O2 -lm -lmpi
OpenBenchmarking.org MB/s, More Is Better IOR 3.3.0 Block Size: 16MB - Disk Target: /pts_data 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 100 200 300 400 500 SE +/- 2.23, N = 8 SE +/- 4.17, N = 7 266.82 476.24 MIN: 243.2 / MAX: 295.17 MIN: 307.99 / MAX: 717.27 1. (CC) gcc options: -O2 -lm -lmpi
OpenBenchmarking.org MB/s, More Is Better IOR 3.3.0 Block Size: 32MB - Disk Target: /pts_data 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 110 220 330 440 550 SE +/- 1.87, N = 3 SE +/- 0.33, N = 3 256.11 515.38 MIN: 43.86 / MAX: 275.79 MIN: 374.59 / MAX: 742.87 1. (CC) gcc options: -O2 -lm -lmpi
OpenBenchmarking.org MB/s, More Is Better IOR 3.3.0 Block Size: 16MB - Disk Target: Default Test Directory 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 600 1200 1800 2400 3000 SE +/- 0.14, N = 3 SE +/- 22.07, N = 15 89.98 2998.09 MIN: 1103.41 / MAX: 3300.37 1. (CC) gcc options: -O2 -lm -lmpi
Flexible IO Tester FIO, the Flexible I/O Tester, is an advanced Linux disk benchmark supporting multiple I/O engines and a wealth of options. FIO was written by Jens Axboe for testing of the Linux I/O subsystem and schedulers. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.29 Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 600 1200 1800 2400 3000 SE +/- 0.58, N = 3 SE +/- 4.70, N = 3 1065 2810 -lnuma 1. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.29 Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 1200 2400 3600 4800 6000 SE +/- 1.20, N = 3 SE +/- 9.21, N = 3 2138 5628 -lnuma 1. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.29 Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 140K 280K 420K 560K 700K SE +/- 288.68, N = 3 SE +/- 3055.05, N = 3 80700 643000 -lnuma 1. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.29 Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 500 1000 1500 2000 2500 SE +/- 1.15, N = 3 SE +/- 11.14, N = 3 315 2511 -lnuma 1. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.29 Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 20K 40K 60K 80K 100K SE +/- 0.00, N = 3 SE +/- 176.38, N = 3 23500 82133 -lnuma 1. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.29 Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 70 140 210 280 350 SE +/- 0.06, N = 3 SE +/- 0.88, N = 3 91.9 321.0 -lnuma 1. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.29 Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 600 1200 1800 2400 3000 SE +/- 0.58, N = 3 SE +/- 5.77, N = 3 1064 2806 -lnuma 1. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.29 Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 1200 2400 3600 4800 6000 SE +/- 1.53, N = 3 SE +/- 11.55, N = 3 2135 5619 -lnuma 1. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.org IOPS, More Is Better Flexible IO Tester 3.29 Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 60K 120K 180K 240K 300K SE +/- 0.00, N = 3 SE +/- 3785.94, N = 3 33800 271000 -lnuma 1. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.org MB/s, More Is Better Flexible IO Tester 3.29 Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 200 400 600 800 1000 SE +/- 0.00, N = 3 SE +/- 15.25, N = 3 132 1059 -lnuma 1. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
IOR IOR is a parallel I/O storage benchmark making use of MPI with a particular focus on HPC (High Performance Computing) systems. IOR is developed at the Lawrence Livermore National Laboratory (LLNL). Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org MB/s, More Is Better IOR 3.3.0 Block Size: 8MB - Disk Target: /pts_data 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 100 200 300 400 500 SE +/- 0.22, N = 3 SE +/- 3.77, N = 8 282.11 445.29 MIN: 260.16 / MAX: 299.59 MIN: 215.07 / MAX: 640.62 1. (CC) gcc options: -O2 -lm -lmpi
OpenBenchmarking.org MB/s, More Is Better IOR 3.3.0 Block Size: 8MB - Disk Target: Default Test Directory 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 600 1200 1800 2400 3000 SE +/- 0.34, N = 3 SE +/- 22.69, N = 3 83.73 2896.20 MIN: 891.49 / MAX: 3253.2 1. (CC) gcc options: -O2 -lm -lmpi
OpenBenchmarking.org MB/s, More Is Better IOR 3.3.0 Block Size: 4MB - Disk Target: Default Test Directory 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 600 1200 1800 2400 3000 SE +/- 0.14, N = 3 SE +/- 29.97, N = 3 73.86 2710.06 MIN: 605.04 / MAX: 3178.8 1. (CC) gcc options: -O2 -lm -lmpi
OpenBenchmarking.org MB/s, More Is Better IOR 3.3.0 Block Size: 2MB - Disk Target: /pts_data 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 90 180 270 360 450 SE +/- 1.58, N = 3 SE +/- 4.31, N = 15 261.50 393.34 MIN: 204 / MAX: 291.18 MIN: 43.3 / MAX: 692.65 1. (CC) gcc options: -O2 -lm -lmpi
OpenBenchmarking.org MB/s, More Is Better IOR 3.3.0 Block Size: 2MB - Disk Target: Default Test Directory 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 500 1000 1500 2000 2500 SE +/- 0.43, N = 3 SE +/- 34.59, N = 3 58.97 2506.87 MIN: 428.23 / MAX: 3129.58 1. (CC) gcc options: -O2 -lm -lmpi
OpenBenchmarking.org MB/s, More Is Better IOR 3.3.0 Block Size: 4MB - Disk Target: /pts_data 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 90 180 270 360 450 SE +/- 0.48, N = 3 SE +/- 5.53, N = 3 272.85 415.46 MIN: 231.95 / MAX: 301 MIN: 186.58 / MAX: 607.94 1. (CC) gcc options: -O2 -lm -lmpi
Compile Bench Compilebench tries to age a filesystem by simulating some of the disk IO common in creating, compiling, patching, stating and reading kernel trees. It indirectly measures how well filesystems can maintain directory locality as the disk fills up and directories age. This current test is setup to use the makej mode with 10 initial directories Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org MB/s, More Is Better Compile Bench 0.6 Test: Read Compiled Tree 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 400 800 1200 1600 2000 SE +/- 0.65, N = 3 SE +/- 54.83, N = 3 169.68 1997.58
OpenBenchmarking.org MB/s, More Is Better Compile Bench 0.6 Test: Initial Create 3 x 3001GB Western Digital WD30EFRX-68E ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F 120 240 360 480 600 SE +/- 0.66, N = 3 SE +/- 1.73, N = 3 83.61 551.10
3 x 3001GB Western Digital WD30EFRX-68E Processor: Intel Pentium Silver J5005 @ 2.80GHz (4 Cores), Motherboard: ASRock J5005-ITX (P1.40 BIOS), Memory: 16GB, Disk: 3 x 3001GB Western Digital WD30EFRX-68E + 240GB CT240BX500SSD1 + 500GB Samsung SSD 860, Graphics: (800MHz)
OS: Ubuntu 22.04.1 LTS, Kernel: 5.15.79 (x86_64), Compiler: GCC 11.3.0, File-System: zfs, System Layer: Docker
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x3cDisk Scheduler Notes: MQ-DEADLINEPython Notes: Python 3.10.6Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Mitigation of PTI + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 26 November 2022 22:47 by user root.
ZFS-nvme-KINGSTON_SKC3000S512G_50026B7685FEB94F Processor: Intel Core i5-12400 @ 5.60GHz (6 Cores / 12 Threads), Motherboard: ASRock B660M-ITX/ac (1.25 BIOS), Memory: 64GB, Disk: 512GB KINGSTON SKC3000S512G, Graphics: EFI VGA, Audio: Realtek ALC897
OS: Ubuntu 22.04.1 LTS, Kernel: 5.15.79 (x86_64), Compiler: GCC 11.3.0, File-System: zfs, Screen Resolution: 800x600, System Layer: Docker
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vDisk Notes: NONE / attr2,inode64,logbsize=64k,logbufs=8,noquota,nouuid,relatime,rw,sunit=128,swidth=128 / Block Size: 131072Processor Notes: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x22Python Notes: Python 3.10.6Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 30 November 2022 21:32 by user root.