05112023-TCST

PVE-NVME-R10-4DISK-ZFS2.2-1

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2311132-TCST-231105569
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
PVE-NVME-R10-4DISK-ZFS2.1
November 05 2023
  2 Hours, 18 Minutes
PVE-NVME-R10-4DISK-ZFS2.2
November 05 2023
  2 Hours, 18 Minutes
PVE-NVME-R10-4DISK-ZFS2.2-0
November 13 2023
 
PVE-NVME-R10-4DISK-ZFS2.2-1
November 13 2023
  2 Hours, 18 Minutes
Invert Hiding All Results Option
  1 Hour, 44 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


05112023-TCSTOpenBenchmarking.orgPhoronix Test SuiteAMD EPYC 7543 32-Core (12 Cores)QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS)Intel 82G33/G31/P35/P31 + ICH916GB34GB QEMU HDDbochs-drmdrmfbIntel 82801IQEMU MonitorRed Hat Virtio deviceUbuntu 22.045.15.0-86-generic (x86_64)5.15.0-88-generic (x86_64)1.3.238GCC 11.4.0ext41280x800KVMProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelsVulkanCompilerFile-SystemScreen ResolutionSystem Layer05112023-TCST BenchmarksSystem Logs- Transparent Huge Pages: madvise- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - NONE / relatime,rw / Block Size: 4096- CPU Microcode: 0xa00110d- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

05112023-TCSTfio: Rand Read - IO_uring - No - No - 1MB - 1 - Default Test Directoryfio: Rand Read - IO_uring - No - No - 1MB - 1 - Default Test Directoryfio: Rand Read - IO_uring - No - No - 4KB - 1 - Default Test Directoryfio: Rand Read - IO_uring - No - No - 4KB - 1 - Default Test Directoryfio: Rand Read - IO_uring - No - No - 64KB - 1 - Default Test Directoryfio: Rand Read - IO_uring - No - No - 64KB - 1 - Default Test Directoryfio: Rand Write - IO_uring - No - No - 1MB - 1 - Default Test Directoryfio: Rand Write - IO_uring - No - No - 1MB - 1 - Default Test Directoryfio: Rand Write - IO_uring - No - No - 4KB - 1 - Default Test Directoryfio: Rand Write - IO_uring - No - No - 4KB - 1 - Default Test Directoryfio: Rand Write - IO_uring - No - No - 64KB - 1 - Default Test Directoryfio: Rand Write - IO_uring - No - No - 64KB - 1 - Default Test Directoryfio: Seq Read - IO_uring - No - No - 1MB - 1 - Default Test Directoryfio: Seq Read - IO_uring - No - No - 1MB - 1 - Default Test Directoryfio: Seq Read - IO_uring - No - No - 4KB - 1 - Default Test Directoryfio: Seq Read - IO_uring - No - No - 4KB - 1 - Default Test Directoryfio: Seq Read - IO_uring - No - No - 64KB - 1 - Default Test Directoryfio: Seq Read - IO_uring - No - No - 64KB - 1 - Default Test Directoryfio: Seq Write - IO_uring - No - No - 1MB - 1 - Default Test Directoryfio: Seq Write - IO_uring - No - No - 1MB - 1 - Default Test Directoryfio: Seq Write - IO_uring - No - No - 4KB - 1 - Default Test Directoryfio: Seq Write - IO_uring - No - No - 4KB - 1 - Default Test Directoryfio: Seq Write - IO_uring - No - No - 64KB - 1 - Default Test Directoryfio: Seq Write - IO_uring - No - No - 64KB - 1 - Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-0PVE-NVME-R10-4DISK-ZFS2.2-14032.604033510833.621277083782.85605262554.282554354712.28886781964.79314373803.883804526231.731315583257.47521192419.832420372002.83930011696.39271423814.213814474764.961186913487.64558022643.082643355963.9488991702583.68109783606.583606489319.731223303009.81481571378.711378366223.5291556656928.121026438607.5438607584524.111461317140.861142547732.617732466359.461165904407.007051232755.7632756598294.791495747266.301162618072.748073487276.451218194291.9068670OpenBenchmarking.org

Flexible IO Tester

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-18K16K24K32K40KSE +/- 2.23, N = 4SE +/- 2.11, N = 4SE +/- 380.08, N = 44032.603814.2138607.54MIN: 37591.38 / MAX: 39279.351. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native
OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-17K14K21K28K35KMin: 4028.61 / Avg: 4032.6 / Max: 4038.79Min: 3810.97 / Avg: 3814.21 / Max: 3819.87Min: 37591.38 / Avg: 38607.54 / Max: 39279.351. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-18K16K24K32K40KSE +/- 2.23, N = 4SE +/- 2.10, N = 4SE +/- 380.09, N = 44033381438607MIN: 4028.6 / MAX: 4038.78MIN: 37591.27 / MAX: 39279.261. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-17K14K21K28K35KMin: 4028.6 / Avg: 4032.57 / Max: 4038.78Min: 3810.7 / Avg: 3813.94 / Max: 3819.55Min: 37591.27 / Avg: 38607.45 / Max: 39279.261. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-1130K260K390K520K650KSE +/- 6969.17, N = 4SE +/- 5616.59, N = 4SE +/- 2380.78, N = 4510833.62474764.96584524.11MIN: 491730.18 / MAX: 524323.85MIN: 459665.87 / MAX: 485427.97MIN: 578905.65 / MAX: 589275.961. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native
OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-1100K200K300K400K500KMin: 491730.18 / Avg: 510833.62 / Max: 524323.85Min: 459665.87 / Avg: 474764.96 / Max: 485427.97Min: 578905.65 / Avg: 584524.11 / Max: 589275.961. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-130K60K90K120K150KSE +/- 1742.30, N = 4SE +/- 1404.16, N = 4SE +/- 595.19, N = 4127708118691146131MIN: 122932.47 / MAX: 131080.9MIN: 114916.45 / MAX: 121357.02MIN: 144726.44 / MAX: 147318.971. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-130K60K90K120K150KMin: 122932.47 / Avg: 127708.35 / Max: 131080.9Min: 114916.45 / Avg: 118691.23 / Max: 121357.02Min: 144726.44 / Avg: 146131.02 / Max: 147318.971. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-115003000450060007500SE +/- 15.75, N = 4SE +/- 5.13, N = 4SE +/- 54.12, N = 43782.853487.647140.86MIN: 3757.95 / MAX: 3826.78MIN: 3473.22 / MAX: 3497.39MIN: 7006.19 / MAX: 7242.331. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native
OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-112002400360048006000Min: 3757.95 / Avg: 3782.85 / Max: 3826.78Min: 3473.22 / Avg: 3487.64 / Max: 3497.39Min: 7006.19 / Avg: 7140.86 / Max: 7242.331. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-120K40K60K80K100KSE +/- 251.91, N = 4SE +/- 82.11, N = 4SE +/- 865.89, N = 46052655802114254MIN: 60127.11 / MAX: 61228.36MIN: 55571.32 / MAX: 55958.14MIN: 112099.1 / MAX: 115877.311. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-120K40K60K80K100KMin: 60127.11 / Avg: 60525.53 / Max: 61228.36Min: 55571.32 / Avg: 55802.03 / Max: 55958.14Min: 112099.1 / Avg: 114253.85 / Max: 115877.311. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-117003400510068008500SE +/- 50.98, N = 4SE +/- 10.38, N = 4SE +/- 97.60, N = 42554.282643.087732.61MIN: 2405.5 / MAX: 2621.26MIN: 2613.46 / MAX: 2660.47MIN: 7548.52 / MAX: 8001.41. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native
OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-113002600390052006500Min: 2405.5 / Avg: 2554.28 / Max: 2621.26Min: 2613.46 / Avg: 2643.08 / Max: 2660.47Min: 7548.52 / Avg: 7732.61 / Max: 8001.41. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-117003400510068008500SE +/- 50.98, N = 4SE +/- 10.38, N = 4SE +/- 97.60, N = 4255426437732MIN: 2405.24 / MAX: 2621MIN: 2613.24 / MAX: 2660.24MIN: 7548.35 / MAX: 8001.21. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-113002600390052006500Min: 2405.24 / Avg: 2554.05 / Max: 2621Min: 2613.24 / Avg: 2642.85 / Max: 2660.24Min: 7548.35 / Avg: 7732.43 / Max: 8001.21. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-1100K200K300K400K500KSE +/- 2079.65, N = 4SE +/- 3067.11, N = 4SE +/- 2890.32, N = 4354712.28355963.94466359.46MIN: 349349.75 / MAX: 358707.21MIN: 351976.19 / MAX: 364928.78MIN: 460348.44 / MAX: 472231.831. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native
OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-180K160K240K320K400KMin: 349349.75 / Avg: 354712.28 / Max: 358707.21Min: 351976.19 / Avg: 355963.94 / Max: 364928.78Min: 460348.44 / Avg: 466359.46 / Max: 472231.831. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-120K40K60K80K100KSE +/- 519.90, N = 4SE +/- 766.78, N = 4SE +/- 722.58, N = 48867888991116590MIN: 87337.43 / MAX: 89676.77MIN: 87994.01 / MAX: 91232.19MIN: 115087.08 / MAX: 118057.921. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-120K40K60K80K100KMin: 87337.43 / Avg: 88678.04 / Max: 89676.77Min: 87994.01 / Avg: 88990.96 / Max: 91232.19Min: 115087.08 / Avg: 116589.86 / Max: 118057.921. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-1150K300K450K600K750KSE +/- 10.04, N = 4SE +/- 1201.47, N = 4SE +/- 77.57, N = 41964.79702583.684407.00MIN: 700032.56 / MAX: 705692.671. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native
OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-1120K240K360K480K600KMin: 1939.39 / Avg: 1964.79 / Max: 1984.91Min: 700032.56 / Avg: 702583.68 / Max: 705692.67Min: 4266.12 / Avg: 4407 / Max: 4546.381. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-115K30K45K60K75KSE +/- 160.70, N = 4SE +/- 18.77, N = 4SE +/- 1241.12, N = 4314371097870512MIN: 31030.13 / MAX: 31758.5MIN: 10937.74 / MAX: 11026.18MIN: 68257.81 / MAX: 72741.991. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-112K24K36K48K60KMin: 31030.13 / Avg: 31436.58 / Max: 31758.5Min: 10937.74 / Avg: 10977.59 / Max: 11026.18Min: 68257.81 / Avg: 70511.99 / Max: 72741.991. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-17K14K21K28K35KSE +/- 2.30, N = 4SE +/- 0.67, N = 4SE +/- 106.02, N = 43803.883606.5832755.76MIN: 32463.63 / MAX: 32968.821. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native
OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-16K12K18K24K30KMin: 3797.8 / Avg: 3803.88 / Max: 3808.79Min: 3605.37 / Avg: 3606.58 / Max: 3608.03Min: 32463.63 / Avg: 32755.76 / Max: 32968.821. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-17K14K21K28K35KSE +/- 2.29, N = 4SE +/- 0.68, N = 4SE +/- 106.01, N = 43804360632756MIN: 3797.73 / MAX: 3808.69MIN: 3604.97 / MAX: 3607.71MIN: 32463.58 / MAX: 32968.661. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-16K12K18K24K30KMin: 3797.73 / Avg: 3803.79 / Max: 3808.69Min: 3604.97 / Avg: 3606.24 / Max: 3607.71Min: 32463.58 / Avg: 32755.69 / Max: 32968.661. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-1130K260K390K520K650KSE +/- 1473.41, N = 4SE +/- 3766.56, N = 4SE +/- 4658.11, N = 4526231.73489319.73598294.79MIN: 522810.86 / MAX: 529209.12MIN: 478129.83 / MAX: 494341.44MIN: 587385.32 / MAX: 608321.281. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native
OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-1100K200K300K400K500KMin: 522810.86 / Avg: 526231.73 / Max: 529209.12Min: 478129.83 / Avg: 489319.73 / Max: 494341.44Min: 587385.32 / Avg: 598294.79 / Max: 608321.281. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-130K60K90K120K150KSE +/- 368.35, N = 4SE +/- 941.64, N = 4SE +/- 1164.52, N = 4131558122330149574MIN: 130702.69 / MAX: 132302.27MIN: 119532.43 / MAX: 123585.36MIN: 146846.33 / MAX: 152080.291. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-130K60K90K120K150KMin: 130702.69 / Avg: 131557.91 / Max: 132302.27Min: 119532.43 / Avg: 122329.91 / Max: 123585.36Min: 146846.33 / Avg: 149573.68 / Max: 152080.291. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-116003200480064008000SE +/- 6.14, N = 4SE +/- 3.93, N = 4SE +/- 171.66, N = 43257.473009.817266.30MIN: 3245.54 / MAX: 3269.54MIN: 2999.83 / MAX: 3018.99MIN: 6979.69 / MAX: 7691.991. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native
OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-113002600390052006500Min: 3245.54 / Avg: 3257.47 / Max: 3269.54Min: 2999.83 / Avg: 3009.81 / Max: 3018.99Min: 6979.69 / Avg: 7266.3 / Max: 7691.991. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-120K40K60K80K100KSE +/- 98.17, N = 4SE +/- 62.81, N = 4SE +/- 2746.65, N = 45211948157116261MIN: 51928.62 / MAX: 52312.58MIN: 47997.17 / MAX: 48303.78MIN: 111674.96 / MAX: 123071.891. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-120K40K60K80K100KMin: 51928.62 / Avg: 52119.39 / Max: 52312.58Min: 47997.17 / Avg: 48156.85 / Max: 48303.78Min: 111674.96 / Avg: 116260.78 / Max: 123071.891. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-12K4K6K8K10KSE +/- 100.97, N = 4SE +/- 16.25, N = 4SE +/- 106.08, N = 42419.831378.718072.74MIN: 2216.36 / MAX: 2646.2MIN: 7763.33 / MAX: 8217.981. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native
OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-114002800420056007000Min: 2216.36 / Avg: 2419.83 / Max: 2646.2Min: 1353.28 / Avg: 1378.71 / Max: 1424.93Min: 7763.33 / Avg: 8072.74 / Max: 8217.981. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-12K4K6K8K10KSE +/- 101.00, N = 4SE +/- 16.25, N = 4SE +/- 106.06, N = 4242013788073MIN: 2216.08 / MAX: 2646.04MIN: 1352.95 / MAX: 1424.59MIN: 7763.24 / MAX: 8217.841. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-114002800420056007000Min: 2216.08 / Avg: 2419.6 / Max: 2646.04Min: 1352.95 / Avg: 1378.36 / Max: 1424.59Min: 7763.24 / Avg: 8072.61 / Max: 8217.841. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-1100K200K300K400K500KSE +/- 2451.46, N = 4SE +/- 1885.36, N = 4SE +/- 2727.11, N = 4372002.83366223.52487276.45MIN: 366395.47 / MAX: 376869.38MIN: 361073.65 / MAX: 369765.43MIN: 479906.43 / MAX: 491520.091. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native
OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-180K160K240K320K400KMin: 366395.47 / Avg: 372002.83 / Max: 376869.38Min: 361073.65 / Avg: 366223.52 / Max: 369765.43Min: 479906.43 / Avg: 487276.45 / Max: 491520.091. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-130K60K90K120K150KSE +/- 612.87, N = 4SE +/- 471.34, N = 4SE +/- 681.78, N = 49300191556121819MIN: 91598.8 / MAX: 94217.31MIN: 90268.39 / MAX: 92441.34MIN: 119976.59 / MAX: 1228801. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-120K40K60K80K100KMin: 91598.8 / Avg: 93000.67 / Max: 94217.31Min: 90268.39 / Avg: 91555.86 / Max: 92441.34Min: 119976.59 / Avg: 121819.1 / Max: 1228801. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-1140K280K420K560K700KSE +/- 26.19, N = 4SE +/- 18466.98, N = 4SE +/- 52.21, N = 41696.39656928.124291.90MIN: 603671.44 / MAX: 688537.191. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native
OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-1110K220K330K440K550KMin: 1630.52 / Avg: 1696.39 / Max: 1740.29Min: 603671.44 / Avg: 656928.12 / Max: 688537.19Min: 4197.08 / Avg: 4291.9 / Max: 4439.91. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-115K30K45K60K75KSE +/- 419.10, N = 4SE +/- 288.54, N = 4SE +/- 835.37, N = 4271421026468670MIN: 26088.08 / MAX: 27844.44MIN: 9432.11 / MAX: 10758.13MIN: 67153.2 / MAX: 71038.271. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.2-112K24K36K48K60KMin: 26088.08 / Avg: 27141.96 / Max: 27844.44Min: 9432.11 / Avg: 10264.21 / Max: 10758.13Min: 67153.2 / Avg: 68670.27 / Max: 71038.271. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

24 Results Shown

Flexible IO Tester:
  Rand Read - IO_uring - No - No - 1MB - 1 - Default Test Directory:
    MiB/s
    IOPS
  Rand Read - IO_uring - No - No - 4KB - 1 - Default Test Directory:
    MiB/s
    IOPS
  Rand Read - IO_uring - No - No - 64KB - 1 - Default Test Directory:
    MiB/s
    IOPS
  Rand Write - IO_uring - No - No - 1MB - 1 - Default Test Directory:
    MiB/s
    IOPS
  Rand Write - IO_uring - No - No - 4KB - 1 - Default Test Directory:
    MiB/s
    IOPS
  Rand Write - IO_uring - No - No - 64KB - 1 - Default Test Directory:
    MiB/s
    IOPS
  Seq Read - IO_uring - No - No - 1MB - 1 - Default Test Directory:
    MiB/s
    IOPS
  Seq Read - IO_uring - No - No - 4KB - 1 - Default Test Directory:
    MiB/s
    IOPS
  Seq Read - IO_uring - No - No - 64KB - 1 - Default Test Directory:
    MiB/s
    IOPS
  Seq Write - IO_uring - No - No - 1MB - 1 - Default Test Directory:
    MiB/s
    IOPS
  Seq Write - IO_uring - No - No - 4KB - 1 - Default Test Directory:
    MiB/s
    IOPS
  Seq Write - IO_uring - No - No - 64KB - 1 - Default Test Directory:
    MiB/s
    IOPS