05112023-TCST

PVE-NVME-R10-8DISK-ZFS2.2 Genoa

HTML result view exported from: https://openbenchmarking.org/result/2312184-TCST-231125580&sro.

05112023-TCSTProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelVulkanCompilerFile-SystemScreen ResolutionSystem LayerPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINXEN-NVME-R10-4DISK-EXT4PVE-NVME-R10-8DISK-ZFS2.2AMD EPYC 7543 32-Core (12 Cores)QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS)Intel 82G33/G31/P35/P31 + ICH916GB34GB QEMU HDDbochs-drmdrmfbIntel 82801IQEMU MonitorRed Hat Virtio deviceUbuntu 22.045.15.0-86-generic (x86_64)1.3.238GCC 11.4.0ext41280x800KVM5.15.0-88-generic (x86_64)AMD EPYC 9354 32-Core (12 Cores)QEMU Standard PC (Q35 + ICH9 2009) (4.2023.08-2 BIOS)5.15.0-84-generic (x86_64)Xen HVM domU v4.13Intel 440FX 82441FX PMC30GB5.15.0-89-generic (x86_64)1024x768Xen HVM domU 4.13AMD EPYC 9354 32-Core (16 Cores)QEMU Standard PC (Q35 + ICH9 2009) (4.2023.08-2 BIOS)Intel 82G33/G31/P35/P31 + ICH934GB QEMU HDDIntel 82801IQEMU MonitorRed Hat Virtio device5.15.0-91-generic (x86_64)1280x800KVMOpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Disk Details- PVE-NVME-R10-4DISK-ZFS2.1, PVE-NVME-R10-4DISK-ZFS2.2, PVE-NVME-R10-4DISK-LVM, PVE-NVME-R10-4DISK-LVM-THIN, PVE-NVME-R10-8DISK-ZFS2.2: NONE / relatime,rw / Block Size: 4096Processor Details- PVE-NVME-R10-4DISK-ZFS2.1: CPU Microcode: 0xa00110d- PVE-NVME-R10-4DISK-ZFS2.2: CPU Microcode: 0xa00110d- PVE-NVME-R10-4DISK-LVM: CPU Microcode: 0xa00110d- PVE-NVME-R10-4DISK-LVM-THIN: CPU Microcode: 0xa101121- XEN-NVME-R10-4DISK-EXT4: CPU Microcode: 0xa101144- PVE-NVME-R10-8DISK-ZFS2.2: CPU Microcode: 0xa101121Security Details- PVE-NVME-R10-4DISK-ZFS2.1: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - PVE-NVME-R10-4DISK-ZFS2.2: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - PVE-NVME-R10-4DISK-LVM: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - PVE-NVME-R10-4DISK-LVM-THIN: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - XEN-NVME-R10-4DISK-EXT4: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - PVE-NVME-R10-8DISK-ZFS2.2: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected Disk Mount Options Details- XEN-NVME-R10-4DISK-EXT4: relatime,rwDisk Details Details- XEN-NVME-R10-4DISK-EXT4: Block Size: 4096

05112023-TCSTfio: Rand Read - IO_uring - No - No - 1MB - 1 - Default Test Directoryfio: Rand Read - IO_uring - No - No - 1MB - 1 - Default Test Directoryfio: Rand Read - IO_uring - No - No - 4KB - 1 - Default Test Directoryfio: Rand Read - IO_uring - No - No - 4KB - 1 - Default Test Directoryfio: Rand Read - IO_uring - No - No - 64KB - 1 - Default Test Directoryfio: Rand Read - IO_uring - No - No - 64KB - 1 - Default Test Directoryfio: Rand Write - IO_uring - No - No - 1MB - 1 - Default Test Directoryfio: Rand Write - IO_uring - No - No - 1MB - 1 - Default Test Directoryfio: Rand Write - IO_uring - No - No - 4KB - 1 - Default Test Directoryfio: Rand Write - IO_uring - No - No - 4KB - 1 - Default Test Directoryfio: Rand Write - IO_uring - No - No - 64KB - 1 - Default Test Directoryfio: Rand Write - IO_uring - No - No - 64KB - 1 - Default Test Directoryfio: Seq Read - IO_uring - No - No - 1MB - 1 - Default Test Directoryfio: Seq Read - IO_uring - No - No - 1MB - 1 - Default Test Directoryfio: Seq Read - IO_uring - No - No - 4KB - 1 - Default Test Directoryfio: Seq Read - IO_uring - No - No - 4KB - 1 - Default Test Directoryfio: Seq Read - IO_uring - No - No - 64KB - 1 - Default Test Directoryfio: Seq Read - IO_uring - No - No - 64KB - 1 - Default Test Directoryfio: Seq Write - IO_uring - No - No - 1MB - 1 - Default Test Directoryfio: Seq Write - IO_uring - No - No - 1MB - 1 - Default Test Directoryfio: Seq Write - IO_uring - No - No - 4KB - 1 - Default Test Directoryfio: Seq Write - IO_uring - No - No - 4KB - 1 - Default Test Directoryfio: Seq Write - IO_uring - No - No - 64KB - 1 - Default Test Directoryfio: Seq Write - IO_uring - No - No - 64KB - 1 - Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINXEN-NVME-R10-4DISK-EXT4PVE-NVME-R10-8DISK-ZFS2.24032.604033510833.621277083782.85605262554.282554354712.28886781964.79314373803.883804526231.731315583257.47521192419.832420372002.83930011696.39271423814.213814474764.961186913487.64558022643.082643355963.9488991702583.68109783606.583606489319.731223303009.81481571378.711378366223.5291556656928.121026418807.8818808696247.301740628276.151324186922.496922470866.561177176124.389799020037.9420038659491.141648737999.781279966807.316807499262.031248156266.2210025919003.6219004800373.642000938750.941400156392.346392609544.811523864846.367754219691.6819692714517.971786298546.581367456108.636109701071.061752685577.91892461637.851638459364.691148411654.23264681504.331504440366.121100911360.37217661486.961487474996.811187491513.12242101494.971495505037.271262591303.25208528708.008708703983.631759966945.551111298225.438225627966.711569925509.34881496695.376695695706.621739275358.76857408429.738430647097.871617745612.1789795OpenBenchmarking.org

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-8DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT44K8K12K16K20KSE +/- 69.50, N = 3SE +/- 203.10, N = 3SE +/- 2.23, N = 4SE +/- 2.11, N = 4SE +/- 111.65, N = 2SE +/- 6.83, N = 318807.8819003.624032.603814.218708.001637.85MIN: 18689.17 / MAX: 18929.86MIN: 18621.35 / MAX: 19313.72MIN: 4028.61 / MAX: 4038.79MIN: 3810.97 / MAX: 3819.87MIN: 8596.35 / MAX: 8819.641. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-8DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT44K8K12K16K20KSE +/- 69.50, N = 3SE +/- 203.09, N = 3SE +/- 2.23, N = 4SE +/- 2.10, N = 4SE +/- 111.63, N = 2SE +/- 6.83, N = 318808190044033381487081638MIN: 18689.13 / MAX: 18929.83MIN: 18621.31 / MAX: 19313.65MIN: 4028.6 / MAX: 4038.78MIN: 3810.7 / MAX: 3819.55MIN: 8596.19 / MAX: 8819.451. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-8DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT4200K400K600K800K1000KSE +/- 3085.12, N = 3SE +/- 6370.47, N = 3SE +/- 6969.17, N = 4SE +/- 5616.59, N = 4SE +/- 1458.64, N = 2SE +/- 3683.77, N = 3696247.30800373.64510833.62474764.96703983.63459364.69MIN: 690109.28 / MAX: 699861.68MIN: 787844.15 / MAX: 808640.32MIN: 491730.18 / MAX: 524323.85MIN: 459665.87 / MAX: 485427.97MIN: 702524.99 / MAX: 705442.26MIN: 452749.3 / MAX: 465480.921. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-8DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT440K80K120K160K200KSE +/- 771.29, N = 3SE +/- 1592.60, N = 3SE +/- 1742.30, N = 4SE +/- 1404.16, N = 4SE +/- 364.67, N = 2SE +/- 920.94, N = 3174062200093127708118691175996114841MIN: 172527.28 / MAX: 174965.41MIN: 196961.07 / MAX: 202160.02MIN: 122932.47 / MAX: 131080.9MIN: 114916.45 / MAX: 121357.02MIN: 175631.32 / MAX: 176360.66MIN: 113187.22 / MAX: 116370.141. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-8DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT42K4K6K8K10KSE +/- 108.38, N = 3SE +/- 123.32, N = 3SE +/- 15.75, N = 4SE +/- 5.13, N = 4SE +/- 7.03, N = 2SE +/- 1.79, N = 38276.158750.943782.853487.646945.551654.23MIN: 8061.35 / MAX: 8408.67MIN: 8613.18 / MAX: 8996.99MIN: 3757.95 / MAX: 3826.78MIN: 3473.22 / MAX: 3497.39MIN: 6938.51 / MAX: 6952.58MIN: 1651.65 / MAX: 1657.671. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-8DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT430K60K90K120K150KSE +/- 1734.03, N = 3SE +/- 1973.06, N = 3SE +/- 251.91, N = 4SE +/- 82.11, N = 4SE +/- 112.60, N = 2SE +/- 28.67, N = 3132418140015605265580211112926468MIN: 128981.55 / MAX: 134538.74MIN: 137810.86 / MAX: 143951.73MIN: 60127.11 / MAX: 61228.36MIN: 55571.32 / MAX: 55958.14MIN: 111016.18 / MAX: 111241.37MIN: 26426.26 / MAX: 26522.631. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-8DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT42K4K6K8K10KSE +/- 31.04, N = 3SE +/- 53.32, N = 3SE +/- 50.98, N = 4SE +/- 10.38, N = 4SE +/- 20.70, N = 2SE +/- 123.03, N = 36922.496392.342554.282643.088225.431504.33MIN: 6861.37 / MAX: 6962.5MIN: 6335.25 / MAX: 6498.89MIN: 2405.5 / MAX: 2621.26MIN: 2613.46 / MAX: 2660.47MIN: 8204.72 / MAX: 8246.131. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-8DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT42K4K6K8K10KSE +/- 31.06, N = 3SE +/- 53.32, N = 3SE +/- 50.98, N = 4SE +/- 10.38, N = 4SE +/- 20.71, N = 2SE +/- 123.07, N = 3692263922554264382251504MIN: 6861.28 / MAX: 6962.45MIN: 6335.18 / MAX: 6498.81MIN: 2405.24 / MAX: 2621MIN: 2613.24 / MAX: 2660.24MIN: 8204.63 / MAX: 8246.05MIN: 1372.1 / MAX: 1749.991. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-8DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT4130K260K390K520K650KSE +/- 1362.71, N = 3SE +/- 3381.35, N = 3SE +/- 2079.65, N = 4SE +/- 3067.11, N = 4SE +/- 7981.55, N = 2SE +/- 11532.29, N = 3470866.56609544.81354712.28355963.94627966.71440366.12MIN: 469021.73 / MAX: 473526.32MIN: 603987.04 / MAX: 615660.46MIN: 349349.75 / MAX: 358707.21MIN: 351976.19 / MAX: 364928.78MIN: 619985.16 / MAX: 635948.26MIN: 426327.83 / MAX: 463233.791. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-8DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT430K60K90K120K150KSE +/- 340.68, N = 3SE +/- 845.39, N = 3SE +/- 519.90, N = 4SE +/- 766.78, N = 4SE +/- 1995.35, N = 2SE +/- 2883.09, N = 31177171523868867888991156992110091MIN: 117255.4 / MAX: 118381.57MIN: 150996.74 / MAX: 153915.28MIN: 87337.43 / MAX: 89676.77MIN: 87994.01 / MAX: 91232.19MIN: 154996.32 / MAX: 158987.02MIN: 106581.88 / MAX: 115808.421. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-8DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT4150K300K450K600K750KSE +/- 12.17, N = 3SE +/- 8.88, N = 3SE +/- 10.04, N = 4SE +/- 1201.47, N = 4SE +/- 22.53, N = 2SE +/- 48.69, N = 36124.384846.361964.79702583.685509.341360.37MIN: 700032.56 / MAX: 705692.671. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-8DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT420K40K60K80K100KSE +/- 194.67, N = 3SE +/- 142.13, N = 3SE +/- 160.70, N = 4SE +/- 18.77, N = 4SE +/- 360.52, N = 2SE +/- 779.05, N = 3979907754231437109788814921766MIN: 97740.13 / MAX: 98373.57MIN: 77272.31 / MAX: 77754.9MIN: 31030.13 / MAX: 31758.5MIN: 87788.79 / MAX: 88509.83MIN: 20720.73 / MAX: 23289.141. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-8DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT44K8K12K16K20KSE +/- 89.44, N = 3SE +/- 246.64, N = 3SE +/- 2.30, N = 4SE +/- 0.67, N = 4SE +/- 11.65, N = 2SE +/- 5.87, N = 320037.9419691.683803.883606.586695.371486.96MIN: 19859.08 / MAX: 20129.14MIN: 19239.35 / MAX: 20088.27MIN: 3797.8 / MAX: 3808.79MIN: 3605.37 / MAX: 3608.03MIN: 6683.72 / MAX: 6707.021. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-8DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT44K8K12K16K20KSE +/- 89.43, N = 3SE +/- 246.63, N = 3SE +/- 2.29, N = 4SE +/- 0.68, N = 4SE +/- 11.67, N = 2SE +/- 5.92, N = 320038196923804360666951487MIN: 19859.03 / MAX: 20129.09MIN: 19239.28 / MAX: 20088.16MIN: 3797.73 / MAX: 3808.69MIN: 3604.97 / MAX: 3607.71MIN: 6683.45 / MAX: 6706.781. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-8DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT4150K300K450K600K750KSE +/- 885.09, N = 3SE +/- 3401.42, N = 3SE +/- 1473.41, N = 4SE +/- 3766.56, N = 4SE +/- 461.66, N = 2SE +/- 43333.44, N = 3659491.14714517.97526231.73489319.73695706.62474996.81MIN: 657985.42 / MAX: 661050.08MIN: 707873.32 / MAX: 719103.4MIN: 522810.86 / MAX: 529209.12MIN: 478129.83 / MAX: 494341.44MIN: 695244.96 / MAX: 696168.28MIN: 425549.84 / MAX: 561361.271. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-8DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT440K80K120K160K200KSE +/- 221.27, N = 3SE +/- 850.37, N = 3SE +/- 368.35, N = 4SE +/- 941.64, N = 4SE +/- 115.40, N = 2SE +/- 10833.35, N = 3164873178629131558122330173927118749MIN: 164496.33 / MAX: 165262.48MIN: 176968.27 / MAX: 179775.83MIN: 130702.69 / MAX: 132302.27MIN: 119532.43 / MAX: 123585.36MIN: 173811.28 / MAX: 174042.09MIN: 106387.39 / MAX: 140340.221. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-8DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT42K4K6K8K10KSE +/- 69.13, N = 3SE +/- 93.33, N = 3SE +/- 6.14, N = 4SE +/- 3.93, N = 4SE +/- 13.35, N = 2SE +/- 24.12, N = 37999.788546.583257.473009.815358.761513.12MIN: 7862.47 / MAX: 8082.37MIN: 8364.23 / MAX: 8672.32MIN: 3245.54 / MAX: 3269.54MIN: 2999.83 / MAX: 3018.99MIN: 5345.41 / MAX: 5372.11. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-8DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT430K60K90K120K150KSE +/- 1105.99, N = 3SE +/- 1493.37, N = 3SE +/- 98.17, N = 4SE +/- 62.81, N = 4SE +/- 213.50, N = 2SE +/- 385.98, N = 312799613674552119481578574024210MIN: 125799.47 / MAX: 129317.81MIN: 133827.61 / MAX: 138757.15MIN: 51928.62 / MAX: 52312.58MIN: 47997.17 / MAX: 48303.78MIN: 85526.58 / MAX: 85953.59MIN: 23570.81 / MAX: 24904.421. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-8DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT42K4K6K8K10KSE +/- 99.06, N = 3SE +/- 63.77, N = 3SE +/- 100.97, N = 4SE +/- 16.25, N = 4SE +/- 13.29, N = 2SE +/- 48.17, N = 36807.316108.632419.831378.718429.731494.97MIN: 6655.42 / MAX: 6993.41MIN: 6018.55 / MAX: 6231.87MIN: 2216.36 / MAX: 2646.2MIN: 8416.44 / MAX: 8443.021. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-8DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT42K4K6K8K10KSE +/- 99.06, N = 3SE +/- 63.77, N = 3SE +/- 101.00, N = 4SE +/- 16.25, N = 4SE +/- 13.27, N = 2SE +/- 48.17, N = 3680761092420137884301495MIN: 6655.38 / MAX: 6993.37MIN: 6018.52 / MAX: 6231.83MIN: 2216.08 / MAX: 2646.04MIN: 1352.95 / MAX: 1424.59MIN: 8416.33 / MAX: 8442.87MIN: 1398.93 / MAX: 1551.641. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-8DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT4150K300K450K600K750KSE +/- 3120.10, N = 3SE +/- 8570.97, N = 3SE +/- 2451.46, N = 4SE +/- 1885.36, N = 4SE +/- 2543.12, N = 2SE +/- 47417.67, N = 3499262.03701071.06372002.83366223.52647097.87505037.27MIN: 493634.13 / MAX: 504410.54MIN: 684178.38 / MAX: 712039.82MIN: 366395.47 / MAX: 376869.38MIN: 361073.65 / MAX: 369765.43MIN: 644554.75 / MAX: 649640.99MIN: 437300.68 / MAX: 596387.051. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-8DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT440K80K120K160K200KSE +/- 780.03, N = 3SE +/- 2142.72, N = 3SE +/- 612.87, N = 4SE +/- 471.34, N = 4SE +/- 635.79, N = 2SE +/- 11854.44, N = 31248151752689300191556161774126259MIN: 123408.48 / MAX: 126102.61MIN: 171044.61 / MAX: 178009.88MIN: 91598.8 / MAX: 94217.31MIN: 90268.39 / MAX: 92441.34MIN: 161138.67 / MAX: 162410.25MIN: 109325.07 / MAX: 149096.741. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-8DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT4140K280K420K560K700KSE +/- 95.22, N = 3SE +/- 215.24, N = 3SE +/- 26.19, N = 4SE +/- 18466.98, N = 4SE +/- 38.05, N = 2SE +/- 14.74, N = 36266.225577.911696.39656928.125612.171303.25MIN: 603671.44 / MAX: 688537.191. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-8DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT420K40K60K80K100KSE +/- 1523.58, N = 3SE +/- 3443.78, N = 3SE +/- 419.10, N = 4SE +/- 288.54, N = 4SE +/- 608.82, N = 2SE +/- 235.86, N = 31002598924627142102648979520852MIN: 97220.11 / MAX: 101967.93MIN: 84204.33 / MAX: 95830.97MIN: 26088.08 / MAX: 27844.44MIN: 89185.9 / MAX: 90403.53MIN: 20567.79 / MAX: 21320.091. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Phoronix Test Suite v10.8.4