05112023-TCST

PVE-NVME-R10-8DISK-ZFS2.2 Genoa

HTML result view exported from: https://openbenchmarking.org/result/2312184-TCST-231125580&sor&grr.

05112023-TCSTProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelVulkanCompilerFile-SystemScreen ResolutionSystem LayerPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINXEN-NVME-R10-4DISK-EXT4PVE-NVME-R10-8DISK-ZFS2.2AMD EPYC 7543 32-Core (12 Cores)QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS)Intel 82G33/G31/P35/P31 + ICH916GB34GB QEMU HDDbochs-drmdrmfbIntel 82801IQEMU MonitorRed Hat Virtio deviceUbuntu 22.045.15.0-86-generic (x86_64)1.3.238GCC 11.4.0ext41280x800KVM5.15.0-88-generic (x86_64)AMD EPYC 9354 32-Core (12 Cores)QEMU Standard PC (Q35 + ICH9 2009) (4.2023.08-2 BIOS)5.15.0-84-generic (x86_64)Xen HVM domU v4.13Intel 440FX 82441FX PMC30GB5.15.0-89-generic (x86_64)1024x768Xen HVM domU 4.13AMD EPYC 9354 32-Core (16 Cores)QEMU Standard PC (Q35 + ICH9 2009) (4.2023.08-2 BIOS)Intel 82G33/G31/P35/P31 + ICH934GB QEMU HDDIntel 82801IQEMU MonitorRed Hat Virtio device5.15.0-91-generic (x86_64)1280x800KVMOpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Disk Details- PVE-NVME-R10-4DISK-ZFS2.1, PVE-NVME-R10-4DISK-ZFS2.2, PVE-NVME-R10-4DISK-LVM, PVE-NVME-R10-4DISK-LVM-THIN, PVE-NVME-R10-8DISK-ZFS2.2: NONE / relatime,rw / Block Size: 4096Processor Details- PVE-NVME-R10-4DISK-ZFS2.1: CPU Microcode: 0xa00110d- PVE-NVME-R10-4DISK-ZFS2.2: CPU Microcode: 0xa00110d- PVE-NVME-R10-4DISK-LVM: CPU Microcode: 0xa00110d- PVE-NVME-R10-4DISK-LVM-THIN: CPU Microcode: 0xa101121- XEN-NVME-R10-4DISK-EXT4: CPU Microcode: 0xa101144- PVE-NVME-R10-8DISK-ZFS2.2: CPU Microcode: 0xa101121Security Details- PVE-NVME-R10-4DISK-ZFS2.1: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - PVE-NVME-R10-4DISK-ZFS2.2: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - PVE-NVME-R10-4DISK-LVM: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - PVE-NVME-R10-4DISK-LVM-THIN: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - XEN-NVME-R10-4DISK-EXT4: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - PVE-NVME-R10-8DISK-ZFS2.2: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected Disk Mount Options Details- XEN-NVME-R10-4DISK-EXT4: relatime,rwDisk Details Details- XEN-NVME-R10-4DISK-EXT4: Block Size: 4096

05112023-TCSTfio: Rand Read - IO_uring - No - No - 4KB - 1 - Default Test Directoryfio: Rand Read - IO_uring - No - No - 4KB - 1 - Default Test Directoryfio: Seq Read - IO_uring - No - No - 64KB - 1 - Default Test Directoryfio: Seq Read - IO_uring - No - No - 64KB - 1 - Default Test Directoryfio: Seq Read - IO_uring - No - No - 4KB - 1 - Default Test Directoryfio: Seq Read - IO_uring - No - No - 4KB - 1 - Default Test Directoryfio: Rand Read - IO_uring - No - No - 1MB - 1 - Default Test Directoryfio: Rand Read - IO_uring - No - No - 1MB - 1 - Default Test Directoryfio: Rand Read - IO_uring - No - No - 64KB - 1 - Default Test Directoryfio: Rand Read - IO_uring - No - No - 64KB - 1 - Default Test Directoryfio: Seq Read - IO_uring - No - No - 1MB - 1 - Default Test Directoryfio: Seq Read - IO_uring - No - No - 1MB - 1 - Default Test Directoryfio: Seq Write - IO_uring - No - No - 1MB - 1 - Default Test Directoryfio: Seq Write - IO_uring - No - No - 1MB - 1 - Default Test Directoryfio: Seq Write - IO_uring - No - No - 64KB - 1 - Default Test Directoryfio: Seq Write - IO_uring - No - No - 64KB - 1 - Default Test Directoryfio: Rand Write - IO_uring - No - No - 1MB - 1 - Default Test Directoryfio: Rand Write - IO_uring - No - No - 1MB - 1 - Default Test Directoryfio: Rand Write - IO_uring - No - No - 64KB - 1 - Default Test Directoryfio: Rand Write - IO_uring - No - No - 64KB - 1 - Default Test Directoryfio: Seq Write - IO_uring - No - No - 4KB - 1 - Default Test Directoryfio: Seq Write - IO_uring - No - No - 4KB - 1 - Default Test Directoryfio: Rand Write - IO_uring - No - No - 4KB - 1 - Default Test Directoryfio: Rand Write - IO_uring - No - No - 4KB - 1 - Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINXEN-NVME-R10-4DISK-EXT4PVE-NVME-R10-8DISK-ZFS2.2127708510833.62521193257.47131558526231.7340334032.60605263782.8538043803.8824202419.83271421696.3925542554.28314371964.7993001372002.8388678354712.28118691474764.96481573009.81122330489319.7338143814.21558023487.6436063606.5813781378.7110264656928.1226432643.0810978702583.6891556366223.5288991355963.94174062696247.301279967999.78164873659491.141880818807.881324188276.152003820037.9468076807.311002596266.2269226922.49979906124.38124815499262.03117717470866.56200093800373.641367458546.58178629714517.971900419003.621400158750.941969219691.6861096108.63892465577.9163926392.34775424846.36175268701071.06152386609544.81114841459364.69242101513.12118749474996.8116381637.85264681654.2314871486.9614951494.97208521303.2515041504.33217661360.37126259505037.27110091440366.12175996703983.63857405358.76173927695706.6287088708.001111296945.5566956695.3784308429.73897955612.1782258225.43881495509.34161774647097.87156992627966.71OpenBenchmarking.org

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-8DISK-ZFS2.2PVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT440K80K120K160K200KSE +/- 1592.60, N = 3SE +/- 364.67, N = 2SE +/- 771.29, N = 3SE +/- 1742.30, N = 4SE +/- 1404.16, N = 4SE +/- 920.94, N = 3200093175996174062127708118691114841MIN: 196961.07 / MAX: 202160.02MIN: 175631.32 / MAX: 176360.66MIN: 172527.28 / MAX: 174965.41MIN: 122932.47 / MAX: 131080.9MIN: 114916.45 / MAX: 121357.02MIN: 113187.22 / MAX: 116370.141. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-8DISK-ZFS2.2PVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT4200K400K600K800K1000KSE +/- 6370.47, N = 3SE +/- 1458.64, N = 2SE +/- 3085.12, N = 3SE +/- 6969.17, N = 4SE +/- 5616.59, N = 4SE +/- 3683.77, N = 3800373.64703983.63696247.30510833.62474764.96459364.69MIN: 787844.15 / MAX: 808640.32MIN: 702524.99 / MAX: 705442.26MIN: 690109.28 / MAX: 699861.68MIN: 491730.18 / MAX: 524323.85MIN: 459665.87 / MAX: 485427.97MIN: 452749.3 / MAX: 465480.921. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-8DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT430K60K90K120K150KSE +/- 1493.37, N = 3SE +/- 1105.99, N = 3SE +/- 213.50, N = 2SE +/- 98.17, N = 4SE +/- 62.81, N = 4SE +/- 385.98, N = 313674512799685740521194815724210MIN: 133827.61 / MAX: 138757.15MIN: 125799.47 / MAX: 129317.81MIN: 85526.58 / MAX: 85953.59MIN: 51928.62 / MAX: 52312.58MIN: 47997.17 / MAX: 48303.78MIN: 23570.81 / MAX: 24904.421. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-8DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT42K4K6K8K10KSE +/- 93.33, N = 3SE +/- 69.13, N = 3SE +/- 13.35, N = 2SE +/- 6.14, N = 4SE +/- 3.93, N = 4SE +/- 24.12, N = 38546.587999.785358.763257.473009.811513.12MIN: 8364.23 / MAX: 8672.32MIN: 7862.47 / MAX: 8082.37MIN: 5345.41 / MAX: 5372.1MIN: 3245.54 / MAX: 3269.54MIN: 2999.83 / MAX: 3018.991. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-8DISK-ZFS2.2PVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT440K80K120K160K200KSE +/- 850.37, N = 3SE +/- 115.40, N = 2SE +/- 221.27, N = 3SE +/- 368.35, N = 4SE +/- 941.64, N = 4SE +/- 10833.35, N = 3178629173927164873131558122330118749MIN: 176968.27 / MAX: 179775.83MIN: 173811.28 / MAX: 174042.09MIN: 164496.33 / MAX: 165262.48MIN: 130702.69 / MAX: 132302.27MIN: 119532.43 / MAX: 123585.36MIN: 106387.39 / MAX: 140340.221. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-8DISK-ZFS2.2PVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT4150K300K450K600K750KSE +/- 3401.42, N = 3SE +/- 461.66, N = 2SE +/- 885.09, N = 3SE +/- 1473.41, N = 4SE +/- 3766.56, N = 4SE +/- 43333.44, N = 3714517.97695706.62659491.14526231.73489319.73474996.81MIN: 707873.32 / MAX: 719103.4MIN: 695244.96 / MAX: 696168.28MIN: 657985.42 / MAX: 661050.08MIN: 522810.86 / MAX: 529209.12MIN: 478129.83 / MAX: 494341.44MIN: 425549.84 / MAX: 561361.271. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-8DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT44K8K12K16K20KSE +/- 203.09, N = 3SE +/- 69.50, N = 3SE +/- 111.63, N = 2SE +/- 2.23, N = 4SE +/- 2.10, N = 4SE +/- 6.83, N = 319004188088708403338141638MIN: 18621.31 / MAX: 19313.65MIN: 18689.13 / MAX: 18929.83MIN: 8596.19 / MAX: 8819.45MIN: 4028.6 / MAX: 4038.78MIN: 3810.7 / MAX: 3819.551. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-8DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT44K8K12K16K20KSE +/- 203.10, N = 3SE +/- 69.50, N = 3SE +/- 111.65, N = 2SE +/- 2.23, N = 4SE +/- 2.11, N = 4SE +/- 6.83, N = 319003.6218807.888708.004032.603814.211637.85MIN: 18621.35 / MAX: 19313.72MIN: 18689.17 / MAX: 18929.86MIN: 8596.35 / MAX: 8819.64MIN: 4028.61 / MAX: 4038.79MIN: 3810.97 / MAX: 3819.871. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-8DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT430K60K90K120K150KSE +/- 1973.06, N = 3SE +/- 1734.03, N = 3SE +/- 112.60, N = 2SE +/- 251.91, N = 4SE +/- 82.11, N = 4SE +/- 28.67, N = 3140015132418111129605265580226468MIN: 137810.86 / MAX: 143951.73MIN: 128981.55 / MAX: 134538.74MIN: 111016.18 / MAX: 111241.37MIN: 60127.11 / MAX: 61228.36MIN: 55571.32 / MAX: 55958.14MIN: 26426.26 / MAX: 26522.631. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-8DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT42K4K6K8K10KSE +/- 123.32, N = 3SE +/- 108.38, N = 3SE +/- 7.03, N = 2SE +/- 15.75, N = 4SE +/- 5.13, N = 4SE +/- 1.79, N = 38750.948276.156945.553782.853487.641654.23MIN: 8613.18 / MAX: 8996.99MIN: 8061.35 / MAX: 8408.67MIN: 6938.51 / MAX: 6952.58MIN: 3757.95 / MAX: 3826.78MIN: 3473.22 / MAX: 3497.39MIN: 1651.65 / MAX: 1657.671. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-8DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT44K8K12K16K20KSE +/- 89.43, N = 3SE +/- 246.63, N = 3SE +/- 11.67, N = 2SE +/- 2.29, N = 4SE +/- 0.68, N = 4SE +/- 5.92, N = 320038196926695380436061487MIN: 19859.03 / MAX: 20129.09MIN: 19239.28 / MAX: 20088.16MIN: 6683.45 / MAX: 6706.78MIN: 3797.73 / MAX: 3808.69MIN: 3604.97 / MAX: 3607.711. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-8DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT44K8K12K16K20KSE +/- 89.44, N = 3SE +/- 246.64, N = 3SE +/- 11.65, N = 2SE +/- 2.30, N = 4SE +/- 0.67, N = 4SE +/- 5.87, N = 320037.9419691.686695.373803.883606.581486.96MIN: 19859.08 / MAX: 20129.14MIN: 19239.35 / MAX: 20088.27MIN: 6683.72 / MAX: 6707.02MIN: 3797.8 / MAX: 3808.79MIN: 3605.37 / MAX: 3608.031. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-8DISK-ZFS2.2PVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-ZFS2.1XEN-NVME-R10-4DISK-EXT4PVE-NVME-R10-4DISK-ZFS2.22K4K6K8K10KSE +/- 13.27, N = 2SE +/- 99.06, N = 3SE +/- 63.77, N = 3SE +/- 101.00, N = 4SE +/- 48.17, N = 3SE +/- 16.25, N = 4843068076109242014951378MIN: 8416.33 / MAX: 8442.87MIN: 6655.38 / MAX: 6993.37MIN: 6018.52 / MAX: 6231.83MIN: 2216.08 / MAX: 2646.04MIN: 1398.93 / MAX: 1551.64MIN: 1352.95 / MAX: 1424.591. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-8DISK-ZFS2.2PVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-ZFS2.1XEN-NVME-R10-4DISK-EXT4PVE-NVME-R10-4DISK-ZFS2.22K4K6K8K10KSE +/- 13.29, N = 2SE +/- 99.06, N = 3SE +/- 63.77, N = 3SE +/- 100.97, N = 4SE +/- 48.17, N = 3SE +/- 16.25, N = 48429.736807.316108.632419.831494.971378.71MIN: 8416.44 / MAX: 8443.02MIN: 6655.42 / MAX: 6993.41MIN: 6018.55 / MAX: 6231.87MIN: 2216.36 / MAX: 2646.21. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-8DISK-ZFS2.2PVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-ZFS2.1XEN-NVME-R10-4DISK-EXT4PVE-NVME-R10-4DISK-ZFS2.220K40K60K80K100KSE +/- 1523.58, N = 3SE +/- 608.82, N = 2SE +/- 3443.78, N = 3SE +/- 419.10, N = 4SE +/- 235.86, N = 3SE +/- 288.54, N = 41002598979589246271422085210264MIN: 97220.11 / MAX: 101967.93MIN: 89185.9 / MAX: 90403.53MIN: 84204.33 / MAX: 95830.97MIN: 26088.08 / MAX: 27844.44MIN: 20567.79 / MAX: 21320.091. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-LVMPVE-NVME-R10-8DISK-ZFS2.2PVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-ZFS2.1XEN-NVME-R10-4DISK-EXT4140K280K420K560K700KSE +/- 18466.98, N = 4SE +/- 95.22, N = 3SE +/- 38.05, N = 2SE +/- 215.24, N = 3SE +/- 26.19, N = 4SE +/- 14.74, N = 3656928.126266.225612.175577.911696.391303.25MIN: 603671.44 / MAX: 688537.191. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-8DISK-ZFS2.2PVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.1XEN-NVME-R10-4DISK-EXT42K4K6K8K10KSE +/- 20.71, N = 2SE +/- 31.06, N = 3SE +/- 53.32, N = 3SE +/- 10.38, N = 4SE +/- 50.98, N = 4SE +/- 123.07, N = 3822569226392264325541504MIN: 8204.63 / MAX: 8246.05MIN: 6861.28 / MAX: 6962.45MIN: 6335.18 / MAX: 6498.81MIN: 2613.24 / MAX: 2660.24MIN: 2405.24 / MAX: 2621MIN: 1372.1 / MAX: 1749.991. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-8DISK-ZFS2.2PVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.1XEN-NVME-R10-4DISK-EXT42K4K6K8K10KSE +/- 20.70, N = 2SE +/- 31.04, N = 3SE +/- 53.32, N = 3SE +/- 10.38, N = 4SE +/- 50.98, N = 4SE +/- 123.03, N = 38225.436922.496392.342643.082554.281504.33MIN: 8204.72 / MAX: 8246.13MIN: 6861.37 / MAX: 6962.5MIN: 6335.25 / MAX: 6498.89MIN: 2613.46 / MAX: 2660.47MIN: 2405.5 / MAX: 2621.261. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVMPVE-NVME-R10-8DISK-ZFS2.2PVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-ZFS2.1XEN-NVME-R10-4DISK-EXT4PVE-NVME-R10-4DISK-ZFS2.220K40K60K80K100KSE +/- 194.67, N = 3SE +/- 360.52, N = 2SE +/- 142.13, N = 3SE +/- 160.70, N = 4SE +/- 779.05, N = 3SE +/- 18.77, N = 4979908814977542314372176610978MIN: 97740.13 / MAX: 98373.57MIN: 87788.79 / MAX: 88509.83MIN: 77272.31 / MAX: 77754.9MIN: 31030.13 / MAX: 31758.5MIN: 20720.73 / MAX: 23289.141. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-LVMPVE-NVME-R10-8DISK-ZFS2.2PVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-ZFS2.1XEN-NVME-R10-4DISK-EXT4150K300K450K600K750KSE +/- 1201.47, N = 4SE +/- 12.17, N = 3SE +/- 22.53, N = 2SE +/- 8.88, N = 3SE +/- 10.04, N = 4SE +/- 48.69, N = 3702583.686124.385509.344846.361964.791360.37MIN: 700032.56 / MAX: 705692.671. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-8DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT4PVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.240K80K120K160K200KSE +/- 2142.72, N = 3SE +/- 635.79, N = 2SE +/- 11854.44, N = 3SE +/- 780.03, N = 3SE +/- 612.87, N = 4SE +/- 471.34, N = 41752681617741262591248159300191556MIN: 171044.61 / MAX: 178009.88MIN: 161138.67 / MAX: 162410.25MIN: 109325.07 / MAX: 149096.74MIN: 123408.48 / MAX: 126102.61MIN: 91598.8 / MAX: 94217.31MIN: 90268.39 / MAX: 92441.341. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-8DISK-ZFS2.2XEN-NVME-R10-4DISK-EXT4PVE-NVME-R10-4DISK-LVMPVE-NVME-R10-4DISK-ZFS2.1PVE-NVME-R10-4DISK-ZFS2.2150K300K450K600K750KSE +/- 8570.97, N = 3SE +/- 2543.12, N = 2SE +/- 47417.67, N = 3SE +/- 3120.10, N = 3SE +/- 2451.46, N = 4SE +/- 1885.36, N = 4701071.06647097.87505037.27499262.03372002.83366223.52MIN: 684178.38 / MAX: 712039.82MIN: 644554.75 / MAX: 649640.99MIN: 437300.68 / MAX: 596387.05MIN: 493634.13 / MAX: 504410.54MIN: 366395.47 / MAX: 376869.38MIN: 361073.65 / MAX: 369765.431. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-8DISK-ZFS2.2PVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-LVMXEN-NVME-R10-4DISK-EXT4PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.130K60K90K120K150KSE +/- 1995.35, N = 2SE +/- 845.39, N = 3SE +/- 340.68, N = 3SE +/- 2883.09, N = 3SE +/- 766.78, N = 4SE +/- 519.90, N = 41569921523861177171100918899188678MIN: 154996.32 / MAX: 158987.02MIN: 150996.74 / MAX: 153915.28MIN: 117255.4 / MAX: 118381.57MIN: 106581.88 / MAX: 115808.42MIN: 87994.01 / MAX: 91232.19MIN: 87337.43 / MAX: 89676.771. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-R10-8DISK-ZFS2.2PVE-NVME-R10-4DISK-LVM-THINPVE-NVME-R10-4DISK-LVMXEN-NVME-R10-4DISK-EXT4PVE-NVME-R10-4DISK-ZFS2.2PVE-NVME-R10-4DISK-ZFS2.1130K260K390K520K650KSE +/- 7981.55, N = 2SE +/- 3381.35, N = 3SE +/- 1362.71, N = 3SE +/- 11532.29, N = 3SE +/- 3067.11, N = 4SE +/- 2079.65, N = 4627966.71609544.81470866.56440366.12355963.94354712.28MIN: 619985.16 / MAX: 635948.26MIN: 603987.04 / MAX: 615660.46MIN: 469021.73 / MAX: 473526.32MIN: 426327.83 / MAX: 463233.79MIN: 351976.19 / MAX: 364928.78MIN: 349349.75 / MAX: 358707.211. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Phoronix Test Suite v10.8.5