PVE-SATA-ZFS-RAID10-6Disks

PVE-NVME-ZFS-RAID10-4Disks

HTML result view exported from: https://openbenchmarking.org/result/2311131-TCST-231103551&grr&sro.

PVE-SATA-ZFS-RAID10-6DisksProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelVulkanCompilerFile-SystemScreen ResolutionSystem LayerPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8DisksPVE-NVME-ZFS-RAID1-2DisksPVE-SATA-ZFS-RAID10-8Disks 64K recPVE-SATA-ZFS-RAID10-8Disks-EPYC7543PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-BPVE-SATA-ZFS-RAID10-8Disks-EPYC7543-CPVE-SATA-ZFS-RAID10-8Disks-EPYC7543-DPVE-SATA-ZFS-RAID10-8Disks-EPYC7543-EPVE-NVME-ZFS-RAID10-4DisksAMD EPYC 7402 24-Core (12 Cores)QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS)Intel 82G33/G31/P35/P31 + ICH916GB34GB QEMU HDDbochs-drmdrmfbIntel 82801IQEMU MonitorRed Hat Virtio deviceUbuntu 22.045.15.0-84-generic (x86_64)1.3.238GCC 11.4.0ext41280x800KVM5.15.0-86-generic (x86_64)AMD EPYC 7543 32-Core (12 Cores)5.15.0-88-generic (x86_64)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Disk Details- NONE / relatime,rw / Block Size: 4096Processor Details- PVE-SATA-ZFS-RAID10-6Disks: CPU Microcode: 0x830104d- PVE-SATA-ZFS-RAID10-8Disks: CPU Microcode: 0x830104d- PVE-NVME-ZFS-RAID1-2Disks: CPU Microcode: 0x830104d- PVE-SATA-ZFS-RAID10-8Disks 64K rec: CPU Microcode: 0x830104d- PVE-SATA-ZFS-RAID10-8Disks-EPYC7543: CPU Microcode: 0xa00110d- PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-B: CPU Microcode: 0xa00110d- PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-C: CPU Microcode: 0xa00110d- PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-D: CPU Microcode: 0xa00110d- PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-E: CPU Microcode: 0xa00110d- PVE-NVME-ZFS-RAID10-4Disks: CPU Microcode: 0xa00110dSecurity Details- PVE-SATA-ZFS-RAID10-6Disks: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT disabled + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - PVE-SATA-ZFS-RAID10-8Disks: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT disabled + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - PVE-NVME-ZFS-RAID1-2Disks: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT disabled + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - PVE-SATA-ZFS-RAID10-8Disks 64K rec: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT disabled + spec_rstack_overflow: Mitigation of SMT disabled + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - PVE-SATA-ZFS-RAID10-8Disks-EPYC7543: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-B: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-C: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-D: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-E: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - PVE-NVME-ZFS-RAID10-4Disks: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

PVE-SATA-ZFS-RAID10-6Disksfio: Rand Write - Linux AIO - No - No - 64KB - 1 - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 64KB - 1 - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 64KB - 1 - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 64KB - 1 - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 4KB - 1 - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 4KB - 1 - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 4KB - 1 - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 4KB - 1 - Default Test DirectoryPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8DisksPVE-NVME-ZFS-RAID1-2DisksPVE-SATA-ZFS-RAID10-8Disks 64K recPVE-SATA-ZFS-RAID10-8Disks-EPYC7543PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-BPVE-SATA-ZFS-RAID10-8Disks-EPYC7543-CPVE-SATA-ZFS-RAID10-8Disks-EPYC7543-DPVE-SATA-ZFS-RAID10-8Disks-EPYC7543-EPVE-NVME-ZFS-RAID10-4Disks172261076.61476032975.23138501554004.19103886415546.15222781392.38752264701.61142180568722.14114974459895.50308891930.57999186244.88131797527188.4192950371799.242064132112.151253727835.74156477625906.39477819110.37139789388.65867305420.61204252817008.53503920155.921422358889.69219500877998.31545121803.522327148966.7416243810152.37206393825574.10576123043.37722174513.601195217470.08159446637784.10131158524630.36OpenBenchmarking.org

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-ZFS-RAID1-2DisksPVE-NVME-ZFS-RAID10-4DisksPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8DisksPVE-SATA-ZFS-RAID10-8Disks 64K recPVE-SATA-ZFS-RAID10-8Disks-EPYC7543PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-E15K30K45K60K75KSE +/- 237.15, N = 3SE +/- 452.19, N = 4SE +/- 152.69, N = 15SE +/- 44.49, N = 3SE +/- 2.95, N = 5SE +/- 26.45, N = 5SE +/- 2.40, N = 430889722171722622278206413972327MIN: 30476.82 / MAX: 31298.32MIN: 70915.86 / MAX: 72991.83MIN: 16559.33 / MAX: 18616.54MIN: 22202 / MAX: 22356.081. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-ZFS-RAID1-2DisksPVE-NVME-ZFS-RAID10-4DisksPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8DisksPVE-SATA-ZFS-RAID10-8Disks 64K recPVE-SATA-ZFS-RAID10-8Disks-EPYC7543PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-E30K60K90K120K150KSE +/- 14.82, N = 3SE +/- 28.26, N = 4SE +/- 9.54, N = 15SE +/- 2.77, N = 3SE +/- 188.68, N = 5SE +/- 1692.33, N = 5SE +/- 155.62, N = 41930.574513.601076.611392.38132112.1589388.65148966.74MIN: 131788.07 / MAX: 132708.91MIN: 86732.47 / MAX: 95994.76MIN: 148676.55 / MAX: 149280.11. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-ZFS-RAID1-2DisksPVE-NVME-ZFS-RAID10-4DisksPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8DisksPVE-SATA-ZFS-RAID10-8Disks 64K recPVE-SATA-ZFS-RAID10-8Disks-EPYC7543PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-DPVE-SATA-ZFS-RAID10-8Disks-EPYC7543-E30K60K90K120K150KSE +/- 1454.83, N = 15SE +/- 4939.21, N = 4SE +/- 188.54, N = 3SE +/- 819.79, N = 3SE +/- 3342.65, N = 5SE +/- 4102.59, N = 5SE +/- 9422.08, N = 3SE +/- 601.28, N = 499918119521476037522612537286730142235162438MIN: 88116.28 / MAX: 109282.62MIN: 110593.8 / MAX: 131556.23MIN: 47226.44 / MAX: 47796.94MIN: 73996.52 / MAX: 76779.97MIN: 120840.15 / MAX: 138556.61MIN: 76356.28 / MAX: 96716.82MIN: 123465.38 / MAX: 153071.58MIN: 161319.63 / MAX: 163651.531. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-ZFS-RAID1-2DisksPVE-NVME-ZFS-RAID10-4DisksPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8DisksPVE-SATA-ZFS-RAID10-8Disks 64K recPVE-SATA-ZFS-RAID10-8Disks-EPYC7543PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-DPVE-SATA-ZFS-RAID10-8Disks-EPYC7543-E2K4K6K8K10KSE +/- 90.93, N = 15SE +/- 308.70, N = 4SE +/- 11.78, N = 3SE +/- 51.24, N = 3SE +/- 208.92, N = 5SE +/- 256.41, N = 5SE +/- 588.88, N = 3SE +/- 37.58, N = 46244.887470.082975.234701.617835.745420.618889.6910152.37MIN: 5507.27 / MAX: 6830.17MIN: 6912.11 / MAX: 8222.27MIN: 2951.66 / MAX: 2987.32MIN: 4624.79 / MAX: 4798.76MIN: 7552.51 / MAX: 8659.79MIN: 4772.27 / MAX: 6044.8MIN: 7716.6 / MAX: 9566.99MIN: 10082.48 / MAX: 10228.221. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-ZFS-RAID1-2DisksPVE-NVME-ZFS-RAID10-4DisksPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8DisksPVE-SATA-ZFS-RAID10-8Disks 64K recPVE-SATA-ZFS-RAID10-8Disks-EPYC7543PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-DPVE-SATA-ZFS-RAID10-8Disks-EPYC7543-E50K100K150K200K250KSE +/- 361.19, N = 3SE +/- 1624.17, N = 4SE +/- 226.74, N = 3SE +/- 740.76, N = 3SE +/- 779.58, N = 5SE +/- 3063.09, N = 5SE +/- 1980.27, N = 3SE +/- 361.98, N = 4131797159446138501142180156477204252219500206393MIN: 131251.14 / MAX: 132479.72MIN: 154937.62 / MAX: 162649.01MIN: 138226.02 / MAX: 138950.81MIN: 141056.82 / MAX: 143578.51MIN: 153965.84 / MAX: 158510.43MIN: 192042.12 / MAX: 207954.57MIN: 217049.91 / MAX: 223419.48MIN: 205673.05 / MAX: 207399.691. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-ZFS-RAID1-2DisksPVE-NVME-ZFS-RAID10-4DisksPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8DisksPVE-SATA-ZFS-RAID10-8Disks 64K recPVE-SATA-ZFS-RAID10-8Disks-EPYC7543PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-DPVE-SATA-ZFS-RAID10-8Disks-EPYC7543-E200K400K600K800K1000KSE +/- 1444.82, N = 3SE +/- 6496.67, N = 4SE +/- 907.07, N = 3SE +/- 2963.15, N = 3SE +/- 3118.29, N = 5SE +/- 12252.38, N = 5SE +/- 7921.08, N = 3SE +/- 1447.94, N = 4527188.41637784.10554004.19568722.14625906.39817008.53877998.31825574.10MIN: 525004.58 / MAX: 529919.12MIN: 619750.54 / MAX: 650596.1MIN: 552904.03 / MAX: 555803.49MIN: 564227.4 / MAX: 574314.47MIN: 615863.53 / MAX: 634041.79MIN: 768168.87 / MAX: 831818.77MIN: 868199.88 / MAX: 893678.23MIN: 822692.61 / MAX: 829599.121. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-ZFS-RAID1-2DisksPVE-NVME-ZFS-RAID10-4DisksPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8DisksPVE-SATA-ZFS-RAID10-8Disks 64K recPVE-SATA-ZFS-RAID10-8Disks-EPYC7543PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-DPVE-SATA-ZFS-RAID10-8Disks-EPYC7543-E30K60K90K120K150KSE +/- 509.01, N = 3SE +/- 710.63, N = 4SE +/- 549.53, N = 3SE +/- 668.16, N = 3SE +/- 20.06, N = 5SE +/- 110.94, N = 5SE +/- 159.33, N = 3SE +/- 15.19, N = 4929501311581038861149744778503954515761MIN: 92104.66 / MAX: 93863.87MIN: 129824.48 / MAX: 132395.81MIN: 103087.2 / MAX: 104939.44MIN: 113657.43 / MAX: 115831.021. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-ZFS-RAID1-2DisksPVE-NVME-ZFS-RAID10-4DisksPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8DisksPVE-SATA-ZFS-RAID10-8Disks 64K recPVE-SATA-ZFS-RAID10-8Disks-EPYC7543PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-DPVE-SATA-ZFS-RAID10-8Disks-EPYC7543-E110K220K330K440K550KSE +/- 2036.04, N = 3SE +/- 2842.53, N = 4SE +/- 2198.09, N = 3SE +/- 2672.63, N = 3SE +/- 80.22, N = 5SE +/- 443.77, N = 5SE +/- 637.27, N = 3SE +/- 60.76, N = 4371799.24524630.36415546.15459895.5019110.3720155.9221803.5223043.37MIN: 368418.88 / MAX: 375455.69MIN: 519298.07 / MAX: 529583.21MIN: 412349 / MAX: 419757.86MIN: 454629.83 / MAX: 463324.231. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Phoronix Test Suite v10.8.5