PVE-SATA-ZFS-RAID10-6Disks

PVE-SATA-ZFS-RAID10-8Disks-EPYC7543

HTML result view exported from: https://openbenchmarking.org/result/2310134-TCST-231008420&grr.

PVE-SATA-ZFS-RAID10-6DisksProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelVulkanCompilerFile-SystemScreen ResolutionSystem LayerPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8DisksPVE-NVME-ZFS-RAID1-2DisksPVE-SATA-ZFS-RAID10-8Disks 64K recPVE-SATA-ZFS-RAID10-8Disks-EPYC7543AMD EPYC 7402 24-Core (12 Cores)QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS)Intel 82G33/G31/P35/P31 + ICH916GB34GB QEMU HDDbochs-drmdrmfbIntel 82801IQEMU MonitorRed Hat Virtio deviceUbuntu 22.045.15.0-84-generic (x86_64)1.3.238GCC 11.4.0ext41280x800KVM5.15.0-86-generic (x86_64)AMD EPYC 7543 32-Core (12 Cores)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Disk Details- NONE / relatime,rw / Block Size: 4096Processor Details- PVE-SATA-ZFS-RAID10-6Disks: CPU Microcode: 0x830104d- PVE-SATA-ZFS-RAID10-8Disks: CPU Microcode: 0x830104d- PVE-NVME-ZFS-RAID1-2Disks: CPU Microcode: 0x830104d- PVE-SATA-ZFS-RAID10-8Disks 64K rec: CPU Microcode: 0x830104d- PVE-SATA-ZFS-RAID10-8Disks-EPYC7543: CPU Microcode: 0xa00110dSecurity Details- PVE-SATA-ZFS-RAID10-6Disks: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT disabled + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - PVE-SATA-ZFS-RAID10-8Disks: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT disabled + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - PVE-NVME-ZFS-RAID1-2Disks: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT disabled + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - PVE-SATA-ZFS-RAID10-8Disks 64K rec: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT disabled + spec_rstack_overflow: Mitigation of SMT disabled + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - PVE-SATA-ZFS-RAID10-8Disks-EPYC7543: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

PVE-SATA-ZFS-RAID10-6Disksfio: Rand Read - Linux AIO - No - No - 64KB - 1 - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 64KB - 1 - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 64KB - 1 - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 64KB - 1 - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 4KB - 1 - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 4KB - 1 - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 4KB - 1 - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 4KB - 1 - Default Test DirectoryPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8DisksPVE-NVME-ZFS-RAID1-2DisksPVE-SATA-ZFS-RAID10-8Disks 64K recPVE-SATA-ZFS-RAID10-8Disks-EPYC7543476032975.23172261076.61138501554004.19103886415546.15752264701.61222781392.38142180568722.14114974459895.50999186244.88308891930.57131797527188.4192950371799.241253727835.742064132112.15156477625906.39477819110.37867305420.61139789388.65204252817008.53503920155.92OpenBenchmarking.org

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8DisksPVE-NVME-ZFS-RAID1-2DisksPVE-SATA-ZFS-RAID10-8Disks 64K recPVE-SATA-ZFS-RAID10-8Disks-EPYC754330K60K90K120K150KSE +/- 188.54, N = 3SE +/- 819.79, N = 3SE +/- 1454.83, N = 15SE +/- 3342.65, N = 5SE +/- 4102.59, N = 547603752269991812537286730MIN: 47226.44 / MAX: 47796.94MIN: 73996.52 / MAX: 76779.97MIN: 88116.28 / MAX: 109282.62MIN: 120840.15 / MAX: 138556.61MIN: 76356.28 / MAX: 96716.821. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8DisksPVE-NVME-ZFS-RAID1-2DisksPVE-SATA-ZFS-RAID10-8Disks 64K recPVE-SATA-ZFS-RAID10-8Disks-EPYC75432K4K6K8K10KSE +/- 11.78, N = 3SE +/- 51.24, N = 3SE +/- 90.93, N = 15SE +/- 208.92, N = 5SE +/- 256.41, N = 52975.234701.616244.887835.745420.61MIN: 2951.66 / MAX: 2987.32MIN: 4624.79 / MAX: 4798.76MIN: 5507.27 / MAX: 6830.17MIN: 7552.51 / MAX: 8659.79MIN: 4772.27 / MAX: 6044.81. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8DisksPVE-NVME-ZFS-RAID1-2DisksPVE-SATA-ZFS-RAID10-8Disks 64K recPVE-SATA-ZFS-RAID10-8Disks-EPYC75437K14K21K28K35KSE +/- 152.69, N = 15SE +/- 44.49, N = 3SE +/- 237.15, N = 3SE +/- 2.95, N = 5SE +/- 26.45, N = 517226222783088920641397MIN: 16559.33 / MAX: 18616.54MIN: 22202 / MAX: 22356.08MIN: 30476.82 / MAX: 31298.321. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8DisksPVE-NVME-ZFS-RAID1-2DisksPVE-SATA-ZFS-RAID10-8Disks 64K recPVE-SATA-ZFS-RAID10-8Disks-EPYC754330K60K90K120K150KSE +/- 9.54, N = 15SE +/- 2.77, N = 3SE +/- 14.82, N = 3SE +/- 188.68, N = 5SE +/- 1692.33, N = 51076.611392.381930.57132112.1589388.65MIN: 131788.07 / MAX: 132708.91MIN: 86732.47 / MAX: 95994.761. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8DisksPVE-NVME-ZFS-RAID1-2DisksPVE-SATA-ZFS-RAID10-8Disks 64K recPVE-SATA-ZFS-RAID10-8Disks-EPYC754340K80K120K160K200KSE +/- 226.74, N = 3SE +/- 740.76, N = 3SE +/- 361.19, N = 3SE +/- 779.58, N = 5SE +/- 3063.09, N = 5138501142180131797156477204252MIN: 138226.02 / MAX: 138950.81MIN: 141056.82 / MAX: 143578.51MIN: 131251.14 / MAX: 132479.72MIN: 153965.84 / MAX: 158510.43MIN: 192042.12 / MAX: 207954.571. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8DisksPVE-NVME-ZFS-RAID1-2DisksPVE-SATA-ZFS-RAID10-8Disks 64K recPVE-SATA-ZFS-RAID10-8Disks-EPYC7543200K400K600K800K1000KSE +/- 907.07, N = 3SE +/- 2963.15, N = 3SE +/- 1444.82, N = 3SE +/- 3118.29, N = 5SE +/- 12252.38, N = 5554004.19568722.14527188.41625906.39817008.53MIN: 552904.03 / MAX: 555803.49MIN: 564227.4 / MAX: 574314.47MIN: 525004.58 / MAX: 529919.12MIN: 615863.53 / MAX: 634041.79MIN: 768168.87 / MAX: 831818.771. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8DisksPVE-NVME-ZFS-RAID1-2DisksPVE-SATA-ZFS-RAID10-8Disks 64K recPVE-SATA-ZFS-RAID10-8Disks-EPYC754320K40K60K80K100KSE +/- 549.53, N = 3SE +/- 668.16, N = 3SE +/- 509.01, N = 3SE +/- 20.06, N = 5SE +/- 110.94, N = 51038861149749295047785039MIN: 103087.2 / MAX: 104939.44MIN: 113657.43 / MAX: 115831.02MIN: 92104.66 / MAX: 93863.871. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8DisksPVE-NVME-ZFS-RAID1-2DisksPVE-SATA-ZFS-RAID10-8Disks 64K recPVE-SATA-ZFS-RAID10-8Disks-EPYC7543100K200K300K400K500KSE +/- 2198.09, N = 3SE +/- 2672.63, N = 3SE +/- 2036.04, N = 3SE +/- 80.22, N = 5SE +/- 443.77, N = 5415546.15459895.50371799.2419110.3720155.92MIN: 412349 / MAX: 419757.86MIN: 454629.83 / MAX: 463324.23MIN: 368418.88 / MAX: 375455.691. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Phoronix Test Suite v10.8.4