PVE-SATA-ZFS-RAID10-6Disks

Proxmox ZFS NVME mirror 2 drives

HTML result view exported from: https://openbenchmarking.org/result/2310064-TCST-231002730&sro&grs.

PVE-SATA-ZFS-RAID10-6DisksProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelVulkanCompilerFile-SystemScreen ResolutionSystem LayerPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8DisksPVE-NVME-ZFS-RAID1-2DisksAMD EPYC 7402 24-Core (12 Cores)QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS)Intel 82G33/G31/P35/P31 + ICH916GB34GB QEMU HDDbochs-drmdrmfbIntel 82801IQEMU MonitorRed Hat Virtio deviceUbuntu 22.045.15.0-84-generic (x86_64)1.3.238GCC 11.4.0ext41280x800KVMOpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Disk Details- NONE / relatime,rw / Block Size: 4096Processor Details- CPU Microcode: 0x830104dSecurity Details- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT disabled + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

PVE-SATA-ZFS-RAID10-6Disksfio: Rand Read - Linux AIO - No - No - 64KB - 1 - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 64KB - 1 - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 64KB - 1 - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 64KB - 1 - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 4KB - 1 - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 4KB - 1 - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 4KB - 1 - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 4KB - 1 - Default Test DirectoryPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8DisksPVE-NVME-ZFS-RAID1-2Disks476032975.231076.6117226415546.15103886554004.19138501752264701.611392.3822278459895.50114974568722.14142180999186244.881930.5730889371799.2492950527188.41131797OpenBenchmarking.org

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-ZFS-RAID1-2DisksPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8Disks20K40K60K80K100KSE +/- 1454.83, N = 15SE +/- 188.54, N = 3SE +/- 819.79, N = 3999184760375226MIN: 88116.28 / MAX: 109282.62MIN: 47226.44 / MAX: 47796.94MIN: 73996.52 / MAX: 76779.971. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-ZFS-RAID1-2DisksPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8Disks13002600390052006500SE +/- 90.93, N = 15SE +/- 11.78, N = 3SE +/- 51.24, N = 36244.882975.234701.61MIN: 5507.27 / MAX: 6830.17MIN: 2951.66 / MAX: 2987.32MIN: 4624.79 / MAX: 4798.761. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-ZFS-RAID1-2DisksPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8Disks400800120016002000SE +/- 14.82, N = 3SE +/- 9.54, N = 15SE +/- 2.77, N = 31930.571076.611392.38MIN: 1904.82 / MAX: 1956.16MIN: 1034.96 / MAX: 1163.54MIN: 1387.63 / MAX: 1397.241. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-ZFS-RAID1-2DisksPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8Disks7K14K21K28K35KSE +/- 237.15, N = 3SE +/- 152.69, N = 15SE +/- 44.49, N = 3308891722622278MIN: 30476.82 / MAX: 31298.32MIN: 16559.33 / MAX: 18616.54MIN: 22202 / MAX: 22356.081. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-ZFS-RAID1-2DisksPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8Disks100K200K300K400K500KSE +/- 2036.04, N = 3SE +/- 2198.09, N = 3SE +/- 2672.63, N = 3371799.24415546.15459895.50MIN: 368418.88 / MAX: 375455.69MIN: 412349 / MAX: 419757.86MIN: 454629.83 / MAX: 463324.231. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-ZFS-RAID1-2DisksPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8Disks20K40K60K80K100KSE +/- 509.01, N = 3SE +/- 549.53, N = 3SE +/- 668.16, N = 392950103886114974MIN: 92104.66 / MAX: 93863.87MIN: 103087.2 / MAX: 104939.44MIN: 113657.43 / MAX: 115831.021. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-ZFS-RAID1-2DisksPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8Disks120K240K360K480K600KSE +/- 1444.82, N = 3SE +/- 907.07, N = 3SE +/- 2963.15, N = 3527188.41554004.19568722.14MIN: 525004.58 / MAX: 529919.12MIN: 552904.03 / MAX: 555803.49MIN: 564227.4 / MAX: 574314.471. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-NVME-ZFS-RAID1-2DisksPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8Disks30K60K90K120K150KSE +/- 361.19, N = 3SE +/- 226.74, N = 3SE +/- 740.76, N = 3131797138501142180MIN: 131251.14 / MAX: 132479.72MIN: 138226.02 / MAX: 138950.81MIN: 141056.82 / MAX: 143578.511. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Phoronix Test Suite v10.8.5