PVE-SATA-ZFS-RAID10-6Disks

Proxmox ZFS NVME mirror 2 drives

HTML result view exported from: https://openbenchmarking.org/result/2310064-TCST-231002730&rdt&grt.

PVE-SATA-ZFS-RAID10-6DisksProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelVulkanCompilerFile-SystemScreen ResolutionSystem LayerPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8DisksPVE-NVME-ZFS-RAID1-2DisksAMD EPYC 7402 24-Core (12 Cores)QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS)Intel 82G33/G31/P35/P31 + ICH916GB34GB QEMU HDDbochs-drmdrmfbIntel 82801IQEMU MonitorRed Hat Virtio deviceUbuntu 22.045.15.0-84-generic (x86_64)1.3.238GCC 11.4.0ext41280x800KVMOpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Disk Details- NONE / relatime,rw / Block Size: 4096Processor Details- CPU Microcode: 0x830104dSecurity Details- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT disabled + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

PVE-SATA-ZFS-RAID10-6Disksfio: Rand Read - Linux AIO - No - No - 4KB - 1 - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 4KB - 1 - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 64KB - 1 - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 64KB - 1 - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 4KB - 1 - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 4KB - 1 - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 64KB - 1 - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 64KB - 1 - Default Test DirectoryPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8DisksPVE-NVME-ZFS-RAID1-2Disks554004.191385012975.2347603415546.151038861076.6117226568722.141421804701.6175226459895.501149741392.3822278527188.411317976244.8899918371799.24929501930.5730889OpenBenchmarking.org

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8DisksPVE-NVME-ZFS-RAID1-2Disks120K240K360K480K600KSE +/- 907.07, N = 3SE +/- 2963.15, N = 3SE +/- 1444.82, N = 3554004.19568722.14527188.41MIN: 552904.03 / MAX: 555803.49MIN: 564227.4 / MAX: 574314.47MIN: 525004.58 / MAX: 529919.121. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8DisksPVE-NVME-ZFS-RAID1-2Disks30K60K90K120K150KSE +/- 226.74, N = 3SE +/- 740.76, N = 3SE +/- 361.19, N = 3138501142180131797MIN: 138226.02 / MAX: 138950.81MIN: 141056.82 / MAX: 143578.51MIN: 131251.14 / MAX: 132479.721. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8DisksPVE-NVME-ZFS-RAID1-2Disks13002600390052006500SE +/- 11.78, N = 3SE +/- 51.24, N = 3SE +/- 90.93, N = 152975.234701.616244.88MIN: 2951.66 / MAX: 2987.32MIN: 4624.79 / MAX: 4798.76MIN: 5507.27 / MAX: 6830.171. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8DisksPVE-NVME-ZFS-RAID1-2Disks20K40K60K80K100KSE +/- 188.54, N = 3SE +/- 819.79, N = 3SE +/- 1454.83, N = 15476037522699918MIN: 47226.44 / MAX: 47796.94MIN: 73996.52 / MAX: 76779.97MIN: 88116.28 / MAX: 109282.621. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8DisksPVE-NVME-ZFS-RAID1-2Disks100K200K300K400K500KSE +/- 2198.09, N = 3SE +/- 2672.63, N = 3SE +/- 2036.04, N = 3415546.15459895.50371799.24MIN: 412349 / MAX: 419757.86MIN: 454629.83 / MAX: 463324.23MIN: 368418.88 / MAX: 375455.691. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8DisksPVE-NVME-ZFS-RAID1-2Disks20K40K60K80K100KSE +/- 549.53, N = 3SE +/- 668.16, N = 3SE +/- 509.01, N = 310388611497492950MIN: 103087.2 / MAX: 104939.44MIN: 113657.43 / MAX: 115831.02MIN: 92104.66 / MAX: 93863.871. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgMiB/s, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8DisksPVE-NVME-ZFS-RAID1-2Disks400800120016002000SE +/- 9.54, N = 15SE +/- 2.77, N = 3SE +/- 14.82, N = 31076.611392.381930.57MIN: 1034.96 / MAX: 1163.54MIN: 1387.63 / MAX: 1397.24MIN: 1904.82 / MAX: 1956.161. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.35Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test DirectoryPVE-SATA-ZFS-RAID10-6DisksPVE-SATA-ZFS-RAID10-8DisksPVE-NVME-ZFS-RAID1-2Disks7K14K21K28K35KSE +/- 152.69, N = 15SE +/- 44.49, N = 3SE +/- 237.15, N = 3172262227830889MIN: 16559.33 / MAX: 18616.54MIN: 22202 / MAX: 22356.08MIN: 30476.82 / MAX: 31298.321. (CC) gcc options: -rdynamic -lm -laio -lpthread -ldl -std=gnu99 -ffast-math -include -O3 -fcommon -march=native

Phoronix Test Suite v10.8.5