phoronix_fio_zfs_raidz

2 x Intel Xeon Gold 6248 testing with a Supermicro X11DGO-T v1.02 (3.2 BIOS) and ASPEED 32GB on RedHatEnterprise 8.2 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2009073-NE-2005220NI00.

phoronix_fio_zfs_raidzProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelDesktopDisplay ServerCompilerFile-SystemScreen ResolutionDisplay Driver5 x 2000GB INTEL SSDPE2KX020T8fio_raidix_xfsRAIDIX_xfsBeast_zfs2 x AMD EPYC 7702 64-Core @ 2.00GHz (128 Cores / 256 Threads)Supermicro H11DSU-iN v2.10 (2.0b BIOS)AMD Starship/Matisse32 x 64 GB DDR4-3200MT/s 36ASF8G72PZ-3G2B25 x 2000GB INTEL SSDPE2KX020T8 + 1000GB INTEL SSDPELKX010T8ASPEED2 x Intel 10-Gigabit X540-AT2Red Hat Enterprise Linux 8.24.18.0-193.1.2.el8_2.x86_64 (x86_64)GNOME Shell 3.32.2X ServerGCC 8.3.1 20191121 + Clang 9.0.1 + LLVM 9.0.1ext41024x7682 x Intel Xeon Gold 6248 @ 3.90GHz (40 Cores / 80 Threads)Supermicro X11DGO-T v1.02 (3.2 BIOS)Intel Sky Lake-E DMI3 Registers24 x 64 GB DDR4-2933MT/s Samsung M393A8G40MB2-CVF4 x 2000GB INTEL SSDPE2KX020T8 + 2 x 480GB INTEL SSDSC2KB48ASPEED 32GBRedHatEnterprise 8.24.18.0-193.6.3.el8_2.x86_64 (x86_64)X Server 1.20.6modesetting 1.20.6GCC 8.3.1 20191121 + Clang 9.0.1 + LLVM 9.0.1 + CUDA 11.0OpenBenchmarking.orgCompiler Details- --build=x86_64-redhat-linux --disable-libmpx --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-gcc-major-version-only --with-isl --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver Disk Details- 5 x 2000GB INTEL SSDPE2KX020T8: NONE / relatime,rw- fio_raidix_xfs: NONE / relatime,rw- RAIDIX_xfs: NONE / relatime,rw- Beast_zfs: NONE / relatime,rw,seclabel / raid1 sdb3[1] sda3[0]Processor Details- 5 x 2000GB INTEL SSDPE2KX020T8: Scaling Governor: acpi-cpufreq performance - CPU Microcode: 0x8301025- fio_raidix_xfs: Scaling Governor: acpi-cpufreq performance - CPU Microcode: 0x8301025- RAIDIX_xfs: Scaling Governor: acpi-cpufreq performance - CPU Microcode: 0x8301025- Beast_zfs: Scaling Governor: intel_pstate performance - CPU Microcode: 0x5002f01Security Details- 5 x 2000GB INTEL SSDPE2KX020T8: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + tsx_async_abort: Not affected - fio_raidix_xfs: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + tsx_async_abort: Not affected - RAIDIX_xfs: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + tsx_async_abort: Not affected - Beast_zfs: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Mitigation of Clear buffers; SMT vulnerable

phoronix_fio_zfs_raidzfio: Rand Read - Linux AIO - No - Yes - 1MB - /zdatafio: Rand Read - Linux AIO - No - Yes - 1MB - /zdatafio: Rand Write - Linux AIO - No - Yes - 1MB - /zdatafio: Rand Write - Linux AIO - No - Yes - 1MB - /zdatafio: Seq Read - Linux AIO - No - Yes - 1MB - /zdatafio: Seq Read - Linux AIO - No - Yes - 1MB - /zdatafio: Seq Write - Linux AIO - No - Yes - 1MB - /zdatafio: Seq Write - Linux AIO - No - Yes - 1MB - /zdata5 x 2000GB INTEL SSDPE2KX020T8fio_raidix_xfsRAIDIX_xfsBeast_zfs574557413300329656625659321032068253824944374433826582614593458938853881227222693902389822752271OpenBenchmarking.org

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: /zdata

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: /zdata5 x 2000GB INTEL SSDPE2KX020T8RAIDIX_xfsBeast_zfs2K4K6K8K10KSE +/- 77.05, N = 5SE +/- 67.18, N = 15SE +/- 40.53, N = 85745825338851. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl

Flexible IO Tester

Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: /zdata

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: /zdata5 x 2000GB INTEL SSDPE2KX020T8RAIDIX_xfsBeast_zfs2K4K6K8K10KSE +/- 77.16, N = 5SE +/- 67.20, N = 15SE +/- 40.48, N = 85741824938811. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: /zdata

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: /zdata5 x 2000GB INTEL SSDPE2KX020T8RAIDIX_xfsBeast_zfs10002000300040005000SE +/- 21.94, N = 3SE +/- 102.02, N = 15SE +/- 22.52, N = 33300443722721. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl

Flexible IO Tester

Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: /zdata

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: /zdata5 x 2000GB INTEL SSDPE2KX020T8RAIDIX_xfsBeast_zfs10002000300040005000SE +/- 21.62, N = 3SE +/- 102.04, N = 15SE +/- 22.81, N = 33296443322691. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl

Flexible IO Tester

Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: /zdata

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: /zdata5 x 2000GB INTEL SSDPE2KX020T8RAIDIX_xfsBeast_zfs2K4K6K8K10KSE +/- 44.72, N = 15SE +/- 80.64, N = 15SE +/- 23.62, N = 35662826539021. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl

Flexible IO Tester

Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: /zdata

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: /zdata5 x 2000GB INTEL SSDPE2KX020T8RAIDIX_xfsBeast_zfs2K4K6K8K10KSE +/- 44.71, N = 15SE +/- 80.61, N = 15SE +/- 23.95, N = 35659826138981. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl

Flexible IO Tester

Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: /zdata

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: /zdata5 x 2000GB INTEL SSDPE2KX020T8RAIDIX_xfsBeast_zfs10002000300040005000SE +/- 42.25, N = 15SE +/- 9.35, N = 3SE +/- 17.74, N = 153210459322751. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl

Flexible IO Tester

Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: /zdata

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 1MB - Disk Target: /zdata5 x 2000GB INTEL SSDPE2KX020T8RAIDIX_xfsBeast_zfs10002000300040005000SE +/- 42.19, N = 15SE +/- 9.54, N = 3SE +/- 17.79, N = 153206458922711. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl

Phoronix Test Suite v10.8.4