2020-06-24-2159

no tuning, compression, or dedup

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2006257-NI-20200624287
Jump To Table - Results

Statistics

Remove Outliers Before Calculating Averages

Graph Settings

Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
zfs_6x_ssd_in_2x_raidz1
June 24 2020
  2 Hours, 24 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

zfs_6x_ssd_in_2x_raidz1

Processor: 2 x Intel Xeon E5-2640 v3 @ 3.40GHz (16 Cores / 32 Threads), Motherboard: Dell 0CNCJW (2.11.0 BIOS), Chipset: Intel Xeon E7 v3/Xeon, Memory: 16 x GB DDR4-2133MT/s HMA42GR7MFR4N-TF, Disk: 6 x 481GB HSCP0480S5xnNMRI + 99GB PERC H730 Mini + 16GB Cruzer Blade + 16GB Cruzer Fit, Graphics: Matrox G200eR2, Monitor: DELL E196FP, Network: 2 x Intel 10-Gigabit X540-AT2 + 2 x Intel I350 + Mellanox MT27500

OS: CentOS Linux 8, Kernel: 4.18.0-193.6.3.el8_2.x86_64 (x86_64), Compiler: GCC 8.3.1 20191121, File-System: xfs, Screen Resolution: 1280x1024

Compiler Notes: --build=x86_64-redhat-linux --disable-libmpx --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-gcc-major-version-only --with-isl --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver
Disk Notes: MQ-DEADLINE / attr2,inode64,noquota,relatime,rw,seclabel
Processor Notes: Scaling Governor: intel_pstate performance - CPU Microcode: 0x43
Security Notes: SELinux + itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

2020-06-24-2159OpenBenchmarking.orgPhoronix Test Suite2 x Intel Xeon E5-2640 v3 @ 3.40GHz (16 Cores / 32 Threads)Dell 0CNCJW (2.11.0 BIOS)Intel Xeon E7 v3/Xeon16 x GB DDR4-2133MT/s HMA42GR7MFR4N-TF6 x 481GB HSCP0480S5xnNMRI + 99GB PERC H730 Mini + 16GB Cruzer Blade + 16GB Cruzer FitMatrox G200eR2DELL E196FP2 x Intel 10-Gigabit X540-AT2 + 2 x Intel I350 + Mellanox MT27500CentOS Linux 84.18.0-193.6.3.el8_2.x86_64 (x86_64)GCC 8.3.1 20191121xfs1280x1024ProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelCompilerFile-SystemScreen Resolution2020-06-24-2159 BenchmarksSystem Logs- --build=x86_64-redhat-linux --disable-libmpx --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-gcc-major-version-only --with-isl --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver - MQ-DEADLINE / attr2,inode64,noquota,relatime,rw,seclabel- Scaling Governor: intel_pstate performance - CPU Microcode: 0x43- SELinux + itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

2020-06-24-2159fio: Rand Read - Sync - No - Yes - 4KB - /mnt/ztest1fio: Rand Read - Sync - No - Yes - 4KB - /mnt/ztest1fio: Rand Read - Sync - No - Yes - 16KB - /mnt/ztest1fio: Rand Read - Sync - No - Yes - 16KB - /mnt/ztest1fio: Rand Read - Sync - No - Yes - 64KB - /mnt/ztest1fio: Rand Read - Sync - No - Yes - 64KB - /mnt/ztest1fio: Rand Write - Sync - No - Yes - 4KB - /mnt/ztest1fio: Rand Write - Sync - No - Yes - 4KB - /mnt/ztest1fio: Rand Write - Sync - No - Yes - 16KB - /mnt/ztest1fio: Rand Write - Sync - No - Yes - 16KB - /mnt/ztest1fio: Rand Write - Sync - No - Yes - 64KB - /mnt/ztest1fio: Rand Write - Sync - No - Yes - 64KB - /mnt/ztest1fio: Seq Read - Sync - No - Yes - 4KB - /mnt/ztest1fio: Seq Read - Sync - No - Yes - 4KB - /mnt/ztest1fio: Rand Read - Linux AIO - No - Yes - 4KB - /mnt/ztest1fio: Rand Read - Linux AIO - No - Yes - 4KB - /mnt/ztest1fio: Seq Read - Sync - No - Yes - 16KB - /mnt/ztest1fio: Seq Read - Sync - No - Yes - 16KB - /mnt/ztest1fio: Seq Read - Sync - No - Yes - 64KB - /mnt/ztest1fio: Seq Read - Sync - No - Yes - 64KB - /mnt/ztest1fio: Seq Write - Sync - No - Yes - 4KB - /mnt/ztest1fio: Seq Write - Sync - No - Yes - 4KB - /mnt/ztest1fio: Rand Read - Linux AIO - No - Yes - 16KB - /mnt/ztest1fio: Rand Read - Linux AIO - No - Yes - 16KB - /mnt/ztest1fio: Rand Read - Linux AIO - No - Yes - 64KB - /mnt/ztest1fio: Rand Read - Linux AIO - No - Yes - 64KB - /mnt/ztest1fio: Rand Write - Linux AIO - No - Yes - 4KB - /mnt/ztest1fio: Rand Write - Linux AIO - No - Yes - 4KB - /mnt/ztest1fio: Seq Write - Sync - No - Yes - 16KB - /mnt/ztest1fio: Seq Write - Sync - No - Yes - 16KB - /mnt/ztest1fio: Seq Write - Sync - No - Yes - 64KB - /mnt/ztest1fio: Seq Write - Sync - No - Yes - 64KB - /mnt/ztest1fio: Rand Write - Linux AIO - No - Yes - 16KB - /mnt/ztest1fio: Rand Write - Linux AIO - No - Yes - 16KB - /mnt/ztest1fio: Rand Write - Linux AIO - No - Yes - 64KB - /mnt/ztest1fio: Rand Write - Linux AIO - No - Yes - 64KB - /mnt/ztest1fio: Seq Read - Linux AIO - No - Yes - 4KB - /mnt/ztest1fio: Seq Read - Linux AIO - No - Yes - 4KB - /mnt/ztest1fio: Seq Read - Linux AIO - No - Yes - 16KB - /mnt/ztest1fio: Seq Read - Linux AIO - No - Yes - 16KB - /mnt/ztest1fio: Seq Read - Linux AIO - No - Yes - 64KB - /mnt/ztest1fio: Seq Read - Linux AIO - No - Yes - 64KB - /mnt/ztest1fio: Seq Write - Linux AIO - No - Yes - 4KB - /mnt/ztest1fio: Seq Write - Linux AIO - No - Yes - 4KB - /mnt/ztest1fio: Seq Write - Linux AIO - No - Yes - 16KB - /mnt/ztest1fio: Seq Write - Linux AIO - No - Yes - 16KB - /mnt/ztest1fio: Seq Write - Linux AIO - No - Yes - 64KB - /mnt/ztest1fio: Seq Write - Linux AIO - No - Yes - 64KB - /mnt/ztest1zfs_6x_ssd_in_2x_raidz1946242133253516226745537277321154027718456671879300671396357667872223333325420833348227716770017933322881466674092654502125413316251040002106334756624222516112570710862783332753176000438570167615157333142391067181128967OpenBenchmarking.org

Flexible IO Tester

Fio is an advanced disk benchmark that depends upon the kernel's AIO access library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz12004006008001000SE +/- 11.46, N = 159461. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz150K100K150K200K250KSE +/- 2946.94, N = 152421331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz15001000150020002500SE +/- 53.47, N = 1525351. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz130K60K90K120K150KSE +/- 3412.12, N = 151622671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz110002000300040005000SE +/- 121.70, N = 1545531. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz116K32K48K64K80KSE +/- 1917.72, N = 15727731. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz150100150200250SE +/- 3.16, N = 152111. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz112K24K36K48K60KSE +/- 803.41, N = 15540271. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz1150300450600750SE +/- 10.11, N = 37181. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz110K20K30K40K50KSE +/- 717.25, N = 3456671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz1400800120016002000SE +/- 25.71, N = 318791. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16K12K18K24K30KSE +/- 433.33, N = 3300671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz130060090012001500SE +/- 4.18, N = 313961. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz180K160K240K320K400KSE +/- 1333.33, N = 33576671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz12004006008001000SE +/- 13.38, N = 38721. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz150K100K150K200K250KSE +/- 3382.96, N = 32233331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz17001400210028003500SE +/- 3.76, N = 332541. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz140K80K120K160K200KSE +/- 333.33, N = 32083331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz110002000300040005000SE +/- 4.04, N = 348221. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz117K34K51K68K85KSE +/- 66.67, N = 3771671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz1150300450600750SE +/- 4.26, N = 37001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz140K80K120K160K200KSE +/- 881.92, N = 31793331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz15001000150020002500SE +/- 5.17, N = 322881. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz130K60K90K120K150KSE +/- 333.33, N = 31466671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz19001800270036004500SE +/- 3.53, N = 340921. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz114K28K42K56K70KSE +/- 28.87, N = 4654501. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz150100150200250SE +/- 2.40, N = 32121. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz112K24K36K48K60KSE +/- 648.93, N = 3541331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz130060090012001500SE +/- 7.64, N = 316251. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz120K40K60K80K100KSE +/- 577.35, N = 31040001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz15001000150020002500SE +/- 31.54, N = 421061. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz17K14K21K28K35KSE +/- 319.83, N = 4334751. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz1140280420560700SE +/- 6.87, N = 86621. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz19K18K27K36K45KSE +/- 506.30, N = 8422251. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz130060090012001500SE +/- 20.14, N = 1516111. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16K12K18K24K30KSE +/- 313.88, N = 15257071. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz12004006008001000SE +/- 14.90, N = 310861. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz160K120K180K240K300KSE +/- 3844.19, N = 32783331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16001200180024003000SE +/- 5.90, N = 327531. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz140K80K120K160K200KSE +/- 577.35, N = 31760001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz19001800270036004500SE +/- 4.37, N = 343851. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz115K30K45K60K75KSE +/- 66.67, N = 3701671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz1130260390520650SE +/- 6.89, N = 36151. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz130K60K90K120K150KSE +/- 1763.83, N = 31573331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz130060090012001500SE +/- 16.33, N = 314231. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz120K40K60K80K100KSE +/- 1052.51, N = 3910671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz1400800120016002000SE +/- 21.62, N = 318111. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16K12K18K24K30KSE +/- 352.77, N = 3289671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

48 Results Shown

Flexible IO Tester:
  Rand Read - Sync - No - Yes - 4KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Read - Sync - No - Yes - 16KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Read - Sync - No - Yes - 64KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Write - Sync - No - Yes - 4KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Write - Sync - No - Yes - 16KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Write - Sync - No - Yes - 64KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Read - Sync - No - Yes - 4KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Read - Linux AIO - No - Yes - 4KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Read - Sync - No - Yes - 16KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Read - Sync - No - Yes - 64KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Write - Sync - No - Yes - 4KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Read - Linux AIO - No - Yes - 16KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Read - Linux AIO - No - Yes - 64KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - Yes - 4KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Write - Sync - No - Yes - 16KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Write - Sync - No - Yes - 64KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - Yes - 16KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - Yes - 64KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Read - Linux AIO - No - Yes - 4KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Read - Linux AIO - No - Yes - 16KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Read - Linux AIO - No - Yes - 64KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Write - Linux AIO - No - Yes - 4KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Write - Linux AIO - No - Yes - 16KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Write - Linux AIO - No - Yes - 64KB - /mnt/ztest1:
    MB/s
    IOPS

zfs_6x_ssd_in_2x_raidz1

Processor: 2 x Intel Xeon E5-2640 v3 @ 3.40GHz (16 Cores / 32 Threads), Motherboard: Dell 0CNCJW (2.11.0 BIOS), Chipset: Intel Xeon E7 v3/Xeon, Memory: 16 x GB DDR4-2133MT/s HMA42GR7MFR4N-TF, Disk: 6 x 481GB HSCP0480S5xnNMRI + 99GB PERC H730 Mini + 16GB Cruzer Blade + 16GB Cruzer Fit, Graphics: Matrox G200eR2, Monitor: DELL E196FP, Network: 2 x Intel 10-Gigabit X540-AT2 + 2 x Intel I350 + Mellanox MT27500

OS: CentOS Linux 8, Kernel: 4.18.0-193.6.3.el8_2.x86_64 (x86_64), Compiler: GCC 8.3.1 20191121, File-System: xfs, Screen Resolution: 1280x1024

Compiler Notes: --build=x86_64-redhat-linux --disable-libmpx --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-gcc-major-version-only --with-isl --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver
Disk Notes: MQ-DEADLINE / attr2,inode64,noquota,relatime,rw,seclabel
Processor Notes: Scaling Governor: intel_pstate performance - CPU Microcode: 0x43
Security Notes: SELinux + itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 24 June 2020 21:59 by user .