2020-06-24-2159

no tuning, compression, or dedup. ashift=12 (last was 9)

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2006251-NI-2006257NI12
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
zfs_6x_ssd_in_2x_raidz1
June 24 2020
  2 Hours, 24 Minutes
zfs_6x_ssd_in_2x_raidz1_ashift=12
June 24 2020
 
6 x 481GB HSCP0480S5xnNMRI
June 24 2020
  2 Hours, 29 Minutes
Invert Hiding All Results Option
  1 Hour, 38 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

zfs_6x_ssd_in_2x_raidz1

Compiler Notes: --build=x86_64-redhat-linux --disable-libmpx --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-gcc-major-version-only --with-isl --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver
Disk Notes: MQ-DEADLINE / attr2,inode64,noquota,relatime,rw,seclabel
Processor Notes: Scaling Governor: intel_pstate performance - CPU Microcode: 0x43
Security Notes: SELinux + itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

zfs_6x_ssd_in_2x_raidz1_ashift=12

6 x 481GB HSCP0480S5xnNMRI

Processor: 2 x Intel Xeon E5-2640 v3 @ 3.40GHz (16 Cores / 32 Threads), Motherboard: Dell 0CNCJW (2.11.0 BIOS), Chipset: Intel Xeon E7 v3/Xeon, Memory: 16 x GB DDR4-2133MT/s HMA42GR7MFR4N-TF, Disk: 6 x 481GB HSCP0480S5xnNMRI + 99GB PERC H730 Mini + 16GB Cruzer Blade + 16GB Cruzer Fit, Graphics: Matrox G200eR2, Monitor: DELL E196FP, Network: 2 x Intel 10-Gigabit X540-AT2 + 2 x Intel I350 + Mellanox MT27500

OS: CentOS Linux 8, Kernel: 4.18.0-193.6.3.el8_2.x86_64 (x86_64), Compiler: GCC 8.3.1 20191121, File-System: xfs, Screen Resolution: 1280x1024

2020-06-24-2159OpenBenchmarking.orgPhoronix Test Suite2 x Intel Xeon E5-2640 v3 @ 3.40GHz (16 Cores / 32 Threads)Dell 0CNCJW (2.11.0 BIOS)Intel Xeon E7 v3/Xeon16 x GB DDR4-2133MT/s HMA42GR7MFR4N-TF6 x 481GB HSCP0480S5xnNMRI + 99GB PERC H730 Mini + 16GB Cruzer Blade + 16GB Cruzer FitMatrox G200eR2DELL E196FP2 x Intel 10-Gigabit X540-AT2 + 2 x Intel I350 + Mellanox MT27500CentOS Linux 84.18.0-193.6.3.el8_2.x86_64 (x86_64)GCC 8.3.1 20191121xfs1280x1024ProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelCompilerFile-SystemScreen Resolution2020-06-24-2159 BenchmarksSystem Logs- --build=x86_64-redhat-linux --disable-libmpx --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-gcc-major-version-only --with-isl --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver - MQ-DEADLINE / attr2,inode64,noquota,relatime,rw,seclabel- Scaling Governor: intel_pstate performance - CPU Microcode: 0x43- SELinux + itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

2020-06-24-2159fio: Rand Read - Sync - No - Yes - 4KB - /mnt/ztest1fio: Rand Read - Sync - No - Yes - 4KB - /mnt/ztest1fio: Rand Read - Sync - No - Yes - 16KB - /mnt/ztest1fio: Rand Read - Sync - No - Yes - 16KB - /mnt/ztest1fio: Rand Read - Sync - No - Yes - 64KB - /mnt/ztest1fio: Rand Read - Sync - No - Yes - 64KB - /mnt/ztest1fio: Rand Write - Sync - No - Yes - 4KB - /mnt/ztest1fio: Rand Write - Sync - No - Yes - 4KB - /mnt/ztest1fio: Rand Write - Sync - No - Yes - 16KB - /mnt/ztest1fio: Rand Write - Sync - No - Yes - 16KB - /mnt/ztest1fio: Rand Write - Sync - No - Yes - 64KB - /mnt/ztest1fio: Rand Write - Sync - No - Yes - 64KB - /mnt/ztest1fio: Seq Read - Sync - No - Yes - 4KB - /mnt/ztest1fio: Seq Read - Sync - No - Yes - 4KB - /mnt/ztest1fio: Rand Read - Linux AIO - No - Yes - 4KB - /mnt/ztest1fio: Rand Read - Linux AIO - No - Yes - 4KB - /mnt/ztest1fio: Seq Read - Sync - No - Yes - 16KB - /mnt/ztest1fio: Seq Read - Sync - No - Yes - 16KB - /mnt/ztest1fio: Seq Read - Sync - No - Yes - 64KB - /mnt/ztest1fio: Seq Read - Sync - No - Yes - 64KB - /mnt/ztest1fio: Seq Write - Sync - No - Yes - 4KB - /mnt/ztest1fio: Seq Write - Sync - No - Yes - 4KB - /mnt/ztest1fio: Rand Read - Linux AIO - No - Yes - 16KB - /mnt/ztest1fio: Rand Read - Linux AIO - No - Yes - 16KB - /mnt/ztest1fio: Rand Read - Linux AIO - No - Yes - 64KB - /mnt/ztest1fio: Rand Read - Linux AIO - No - Yes - 64KB - /mnt/ztest1fio: Rand Write - Linux AIO - No - Yes - 4KB - /mnt/ztest1fio: Rand Write - Linux AIO - No - Yes - 4KB - /mnt/ztest1fio: Seq Write - Sync - No - Yes - 16KB - /mnt/ztest1fio: Seq Write - Sync - No - Yes - 16KB - /mnt/ztest1fio: Seq Write - Sync - No - Yes - 64KB - /mnt/ztest1fio: Seq Write - Sync - No - Yes - 64KB - /mnt/ztest1fio: Rand Write - Linux AIO - No - Yes - 16KB - /mnt/ztest1fio: Rand Write - Linux AIO - No - Yes - 16KB - /mnt/ztest1fio: Rand Write - Linux AIO - No - Yes - 64KB - /mnt/ztest1fio: Rand Write - Linux AIO - No - Yes - 64KB - /mnt/ztest1fio: Seq Read - Linux AIO - No - Yes - 4KB - /mnt/ztest1fio: Seq Read - Linux AIO - No - Yes - 4KB - /mnt/ztest1fio: Seq Read - Linux AIO - No - Yes - 16KB - /mnt/ztest1fio: Seq Read - Linux AIO - No - Yes - 16KB - /mnt/ztest1fio: Seq Read - Linux AIO - No - Yes - 64KB - /mnt/ztest1fio: Seq Read - Linux AIO - No - Yes - 64KB - /mnt/ztest1fio: Seq Write - Linux AIO - No - Yes - 4KB - /mnt/ztest1fio: Seq Write - Linux AIO - No - Yes - 4KB - /mnt/ztest1fio: Seq Write - Linux AIO - No - Yes - 16KB - /mnt/ztest1fio: Seq Write - Linux AIO - No - Yes - 16KB - /mnt/ztest1fio: Seq Write - Linux AIO - No - Yes - 64KB - /mnt/ztest1fio: Seq Write - Linux AIO - No - Yes - 64KB - /mnt/ztest1zfs_6x_ssd_in_2x_raidz1zfs_6x_ssd_in_2x_raidz1_ashift=126 x 481GB HSCP0480S5xnNMRI946242133253516226745537277321154027718456671879300671396357667872223333325420833348227716770017933322881466674092654502125413316251040002106334756624222516112570710862783332753176000438570167615157333142391067181128967928237467240715433342606816723158887776495201865298671416362667860220000324420766748977833370318033322831460004153662562185566715811011502097335677264636416132580011172863332820180667449571900628161000144192233207233167OpenBenchmarking.org

Flexible IO Tester

Fio is an advanced disk benchmark that depends upon the kernel's AIO access library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI2004006008001000SE +/- 11.46, N = 15SE +/- 8.94, N = 159469281. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI170340510680850Min: 897 / Avg: 945.6 / Max: 1023Min: 904 / Avg: 927.8 / Max: 10121. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI50K100K150K200K250KSE +/- 2946.94, N = 15SE +/- 2302.93, N = 152421332374671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI40K80K120K160K200KMin: 230000 / Avg: 242133.33 / Max: 262000Min: 231000 / Avg: 237466.67 / Max: 2590001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI5001000150020002500SE +/- 53.47, N = 15SE +/- 9.68, N = 3253524071. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI400800120016002000Min: 2400 / Avg: 2534.6 / Max: 2954Min: 2388 / Avg: 2407.33 / Max: 24181. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI30K60K90K120K150KSE +/- 3412.12, N = 15SE +/- 666.67, N = 31622671543331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI30K60K90K120K150KMin: 154000 / Avg: 162266.67 / Max: 189000Min: 153000 / Avg: 154333.33 / Max: 1550001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI10002000300040005000SE +/- 121.70, N = 15SE +/- 2.40, N = 3455342601. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI8001600240032004000Min: 4264 / Avg: 4553.33 / Max: 5506Min: 4255 / Avg: 4259.67 / Max: 42631. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI16K32K48K64K80KSE +/- 1917.72, N = 15SE +/- 33.33, N = 372773681671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI13K26K39K52K65KMin: 68200 / Avg: 72773.33 / Max: 88100Min: 68100 / Avg: 68166.67 / Max: 682001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI50100150200250SE +/- 3.16, N = 15SE +/- 3.26, N = 152112311. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI4080120160200Min: 189 / Avg: 211.13 / Max: 230Min: 211 / Avg: 230.53 / Max: 2591. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI13K26K39K52K65KSE +/- 803.41, N = 15SE +/- 840.57, N = 1554027588871. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI10K20K30K40K50KMin: 48400 / Avg: 54026.67 / Max: 58900Min: 54100 / Avg: 58886.67 / Max: 663001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI2004006008001000SE +/- 10.11, N = 3SE +/- 7.20, N = 157187761. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI140280420560700Min: 701 / Avg: 718.33 / Max: 736Min: 746 / Avg: 775.73 / Max: 8471. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI11K22K33K44K55KSE +/- 717.25, N = 3SE +/- 473.11, N = 1545667495201. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI9K18K27K36K45KMin: 44900 / Avg: 45666.67 / Max: 47100Min: 47000 / Avg: 49520 / Max: 542001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI400800120016002000SE +/- 25.71, N = 3SE +/- 32.20, N = 3187918651. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI30060090012001500Min: 1834 / Avg: 1879.33 / Max: 1923Min: 1804 / Avg: 1865.33 / Max: 19131. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI6K12K18K24K30KSE +/- 433.33, N = 3SE +/- 504.42, N = 330067298671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI5K10K15K20K25KMin: 29300 / Avg: 30066.67 / Max: 30800Min: 28900 / Avg: 29866.67 / Max: 306001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI30060090012001500SE +/- 4.18, N = 3SE +/- 2.40, N = 3139614161. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI2004006008001000Min: 1388 / Avg: 1396.33 / Max: 1401Min: 1413 / Avg: 1416.33 / Max: 14211. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI80K160K240K320K400KSE +/- 1333.33, N = 3SE +/- 666.67, N = 33576673626671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI60K120K180K240K300KMin: 355000 / Avg: 357666.67 / Max: 359000Min: 362000 / Avg: 362666.67 / Max: 3640001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI2004006008001000SE +/- 13.38, N = 3SE +/- 2.65, N = 38728601. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI150300450600750Min: 857 / Avg: 872.33 / Max: 899Min: 856 / Avg: 860 / Max: 8651. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI50K100K150K200K250KSE +/- 3382.96, N = 3SE +/- 577.35, N = 32233332200001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI40K80K120K160K200KMin: 219000 / Avg: 223333.33 / Max: 230000Min: 219000 / Avg: 220000 / Max: 2210001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI7001400210028003500SE +/- 3.76, N = 3SE +/- 25.32, N = 3325432441. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI6001200180024003000Min: 3247 / Avg: 3253.67 / Max: 3260Min: 3194 / Avg: 3244 / Max: 32761. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI40K80K120K160K200KSE +/- 333.33, N = 3SE +/- 1855.92, N = 32083332076671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI40K80K120K160K200KMin: 208000 / Avg: 208333.33 / Max: 209000Min: 204000 / Avg: 207666.67 / Max: 2100001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI10002000300040005000SE +/- 4.04, N = 3SE +/- 10.17, N = 3482248971. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI9001800270036004500Min: 4817 / Avg: 4822 / Max: 4830Min: 4877 / Avg: 4896.67 / Max: 49111. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI20K40K60K80K100KSE +/- 66.67, N = 3SE +/- 176.38, N = 377167783331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI14K28K42K56K70KMin: 77100 / Avg: 77166.67 / Max: 77300Min: 78000 / Avg: 78333.33 / Max: 786001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI150300450600750SE +/- 4.26, N = 3SE +/- 5.81, N = 37007031. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI120240360480600Min: 694 / Avg: 699.67 / Max: 708Min: 694 / Avg: 703.33 / Max: 7141. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI40K80K120K160K200KSE +/- 881.92, N = 3SE +/- 1452.97, N = 31793331803331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI30K60K90K120K150KMin: 178000 / Avg: 179333.33 / Max: 181000Min: 178000 / Avg: 180333.33 / Max: 1830001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI5001000150020002500SE +/- 5.17, N = 3SE +/- 1.86, N = 3228822831. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI400800120016002000Min: 2278 / Avg: 2288.33 / Max: 2294Min: 2279 / Avg: 2282.67 / Max: 22851. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI30K60K90K120K150KSE +/- 333.33, N = 31466671460001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI30K60K90K120K150KMin: 146000 / Avg: 146666.67 / Max: 1470001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI9001800270036004500SE +/- 3.53, N = 3SE +/- 37.97, N = 15409241531. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI7001400210028003500Min: 4085 / Avg: 4091.67 / Max: 4097Min: 4033 / Avg: 4152.67 / Max: 45081. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI14K28K42K56K70KSE +/- 28.87, N = 4SE +/- 583.81, N = 1665450662561. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI11K22K33K44K55KMin: 65400 / Avg: 65450 / Max: 65500Min: 64500 / Avg: 66256.25 / Max: 721001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI50100150200250SE +/- 2.40, N = 3SE +/- 5.09, N = 122122181. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI4080120160200Min: 207 / Avg: 211.67 / Max: 215Min: 184 / Avg: 217.67 / Max: 2401. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI12K24K36K48K60KSE +/- 648.93, N = 3SE +/- 1279.40, N = 1254133556671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI10K20K30K40K50KMin: 52900 / Avg: 54133.33 / Max: 55100Min: 47200 / Avg: 55666.67 / Max: 614001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI30060090012001500SE +/- 7.64, N = 3SE +/- 17.99, N = 6162515811. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI30060090012001500Min: 1615 / Avg: 1625 / Max: 1640Min: 1499 / Avg: 1580.67 / Max: 16291. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI20K40K60K80K100KSE +/- 577.35, N = 3SE +/- 1152.89, N = 61040001011501. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI20K40K60K80K100KMin: 103000 / Avg: 104000 / Max: 105000Min: 95900 / Avg: 101150 / Max: 1040001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI5001000150020002500SE +/- 31.54, N = 4SE +/- 10.20, N = 3210620971. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI400800120016002000Min: 2035 / Avg: 2105.75 / Max: 2186Min: 2085 / Avg: 2096.67 / Max: 21171. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI7K14K21K28K35KSE +/- 319.83, N = 4SE +/- 166.67, N = 333475335671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI6K12K18K24K30KMin: 32600 / Avg: 33475 / Max: 34000Min: 33400 / Avg: 33566.67 / Max: 339001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI160320480640800SE +/- 6.87, N = 8SE +/- 12.87, N = 146627261. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI130260390520650Min: 637 / Avg: 661.75 / Max: 699Min: 655 / Avg: 725.79 / Max: 8341. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI10K20K30K40K50KSE +/- 506.30, N = 8SE +/- 825.66, N = 1442225463641. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI8K16K24K32K40KMin: 40000 / Avg: 42225 / Max: 44700Min: 41900 / Avg: 46364.29 / Max: 533001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI30060090012001500SE +/- 20.14, N = 15SE +/- 4.10, N = 3161116131. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI30060090012001500Min: 1490 / Avg: 1610.8 / Max: 1756Min: 1607 / Avg: 1613.33 / Max: 16211. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI6K12K18K24K30KSE +/- 313.88, N = 15SE +/- 57.74, N = 325707258001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI4K8K12K16K20KMin: 23800 / Avg: 25706.67 / Max: 28100Min: 25700 / Avg: 25800 / Max: 259001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI2004006008001000SE +/- 14.90, N = 3SE +/- 2.73, N = 3108611171. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI2004006008001000Min: 1069 / Avg: 1086.33 / Max: 1116Min: 1112 / Avg: 1117.33 / Max: 11211. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI60K120K180K240K300KSE +/- 3844.19, N = 3SE +/- 666.67, N = 32783332863331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI50K100K150K200K250KMin: 274000 / Avg: 278333.33 / Max: 286000Min: 285000 / Avg: 286333.33 / Max: 2870001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI6001200180024003000SE +/- 5.90, N = 3SE +/- 2.40, N = 3275328201. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI5001000150020002500Min: 2741 / Avg: 2752.67 / Max: 2760Min: 2815 / Avg: 2819.67 / Max: 28231. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI40K80K120K160K200KSE +/- 577.35, N = 3SE +/- 333.33, N = 31760001806671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI30K60K90K120K150KMin: 175000 / Avg: 176000 / Max: 177000Min: 180000 / Avg: 180666.67 / Max: 1810001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI10002000300040005000SE +/- 4.37, N = 3SE +/- 9.17, N = 3438544951. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI8001600240032004000Min: 4380 / Avg: 4385.33 / Max: 4394Min: 4483 / Avg: 4495 / Max: 45131. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI15K30K45K60K75KSE +/- 66.67, N = 3SE +/- 152.75, N = 370167719001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI12K24K36K48K60KMin: 70100 / Avg: 70166.67 / Max: 70300Min: 71700 / Avg: 71900 / Max: 722001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI140280420560700SE +/- 6.89, N = 3SE +/- 5.90, N = 36156281. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI110220330440550Min: 602 / Avg: 615.33 / Max: 625Min: 621 / Avg: 628.33 / Max: 6401. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI30K60K90K120K150KSE +/- 1763.83, N = 3SE +/- 1527.53, N = 31573331610001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI30K60K90K120K150KMin: 154000 / Avg: 157333.33 / Max: 160000Min: 159000 / Avg: 161000 / Max: 1640001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI30060090012001500SE +/- 16.33, N = 3SE +/- 19.47, N = 3142314411. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI30060090012001500Min: 1393 / Avg: 1423.33 / Max: 1449Min: 1404 / Avg: 1441 / Max: 14701. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI20K40K60K80K100KSE +/- 1052.51, N = 3SE +/- 1234.68, N = 391067922331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI16K32K48K64K80KMin: 89100 / Avg: 91066.67 / Max: 92700Min: 89900 / Avg: 92233.33 / Max: 941001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI400800120016002000SE +/- 21.62, N = 3SE +/- 33.95, N = 3181120721. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI400800120016002000Min: 1771 / Avg: 1811.33 / Max: 1845Min: 2029 / Avg: 2072 / Max: 21391. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI7K14K21K28K35KSE +/- 352.77, N = 3SE +/- 523.87, N = 328967331671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI6K12K18K24K30KMin: 28300 / Avg: 28966.67 / Max: 29500Min: 32500 / Avg: 33166.67 / Max: 342001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

48 Results Shown

Flexible IO Tester:
  Rand Read - Sync - No - Yes - 4KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Read - Sync - No - Yes - 16KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Read - Sync - No - Yes - 64KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Write - Sync - No - Yes - 4KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Write - Sync - No - Yes - 16KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Write - Sync - No - Yes - 64KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Read - Sync - No - Yes - 4KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Read - Linux AIO - No - Yes - 4KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Read - Sync - No - Yes - 16KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Read - Sync - No - Yes - 64KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Write - Sync - No - Yes - 4KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Read - Linux AIO - No - Yes - 16KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Read - Linux AIO - No - Yes - 64KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - Yes - 4KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Write - Sync - No - Yes - 16KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Write - Sync - No - Yes - 64KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - Yes - 16KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - Yes - 64KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Read - Linux AIO - No - Yes - 4KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Read - Linux AIO - No - Yes - 16KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Read - Linux AIO - No - Yes - 64KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Write - Linux AIO - No - Yes - 4KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Write - Linux AIO - No - Yes - 16KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Write - Linux AIO - No - Yes - 64KB - /mnt/ztest1:
    MB/s
    IOPS

zfs_6x_ssd_in_2x_raidz1

Compiler Notes: --build=x86_64-redhat-linux --disable-libmpx --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-gcc-major-version-only --with-isl --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver
Disk Notes: MQ-DEADLINE / attr2,inode64,noquota,relatime,rw,seclabel
Processor Notes: Scaling Governor: intel_pstate performance - CPU Microcode: 0x43
Security Notes: SELinux + itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 24 June 2020 21:59 by user .

zfs_6x_ssd_in_2x_raidz1_ashift=12

Compiler Notes: --build=x86_64-redhat-linux --disable-libmpx --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-gcc-major-version-only --with-isl --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver
Disk Notes: MQ-DEADLINE / attr2,inode64,noquota,relatime,rw,seclabel
Processor Notes: Scaling Governor: intel_pstate performance - CPU Microcode: 0x43
Security Notes: SELinux + itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 24 June 2020 23:34 by user .

6 x 481GB HSCP0480S5xnNMRI

Processor: 2 x Intel Xeon E5-2640 v3 @ 3.40GHz (16 Cores / 32 Threads), Motherboard: Dell 0CNCJW (2.11.0 BIOS), Chipset: Intel Xeon E7 v3/Xeon, Memory: 16 x GB DDR4-2133MT/s HMA42GR7MFR4N-TF, Disk: 6 x 481GB HSCP0480S5xnNMRI + 99GB PERC H730 Mini + 16GB Cruzer Blade + 16GB Cruzer Fit, Graphics: Matrox G200eR2, Monitor: DELL E196FP, Network: 2 x Intel 10-Gigabit X540-AT2 + 2 x Intel I350 + Mellanox MT27500

OS: CentOS Linux 8, Kernel: 4.18.0-193.6.3.el8_2.x86_64 (x86_64), Compiler: GCC 8.3.1 20191121, File-System: xfs, Screen Resolution: 1280x1024

Compiler Notes: --build=x86_64-redhat-linux --disable-libmpx --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-gcc-major-version-only --with-isl --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver
Disk Notes: MQ-DEADLINE / attr2,inode64,noquota,relatime,rw,seclabel
Processor Notes: Scaling Governor: intel_pstate performance - CPU Microcode: 0x43
Security Notes: SELinux + itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 24 June 2020 23:35 by user .