2020-06-24-2159

no tuning, dedup=on, compression=on, ashift=9

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2006250-NI-2006251NI77
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
zfs_6x_ssd_in_2x_raidz1
June 24 2020
  2 Hours, 24 Minutes
zfs_6x_ssd_in_2x_raidz1_ashift=12
June 24 2020
 
6 x 481GB HSCP0480S5xnNMRI
June 24 2020
  2 Hours, 29 Minutes
zfs_ashift=9_compression=on_dedup=off
June 25 2020
  1 Hour, 57 Minutes
zfs_ashift=9_compression=on_dedup=on
June 25 2020
  1 Hour, 19 Minutes
Invert Hiding All Results Option
  1 Hour, 38 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


2020-06-24-2159OpenBenchmarking.orgPhoronix Test Suite2 x Intel Xeon E5-2640 v3 @ 3.40GHz (16 Cores / 32 Threads)Dell 0CNCJW (2.11.0 BIOS)Intel Xeon E7 v3/Xeon16 x GB DDR4-2133MT/s HMA42GR7MFR4N-TF6 x 481GB HSCP0480S5xnNMRI + 99GB PERC H730 Mini + 16GB Cruzer Blade + 16GB Cruzer FitMatrox G200eR2DELL E196FP2 x Intel 10-Gigabit X540-AT2 + 2 x Intel I350 + Mellanox MT27500CentOS Linux 84.18.0-193.6.3.el8_2.x86_64 (x86_64)GCC 8.3.1 20191121xfs1280x1024ProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelCompilerFile-SystemScreen Resolution2020-06-24-2159 BenchmarksSystem Logs- --build=x86_64-redhat-linux --disable-libmpx --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-gcc-major-version-only --with-isl --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver - MQ-DEADLINE / attr2,inode64,noquota,relatime,rw,seclabel- Scaling Governor: intel_pstate performance - CPU Microcode: 0x43- SELinux + itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

2020-06-24-2159fio: Rand Read - Sync - No - Yes - 4KB - /mnt/ztest1fio: Rand Read - Sync - No - Yes - 4KB - /mnt/ztest1fio: Rand Read - Sync - No - Yes - 16KB - /mnt/ztest1fio: Rand Read - Sync - No - Yes - 16KB - /mnt/ztest1fio: Rand Read - Sync - No - Yes - 64KB - /mnt/ztest1fio: Rand Read - Sync - No - Yes - 64KB - /mnt/ztest1fio: Rand Write - Sync - No - Yes - 4KB - /mnt/ztest1fio: Rand Write - Sync - No - Yes - 4KB - /mnt/ztest1fio: Rand Write - Sync - No - Yes - 16KB - /mnt/ztest1fio: Rand Write - Sync - No - Yes - 16KB - /mnt/ztest1fio: Rand Write - Sync - No - Yes - 64KB - /mnt/ztest1fio: Rand Write - Sync - No - Yes - 64KB - /mnt/ztest1fio: Seq Read - Sync - No - Yes - 4KB - /mnt/ztest1fio: Seq Read - Sync - No - Yes - 4KB - /mnt/ztest1fio: Rand Read - Linux AIO - No - Yes - 4KB - /mnt/ztest1fio: Rand Read - Linux AIO - No - Yes - 4KB - /mnt/ztest1fio: Seq Read - Sync - No - Yes - 16KB - /mnt/ztest1fio: Seq Read - Sync - No - Yes - 16KB - /mnt/ztest1fio: Seq Read - Sync - No - Yes - 64KB - /mnt/ztest1fio: Seq Read - Sync - No - Yes - 64KB - /mnt/ztest1fio: Seq Write - Sync - No - Yes - 4KB - /mnt/ztest1fio: Seq Write - Sync - No - Yes - 4KB - /mnt/ztest1fio: Rand Read - Linux AIO - No - Yes - 16KB - /mnt/ztest1fio: Rand Read - Linux AIO - No - Yes - 16KB - /mnt/ztest1fio: Rand Read - Linux AIO - No - Yes - 64KB - /mnt/ztest1fio: Rand Read - Linux AIO - No - Yes - 64KB - /mnt/ztest1fio: Rand Write - Linux AIO - No - Yes - 4KB - /mnt/ztest1fio: Rand Write - Linux AIO - No - Yes - 4KB - /mnt/ztest1fio: Seq Write - Sync - No - Yes - 16KB - /mnt/ztest1fio: Seq Write - Sync - No - Yes - 16KB - /mnt/ztest1fio: Seq Write - Sync - No - Yes - 64KB - /mnt/ztest1fio: Seq Write - Sync - No - Yes - 64KB - /mnt/ztest1fio: Rand Write - Linux AIO - No - Yes - 16KB - /mnt/ztest1fio: Rand Write - Linux AIO - No - Yes - 16KB - /mnt/ztest1fio: Rand Write - Linux AIO - No - Yes - 64KB - /mnt/ztest1fio: Rand Write - Linux AIO - No - Yes - 64KB - /mnt/ztest1fio: Seq Read - Linux AIO - No - Yes - 4KB - /mnt/ztest1fio: Seq Read - Linux AIO - No - Yes - 4KB - /mnt/ztest1fio: Seq Read - Linux AIO - No - Yes - 16KB - /mnt/ztest1fio: Seq Read - Linux AIO - No - Yes - 16KB - /mnt/ztest1fio: Seq Read - Linux AIO - No - Yes - 64KB - /mnt/ztest1fio: Seq Read - Linux AIO - No - Yes - 64KB - /mnt/ztest1fio: Seq Write - Linux AIO - No - Yes - 4KB - /mnt/ztest1fio: Seq Write - Linux AIO - No - Yes - 4KB - /mnt/ztest1fio: Seq Write - Linux AIO - No - Yes - 16KB - /mnt/ztest1fio: Seq Write - Linux AIO - No - Yes - 16KB - /mnt/ztest1fio: Seq Write - Linux AIO - No - Yes - 64KB - /mnt/ztest1fio: Seq Write - Linux AIO - No - Yes - 64KB - /mnt/ztest1zfs_6x_ssd_in_2x_raidz1zfs_6x_ssd_in_2x_raidz1_ashift=126 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on9462421332535162267455372773211540277184566718793006713963576678722233333254208333482277167700179333228814666740926545021254133162510400021063347566242225161125707108627833327531760004385701676151573331423910671811289679282374672407154333426068167231588877764952018652986714163626678602200003244207667489778333703180333228314600041536625621855667158110115020973356772646364161325800111728633328201806674495719006281610001441922332072331679682476672511160667439470300321823679616153316692670014473710008682223333233207000480976633743190333232114866741176586718146300186211900021763480062039640154424700113128966728211806004454712606141570001441921871961316009662473332547163000450371700344880331037663332009321331435367667886226667329521100049117860075419266723581510004242678832155503318621190002208353007364710016082573311212870002858182667453472533606155333147194133215034367OpenBenchmarking.org

Flexible IO Tester

Fio is an advanced disk benchmark that depends upon the kernel's AIO access library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on2004006008001000SE +/- 11.46, N = 15SE +/- 8.94, N = 15SE +/- 12.78, N = 3SE +/- 6.98, N = 39469289689661. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on2004006008001000Min: 897 / Avg: 945.6 / Max: 1023Min: 904 / Avg: 927.8 / Max: 1012Min: 952 / Avg: 967.67 / Max: 993Min: 957 / Avg: 966.33 / Max: 9801. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on50K100K150K200K250KSE +/- 2946.94, N = 15SE +/- 2302.93, N = 15SE +/- 3179.80, N = 3SE +/- 1855.92, N = 32421332374672476672473331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on40K80K120K160K200KMin: 230000 / Avg: 242133.33 / Max: 262000Min: 231000 / Avg: 237466.67 / Max: 259000Min: 244000 / Avg: 247666.67 / Max: 254000Min: 245000 / Avg: 247333.33 / Max: 2510001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on5001000150020002500SE +/- 53.47, N = 15SE +/- 9.68, N = 3SE +/- 8.33, N = 3SE +/- 8.82, N = 325352407251125471. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on400800120016002000Min: 2400 / Avg: 2534.6 / Max: 2954Min: 2388 / Avg: 2407.33 / Max: 2418Min: 2499 / Avg: 2511 / Max: 2527Min: 2534 / Avg: 2547.33 / Max: 25641. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on30K60K90K120K150KSE +/- 3412.12, N = 15SE +/- 666.67, N = 3SE +/- 666.67, N = 3SE +/- 577.35, N = 31622671543331606671630001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on30K60K90K120K150KMin: 154000 / Avg: 162266.67 / Max: 189000Min: 153000 / Avg: 154333.33 / Max: 155000Min: 160000 / Avg: 160666.67 / Max: 162000Min: 162000 / Avg: 163000 / Max: 1640001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on10002000300040005000SE +/- 121.70, N = 15SE +/- 2.40, N = 3SE +/- 8.67, N = 3SE +/- 2.52, N = 345534260439445031. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on8001600240032004000Min: 4264 / Avg: 4553.33 / Max: 5506Min: 4255 / Avg: 4259.67 / Max: 4263Min: 4379 / Avg: 4394.33 / Max: 4409Min: 4500 / Avg: 4503 / Max: 45081. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on16K32K48K64K80KSE +/- 1917.72, N = 15SE +/- 33.33, N = 3SE +/- 115.47, N = 3SE +/- 351.19, N = 3727736816770300717001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on13K26K39K52K65KMin: 68200 / Avg: 72773.33 / Max: 88100Min: 68100 / Avg: 68166.67 / Max: 68200Min: 70100 / Avg: 70300 / Max: 70500Min: 71000 / Avg: 71700 / Max: 721001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on70140210280350SE +/- 3.16, N = 15SE +/- 3.26, N = 15SE +/- 2.33, N = 32112313213441. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on60120180240300Min: 189 / Avg: 211.13 / Max: 230Min: 211 / Avg: 230.53 / Max: 259Min: 340 / Avg: 343.67 / Max: 3481. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on20K40K60K80K100KSE +/- 803.41, N = 15SE +/- 840.57, N = 15SE +/- 1097.47, N = 3SE +/- 638.57, N = 3540275888782367880331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on15K30K45K60K75KMin: 48400 / Avg: 54026.67 / Max: 58900Min: 54100 / Avg: 58886.67 / Max: 66300Min: 80500 / Avg: 82366.67 / Max: 84300Min: 87000 / Avg: 88033.33 / Max: 892001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on2004006008001000SE +/- 10.11, N = 3SE +/- 7.20, N = 15SE +/- 1.45, N = 3SE +/- 5.13, N = 371877696110371. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on2004006008001000Min: 701 / Avg: 718.33 / Max: 736Min: 746 / Avg: 775.73 / Max: 847Min: 959 / Avg: 961.33 / Max: 964Min: 1027 / Avg: 1037 / Max: 10441. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on14K28K42K56K70KSE +/- 717.25, N = 3SE +/- 473.11, N = 15SE +/- 88.19, N = 3SE +/- 328.30, N = 3456674952061533663331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on11K22K33K44K55KMin: 44900 / Avg: 45666.67 / Max: 47100Min: 47000 / Avg: 49520 / Max: 54200Min: 61400 / Avg: 61533.33 / Max: 61700Min: 65700 / Avg: 66333.33 / Max: 668001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on400800120016002000SE +/- 25.71, N = 3SE +/- 32.20, N = 3SE +/- 20.83, N = 4SE +/- 15.88, N = 318791865166920091. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on400800120016002000Min: 1834 / Avg: 1879.33 / Max: 1923Min: 1804 / Avg: 1865.33 / Max: 1913Min: 1613 / Avg: 1668.5 / Max: 1702Min: 1982 / Avg: 2009.33 / Max: 20371. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on7K14K21K28K35KSE +/- 433.33, N = 3SE +/- 504.42, N = 3SE +/- 331.66, N = 4SE +/- 260.34, N = 3300672986726700321331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on6K12K18K24K30KMin: 29300 / Avg: 30066.67 / Max: 30800Min: 28900 / Avg: 29866.67 / Max: 30600Min: 25800 / Avg: 26700 / Max: 27200Min: 31700 / Avg: 32133.33 / Max: 326001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on30060090012001500SE +/- 4.18, N = 3SE +/- 2.40, N = 3SE +/- 21.61, N = 3SE +/- 7.69, N = 313961416144714351. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on30060090012001500Min: 1388 / Avg: 1396.33 / Max: 1401Min: 1413 / Avg: 1416.33 / Max: 1421Min: 1420 / Avg: 1447.33 / Max: 1490Min: 1424 / Avg: 1435.33 / Max: 14501. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on80K160K240K320K400KSE +/- 1333.33, N = 3SE +/- 666.67, N = 3SE +/- 5567.76, N = 3SE +/- 1763.83, N = 33576673626673710003676671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on60K120K180K240K300KMin: 355000 / Avg: 357666.67 / Max: 359000Min: 362000 / Avg: 362666.67 / Max: 364000Min: 364000 / Avg: 371000 / Max: 382000Min: 365000 / Avg: 367666.67 / Max: 3710001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on2004006008001000SE +/- 13.38, N = 3SE +/- 2.65, N = 3SE +/- 5.84, N = 3SE +/- 4.06, N = 38728608688861. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on160320480640800Min: 857 / Avg: 872.33 / Max: 899Min: 856 / Avg: 860 / Max: 865Min: 856 / Avg: 867.67 / Max: 874Min: 879 / Avg: 885.67 / Max: 8931. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on50K100K150K200K250KSE +/- 3382.96, N = 3SE +/- 577.35, N = 3SE +/- 1666.67, N = 3SE +/- 1201.85, N = 32233332200002223332266671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on40K80K120K160K200KMin: 219000 / Avg: 223333.33 / Max: 230000Min: 219000 / Avg: 220000 / Max: 221000Min: 219000 / Avg: 222333.33 / Max: 224000Min: 225000 / Avg: 226666.67 / Max: 2290001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on7001400210028003500SE +/- 3.76, N = 3SE +/- 25.32, N = 3SE +/- 3.28, N = 3SE +/- 7.22, N = 332543244323332951. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on6001200180024003000Min: 3247 / Avg: 3253.67 / Max: 3260Min: 3194 / Avg: 3244 / Max: 3276Min: 3228 / Avg: 3232.67 / Max: 3239Min: 3282 / Avg: 3294.67 / Max: 33071. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on50K100K150K200K250KSE +/- 333.33, N = 3SE +/- 1855.92, N = 3SE +/- 577.35, N = 32083332076672070002110001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on40K80K120K160K200KMin: 208000 / Avg: 208333.33 / Max: 209000Min: 204000 / Avg: 207666.67 / Max: 210000Min: 210000 / Avg: 211000 / Max: 2120001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on11002200330044005500SE +/- 4.04, N = 3SE +/- 10.17, N = 3SE +/- 4.73, N = 3SE +/- 6.23, N = 348224897480949111. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on9001800270036004500Min: 4817 / Avg: 4822 / Max: 4830Min: 4877 / Avg: 4896.67 / Max: 4911Min: 4800 / Avg: 4809 / Max: 4816Min: 4899 / Avg: 4911.33 / Max: 49191. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on20K40K60K80K100KSE +/- 66.67, N = 3SE +/- 176.38, N = 3SE +/- 328.30, N = 3SE +/- 100.00, N = 3771677833376633786001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on14K28K42K56K70KMin: 77100 / Avg: 77166.67 / Max: 77300Min: 78000 / Avg: 78333.33 / Max: 78600Min: 76000 / Avg: 76633.33 / Max: 77100Min: 78400 / Avg: 78600 / Max: 787001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on160320480640800SE +/- 4.26, N = 3SE +/- 5.81, N = 3SE +/- 7.06, N = 3SE +/- 2.73, N = 37007037437541. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on130260390520650Min: 694 / Avg: 699.67 / Max: 708Min: 694 / Avg: 703.33 / Max: 714Min: 730 / Avg: 743.33 / Max: 754Min: 750 / Avg: 753.67 / Max: 7591. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on40K80K120K160K200KSE +/- 881.92, N = 3SE +/- 1452.97, N = 3SE +/- 1763.83, N = 3SE +/- 666.67, N = 31793331803331903331926671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on30K60K90K120K150KMin: 178000 / Avg: 179333.33 / Max: 181000Min: 178000 / Avg: 180333.33 / Max: 183000Min: 187000 / Avg: 190333.33 / Max: 193000Min: 192000 / Avg: 192666.67 / Max: 1940001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on5001000150020002500SE +/- 5.17, N = 3SE +/- 1.86, N = 3SE +/- 16.37, N = 3SE +/- 9.61, N = 322882283232123581. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on400800120016002000Min: 2278 / Avg: 2288.33 / Max: 2294Min: 2279 / Avg: 2282.67 / Max: 2285Min: 2289 / Avg: 2321.33 / Max: 2342Min: 2339 / Avg: 2358 / Max: 23701. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on30K60K90K120K150KSE +/- 333.33, N = 3SE +/- 881.92, N = 3SE +/- 577.35, N = 31466671460001486671510001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on30K60K90K120K150KMin: 146000 / Avg: 146666.67 / Max: 147000Min: 147000 / Avg: 148666.67 / Max: 150000Min: 150000 / Avg: 151000 / Max: 1520001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on9001800270036004500SE +/- 3.53, N = 3SE +/- 37.97, N = 15SE +/- 28.04, N = 3SE +/- 49.30, N = 640924153411742421. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on7001400210028003500Min: 4085 / Avg: 4091.67 / Max: 4097Min: 4033 / Avg: 4152.67 / Max: 4508Min: 4080 / Avg: 4117 / Max: 4172Min: 4136 / Avg: 4242 / Max: 44791. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on15K30K45K60K75KSE +/- 28.87, N = 4SE +/- 583.81, N = 16SE +/- 425.57, N = 3SE +/- 793.06, N = 6654506625665867678831. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on12K24K36K48K60KMin: 65400 / Avg: 65450 / Max: 65500Min: 64500 / Avg: 66256.25 / Max: 72100Min: 65300 / Avg: 65866.67 / Max: 66700Min: 66200 / Avg: 67883.33 / Max: 717001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on50100150200250SE +/- 2.40, N = 3SE +/- 5.09, N = 12SE +/- 2.48, N = 4SE +/- 0.58, N = 32122181812151. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on4080120160200Min: 207 / Avg: 211.67 / Max: 215Min: 184 / Avg: 217.67 / Max: 240Min: 175 / Avg: 181 / Max: 186Min: 214 / Avg: 215 / Max: 2161. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on12K24K36K48K60KSE +/- 648.93, N = 3SE +/- 1279.40, N = 12SE +/- 678.23, N = 4SE +/- 202.76, N = 3541335566746300550331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on10K20K30K40K50KMin: 52900 / Avg: 54133.33 / Max: 55100Min: 47200 / Avg: 55666.67 / Max: 61400Min: 44700 / Avg: 46300 / Max: 47700Min: 54700 / Avg: 55033.33 / Max: 554001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on400800120016002000SE +/- 7.64, N = 3SE +/- 17.99, N = 6SE +/- 7.23, N = 3SE +/- 16.68, N = 316251581186218621. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on30060090012001500Min: 1615 / Avg: 1625 / Max: 1640Min: 1499 / Avg: 1580.67 / Max: 1629Min: 1849 / Avg: 1862 / Max: 1874Min: 1829 / Avg: 1862.33 / Max: 18801. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on30K60K90K120K150KSE +/- 577.35, N = 3SE +/- 1152.89, N = 6SE +/- 577.35, N = 3SE +/- 1000.00, N = 31040001011501190001190001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on20K40K60K80K100KMin: 103000 / Avg: 104000 / Max: 105000Min: 95900 / Avg: 101150 / Max: 104000Min: 118000 / Avg: 119000 / Max: 120000Min: 117000 / Avg: 119000 / Max: 1200001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on5001000150020002500SE +/- 31.54, N = 4SE +/- 10.20, N = 3SE +/- 30.28, N = 3SE +/- 2.65, N = 321062097217622081. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on400800120016002000Min: 2035 / Avg: 2105.75 / Max: 2186Min: 2085 / Avg: 2096.67 / Max: 2117Min: 2116 / Avg: 2176.33 / Max: 2211Min: 2203 / Avg: 2208 / Max: 22121. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on8K16K24K32K40KSE +/- 319.83, N = 4SE +/- 166.67, N = 3SE +/- 503.32, N = 3SE +/- 57.74, N = 3334753356734800353001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on6K12K18K24K30KMin: 32600 / Avg: 33475 / Max: 34000Min: 33400 / Avg: 33566.67 / Max: 33900Min: 33800 / Avg: 34800 / Max: 35400Min: 35200 / Avg: 35300 / Max: 354001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on160320480640800SE +/- 6.87, N = 8SE +/- 12.87, N = 14SE +/- 5.18, N = 15SE +/- 8.09, N = 36627266207361. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on130260390520650Min: 637 / Avg: 661.75 / Max: 699Min: 655 / Avg: 725.79 / Max: 834Min: 594 / Avg: 619.6 / Max: 660Min: 720 / Avg: 735.67 / Max: 7471. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on10K20K30K40K50KSE +/- 506.30, N = 8SE +/- 825.66, N = 14SE +/- 329.62, N = 15SE +/- 513.16, N = 3422254636439640471001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on8K16K24K32K40KMin: 40000 / Avg: 42225 / Max: 44700Min: 41900 / Avg: 46364.29 / Max: 53300Min: 38000 / Avg: 39640 / Max: 42200Min: 46100 / Avg: 47100 / Max: 478001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on30060090012001500SE +/- 20.14, N = 15SE +/- 4.10, N = 3SE +/- 26.54, N = 316111613154416081. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on30060090012001500Min: 1490 / Avg: 1610.8 / Max: 1756Min: 1607 / Avg: 1613.33 / Max: 1621Min: 1579 / Avg: 1608 / Max: 16611. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on6K12K18K24K30KSE +/- 313.88, N = 15SE +/- 57.74, N = 3SE +/- 433.33, N = 3257072580024700257331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on4K8K12K16K20KMin: 23800 / Avg: 25706.67 / Max: 28100Min: 25700 / Avg: 25800 / Max: 25900Min: 25300 / Avg: 25733.33 / Max: 266001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on2004006008001000SE +/- 14.90, N = 3SE +/- 2.73, N = 3SE +/- 6.35, N = 3SE +/- 3.84, N = 310861117113111211. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on2004006008001000Min: 1069 / Avg: 1086.33 / Max: 1116Min: 1112 / Avg: 1117.33 / Max: 1121Min: 1120 / Avg: 1131 / Max: 1142Min: 1115 / Avg: 1120.67 / Max: 11281. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on60K120K180K240K300KSE +/- 3844.19, N = 3SE +/- 666.67, N = 3SE +/- 1452.97, N = 32783332863332896672870001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on50K100K150K200K250KMin: 274000 / Avg: 278333.33 / Max: 286000Min: 285000 / Avg: 286333.33 / Max: 287000Min: 287000 / Avg: 289666.67 / Max: 2920001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on6001200180024003000SE +/- 5.90, N = 3SE +/- 2.40, N = 3SE +/- 35.95, N = 5SE +/- 26.21, N = 327532820282128581. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on5001000150020002500Min: 2741 / Avg: 2752.67 / Max: 2760Min: 2815 / Avg: 2819.67 / Max: 2823Min: 2778 / Avg: 2820.8 / Max: 2964Min: 2829 / Avg: 2857.67 / Max: 29101. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on40K80K120K160K200KSE +/- 577.35, N = 3SE +/- 333.33, N = 3SE +/- 2357.97, N = 5SE +/- 1666.67, N = 31760001806671806001826671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on30K60K90K120K150KMin: 175000 / Avg: 176000 / Max: 177000Min: 180000 / Avg: 180666.67 / Max: 181000Min: 178000 / Avg: 180600 / Max: 190000Min: 181000 / Avg: 182666.67 / Max: 1860001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on10002000300040005000SE +/- 4.37, N = 3SE +/- 9.17, N = 3SE +/- 37.20, N = 15SE +/- 6.12, N = 343854495445445341. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on8001600240032004000Min: 4380 / Avg: 4385.33 / Max: 4394Min: 4483 / Avg: 4495 / Max: 4513Min: 4305 / Avg: 4453.87 / Max: 4804Min: 4524 / Avg: 4533.67 / Max: 45451. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on16K32K48K64K80KSE +/- 66.67, N = 3SE +/- 152.75, N = 3SE +/- 594.56, N = 15SE +/- 88.19, N = 3701677190071260725331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on13K26K39K52K65KMin: 70100 / Avg: 70166.67 / Max: 70300Min: 71700 / Avg: 71900 / Max: 72200Min: 68900 / Avg: 71260 / Max: 76900Min: 72400 / Avg: 72533.33 / Max: 727001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on140280420560700SE +/- 6.89, N = 3SE +/- 5.90, N = 3SE +/- 1.00, N = 3SE +/- 2.89, N = 36156286146061. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on110220330440550Min: 602 / Avg: 615.33 / Max: 625Min: 621 / Avg: 628.33 / Max: 640Min: 612 / Avg: 614 / Max: 615Min: 601 / Avg: 606 / Max: 6111. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on30K60K90K120K150KSE +/- 1763.83, N = 3SE +/- 1527.53, N = 3SE +/- 881.92, N = 31573331610001570001553331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on30K60K90K120K150KMin: 154000 / Avg: 157333.33 / Max: 160000Min: 159000 / Avg: 161000 / Max: 164000Min: 154000 / Avg: 155333.33 / Max: 1570001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on30060090012001500SE +/- 16.33, N = 3SE +/- 19.47, N = 3SE +/- 12.05, N = 15SE +/- 8.54, N = 314231441144114711. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on30060090012001500Min: 1393 / Avg: 1423.33 / Max: 1449Min: 1404 / Avg: 1441 / Max: 1470Min: 1399 / Avg: 1440.53 / Max: 1510Min: 1454 / Avg: 1471 / Max: 14811. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on20K40K60K80K100KSE +/- 1052.51, N = 3SE +/- 1234.68, N = 3SE +/- 772.68, N = 15SE +/- 569.60, N = 3910679223392187941331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on16K32K48K64K80KMin: 89100 / Avg: 91066.67 / Max: 92700Min: 89900 / Avg: 92233.33 / Max: 94100Min: 89500 / Avg: 92186.67 / Max: 96600Min: 93000 / Avg: 94133.33 / Max: 948001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on5001000150020002500SE +/- 21.62, N = 3SE +/- 33.95, N = 3SE +/- 30.83, N = 3SE +/- 5.51, N = 318112072196121501. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on400800120016002000Min: 1771 / Avg: 1811.33 / Max: 1845Min: 2029 / Avg: 2072 / Max: 2139Min: 1916 / Avg: 1961 / Max: 2020Min: 2140 / Avg: 2150 / Max: 21591. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on7K14K21K28K35KSE +/- 352.77, N = 3SE +/- 523.87, N = 3SE +/- 422.30, N = 4SE +/- 88.19, N = 3289673316731600343671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on6K12K18K24K30KMin: 28300 / Avg: 28966.67 / Max: 29500Min: 32500 / Avg: 33166.67 / Max: 34200Min: 30600 / Avg: 31600 / Max: 32300Min: 34200 / Avg: 34366.67 / Max: 345001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

48 Results Shown

Flexible IO Tester:
  Rand Read - Sync - No - Yes - 4KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Read - Sync - No - Yes - 16KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Read - Sync - No - Yes - 64KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Write - Sync - No - Yes - 4KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Write - Sync - No - Yes - 16KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Write - Sync - No - Yes - 64KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Read - Sync - No - Yes - 4KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Read - Linux AIO - No - Yes - 4KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Read - Sync - No - Yes - 16KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Read - Sync - No - Yes - 64KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Write - Sync - No - Yes - 4KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Read - Linux AIO - No - Yes - 16KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Read - Linux AIO - No - Yes - 64KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - Yes - 4KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Write - Sync - No - Yes - 16KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Write - Sync - No - Yes - 64KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - Yes - 16KB - /mnt/ztest1:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - Yes - 64KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Read - Linux AIO - No - Yes - 4KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Read - Linux AIO - No - Yes - 16KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Read - Linux AIO - No - Yes - 64KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Write - Linux AIO - No - Yes - 4KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Write - Linux AIO - No - Yes - 16KB - /mnt/ztest1:
    MB/s
    IOPS
  Seq Write - Linux AIO - No - Yes - 64KB - /mnt/ztest1:
    MB/s
    IOPS