2020-06-24-2159

no tuning, dedup=on, compression=on, ashift=9

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2006250-NI-2006251NI77
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
zfs_6x_ssd_in_2x_raidz1
June 24 2020
  2 Hours, 24 Minutes
zfs_6x_ssd_in_2x_raidz1_ashift=12
June 24 2020
 
6 x 481GB HSCP0480S5xnNMRI
June 24 2020
  2 Hours, 29 Minutes
zfs_ashift=9_compression=on_dedup=off
June 25 2020
  1 Hour, 57 Minutes
zfs_ashift=9_compression=on_dedup=on
June 25 2020
  1 Hour, 19 Minutes
Invert Hiding All Results Option
  1 Hour, 38 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


2020-06-24-2159OpenBenchmarking.orgPhoronix Test Suite2 x Intel Xeon E5-2640 v3 @ 3.40GHz (16 Cores / 32 Threads)Dell 0CNCJW (2.11.0 BIOS)Intel Xeon E7 v3/Xeon16 x GB DDR4-2133MT/s HMA42GR7MFR4N-TF6 x 481GB HSCP0480S5xnNMRI + 99GB PERC H730 Mini + 16GB Cruzer Blade + 16GB Cruzer FitMatrox G200eR2DELL E196FP2 x Intel 10-Gigabit X540-AT2 + 2 x Intel I350 + Mellanox MT27500CentOS Linux 84.18.0-193.6.3.el8_2.x86_64 (x86_64)GCC 8.3.1 20191121xfs1280x1024ProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelCompilerFile-SystemScreen Resolution2020-06-24-2159 BenchmarksSystem Logs- --build=x86_64-redhat-linux --disable-libmpx --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-gcc-major-version-only --with-isl --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver - MQ-DEADLINE / attr2,inode64,noquota,relatime,rw,seclabel- Scaling Governor: intel_pstate performance - CPU Microcode: 0x43- SELinux + itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

2020-06-24-2159fio: Rand Read - Sync - No - Yes - 4KB - /mnt/ztest1fio: Rand Read - Sync - No - Yes - 16KB - /mnt/ztest1fio: Rand Read - Sync - No - Yes - 64KB - /mnt/ztest1fio: Rand Write - Sync - No - Yes - 4KB - /mnt/ztest1fio: Rand Write - Sync - No - Yes - 16KB - /mnt/ztest1fio: Rand Write - Sync - No - Yes - 64KB - /mnt/ztest1fio: Seq Read - Sync - No - Yes - 4KB - /mnt/ztest1fio: Rand Read - Linux AIO - No - Yes - 4KB - /mnt/ztest1fio: Seq Read - Sync - No - Yes - 16KB - /mnt/ztest1fio: Seq Read - Sync - No - Yes - 64KB - /mnt/ztest1fio: Seq Write - Sync - No - Yes - 4KB - /mnt/ztest1fio: Rand Read - Linux AIO - No - Yes - 16KB - /mnt/ztest1fio: Rand Read - Linux AIO - No - Yes - 64KB - /mnt/ztest1fio: Rand Write - Linux AIO - No - Yes - 4KB - /mnt/ztest1fio: Seq Write - Sync - No - Yes - 16KB - /mnt/ztest1fio: Seq Write - Sync - No - Yes - 64KB - /mnt/ztest1fio: Rand Write - Linux AIO - No - Yes - 16KB - /mnt/ztest1fio: Rand Write - Linux AIO - No - Yes - 64KB - /mnt/ztest1fio: Seq Read - Linux AIO - No - Yes - 4KB - /mnt/ztest1fio: Seq Read - Linux AIO - No - Yes - 16KB - /mnt/ztest1fio: Seq Read - Linux AIO - No - Yes - 64KB - /mnt/ztest1fio: Seq Write - Linux AIO - No - Yes - 4KB - /mnt/ztest1fio: Seq Write - Linux AIO - No - Yes - 16KB - /mnt/ztest1fio: Seq Write - Linux AIO - No - Yes - 64KB - /mnt/ztest1fio: Rand Read - Sync - No - Yes - 4KB - /mnt/ztest1fio: Rand Read - Sync - No - Yes - 16KB - /mnt/ztest1fio: Rand Read - Sync - No - Yes - 64KB - /mnt/ztest1fio: Rand Write - Sync - No - Yes - 4KB - /mnt/ztest1fio: Rand Write - Sync - No - Yes - 16KB - /mnt/ztest1fio: Rand Write - Sync - No - Yes - 64KB - /mnt/ztest1fio: Seq Read - Sync - No - Yes - 4KB - /mnt/ztest1fio: Rand Read - Linux AIO - No - Yes - 4KB - /mnt/ztest1fio: Seq Read - Sync - No - Yes - 16KB - /mnt/ztest1fio: Seq Read - Sync - No - Yes - 64KB - /mnt/ztest1fio: Seq Write - Sync - No - Yes - 4KB - /mnt/ztest1fio: Rand Read - Linux AIO - No - Yes - 16KB - /mnt/ztest1fio: Rand Read - Linux AIO - No - Yes - 64KB - /mnt/ztest1fio: Rand Write - Linux AIO - No - Yes - 4KB - /mnt/ztest1fio: Seq Write - Sync - No - Yes - 16KB - /mnt/ztest1fio: Seq Write - Sync - No - Yes - 64KB - /mnt/ztest1fio: Rand Write - Linux AIO - No - Yes - 16KB - /mnt/ztest1fio: Rand Write - Linux AIO - No - Yes - 64KB - /mnt/ztest1fio: Seq Read - Linux AIO - No - Yes - 4KB - /mnt/ztest1fio: Seq Read - Linux AIO - No - Yes - 16KB - /mnt/ztest1fio: Seq Read - Linux AIO - No - Yes - 64KB - /mnt/ztest1fio: Seq Write - Linux AIO - No - Yes - 4KB - /mnt/ztest1fio: Seq Write - Linux AIO - No - Yes - 16KB - /mnt/ztest1fio: Seq Write - Linux AIO - No - Yes - 64KB - /mnt/ztest1zfs_6x_ssd_in_2x_raidz1zfs_6x_ssd_in_2x_raidz1_ashift=126 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on2421331622677277354027456673006735766722333320833377167179333146667654505413310400033475422252570727833317600070167157333910672896794625354553211718187913968723254482270022884092212162521066621611108627534385615142318112374671543336816758887495202986736266722000020766778333180333146000662565566710115033567463642580028633318066771900161000922333316792824074260231776186514168603244489770322834153218158120977261613111728204495628144120722476671606677030082367615332670037100022233320700076633190333148667658674630011900034800396402470028966718060071260157000921873160096825114394321961166914478683233480974323214117181186221766201544113128214454614144119612473331630007170088033663333213336766722666721100078600192667151000678835503311900035300471002573328700018266772533155333941333436796625474503344103720091435886329549117542358424221518622208736160811212858453460614712150OpenBenchmarking.org

Flexible IO Tester

Fio is an advanced disk benchmark that depends upon the kernel's AIO access library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=onzfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI50K100K150K200K250KSE +/- 3179.80, N = 3SE +/- 1855.92, N = 3SE +/- 2946.94, N = 15SE +/- 2302.93, N = 152476672473332421332374671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=onzfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI40K80K120K160K200KMin: 244000 / Avg: 247666.67 / Max: 254000Min: 245000 / Avg: 247333.33 / Max: 251000Min: 230000 / Avg: 242133.33 / Max: 262000Min: 231000 / Avg: 237466.67 / Max: 2590001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_6x_ssd_in_2x_raidz1zfs_ashift=9_compression=on_dedup=off6 x 481GB HSCP0480S5xnNMRI30K60K90K120K150KSE +/- 577.35, N = 3SE +/- 3412.12, N = 15SE +/- 666.67, N = 3SE +/- 666.67, N = 31630001622671606671543331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_6x_ssd_in_2x_raidz1zfs_ashift=9_compression=on_dedup=off6 x 481GB HSCP0480S5xnNMRI30K60K90K120K150KMin: 162000 / Avg: 163000 / Max: 164000Min: 154000 / Avg: 162266.67 / Max: 189000Min: 160000 / Avg: 160666.67 / Max: 162000Min: 153000 / Avg: 154333.33 / Max: 1550001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=off6 x 481GB HSCP0480S5xnNMRI16K32K48K64K80KSE +/- 1917.72, N = 15SE +/- 351.19, N = 3SE +/- 115.47, N = 3SE +/- 33.33, N = 3727737170070300681671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=off6 x 481GB HSCP0480S5xnNMRI13K26K39K52K65KMin: 68200 / Avg: 72773.33 / Max: 88100Min: 71000 / Avg: 71700 / Max: 72100Min: 70100 / Avg: 70300 / Max: 70500Min: 68100 / Avg: 68166.67 / Max: 682001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=off6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz120K40K60K80K100KSE +/- 638.57, N = 3SE +/- 1097.47, N = 3SE +/- 840.57, N = 15SE +/- 803.41, N = 15880338236758887540271. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=off6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz115K30K45K60K75KMin: 87000 / Avg: 88033.33 / Max: 89200Min: 80500 / Avg: 82366.67 / Max: 84300Min: 54100 / Avg: 58886.67 / Max: 66300Min: 48400 / Avg: 54026.67 / Max: 589001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=off6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz114K28K42K56K70KSE +/- 328.30, N = 3SE +/- 88.19, N = 3SE +/- 473.11, N = 15SE +/- 717.25, N = 3663336153349520456671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=off6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz111K22K33K44K55KMin: 65700 / Avg: 66333.33 / Max: 66800Min: 61400 / Avg: 61533.33 / Max: 61700Min: 47000 / Avg: 49520 / Max: 54200Min: 44900 / Avg: 45666.67 / Max: 471001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=off7K14K21K28K35KSE +/- 260.34, N = 3SE +/- 433.33, N = 3SE +/- 504.42, N = 3SE +/- 331.66, N = 4321333006729867267001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=off6K12K18K24K30KMin: 31700 / Avg: 32133.33 / Max: 32600Min: 29300 / Avg: 30066.67 / Max: 30800Min: 28900 / Avg: 29866.67 / Max: 30600Min: 25800 / Avg: 26700 / Max: 272001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz180K160K240K320K400KSE +/- 5567.76, N = 3SE +/- 1763.83, N = 3SE +/- 666.67, N = 3SE +/- 1333.33, N = 33710003676673626673576671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz160K120K180K240K300KMin: 364000 / Avg: 371000 / Max: 382000Min: 365000 / Avg: 367666.67 / Max: 371000Min: 362000 / Avg: 362666.67 / Max: 364000Min: 355000 / Avg: 357666.67 / Max: 3590001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_6x_ssd_in_2x_raidz1zfs_ashift=9_compression=on_dedup=off6 x 481GB HSCP0480S5xnNMRI50K100K150K200K250KSE +/- 1201.85, N = 3SE +/- 3382.96, N = 3SE +/- 1666.67, N = 3SE +/- 577.35, N = 32266672233332223332200001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_6x_ssd_in_2x_raidz1zfs_ashift=9_compression=on_dedup=off6 x 481GB HSCP0480S5xnNMRI40K80K120K160K200KMin: 225000 / Avg: 226666.67 / Max: 229000Min: 219000 / Avg: 223333.33 / Max: 230000Min: 219000 / Avg: 222333.33 / Max: 224000Min: 219000 / Avg: 220000 / Max: 2210001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=off50K100K150K200K250KSE +/- 577.35, N = 3SE +/- 333.33, N = 3SE +/- 1855.92, N = 32110002083332076672070001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=off40K80K120K160K200KMin: 210000 / Avg: 211000 / Max: 212000Min: 208000 / Avg: 208333.33 / Max: 209000Min: 204000 / Avg: 207666.67 / Max: 2100001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=on6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz1zfs_ashift=9_compression=on_dedup=off20K40K60K80K100KSE +/- 100.00, N = 3SE +/- 176.38, N = 3SE +/- 66.67, N = 3SE +/- 328.30, N = 3786007833377167766331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=on6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz1zfs_ashift=9_compression=on_dedup=off14K28K42K56K70KMin: 78400 / Avg: 78600 / Max: 78700Min: 78000 / Avg: 78333.33 / Max: 78600Min: 77100 / Avg: 77166.67 / Max: 77300Min: 76000 / Avg: 76633.33 / Max: 771001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=off6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz140K80K120K160K200KSE +/- 666.67, N = 3SE +/- 1763.83, N = 3SE +/- 1452.97, N = 3SE +/- 881.92, N = 31926671903331803331793331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=off6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz130K60K90K120K150KMin: 192000 / Avg: 192666.67 / Max: 194000Min: 187000 / Avg: 190333.33 / Max: 193000Min: 178000 / Avg: 180333.33 / Max: 183000Min: 178000 / Avg: 179333.33 / Max: 1810001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=offzfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI30K60K90K120K150KSE +/- 577.35, N = 3SE +/- 881.92, N = 3SE +/- 333.33, N = 31510001486671466671460001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=offzfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI30K60K90K120K150KMin: 150000 / Avg: 151000 / Max: 152000Min: 147000 / Avg: 148666.67 / Max: 150000Min: 146000 / Avg: 146666.67 / Max: 1470001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=on6 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_6x_ssd_in_2x_raidz115K30K45K60K75KSE +/- 793.06, N = 6SE +/- 583.81, N = 16SE +/- 425.57, N = 3SE +/- 28.87, N = 4678836625665867654501. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=on6 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_6x_ssd_in_2x_raidz112K24K36K48K60KMin: 66200 / Avg: 67883.33 / Max: 71700Min: 64500 / Avg: 66256.25 / Max: 72100Min: 65300 / Avg: 65866.67 / Max: 66700Min: 65400 / Avg: 65450 / Max: 655001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=onzfs_6x_ssd_in_2x_raidz1zfs_ashift=9_compression=on_dedup=off12K24K36K48K60KSE +/- 1279.40, N = 12SE +/- 202.76, N = 3SE +/- 648.93, N = 3SE +/- 678.23, N = 4556675503354133463001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=onzfs_6x_ssd_in_2x_raidz1zfs_ashift=9_compression=on_dedup=off10K20K30K40K50KMin: 47200 / Avg: 55666.67 / Max: 61400Min: 54700 / Avg: 55033.33 / Max: 55400Min: 52900 / Avg: 54133.33 / Max: 55100Min: 44700 / Avg: 46300 / Max: 477001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=offzfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI30K60K90K120K150KSE +/- 1000.00, N = 3SE +/- 577.35, N = 3SE +/- 577.35, N = 3SE +/- 1152.89, N = 61190001190001040001011501. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=offzfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI20K40K60K80K100KMin: 117000 / Avg: 119000 / Max: 120000Min: 118000 / Avg: 119000 / Max: 120000Min: 103000 / Avg: 104000 / Max: 105000Min: 95900 / Avg: 101150 / Max: 1040001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=off6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz18K16K24K32K40KSE +/- 57.74, N = 3SE +/- 503.32, N = 3SE +/- 166.67, N = 3SE +/- 319.83, N = 4353003480033567334751. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=off6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz16K12K18K24K30KMin: 35200 / Avg: 35300 / Max: 35400Min: 33800 / Avg: 34800 / Max: 35400Min: 33400 / Avg: 33566.67 / Max: 33900Min: 32600 / Avg: 33475 / Max: 340001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=on6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz1zfs_ashift=9_compression=on_dedup=off10K20K30K40K50KSE +/- 513.16, N = 3SE +/- 825.66, N = 14SE +/- 506.30, N = 8SE +/- 329.62, N = 15471004636442225396401. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=on6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz1zfs_ashift=9_compression=on_dedup=off8K16K24K32K40KMin: 46100 / Avg: 47100 / Max: 47800Min: 41900 / Avg: 46364.29 / Max: 53300Min: 40000 / Avg: 42225 / Max: 44700Min: 38000 / Avg: 39640 / Max: 422001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=onzfs_6x_ssd_in_2x_raidz1zfs_ashift=9_compression=on_dedup=off6K12K18K24K30KSE +/- 57.74, N = 3SE +/- 433.33, N = 3SE +/- 313.88, N = 15258002573325707247001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=onzfs_6x_ssd_in_2x_raidz1zfs_ashift=9_compression=on_dedup=off4K8K12K16K20KMin: 25700 / Avg: 25800 / Max: 25900Min: 25300 / Avg: 25733.33 / Max: 26600Min: 23800 / Avg: 25706.67 / Max: 281001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz160K120K180K240K300KSE +/- 1452.97, N = 3SE +/- 666.67, N = 3SE +/- 3844.19, N = 32896672870002863332783331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz150K100K150K200K250KMin: 287000 / Avg: 289666.67 / Max: 292000Min: 285000 / Avg: 286333.33 / Max: 287000Min: 274000 / Avg: 278333.33 / Max: 2860001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=on6 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_6x_ssd_in_2x_raidz140K80K120K160K200KSE +/- 1666.67, N = 3SE +/- 333.33, N = 3SE +/- 2357.97, N = 5SE +/- 577.35, N = 31826671806671806001760001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=on6 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_6x_ssd_in_2x_raidz130K60K90K120K150KMin: 181000 / Avg: 182666.67 / Max: 186000Min: 180000 / Avg: 180666.67 / Max: 181000Min: 178000 / Avg: 180600 / Max: 190000Min: 175000 / Avg: 176000 / Max: 1770001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=on6 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_6x_ssd_in_2x_raidz116K32K48K64K80KSE +/- 88.19, N = 3SE +/- 152.75, N = 3SE +/- 594.56, N = 15SE +/- 66.67, N = 3725337190071260701671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=on6 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_6x_ssd_in_2x_raidz113K26K39K52K65KMin: 72400 / Avg: 72533.33 / Max: 72700Min: 71700 / Avg: 71900 / Max: 72200Min: 68900 / Avg: 71260 / Max: 76900Min: 70100 / Avg: 70166.67 / Max: 703001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest16 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz1zfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on30K60K90K120K150KSE +/- 1527.53, N = 3SE +/- 1763.83, N = 3SE +/- 881.92, N = 31610001573331570001553331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest16 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz1zfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on30K60K90K120K150KMin: 159000 / Avg: 161000 / Max: 164000Min: 154000 / Avg: 157333.33 / Max: 160000Min: 154000 / Avg: 155333.33 / Max: 1570001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=on6 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_6x_ssd_in_2x_raidz120K40K60K80K100KSE +/- 569.60, N = 3SE +/- 1234.68, N = 3SE +/- 772.68, N = 15SE +/- 1052.51, N = 3941339223392187910671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=on6 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_6x_ssd_in_2x_raidz116K32K48K64K80KMin: 93000 / Avg: 94133.33 / Max: 94800Min: 89900 / Avg: 92233.33 / Max: 94100Min: 89500 / Avg: 92186.67 / Max: 96600Min: 89100 / Avg: 91066.67 / Max: 927001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=on6 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_6x_ssd_in_2x_raidz17K14K21K28K35KSE +/- 88.19, N = 3SE +/- 523.87, N = 3SE +/- 422.30, N = 4SE +/- 352.77, N = 3343673316731600289671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=on6 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_6x_ssd_in_2x_raidz16K12K18K24K30KMin: 34200 / Avg: 34366.67 / Max: 34500Min: 32500 / Avg: 33166.67 / Max: 34200Min: 30600 / Avg: 31600 / Max: 32300Min: 28300 / Avg: 28966.67 / Max: 295001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=onzfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI2004006008001000SE +/- 12.78, N = 3SE +/- 6.98, N = 3SE +/- 11.46, N = 15SE +/- 8.94, N = 159689669469281. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=onzfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI2004006008001000Min: 952 / Avg: 967.67 / Max: 993Min: 957 / Avg: 966.33 / Max: 980Min: 897 / Avg: 945.6 / Max: 1023Min: 904 / Avg: 927.8 / Max: 10121. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_6x_ssd_in_2x_raidz1zfs_ashift=9_compression=on_dedup=off6 x 481GB HSCP0480S5xnNMRI5001000150020002500SE +/- 8.82, N = 3SE +/- 53.47, N = 15SE +/- 8.33, N = 3SE +/- 9.68, N = 325472535251124071. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_6x_ssd_in_2x_raidz1zfs_ashift=9_compression=on_dedup=off6 x 481GB HSCP0480S5xnNMRI400800120016002000Min: 2534 / Avg: 2547.33 / Max: 2564Min: 2400 / Avg: 2534.6 / Max: 2954Min: 2499 / Avg: 2511 / Max: 2527Min: 2388 / Avg: 2407.33 / Max: 24181. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=off6 x 481GB HSCP0480S5xnNMRI10002000300040005000SE +/- 121.70, N = 15SE +/- 2.52, N = 3SE +/- 8.67, N = 3SE +/- 2.40, N = 345534503439442601. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_6x_ssd_in_2x_raidz1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=off6 x 481GB HSCP0480S5xnNMRI8001600240032004000Min: 4264 / Avg: 4553.33 / Max: 5506Min: 4500 / Avg: 4503 / Max: 4508Min: 4379 / Avg: 4394.33 / Max: 4409Min: 4255 / Avg: 4259.67 / Max: 42631. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=off6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz170140210280350SE +/- 2.33, N = 3SE +/- 3.26, N = 15SE +/- 3.16, N = 153443212312111. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=off6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz160120180240300Min: 340 / Avg: 343.67 / Max: 348Min: 211 / Avg: 230.53 / Max: 259Min: 189 / Avg: 211.13 / Max: 2301. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=off6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz12004006008001000SE +/- 5.13, N = 3SE +/- 1.45, N = 3SE +/- 7.20, N = 15SE +/- 10.11, N = 310379617767181. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=off6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz12004006008001000Min: 1027 / Avg: 1037 / Max: 1044Min: 959 / Avg: 961.33 / Max: 964Min: 746 / Avg: 775.73 / Max: 847Min: 701 / Avg: 718.33 / Max: 7361. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=off400800120016002000SE +/- 15.88, N = 3SE +/- 25.71, N = 3SE +/- 32.20, N = 3SE +/- 20.83, N = 420091879186516691. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=off400800120016002000Min: 1982 / Avg: 2009.33 / Max: 2037Min: 1834 / Avg: 1879.33 / Max: 1923Min: 1804 / Avg: 1865.33 / Max: 1913Min: 1613 / Avg: 1668.5 / Max: 17021. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz130060090012001500SE +/- 21.61, N = 3SE +/- 7.69, N = 3SE +/- 2.40, N = 3SE +/- 4.18, N = 314471435141613961. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz130060090012001500Min: 1420 / Avg: 1447.33 / Max: 1490Min: 1424 / Avg: 1435.33 / Max: 1450Min: 1413 / Avg: 1416.33 / Max: 1421Min: 1388 / Avg: 1396.33 / Max: 14011. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_6x_ssd_in_2x_raidz1zfs_ashift=9_compression=on_dedup=off6 x 481GB HSCP0480S5xnNMRI2004006008001000SE +/- 4.06, N = 3SE +/- 13.38, N = 3SE +/- 5.84, N = 3SE +/- 2.65, N = 38868728688601. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_6x_ssd_in_2x_raidz1zfs_ashift=9_compression=on_dedup=off6 x 481GB HSCP0480S5xnNMRI160320480640800Min: 879 / Avg: 885.67 / Max: 893Min: 857 / Avg: 872.33 / Max: 899Min: 856 / Avg: 867.67 / Max: 874Min: 856 / Avg: 860 / Max: 8651. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=off7001400210028003500SE +/- 7.22, N = 3SE +/- 3.76, N = 3SE +/- 25.32, N = 3SE +/- 3.28, N = 332953254324432331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=off6001200180024003000Min: 3282 / Avg: 3294.67 / Max: 3307Min: 3247 / Avg: 3253.67 / Max: 3260Min: 3194 / Avg: 3244 / Max: 3276Min: 3228 / Avg: 3232.67 / Max: 32391. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=on6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz1zfs_ashift=9_compression=on_dedup=off11002200330044005500SE +/- 6.23, N = 3SE +/- 10.17, N = 3SE +/- 4.04, N = 3SE +/- 4.73, N = 349114897482248091. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=on6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz1zfs_ashift=9_compression=on_dedup=off9001800270036004500Min: 4899 / Avg: 4911.33 / Max: 4919Min: 4877 / Avg: 4896.67 / Max: 4911Min: 4817 / Avg: 4822 / Max: 4830Min: 4800 / Avg: 4809 / Max: 48161. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=off6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz1160320480640800SE +/- 2.73, N = 3SE +/- 7.06, N = 3SE +/- 5.81, N = 3SE +/- 4.26, N = 37547437037001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=off6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz1130260390520650Min: 750 / Avg: 753.67 / Max: 759Min: 730 / Avg: 743.33 / Max: 754Min: 694 / Avg: 703.33 / Max: 714Min: 694 / Avg: 699.67 / Max: 7081. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=offzfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI5001000150020002500SE +/- 9.61, N = 3SE +/- 16.37, N = 3SE +/- 5.17, N = 3SE +/- 1.86, N = 323582321228822831. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=offzfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI400800120016002000Min: 2339 / Avg: 2358 / Max: 2370Min: 2289 / Avg: 2321.33 / Max: 2342Min: 2278 / Avg: 2288.33 / Max: 2294Min: 2279 / Avg: 2282.67 / Max: 22851. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=on6 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_6x_ssd_in_2x_raidz19001800270036004500SE +/- 49.30, N = 6SE +/- 37.97, N = 15SE +/- 28.04, N = 3SE +/- 3.53, N = 342424153411740921. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=on6 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_6x_ssd_in_2x_raidz17001400210028003500Min: 4136 / Avg: 4242 / Max: 4479Min: 4033 / Avg: 4152.67 / Max: 4508Min: 4080 / Avg: 4117 / Max: 4172Min: 4085 / Avg: 4091.67 / Max: 40971. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=onzfs_6x_ssd_in_2x_raidz1zfs_ashift=9_compression=on_dedup=off50100150200250SE +/- 5.09, N = 12SE +/- 0.58, N = 3SE +/- 2.40, N = 3SE +/- 2.48, N = 42182152121811. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest16 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=onzfs_6x_ssd_in_2x_raidz1zfs_ashift=9_compression=on_dedup=off4080120160200Min: 184 / Avg: 217.67 / Max: 240Min: 214 / Avg: 215 / Max: 216Min: 207 / Avg: 211.67 / Max: 215Min: 175 / Avg: 181 / Max: 1861. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=offzfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI400800120016002000SE +/- 16.68, N = 3SE +/- 7.23, N = 3SE +/- 7.64, N = 3SE +/- 17.99, N = 618621862162515811. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=offzfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI30060090012001500Min: 1829 / Avg: 1862.33 / Max: 1880Min: 1849 / Avg: 1862 / Max: 1874Min: 1615 / Avg: 1625 / Max: 1640Min: 1499 / Avg: 1580.67 / Max: 16291. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=offzfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI5001000150020002500SE +/- 2.65, N = 3SE +/- 30.28, N = 3SE +/- 31.54, N = 4SE +/- 10.20, N = 322082176210620971. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=offzfs_6x_ssd_in_2x_raidz16 x 481GB HSCP0480S5xnNMRI400800120016002000Min: 2203 / Avg: 2208 / Max: 2212Min: 2116 / Avg: 2176.33 / Max: 2211Min: 2035 / Avg: 2105.75 / Max: 2186Min: 2085 / Avg: 2096.67 / Max: 21171. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=on6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz1zfs_ashift=9_compression=on_dedup=off160320480640800SE +/- 8.09, N = 3SE +/- 12.87, N = 14SE +/- 6.87, N = 8SE +/- 5.18, N = 157367266626201. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=on6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz1zfs_ashift=9_compression=on_dedup=off130260390520650Min: 720 / Avg: 735.67 / Max: 747Min: 655 / Avg: 725.79 / Max: 834Min: 637 / Avg: 661.75 / Max: 699Min: 594 / Avg: 619.6 / Max: 6601. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest16 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=off30060090012001500SE +/- 4.10, N = 3SE +/- 20.14, N = 15SE +/- 26.54, N = 316131611160815441. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest16 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=off30060090012001500Min: 1607 / Avg: 1613.33 / Max: 1621Min: 1490 / Avg: 1610.8 / Max: 1756Min: 1579 / Avg: 1608 / Max: 16611. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz12004006008001000SE +/- 6.35, N = 3SE +/- 3.84, N = 3SE +/- 2.73, N = 3SE +/- 14.90, N = 311311121111710861. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz12004006008001000Min: 1120 / Avg: 1131 / Max: 1142Min: 1115 / Avg: 1120.67 / Max: 1128Min: 1112 / Avg: 1117.33 / Max: 1121Min: 1069 / Avg: 1086.33 / Max: 11161. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=off6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz16001200180024003000SE +/- 26.21, N = 3SE +/- 35.95, N = 5SE +/- 2.40, N = 3SE +/- 5.90, N = 328582821282027531. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=off6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz15001000150020002500Min: 2829 / Avg: 2857.67 / Max: 2910Min: 2778 / Avg: 2820.8 / Max: 2964Min: 2815 / Avg: 2819.67 / Max: 2823Min: 2741 / Avg: 2752.67 / Max: 27601. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=on6 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_6x_ssd_in_2x_raidz110002000300040005000SE +/- 6.12, N = 3SE +/- 9.17, N = 3SE +/- 37.20, N = 15SE +/- 4.37, N = 345344495445443851. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=on6 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_6x_ssd_in_2x_raidz18001600240032004000Min: 4524 / Avg: 4533.67 / Max: 4545Min: 4483 / Avg: 4495 / Max: 4513Min: 4305 / Avg: 4453.87 / Max: 4804Min: 4380 / Avg: 4385.33 / Max: 43941. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest16 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz1zfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on140280420560700SE +/- 5.90, N = 3SE +/- 6.89, N = 3SE +/- 1.00, N = 3SE +/- 2.89, N = 36286156146061. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /mnt/ztest16 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz1zfs_ashift=9_compression=on_dedup=offzfs_ashift=9_compression=on_dedup=on110220330440550Min: 621 / Avg: 628.33 / Max: 640Min: 602 / Avg: 615.33 / Max: 625Min: 612 / Avg: 614 / Max: 615Min: 601 / Avg: 606 / Max: 6111. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=off6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz130060090012001500SE +/- 8.54, N = 3SE +/- 12.05, N = 15SE +/- 19.47, N = 3SE +/- 16.33, N = 314711441144114231. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=onzfs_ashift=9_compression=on_dedup=off6 x 481GB HSCP0480S5xnNMRIzfs_6x_ssd_in_2x_raidz130060090012001500Min: 1454 / Avg: 1471 / Max: 1481Min: 1399 / Avg: 1440.53 / Max: 1510Min: 1404 / Avg: 1441 / Max: 1470Min: 1393 / Avg: 1423.33 / Max: 14491. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=on6 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_6x_ssd_in_2x_raidz15001000150020002500SE +/- 5.51, N = 3SE +/- 33.95, N = 3SE +/- 30.83, N = 3SE +/- 21.62, N = 321502072196118111. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /mnt/ztest1zfs_ashift=9_compression=on_dedup=on6 x 481GB HSCP0480S5xnNMRIzfs_ashift=9_compression=on_dedup=offzfs_6x_ssd_in_2x_raidz1400800120016002000Min: 2140 / Avg: 2150 / Max: 2159Min: 2029 / Avg: 2072 / Max: 2139Min: 1916 / Avg: 1961 / Max: 2020Min: 1771 / Avg: 1811.33 / Max: 18451. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

48 Results Shown

Flexible IO Tester:
  Rand Read - Sync - No - Yes - 4KB - /mnt/ztest1
  Rand Read - Sync - No - Yes - 16KB - /mnt/ztest1
  Rand Read - Sync - No - Yes - 64KB - /mnt/ztest1
  Rand Write - Sync - No - Yes - 4KB - /mnt/ztest1
  Rand Write - Sync - No - Yes - 16KB - /mnt/ztest1
  Rand Write - Sync - No - Yes - 64KB - /mnt/ztest1
  Seq Read - Sync - No - Yes - 4KB - /mnt/ztest1
  Rand Read - Linux AIO - No - Yes - 4KB - /mnt/ztest1
  Seq Read - Sync - No - Yes - 16KB - /mnt/ztest1
  Seq Read - Sync - No - Yes - 64KB - /mnt/ztest1
  Seq Write - Sync - No - Yes - 4KB - /mnt/ztest1
  Rand Read - Linux AIO - No - Yes - 16KB - /mnt/ztest1
  Rand Read - Linux AIO - No - Yes - 64KB - /mnt/ztest1
  Rand Write - Linux AIO - No - Yes - 4KB - /mnt/ztest1
  Seq Write - Sync - No - Yes - 16KB - /mnt/ztest1
  Seq Write - Sync - No - Yes - 64KB - /mnt/ztest1
  Rand Write - Linux AIO - No - Yes - 16KB - /mnt/ztest1
  Rand Write - Linux AIO - No - Yes - 64KB - /mnt/ztest1
  Seq Read - Linux AIO - No - Yes - 4KB - /mnt/ztest1
  Seq Read - Linux AIO - No - Yes - 16KB - /mnt/ztest1
  Seq Read - Linux AIO - No - Yes - 64KB - /mnt/ztest1
  Seq Write - Linux AIO - No - Yes - 4KB - /mnt/ztest1
  Seq Write - Linux AIO - No - Yes - 16KB - /mnt/ztest1
  Seq Write - Linux AIO - No - Yes - 64KB - /mnt/ztest1
  Rand Read - Sync - No - Yes - 4KB - /mnt/ztest1
  Rand Read - Sync - No - Yes - 16KB - /mnt/ztest1
  Rand Read - Sync - No - Yes - 64KB - /mnt/ztest1
  Rand Write - Sync - No - Yes - 4KB - /mnt/ztest1
  Rand Write - Sync - No - Yes - 16KB - /mnt/ztest1
  Rand Write - Sync - No - Yes - 64KB - /mnt/ztest1
  Seq Read - Sync - No - Yes - 4KB - /mnt/ztest1
  Rand Read - Linux AIO - No - Yes - 4KB - /mnt/ztest1
  Seq Read - Sync - No - Yes - 16KB - /mnt/ztest1
  Seq Read - Sync - No - Yes - 64KB - /mnt/ztest1
  Seq Write - Sync - No - Yes - 4KB - /mnt/ztest1
  Rand Read - Linux AIO - No - Yes - 16KB - /mnt/ztest1
  Rand Read - Linux AIO - No - Yes - 64KB - /mnt/ztest1
  Rand Write - Linux AIO - No - Yes - 4KB - /mnt/ztest1
  Seq Write - Sync - No - Yes - 16KB - /mnt/ztest1
  Seq Write - Sync - No - Yes - 64KB - /mnt/ztest1
  Rand Write - Linux AIO - No - Yes - 16KB - /mnt/ztest1
  Rand Write - Linux AIO - No - Yes - 64KB - /mnt/ztest1
  Seq Read - Linux AIO - No - Yes - 4KB - /mnt/ztest1
  Seq Read - Linux AIO - No - Yes - 16KB - /mnt/ztest1
  Seq Read - Linux AIO - No - Yes - 64KB - /mnt/ztest1
  Seq Write - Linux AIO - No - Yes - 4KB - /mnt/ztest1
  Seq Write - Linux AIO - No - Yes - 16KB - /mnt/ztest1
  Seq Write - Linux AIO - No - Yes - 64KB - /mnt/ztest1