merge-9201

2 x Intel Xeon E5-2620 v4 testing with a Intel S2600CWR (SE5C610.86B.01.01.0020.122820161512 BIOS) and mgadrmfb on CentOS Linux 7 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2005197-SDS-MERGE92070
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable
Show Perf Per Clock Calculation Graphs Where Applicable
Show Perf Per RAM Channel Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
Promise D5800 Raid10 14TB 24EA
May 18 2020
  52 Minutes
Promise D5800 Raid5 14TB 24EA
May 18 2020
  52 Minutes
Synology RS2418+ Raid5 8TB 12EA
May 19 2020
  50 Minutes
Synology RS2418+ Raid10 8TB 12EA
May 19 2020
  53 Minutes
Intel S3710 200G 1EA localhost
May 19 2020
  26 Minutes
ZFS Raidz3 12TB 11EA sync=always
May 19 2020
  26 Minutes
Invert Hiding All Results Option
  43 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


merge-9201ProcessorMotherboardChipsetMemoryDiskGraphicsNetworkMonitorOSKernelCompilerFile-SystemScreen ResolutionPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhostZFS Raidz3 12TB 11EA sync=always2 x Intel Xeon E5-2620 0 @ 2.50GHz (12 Cores / 24 Threads)Dell 0020HJ (2.5.4 BIOS)Intel Xeon E5/Core8 x 16384 MB DDR3-1600MT/s M393B2G70BH0-CK0149GB PERC H710P + 1200GB PERC H710P + 8001GB PERC H710P + 153293GB VTrak D5800Matrox G200eR24 x Broadcom NetXtreme BCM5720 2-port PCIe + 2 x Intel 82599ES 10-Gigabit SFI/SFP+CentOS Linux 73.10.0-957.12.2.el7.x86_64 (x86_64)GCC 4.8.5 20150623ext41024x768Intel Xeon E5-2403 v2 @ 1.80GHz (4 Cores)Dell 0K29HN (2.9.0 BIOS)4 x 4096 MB DDR3-1600MT/s M393B5270QB0-YK0120GB INTEL SSDSC2BW12 + 2000GB PERC H310 + 75162GB iSCSI Storagemgadrmfb3.10.0-1062.el7.x86_64 (x86_64)xfsIntel Xeon E7 v2/XeonMatrox G200eR22 x Broadcom NetXtreme BCM5720 2-port PCIe + 2 x Intel 82599ES 10-Gigabit SFI/SFP+3.10.0-1127.8.2.el7.x86_64 (x86_64)2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads)Intel S2600CWR (SE5C610.86B.01.01.0020.122820161512 BIOS)16 x 16384 MB DDR4-2400MT/s Samsung M393A2K40CB1-CRC240GB INTEL SSDSC2KB24 + 13 x 12000GB Seagate ST12000NM0027 + 2 x 8002GB Seagate ST8000NM0016-1U3mgadrmfbDELL 1908FP3.10.0-1062.18.1.el7.x86_64 (x86_64)1280x1024OpenBenchmarking.orgCompiler Details- --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=genericDisk Details- Promise D5800 Raid10 14TB 24EA: NOOP / data=ordered,relatime,rw- Promise D5800 Raid5 14TB 24EA: NOOP / data=ordered,relatime,rw- Synology RS2418+ Raid5 8TB 12EA: DEADLINE / attr2,inode64,noquota,relatime,rw- Synology RS2418+ Raid10 8TB 12EA: DEADLINE / attr2,inode64,noquota,relatime,rw- Intel S3710 200G 1EA localhost: NOOP / attr2,inode64,noquota,relatime,rw- ZFS Raidz3 12TB 11EA sync=always: NOOP / attr2,inode64,noquota,relatime,rwProcessor Details- Promise D5800 Raid10 14TB 24EA: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x714- Promise D5800 Raid5 14TB 24EA: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x714- Synology RS2418+ Raid5 8TB 12EA: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x42e- Synology RS2418+ Raid10 8TB 12EA: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x42e- Intel S3710 200G 1EA localhost: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x42e- ZFS Raidz3 12TB 11EA sync=always: Scaling Governor: intel_pstate powersave - CPU Microcode: 0xb00001fSecurity Details- Promise D5800 Raid10 14TB 24EA: l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of Load fences __user pointer sanitization + spectre_v2: Mitigation of Full retpoline IBPB- Promise D5800 Raid5 14TB 24EA: l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of Load fences __user pointer sanitization + spectre_v2: Mitigation of Full retpoline IBPB- Synology RS2418+ Raid5 8TB 12EA: l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT disabled + mds: Mitigation of Clear buffers; SMT disabled + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of Load fences __user pointer sanitization + spectre_v2: Mitigation of Full retpoline IBPB- Synology RS2418+ Raid10 8TB 12EA: l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT disabled + mds: Mitigation of Clear buffers; SMT disabled + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of Load fences __user pointer sanitization + spectre_v2: Mitigation of Full retpoline IBPB- Intel S3710 200G 1EA localhost: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT disabled + mds: Mitigation of Clear buffers; SMT disabled + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of Load fences usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full retpoline IBPB + tsx_async_abort: Not affected- ZFS Raidz3 12TB 11EA sync=always: itlb_multihit: vulnerable + l1tf: Mitigation of PTE Inversion + mds: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of Load fences usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Vulnerable: Retpoline without IBPB + tsx_async_abort: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable

Promise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhostZFS Raidz3 12TB 11EA sync=alwaysResult OverviewPhoronix Test Suite100%550%1000%1450%1900%Flexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterRand Write - Sync - No - Yes - 64KB - /iscsiRand Write - Sync - No - Yes - 64KB - /iscsiRand Write - Sync - No - Yes - 128KB - /iscsiRand Write - Sync - No - Yes - 128KB - /iscsiRand Write - Sync - No - Yes - 4KB - /iscsiRand Write - Sync - No - Yes - 4KB - /iscsiRand Write - Sync - No - Yes - 16KB - /iscsiRand Write - Sync - No - Yes - 16KB - /iscsi

merge-9201fio: Rand Read - Sync - No - Yes - 4KB - /iscsifio: Rand Read - Sync - No - Yes - 4KB - /iscsifio: Rand Write - Sync - No - Yes - 4KB - /iscsifio: Rand Write - Sync - No - Yes - 4KB - /iscsifio: Rand Read - Sync - No - Yes - 16KB - /iscsifio: Rand Read - Sync - No - Yes - 16KB - /iscsifio: Rand Write - Sync - No - Yes - 16KB - /iscsifio: Rand Write - Sync - No - Yes - 16KB - /iscsifio: Rand Read - Sync - No - Yes - 64KB - /iscsifio: Rand Read - Sync - No - Yes - 64KB - /iscsifio: Rand Write - Sync - No - Yes - 64KB - /iscsifio: Rand Write - Sync - No - Yes - 64KB - /iscsifio: Rand Read - Sync - No - Yes - 128KB - /iscsifio: Rand Read - Sync - No - Yes - 128KB - /iscsifio: Rand Write - Sync - No - Yes - 128KB - /iscsifio: Rand Write - Sync - No - Yes - 128KB - /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhostZFS Raidz3 12TB 11EA sync=always23.860827.429185789.1570127.31755189301598.41571244194956.845420.552553.51887980.5515512.4795180288549.0783246196510785716.7429220.7530065.1416361.8395116927081181890265212298.478615.9415319.5499356.3360461.43930177282816426182952363183146529.2748365.11670096.6617818011533188300828745852451955294234811.262287438.5246510116241531228OpenBenchmarking.org

Flexible IO Tester

Fio is an advanced disk benchmark that depends upon the kernel's AIO access library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhost714212835SE +/- 0.17, N = 3SE +/- 0.15, N = 3SE +/- 0.15, N = 10SE +/- 0.26, N = 3SE +/- 0.03, N = 323.820.516.715.929.2-lcurl -lssl -lcrypto -lz-lcurl -lssl -lcrypto -lz1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhost612182430Min: 23.6 / Avg: 23.77 / Max: 24.1Min: 20.3 / Avg: 20.53 / Max: 20.8Min: 16 / Avg: 16.68 / Max: 17.7Min: 15.4 / Avg: 15.9 / Max: 16.3Min: 29.2 / Avg: 29.23 / Max: 29.31. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhost16003200480064008000SE +/- 42.39, N = 3SE +/- 42.60, N = 3SE +/- 33.47, N = 10SE +/- 118.26, N = 3SE +/- 4.16, N = 360825255429241537483-lcurl -lssl -lcrypto -lz-lcurl -lssl -lcrypto -lz1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhost13002600390052006500Min: 6032 / Avg: 6081.67 / Max: 6166Min: 5192 / Avg: 5254.67 / Max: 5336Min: 4153 / Avg: 4292.2 / Max: 4520Min: 3936 / Avg: 4153 / Max: 4343Min: 7475 / Avg: 7483 / Max: 74891. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhostZFS Raidz3 12TB 11EA sync=always1530456075SE +/- 0.103, N = 3SE +/- 0.013, N = 3SE +/- 0.100, N = 3SE +/- 0.258, N = 5SE +/- 0.203, N = 3SE +/- 0.993, N = 127.4293.51820.70019.50065.10011.2621. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhostZFS Raidz3 12TB 11EA sync=always1326395265Min: 7.27 / Avg: 7.43 / Max: 7.62Min: 3.5 / Avg: 3.52 / Max: 3.54Min: 20.5 / Avg: 20.7 / Max: 20.8Min: 19 / Avg: 19.52 / Max: 20.4Min: 64.7 / Avg: 65.07 / Max: 65.4Min: 0.82 / Avg: 11.26 / Max: 13.21. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhostZFS Raidz3 12TB 11EA sync=always4K8K12K16K20KSE +/- 25.72, N = 3SE +/- 3.33, N = 3SE +/- 20.85, N = 3SE +/- 63.42, N = 5SE +/- 57.74, N = 3SE +/- 255.18, N = 12185787953004993167002874-lcurl -lssl -lcrypto -lz1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhostZFS Raidz3 12TB 11EA sync=always3K6K9K12K15KMin: 1817 / Avg: 1857 / Max: 1905Min: 876 / Avg: 879.33 / Max: 886Min: 5259 / Avg: 5299.67 / Max: 5328Min: 4867 / Avg: 4992.8 / Max: 5211Min: 16600 / Avg: 16700 / Max: 16800Min: 204 / Avg: 2874.25 / Max: 33671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhost20406080100SE +/- 0.32, N = 3SE +/- 0.70, N = 3SE +/- 0.90, N = 3SE +/- 0.56, N = 3SE +/- 0.15, N = 389.180.565.156.396.6-lcurl -lssl -lcrypto -lz-lcurl -lssl -lcrypto -lz1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhost20406080100Min: 88.5 / Avg: 89.1 / Max: 89.6Min: 79.4 / Avg: 80.53 / Max: 81.8Min: 63.5 / Avg: 65.07 / Max: 66.6Min: 55.6 / Avg: 56.3 / Max: 57.4Min: 96.3 / Avg: 96.57 / Max: 96.81. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhost13002600390052006500SE +/- 20.43, N = 3SE +/- 44.40, N = 3SE +/- 55.43, N = 3SE +/- 36.33, N = 3SE +/- 8.76, N = 357015155416336046178-lcurl -lssl -lcrypto -lz-lcurl -lssl -lcrypto -lz1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhost11002200330044005500Min: 5663 / Avg: 5701 / Max: 5733Min: 5083 / Avg: 5155 / Max: 5236Min: 4067 / Avg: 4163 / Max: 4259Min: 3556 / Avg: 3603.67 / Max: 3675Min: 6162 / Avg: 6178.33 / Max: 61921. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhostZFS Raidz3 12TB 11EA sync=always4080120160200SE +/- 0.31, N = 6SE +/- 0.15, N = 3SE +/- 0.55, N = 3SE +/- 0.98, N = 15SE +/- 0.44, N = 627.312.461.861.4180.038.5-lcurl -lssl -lcrypto -lz-lcurl -lssl -lcrypto -lz1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhostZFS Raidz3 12TB 11EA sync=always306090120150Min: 26.4 / Avg: 27.27 / Max: 28.5Min: 12.2 / Avg: 12.4 / Max: 12.7Min: 60.8 / Avg: 61.77 / Max: 62.7Min: 56.7 / Avg: 61.43 / Max: 71Min: 37.4 / Avg: 38.52 / Max: 40.41. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhostZFS Raidz3 12TB 11EA sync=always2K4K6K8K10KSE +/- 20.73, N = 6SE +/- 9.74, N = 3SE +/- 35.81, N = 3SE +/- 63.14, N = 15SE +/- 33.33, N = 3SE +/- 28.19, N = 6175579539513930115332465-lcurl -lssl -lcrypto -lz-lcurl -lssl -lcrypto -lz1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 16KB - Disk Target: /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhostZFS Raidz3 12TB 11EA sync=always2K4K6K8K10KMin: 1690 / Avg: 1755.33 / Max: 1825Min: 783 / Avg: 794.67 / Max: 814Min: 3888 / Avg: 3951 / Max: 4012Min: 3627 / Avg: 3930.47 / Max: 4544Min: 11500 / Avg: 11533.33 / Max: 11600Min: 2393 / Avg: 2464.67 / Max: 25841. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhost4080120160200SE +/- 2.40, N = 3SE +/- 1.82, N = 15SE +/- 2.08, N = 3SE +/- 0.67, N = 3189180169177188-lcurl -lssl -lcrypto -lz-lcurl -lssl -lcrypto -lz1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhost306090120150Min: 184 / Avg: 188.67 / Max: 192Min: 172 / Avg: 180.33 / Max: 202Min: 174 / Avg: 177 / Max: 181Min: 187 / Avg: 188.33 / Max: 1891. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhost6001200180024003000SE +/- 38.05, N = 3SE +/- 28.92, N = 15SE +/- 30.86, N = 7SE +/- 37.08, N = 3SE +/- 10.54, N = 330152885270828283008-lcurl -lssl -lcrypto -lz-lcurl -lssl -lcrypto -lz1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhost5001000150020002500Min: 2941 / Avg: 3014.67 / Max: 3068Min: 2757 / Avg: 2885.2 / Max: 3232Min: 2600 / Avg: 2708 / Max: 2824Min: 2776 / Avg: 2828.33 / Max: 2900Min: 2987 / Avg: 3008 / Max: 30201. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhostZFS Raidz3 12TB 11EA sync=always60120180240300SE +/- 1.38, N = 3SE +/- 0.45, N = 3SE +/- 0.33, N = 3SE +/- 1.20, N = 3SE +/- 0.33, N = 398.449.0118.0164.0287.0101.0-lcurl -lssl -lcrypto -lz-lcurl -lssl -lcrypto -lz-lcurl -lssl -lcrypto -lz1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhostZFS Raidz3 12TB 11EA sync=always50100150200250Min: 96.3 / Avg: 98.4 / Max: 101Min: 48.1 / Avg: 48.97 / Max: 49.6Min: 118 / Avg: 118.33 / Max: 119Min: 162 / Avg: 163.67 / Max: 166Min: 286 / Avg: 286.67 / Max: 2871. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhostZFS Raidz3 12TB 11EA sync=always10002000300040005000SE +/- 19.60, N = 3SE +/- 7.21, N = 3SE +/- 5.36, N = 3SE +/- 22.45, N = 3SE +/- 1.73, N = 3SE +/- 2.96, N = 315717831890261845851624-lcurl -lssl -lcrypto -lz-lcurl -lssl -lcrypto -lz-lcurl -lssl -lcrypto -lz1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 64KB - Disk Target: /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhostZFS Raidz3 12TB 11EA sync=always8001600240032004000Min: 1541 / Avg: 1571.33 / Max: 1608Min: 769 / Avg: 783 / Max: 793Min: 1880 / Avg: 1890.33 / Max: 1898Min: 2592 / Avg: 2618.33 / Max: 2663Min: 4582 / Avg: 4585 / Max: 4588Min: 1620 / Avg: 1624.33 / Max: 16301. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhost60120180240300SE +/- 3.18, N = 15SE +/- 2.61, N = 15SE +/- 1.86, N = 3SE +/- 2.73, N = 3SE +/- 0.88, N = 3244246265295245-lcurl -lssl -lcrypto -lz-lcurl -lssl -lcrypto -lz1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhost50100150200250Min: 233 / Avg: 243.73 / Max: 271Min: 228 / Avg: 245.67 / Max: 261Min: 263 / Avg: 265.33 / Max: 269Min: 290 / Avg: 295.33 / Max: 299Min: 243 / Avg: 244.67 / Max: 2461. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhost5001000150020002500SE +/- 25.34, N = 15SE +/- 20.91, N = 15SE +/- 15.38, N = 3SE +/- 20.51, N = 3SE +/- 7.22, N = 319491965212223631955-lcurl -lssl -lcrypto -lz-lcurl -lssl -lcrypto -lz1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhost400800120016002000Min: 1866 / Avg: 1948.87 / Max: 2164Min: 1820 / Avg: 1964.6 / Max: 2087Min: 2105 / Avg: 2122.33 / Max: 2153Min: 2323 / Avg: 2363.33 / Max: 2390Min: 1941 / Avg: 1955.33 / Max: 19641. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhostZFS Raidz3 12TB 11EA sync=always60120180240300SE +/- 1.81, N = 12SE +/- 1.00, N = 3SE +/- 1.89, N = 15SE +/- 1.99, N = 15SE +/- 0.67, N = 3SE +/- 1.67, N = 356.8107.098.4183.0294.0153.0-lcurl -lssl -lcrypto -lz-lcurl -lssl -lcrypto -lz-lcurl -lssl -lcrypto -lz1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhostZFS Raidz3 12TB 11EA sync=always50100150200250Min: 47.7 / Avg: 56.77 / Max: 64.6Min: 105 / Avg: 107 / Max: 108Min: 83.7 / Avg: 98.37 / Max: 111Min: 168 / Avg: 183.13 / Max: 193Min: 293 / Avg: 293.67 / Max: 295Min: 150 / Avg: 153.33 / Max: 1551. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhostZFS Raidz3 12TB 11EA sync=always5001000150020002500SE +/- 14.53, N = 12SE +/- 7.02, N = 3SE +/- 15.12, N = 15SE +/- 16.00, N = 15SE +/- 4.73, N = 3SE +/- 15.33, N = 3454857786146523481228-lcurl -lssl -lcrypto -lz-lcurl -lssl -lcrypto -lz-lcurl -lssl -lcrypto -lz1. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - Engine: Sync - Buffered: No - Direct: Yes - Block Size: 128KB - Disk Target: /iscsiPromise D5800 Raid10 14TB 24EAPromise D5800 Raid5 14TB 24EASynology RS2418+ Raid5 8TB 12EASynology RS2418+ Raid10 8TB 12EAIntel S3710 200G 1EA localhostZFS Raidz3 12TB 11EA sync=always400800120016002000Min: 381 / Avg: 453.67 / Max: 517Min: 843 / Avg: 857 / Max: 865Min: 669 / Avg: 786.2 / Max: 889Min: 1343 / Avg: 1465 / Max: 1547Min: 2341 / Avg: 2348 / Max: 2357Min: 1197 / Avg: 1227.67 / Max: 12431. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lpthread -lm -ldl

16 Results Shown

Flexible IO Tester:
  Rand Read - Sync - No - Yes - 4KB - /iscsi:
    MB/s
    IOPS
  Rand Write - Sync - No - Yes - 4KB - /iscsi:
    MB/s
    IOPS
  Rand Read - Sync - No - Yes - 16KB - /iscsi:
    MB/s
    IOPS
  Rand Write - Sync - No - Yes - 16KB - /iscsi:
    MB/s
    IOPS
  Rand Read - Sync - No - Yes - 64KB - /iscsi:
    MB/s
    IOPS
  Rand Write - Sync - No - Yes - 64KB - /iscsi:
    MB/s
    IOPS
  Rand Read - Sync - No - Yes - 128KB - /iscsi:
    MB/s
    IOPS
  Rand Write - Sync - No - Yes - 128KB - /iscsi:
    MB/s
    IOPS