201906040855

2 x Intel Xeon E5-2620 v4 testing with a Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS) and Matrox MGA G200e [Pilot] on CentOS Linux 7 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1906049-HV-20190604024
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
ZFS RAIDZ2 12TB 4EA
June 04 2019
  3 Hours, 22 Minutes
ZFS RAIDZ2 12TB 6EA
June 04 2019
  1 Hour, 56 Minutes
ZFS RAIDZ2 12TB 10EA
June 04 2019
  1 Hour, 27 Minutes
Invert Hiding All Results Option
  2 Hours, 15 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

ZFS RAIDZ2 12TB 4EA

Compiler Notes: --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic
Disk Notes: DEADLINE / attr2,inode64,noquota,relatime,rw,seclabel
Processor Notes: Scaling Governor: intel_pstate powersave
Security Notes: SELinux + l1tf: Mitigation of PTE Inversion + meltdown: Mitigation of PTI + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of Load fences __user pointer sanitization + spectre_v2: Mitigation of Full retpoline

ZFS RAIDZ2 12TB 6EA

Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS), Memory: 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD, Disk: 7 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume, Graphics: mgadrmfb

OS: CentOS Linux 7, Kernel: 3.10.0-957.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768

ZFS RAIDZ2 12TB 10EA

Changed Chipset to Intel Xeon E7 v4/Xeon.

Changed Memory to 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD.

Changed Disk to 11 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume.

201906040855ProcessorMotherboardMemoryDiskGraphicsChipsetNetworkOSKernelCompilerFile-SystemScreen ResolutionZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads)Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS)4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD7 x 12000GB Seagate ST12000NM0027 + 239GB Logical VolumemgadrmfbCentOS Linux 73.10.0-957.el7.x86_64 (x86_64)GCC 4.8.5 20150623zfs1024x768Intel Xeon E7 v4/Xeon11 x 12000GB Seagate ST12000NM0027 + 239GB Logical VolumeMatrox MGA G200e [Pilot]2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+OpenBenchmarking.orgCompiler Details- --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic Disk Details- DEADLINE / attr2,inode64,noquota,relatime,rw,seclabelProcessor Details- Scaling Governor: intel_pstate powersaveSecurity Details- SELinux + l1tf: Mitigation of PTE Inversion + meltdown: Mitigation of PTI + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of Load fences __user pointer sanitization + spectre_v2: Mitigation of Full retpoline

ZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EAResult OverviewPhoronix Test Suite100%163%227%290%354%IOzoneIOzoneIOzoneIOzoneIOzoneIOzoneIOzoneIOzoneIOzoneIOzoneIOzoneIOzoneIOzoneIOzoneIOzoneIOzoneIOzoneIOzoneIOzoneIOzoneIOzoneIOzoneIOzoneIOzone64Kb - 4GB - Write Performance64Kb - 2GB - Write Performance1MB - 512MB - Write Performance1MB - 2GB - Write Performance1MB - 4GB - Write Performance64Kb - 512MB - Write Performance64Kb - 8GB - Write Performance1MB - 8GB - Write Performance4Kb - 2GB - Write Performance4Kb - 8GB - Write Performance4Kb - 4GB - Write Performance4Kb - 512MB - Write Performance64Kb - 512MB - Read Performance1MB - 2GB - Read Performance64Kb - 2GB - Read Performance1MB - 512MB - Read Performance64Kb - 4GB - Read Performance4Kb - 512MB - Read Performance64Kb - 8GB - Read Performance1MB - 8GB - Read Performance4Kb - 4GB - Read Performance1MB - 4GB - Read Performance4Kb - 2GB - Read Performance4Kb - 8GB - Read Performance

201906040855iozone: 1MB - 2GB - Read Performanceiozone: 1MB - 4GB - Read Performanceiozone: 1MB - 8GB - Read Performanceiozone: 4Kb - 2GB - Read Performanceiozone: 4Kb - 4GB - Read Performanceiozone: 4Kb - 8GB - Read Performanceiozone: 1MB - 2GB - Write Performanceiozone: 1MB - 4GB - Write Performanceiozone: 1MB - 8GB - Write Performanceiozone: 4Kb - 2GB - Write Performanceiozone: 4Kb - 4GB - Write Performanceiozone: 4Kb - 8GB - Write Performanceiozone: 64Kb - 2GB - Read Performanceiozone: 64Kb - 4GB - Read Performanceiozone: 64Kb - 8GB - Read Performanceiozone: 1MB - 512MB - Read Performanceiozone: 4Kb - 512MB - Read Performanceiozone: 64Kb - 2GB - Write Performanceiozone: 64Kb - 4GB - Write Performanceiozone: 64Kb - 8GB - Write Performanceiozone: 1MB - 512MB - Write Performanceiozone: 4Kb - 512MB - Write Performanceiozone: 64Kb - 512MB - Read Performanceiozone: 64Kb - 512MB - Write PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA21492225227999210501106181165206205227240194719632124284297915110816018318020821672299217223741003105710983373353773153443632147210921043192945330260323330244233234425572243227010191091109756550351634634337623092124201729329204953824265902722857486OpenBenchmarking.org

IOzone

The IOzone benchmark tests the hard disk drive / file-system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 2GB - Disk Test: Read PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA5001000150020002500SE +/- 26.57, N = 15SE +/- 91.27, N = 15SE +/- 114.77, N = 152149229925571. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 2GB - Disk Test: Read PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA400800120016002000Min: 1941.82 / Avg: 2149.26 / Max: 2290.32Min: 1929.95 / Avg: 2299.07 / Max: 3053.22Min: 2027.46 / Avg: 2556.67 / Max: 3480.391. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 4GB - Disk Test: Read PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA5001000150020002500SE +/- 25.59, N = 15SE +/- 27.63, N = 15SE +/- 26.71, N = 152225217222431. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 4GB - Disk Test: Read PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA400800120016002000Min: 1969.61 / Avg: 2224.57 / Max: 2395.13Min: 1969.71 / Avg: 2171.52 / Max: 2326.7Min: 2030.24 / Avg: 2243.46 / Max: 2437.091. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Read PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA5001000150020002500SE +/- 33.97, N = 15SE +/- 17.55, N = 3SE +/- 50.20, N = 122279237422701. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Read PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA400800120016002000Min: 2021.19 / Avg: 2279.17 / Max: 2458.85Min: 2344.8 / Avg: 2373.72 / Max: 2405.41Min: 1958.73 / Avg: 2269.56 / Max: 2496.361. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 2GB - Disk Test: Read PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA2004006008001000SE +/- 11.55, N = 6SE +/- 15.98, N = 15SE +/- 14.55, N = 15992100310191. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 2GB - Disk Test: Read PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA2004006008001000Min: 957.56 / Avg: 992.49 / Max: 1037.13Min: 843.4 / Avg: 1003.13 / Max: 1068.83Min: 922.06 / Avg: 1018.89 / Max: 1127.581. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 4GB - Disk Test: Read PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA2004006008001000SE +/- 16.52, N = 15SE +/- 8.02, N = 3SE +/- 14.10, N = 41050105710911. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 4GB - Disk Test: Read PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA2004006008001000Min: 923.47 / Avg: 1049.74 / Max: 1134.87Min: 1047.97 / Avg: 1057.36 / Max: 1073.32Min: 1061.61 / Avg: 1090.92 / Max: 1125.751. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Read PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA2004006008001000SE +/- 12.41, N = 15SE +/- 10.83, N = 15SE +/- 11.39, N = 151106109810971. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Read PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA2004006008001000Min: 1030.71 / Avg: 1105.51 / Max: 1192.38Min: 1030.19 / Avg: 1098.35 / Max: 1148.64Min: 1049.32 / Avg: 1097.23 / Max: 1169.71. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 2GB - Disk Test: Write PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA120240360480600SE +/- 2.17, N = 15SE +/- 5.45, N = 3SE +/- 12.76, N = 151813375651. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 2GB - Disk Test: Write PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA100200300400500Min: 168.74 / Avg: 181.23 / Max: 193.72Min: 327.9 / Avg: 336.84 / Max: 346.71Min: 487.81 / Avg: 565.17 / Max: 699.731. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 4GB - Disk Test: Write PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA110220330440550SE +/- 7.65, N = 15SE +/- 4.11, N = 3SE +/- 4.39, N = 31653355031. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 4GB - Disk Test: Write PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA90180270360450Min: 149.68 / Avg: 164.67 / Max: 268.14Min: 327.16 / Avg: 335.05 / Max: 341.01Min: 495.25 / Avg: 503.28 / Max: 510.351. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Write PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA110220330440550SE +/- 2.06, N = 3SE +/- 9.54, N = 15SE +/- 3.46, N = 32063775161. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Write PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA90180270360450Min: 203.47 / Avg: 205.98 / Max: 210.07Min: 302.33 / Avg: 376.73 / Max: 446.09Min: 511.26 / Avg: 515.71 / Max: 522.511. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 2GB - Disk Test: Write PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA80160240320400SE +/- 11.08, N = 12SE +/- 6.50, N = 15SE +/- 2.85, N = 32053153461. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 2GB - Disk Test: Write PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA60120180240300Min: 167.25 / Avg: 204.67 / Max: 314.11Min: 277.23 / Avg: 314.97 / Max: 367.78Min: 342.06 / Avg: 346.09 / Max: 351.61. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 4GB - Disk Test: Write PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA70140210280350SE +/- 10.61, N = 15SE +/- 11.21, N = 12SE +/- 7.25, N = 152273443431. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 4GB - Disk Test: Write PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA60120180240300Min: 157.56 / Avg: 227.09 / Max: 312.87Min: 284.01 / Avg: 344 / Max: 403.18Min: 284.28 / Avg: 343.21 / Max: 377.131. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Write PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA80160240320400SE +/- 1.36, N = 3SE +/- 8.28, N = 12SE +/- 3.92, N = 152403633761. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Write PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA70140210280350Min: 238.05 / Avg: 240.19 / Max: 242.73Min: 319.5 / Avg: 362.95 / Max: 405.19Min: 352.36 / Avg: 375.79 / Max: 4001. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 2GB - Disk Test: Read PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA5001000150020002500SE +/- 36.06, N = 15SE +/- 132.09, N = 15SE +/- 76.01, N = 151947214723091. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 2GB - Disk Test: Read PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA400800120016002000Min: 1795.82 / Avg: 1947.4 / Max: 2133.51Min: 1766.89 / Avg: 2146.68 / Max: 3697.93Min: 1881.29 / Avg: 2308.5 / Max: 2808.671. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 4GB - Disk Test: Read PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA5001000150020002500SE +/- 31.87, N = 3SE +/- 30.77, N = 3SE +/- 12.73, N = 31963210921241. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 4GB - Disk Test: Read PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA400800120016002000Min: 1925.27 / Avg: 1962.51 / Max: 2025.93Min: 2070.71 / Avg: 2108.78 / Max: 2169.69Min: 2105.2 / Avg: 2124.25 / Max: 2148.41. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 8GB - Disk Test: Read PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA5001000150020002500SE +/- 31.23, N = 12SE +/- 22.93, N = 15SE +/- 28.44, N = 32124210420171. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 8GB - Disk Test: Read PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA400800120016002000Min: 1921.19 / Avg: 2124.11 / Max: 2286.72Min: 1906.1 / Avg: 2103.77 / Max: 2233.64Min: 1981.59 / Avg: 2016.6 / Max: 2072.931. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 512MB - Disk Test: Read PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA7001400210028003500SE +/- 102.87, N = 15SE +/- 222.42, N = 15SE +/- 166.08, N = 152842319229321. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 512MB - Disk Test: Read PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA6001200180024003000Min: 2049.17 / Avg: 2841.51 / Max: 3438.78Min: 1936.37 / Avg: 3192.45 / Max: 4493.83Min: 2006.69 / Avg: 2931.95 / Max: 3796.131. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 512MB - Disk Test: Read PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA2004006008001000SE +/- 28.43, N = 15SE +/- 44.29, N = 15SE +/- 11.02, N = 159799459201. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 512MB - Disk Test: Read PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA2004006008001000Min: 852.64 / Avg: 979.45 / Max: 1197.64Min: 555.23 / Avg: 945.08 / Max: 1370.92Min: 818.06 / Avg: 919.53 / Max: 1003.181. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 2GB - Disk Test: Write PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA110220330440550SE +/- 2.09, N = 3SE +/- 24.53, N = 12SE +/- 34.64, N = 151513304951. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 2GB - Disk Test: Write PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA90180270360450Min: 146.65 / Avg: 150.7 / Max: 153.64Min: 201.43 / Avg: 330.38 / Max: 450.16Min: 250.65 / Avg: 494.54 / Max: 772.091. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 4GB - Disk Test: Write PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA80160240320400SE +/- 2.89, N = 15SE +/- 21.18, N = 12SE +/- 15.36, N = 151082603821. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 4GB - Disk Test: Write PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA70140210280350Min: 96.35 / Avg: 107.96 / Max: 135.42Min: 210.72 / Avg: 259.75 / Max: 482.33Min: 306.6 / Avg: 381.71 / Max: 552.921. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 8GB - Disk Test: Write PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA90180270360450SE +/- 1.40, N = 15SE +/- 20.72, N = 15SE +/- 22.32, N = 121603234261. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 8GB - Disk Test: Write PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA80160240320400Min: 152.04 / Avg: 160.44 / Max: 170.32Min: 258.76 / Avg: 322.82 / Max: 569.33Min: 358.71 / Avg: 426.27 / Max: 656.681. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 512MB - Disk Test: Write PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA130260390520650SE +/- 4.55, N = 15SE +/- 12.49, N = 15SE +/- 21.44, N = 121833305901. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 512MB - Disk Test: Write PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA100200300400500Min: 124.71 / Avg: 182.74 / Max: 197.3Min: 244.9 / Avg: 330.26 / Max: 414.54Min: 474.27 / Avg: 589.84 / Max: 690.361. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 512MB - Disk Test: Write PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA60120180240300SE +/- 9.97, N = 15SE +/- 6.50, N = 15SE +/- 5.14, N = 151802442721. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 512MB - Disk Test: Write PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA50100150200250Min: 118.74 / Avg: 179.8 / Max: 232.18Min: 199.67 / Avg: 244.14 / Max: 295.85Min: 239.18 / Avg: 272.22 / Max: 302.431. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 512MB - Disk Test: Read PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA6001200180024003000SE +/- 125.45, N = 12SE +/- 181.31, N = 12SE +/- 237.99, N = 152082233228571. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 512MB - Disk Test: Read PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA5001000150020002500Min: 1599.82 / Avg: 2081.72 / Max: 2819.93Min: 1663.06 / Avg: 2331.85 / Max: 3524.03Min: 1826.35 / Avg: 2856.68 / Max: 4415.551. (CC) gcc options: -O3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 512MB - Disk Test: Write PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA110220330440550SE +/- 2.31, N = 3SE +/- 23.20, N = 15SE +/- 35.15, N = 121673444861. (CC) gcc options: -O3
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 512MB - Disk Test: Write PerformanceZFS RAIDZ2 12TB 4EAZFS RAIDZ2 12TB 6EAZFS RAIDZ2 12TB 10EA90180270360450Min: 163.02 / Avg: 167.38 / Max: 170.86Min: 174.43 / Avg: 344.31 / Max: 465.89Min: 163.88 / Avg: 485.87 / Max: 585.621. (CC) gcc options: -O3

ZFS RAIDZ2 12TB 4EA

Compiler Notes: --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic
Disk Notes: DEADLINE / attr2,inode64,noquota,relatime,rw,seclabel
Processor Notes: Scaling Governor: intel_pstate powersave
Security Notes: SELinux + l1tf: Mitigation of PTE Inversion + meltdown: Mitigation of PTI + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of Load fences __user pointer sanitization + spectre_v2: Mitigation of Full retpoline

Testing initiated at 4 June 2019 08:55 by user sds.

ZFS RAIDZ2 12TB 6EA

Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS), Memory: 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD, Disk: 7 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume, Graphics: mgadrmfb

OS: CentOS Linux 7, Kernel: 3.10.0-957.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768

Compiler Notes: --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic
Disk Notes: DEADLINE / attr2,inode64,noquota,relatime,rw,seclabel
Processor Notes: Scaling Governor: intel_pstate powersave
Security Notes: SELinux + l1tf: Mitigation of PTE Inversion + meltdown: Mitigation of PTI + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of Load fences __user pointer sanitization + spectre_v2: Mitigation of Full retpoline

Testing initiated at 4 June 2019 13:30 by user sds.

ZFS RAIDZ2 12TB 10EA

Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD, Disk: 11 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume, Graphics: Matrox MGA G200e [Pilot], Network: 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+

OS: CentOS Linux 7, Kernel: 3.10.0-957.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768

Compiler Notes: --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic
Disk Notes: DEADLINE / attr2,inode64,noquota,relatime,rw,seclabel
Processor Notes: Scaling Governor: intel_pstate powersave
Security Notes: SELinux + l1tf: Mitigation of PTE Inversion + meltdown: Mitigation of PTI + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of Load fences __user pointer sanitization + spectre_v2: Mitigation of Full retpoline

Testing initiated at 4 June 2019 20:05 by user sds.