201907041004

2 x Intel Xeon E5-2620 v4 testing with a Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS) and Matrox MGA G200e [Pilot] on CentOS Linux 7 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1907040-SDS-2019070462
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
ZFS RaidZ3 12TB 7EA recordsize 4K
July 04 2019
  2 Hours, 41 Minutes
ZFS RaidZ3 12TB 7EA recordsize 64K
July 04 2019
  1 Hour, 25 Minutes
Invert Hiding All Results Option
  2 Hours, 3 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

ZFS RaidZ3 12TB 7EA recordsize 4K

Compiler Notes: --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic
Disk Notes: DEADLINE / attr2,inode64,noquota,relatime,rw
Processor Notes: Scaling Governor: intel_pstate powersave
Security Notes: l1tf: Mitigation of PTE Inversion + mds: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of Load fences __user pointer sanitization + spectre_v2: Mitigation of Full retpoline IBPB

ZFS RaidZ3 12TB 7EA recordsize 64K

Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD, Disk: 7 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume, Graphics: Matrox MGA G200e [Pilot], Network: 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+

OS: CentOS Linux 7, Kernel: 3.10.0-957.21.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768

201907041004OpenBenchmarking.orgPhoronix Test Suite2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads)Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS)Intel Xeon E7 v4/Xeon4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD7 x 12000GB Seagate ST12000NM0027 + 239GB Logical VolumeMatrox MGA G200e [Pilot]2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+CentOS Linux 73.10.0-957.21.2.el7.x86_64 (x86_64)GCC 4.8.5 20150623zfs1024x768ProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen Resolution201907041004 BenchmarksSystem Logs- --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic - DEADLINE / attr2,inode64,noquota,relatime,rw- Scaling Governor: intel_pstate powersave- l1tf: Mitigation of PTE Inversion + mds: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of Load fences __user pointer sanitization + spectre_v2: Mitigation of Full retpoline IBPB

ZFS RaidZ3 12TB 7EA recordsize 4K vs. ZFS RaidZ3 12TB 7EA recordsize 64K ComparisonPhoronix Test SuiteBaseline+240.4%+240.4%+480.8%+480.8%+721.2%+721.2%767.4%320.7%150.3%108.9%961.5%87.9%85.3%56.2%44.8%39.1%33.2%30.2%15.9%9.1%N.F.S.1.F.1.S.4.TN.F.S.1.F.1.S.1.T1.F.1.S.1.TN.F.S.1.F.6.SN.F.S.1.F.1.S.1.T1.F.6.S.1.T1.F.1.SN.F.S.1.F.1.S.4.T79.4%N.F.S.1.F.1.S58.3%1.F.1.S1.F.1.S.4.T1.F.1.S.4.T1.F.6.S.4.TN.F.S.1.F.6.S.1.T30.7%1.F.1.S.1.T1.F.4.S30.1%N.F.S.1.F.4.S29.5%N.F.S.1.F.6.S.4.T20.6%N.F.S.1.F.1.S19.6%1.F.4.S.4.T16.8%1.F.6.SN.F.S.1.F.4.S.4.TFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K

201907041004fs-mark: 1000 Files, 4K Sizefs-mark: 1000 Files, 1MB Sizefs-mark: 1000 Files, 64K Sizefs-mark: 1000 Files, 128K Sizefs-mark: 1000 Files, 4K Size, 4 Threadsfs-mark: 1000 Files, 1MB Size, 4 Threadsfs-mark: 1000 Files, 4K Size, 16 Threadsfs-mark: 1000 Files, 64K Size, 4 Threadsfs-mark: 1000 Files, 128K Size, 4 Threadsfs-mark: 1000 Files, 1MB Size, 16 Threadsfs-mark: 1000 Files, 64K Size, 16 Threadsfs-mark: 1000 Files, 128K Size, 16 Threadsfs-mark: No FSYNC/SYNC 1000 Files, 4K Sizefs-mark: No FSYNC/SYNC 1000 Files, 1MB Sizefs-mark: No FSYNC/SYNC 1000 Files, 64K Sizefs-mark: No FSYNC/SYNC 1000 Files, 128K Sizefs-mark: No FSYNC/SYNC 1000 Files, 4K Size, 4 Threadsfs-mark: No FSYNC/SYNC 1000 Files, 1MB Size, 4 Threadsfs-mark: No FSYNC/SYNC 1000 Files, 4K Size, 16 Threadsfs-mark: No FSYNC/SYNC 1000 Files, 64K Size, 4 Threadsfs-mark: No FSYNC/SYNC 1000 Files, 128K Size, 4 Threadsfs-mark: No FSYNC/SYNC 1000 Files, 1MB Size, 16 Threadsfs-mark: No FSYNC/SYNC 1000 Files, 64K Size, 16 Threadsfs-mark: No FSYNC/SYNC 1000 Files, 128K Size, 16 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K105.4018.8072.7543.57180.4829.33451.2593.3073.9724144.17109.833576.94370.201407.66881.302815.1756.432943.672947.663822.43242649.82705.9381.0334.8384.3068.07154.5542.47456.91124.27102.8760.07270.83143.002762.98233.852940.64736.933071.13489.492926.072443.912131.15254.762028.122970.06OpenBenchmarking.org

FS-Mark

FS_Mark is designed to test a system's file-system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 4K SizeZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K20406080100SE +/- 0.57, N = 3SE +/- 1.22, N = 3105.4081.031. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 4K SizeZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K20406080100Min: 104.3 / Avg: 105.4 / Max: 106.2Min: 78.6 / Avg: 81.03 / Max: 82.31. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K816243240SE +/- 0.15, N = 3SE +/- 0.52, N = 318.8034.831. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K714212835Min: 18.6 / Avg: 18.8 / Max: 19.1Min: 33.9 / Avg: 34.83 / Max: 35.71. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 64K SizeZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K20406080100SE +/- 0.89, N = 15SE +/- 1.17, N = 372.7584.301. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 64K SizeZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K1632486480Min: 66.2 / Avg: 72.75 / Max: 77.7Min: 82 / Avg: 84.3 / Max: 85.81. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 128K SizeZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K1530456075SE +/- 0.09, N = 3SE +/- 1.11, N = 343.5768.071. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 128K SizeZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K1326395265Min: 43.4 / Avg: 43.57 / Max: 43.7Min: 66.5 / Avg: 68.07 / Max: 70.21. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 4K Size, 4 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K4080120160200SE +/- 2.18, N = 6SE +/- 2.95, N = 12180.48154.551. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 4K Size, 4 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K306090120150Min: 176.5 / Avg: 180.48 / Max: 190.1Min: 140.2 / Avg: 154.55 / Max: 177.41. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size, 4 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K1020304050SE +/- 0.13, N = 3SE +/- 0.29, N = 329.3342.471. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size, 4 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K918273645Min: 29.2 / Avg: 29.33 / Max: 29.6Min: 42 / Avg: 42.47 / Max: 431. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 4K Size, 16 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K100200300400500SE +/- 9.74, N = 15SE +/- 10.98, N = 15451.25456.911. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 4K Size, 16 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K80160240320400Min: 388.3 / Avg: 451.25 / Max: 534.5Min: 390.3 / Avg: 456.91 / Max: 527.21. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 64K Size, 4 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K306090120150SE +/- 0.46, N = 3SE +/- 1.02, N = 393.30124.271. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 64K Size, 4 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K20406080100Min: 92.4 / Avg: 93.3 / Max: 93.9Min: 123.2 / Avg: 124.27 / Max: 126.31. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 128K Size, 4 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K20406080100SE +/- 0.78, N = 3SE +/- 1.21, N = 373.97102.871. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 128K Size, 4 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K20406080100Min: 73 / Avg: 73.97 / Max: 75.5Min: 100.8 / Avg: 102.87 / Max: 1051. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size, 16 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K1326395265SE +/- 0.47, N = 324.0060.071. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size, 16 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K1224364860Min: 59.2 / Avg: 60.07 / Max: 60.81. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 64K Size, 16 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K60120180240300SE +/- 0.44, N = 3SE +/- 1.10, N = 3144.17270.831. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 64K Size, 16 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K50100150200250Min: 143.5 / Avg: 144.17 / Max: 145Min: 269.4 / Avg: 270.83 / Max: 2731. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 128K Size, 16 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K306090120150SE +/- 1.27, N = 3SE +/- 0.83, N = 3109.83143.001. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 128K Size, 16 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K306090120150Min: 107.7 / Avg: 109.83 / Max: 112.1Min: 141.8 / Avg: 143 / Max: 144.61. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 4K SizeZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K8001600240032004000SE +/- 228.40, N = 12SE +/- 279.08, N = 153576.942762.981. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 4K SizeZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K6001200180024003000Min: 2419.4 / Avg: 3576.94 / Max: 5309.5Min: 1426.9 / Avg: 2762.98 / Max: 4100.21. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 1MB SizeZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K80160240320400SE +/- 5.25, N = 3SE +/- 30.17, N = 15370.20233.851. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 1MB SizeZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K70140210280350Min: 361.2 / Avg: 370.2 / Max: 379.4Min: 94.3 / Avg: 233.85 / Max: 4031. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 64K SizeZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K6001200180024003000SE +/- 228.39, N = 12SE +/- 215.76, N = 151407.662940.641. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 64K SizeZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K5001000150020002500Min: 674.3 / Avg: 1407.66 / Max: 2780.6Min: 1101.6 / Avg: 2940.64 / Max: 3683.71. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 128K SizeZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K2004006008001000SE +/- 61.40, N = 12SE +/- 17.19, N = 15881.30736.931. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 128K SizeZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K150300450600750Min: 491.9 / Avg: 881.3 / Max: 1196Min: 601.1 / Avg: 736.93 / Max: 855.11. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 4K Size, 4 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K7001400210028003500SE +/- 88.55, N = 12SE +/- 108.66, N = 152815.173071.131. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 4K Size, 4 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K5001000150020002500Min: 1990.2 / Avg: 2815.17 / Max: 3273.9Min: 2057.5 / Avg: 3071.13 / Max: 3722.91. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 1MB Size, 4 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K110220330440550SE +/- 0.15, N = 3SE +/- 7.94, N = 1556.43489.491. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 1MB Size, 4 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K90180270360450Min: 56.2 / Avg: 56.43 / Max: 56.7Min: 414.4 / Avg: 489.49 / Max: 521.61. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 4K Size, 16 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K6001200180024003000SE +/- 36.75, N = 3SE +/- 90.05, N = 122943.672926.071. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 4K Size, 16 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K5001000150020002500Min: 2900.7 / Avg: 2943.67 / Max: 3016.8Min: 2382.5 / Avg: 2926.07 / Max: 3328.31. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 64K Size, 4 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K6001200180024003000SE +/- 187.26, N = 15SE +/- 223.64, N = 152947.662443.911. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 64K Size, 4 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K5001000150020002500Min: 2130 / Avg: 2947.66 / Max: 4456.1Min: 1238.8 / Avg: 2443.91 / Max: 4183.31. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 128K Size, 4 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K8001600240032004000SE +/- 245.26, N = 15SE +/- 87.98, N = 153822.432131.151. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 128K Size, 4 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K7001400210028003500Min: 2413.1 / Avg: 3822.43 / Max: 4945Min: 1443.7 / Avg: 2131.15 / Max: 2560.21. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 1MB Size, 16 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K60120180240300SE +/- 2.87, N = 724.00254.761. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 1MB Size, 16 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K50100150200250Min: 246.9 / Avg: 254.76 / Max: 270.41. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 64K Size, 16 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K6001200180024003000SE +/- 270.46, N = 15SE +/- 242.72, N = 122649.822028.121. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 64K Size, 16 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K5001000150020002500Min: 1149.9 / Avg: 2649.82 / Max: 3709.5Min: 1296 / Avg: 2028.12 / Max: 3872.21. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 128K Size, 16 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K6001200180024003000SE +/- 9.91, N = 3SE +/- 42.75, N = 15705.932970.061. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 128K Size, 16 ThreadsZFS RaidZ3 12TB 7EA recordsize 4KZFS RaidZ3 12TB 7EA recordsize 64K5001000150020002500Min: 686.4 / Avg: 705.93 / Max: 718.6Min: 2711.7 / Avg: 2970.06 / Max: 3241.61. (CC) gcc options: -static

ZFS RaidZ3 12TB 7EA recordsize 4K

Compiler Notes: --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic
Disk Notes: DEADLINE / attr2,inode64,noquota,relatime,rw
Processor Notes: Scaling Governor: intel_pstate powersave
Security Notes: l1tf: Mitigation of PTE Inversion + mds: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of Load fences __user pointer sanitization + spectre_v2: Mitigation of Full retpoline IBPB

Testing initiated at 4 July 2019 10:04 by user sds.

ZFS RaidZ3 12TB 7EA recordsize 64K

Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD, Disk: 7 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume, Graphics: Matrox MGA G200e [Pilot], Network: 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+

OS: CentOS Linux 7, Kernel: 3.10.0-957.21.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768

Compiler Notes: --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic
Disk Notes: DEADLINE / attr2,inode64,noquota,relatime,rw
Processor Notes: Scaling Governor: intel_pstate powersave
Security Notes: l1tf: Mitigation of PTE Inversion + mds: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of Load fences __user pointer sanitization + spectre_v2: Mitigation of Full retpoline IBPB

Testing initiated at 4 July 2019 13:03 by user sds.