201907040914

2 x Intel Xeon E5-2620 v4 testing with a Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS) and Matrox MGA G200e [Pilot] on CentOS Linux 7 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1907044-SDS-2019070459
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
ZFS RaidZ3 12TB 5EA recordsize 4K
July 04 2019
  2 Hours, 56 Minutes
ZFS RaidZ3 12TB 5EA recordsize 64K
July 04 2019
  1 Hour, 18 Minutes
ZFS RaidZ3 12TB 5EA recordsize 128K
July 04 2019
  1 Hour, 2 Minutes
ZFS RaidZ3 12TB 5EA recordsize 1M
July 04 2019
  1 Hour, 4 Minutes
Invert Hiding All Results Option
  1 Hour, 35 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


201907040914OpenBenchmarking.orgPhoronix Test Suite2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads)Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS)Intel Xeon E7 v4/Xeon4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD7 x 12000GB Seagate ST12000NM0027 + 239GB Logical VolumeMatrox MGA G200e [Pilot]2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+CentOS Linux 73.10.0-957.21.2.el7.x86_64 (x86_64)GCC 4.8.5 20150623zfs1024x768ProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen Resolution201907040914 BenchmarksSystem Logs- --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic - DEADLINE / attr2,inode64,noquota,relatime,rw- Scaling Governor: intel_pstate powersave- l1tf: Mitigation of PTE Inversion + mds: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of Load fences __user pointer sanitization + spectre_v2: Mitigation of Full retpoline IBPB

ZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1MLogarithmic Result OverviewPhoronix Test SuiteFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkFS-MarkN.F.S.1.F.6.S.1.T1.F.1.S.1.TN.F.S.1.F.1.S.1.TN.F.S.1.F.1.S.1.TN.F.S.1.F.1.S1.F.6.S.1.TN.F.S.1.F.1.S.4.TN.F.S.1.F.1.S.4.TN.F.S.1.F.1.S1.F.6.S.4.TN.F.S.1.F.6.SN.F.S.1.F.6.S.4.T1.F.1.S.4.T1.F.1.S.1.T1.F.1.S1.F.4.S1.F.6.S1.F.1.S.4.T1.F.1.SN.F.S.1.F.4.S.1.T1.F.4.S.4.TN.F.S.1.F.4.S.4.T1.F.4.S.1.TN.F.S.1.F.4.S

201907040914fs-mark: 1000 Files, 4K Sizefs-mark: 1000 Files, 1MB Sizefs-mark: 1000 Files, 64K Sizefs-mark: 1000 Files, 128K Sizefs-mark: 1000 Files, 4K Size, 4 Threadsfs-mark: 1000 Files, 1MB Size, 4 Threadsfs-mark: 1000 Files, 4K Size, 16 Threadsfs-mark: 1000 Files, 64K Size, 4 Threadsfs-mark: 1000 Files, 128K Size, 4 Threadsfs-mark: 1000 Files, 1MB Size, 16 Threadsfs-mark: 1000 Files, 64K Size, 16 Threadsfs-mark: 1000 Files, 128K Size, 16 Threadsfs-mark: No FSYNC/SYNC 1000 Files, 4K Sizefs-mark: No FSYNC/SYNC 1000 Files, 1MB Sizefs-mark: No FSYNC/SYNC 1000 Files, 64K Sizefs-mark: No FSYNC/SYNC 1000 Files, 128K Sizefs-mark: No FSYNC/SYNC 1000 Files, 4K Size, 4 Threadsfs-mark: No FSYNC/SYNC 1000 Files, 1MB Size, 4 Threadsfs-mark: No FSYNC/SYNC 1000 Files, 4K Size, 16 Threadsfs-mark: No FSYNC/SYNC 1000 Files, 64K Size, 4 Threadsfs-mark: No FSYNC/SYNC 1000 Files, 128K Size, 4 Threadsfs-mark: No FSYNC/SYNC 1000 Files, 1MB Size, 16 Threadsfs-mark: No FSYNC/SYNC 1000 Files, 64K Size, 16 Threadsfs-mark: No FSYNC/SYNC 1000 Files, 128K Size, 16 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M107.6021.3070.8742.77187.1230.93651.3377.3560.9420.80161.07154.6713944.20463.304277.352602.7324305.1548.1333053.2111076.936628.4319.203037.31762.3888.8327.4795.3846.23177.0331.73678.57125.6579.2058.67365.70165.3313904.77630.516854.434633.8024856.04381.2731516.0016767.5113145.90161.1617673.232485.0791.4030.3390.9748.14192.0732.27671.90133.5087.6059.73345.81218.1313913.37756.516665.204019.2724067.11446.6529694.1816580.8711385.90207.2317888.7314991.8779.3328.2389.8348.47181.3540.83662.63121.5388.2762.93332.93220.8313895.40255.076550.073810.1423683.08621.3731703.6316733.7311175.33446.7717209.8315440.53OpenBenchmarking.org

FS-Mark

FS_Mark is designed to test a system's file-system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 4K SizeZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M20406080100SE +/- 0.36, N = 3SE +/- 0.66, N = 3SE +/- 1.04, N = 3SE +/- 0.52, N = 3107.6088.8391.4079.331. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 4K SizeZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M20406080100Min: 107.1 / Avg: 107.6 / Max: 108.3Min: 87.7 / Avg: 88.83 / Max: 90Min: 89.4 / Avg: 91.4 / Max: 92.9Min: 78.4 / Avg: 79.33 / Max: 80.21. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M714212835SE +/- 0.36, N = 3SE +/- 0.54, N = 3SE +/- 0.17, N = 3SE +/- 0.27, N = 321.3027.4730.3328.231. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M714212835Min: 20.8 / Avg: 21.3 / Max: 22Min: 26.4 / Avg: 27.47 / Max: 28.1Min: 30 / Avg: 30.33 / Max: 30.5Min: 27.7 / Avg: 28.23 / Max: 28.61. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 64K SizeZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M20406080100SE +/- 0.76, N = 15SE +/- 0.99, N = 13SE +/- 1.07, N = 3SE +/- 1.21, N = 1570.8795.3890.9789.831. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 64K SizeZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M20406080100Min: 64.8 / Avg: 70.87 / Max: 75.4Min: 85.6 / Avg: 95.38 / Max: 100.3Min: 89.7 / Avg: 90.97 / Max: 93.1Min: 81.7 / Avg: 89.83 / Max: 97.21. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 128K SizeZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M1122334455SE +/- 0.52, N = 3SE +/- 0.92, N = 3SE +/- 0.66, N = 5SE +/- 0.24, N = 342.7746.2348.1448.471. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 128K SizeZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M1020304050Min: 41.9 / Avg: 42.77 / Max: 43.7Min: 44.6 / Avg: 46.23 / Max: 47.8Min: 45.9 / Avg: 48.14 / Max: 49.6Min: 48 / Avg: 48.47 / Max: 48.81. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 4K Size, 4 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M4080120160200SE +/- 3.99, N = 15SE +/- 3.13, N = 12SE +/- 2.45, N = 3SE +/- 3.13, N = 15187.12177.03192.07181.351. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 4K Size, 4 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M4080120160200Min: 152.8 / Avg: 187.12 / Max: 202.8Min: 152.4 / Avg: 177.03 / Max: 190.4Min: 188.6 / Avg: 192.07 / Max: 196.8Min: 161.6 / Avg: 181.35 / Max: 197.91. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size, 4 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M918273645SE +/- 0.51, N = 4SE +/- 0.27, N = 3SE +/- 0.35, N = 3SE +/- 0.60, N = 430.9331.7332.2740.831. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size, 4 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M816243240Min: 30.1 / Avg: 30.93 / Max: 32.4Min: 31.2 / Avg: 31.73 / Max: 32Min: 31.6 / Avg: 32.27 / Max: 32.8Min: 39.3 / Avg: 40.83 / Max: 421. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 4K Size, 16 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M150300450600750SE +/- 5.56, N = 3SE +/- 10.10, N = 3SE +/- 0.10, N = 3SE +/- 8.15, N = 3651.33678.57671.90662.631. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 4K Size, 16 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M120240360480600Min: 644.8 / Avg: 651.33 / Max: 662.4Min: 659.2 / Avg: 678.57 / Max: 693.2Min: 671.7 / Avg: 671.9 / Max: 672Min: 646.8 / Avg: 662.63 / Max: 673.91. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 64K Size, 4 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M306090120150SE +/- 1.34, N = 4SE +/- 1.32, N = 15SE +/- 0.55, N = 3SE +/- 3.06, N = 1277.35125.65133.50121.531. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 64K Size, 4 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M306090120150Min: 74 / Avg: 77.35 / Max: 80.1Min: 115.6 / Avg: 125.65 / Max: 132.1Min: 132.5 / Avg: 133.5 / Max: 134.4Min: 105.4 / Avg: 121.53 / Max: 132.81. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 128K Size, 4 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M20406080100SE +/- 0.95, N = 5SE +/- 0.23, N = 3SE +/- 0.40, N = 3SE +/- 1.16, N = 360.9479.2087.6088.271. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 128K Size, 4 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M20406080100Min: 57.2 / Avg: 60.94 / Max: 62.4Min: 78.8 / Avg: 79.2 / Max: 79.6Min: 86.8 / Avg: 87.6 / Max: 88Min: 86.4 / Avg: 88.27 / Max: 90.41. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size, 16 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M1428425670SE +/- 0.00, N = 3SE +/- 1.07, N = 3SE +/- 1.07, N = 3SE +/- 0.53, N = 320.8058.6759.7362.931. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size, 16 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M1224364860Min: 20.8 / Avg: 20.8 / Max: 20.8Min: 57.6 / Avg: 58.67 / Max: 60.8Min: 57.6 / Avg: 59.73 / Max: 60.8Min: 62.4 / Avg: 62.93 / Max: 641. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 64K Size, 16 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M80160240320400SE +/- 2.32, N = 3SE +/- 6.01, N = 3SE +/- 5.90, N = 15SE +/- 4.46, N = 15161.07365.70345.81332.931. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 64K Size, 16 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M70140210280350Min: 156.8 / Avg: 161.07 / Max: 164.8Min: 355.2 / Avg: 365.7 / Max: 376Min: 297.6 / Avg: 345.81 / Max: 379.2Min: 300.8 / Avg: 332.93 / Max: 356.81. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 128K Size, 16 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M50100150200250SE +/- 0.53, N = 3SE +/- 2.97, N = 3SE +/- 1.41, N = 3SE +/- 2.41, N = 3154.67165.33218.13220.831. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 128K Size, 16 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M4080120160200Min: 153.6 / Avg: 154.67 / Max: 155.2Min: 161.6 / Avg: 165.33 / Max: 171.2Min: 216 / Avg: 218.13 / Max: 220.8Min: 216.1 / Avg: 220.83 / Max: 2241. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 4K SizeZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M3K6K9K12K15KSE +/- 71.66, N = 3SE +/- 98.92, N = 3SE +/- 121.96, N = 3SE +/- 129.86, N = 313944.2013904.7713913.3713895.401. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 4K SizeZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M2K4K6K8K10KMin: 13803.2 / Avg: 13944.2 / Max: 14036.9Min: 13770.7 / Avg: 13904.77 / Max: 14097.8Min: 13734.2 / Avg: 13913.37 / Max: 14146.3Min: 13635.9 / Avg: 13895.4 / Max: 14034.51. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 1MB SizeZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M160320480640800SE +/- 7.80, N = 3SE +/- 15.01, N = 14SE +/- 19.79, N = 15SE +/- 4.01, N = 3463.30630.51756.51255.071. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 1MB SizeZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M130260390520650Min: 448 / Avg: 463.3 / Max: 473.6Min: 525.3 / Avg: 630.51 / Max: 698.3Min: 643.2 / Avg: 756.51 / Max: 933.7Min: 248.9 / Avg: 255.07 / Max: 262.61. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 64K SizeZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M15003000450060007500SE +/- 64.82, N = 15SE +/- 64.76, N = 3SE +/- 127.24, N = 3SE +/- 115.23, N = 34277.356854.436665.206550.071. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 64K SizeZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M12002400360048006000Min: 3858.5 / Avg: 4277.35 / Max: 4659.7Min: 6729 / Avg: 6854.43 / Max: 6945.1Min: 6526.1 / Avg: 6665.2 / Max: 6919.3Min: 6387.2 / Avg: 6550.07 / Max: 6772.71. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 128K SizeZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M10002000300040005000SE +/- 42.69, N = 3SE +/- 58.71, N = 7SE +/- 19.39, N = 3SE +/- 114.13, N = 152602.734633.804019.273810.141. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 128K SizeZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M8001600240032004000Min: 2546.5 / Avg: 2602.73 / Max: 2686.5Min: 4441.7 / Avg: 4633.8 / Max: 4846.5Min: 3982 / Avg: 4019.27 / Max: 4047.2Min: 2582.6 / Avg: 3810.14 / Max: 4063.41. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 4K Size, 4 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M5K10K15K20K25KSE +/- 635.61, N = 12SE +/- 806.46, N = 12SE +/- 869.76, N = 15SE +/- 982.42, N = 1224305.1524856.0424067.1123683.081. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 4K Size, 4 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M4K8K12K16K20KMin: 21235.7 / Avg: 24305.15 / Max: 29269.5Min: 19501 / Avg: 24856.04 / Max: 29295.1Min: 18865.5 / Avg: 24067.11 / Max: 28867.8Min: 18630.4 / Avg: 23683.08 / Max: 29850.71. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 1MB Size, 4 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M130260390520650SE +/- 0.32, N = 3SE +/- 4.42, N = 3SE +/- 17.23, N = 12SE +/- 12.39, N = 348.13381.27446.65621.371. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 1MB Size, 4 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M110220330440550Min: 47.5 / Avg: 48.13 / Max: 48.5Min: 376.5 / Avg: 381.27 / Max: 390.1Min: 406.2 / Avg: 446.65 / Max: 564.2Min: 600.2 / Avg: 621.37 / Max: 643.11. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 4K Size, 16 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M7K14K21K28K35KSE +/- 1915.99, N = 12SE +/- 1170.52, N = 15SE +/- 1292.84, N = 15SE +/- 1207.97, N = 1533053.2131516.0029694.1831703.631. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 4K Size, 16 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M6K12K18K24K30KMin: 25852.7 / Avg: 33053.21 / Max: 45385Min: 23485.4 / Avg: 31516 / Max: 39750.1Min: 22120.6 / Avg: 29694.18 / Max: 39998.1Min: 24099.4 / Avg: 31703.63 / Max: 39512.41. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 64K Size, 4 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M4K8K12K16K20KSE +/- 152.87, N = 6SE +/- 181.65, N = 15SE +/- 206.08, N = 3SE +/- 34.03, N = 311076.9316767.5116580.8716733.731. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 64K Size, 4 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M3K6K9K12K15KMin: 10623.7 / Avg: 11076.93 / Max: 11526.6Min: 15916.5 / Avg: 16767.51 / Max: 18008.9Min: 16248.9 / Avg: 16580.87 / Max: 16958.4Min: 16673.6 / Avg: 16733.73 / Max: 16791.41. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 128K Size, 4 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M3K6K9K12K15KSE +/- 94.05, N = 15SE +/- 177.47, N = 3SE +/- 179.91, N = 3SE +/- 122.26, N = 36628.4313145.9011385.9011175.331. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 128K Size, 4 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M2K4K6K8K10KMin: 5757.9 / Avg: 6628.43 / Max: 7220.1Min: 12938.1 / Avg: 13145.9 / Max: 13499Min: 11121.8 / Avg: 11385.9 / Max: 11729.6Min: 11049.1 / Avg: 11175.33 / Max: 11419.81. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 1MB Size, 16 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M100200300400500SE +/- 0.00, N = 3SE +/- 2.34, N = 12SE +/- 2.91, N = 6SE +/- 7.65, N = 319.20161.16207.23446.771. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 1MB Size, 16 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M80160240320400Min: 19.2 / Avg: 19.2 / Max: 19.2Min: 151.9 / Avg: 161.16 / Max: 179.3Min: 199 / Avg: 207.23 / Max: 217.7Min: 434.2 / Avg: 446.77 / Max: 460.61. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 64K Size, 16 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M4K8K12K16K20KSE +/- 415.58, N = 15SE +/- 444.17, N = 12SE +/- 332.33, N = 3SE +/- 221.43, N = 33037.3117673.2317888.7317209.831. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 64K Size, 16 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M3K6K9K12K15KMin: 1293.5 / Avg: 3037.31 / Max: 5475Min: 16004.1 / Avg: 17673.23 / Max: 21516.5Min: 17530.6 / Avg: 17888.73 / Max: 18552.7Min: 16816.8 / Avg: 17209.83 / Max: 17583.11. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 128K Size, 16 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M3K6K9K12K15KSE +/- 11.42, N = 15SE +/- 47.87, N = 3SE +/- 196.72, N = 6SE +/- 166.77, N = 15762.382485.0714991.8715440.531. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: No FSYNC/SYNC 1000 Files, 128K Size, 16 ThreadsZFS RaidZ3 12TB 5EA recordsize 4KZFS RaidZ3 12TB 5EA recordsize 64KZFS RaidZ3 12TB 5EA recordsize 128KZFS RaidZ3 12TB 5EA recordsize 1M3K6K9K12K15KMin: 654.7 / Avg: 762.38 / Max: 819.4Min: 2391.5 / Avg: 2485.07 / Max: 2549.4Min: 14458.2 / Avg: 14991.87 / Max: 15762.9Min: 14998 / Avg: 15440.53 / Max: 17130.61. (CC) gcc options: -static