201907041004 2 x Intel Xeon E5-2620 v4 testing with a Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS) and Matrox MGA G200e [Pilot] on CentOS Linux 7 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/1907040-SDS-2019070462 .
201907041004 Processor Motherboard Chipset Memory Disk Graphics Network OS Kernel Compiler File-System Screen Resolution ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 64K 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads) Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS) Intel Xeon E7 v4/Xeon 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD 7 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume Matrox MGA G200e [Pilot] 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ CentOS Linux 7 3.10.0-957.21.2.el7.x86_64 (x86_64) GCC 4.8.5 20150623 zfs 1024x768 OpenBenchmarking.org Compiler Details - --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic Disk Details - DEADLINE / attr2,inode64,noquota,relatime,rw Processor Details - Scaling Governor: intel_pstate powersave Security Details - l1tf: Mitigation of PTE Inversion + mds: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of Load fences __user pointer sanitization + spectre_v2: Mitigation of Full retpoline IBPB
201907041004 fs-mark: 1000 Files, 4K Size fs-mark: 1000 Files, 1MB Size fs-mark: 1000 Files, 64K Size fs-mark: 1000 Files, 128K Size fs-mark: 1000 Files, 4K Size, 4 Threads fs-mark: 1000 Files, 1MB Size, 4 Threads fs-mark: 1000 Files, 4K Size, 16 Threads fs-mark: 1000 Files, 64K Size, 4 Threads fs-mark: 1000 Files, 128K Size, 4 Threads fs-mark: 1000 Files, 1MB Size, 16 Threads fs-mark: 1000 Files, 64K Size, 16 Threads fs-mark: 1000 Files, 128K Size, 16 Threads fs-mark: No FSYNC/SYNC 1000 Files, 4K Size fs-mark: No FSYNC/SYNC 1000 Files, 1MB Size fs-mark: No FSYNC/SYNC 1000 Files, 64K Size fs-mark: No FSYNC/SYNC 1000 Files, 128K Size fs-mark: No FSYNC/SYNC 1000 Files, 4K Size, 4 Threads fs-mark: No FSYNC/SYNC 1000 Files, 1MB Size, 4 Threads fs-mark: No FSYNC/SYNC 1000 Files, 4K Size, 16 Threads fs-mark: No FSYNC/SYNC 1000 Files, 64K Size, 4 Threads fs-mark: No FSYNC/SYNC 1000 Files, 128K Size, 4 Threads fs-mark: No FSYNC/SYNC 1000 Files, 1MB Size, 16 Threads fs-mark: No FSYNC/SYNC 1000 Files, 64K Size, 16 Threads fs-mark: No FSYNC/SYNC 1000 Files, 128K Size, 16 Threads ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 64K 105.40 18.80 72.75 43.57 180.48 29.33 451.25 93.30 73.97 24 144.17 109.83 3576.94 370.20 1407.66 881.30 2815.17 56.43 2943.67 2947.66 3822.43 24 2649.82 705.93 81.03 34.83 84.30 68.07 154.55 42.47 456.91 124.27 102.87 60.07 270.83 143.00 2762.98 233.85 2940.64 736.93 3071.13 489.49 2926.07 2443.91 2131.15 254.76 2028.12 2970.06 OpenBenchmarking.org
FS-Mark Test: 1000 Files, 4K Size OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 1000 Files, 4K Size ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 64K 20 40 60 80 100 SE +/- 0.57, N = 3 SE +/- 1.22, N = 3 105.40 81.03 1. (CC) gcc options: -static
FS-Mark Test: 1000 Files, 1MB Size OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 1000 Files, 1MB Size ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 64K 8 16 24 32 40 SE +/- 0.15, N = 3 SE +/- 0.52, N = 3 18.80 34.83 1. (CC) gcc options: -static
FS-Mark Test: 1000 Files, 64K Size OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 1000 Files, 64K Size ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 64K 20 40 60 80 100 SE +/- 0.89, N = 15 SE +/- 1.17, N = 3 72.75 84.30 1. (CC) gcc options: -static
FS-Mark Test: 1000 Files, 128K Size OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 1000 Files, 128K Size ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 64K 15 30 45 60 75 SE +/- 0.09, N = 3 SE +/- 1.11, N = 3 43.57 68.07 1. (CC) gcc options: -static
FS-Mark Test: 1000 Files, 4K Size, 4 Threads OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 1000 Files, 4K Size, 4 Threads ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 64K 40 80 120 160 200 SE +/- 2.18, N = 6 SE +/- 2.95, N = 12 180.48 154.55 1. (CC) gcc options: -static
FS-Mark Test: 1000 Files, 1MB Size, 4 Threads OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 1000 Files, 1MB Size, 4 Threads ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 64K 10 20 30 40 50 SE +/- 0.13, N = 3 SE +/- 0.29, N = 3 29.33 42.47 1. (CC) gcc options: -static
FS-Mark Test: 1000 Files, 4K Size, 16 Threads OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 1000 Files, 4K Size, 16 Threads ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 64K 100 200 300 400 500 SE +/- 9.74, N = 15 SE +/- 10.98, N = 15 451.25 456.91 1. (CC) gcc options: -static
FS-Mark Test: 1000 Files, 64K Size, 4 Threads OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 1000 Files, 64K Size, 4 Threads ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 64K 30 60 90 120 150 SE +/- 0.46, N = 3 SE +/- 1.02, N = 3 93.30 124.27 1. (CC) gcc options: -static
FS-Mark Test: 1000 Files, 128K Size, 4 Threads OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 1000 Files, 128K Size, 4 Threads ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 64K 20 40 60 80 100 SE +/- 0.78, N = 3 SE +/- 1.21, N = 3 73.97 102.87 1. (CC) gcc options: -static
FS-Mark Test: 1000 Files, 1MB Size, 16 Threads OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 1000 Files, 1MB Size, 16 Threads ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 64K 13 26 39 52 65 SE +/- 0.47, N = 3 24.00 60.07 1. (CC) gcc options: -static
FS-Mark Test: 1000 Files, 64K Size, 16 Threads OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 1000 Files, 64K Size, 16 Threads ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 64K 60 120 180 240 300 SE +/- 0.44, N = 3 SE +/- 1.10, N = 3 144.17 270.83 1. (CC) gcc options: -static
FS-Mark Test: 1000 Files, 128K Size, 16 Threads OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 1000 Files, 128K Size, 16 Threads ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 64K 30 60 90 120 150 SE +/- 1.27, N = 3 SE +/- 0.83, N = 3 109.83 143.00 1. (CC) gcc options: -static
FS-Mark Test: No FSYNC/SYNC 1000 Files, 4K Size OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: No FSYNC/SYNC 1000 Files, 4K Size ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 64K 800 1600 2400 3200 4000 SE +/- 228.40, N = 12 SE +/- 279.08, N = 15 3576.94 2762.98 1. (CC) gcc options: -static
FS-Mark Test: No FSYNC/SYNC 1000 Files, 1MB Size OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: No FSYNC/SYNC 1000 Files, 1MB Size ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 64K 80 160 240 320 400 SE +/- 5.25, N = 3 SE +/- 30.17, N = 15 370.20 233.85 1. (CC) gcc options: -static
FS-Mark Test: No FSYNC/SYNC 1000 Files, 64K Size OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: No FSYNC/SYNC 1000 Files, 64K Size ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 64K 600 1200 1800 2400 3000 SE +/- 228.39, N = 12 SE +/- 215.76, N = 15 1407.66 2940.64 1. (CC) gcc options: -static
FS-Mark Test: No FSYNC/SYNC 1000 Files, 128K Size OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: No FSYNC/SYNC 1000 Files, 128K Size ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 64K 200 400 600 800 1000 SE +/- 61.40, N = 12 SE +/- 17.19, N = 15 881.30 736.93 1. (CC) gcc options: -static
FS-Mark Test: No FSYNC/SYNC 1000 Files, 4K Size, 4 Threads OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: No FSYNC/SYNC 1000 Files, 4K Size, 4 Threads ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 64K 700 1400 2100 2800 3500 SE +/- 88.55, N = 12 SE +/- 108.66, N = 15 2815.17 3071.13 1. (CC) gcc options: -static
FS-Mark Test: No FSYNC/SYNC 1000 Files, 1MB Size, 4 Threads OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: No FSYNC/SYNC 1000 Files, 1MB Size, 4 Threads ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 64K 110 220 330 440 550 SE +/- 0.15, N = 3 SE +/- 7.94, N = 15 56.43 489.49 1. (CC) gcc options: -static
FS-Mark Test: No FSYNC/SYNC 1000 Files, 4K Size, 16 Threads OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: No FSYNC/SYNC 1000 Files, 4K Size, 16 Threads ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 64K 600 1200 1800 2400 3000 SE +/- 36.75, N = 3 SE +/- 90.05, N = 12 2943.67 2926.07 1. (CC) gcc options: -static
FS-Mark Test: No FSYNC/SYNC 1000 Files, 64K Size, 4 Threads OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: No FSYNC/SYNC 1000 Files, 64K Size, 4 Threads ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 64K 600 1200 1800 2400 3000 SE +/- 187.26, N = 15 SE +/- 223.64, N = 15 2947.66 2443.91 1. (CC) gcc options: -static
FS-Mark Test: No FSYNC/SYNC 1000 Files, 128K Size, 4 Threads OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: No FSYNC/SYNC 1000 Files, 128K Size, 4 Threads ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 64K 800 1600 2400 3200 4000 SE +/- 245.26, N = 15 SE +/- 87.98, N = 15 3822.43 2131.15 1. (CC) gcc options: -static
FS-Mark Test: No FSYNC/SYNC 1000 Files, 1MB Size, 16 Threads OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: No FSYNC/SYNC 1000 Files, 1MB Size, 16 Threads ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 64K 60 120 180 240 300 SE +/- 2.87, N = 7 24.00 254.76 1. (CC) gcc options: -static
FS-Mark Test: No FSYNC/SYNC 1000 Files, 64K Size, 16 Threads OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: No FSYNC/SYNC 1000 Files, 64K Size, 16 Threads ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 64K 600 1200 1800 2400 3000 SE +/- 270.46, N = 15 SE +/- 242.72, N = 12 2649.82 2028.12 1. (CC) gcc options: -static
FS-Mark Test: No FSYNC/SYNC 1000 Files, 128K Size, 16 Threads OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: No FSYNC/SYNC 1000 Files, 128K Size, 16 Threads ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 64K 600 1200 1800 2400 3000 SE +/- 9.91, N = 3 SE +/- 42.75, N = 15 705.93 2970.06 1. (CC) gcc options: -static
Phoronix Test Suite v10.8.4