201907011142-zfs-z3 2 x Intel Xeon E5-2620 v4 testing with a Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS) and Matrox MGA G200e [Pilot] on CentOS Linux 7 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/1907015-SDS-2019070116&grt&sor .
201907011142-zfs-z3 Processor Motherboard Chipset Memory Disk Graphics Network OS Kernel Compiler File-System Screen Resolution ZFS RaidZ3 12TB 5EA recordsize 128K ZFS RaidZ3 12TB 5EA recordsize 4K ZFS RaidZ3 12TB 5EA recordsize 64K ZFS RaidZ3 12TB 5EA recordsize 1M ZFS RaidZ3 12TB 7EA 128K ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 64K 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads) Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS) Intel Xeon E7 v4/Xeon 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD 11 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume Matrox MGA G200e [Pilot] 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ CentOS Linux 7 3.10.0-957.21.2.el7.x86_64 (x86_64) GCC 4.8.5 20150623 zfs 1024x768 OpenBenchmarking.org Compiler Details - --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic Disk Details - DEADLINE / attr2,inode64,noquota,relatime,rw Processor Details - Scaling Governor: intel_pstate powersave Security Details - l1tf: Mitigation of PTE Inversion + mds: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of Load fences __user pointer sanitization + spectre_v2: Mitigation of Full retpoline IBPB
201907011142-zfs-z3 iozone: 128Kb - 2GB - Write Performance iozone: 128Kb - 4GB - Write Performance iozone: 128Kb - 8GB - Write Performance iozone: 128Kb - 512MB - Write Performance iozone: 4Kb - 2GB - Write Performance iozone: 4Kb - 4GB - Write Performance iozone: 4Kb - 8GB - Write Performance iozone: 4Kb - 512MB - Write Performance iozone: 64Kb - 2GB - Write Performance iozone: 64Kb - 4GB - Write Performance iozone: 64Kb - 8GB - Write Performance iozone: 64Kb - 512MB - Write Performance iozone: 1MB - 2GB - Write Performance iozone: 1MB - 4GB - Write Performance iozone: 1MB - 8GB - Write Performance iozone: 1MB - 512MB - Write Performance ZFS RaidZ3 12TB 5EA recordsize 128K ZFS RaidZ3 12TB 5EA recordsize 4K ZFS RaidZ3 12TB 5EA recordsize 64K ZFS RaidZ3 12TB 5EA recordsize 1M ZFS RaidZ3 12TB 7EA 128K ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 64K 185 170 220 193 176 40.32 22.36 139 175 164 201 209 203.57 234.74 244.85 227.24 322 321 360 366 179 47.69 27.79 198 374 284 271 406 OpenBenchmarking.org
IOzone Record Size: 128Kb - File Size: 2GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 128Kb - File Size: 2GB - Disk Test: Write Performance ZFS RaidZ3 12TB 7EA 128K ZFS RaidZ3 12TB 5EA recordsize 128K 70 140 210 280 350 SE +/- 10.62, N = 15 SE +/- 4.44, N = 15 322 185 1. (CC) gcc options: -O3
IOzone Record Size: 128Kb - File Size: 4GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 128Kb - File Size: 4GB - Disk Test: Write Performance ZFS RaidZ3 12TB 7EA 128K ZFS RaidZ3 12TB 5EA recordsize 128K 70 140 210 280 350 SE +/- 11.59, N = 15 SE +/- 2.67, N = 3 321 170 1. (CC) gcc options: -O3
IOzone Record Size: 128Kb - File Size: 8GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 128Kb - File Size: 8GB - Disk Test: Write Performance ZFS RaidZ3 12TB 7EA 128K ZFS RaidZ3 12TB 5EA recordsize 128K 80 160 240 320 400 SE +/- 10.81, N = 15 SE +/- 1.81, N = 3 360 220 1. (CC) gcc options: -O3
IOzone Record Size: 128Kb - File Size: 512MB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 128Kb - File Size: 512MB - Disk Test: Write Performance ZFS RaidZ3 12TB 7EA 128K ZFS RaidZ3 12TB 5EA recordsize 128K 80 160 240 320 400 SE +/- 17.91, N = 15 SE +/- 2.23, N = 15 366 193 1. (CC) gcc options: -O3
IOzone Record Size: 4Kb - File Size: 2GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 4Kb - File Size: 2GB - Disk Test: Write Performance ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 5EA recordsize 4K 40 80 120 160 200 SE +/- 1.62, N = 3 SE +/- 9.55, N = 15 179 176 1. (CC) gcc options: -O3
IOzone Record Size: 4Kb - File Size: 4GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 4Kb - File Size: 4GB - Disk Test: Write Performance ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 5EA recordsize 4K 11 22 33 44 55 SE +/- 0.41, N = 3 SE +/- 0.35, N = 3 47.69 40.32 1. (CC) gcc options: -O3
IOzone Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 5EA recordsize 4K 7 14 21 28 35 SE +/- 0.06, N = 3 SE +/- 0.13, N = 3 27.79 22.36 1. (CC) gcc options: -O3
IOzone Record Size: 4Kb - File Size: 512MB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 4Kb - File Size: 512MB - Disk Test: Write Performance ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 5EA recordsize 4K 40 80 120 160 200 SE +/- 7.51, N = 14 SE +/- 6.21, N = 15 198 139 1. (CC) gcc options: -O3
IOzone Record Size: 64Kb - File Size: 2GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 64Kb - File Size: 2GB - Disk Test: Write Performance ZFS RaidZ3 12TB 7EA recordsize 64K ZFS RaidZ3 12TB 5EA recordsize 64K 80 160 240 320 400 SE +/- 16.46, N = 15 SE +/- 2.01, N = 3 374 175 1. (CC) gcc options: -O3
IOzone Record Size: 64Kb - File Size: 4GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 64Kb - File Size: 4GB - Disk Test: Write Performance ZFS RaidZ3 12TB 7EA recordsize 64K ZFS RaidZ3 12TB 5EA recordsize 64K 60 120 180 240 300 SE +/- 6.38, N = 15 SE +/- 2.71, N = 15 284 164 1. (CC) gcc options: -O3
IOzone Record Size: 64Kb - File Size: 8GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 64Kb - File Size: 8GB - Disk Test: Write Performance ZFS RaidZ3 12TB 7EA recordsize 64K ZFS RaidZ3 12TB 5EA recordsize 64K 60 120 180 240 300 SE +/- 2.93, N = 15 SE +/- 1.88, N = 15 271 201 1. (CC) gcc options: -O3
IOzone Record Size: 64Kb - File Size: 512MB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 64Kb - File Size: 512MB - Disk Test: Write Performance ZFS RaidZ3 12TB 7EA recordsize 64K ZFS RaidZ3 12TB 5EA recordsize 64K 90 180 270 360 450 SE +/- 18.12, N = 12 SE +/- 5.14, N = 15 406 209 1. (CC) gcc options: -O3
IOzone Record Size: 1MB - File Size: 2GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 1MB - File Size: 2GB - Disk Test: Write Performance ZFS RaidZ3 12TB 5EA recordsize 1M 40 80 120 160 200 SE +/- 2.78, N = 15 203.57 1. (CC) gcc options: -O3
IOzone Record Size: 1MB - File Size: 4GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 1MB - File Size: 4GB - Disk Test: Write Performance ZFS RaidZ3 12TB 5EA recordsize 1M 50 100 150 200 250 SE +/- 2.83, N = 3 234.74 1. (CC) gcc options: -O3
IOzone Record Size: 1MB - File Size: 8GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 1MB - File Size: 8GB - Disk Test: Write Performance ZFS RaidZ3 12TB 5EA recordsize 1M 50 100 150 200 250 SE +/- 2.71, N = 3 244.85 1. (CC) gcc options: -O3
IOzone Record Size: 1MB - File Size: 512MB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 1MB - File Size: 512MB - Disk Test: Write Performance ZFS RaidZ3 12TB 5EA recordsize 1M 50 100 150 200 250 SE +/- 3.16, N = 4 227.24 1. (CC) gcc options: -O3
Phoronix Test Suite v10.8.4