201907011142-zfs-z3 2 x Intel Xeon E5-2620 v4 testing with a Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS) and Matrox MGA G200e [Pilot] on CentOS Linux 7 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/1907012-SDS-2019070145 .
201907011142-zfs-z3 Processor Motherboard Chipset Memory Disk Graphics Network OS Kernel Compiler File-System Screen Resolution ZFS RaidZ3 12TB 5EA recordsize 128K ZFS RaidZ3 12TB 5EA recordsize 4K ZFS RaidZ3 12TB 5EA recordsize 64K ZFS RaidZ3 12TB 5EA recordsize 1M ZFS RaidZ3 12TB 7EA 128K ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 64K ZFS RaidZ3 12TB 7EA recordsize 1M ZFS RaidZ3 12TB 11EA recordsize 128K ZFS RaidZ3 12TB 11EA recordsize 4K ZFS RaidZ3 12TB 11EA recordsize 64K 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads) Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS) Intel Xeon E7 v4/Xeon 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD 11 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume Matrox MGA G200e [Pilot] 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ CentOS Linux 7 3.10.0-957.21.2.el7.x86_64 (x86_64) GCC 4.8.5 20150623 zfs 1024x768 OpenBenchmarking.org Compiler Details - --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic Disk Details - DEADLINE / attr2,inode64,noquota,relatime,rw Processor Details - Scaling Governor: intel_pstate powersave Security Details - l1tf: Mitigation of PTE Inversion + mds: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of Load fences __user pointer sanitization + spectre_v2: Mitigation of Full retpoline IBPB
201907011142-zfs-z3 iozone: 128Kb - 2GB - Write Performance iozone: 128Kb - 4GB - Write Performance iozone: 128Kb - 8GB - Write Performance iozone: 128Kb - 512MB - Write Performance iozone: 4Kb - 2GB - Write Performance iozone: 4Kb - 4GB - Write Performance iozone: 4Kb - 8GB - Write Performance iozone: 4Kb - 512MB - Write Performance iozone: 64Kb - 2GB - Write Performance iozone: 64Kb - 4GB - Write Performance iozone: 64Kb - 8GB - Write Performance iozone: 64Kb - 512MB - Write Performance iozone: 1MB - 2GB - Write Performance iozone: 1MB - 4GB - Write Performance iozone: 1MB - 8GB - Write Performance iozone: 1MB - 512MB - Write Performance ZFS RaidZ3 12TB 5EA recordsize 128K ZFS RaidZ3 12TB 5EA recordsize 4K ZFS RaidZ3 12TB 5EA recordsize 64K ZFS RaidZ3 12TB 5EA recordsize 1M ZFS RaidZ3 12TB 7EA 128K ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 64K ZFS RaidZ3 12TB 7EA recordsize 1M ZFS RaidZ3 12TB 11EA recordsize 128K ZFS RaidZ3 12TB 11EA recordsize 4K ZFS RaidZ3 12TB 11EA recordsize 64K 185 170 220 193 176 40.32 22.36 139 175 164 201 209 204 235 245 227 322 321 360 366 179 47.69 27.79 198 374 284 271 406 345 446 432 344 571 518 511 544 212 58.80 35.48 222 513 474 551 547 OpenBenchmarking.org
IOzone Record Size: 128Kb - File Size: 2GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 128Kb - File Size: 2GB - Disk Test: Write Performance ZFS RaidZ3 12TB 5EA recordsize 128K ZFS RaidZ3 12TB 7EA 128K ZFS RaidZ3 12TB 11EA recordsize 128K 120 240 360 480 600 SE +/- 4.44, N = 15 SE +/- 10.62, N = 15 SE +/- 8.54, N = 4 185 322 571 1. (CC) gcc options: -O3
IOzone Record Size: 128Kb - File Size: 4GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 128Kb - File Size: 4GB - Disk Test: Write Performance ZFS RaidZ3 12TB 5EA recordsize 128K ZFS RaidZ3 12TB 7EA 128K ZFS RaidZ3 12TB 11EA recordsize 128K 110 220 330 440 550 SE +/- 2.67, N = 3 SE +/- 11.59, N = 15 SE +/- 4.93, N = 15 170 321 518 1. (CC) gcc options: -O3
IOzone Record Size: 128Kb - File Size: 8GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 128Kb - File Size: 8GB - Disk Test: Write Performance ZFS RaidZ3 12TB 5EA recordsize 128K ZFS RaidZ3 12TB 7EA 128K ZFS RaidZ3 12TB 11EA recordsize 128K 110 220 330 440 550 SE +/- 1.81, N = 3 SE +/- 10.81, N = 15 SE +/- 5.48, N = 3 220 360 511 1. (CC) gcc options: -O3
IOzone Record Size: 128Kb - File Size: 512MB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 128Kb - File Size: 512MB - Disk Test: Write Performance ZFS RaidZ3 12TB 5EA recordsize 128K ZFS RaidZ3 12TB 7EA 128K ZFS RaidZ3 12TB 11EA recordsize 128K 120 240 360 480 600 SE +/- 2.23, N = 15 SE +/- 17.91, N = 15 SE +/- 53.82, N = 12 193 366 544 1. (CC) gcc options: -O3
IOzone Record Size: 4Kb - File Size: 2GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 4Kb - File Size: 2GB - Disk Test: Write Performance ZFS RaidZ3 12TB 5EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 11EA recordsize 4K 50 100 150 200 250 SE +/- 9.55, N = 15 SE +/- 1.62, N = 3 SE +/- 1.10, N = 3 176 179 212 1. (CC) gcc options: -O3
IOzone Record Size: 4Kb - File Size: 4GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 4Kb - File Size: 4GB - Disk Test: Write Performance ZFS RaidZ3 12TB 5EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 11EA recordsize 4K 13 26 39 52 65 SE +/- 0.35, N = 3 SE +/- 0.41, N = 3 SE +/- 0.38, N = 3 40.32 47.69 58.80 1. (CC) gcc options: -O3
IOzone Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance ZFS RaidZ3 12TB 5EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 11EA recordsize 4K 8 16 24 32 40 SE +/- 0.13, N = 3 SE +/- 0.06, N = 3 SE +/- 0.28, N = 3 22.36 27.79 35.48 1. (CC) gcc options: -O3
IOzone Record Size: 4Kb - File Size: 512MB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 4Kb - File Size: 512MB - Disk Test: Write Performance ZFS RaidZ3 12TB 5EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 11EA recordsize 4K 50 100 150 200 250 SE +/- 6.21, N = 15 SE +/- 7.51, N = 14 SE +/- 7.25, N = 12 139 198 222 1. (CC) gcc options: -O3
IOzone Record Size: 64Kb - File Size: 2GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 64Kb - File Size: 2GB - Disk Test: Write Performance ZFS RaidZ3 12TB 5EA recordsize 64K ZFS RaidZ3 12TB 7EA recordsize 64K ZFS RaidZ3 12TB 11EA recordsize 64K 110 220 330 440 550 SE +/- 2.01, N = 3 SE +/- 16.46, N = 15 SE +/- 2.91, N = 3 175 374 513 1. (CC) gcc options: -O3
IOzone Record Size: 64Kb - File Size: 4GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 64Kb - File Size: 4GB - Disk Test: Write Performance ZFS RaidZ3 12TB 5EA recordsize 64K ZFS RaidZ3 12TB 7EA recordsize 64K ZFS RaidZ3 12TB 11EA recordsize 64K 100 200 300 400 500 SE +/- 2.71, N = 15 SE +/- 6.38, N = 15 SE +/- 7.47, N = 15 164 284 474 1. (CC) gcc options: -O3
IOzone Record Size: 64Kb - File Size: 8GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 64Kb - File Size: 8GB - Disk Test: Write Performance ZFS RaidZ3 12TB 5EA recordsize 64K ZFS RaidZ3 12TB 7EA recordsize 64K ZFS RaidZ3 12TB 11EA recordsize 64K 120 240 360 480 600 SE +/- 1.88, N = 15 SE +/- 2.93, N = 15 SE +/- 6.86, N = 5 201 271 551 1. (CC) gcc options: -O3
IOzone Record Size: 64Kb - File Size: 512MB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 64Kb - File Size: 512MB - Disk Test: Write Performance ZFS RaidZ3 12TB 5EA recordsize 64K ZFS RaidZ3 12TB 7EA recordsize 64K ZFS RaidZ3 12TB 11EA recordsize 64K 120 240 360 480 600 SE +/- 5.14, N = 15 SE +/- 18.12, N = 12 SE +/- 22.39, N = 15 209 406 547 1. (CC) gcc options: -O3
IOzone Record Size: 1MB - File Size: 2GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 1MB - File Size: 2GB - Disk Test: Write Performance ZFS RaidZ3 12TB 5EA recordsize 1M ZFS RaidZ3 12TB 7EA recordsize 1M 70 140 210 280 350 SE +/- 2.78, N = 15 SE +/- 3.08, N = 3 204 345 1. (CC) gcc options: -O3
IOzone Record Size: 1MB - File Size: 4GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 1MB - File Size: 4GB - Disk Test: Write Performance ZFS RaidZ3 12TB 5EA recordsize 1M ZFS RaidZ3 12TB 7EA recordsize 1M 100 200 300 400 500 SE +/- 2.83, N = 3 SE +/- 5.98, N = 3 235 446 1. (CC) gcc options: -O3
IOzone Record Size: 1MB - File Size: 8GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 1MB - File Size: 8GB - Disk Test: Write Performance ZFS RaidZ3 12TB 5EA recordsize 1M ZFS RaidZ3 12TB 7EA recordsize 1M 90 180 270 360 450 SE +/- 2.71, N = 3 SE +/- 10.98, N = 15 245 432 1. (CC) gcc options: -O3
IOzone Record Size: 1MB - File Size: 512MB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 1MB - File Size: 512MB - Disk Test: Write Performance ZFS RaidZ3 12TB 5EA recordsize 1M ZFS RaidZ3 12TB 7EA recordsize 1M 70 140 210 280 350 SE +/- 3.16, N = 4 SE +/- 3.13, N = 15 227 344 1. (CC) gcc options: -O3
Phoronix Test Suite v10.8.4