201907011142-zfs-z3 2 x Intel Xeon E5-2620 v4 testing with a Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS) and Matrox MGA G200e [Pilot] on CentOS Linux 7 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/1907016-SDS-2019070138&sor&grs .
201907011142-zfs-z3 Processor Motherboard Chipset Memory Disk Graphics Network OS Kernel Compiler File-System Screen Resolution ZFS RaidZ3 12TB 5EA recordsize 128K ZFS RaidZ3 12TB 5EA recordsize 4K ZFS RaidZ3 12TB 5EA recordsize 64K ZFS RaidZ3 12TB 5EA recordsize 1M ZFS RaidZ3 12TB 7EA 128K ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 64K ZFS RaidZ3 12TB 7EA recordsize 1M ZFS RaidZ3 12TB 11EA recordsize 128K ZFS RaidZ3 12TB 11EA recordsize 4K ZFS RaidZ3 12TB 11EA recordsize 64K ZFS RaidZ3 12TB 11EA recordsize 1M 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads) Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS) Intel Xeon E7 v4/Xeon 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD 11 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume Matrox MGA G200e [Pilot] 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ CentOS Linux 7 3.10.0-957.21.2.el7.x86_64 (x86_64) GCC 4.8.5 20150623 zfs 1024x768 OpenBenchmarking.org Compiler Details - --build=x86_64-redhat-linux --disable-libgcj --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-linker-hash-style=gnu --with-tune=generic Disk Details - DEADLINE / attr2,inode64,noquota,relatime,rw Processor Details - Scaling Governor: intel_pstate powersave Security Details - l1tf: Mitigation of PTE Inversion + mds: Vulnerable: Clear buffers attempted no microcode; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Vulnerable + spectre_v1: Mitigation of Load fences __user pointer sanitization + spectre_v2: Mitigation of Full retpoline IBPB
201907011142-zfs-z3 iozone: 1MB - 2GB - Write Performance iozone: 64Kb - 8GB - Write Performance iozone: 1MB - 512MB - Write Performance iozone: 4Kb - 8GB - Write Performance iozone: 4Kb - 4GB - Write Performance iozone: 1MB - 8GB - Write Performance iozone: 1MB - 4GB - Write Performance iozone: 64Kb - 512MB - Write Performance iozone: 64Kb - 4GB - Write Performance iozone: 64Kb - 2GB - Write Performance iozone: 4Kb - 512MB - Write Performance iozone: 4Kb - 2GB - Write Performance iozone: 128Kb - 512MB - Write Performance iozone: 128Kb - 8GB - Write Performance iozone: 128Kb - 4GB - Write Performance iozone: 128Kb - 2GB - Write Performance ZFS RaidZ3 12TB 5EA recordsize 128K ZFS RaidZ3 12TB 5EA recordsize 4K ZFS RaidZ3 12TB 5EA recordsize 64K ZFS RaidZ3 12TB 5EA recordsize 1M ZFS RaidZ3 12TB 7EA 128K ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 64K ZFS RaidZ3 12TB 7EA recordsize 1M ZFS RaidZ3 12TB 11EA recordsize 128K ZFS RaidZ3 12TB 11EA recordsize 4K ZFS RaidZ3 12TB 11EA recordsize 64K ZFS RaidZ3 12TB 11EA recordsize 1M 193 220 170 185 22.36 40.32 139 176 201 209 164 175 204 227 245 235 366 360 321 322 27.79 47.69 198 179 271 406 284 374 345 344 432 446 544 511 518 571 35.48 58.80 222 212 551 547 474 513 602 598 750 620 OpenBenchmarking.org
IOzone Record Size: 1MB - File Size: 2GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 1MB - File Size: 2GB - Disk Test: Write Performance ZFS RaidZ3 12TB 11EA recordsize 1M ZFS RaidZ3 12TB 7EA recordsize 1M ZFS RaidZ3 12TB 5EA recordsize 1M 130 260 390 520 650 SE +/- 7.58, N = 3 SE +/- 3.08, N = 3 SE +/- 2.78, N = 15 602 345 204 1. (CC) gcc options: -O3
IOzone Record Size: 64Kb - File Size: 8GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 64Kb - File Size: 8GB - Disk Test: Write Performance ZFS RaidZ3 12TB 11EA recordsize 64K ZFS RaidZ3 12TB 7EA recordsize 64K ZFS RaidZ3 12TB 5EA recordsize 64K 120 240 360 480 600 SE +/- 6.86, N = 5 SE +/- 2.93, N = 15 SE +/- 1.88, N = 15 551 271 201 1. (CC) gcc options: -O3
IOzone Record Size: 1MB - File Size: 512MB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 1MB - File Size: 512MB - Disk Test: Write Performance ZFS RaidZ3 12TB 11EA recordsize 1M ZFS RaidZ3 12TB 7EA recordsize 1M ZFS RaidZ3 12TB 5EA recordsize 1M 130 260 390 520 650 SE +/- 8.42, N = 3 SE +/- 3.13, N = 15 SE +/- 3.16, N = 4 598 344 227 1. (CC) gcc options: -O3
IOzone Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance ZFS RaidZ3 12TB 11EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 5EA recordsize 4K 8 16 24 32 40 SE +/- 0.28, N = 3 SE +/- 0.06, N = 3 SE +/- 0.13, N = 3 35.48 27.79 22.36 1. (CC) gcc options: -O3
IOzone Record Size: 4Kb - File Size: 4GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 4Kb - File Size: 4GB - Disk Test: Write Performance ZFS RaidZ3 12TB 11EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 5EA recordsize 4K 13 26 39 52 65 SE +/- 0.38, N = 3 SE +/- 0.41, N = 3 SE +/- 0.35, N = 3 58.80 47.69 40.32 1. (CC) gcc options: -O3
IOzone Record Size: 1MB - File Size: 8GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 1MB - File Size: 8GB - Disk Test: Write Performance ZFS RaidZ3 12TB 11EA recordsize 1M ZFS RaidZ3 12TB 7EA recordsize 1M ZFS RaidZ3 12TB 5EA recordsize 1M 160 320 480 640 800 SE +/- 2.93, N = 3 SE +/- 10.98, N = 15 SE +/- 2.71, N = 3 750 432 245 1. (CC) gcc options: -O3
IOzone Record Size: 1MB - File Size: 4GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 1MB - File Size: 4GB - Disk Test: Write Performance ZFS RaidZ3 12TB 11EA recordsize 1M ZFS RaidZ3 12TB 7EA recordsize 1M ZFS RaidZ3 12TB 5EA recordsize 1M 130 260 390 520 650 SE +/- 19.47, N = 12 SE +/- 5.98, N = 3 SE +/- 2.83, N = 3 620 446 235 1. (CC) gcc options: -O3
IOzone Record Size: 64Kb - File Size: 512MB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 64Kb - File Size: 512MB - Disk Test: Write Performance ZFS RaidZ3 12TB 11EA recordsize 64K ZFS RaidZ3 12TB 7EA recordsize 64K ZFS RaidZ3 12TB 5EA recordsize 64K 120 240 360 480 600 SE +/- 22.39, N = 15 SE +/- 18.12, N = 12 SE +/- 5.14, N = 15 547 406 209 1. (CC) gcc options: -O3
IOzone Record Size: 64Kb - File Size: 4GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 64Kb - File Size: 4GB - Disk Test: Write Performance ZFS RaidZ3 12TB 11EA recordsize 64K ZFS RaidZ3 12TB 7EA recordsize 64K ZFS RaidZ3 12TB 5EA recordsize 64K 100 200 300 400 500 SE +/- 7.47, N = 15 SE +/- 6.38, N = 15 SE +/- 2.71, N = 15 474 284 164 1. (CC) gcc options: -O3
IOzone Record Size: 64Kb - File Size: 2GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 64Kb - File Size: 2GB - Disk Test: Write Performance ZFS RaidZ3 12TB 11EA recordsize 64K ZFS RaidZ3 12TB 7EA recordsize 64K ZFS RaidZ3 12TB 5EA recordsize 64K 110 220 330 440 550 SE +/- 2.91, N = 3 SE +/- 16.46, N = 15 SE +/- 2.01, N = 3 513 374 175 1. (CC) gcc options: -O3
IOzone Record Size: 4Kb - File Size: 512MB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 4Kb - File Size: 512MB - Disk Test: Write Performance ZFS RaidZ3 12TB 11EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 5EA recordsize 4K 50 100 150 200 250 SE +/- 7.25, N = 12 SE +/- 7.51, N = 14 SE +/- 6.21, N = 15 222 198 139 1. (CC) gcc options: -O3
IOzone Record Size: 4Kb - File Size: 2GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 4Kb - File Size: 2GB - Disk Test: Write Performance ZFS RaidZ3 12TB 11EA recordsize 4K ZFS RaidZ3 12TB 7EA recordsize 4K ZFS RaidZ3 12TB 5EA recordsize 4K 50 100 150 200 250 SE +/- 1.10, N = 3 SE +/- 1.62, N = 3 SE +/- 9.55, N = 15 212 179 176 1. (CC) gcc options: -O3
IOzone Record Size: 128Kb - File Size: 512MB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 128Kb - File Size: 512MB - Disk Test: Write Performance ZFS RaidZ3 12TB 11EA recordsize 128K ZFS RaidZ3 12TB 7EA 128K ZFS RaidZ3 12TB 5EA recordsize 128K 120 240 360 480 600 SE +/- 53.82, N = 12 SE +/- 17.91, N = 15 SE +/- 2.23, N = 15 544 366 193 1. (CC) gcc options: -O3
IOzone Record Size: 128Kb - File Size: 8GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 128Kb - File Size: 8GB - Disk Test: Write Performance ZFS RaidZ3 12TB 11EA recordsize 128K ZFS RaidZ3 12TB 7EA 128K ZFS RaidZ3 12TB 5EA recordsize 128K 110 220 330 440 550 SE +/- 5.48, N = 3 SE +/- 10.81, N = 15 SE +/- 1.81, N = 3 511 360 220 1. (CC) gcc options: -O3
IOzone Record Size: 128Kb - File Size: 4GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 128Kb - File Size: 4GB - Disk Test: Write Performance ZFS RaidZ3 12TB 11EA recordsize 128K ZFS RaidZ3 12TB 7EA 128K ZFS RaidZ3 12TB 5EA recordsize 128K 110 220 330 440 550 SE +/- 4.93, N = 15 SE +/- 11.59, N = 15 SE +/- 2.67, N = 3 518 321 170 1. (CC) gcc options: -O3
IOzone Record Size: 128Kb - File Size: 2GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.465 Record Size: 128Kb - File Size: 2GB - Disk Test: Write Performance ZFS RaidZ3 12TB 11EA recordsize 128K ZFS RaidZ3 12TB 7EA 128K ZFS RaidZ3 12TB 5EA recordsize 128K 120 240 360 480 600 SE +/- 8.54, N = 4 SE +/- 10.62, N = 15 SE +/- 4.44, N = 15 571 322 185 1. (CC) gcc options: -O3
Phoronix Test Suite v10.8.4