201907011132 2 x Intel Xeon E5-2620 v4 testing with a Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS) and Matrox MGA G200e [Pilot] on CentOS Linux 7 via the Phoronix Test Suite. ZFS RaidZ2 12TB 4EA recordsize 128K: Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD, Disk: 7 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume, Graphics: Matrox MGA G200e [Pilot], Network: 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-957.21.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768 ZFS RaidZ2 12TB 4EA recordsize 4K: Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD, Disk: 7 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume, Graphics: Matrox MGA G200e [Pilot], Network: 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-957.21.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768 ZFS RaidZ1 12TB 3EA recordsize 4K: Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD, Disk: 7 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume, Graphics: Matrox MGA G200e [Pilot], Network: 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-957.21.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768 ZFS RaidZ1 12TB 3EA recordsize 64K: Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD, Disk: 7 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume, Graphics: Matrox MGA G200e [Pilot], Network: 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-957.21.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768 ZFS RaidZ1 12TB 3EA recordsize 128K: Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD, Disk: 7 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume, Graphics: Matrox MGA G200e [Pilot], Network: 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-957.21.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768 ZFS RaidZ1 12TB 3EA recordsize 1M: Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD, Disk: 7 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume, Graphics: Matrox MGA G200e [Pilot], Network: 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-957.21.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768 ZFS RaidZ1 12TB 5EA recordsize 4K: Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD, Disk: 7 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume, Graphics: Matrox MGA G200e [Pilot], Network: 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-957.21.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768 ZFS RaidZ1 12TB 5EA recordsize 64K: Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD, Disk: 7 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume, Graphics: Matrox MGA G200e [Pilot], Network: 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-957.21.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768 ZFS RaidZ1 12TB 5EA recordsize 128K: Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD, Disk: 7 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume, Graphics: Matrox MGA G200e [Pilot], Network: 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-957.21.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768 ZFS RaidZ1 12TB 5EA recordsize 1M: Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD, Disk: 7 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume, Graphics: Matrox MGA G200e [Pilot], Network: 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-957.21.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768 IOzone 3.465 Record Size: 128Kb - File Size: 512MB - Disk Test: Write Performance MB/s > Higher Is Better ZFS RaidZ2 12TB 4EA recordsize 128K . 199.90 |============= ZFS RaidZ1 12TB 3EA recordsize 128K . 257.77 |================= ZFS RaidZ1 12TB 5EA recordsize 128K . 493.46 |================================= IOzone 3.465 Record Size: 4Kb - File Size: 512MB - Disk Test: Write Performance MB/s > Higher Is Better ZFS RaidZ2 12TB 4EA recordsize 4K . 187.41 |============================= ZFS RaidZ1 12TB 3EA recordsize 4K . 204.13 |=============================== ZFS RaidZ1 12TB 5EA recordsize 4K . 229.25 |=================================== IOzone 3.465 Record Size: 4Kb - File Size: 2GB - Disk Test: Write Performance MB/s > Higher Is Better ZFS RaidZ1 12TB 3EA recordsize 4K . 125.64 |======================== ZFS RaidZ1 12TB 5EA recordsize 4K . 184.42 |=================================== IOzone 3.465 Record Size: 4Kb - File Size: 4GB - Disk Test: Write Performance MB/s > Higher Is Better ZFS RaidZ1 12TB 3EA recordsize 4K . 60.55 |=============================== ZFS RaidZ1 12TB 5EA recordsize 4K . 71.25 |==================================== IOzone 3.465 Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance MB/s > Higher Is Better ZFS RaidZ1 12TB 3EA recordsize 4K . 40.02 |============================= ZFS RaidZ1 12TB 5EA recordsize 4K . 48.95 |==================================== IOzone 3.465 Record Size: 64Kb - File Size: 2GB - Disk Test: Write Performance MB/s > Higher Is Better ZFS RaidZ1 12TB 3EA recordsize 64K . 238.93 |=================== ZFS RaidZ1 12TB 5EA recordsize 64K . 420.29 |================================== IOzone 3.465 Record Size: 64Kb - File Size: 4GB - Disk Test: Write Performance MB/s > Higher Is Better ZFS RaidZ1 12TB 3EA recordsize 64K . 189.96 |======================= ZFS RaidZ1 12TB 5EA recordsize 64K . 286.08 |================================== IOzone 3.465 Record Size: 64Kb - File Size: 8GB - Disk Test: Write Performance MB/s > Higher Is Better ZFS RaidZ1 12TB 3EA recordsize 64K . 258.05 |============================== ZFS RaidZ1 12TB 5EA recordsize 64K . 292.32 |================================== IOzone 3.465 Record Size: 64Kb - File Size: 512MB - Disk Test: Write Performance MB/s > Higher Is Better ZFS RaidZ1 12TB 3EA recordsize 64K . 304.82 |======================= ZFS RaidZ1 12TB 5EA recordsize 64K . 451.87 |================================== IOzone 3.465 Record Size: 128Kb - File Size: 2GB - Disk Test: Write Performance MB/s > Higher Is Better ZFS RaidZ1 12TB 3EA recordsize 128K . 207.27 |================== ZFS RaidZ1 12TB 5EA recordsize 128K . 373.37 |================================= IOzone 3.465 Record Size: 128Kb - File Size: 4GB - Disk Test: Write Performance MB/s > Higher Is Better ZFS RaidZ1 12TB 3EA recordsize 128K . 171.83 |================= ZFS RaidZ1 12TB 5EA recordsize 128K . 340.80 |================================= IOzone 3.465 Record Size: 128Kb - File Size: 8GB - Disk Test: Write Performance MB/s > Higher Is Better ZFS RaidZ1 12TB 3EA recordsize 128K . 222.67 |================= ZFS RaidZ1 12TB 5EA recordsize 128K . 422.24 |================================= IOzone 3.465 Record Size: 1MB - File Size: 2GB - Disk Test: Write Performance MB/s > Higher Is Better ZFS RaidZ1 12TB 3EA recordsize 1M . 228.09 |==================== ZFS RaidZ1 12TB 5EA recordsize 1M . 395.03 |=================================== IOzone 3.465 Record Size: 1MB - File Size: 4GB - Disk Test: Write Performance MB/s > Higher Is Better ZFS RaidZ1 12TB 3EA recordsize 1M . 248.51 |===================== ZFS RaidZ1 12TB 5EA recordsize 1M . 410.21 |=================================== IOzone 3.465 Record Size: 1MB - File Size: 8GB - Disk Test: Write Performance MB/s > Higher Is Better ZFS RaidZ1 12TB 3EA recordsize 1M . 262.55 |==================== ZFS RaidZ1 12TB 5EA recordsize 1M . 467.36 |=================================== IOzone 3.465 Record Size: 1MB - File Size: 512MB - Disk Test: Write Performance MB/s > Higher Is Better ZFS RaidZ1 12TB 3EA recordsize 1M . 240.30 |===================== ZFS RaidZ1 12TB 5EA recordsize 1M . 406.59 |===================================