201907011228 2 x Intel Xeon E5-2620 v4 testing with a Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS) and Matrox MGA G200e [Pilot] on CentOS Linux 7 via the Phoronix Test Suite. ZFS RaidZ2 12TB 4EA recordsize 4K: Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD, Disk: 7 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume, Graphics: Matrox MGA G200e [Pilot], Network: 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-957.21.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768 ZFS RaidZ2 12TB 4EA recordsize 64K: Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD, Disk: 7 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume, Graphics: Matrox MGA G200e [Pilot], Network: 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-957.21.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768 ZFS RaidZ2 12TB 4EA recordsize 128K: Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD, Disk: 7 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume, Graphics: Matrox MGA G200e [Pilot], Network: 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-957.21.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768 ZFS RaidZ2 12TB 4EA recordsize 1M: Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD, Disk: 7 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume, Graphics: Matrox MGA G200e [Pilot], Network: 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-957.21.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768 ZFS RaidZ2 12TB 6EA recordsize 4K: Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD, Disk: 7 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume, Graphics: Matrox MGA G200e [Pilot], Network: 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-957.21.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768 ZFS RaidZ2 12TB 6EA recordsize 64K: Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD, Disk: 7 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume, Graphics: Matrox MGA G200e [Pilot], Network: 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-957.21.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768 ZFS RaidZ2 12TB 6EA recordsize 128K: Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD, Disk: 7 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume, Graphics: Matrox MGA G200e [Pilot], Network: 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-957.21.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768 ZFS RaidZ2 Test: Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD, Disk: 7 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume, Graphics: Matrox MGA G200e [Pilot], Network: 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-957.21.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768 ZFS RaidZ2 12TB 6EA recordsize 1M: Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Intel S2600CWR (SE5C610.86B.01.01.0024.021320181901 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 4 x 32 GB DDR4-2134MT/s Samsung M393A4K40CB2-CTD, Disk: 7 x 12000GB Seagate ST12000NM0027 + 239GB Logical Volume, Graphics: Matrox MGA G200e [Pilot], Network: 2 x Intel I350 + 2 x Intel 82599ES 10-Gigabit SFI/SFP+ OS: CentOS Linux 7, Kernel: 3.10.0-957.21.2.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: zfs, Screen Resolution: 1024x768 IOzone 3.465 Record Size: 4Kb - File Size: 2GB - Disk Test: Write Performance MB/s > Higher Is Better ZFS RaidZ2 12TB 4EA recordsize 4K . 125.49 |======================== ZFS RaidZ2 12TB 6EA recordsize 4K . 179.97 |=================================== IOzone 3.465 Record Size: 4Kb - File Size: 4GB - Disk Test: Write Performance MB/s > Higher Is Better ZFS RaidZ2 12TB 4EA recordsize 4K . 44.00 |=========================== ZFS RaidZ2 12TB 6EA recordsize 4K . 58.74 |==================================== IOzone 3.465 Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance MB/s > Higher Is Better ZFS RaidZ2 12TB 4EA recordsize 4K . 26.70 |========================== ZFS RaidZ2 12TB 6EA recordsize 4K . 36.45 |==================================== IOzone 3.465 Record Size: 4Kb - File Size: 512MB - Disk Test: Write Performance MB/s > Higher Is Better ZFS RaidZ2 12TB 4EA recordsize 4K . 147.79 |========================== ZFS RaidZ2 12TB 6EA recordsize 4K . 198.11 |=================================== IOzone 3.465 Record Size: 64Kb - File Size: 2GB - Disk Test: Write Performance MB/s > Higher Is Better ZFS RaidZ2 12TB 4EA recordsize 64K . 179.96 |================ ZFS RaidZ2 12TB 6EA recordsize 64K . 393.15 |================================== IOzone 3.465 Record Size: 64Kb - File Size: 4GB - Disk Test: Write Performance MB/s > Higher Is Better ZFS RaidZ2 12TB 4EA recordsize 64K . 160.78 |=================== ZFS RaidZ2 12TB 6EA recordsize 64K . 280.79 |================================== IOzone 3.465 Record Size: 64Kb - File Size: 8GB - Disk Test: Write Performance MB/s > Higher Is Better ZFS RaidZ2 12TB 4EA recordsize 64K . 160.19 |===================== ZFS RaidZ2 12TB 6EA recordsize 64K . 263.86 |================================== IOzone 3.465 Record Size: 64Kb - File Size: 512MB - Disk Test: Write Performance MB/s > Higher Is Better ZFS RaidZ2 12TB 4EA recordsize 64K . 226.60 |================== ZFS RaidZ2 12TB 6EA recordsize 64K . 424.65 |================================== IOzone 3.465 Record Size: 128Kb - File Size: 2GB - Disk Test: Write Performance MB/s > Higher Is Better ZFS RaidZ2 12TB 4EA recordsize 128K . 175.91 |================= ZFS RaidZ2 12TB 6EA recordsize 128K . 345.83 |================================= IOzone 3.465 Record Size: 128Kb - File Size: 4GB - Disk Test: Write Performance MB/s > Higher Is Better ZFS RaidZ2 12TB 4EA recordsize 128K . 148.05 |=============== ZFS RaidZ2 12TB 6EA recordsize 128K . 328.98 |================================= IOzone 3.465 Record Size: 128Kb - File Size: 8GB - Disk Test: Write Performance MB/s > Higher Is Better ZFS RaidZ2 12TB 4EA recordsize 128K . 198.53 |================= ZFS RaidZ2 12TB 6EA recordsize 128K . 383.64 |================================= IOzone 3.465 Record Size: 128Kb - File Size: 512MB - Disk Test: Write Performance MB/s > Higher Is Better ZFS RaidZ2 12TB 4EA recordsize 128K . 179.64 |=============== ZFS RaidZ2 12TB 6EA recordsize 128K . 391.64 |================================= IOzone 3.465 Record Size: 1MB - File Size: 2GB - Disk Test: Write Performance MB/s > Higher Is Better ZFS RaidZ2 12TB 4EA recordsize 1M . 215.57 |===================== ZFS RaidZ2 Test ................... 355.66 |================================== ZFS RaidZ2 12TB 6EA recordsize 1M . 365.98 |=================================== IOzone 3.465 Record Size: 1MB - File Size: 4GB - Disk Test: Write Performance MB/s > Higher Is Better ZFS RaidZ2 12TB 4EA recordsize 1M . 235.71 |=================== ZFS RaidZ2 Test ................... 432.12 |=================================== ZFS RaidZ2 12TB 6EA recordsize 1M . 396.67 |================================ IOzone 3.465 Record Size: 1MB - File Size: 8GB - Disk Test: Write Performance MB/s > Higher Is Better ZFS RaidZ2 12TB 4EA recordsize 1M . 230.08 |================== ZFS RaidZ2 Test ................... 440.50 |================================== ZFS RaidZ2 12TB 6EA recordsize 1M . 456.47 |=================================== IOzone 3.465 Record Size: 1MB - File Size: 512MB - Disk Test: Write Performance MB/s > Higher Is Better ZFS RaidZ2 12TB 4EA recordsize 1M . 223.97 |==================== ZFS RaidZ2 Test ................... 389.81 |=================================== ZFS RaidZ2 12TB 6EA recordsize 1M . 383.71 |==================================