sds-fio 2 x Intel Xeon E5-2620 v4 testing with a Intel S2600CW and Matrox s MGA G200e [Pilot] (SEP1) on CentOS Linux 7 via the Phoronix Test Suite. NFS / ZFS sync=standard 8TB 24ea Raidz2 lz4: Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (32 Cores), Motherboard: Intel S2600CW, Chipset: Intel Xeon E7 v4/Xeon, Memory: 6 x 16384 MB DDR4-2134MHz Samsung, Disk: 150GB INTEL SSDSC2BB15 + 1200GB INTEL SSDSC2BB01, Graphics: Matrox s MGA G200e [Pilot] (SEP1), Network: Intel I350 Gigabit Connection OS: CentOS Linux 7, Kernel: 3.10.0-514.16.1.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: ext4, Screen Resolution: 1024x768 NFS / ZFS sync=disabled 8TB 24ea Raidz2 lz4: Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (32 Cores), Motherboard: Intel S2600CW, Chipset: Intel Xeon E7 v4/Xeon, Memory: 6 x 16384 MB DDR4-2134MHz Samsung, Disk: 150GB INTEL SSDSC2BB15 + 1200GB INTEL SSDSC2BB01, Graphics: Matrox s MGA G200e [Pilot] (SEP1), Network: Intel I350 Gigabit Connection OS: CentOS Linux 7, Kernel: 3.10.0-514.16.1.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: ext4, Screen Resolution: 1024x768 NFS / ZFS sync=standard 8TB 24ea Raidz2 lz4 zil: Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (32 Cores), Motherboard: Intel S2600CW, Chipset: Intel Xeon E7 v4/Xeon, Memory: 6 x 16384 MB DDR4-2134MHz Samsung, Disk: 150GB INTEL SSDSC2BB15 + 1200GB INTEL SSDSC2BB01, Graphics: Matrox s MGA G200e [Pilot] (SEP1), Network: Intel I350 Gigabit Connection OS: CentOS Linux 7, Kernel: 3.10.0-514.16.1.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: ext4, Screen Resolution: 1024x768 NFS / ZFS sync=disabled 8TB 24ea Raidz2 lz4 zil: Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (32 Cores), Motherboard: Intel S2600CW, Chipset: Intel Xeon E7 v4/Xeon, Memory: 6 x 16384 MB DDR4-2134MHz Samsung, Disk: 150GB INTEL SSDSC2BB15 + 1200GB INTEL SSDSC2BB01, Graphics: Matrox s MGA G200e [Pilot] (SEP1), Network: Intel I350 Gigabit Connection OS: CentOS Linux 7, Kernel: 3.10.0-514.16.1.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: ext4, Screen Resolution: 1024x768 NFS / ZFS sync=always 8TB 24ea Raidz2 lz4 zil: Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (32 Cores), Motherboard: Intel S2600CW, Chipset: Intel Xeon E7 v4/Xeon, Memory: 6 x 16384 MB DDR4-2134MHz Samsung, Disk: 150GB INTEL SSDSC2BB15 + 1200GB INTEL SSDSC2BB01, Graphics: Matrox s MGA G200e [Pilot] (SEP1), Network: Intel I350 Gigabit Connection OS: CentOS Linux 7, Kernel: 3.10.0-514.16.1.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: ext4, Screen Resolution: 1024x768 Flexible IO Tester 2.1.13 Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory MB/s > Higher Is Better NFS / ZFS sync=standard 8TB 24ea Raidz2 lz4 ..... 240.33 |===================== NFS / ZFS sync=disabled 8TB 24ea Raidz2 lz4 ..... 223.43 |==================== NFS / ZFS sync=standard 8TB 24ea Raidz2 lz4 zil . 181.03 |================ NFS / ZFS sync=disabled 8TB 24ea Raidz2 lz4 zil . 182.10 |================ NFS / ZFS sync=always 8TB 24ea Raidz2 lz4 zil ... 212.67 |=================== Flexible IO Tester 2.1.13 Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory IOPS > Higher Is Better NFS / ZFS sync=standard 8TB 24ea Raidz2 lz4 ..... 60079 |====================== NFS / ZFS sync=disabled 8TB 24ea Raidz2 lz4 ..... 55853 |==================== NFS / ZFS sync=standard 8TB 24ea Raidz2 lz4 zil . 45255 |================= NFS / ZFS sync=disabled 8TB 24ea Raidz2 lz4 zil . 45522 |================= NFS / ZFS sync=always 8TB 24ea Raidz2 lz4 zil ... 53164 |=================== Flexible IO Tester 2.1.13 Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory MB/s > Higher Is Better NFS / ZFS sync=standard 8TB 24ea Raidz2 lz4 ..... 331.39 |===================== NFS / ZFS sync=disabled 8TB 24ea Raidz2 lz4 ..... 338.00 |===================== NFS / ZFS sync=standard 8TB 24ea Raidz2 lz4 zil . 338.19 |===================== NFS / ZFS sync=disabled 8TB 24ea Raidz2 lz4 zil . 338.05 |===================== NFS / ZFS sync=always 8TB 24ea Raidz2 lz4 zil ... 125.22 |======== Flexible IO Tester 2.1.13 Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory IOPS > Higher Is Better NFS / ZFS sync=standard 8TB 24ea Raidz2 lz4 ..... 82845 |====================== NFS / ZFS sync=disabled 8TB 24ea Raidz2 lz4 ..... 84497 |====================== NFS / ZFS sync=standard 8TB 24ea Raidz2 lz4 zil . 84544 |====================== NFS / ZFS sync=disabled 8TB 24ea Raidz2 lz4 zil . 84510 |====================== NFS / ZFS sync=always 8TB 24ea Raidz2 lz4 zil ... 31300 |========