zfs-fio
2 x Intel Xeon E5-2620 v4 testing with a Intel S2600CW and Matrox s MGA G200e [Pilot] (SEP1) on CentOS Linux 7 via the Phoronix Test Suite.


NFS / ZFS 8TB 24ea sync=standard Raidz2 lz4: 

	Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (32 Cores), Motherboard: Intel S2600CW, Chipset: Intel Xeon E7 v4/Xeon, Memory: 6 x 16384 MB DDR4-2134MHz Samsung, Disk: 150GB INTEL SSDSC2BB15 + 1200GB INTEL SSDSC2BB01, Graphics: Matrox s MGA G200e [Pilot] (SEP1), Network: Intel I350 Gigabit Connection

	OS: CentOS Linux 7, Kernel: 3.10.0-514.16.1.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: ext4, Screen Resolution: 1024x768

NFS / ZFS 8TB 24ea sync=disabled Raidz2 lz4: 

	Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (32 Cores), Motherboard: Intel S2600CW, Chipset: Intel Xeon E7 v4/Xeon, Memory: 6 x 16384 MB DDR4-2134MHz Samsung, Disk: 150GB INTEL SSDSC2BB15 + 1200GB INTEL SSDSC2BB01, Graphics: Matrox s MGA G200e [Pilot] (SEP1), Network: Intel I350 Gigabit Connection

	OS: CentOS Linux 7, Kernel: 3.10.0-514.16.1.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: ext4, Screen Resolution: 1024x768

NFS / ZFS 8TB 24ea sync=standard Raidz2: 

	Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (32 Cores), Motherboard: Intel S2600CW, Chipset: Intel Xeon E7 v4/Xeon, Memory: 6 x 16384 MB DDR4-2134MHz Samsung, Disk: 150GB INTEL SSDSC2BB15 + 1200GB INTEL SSDSC2BB01, Graphics: Matrox s MGA G200e [Pilot] (SEP1), Network: Intel I350 Gigabit Connection

	OS: CentOS Linux 7, Kernel: 3.10.0-514.16.1.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: ext4, Screen Resolution: 1024x768

NFS / ZFS 8TB 24ea sync=disabled Raidz2: 

	Processor: 2 x Intel Xeon E5-2620 v4 @ 3.00GHz (32 Cores), Motherboard: Intel S2600CW, Chipset: Intel Xeon E7 v4/Xeon, Memory: 6 x 16384 MB DDR4-2134MHz Samsung, Disk: 150GB INTEL SSDSC2BB15 + 1200GB INTEL SSDSC2BB01, Graphics: Matrox s MGA G200e [Pilot] (SEP1), Network: Intel I350 Gigabit Connection

	OS: CentOS Linux 7, Kernel: 3.10.0-514.16.1.el7.x86_64 (x86_64), Compiler: GCC 4.8.5 20150623, File-System: ext4, Screen Resolution: 1024x768


Flexible IO Tester 2.1.13
Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory
MB/s > Higher Is Better
NFS / ZFS 8TB 24ea sync=standard Raidz2 lz4 . 245.56 |=========================
NFS / ZFS 8TB 24ea sync=disabled Raidz2 lz4 . 224.53 |=======================
NFS / ZFS 8TB 24ea sync=standard Raidz2 ..... 177.90 |==================
NFS / ZFS 8TB 24ea sync=disabled Raidz2 ..... 200.07 |====================


Flexible IO Tester 2.1.13
Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory
IOPS > Higher Is Better
NFS / ZFS 8TB 24ea sync=standard Raidz2 lz4 . 61385 |==========================
NFS / ZFS 8TB 24ea sync=disabled Raidz2 lz4 . 56129 |========================
NFS / ZFS 8TB 24ea sync=standard Raidz2 ..... 44471 |===================
NFS / ZFS 8TB 24ea sync=disabled Raidz2 ..... 50015 |=====================


Flexible IO Tester 2.1.13
Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory
MB/s > Higher Is Better
NFS / ZFS 8TB 24ea sync=standard Raidz2 lz4 . 329.71 |=====================
NFS / ZFS 8TB 24ea sync=disabled Raidz2 lz4 . 332.79 |======================
NFS / ZFS 8TB 24ea sync=standard Raidz2 ..... 374.18 |========================
NFS / ZFS 8TB 24ea sync=disabled Raidz2 ..... 384.83 |=========================


Flexible IO Tester 2.1.13
Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory
IOPS > Higher Is Better
NFS / ZFS 8TB 24ea sync=standard Raidz2 lz4 . 82424 |======================
NFS / ZFS 8TB 24ea sync=disabled Raidz2 lz4 . 83194 |======================
NFS / ZFS 8TB 24ea sync=standard Raidz2 ..... 93542 |=========================
NFS / ZFS 8TB 24ea sync=disabled Raidz2 ..... 96204 |==========================