9disk-raidz, JHMultidisk-ZFS-RaidZ-JBod, zfs-raidz2-new
ZFS RaidZ, 9-drive JBoD, qla-speed=2Gbx2 (multi-pathed), Atime=off

JHMultidisk-ZFS-RaidZ-JBod: ZFS RaidZ, 5-drive JBoD, qla-speed=2Gbx2 (multi-pathed), Atime=off

zfs-raidz2-new: ZFS-on 10-disk RaidZ2, qla-speed=2Gbx2 (multi-pathed), NoAtime


JHMultidisk-ZFS-9disk-RaidZ-JBoD: 

	Processor: Intel Xeon E3-1230 V2 @ 3.30GHz (8 Cores), Motherboard: IBM 00D3729, Chipset: Intel Xeon E3-1200 v2/Ivy, Memory: 4 x 4096 MB DDR3-1600MHz Hynix, Disk: 10 x 137GB DISK + 10 x 144GB DISK + 2 x 574GB RAID 5 + 500GB Seagate ST500NM0011 + 500GB Western Digital WD5003ABYX-23, Graphics: Matrox s G200eR2, Network: Intel 82574L Gigabit Connection

	OS: RedHatEnterpriseServer 6.4, Kernel: 2.6.32-358.6.1.el6.x86_64 (x86_64), Compiler: GCC 4.4.7 20120313, File-System: ext4

JHMultidisk-EXT4-on-9disk-RaidZ-zvol: 

	Processor: Intel Xeon E3-1230 V2 @ 3.30GHz (8 Cores), Motherboard: IBM 00D3729, Chipset: Intel Xeon E3-1200 v2/Ivy, Memory: 4 x 4096 MB DDR3-1600MHz Hynix, Disk: 10 x 137GB DISK + 10 x 144GB DISK + 2 x 574GB RAID 5 + 500GB Seagate ST500NM0011 + 500GB Western Digital WD5003ABYX-23, Graphics: Matrox s G200eR2, Network: Intel 82574L Gigabit Connection

	OS: RedHatEnterpriseServer 6.4, Kernel: 2.6.32-358.6.1.el6.x86_64 (x86_64), Compiler: GCC 4.4.7 20120313, File-System: ext4

JHMultidisk-Ext4-LVM-10disk-md-Raid6: 

	Processor: Intel Xeon E3-1230 V2 @ 3.30GHz (8 Cores), Motherboard: IBM 00D3729, Chipset: Intel Xeon E3-1200 v2/Ivy, Memory: 4 x 4096 MB DDR3-1600MHz Hynix, Disk: 10 x 137GB DISK + 10 x 144GB DISK + 2 x 574GB RAID 5 + 500GB Seagate ST500NM0011 + 500GB Western Digital WD5003ABYX-23, Graphics: Matrox s G200eR2, Network: Intel 82574L Gigabit Connection

	OS: RedHatEnterpriseServer 6.4, Kernel: 2.6.32-358.6.1.el6.x86_64 (x86_64), Compiler: GCC 4.4.7 20120313, File-System: ext4

JHMultidisk-Ext4-LVM-10disk-md-Raid6-s: 

	Processor: Intel Xeon E3-1230 V2 @ 3.30GHz (8 Cores), Motherboard: IBM 00D3729, Chipset: Intel Xeon E3-1200 v2/Ivy, Memory: 4 x 4096 MB DDR3-1600MHz Hynix, Disk: 10 x 137GB DISK + 10 x 144GB DISK + 2 x 574GB RAID 5 + 500GB Seagate ST500NM0011 + 500GB Western Digital WD5003ABYX-23, Graphics: Matrox s G200eR2, Network: Intel 82574L Gigabit Connection

	OS: RedHatEnterpriseServer 6.4, Kernel: 2.6.32-358.6.1.el6.x86_64 (x86_64), Compiler: GCC 4.4.7 20120313, File-System: ext4

JHMultidisk-EXT4-on-10disk-RaidZ2-zvol: 

	Processor: Intel Xeon E3-1230 V2 @ 3.30GHz (8 Cores), Motherboard: IBM 00D3729, Chipset: Intel Xeon E3-1200 v2/Ivy, Memory: 4 x 4096 MB DDR3-1600MHz Hynix, Disk: 10 x 137GB DISK + 10 x 144GB DISK + 2 x 574GB RAID 5 + 500GB Seagate ST500NM0011 + 500GB Western Digital WD5003ABYX-23, Graphics: Matrox s G200eR2, Network: Intel 82574L Gigabit Connection

	OS: RedHatEnterpriseServer 6.4, Kernel: 2.6.32-358.6.1.el6.x86_64 (x86_64), Compiler: GCC 4.4.7 20120313, File-System: ext4

JHMultidisk-ZFS-RaidZ-JBoD: 

	Processor: Intel Xeon E3-1230 V2 @ 3.30GHz (8 Cores), Motherboard: IBM 00D3729, Chipset: Intel Xeon E3-1200 v2/Ivy, Memory: 4 x 4096 MB DDR3-1600MHz Hynix, Disk: 10 x 137GB DISK + 10 x 144GB DISK + 500GB Seagate ST500NM0011 + 500GB Western Digital WD5003ABYX-23, Graphics: Matrox s G200eR2, Network: Intel 82574L Gigabit Connection

	OS: RedHatEnterpriseServer 6.4, Kernel: 2.6.32-358.2.1.el6.x86_64 (x86_64), Compiler: GCC 4.4.7 20120313, File-System: ext4

JHMultidisk-ZFS-Raid10: 

	Processor: Intel Xeon E3-1230 V2 @ 3.30GHz (8 Cores), Motherboard: IBM 00D3729, Chipset: Intel Xeon E3-1200 v2/Ivy, Memory: 4 x 4096 MB DDR3-1600MHz Hynix, Disk: 10 x 137GB DISK + 10 x 144GB DISK + 500GB Seagate ST500NM0011 + 500GB Western Digital WD5003ABYX-23, Graphics: Matrox s G200eR2, Network: Intel 82574L Gigabit Connection

	OS: RedHatEnterpriseServer 6.4, Kernel: 2.6.32-358.2.1.el6.x86_64 (x86_64), Compiler: GCC 4.4.7 20120313, File-System: ext4

JHMultidisk-ZFS-Mirror-JBod: 

	Processor: Intel Xeon E3-1230 V2 @ 3.30GHz (8 Cores), Motherboard: IBM 00D3729, Chipset: Intel Xeon E3-1200 v2/Ivy, Memory: 4 x 4096 MB DDR3-1600MHz Hynix, Disk: 500GB Seagate ST500NM0011 + 500GB Western Digital WD5003ABYX-23 + 10 x 137GB DISK + 10 x 144GB DISK + 2 x 574GB RAID 5, Graphics: Matrox s G200eR2, Network: Intel 82574L Gigabit Connection

	OS: RedHatEnterpriseServer 6.4, Kernel: 2.6.32-358.2.1.el6.x86_64 (x86_64), Compiler: GCC 4.4.7 20120313, File-System: ext4

JHMultidisk-EXT4-LVM-mdRaid5-JBoD: 

	Processor: Intel Xeon E3-1230 V2 @ 3.30GHz (8 Cores), Motherboard: IBM 00D3729, Chipset: Intel Xeon E3-1200 v2/Ivy, Memory: 4 x 4096 MB DDR3-1600MHz Hynix, Disk: 10 x 137GB DISK + 10 x 144GB DISK + 500GB Seagate ST500NM0011 + 500GB Western Digital WD5003ABYX-23, Graphics: Matrox s G200eR2, Network: Intel 82574L Gigabit Connection

	OS: RedHatEnterpriseServer 6.4, Kernel: 2.6.32-358.2.1.el6.x86_64 (x86_64), Compiler: GCC 4.4.7 20120313, File-System: ext4

JHMultidisk-EXT4-LVM-mdMirror: 

	Processor: Intel Xeon E3-1230 V2 @ 3.30GHz (8 Cores), Motherboard: IBM 00D3729, Chipset: Intel Xeon E3-1200 v2/Ivy, Memory: 4 x 4096 MB DDR3-1600MHz Hynix, Disk: 500GB Seagate ST500NM0011 + 500GB Western Digital WD5003ABYX-23 + 10 x 137GB DISK + 10 x 144GB DISK + 2 x 574GB RAID 5, Graphics: Matrox s G200eR2, Network: Intel 82574L Gigabit Connection

	OS: RedHatEnterpriseServer 6.4, Kernel: 2.6.32-358.2.1.el6.x86_64 (x86_64), Compiler: GCC 4.4.7 20120313, File-System: ext4

JHMultidisk-EXT4-LVM-HWRaid5: 

	Processor: Intel Xeon E3-1230 V2 @ 3.30GHz (8 Cores), Motherboard: IBM 00D3729, Chipset: Intel Xeon E3-1200 v2/Ivy, Memory: 4 x 4096 MB DDR3-1600MHz Hynix, Disk: 10 x 137GB DISK + 10 x 144GB DISK + 500GB Seagate ST500NM0011 + 500GB Western Digital WD5003ABYX-23, Graphics: Matrox s G200eR2, Network: Intel 82574L Gigabit Connection

	OS: RedHatEnterpriseServer 6.4, Kernel: 2.6.32-358.2.1.el6.x86_64 (x86_64), Compiler: GCC 4.4.7 20120313, File-System: ext4

JHMultidisk-ZFS-10disk-RaidZ2-JBoD: 

	Processor: Intel Xeon E3-1230 V2 @ 3.30GHz (8 Cores), Motherboard: IBM 00D3729, Chipset: Intel Xeon E3-1200 v2/Ivy, Memory: 4 x 4096 MB DDR3-1600MHz Hynix, Disk: 10 x 137GB DISK + 10 x 144GB DISK + 2 x 574GB RAID 5 + 500GB Seagate ST500NM0011 + 500GB Western Digital WD5003ABYX-23, Graphics: Matrox s G200eR2, Network: Intel 82574L Gigabit Connection

	OS: RedHatEnterpriseServer 6.4, Kernel: 2.6.32-358.6.1.el6.x86_64 (x86_64), Compiler: GCC 4.4.7 20120313, File-System: ext4

zfs-raidz2-new: JHMultidisk-EXT4-on-10disk-RaidZ2-zvol: 

	Processor: Intel Xeon E3-1230 V2 @ 3.30GHz (8 Cores), Motherboard: IBM 00D3729, Chipset: Intel Xeon E3-1200 v2/Ivy, Memory: 4 x 4096 MB DDR3-1600MHz Hynix, Disk: 10 x 137GB DISK + 10 x 144GB DISK + 2 x 574GB RAID 5 + 500GB Seagate ST500NM0011 + 500GB Western Digital WD5003ABYX-23, Graphics: Matrox s G200eR2, Network: Intel 82574L Gigabit Connection

	OS: RedHatEnterpriseServer 6.4, Kernel: 2.6.32-358.6.1.el6.x86_64 (x86_64), Compiler: GCC 4.4.7 20120313, File-System: ext4


FS-Mark 3.3
Test: 1000 Files, 1MB Size
Files/s > Higher Is Better
JHMultidisk-ZFS-9disk-RaidZ-JBoD ....... 34.83 |===============================
JHMultidisk-EXT4-on-9disk-RaidZ-zvol ... 19.47 |=================
JHMultidisk-Ext4-LVM-10disk-md-Raid6 ... 6.53  |======
JHMultidisk-Ext4-LVM-10disk-md-Raid6-s . 6.63  |======
JHMultidisk-EXT4-on-10disk-RaidZ2-zvol . 16.43 |===============
JHMultidisk-ZFS-RaidZ-JBoD ............. 25.63 |=======================
JHMultidisk-ZFS-Raid10 ................. 24.40 |======================
JHMultidisk-ZFS-Mirror-JBod ............ 12.40 |===========
JHMultidisk-EXT4-LVM-mdRaid5-JBoD ...... 11.87 |===========
JHMultidisk-EXT4-LVM-mdMirror .......... 13.20 |============
JHMultidisk-EXT4-LVM-HWRaid5 ........... 14.50 |=============
JHMultidisk-ZFS-10disk-RaidZ2-JBoD ..... 24.90 |======================


FS-Mark 3.3
Test: 5000 Files, 1MB Size, 4 Threads
Files/s > Higher Is Better
JHMultidisk-ZFS-9disk-RaidZ-JBoD ....... 47.70 |===============================
JHMultidisk-EXT4-on-9disk-RaidZ-zvol ... 34.70 |=======================
JHMultidisk-Ext4-LVM-10disk-md-Raid6 ... 18.87 |============
JHMultidisk-Ext4-LVM-10disk-md-Raid6-s . 19.90 |=============
JHMultidisk-EXT4-on-10disk-RaidZ2-zvol . 28.63 |===================
JHMultidisk-ZFS-RaidZ-JBoD ............. 32.00 |=====================
JHMultidisk-ZFS-Raid10 ................. 32.27 |=====================
JHMultidisk-ZFS-Mirror-JBod ............ 13.30 |=========
JHMultidisk-EXT4-LVM-mdRaid5-JBoD ...... 22.07 |==============
JHMultidisk-EXT4-LVM-mdMirror .......... 23.57 |===============
JHMultidisk-EXT4-LVM-HWRaid5 ........... 21.07 |==============
JHMultidisk-ZFS-10disk-RaidZ2-JBoD ..... 40.40 |==========================


FS-Mark 3.3
Test: 4000 Files, 32 Sub Dirs, 1MB Size
Files/s > Higher Is Better
JHMultidisk-ZFS-9disk-RaidZ-JBoD ....... 34.23 |===============================
JHMultidisk-EXT4-on-9disk-RaidZ-zvol ... 20.78 |===================
JHMultidisk-Ext4-LVM-10disk-md-Raid6 ... 6.70  |======
JHMultidisk-Ext4-LVM-10disk-md-Raid6-s . 6.77  |======
JHMultidisk-EXT4-on-10disk-RaidZ2-zvol . 17.33 |================
JHMultidisk-ZFS-RaidZ-JBoD ............. 24.67 |======================
JHMultidisk-ZFS-Raid10 ................. 23.77 |======================
JHMultidisk-ZFS-Mirror-JBod ............ 12.43 |===========
JHMultidisk-EXT4-LVM-mdRaid5-JBoD ...... 11.77 |===========
JHMultidisk-EXT4-LVM-mdMirror .......... 13.10 |============
JHMultidisk-EXT4-LVM-HWRaid5 ........... 14.87 |=============
JHMultidisk-ZFS-10disk-RaidZ2-JBoD ..... 27.77 |=========================


FS-Mark 3.3
Test: 1000 Files, 1MB Size, No Sync/FSync
Files/s > Higher Is Better
JHMultidisk-ZFS-9disk-RaidZ-JBoD ....... 653.52  |=========
JHMultidisk-EXT4-on-9disk-RaidZ-zvol ... 391.88  |======
JHMultidisk-Ext4-LVM-10disk-md-Raid6 ... 1813.45 |==========================
JHMultidisk-Ext4-LVM-10disk-md-Raid6-s . 1946.68 |============================
JHMultidisk-EXT4-on-10disk-RaidZ2-zvol . 250.37  |====
JHMultidisk-ZFS-RaidZ-JBoD ............. 147.33  |==
JHMultidisk-ZFS-Raid10 ................. 126.70  |==
JHMultidisk-ZFS-Mirror-JBod ............ 37.70   |=
JHMultidisk-EXT4-LVM-mdRaid5-JBoD ...... 2029.40 |=============================
JHMultidisk-EXT4-LVM-mdMirror .......... 1914.83 |===========================
JHMultidisk-EXT4-LVM-HWRaid5 ........... 1858.28 |===========================
JHMultidisk-ZFS-10disk-RaidZ2-JBoD ..... 501.58  |=======