r630
Xen HVM domU 4.13 testing on Ubuntu 20.04 via the Phoronix Test Suite.


local storage: 

	Processor: 8 x Intel Xeon E5-2680 v3 (15 Cores), Motherboard: Xen HVM domU v4.13, Chipset: Intel 440FX 82441FX PMC, Memory: 4096MB, Disk: 29GB, Graphics: bochs-drmdrmfb

	OS: Ubuntu 20.04, Kernel: 5.4.0-100-generic (x86_64), Vulkan: 1.1.182, Compiler: GCC 9.4.0, File-System: ext4, Screen Resolution: 1024x768, System Layer: Xen HVM domU 4.13

DellRaid SSD: 

	Processor: 8 x Intel Xeon E5-2680 v3 (15 Cores), Motherboard: Xen HVM domU v4.13, Chipset: Intel 440FX 82441FX PMC, Memory: 4096MB, Disk: 29GB, Graphics: bochs-drmdrmfb

	OS: Ubuntu 20.04, Kernel: 5.4.0-100-generic (x86_64), Vulkan: 1.1.182, Compiler: GCC 9.4.0, File-System: ext4, Screen Resolution: 1024x768, System Layer: Xen HVM domU 4.13

ZFS NVME: 

	Processor: 8 x Intel Xeon E5-2680 v3 (15 Cores), Motherboard: Xen HVM domU v4.13, Chipset: Intel 440FX 82441FX PMC, Memory: 4096MB, Disk: 29GB, Graphics: bochs-drmdrmfb

	OS: Ubuntu 20.04, Kernel: 5.4.0-100-generic (x86_64), Vulkan: 1.1.182, Compiler: GCC 9.4.0, File-System: ext4, Screen Resolution: 1024x768, System Layer: Xen HVM domU 4.13

zfs compress off: 

	Processor: 8 x Intel Xeon E5-2680 v3 (15 Cores), Motherboard: Xen HVM domU v4.13, Chipset: Intel 440FX 82441FX PMC, Memory: 4096MB, Disk: 29GB, Graphics: bochs-drmdrmfb

	OS: Ubuntu 20.04, Kernel: 5.4.0-100-generic (x86_64), Vulkan: 1.1.182, Compiler: GCC 9.4.0, File-System: ext4, Screen Resolution: 1024x768, System Layer: Xen HVM domU 4.13

Single NVME Drive: 

	Processor: 8 x Intel Xeon E5-2680 v3 (15 Cores), Motherboard: Xen HVM domU v4.13, Chipset: Intel 440FX 82441FX PMC, Memory: 4096MB, Disk: 29GB, Graphics: bochs-drmdrmfb

	OS: Ubuntu 20.04, Kernel: 5.4.0-100-generic (x86_64), Vulkan: 1.1.182, Compiler: GCC 9.4.0, File-System: ext4, Screen Resolution: 1024x768, System Layer: Xen HVM domU 4.13

ZFS fresh no ashift: 

	Processor: 8 x Intel Xeon E5-2680 v3 (15 Cores), Motherboard: Xen HVM domU v4.13, Chipset: Intel 440FX 82441FX PMC, Memory: 4096MB, Disk: 29GB, Graphics: bochs-drmdrmfb

	OS: Ubuntu 20.04, Kernel: 5.4.0-100-generic (x86_64), Vulkan: 1.1.182, Compiler: GCC 9.4.0, File-System: ext4, Screen Resolution: 1024x768, System Layer: Xen HVM domU 4.13

ZFS ashift13: 

	Processor: 8 x Intel Xeon E5-2680 v3 (15 Cores), Motherboard: Xen HVM domU v4.13, Chipset: Intel 440FX 82441FX PMC, Memory: 4096MB, Disk: 29GB, Graphics: bochs-drmdrmfb

	OS: Ubuntu 20.04, Kernel: 5.4.0-100-generic (x86_64), Vulkan: 1.1.182, Compiler: GCC 9.4.0, File-System: ext4, Screen Resolution: 1024x768, System Layer: Xen HVM domU 4.13

ZFS Mirror Stripe: 

	Processor: 8 x Intel Xeon E5-2680 v3 (15 Cores), Motherboard: Xen HVM domU v4.13, Chipset: Intel 440FX 82441FX PMC, Memory: 4096MB, Disk: 29GB, Graphics: bochs-drmdrmfb

	OS: Ubuntu 20.04, Kernel: 5.4.0-100-generic (x86_64), Vulkan: 1.1.182, Compiler: GCC 9.4.0, File-System: ext4, Screen Resolution: 1024x768, System Layer: Xen HVM domU 4.13

New Dell NVME Drives: 

	Processor: 8 x Intel Xeon E5-2697 v3 (15 Cores), Motherboard: Xen HVM domU v4.13, Chipset: Intel 440FX 82441FX PMC, Memory: 4096MB, Disk: 29GB, Graphics: bochs-drmdrmfb

	OS: Ubuntu 20.04, Kernel: 5.4.0-113-generic (x86_64), Vulkan: 1.1.182, Compiler: GCC 9.4.0, File-System: ext4, Screen Resolution: 1024x768, System Layer: Xen HVM domU 4.13

Single ZFS NVME New R630: 

	Processor: 8 x Intel Xeon E5-2697 v3 (15 Cores), Motherboard: Xen HVM domU v4.13, Chipset: Intel 440FX 82441FX PMC, Memory: 4096MB, Disk: 29GB, Graphics: bochs-drmdrmfb

	OS: Ubuntu 20.04, Kernel: 5.4.0-113-generic (x86_64), Vulkan: 1.1.182, Compiler: GCC 9.4.0, File-System: ext4, Screen Resolution: 1024x768, System Layer: Xen HVM domU 4.13

New Dell 630 Z1 LZ4: 

	Processor: 8 x Intel Xeon E5-2697 v3 (15 Cores), Motherboard: Xen HVM domU v4.13, Chipset: Intel 440FX 82441FX PMC, Memory: 4096MB, Disk: 29GB, Graphics: bochs-drmdrmfb

	OS: Ubuntu 20.04, Kernel: 5.4.0-113-generic (x86_64), Vulkan: 1.1.182, Compiler: GCC 9.4.0, File-System: ext4, Screen Resolution: 1024x768, System Layer: Xen HVM domU 4.13


Flexible IO Tester 3.29
Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 8KB - Disk Target: Default Test Directory
MB/s > Higher Is Better
DellRaid SSD ............. 220.0 |=======================================
ZFS NVME ................. 114.0 |====================
zfs compress off ......... 114.0 |====================
Single NVME Drive ........ 257.0 |=============================================
ZFS fresh no ashift ...... 110.0 |===================
ZFS ashift13 ............. 115.0 |====================
ZFS Mirror Stripe ........ 99.3  |=================
New Dell NVME Drives ..... 179.0 |===============================
Single ZFS NVME New R630 . 193.0 |==================================
New Dell 630 Z1 LZ4 ...... 191.0 |=================================


Flexible IO Tester 3.29
Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 8KB - Disk Target: Default Test Directory
IOPS > Higher Is Better
DellRaid SSD ............. 28129 |======================================
ZFS NVME ................. 14527 |====================
zfs compress off ......... 14620 |====================
Single NVME Drive ........ 32900 |=============================================
ZFS fresh no ashift ...... 14100 |===================
ZFS ashift13 ............. 14780 |====================
ZFS Mirror Stripe ........ 12708 |=================
New Dell NVME Drives ..... 22933 |===============================
Single ZFS NVME New R630 . 24640 |==================================
New Dell 630 Z1 LZ4 ...... 24493 |==================================


Flexible IO Tester 3.29
Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 8KB - Disk Target: Default Test Directory
MB/s > Higher Is Better
DellRaid SSD ............. 179.0 |========================================
ZFS NVME ................. 56.8  |=============
zfs compress off ......... 69.1  |================
Single NVME Drive ........ 199.0 |=============================================
ZFS fresh no ashift ...... 68.3  |===============
ZFS ashift13 ............. 69.8  |================
ZFS Mirror Stripe ........ 59.3  |=============
New Dell NVME Drives ..... 117.0 |==========================
Single ZFS NVME New R630 . 155.0 |===================================
New Dell 630 Z1 LZ4 ...... 111.0 |=========================


Flexible IO Tester 3.29
Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 8KB - Disk Target: Default Test Directory
IOPS > Higher Is Better
DellRaid SSD ............. 22925 |=========================================
ZFS NVME ................. 7264  |=============
zfs compress off ......... 8842  |================
Single NVME Drive ........ 25433 |=============================================
ZFS fresh no ashift ...... 8736  |===============
ZFS ashift13 ............. 8927  |================
ZFS Mirror Stripe ........ 7588  |=============
New Dell NVME Drives ..... 15067 |===========================
Single ZFS NVME New R630 . 19833 |===================================
New Dell 630 Z1 LZ4 ...... 14233 |=========================