FreeBSD ZFS Hypervisor
AMD Ryzen 5 3600 6-Core testing on FreeBSD via the Phoronix Test Suite.


Physical: 

	Processor: AMD Ryzen 5 3600 6-Core @ 3.60GHz (12 Cores), Chipset: AMD [AMD] Starship/Matisse Root Complex, Memory: 64GB, Disk: Samsung SSD 980 1TB, Graphics: ASPEED, Audio: AMD X570 HDA

	OS: FreeBSD, Kernel: 13.0-RELEASE (x86_64), Compiler: GCC 10.3.0 + Clang 11.0.1, File-System: zfs, Screen Resolution: 800x600

Hyper-V Server 2022 gen2 ZFS #1: 

	Processor: AMD Ryzen 5 3600 6-Core (4 Cores), Motherboard: Microsoft Virtual Machine Hyper-V UEFI v4.1 (Hyper-V BIOS), Memory: 4096MB, Disk: Msft Virtual Disk 1.0

	OS: FreeBSD, Kernel: 13.0-RELEASE-p4 (x86_64), Compiler: GCC 10.3.0 + Clang 11.0.1, File-System: zfs, Screen Resolution: 1024x768

Hyper-V Server 2019 gen2 UFS: 

	Processor: AMD Ryzen 5 3600 6-Core (4 Cores), Motherboard: Microsoft Virtual Machine Hyper-V UEFI v4.0 (Hyper-V BIOS), Memory: 4096MB, Disk: Msft Virtual Disk 1.0

	OS: FreeBSD, Kernel: 13.0-RELEASE-p4 (x86_64), Compiler: GCC 10.3.0 + Clang 11.0.1, File-System: ufs, Screen Resolution: 1024x768

Hyper-V Server 2019 gen2 ZFS: 

	Processor: AMD Ryzen 5 3600 6-Core (4 Cores), Motherboard: Microsoft Virtual Machine Hyper-V UEFI v4.0 (Hyper-V BIOS), Memory: 4096MB, Disk: Msft Virtual Disk 1.0

	OS: FreeBSD, Kernel: 13.0-RELEASE (x86_64), Compiler: GCC 10.3.0 + Clang 11.0.1, File-System: zfs, Screen Resolution: 1024x768

Hyper-V Server 2022 gen2 UFS: 

	Processor: AMD Ryzen 5 3600 6-Core (4 Cores), Motherboard: Microsoft Virtual Machine Hyper-V UEFI v4.1 (Hyper-V BIOS), Memory: 4096MB, Disk: Msft Virtual Disk 1.0

	OS: FreeBSD, Kernel: 13.0-RELEASE (x86_64), Compiler: GCC 10.3.0 + Clang 11.0.1, File-System: ufs, Screen Resolution: 1024x768

Hyper-V Server 2022 gen2 ZFS #2: 

	Processor: AMD Ryzen 5 3600 6-Core (4 Cores), Motherboard: Microsoft Virtual Machine Hyper-V UEFI v4.1 (Hyper-V BIOS), Memory: 4096MB, Disk: Msft Virtual Disk 1.0

	OS: FreeBSD, Kernel: 13.0-RELEASE-p4 (x86_64), Compiler: GCC 10.3.0 + Clang 11.0.1, File-System: zfs, Screen Resolution: 1024x768

Proxmox 7 ZFS: 

	Processor: Common KVM (4 Cores), Motherboard: QEMU Standard PC (i440FX + PIIX 1996) pc-i440fx-6.0, Chipset: Intel 440FX 82441FX PMC [Natoma], Memory: 4096MB, Disk: 47GB, Graphics: Intel 82371AB/EB/MB PIIX4 ACPI

	OS: FreeBSD, Kernel: 13.0-RELEASE (x86_64), Compiler: GCC 10.3.0 + Clang 11.0.1, File-System: zfs

XCP-ng 8.2 ZFS: 

	Processor: AMD Ryzen 5 3600 6-Core (4 Cores), Motherboard: Xen HVM domU 4.13, Chipset: Intel 440FX 82441FX PMC [Natoma], Memory: 4096MB, Disk: 47GB, Graphics: Cirrus Logic GD 5446

	OS: FreeBSD, Kernel: 13.0-RELEASE-p4 (x86_64), Compiler: GCC 10.3.0 + Clang 11.0.1, File-System: zfs


BlogBench 1.1
Test: Read
Final Score > Higher Is Better
Physical ........................ 1927724 |====================================
Hyper-V Server 2022 gen2 ZFS #1 . 878994  |================
Hyper-V Server 2019 gen2 UFS .... 754487  |==============
Hyper-V Server 2019 gen2 ZFS .... 939801  |==================
Hyper-V Server 2022 gen2 UFS .... 636646  |============
Proxmox 7 ZFS ................... 1132456 |=====================
XCP-ng 8.2 ZFS .................. 1355701 |=========================


BlogBench 1.1
Test: Write
Final Score > Higher Is Better
Physical ........................ 13102 |======================================
Hyper-V Server 2022 gen2 ZFS #1 . 1498  |====
Hyper-V Server 2019 gen2 UFS .... 671   |==
Hyper-V Server 2019 gen2 ZFS .... 1199  |===
Hyper-V Server 2022 gen2 UFS .... 3050  |=========
Proxmox 7 ZFS ................... 1267  |====
XCP-ng 8.2 ZFS .................. 5398  |================


t-test1 2017-01-13
Threads: 1
Seconds < Lower Is Better
Physical ........................ 8.250  |==================
Hyper-V Server 2022 gen2 ZFS #1 . 16.019 |===================================
Hyper-V Server 2019 gen2 UFS .... 16.447 |====================================
Hyper-V Server 2019 gen2 ZFS .... 16.387 |====================================
Hyper-V Server 2022 gen2 UFS .... 16.774 |=====================================
Proxmox 7 ZFS ................... 9.161  |====================
XCP-ng 8.2 ZFS .................. 16.148 |====================================


t-test1 2017-01-13
Threads: 2
Seconds < Lower Is Better
Physical ........................ 2.691 |=================
Hyper-V Server 2022 gen2 ZFS #1 . 5.705 |====================================
Hyper-V Server 2019 gen2 UFS .... 5.621 |====================================
Hyper-V Server 2019 gen2 ZFS .... 5.722 |====================================
Hyper-V Server 2022 gen2 UFS .... 5.966 |======================================
Proxmox 7 ZFS ................... 3.295 |=====================
XCP-ng 8.2 ZFS .................. 4.642 |==============================


iPerf 3.7
Server Address: 192.168.1.27 - Server Port: 5201 - Duration: 360 Seconds - Test: TCP - Parallel: 20
Mbits/sec > Higher Is Better
Physical ........................ 885 |======================================
Hyper-V Server 2022 gen2 ZFS #1 . 941 |========================================
Hyper-V Server 2019 gen2 UFS .... 939 |========================================
Hyper-V Server 2019 gen2 ZFS .... 940 |========================================
Hyper-V Server 2022 gen2 UFS .... 940 |========================================
Proxmox 7 ZFS ................... 941 |========================================
XCP-ng 8.2 ZFS .................. 941 |========================================


John The Ripper 1.9.0-jumbo-1
Test: Blowfish
Real C/S > Higher Is Better
Physical ........................ 8867 |=======================================
Hyper-V Server 2022 gen2 ZFS #1 . 1838 |========
Hyper-V Server 2019 gen2 UFS .... 1822 |========
Hyper-V Server 2019 gen2 ZFS .... 1812 |========
Hyper-V Server 2022 gen2 UFS .... 1818 |========
Proxmox 7 ZFS ................... 6510 |=============================
XCP-ng 8.2 ZFS .................. 6195 |===========================


John The Ripper 1.9.0-jumbo-1
Test: MD5
Real C/S > Higher Is Better
Physical ........................ 310526 |================================
Hyper-V Server 2022 gen2 ZFS #1 . 120610 |============
Hyper-V Server 2019 gen2 UFS .... 119774 |============
Hyper-V Server 2019 gen2 ZFS .... 120686 |============
Hyper-V Server 2022 gen2 UFS .... 119980 |============
Proxmox 7 ZFS ................... 175935 |==================
XCP-ng 8.2 ZFS .................. 362831 |=====================================


7-Zip Compression 16.02
Compress Speed Test
MIPS > Higher Is Better
Physical ........................ 43391 |======================================
Hyper-V Server 2022 gen2 ZFS #1 . 8828  |========
Hyper-V Server 2019 gen2 UFS .... 8524  |=======
Hyper-V Server 2019 gen2 ZFS .... 8458  |=======
Hyper-V Server 2022 gen2 UFS .... 8359  |=======
Proxmox 7 ZFS ................... 20333 |==================
XCP-ng 8.2 ZFS .................. 19548 |=================


OpenSSL 3.0
Algorithm: SHA256
byte/s > Higher Is Better
Physical ........................ 9184935510 |=================================
Hyper-V Server 2022 gen2 ZFS #1 . 1696724313 |======
Hyper-V Server 2019 gen2 UFS .... 1733037107 |======
Hyper-V Server 2019 gen2 ZFS .... 1818648249 |=======
Hyper-V Server 2022 gen2 UFS .... 1695300020 |======
Proxmox 7 ZFS ................... 1074437310 |====
XCP-ng 8.2 ZFS .................. 3694399100 |=============


OpenSSL 3.0
Algorithm: RSA4096
sign/s > Higher Is Better
Physical ........................ 1748.8 |=====================================
Hyper-V Server 2022 gen2 ZFS #1 . 318.5  |=======
Hyper-V Server 2019 gen2 UFS .... 323.6  |=======
Hyper-V Server 2019 gen2 ZFS .... 326.3  |=======
Hyper-V Server 2022 gen2 UFS .... 318.8  |=======
Proxmox 7 ZFS ................... 780.8  |=================
XCP-ng 8.2 ZFS .................. 1095.4 |=======================


OpenSSL 3.0
Algorithm: RSA4096
verify/s > Higher Is Better
Physical ........................ 113146.4 |===================================
Hyper-V Server 2022 gen2 ZFS #1 . 20825.1  |======
Hyper-V Server 2019 gen2 UFS .... 21469.3  |=======
Hyper-V Server 2019 gen2 ZFS .... 20817.2  |======
Hyper-V Server 2022 gen2 UFS .... 20691.5  |======
Proxmox 7 ZFS ................... 51093.4  |================
XCP-ng 8.2 ZFS .................. 72872.1  |=======================


PostgreSQL pgbench 13.0
Scaling Factor: 1 - Clients: 100 - Mode: Read Only
TPS > Higher Is Better
Physical ..................... 204649 |========================================
Hyper-V Server 2019 gen2 UFS . 43893  |=========
Hyper-V Server 2019 gen2 ZFS . 42388  |========
Proxmox 7 ZFS ................ 67017  |=============
XCP-ng 8.2 ZFS ............... 83988  |================


PostgreSQL pgbench 13.0
Scaling Factor: 1 - Clients: 100 - Mode: Read Only - Average Latency
ms < Lower Is Better
Physical ..................... 0.489 |========
Hyper-V Server 2019 gen2 UFS . 2.279 |========================================
Hyper-V Server 2019 gen2 ZFS . 2.360 |=========================================
Proxmox 7 ZFS ................ 1.492 |==========================
XCP-ng 8.2 ZFS ............... 1.191 |=====================


PostgreSQL pgbench 13.0
Scaling Factor: 1 - Clients: 100 - Mode: Read Write
TPS > Higher Is Better
Physical ..................... 1608 |=================================
Hyper-V Server 2019 gen2 UFS . 1672 |==================================
Hyper-V Server 2019 gen2 ZFS . 767  |================
Proxmox 7 ZFS ................ 635  |=============
XCP-ng 8.2 ZFS ............... 2067 |==========================================


PostgreSQL pgbench 13.0
Scaling Factor: 1 - Clients: 100 - Mode: Read Write - Average Latency
ms < Lower Is Better
Physical ..................... 62.18  |===============
Hyper-V Server 2019 gen2 UFS . 59.83  |==============
Hyper-V Server 2019 gen2 ZFS . 130.36 |===============================
Proxmox 7 ZFS ................ 169.75 |========================================
XCP-ng 8.2 ZFS ............... 48.81  |============


SQLite Speedtest 3.30
Timed Time - Size 1,000
Seconds < Lower Is Better
Physical ........................ 88.01  |=====
Hyper-V Server 2022 gen2 ZFS #1 . 658.19 |=====================================
Hyper-V Server 2019 gen2 UFS .... 125.22 |=======
Hyper-V Server 2019 gen2 ZFS .... 567.08 |================================
Hyper-V Server 2022 gen2 UFS .... 125.61 |=======
Proxmox 7 ZFS ................... 607.51 |==================================
XCP-ng 8.2 ZFS .................. 401.76 |=======================


nginx 1.21.1
Concurrent Requests: 100
Requests Per Second > Higher Is Better
Physical ........................ 224.70 |=====================================
Hyper-V Server 2022 gen2 ZFS #1 . 203.77 |==================================
Hyper-V Server 2019 gen2 UFS .... 203.92 |==================================
Hyper-V Server 2019 gen2 ZFS .... 203.75 |==================================
Hyper-V Server 2022 gen2 UFS .... 204.22 |==================================
Proxmox 7 ZFS ................... 206.46 |==================================
XCP-ng 8.2 ZFS .................. 205.51 |==================================


Apache HTTP Server 2.4.48
Concurrent Requests: 100
Requests Per Second > Higher Is Better
Physical ........................ 104396.27 |==================================
Hyper-V Server 2022 gen2 ZFS #1 . 26738.70  |=========
Hyper-V Server 2019 gen2 UFS .... 30532.74  |==========
Hyper-V Server 2019 gen2 ZFS .... 26539.34  |=========
Hyper-V Server 2022 gen2 UFS .... 31019.81  |==========
Proxmox 7 ZFS ................... 22418.65  |=======
XCP-ng 8.2 ZFS .................. 49812.86  |================


PHPBench 0.8.1
PHP Benchmark Suite
Score > Higher Is Better
Physical ........................ 457046 |=================================
Hyper-V Server 2022 gen2 ZFS #1 . 238950 |=================
Hyper-V Server 2019 gen2 UFS .... 239316 |=================
Hyper-V Server 2019 gen2 ZFS .... 259131 |===================
Hyper-V Server 2022 gen2 UFS .... 263094 |===================
Proxmox 7 ZFS ................... 321349 |=======================
XCP-ng 8.2 ZFS .................. 509500 |=====================================


PostgreSQL pgbench 14.0
Scaling Factor: 1 - Clients: 100 - Mode: Read Only
TPS > Higher Is Better
Hyper-V Server 2022 gen2 ZFS #1 . 44192 |======================================
Hyper-V Server 2022 gen2 UFS .... 41812 |====================================


PostgreSQL pgbench 14.0
Scaling Factor: 1 - Clients: 100 - Mode: Read Only - Average Latency
ms < Lower Is Better
Hyper-V Server 2022 gen2 ZFS #1 . 2.263 |====================================
Hyper-V Server 2022 gen2 UFS .... 2.392 |======================================


PostgreSQL pgbench 14.0
Scaling Factor: 1 - Clients: 100 - Mode: Read Write
TPS > Higher Is Better
Hyper-V Server 2022 gen2 ZFS #1 . 436  |==========
Hyper-V Server 2022 gen2 UFS .... 1777 |=======================================


PostgreSQL pgbench 14.0
Scaling Factor: 1 - Clients: 100 - Mode: Read Write - Average Latency
ms < Lower Is Better
Hyper-V Server 2022 gen2 ZFS #1 . 249.65 |=====================================
Hyper-V Server 2022 gen2 UFS .... 56.29  |========