PVE-SATA-ZFS-RAID10-6Disks
PVE-NVME-ZFS-RAID10-4Disks


PVE-SATA-ZFS-RAID10-6Disks: 

	Processor: AMD EPYC 7402 24-Core (12 Cores), Motherboard: QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS), Chipset: Intel 82G33/G31/P35/P31 + ICH9, Memory: 16GB, Disk: 34GB QEMU HDD, Graphics: bochs-drmdrmfb, Audio: Intel 82801I, Monitor: QEMU Monitor, Network: Red Hat Virtio device

	OS: Ubuntu 22.04, Kernel: 5.15.0-84-generic (x86_64), Vulkan: 1.3.238, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1280x800, System Layer: KVM

PVE-SATA-ZFS-RAID10-8Disks: 

	Processor: AMD EPYC 7402 24-Core (12 Cores), Motherboard: QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS), Chipset: Intel 82G33/G31/P35/P31 + ICH9, Memory: 16GB, Disk: 34GB QEMU HDD, Graphics: bochs-drmdrmfb, Audio: Intel 82801I, Monitor: QEMU Monitor, Network: Red Hat Virtio device

	OS: Ubuntu 22.04, Kernel: 5.15.0-84-generic (x86_64), Vulkan: 1.3.238, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1280x800, System Layer: KVM

PVE-NVME-ZFS-RAID1-2Disks: 

	Processor: AMD EPYC 7402 24-Core (12 Cores), Motherboard: QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS), Chipset: Intel 82G33/G31/P35/P31 + ICH9, Memory: 16GB, Disk: 34GB QEMU HDD, Graphics: bochs-drmdrmfb, Audio: Intel 82801I, Monitor: QEMU Monitor, Network: Red Hat Virtio device

	OS: Ubuntu 22.04, Kernel: 5.15.0-84-generic (x86_64), Vulkan: 1.3.238, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1280x800, System Layer: KVM

PVE-SATA-ZFS-RAID10-8Disks 64K rec: 

	Processor: AMD EPYC 7402 24-Core (12 Cores), Motherboard: QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS), Chipset: Intel 82G33/G31/P35/P31 + ICH9, Memory: 16GB, Disk: 34GB QEMU HDD, Graphics: bochs-drmdrmfb, Audio: Intel 82801I, Monitor: QEMU Monitor, Network: Red Hat Virtio device

	OS: Ubuntu 22.04, Kernel: 5.15.0-86-generic (x86_64), Vulkan: 1.3.238, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1280x800, System Layer: KVM

PVE-SATA-ZFS-RAID10-8Disks-EPYC7543: 

	Processor: AMD EPYC 7543 32-Core (12 Cores), Motherboard: QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS), Chipset: Intel 82G33/G31/P35/P31 + ICH9, Memory: 16GB, Disk: 34GB QEMU HDD, Graphics: bochs-drmdrmfb, Audio: Intel 82801I, Monitor: QEMU Monitor, Network: Red Hat Virtio device

	OS: Ubuntu 22.04, Kernel: 5.15.0-86-generic (x86_64), Vulkan: 1.3.238, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1280x800, System Layer: KVM

PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-B: 

	Processor: AMD EPYC 7543 32-Core (12 Cores), Motherboard: QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS), Chipset: Intel 82G33/G31/P35/P31 + ICH9, Memory: 16GB, Disk: 34GB QEMU HDD, Graphics: bochs-drmdrmfb, Audio: Intel 82801I, Monitor: QEMU Monitor, Network: Red Hat Virtio device

	OS: Ubuntu 22.04, Kernel: 5.15.0-86-generic (x86_64), Vulkan: 1.3.238, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1280x800, System Layer: KVM

PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-C: 

	Processor: AMD EPYC 7543 32-Core (12 Cores), Motherboard: QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS), Chipset: Intel 82G33/G31/P35/P31 + ICH9, Memory: 16GB, Disk: 34GB QEMU HDD, Graphics: bochs-drmdrmfb, Audio: Intel 82801I, Monitor: QEMU Monitor, Network: Red Hat Virtio device

	OS: Ubuntu 22.04, Kernel: 5.15.0-86-generic (x86_64), Vulkan: 1.3.238, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1280x800, System Layer: KVM

PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-D: 

	Processor: AMD EPYC 7543 32-Core (12 Cores), Motherboard: QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS), Chipset: Intel 82G33/G31/P35/P31 + ICH9, Memory: 16GB, Disk: 34GB QEMU HDD, Graphics: bochs-drmdrmfb, Audio: Intel 82801I, Monitor: QEMU Monitor, Network: Red Hat Virtio device

	OS: Ubuntu 22.04, Kernel: 5.15.0-86-generic (x86_64), Vulkan: 1.3.238, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1280x800, System Layer: KVM

PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-E: 

	Processor: AMD EPYC 7543 32-Core (12 Cores), Motherboard: QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS), Chipset: Intel 82G33/G31/P35/P31 + ICH9, Memory: 16GB, Disk: 34GB QEMU HDD, Graphics: bochs-drmdrmfb, Audio: Intel 82801I, Monitor: QEMU Monitor, Network: Red Hat Virtio device

	OS: Ubuntu 22.04, Kernel: 5.15.0-86-generic (x86_64), Vulkan: 1.3.238, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1280x800, System Layer: KVM

PVE-NVME-ZFS-RAID10-4Disks: 

	Processor: AMD EPYC 7543 32-Core (12 Cores), Motherboard: QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS), Chipset: Intel 82G33/G31/P35/P31 + ICH9, Memory: 16GB, Disk: 34GB QEMU HDD, Graphics: bochs-drmdrmfb, Audio: Intel 82801I, Monitor: QEMU Monitor, Network: Red Hat Virtio device

	OS: Ubuntu 22.04, Kernel: 5.15.0-88-generic (x86_64), Vulkan: 1.3.238, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1280x800, System Layer: KVM


Flexible IO Tester 3.35
Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory
IOPS > Higher Is Better
PVE-SATA-ZFS-RAID10-6Disks ............ 17226 |========
PVE-SATA-ZFS-RAID10-8Disks ............ 22278 |==========
PVE-NVME-ZFS-RAID1-2Disks ............. 30889 |==============
PVE-SATA-ZFS-RAID10-8Disks 64K rec .... 2064  |=
PVE-SATA-ZFS-RAID10-8Disks-EPYC7543 ... 1397  |=
PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-E . 2327  |=
PVE-NVME-ZFS-RAID10-4Disks ............ 72217 |================================


Flexible IO Tester 3.35
Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory
MiB/s > Higher Is Better
PVE-SATA-ZFS-RAID10-6Disks ............ 1076.61   |
PVE-SATA-ZFS-RAID10-8Disks ............ 1392.38   |
PVE-NVME-ZFS-RAID1-2Disks ............. 1930.57   |
PVE-SATA-ZFS-RAID10-8Disks 64K rec .... 132112.15 |=========================
PVE-SATA-ZFS-RAID10-8Disks-EPYC7543 ... 89388.65  |=================
PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-E . 148966.74 |============================
PVE-NVME-ZFS-RAID10-4Disks ............ 4513.60   |=


Flexible IO Tester 3.35
Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory
IOPS > Higher Is Better
PVE-SATA-ZFS-RAID10-6Disks ............ 47603  |=========
PVE-SATA-ZFS-RAID10-8Disks ............ 75226  |==============
PVE-NVME-ZFS-RAID1-2Disks ............. 99918  |===================
PVE-SATA-ZFS-RAID10-8Disks 64K rec .... 125372 |========================
PVE-SATA-ZFS-RAID10-8Disks-EPYC7543 ... 86730  |=================
PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-D . 142235 |===========================
PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-E . 162438 |===============================
PVE-NVME-ZFS-RAID10-4Disks ............ 119521 |=======================


Flexible IO Tester 3.35
Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory
MiB/s > Higher Is Better
PVE-SATA-ZFS-RAID10-6Disks ............ 2975.23  |========
PVE-SATA-ZFS-RAID10-8Disks ............ 4701.61  |=============
PVE-NVME-ZFS-RAID1-2Disks ............. 6244.88  |==================
PVE-SATA-ZFS-RAID10-8Disks 64K rec .... 7835.74  |======================
PVE-SATA-ZFS-RAID10-8Disks-EPYC7543 ... 5420.61  |===============
PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-D . 8889.69  |=========================
PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-E . 10152.37 |=============================
PVE-NVME-ZFS-RAID10-4Disks ............ 7470.08  |=====================


Flexible IO Tester 3.35
Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory
IOPS > Higher Is Better
PVE-SATA-ZFS-RAID10-6Disks ............ 138501 |====================
PVE-SATA-ZFS-RAID10-8Disks ............ 142180 |====================
PVE-NVME-ZFS-RAID1-2Disks ............. 131797 |===================
PVE-SATA-ZFS-RAID10-8Disks 64K rec .... 156477 |======================
PVE-SATA-ZFS-RAID10-8Disks-EPYC7543 ... 204252 |=============================
PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-D . 219500 |===============================
PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-E . 206393 |=============================
PVE-NVME-ZFS-RAID10-4Disks ............ 159446 |=======================


Flexible IO Tester 3.35
Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory
MiB/s > Higher Is Better
PVE-SATA-ZFS-RAID10-6Disks ............ 554004.19 |==================
PVE-SATA-ZFS-RAID10-8Disks ............ 568722.14 |==================
PVE-NVME-ZFS-RAID1-2Disks ............. 527188.41 |=================
PVE-SATA-ZFS-RAID10-8Disks 64K rec .... 625906.39 |====================
PVE-SATA-ZFS-RAID10-8Disks-EPYC7543 ... 817008.53 |==========================
PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-D . 877998.31 |============================
PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-E . 825574.10 |==========================
PVE-NVME-ZFS-RAID10-4Disks ............ 637784.10 |====================


Flexible IO Tester 3.35
Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory
IOPS > Higher Is Better
PVE-SATA-ZFS-RAID10-6Disks ............ 103886 |=========================
PVE-SATA-ZFS-RAID10-8Disks ............ 114974 |===========================
PVE-NVME-ZFS-RAID1-2Disks ............. 92950  |======================
PVE-SATA-ZFS-RAID10-8Disks 64K rec .... 4778   |=
PVE-SATA-ZFS-RAID10-8Disks-EPYC7543 ... 5039   |=
PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-D . 5451   |=
PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-E . 5761   |=
PVE-NVME-ZFS-RAID10-4Disks ............ 131158 |===============================


Flexible IO Tester 3.35
Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory
MiB/s > Higher Is Better
PVE-SATA-ZFS-RAID10-6Disks ............ 415546.15 |======================
PVE-SATA-ZFS-RAID10-8Disks ............ 459895.50 |=========================
PVE-NVME-ZFS-RAID1-2Disks ............. 371799.24 |====================
PVE-SATA-ZFS-RAID10-8Disks 64K rec .... 19110.37  |=
PVE-SATA-ZFS-RAID10-8Disks-EPYC7543 ... 20155.92  |=
PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-D . 21803.52  |=
PVE-SATA-ZFS-RAID10-8Disks-EPYC7543-E . 23043.37  |=
PVE-NVME-ZFS-RAID10-4Disks ............ 524630.36 |============================