05112023-TCST PVE-NVME-R10-4DISK-ZFS2.2-1 PVE-NVME-R10-4DISK-ZFS2.1: Processor: AMD EPYC 7543 32-Core (12 Cores), Motherboard: QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS), Chipset: Intel 82G33/G31/P35/P31 + ICH9, Memory: 16GB, Disk: 34GB QEMU HDD, Graphics: bochs-drmdrmfb, Audio: Intel 82801I, Monitor: QEMU Monitor, Network: Red Hat Virtio device OS: Ubuntu 22.04, Kernel: 5.15.0-86-generic (x86_64), Vulkan: 1.3.238, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1280x800, System Layer: KVM PVE-NVME-R10-4DISK-ZFS2.2: Processor: AMD EPYC 7543 32-Core (12 Cores), Motherboard: QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS), Chipset: Intel 82G33/G31/P35/P31 + ICH9, Memory: 16GB, Disk: 34GB QEMU HDD, Graphics: bochs-drmdrmfb, Audio: Intel 82801I, Monitor: QEMU Monitor, Network: Red Hat Virtio device OS: Ubuntu 22.04, Kernel: 5.15.0-88-generic (x86_64), Vulkan: 1.3.238, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1280x800, System Layer: KVM PVE-NVME-R10-4DISK-ZFS2.2-0: Processor: AMD EPYC 7543 32-Core (12 Cores), Motherboard: QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS), Chipset: Intel 82G33/G31/P35/P31 + ICH9, Memory: 16GB, Disk: 34GB QEMU HDD, Graphics: bochs-drmdrmfb, Audio: Intel 82801I, Monitor: QEMU Monitor, Network: Red Hat Virtio device OS: Ubuntu 22.04, Kernel: 5.15.0-88-generic (x86_64), Vulkan: 1.3.238, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1280x800, System Layer: KVM PVE-NVME-R10-4DISK-ZFS2.2-1: Processor: AMD EPYC 7543 32-Core (12 Cores), Motherboard: QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS), Chipset: Intel 82G33/G31/P35/P31 + ICH9, Memory: 16GB, Disk: 34GB QEMU HDD, Graphics: bochs-drmdrmfb, Audio: Intel 82801I, Monitor: QEMU Monitor, Network: Red Hat Virtio device OS: Ubuntu 22.04, Kernel: 5.15.0-88-generic (x86_64), Vulkan: 1.3.238, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1280x800, System Layer: KVM Flexible IO Tester 3.35 Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 52119 |================== PVE-NVME-R10-4DISK-ZFS2.2 ... 48157 |================= PVE-NVME-R10-4DISK-ZFS2.2-1 . 116261 |========================================= Flexible IO Tester 3.35 Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 3257.47 |================== PVE-NVME-R10-4DISK-ZFS2.2 ... 3009.81 |================= PVE-NVME-R10-4DISK-ZFS2.2-1 . 7266.30 |======================================== Flexible IO Tester 3.35 Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 127708 |==================================== PVE-NVME-R10-4DISK-ZFS2.2 ... 118691 |================================= PVE-NVME-R10-4DISK-ZFS2.2-1 . 146131 |========================================= Flexible IO Tester 3.35 Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 510833.62 |================================= PVE-NVME-R10-4DISK-ZFS2.2 ... 474764.96 |=============================== PVE-NVME-R10-4DISK-ZFS2.2-1 . 584524.11 |====================================== Flexible IO Tester 3.35 Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 131558 |==================================== PVE-NVME-R10-4DISK-ZFS2.2 ... 122330 |================================== PVE-NVME-R10-4DISK-ZFS2.2-1 . 149574 |========================================= Flexible IO Tester 3.35 Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 526231.73 |================================= PVE-NVME-R10-4DISK-ZFS2.2 ... 489319.73 |=============================== PVE-NVME-R10-4DISK-ZFS2.2-1 . 598294.79 |====================================== Flexible IO Tester 3.35 Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 4033 |==== PVE-NVME-R10-4DISK-ZFS2.2 ... 3814 |==== PVE-NVME-R10-4DISK-ZFS2.2-1 . 38607 |========================================== Flexible IO Tester 3.35 Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 4032.60 |==== PVE-NVME-R10-4DISK-ZFS2.2 ... 3814.21 |==== PVE-NVME-R10-4DISK-ZFS2.2-1 . 38607.54 |======================================= Flexible IO Tester 3.35 Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 60526 |====================== PVE-NVME-R10-4DISK-ZFS2.2 ... 55802 |==================== PVE-NVME-R10-4DISK-ZFS2.2-1 . 114254 |========================================= Flexible IO Tester 3.35 Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 3782.85 |===================== PVE-NVME-R10-4DISK-ZFS2.2 ... 3487.64 |==================== PVE-NVME-R10-4DISK-ZFS2.2-1 . 7140.86 |======================================== Flexible IO Tester 3.35 Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 3804 |===== PVE-NVME-R10-4DISK-ZFS2.2 ... 3606 |===== PVE-NVME-R10-4DISK-ZFS2.2-1 . 32756 |========================================== Flexible IO Tester 3.35 Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 3803.88 |===== PVE-NVME-R10-4DISK-ZFS2.2 ... 3606.58 |==== PVE-NVME-R10-4DISK-ZFS2.2-1 . 32755.76 |======================================= Flexible IO Tester 3.35 Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 27142 |================= PVE-NVME-R10-4DISK-ZFS2.2 ... 10264 |====== PVE-NVME-R10-4DISK-ZFS2.2-1 . 68670 |========================================== Flexible IO Tester 3.35 Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 1696.39 | PVE-NVME-R10-4DISK-ZFS2.2 ... 656928.12 |====================================== PVE-NVME-R10-4DISK-ZFS2.2-1 . 4291.90 | Flexible IO Tester 3.35 Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 2420 |============= PVE-NVME-R10-4DISK-ZFS2.2 ... 1378 |======= PVE-NVME-R10-4DISK-ZFS2.2-1 . 8073 |=========================================== Flexible IO Tester 3.35 Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 2419.83 |============ PVE-NVME-R10-4DISK-ZFS2.2 ... 1378.71 |======= PVE-NVME-R10-4DISK-ZFS2.2-1 . 8072.74 |======================================== Flexible IO Tester 3.35 Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 2554 |============== PVE-NVME-R10-4DISK-ZFS2.2 ... 2643 |=============== PVE-NVME-R10-4DISK-ZFS2.2-1 . 7732 |=========================================== Flexible IO Tester 3.35 Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 2554.28 |============= PVE-NVME-R10-4DISK-ZFS2.2 ... 2643.08 |============== PVE-NVME-R10-4DISK-ZFS2.2-1 . 7732.61 |======================================== Flexible IO Tester 3.35 Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 31437 |=================== PVE-NVME-R10-4DISK-ZFS2.2 ... 10978 |======= PVE-NVME-R10-4DISK-ZFS2.2-1 . 70512 |========================================== Flexible IO Tester 3.35 Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 1964.79 | PVE-NVME-R10-4DISK-ZFS2.2 ... 702583.68 |====================================== PVE-NVME-R10-4DISK-ZFS2.2-1 . 4407.00 | Flexible IO Tester 3.35 Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 93001 |=============================== PVE-NVME-R10-4DISK-ZFS2.2 ... 91556 |=============================== PVE-NVME-R10-4DISK-ZFS2.2-1 . 121819 |========================================= Flexible IO Tester 3.35 Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 372002.83 |============================= PVE-NVME-R10-4DISK-ZFS2.2 ... 366223.52 |============================= PVE-NVME-R10-4DISK-ZFS2.2-1 . 487276.45 |====================================== Flexible IO Tester 3.35 Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 88678 |=============================== PVE-NVME-R10-4DISK-ZFS2.2 ... 88991 |=============================== PVE-NVME-R10-4DISK-ZFS2.2-1 . 116590 |========================================= Flexible IO Tester 3.35 Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 354712.28 |============================= PVE-NVME-R10-4DISK-ZFS2.2 ... 355963.94 |============================= PVE-NVME-R10-4DISK-ZFS2.2-1 . 466359.46 |======================================