05112023-TCST PVE-NVME-R10-4DISK-LVM PVE-NVME-R10-4DISK-ZFS2.1: Processor: AMD EPYC 7543 32-Core (12 Cores), Motherboard: QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS), Chipset: Intel 82G33/G31/P35/P31 + ICH9, Memory: 16GB, Disk: 34GB QEMU HDD, Graphics: bochs-drmdrmfb, Audio: Intel 82801I, Monitor: QEMU Monitor, Network: Red Hat Virtio device OS: Ubuntu 22.04, Kernel: 5.15.0-86-generic (x86_64), Vulkan: 1.3.238, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1280x800, System Layer: KVM PVE-NVME-R10-4DISK-ZFS2.2: Processor: AMD EPYC 7543 32-Core (12 Cores), Motherboard: QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS), Chipset: Intel 82G33/G31/P35/P31 + ICH9, Memory: 16GB, Disk: 34GB QEMU HDD, Graphics: bochs-drmdrmfb, Audio: Intel 82801I, Monitor: QEMU Monitor, Network: Red Hat Virtio device OS: Ubuntu 22.04, Kernel: 5.15.0-88-generic (x86_64), Vulkan: 1.3.238, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1280x800, System Layer: KVM PVE-NVME-R10-4DISK-LVM: Processor: AMD EPYC 7543 32-Core (12 Cores), Motherboard: QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS), Chipset: Intel 82G33/G31/P35/P31 + ICH9, Memory: 16GB, Disk: 34GB QEMU HDD, Graphics: bochs-drmdrmfb, Audio: Intel 82801I, Monitor: QEMU Monitor, Network: Red Hat Virtio device OS: Ubuntu 22.04, Kernel: 5.15.0-88-generic (x86_64), Vulkan: 1.3.238, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1280x800, System Layer: KVM Flexible IO Tester 3.35 Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 . 4032.60 |========= PVE-NVME-R10-4DISK-ZFS2.2 . 3814.21 |======== PVE-NVME-R10-4DISK-LVM .... 18807.88 |========================================= Flexible IO Tester 3.35 Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 . 4033 |========= PVE-NVME-R10-4DISK-ZFS2.2 . 3814 |========= PVE-NVME-R10-4DISK-LVM .... 18808 |============================================ Flexible IO Tester 3.35 Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 . 510833.62 |============================= PVE-NVME-R10-4DISK-ZFS2.2 . 474764.96 |=========================== PVE-NVME-R10-4DISK-LVM .... 696247.30 |======================================== Flexible IO Tester 3.35 Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 . 127708 |================================ PVE-NVME-R10-4DISK-ZFS2.2 . 118691 |============================= PVE-NVME-R10-4DISK-LVM .... 174062 |=========================================== Flexible IO Tester 3.35 Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 . 3782.85 |=================== PVE-NVME-R10-4DISK-ZFS2.2 . 3487.64 |================== PVE-NVME-R10-4DISK-LVM .... 8276.15 |========================================== Flexible IO Tester 3.35 Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 . 60526 |==================== PVE-NVME-R10-4DISK-ZFS2.2 . 55802 |================== PVE-NVME-R10-4DISK-LVM .... 132418 |=========================================== Flexible IO Tester 3.35 Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 . 2554.28 |=============== PVE-NVME-R10-4DISK-ZFS2.2 . 2643.08 |================ PVE-NVME-R10-4DISK-LVM .... 6922.49 |========================================== Flexible IO Tester 3.35 Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 . 2554 |================= PVE-NVME-R10-4DISK-ZFS2.2 . 2643 |================= PVE-NVME-R10-4DISK-LVM .... 6922 |============================================= Flexible IO Tester 3.35 Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 . 354712.28 |============================== PVE-NVME-R10-4DISK-ZFS2.2 . 355963.94 |============================== PVE-NVME-R10-4DISK-LVM .... 470866.56 |======================================== Flexible IO Tester 3.35 Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 . 88678 |================================ PVE-NVME-R10-4DISK-ZFS2.2 . 88991 |================================= PVE-NVME-R10-4DISK-LVM .... 117717 |=========================================== Flexible IO Tester 3.35 Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 . 1964.79 | PVE-NVME-R10-4DISK-ZFS2.2 . 702583.68 |======================================== PVE-NVME-R10-4DISK-LVM .... 6124.38 | Flexible IO Tester 3.35 Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 . 31437 |============== PVE-NVME-R10-4DISK-ZFS2.2 . 10978 |===== PVE-NVME-R10-4DISK-LVM .... 97990 |============================================ Flexible IO Tester 3.35 Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 . 3803.88 |======== PVE-NVME-R10-4DISK-ZFS2.2 . 3606.58 |======= PVE-NVME-R10-4DISK-LVM .... 20037.94 |========================================= Flexible IO Tester 3.35 Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 . 3804 |======== PVE-NVME-R10-4DISK-ZFS2.2 . 3606 |======== PVE-NVME-R10-4DISK-LVM .... 20038 |============================================ Flexible IO Tester 3.35 Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 . 526231.73 |================================ PVE-NVME-R10-4DISK-ZFS2.2 . 489319.73 |============================== PVE-NVME-R10-4DISK-LVM .... 659491.14 |======================================== Flexible IO Tester 3.35 Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 . 131558 |================================== PVE-NVME-R10-4DISK-ZFS2.2 . 122330 |================================ PVE-NVME-R10-4DISK-LVM .... 164873 |=========================================== Flexible IO Tester 3.35 Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 . 3257.47 |================= PVE-NVME-R10-4DISK-ZFS2.2 . 3009.81 |================ PVE-NVME-R10-4DISK-LVM .... 7999.78 |========================================== Flexible IO Tester 3.35 Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 . 52119 |================== PVE-NVME-R10-4DISK-ZFS2.2 . 48157 |================ PVE-NVME-R10-4DISK-LVM .... 127996 |=========================================== Flexible IO Tester 3.35 Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 . 2419.83 |=============== PVE-NVME-R10-4DISK-ZFS2.2 . 1378.71 |========= PVE-NVME-R10-4DISK-LVM .... 6807.31 |========================================== Flexible IO Tester 3.35 Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 . 2420 |================ PVE-NVME-R10-4DISK-ZFS2.2 . 1378 |========= PVE-NVME-R10-4DISK-LVM .... 6807 |============================================= Flexible IO Tester 3.35 Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 . 372002.83 |============================== PVE-NVME-R10-4DISK-ZFS2.2 . 366223.52 |============================= PVE-NVME-R10-4DISK-LVM .... 499262.03 |======================================== Flexible IO Tester 3.35 Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 . 93001 |================================ PVE-NVME-R10-4DISK-ZFS2.2 . 91556 |================================ PVE-NVME-R10-4DISK-LVM .... 124815 |=========================================== Flexible IO Tester 3.35 Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 . 1696.39 | PVE-NVME-R10-4DISK-ZFS2.2 . 656928.12 |======================================== PVE-NVME-R10-4DISK-LVM .... 6266.22 | Flexible IO Tester 3.35 Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 . 27142 |============ PVE-NVME-R10-4DISK-ZFS2.2 . 10264 |==== PVE-NVME-R10-4DISK-LVM .... 100259 |===========================================