05112023-TCST PVE-NVME-R10-4DISK-LVM-THIN PVE-NVME-R10-4DISK-ZFS2.1: Processor: AMD EPYC 7543 32-Core (12 Cores), Motherboard: QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS), Chipset: Intel 82G33/G31/P35/P31 + ICH9, Memory: 16GB, Disk: 34GB QEMU HDD, Graphics: bochs-drmdrmfb, Audio: Intel 82801I, Monitor: QEMU Monitor, Network: Red Hat Virtio device OS: Ubuntu 22.04, Kernel: 5.15.0-86-generic (x86_64), Vulkan: 1.3.238, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1280x800, System Layer: KVM PVE-NVME-R10-4DISK-ZFS2.2: Processor: AMD EPYC 7543 32-Core (12 Cores), Motherboard: QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS), Chipset: Intel 82G33/G31/P35/P31 + ICH9, Memory: 16GB, Disk: 34GB QEMU HDD, Graphics: bochs-drmdrmfb, Audio: Intel 82801I, Monitor: QEMU Monitor, Network: Red Hat Virtio device OS: Ubuntu 22.04, Kernel: 5.15.0-88-generic (x86_64), Vulkan: 1.3.238, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1280x800, System Layer: KVM PVE-NVME-R10-4DISK-LVM: Processor: AMD EPYC 7543 32-Core (12 Cores), Motherboard: QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS), Chipset: Intel 82G33/G31/P35/P31 + ICH9, Memory: 16GB, Disk: 34GB QEMU HDD, Graphics: bochs-drmdrmfb, Audio: Intel 82801I, Monitor: QEMU Monitor, Network: Red Hat Virtio device OS: Ubuntu 22.04, Kernel: 5.15.0-88-generic (x86_64), Vulkan: 1.3.238, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1280x800, System Layer: KVM PVE-NVME-R10-4DISK-LVM-THIN: Processor: AMD EPYC 9354 32-Core (12 Cores), Motherboard: QEMU Standard PC (Q35 + ICH9 2009) (4.2023.08-2 BIOS), Chipset: Intel 82G33/G31/P35/P31 + ICH9, Memory: 16GB, Disk: 34GB QEMU HDD, Graphics: bochs-drmdrmfb, Audio: Intel 82801I, Monitor: QEMU Monitor, Network: Red Hat Virtio device OS: Ubuntu 22.04, Kernel: 5.15.0-84-generic (x86_64), Vulkan: 1.3.238, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1280x800, System Layer: KVM Flexible IO Tester 3.35 Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 31437 |============= PVE-NVME-R10-4DISK-ZFS2.2 ... 10978 |===== PVE-NVME-R10-4DISK-LVM ...... 97990 |========================================== PVE-NVME-R10-4DISK-LVM-THIN . 77542 |================================= Flexible IO Tester 3.35 Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 3804 |======== PVE-NVME-R10-4DISK-ZFS2.2 ... 3606 |======== PVE-NVME-R10-4DISK-LVM ...... 20038 |========================================== PVE-NVME-R10-4DISK-LVM-THIN . 19692 |========================================= Flexible IO Tester 3.35 Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 3803.88 |======= PVE-NVME-R10-4DISK-ZFS2.2 ... 3606.58 |======= PVE-NVME-R10-4DISK-LVM ...... 20037.94 |======================================= PVE-NVME-R10-4DISK-LVM-THIN . 19691.68 |====================================== Flexible IO Tester 3.35 Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 4033 |========= PVE-NVME-R10-4DISK-ZFS2.2 ... 3814 |======== PVE-NVME-R10-4DISK-LVM ...... 18808 |========================================== PVE-NVME-R10-4DISK-LVM-THIN . 19004 |========================================== Flexible IO Tester 3.35 Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 4032.60 |======== PVE-NVME-R10-4DISK-ZFS2.2 ... 3814.21 |======== PVE-NVME-R10-4DISK-LVM ...... 18807.88 |======================================= PVE-NVME-R10-4DISK-LVM-THIN . 19003.62 |======================================= Flexible IO Tester 3.35 Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 1964.79 | PVE-NVME-R10-4DISK-ZFS2.2 ... 702583.68 |====================================== PVE-NVME-R10-4DISK-LVM ...... 6124.38 | PVE-NVME-R10-4DISK-LVM-THIN . 4846.36 | Flexible IO Tester 3.35 Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 3257.47 |=============== PVE-NVME-R10-4DISK-ZFS2.2 ... 3009.81 |============== PVE-NVME-R10-4DISK-LVM ...... 7999.78 |===================================== PVE-NVME-R10-4DISK-LVM-THIN . 8546.58 |======================================== Flexible IO Tester 3.35 Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 52119 |================ PVE-NVME-R10-4DISK-ZFS2.2 ... 48157 |============== PVE-NVME-R10-4DISK-LVM ...... 127996 |====================================== PVE-NVME-R10-4DISK-LVM-THIN . 136745 |========================================= Flexible IO Tester 3.35 Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 2554 |================ PVE-NVME-R10-4DISK-ZFS2.2 ... 2643 |================ PVE-NVME-R10-4DISK-LVM ...... 6922 |=========================================== PVE-NVME-R10-4DISK-LVM-THIN . 6392 |======================================== Flexible IO Tester 3.35 Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 2554.28 |=============== PVE-NVME-R10-4DISK-ZFS2.2 ... 2643.08 |=============== PVE-NVME-R10-4DISK-LVM ...... 6922.49 |======================================== PVE-NVME-R10-4DISK-LVM-THIN . 6392.34 |===================================== Flexible IO Tester 3.35 Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 60526 |================== PVE-NVME-R10-4DISK-ZFS2.2 ... 55802 |================ PVE-NVME-R10-4DISK-LVM ...... 132418 |======================================= PVE-NVME-R10-4DISK-LVM-THIN . 140015 |========================================= Flexible IO Tester 3.35 Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 3782.85 |================= PVE-NVME-R10-4DISK-ZFS2.2 ... 3487.64 |================ PVE-NVME-R10-4DISK-LVM ...... 8276.15 |====================================== PVE-NVME-R10-4DISK-LVM-THIN . 8750.94 |======================================== Flexible IO Tester 3.35 Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 93001 |====================== PVE-NVME-R10-4DISK-ZFS2.2 ... 91556 |===================== PVE-NVME-R10-4DISK-LVM ...... 124815 |============================= PVE-NVME-R10-4DISK-LVM-THIN . 175268 |========================================= Flexible IO Tester 3.35 Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 372002.83 |==================== PVE-NVME-R10-4DISK-ZFS2.2 ... 366223.52 |==================== PVE-NVME-R10-4DISK-LVM ...... 499262.03 |=========================== PVE-NVME-R10-4DISK-LVM-THIN . 701071.06 |====================================== Flexible IO Tester 3.35 Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 354712.28 |====================== PVE-NVME-R10-4DISK-ZFS2.2 ... 355963.94 |====================== PVE-NVME-R10-4DISK-LVM ...... 470866.56 |============================= PVE-NVME-R10-4DISK-LVM-THIN . 609544.81 |====================================== Flexible IO Tester 3.35 Type: Random Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 88678 |======================== PVE-NVME-R10-4DISK-ZFS2.2 ... 88991 |======================== PVE-NVME-R10-4DISK-LVM ...... 117717 |================================ PVE-NVME-R10-4DISK-LVM-THIN . 152386 |========================================= Flexible IO Tester 3.35 Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 510833.62 |======================== PVE-NVME-R10-4DISK-ZFS2.2 ... 474764.96 |======================= PVE-NVME-R10-4DISK-LVM ...... 696247.30 |================================= PVE-NVME-R10-4DISK-LVM-THIN . 800373.64 |====================================== Flexible IO Tester 3.35 Type: Random Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 127708 |========================== PVE-NVME-R10-4DISK-ZFS2.2 ... 118691 |======================== PVE-NVME-R10-4DISK-LVM ...... 174062 |==================================== PVE-NVME-R10-4DISK-LVM-THIN . 200093 |========================================= Flexible IO Tester 3.35 Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 526231.73 |============================ PVE-NVME-R10-4DISK-ZFS2.2 ... 489319.73 |========================== PVE-NVME-R10-4DISK-LVM ...... 659491.14 |=================================== PVE-NVME-R10-4DISK-LVM-THIN . 714517.97 |====================================== Flexible IO Tester 3.35 Type: Sequential Read - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 131558 |============================== PVE-NVME-R10-4DISK-ZFS2.2 ... 122330 |============================ PVE-NVME-R10-4DISK-LVM ...... 164873 |====================================== PVE-NVME-R10-4DISK-LVM-THIN . 178629 |========================================= Flexible IO Tester 3.35 Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 27142 |=========== PVE-NVME-R10-4DISK-ZFS2.2 ... 10264 |==== PVE-NVME-R10-4DISK-LVM ...... 100259 |========================================= PVE-NVME-R10-4DISK-LVM-THIN . 89246 |==================================== Flexible IO Tester 3.35 Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 1696.39 | PVE-NVME-R10-4DISK-ZFS2.2 ... 656928.12 |====================================== PVE-NVME-R10-4DISK-LVM ...... 6266.22 | PVE-NVME-R10-4DISK-LVM-THIN . 5577.91 | Flexible IO Tester 3.35 Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 2420 |=============== PVE-NVME-R10-4DISK-ZFS2.2 ... 1378 |========= PVE-NVME-R10-4DISK-LVM ...... 6807 |=========================================== PVE-NVME-R10-4DISK-LVM-THIN . 6109 |======================================= Flexible IO Tester 3.35 Type: Sequential Write - Engine: IO_uring - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better PVE-NVME-R10-4DISK-ZFS2.1 ... 2419.83 |============== PVE-NVME-R10-4DISK-ZFS2.2 ... 1378.71 |======== PVE-NVME-R10-4DISK-LVM ...... 6807.31 |======================================== PVE-NVME-R10-4DISK-LVM-THIN . 6108.63 |====================================