sa3400d PVE-NVME-R10-4DISK-fio iSCSI XCP-NG: Processor: 2 x AMD Ryzen 9 5900X 12-Core (32 Cores), Motherboard: Xen HVM domU v4.13, Chipset: Intel 440FX 82441FX PMC, Memory: 16GB, Disk: 29GB, Graphics: bochs-drmdrmfb OS: Ubuntu 22.04, Kernel: 5.15.0-82-generic (x86_64), Vulkan: 1.3.238, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1024x768, System Layer: Xen HVM domU 4.13 NFS XCP-NG: Processor: 2 x AMD Ryzen 9 5900X 12-Core (32 Cores), Motherboard: Xen HVM domU v4.13, Chipset: Intel 440FX 82441FX PMC, Memory: 16GB, Disk: 29GB, Graphics: bochs-drmdrmfb OS: Ubuntu 22.04, Kernel: 5.15.0-82-generic (x86_64), Vulkan: 1.3.238, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1024x768, System Layer: Xen HVM domU 4.13 PVE-SAS-SSD-fio: Processor: 2 x Intel Xeon Gold 6152 (12 Cores), Motherboard: QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS), Chipset: Intel 82G33/G31/P35/P31 + ICH9, Memory: 16GB, Disk: 34GB QEMU HDD, Graphics: bochs-drmdrmfb, Audio: Intel 82801I, Monitor: QEMU Monitor, Network: Red Hat Virtio device OS: Ubuntu 22.04, Kernel: 5.15.0-84-generic (x86_64), Vulkan: 1.3.238, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1280x800, System Layer: KVM PVE-SATA-SSD-fio: Processor: 2 x Intel Xeon Gold 6152 (12 Cores), Motherboard: QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS), Chipset: Intel 82G33/G31/P35/P31 + ICH9, Memory: 16GB, Disk: 34GB QEMU HDD, Graphics: bochs-drmdrmfb, Audio: Intel 82801I, Monitor: QEMU Monitor, Network: Red Hat Virtio device OS: Ubuntu 22.04, Kernel: 5.15.0-84-generic (x86_64), Vulkan: 1.3.238, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1280x800, System Layer: KVM XCP-NVME-R1-fio: Processor: 3 x AMD EPYC 7402 24-Core (12 Cores), Motherboard: Xen HVM domU v4.13, Chipset: Intel 440FX 82441FX PMC, Memory: 16GB, Disk: 30GB, Graphics: bochs-drmdrmfb OS: Ubuntu 22.04, Kernel: 5.15.0-84-generic (x86_64), Vulkan: 1.3.238, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1024x768, System Layer: Xen HVM domU 4.13 PVE-NVME-R10-4DISK-fio: Processor: AMD EPYC 7543 32-Core (12 Cores), Motherboard: QEMU Standard PC (Q35 + ICH9 2009) (3.20230228-4 BIOS), Chipset: Intel 82G33/G31/P35/P31 + ICH9, Memory: 16GB, Disk: 34GB QEMU HDD, Graphics: bochs-drmdrmfb, Audio: Intel 82801I, Monitor: QEMU Monitor, Network: Red Hat Virtio device OS: Ubuntu 22.04, Kernel: 5.15.0-86-generic (x86_64), Vulkan: 1.3.238, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1280x800, System Layer: KVM Flexible IO Tester 3.35 Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better iSCSI XCP-NG ........... 1421 |===== NFS XCP-NG ............. 1428 |===== PVE-SAS-SSD-fio ........ 3638 |============ PVE-SATA-SSD-fio ....... 1760 |====== XCP-NVME-R1-fio ........ 1230 |==== PVE-NVME-R10-4DISK-fio . 14670 |=============================================== Flexible IO Tester 3.35 Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better iSCSI XCP-NG ........... 114883 |========================== NFS XCP-NG ............. 78360 |================= PVE-SAS-SSD-fio ........ 113147 |========================= PVE-SATA-SSD-fio ....... 77689 |================= XCP-NVME-R1-fio ........ 98732 |====================== PVE-NVME-R10-4DISK-fio . 206395 |============================================== Flexible IO Tester 3.35 Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better iSCSI XCP-NG ........... 22563 |======= NFS XCP-NG ............. 21320 |====== PVE-SAS-SSD-fio ........ 63416 |=================== PVE-SATA-SSD-fio ....... 26213 |======== XCP-NVME-R1-fio ........ 20140 |====== PVE-NVME-R10-4DISK-fio . 155349 |============================================== Flexible IO Tester 3.35 Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better iSCSI XCP-NG ........... 1413 |=========================== NFS XCP-NG ............. 1293 |======================== PVE-SAS-SSD-fio ........ 2555 |================================================ PVE-SATA-SSD-fio ....... 942 |================== XCP-NVME-R1-fio ........ 1051 |==================== PVE-NVME-R10-4DISK-fio . 451 |======== Flexible IO Tester 3.35 Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better iSCSI XCP-NG ........... 104425 |============================================== NFS XCP-NG ............. 38995 |================= PVE-SAS-SSD-fio ........ 92847 |========================================= PVE-SATA-SSD-fio ....... 72796 |================================ XCP-NVME-R1-fio ........ 74646 |================================= PVE-NVME-R10-4DISK-fio . 10350 |===== Flexible IO Tester 3.35 Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better iSCSI XCP-NG ........... 18496 |=================== NFS XCP-NG ............. 18277 |=================== PVE-SAS-SSD-fio ........ 46184 |=============================================== PVE-SATA-SSD-fio ....... 14848 |=============== XCP-NVME-R1-fio ........ 14649 |=============== PVE-NVME-R10-4DISK-fio . 4081 |==== Flexible IO Tester 3.35 Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better iSCSI XCP-NG ........... 1408 |==== NFS XCP-NG ............. 1433 |==== PVE-SAS-SSD-fio ........ 4347 |============ PVE-SATA-SSD-fio ....... 1751 |===== XCP-NVME-R1-fio ........ 1241 |=== PVE-NVME-R10-4DISK-fio . 17205 |=============================================== Flexible IO Tester 3.35 Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better iSCSI XCP-NG ........... 172976 |======================================= NFS XCP-NG ............. 128753 |============================= PVE-SAS-SSD-fio ........ 133298 |============================== PVE-SATA-SSD-fio ....... 82878 |================== XCP-NVME-R1-fio ........ 117149 |========================== PVE-NVME-R10-4DISK-fio . 206319 |============================================== Flexible IO Tester 3.35 Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better iSCSI XCP-NG ........... 23052 |======== NFS XCP-NG ............. 21829 |======= PVE-SAS-SSD-fio ........ 70995 |======================= PVE-SATA-SSD-fio ....... 26318 |========= XCP-NVME-R1-fio ........ 19106 |====== PVE-NVME-R10-4DISK-fio . 141146 |============================================== Flexible IO Tester 3.35 Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better iSCSI XCP-NG ........... 1426 |=========================== NFS XCP-NG ............. 1233 |======================= PVE-SAS-SSD-fio ........ 2579 |================================================ PVE-SATA-SSD-fio ....... 939 |================= XCP-NVME-R1-fio ........ 1057 |==================== PVE-NVME-R10-4DISK-fio . 438 |======== Flexible IO Tester 3.35 Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better iSCSI XCP-NG ........... 152111 |============================================== NFS XCP-NG ............. 119967 |==================================== PVE-SAS-SSD-fio ........ 98926 |============================== PVE-SATA-SSD-fio ....... 75861 |======================= XCP-NVME-R1-fio ........ 115737 |=================================== PVE-NVME-R10-4DISK-fio . 10696 |=== Flexible IO Tester 3.35 Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory IOPS > Higher Is Better iSCSI XCP-NG ........... 21654 |========================== NFS XCP-NG ............. 19287 |======================= PVE-SAS-SSD-fio ........ 38964 |=============================================== PVE-SATA-SSD-fio ....... 15031 |================== XCP-NVME-R1-fio ........ 16870 |==================== PVE-NVME-R10-4DISK-fio . 3968 |===== Flexible IO Tester 3.35 Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better iSCSI XCP-NG ........... 1421.57 |==== NFS XCP-NG ............. 1428.42 |==== PVE-SAS-SSD-fio ........ 3637.90 |=========== PVE-SATA-SSD-fio ....... 1760.23 |===== XCP-NVME-R1-fio ........ 1229.70 |==== PVE-NVME-R10-4DISK-fio . 14670.08 |============================================ Flexible IO Tester 3.35 Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better iSCSI XCP-NG ........... 459533.60 |======================== NFS XCP-NG ............. 313440.58 |================ PVE-SAS-SSD-fio ........ 452587.87 |======================== PVE-SATA-SSD-fio ....... 310754.79 |================ XCP-NVME-R1-fio ........ 394930.20 |===================== PVE-NVME-R10-4DISK-fio . 825579.89 |=========================================== Flexible IO Tester 3.35 Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better iSCSI XCP-NG ........... 1410.17 |======= NFS XCP-NG ............. 1332.50 |====== PVE-SAS-SSD-fio ........ 3963.50 |================== PVE-SATA-SSD-fio ....... 1638.35 |======== XCP-NVME-R1-fio ........ 1258.78 |====== PVE-NVME-R10-4DISK-fio . 9709.30 |============================================= Flexible IO Tester 3.35 Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better iSCSI XCP-NG ........... 1412.98 | NFS XCP-NG ............. 1292.83 | PVE-SAS-SSD-fio ........ 2554.68 | PVE-SATA-SSD-fio ....... 964833.15 |=========================================== XCP-NVME-R1-fio ........ 1050.91 | PVE-NVME-R10-4DISK-fio . 461886.65 |===================== Flexible IO Tester 3.35 Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better iSCSI XCP-NG ........... 417699.01 |=========================================== NFS XCP-NG ............. 155981.56 |================ PVE-SAS-SSD-fio ........ 371388.68 |====================================== PVE-SATA-SSD-fio ....... 291184.11 |============================== XCP-NVME-R1-fio ........ 298582.89 |=============================== PVE-NVME-R10-4DISK-fio . 41400.86 |==== Flexible IO Tester 3.35 Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better iSCSI XCP-NG ........... 1155.99 | NFS XCP-NG ............. 1142.29 | PVE-SAS-SSD-fio ........ 2886.52 | PVE-SATA-SSD-fio ....... 950301.23 |=========================================== XCP-NVME-R1-fio ........ 937533.04 |========================================== PVE-NVME-R10-4DISK-fio . 261184.32 |============ Flexible IO Tester 3.35 Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better iSCSI XCP-NG ........... 1408.40 |==== NFS XCP-NG ............. 1433.42 |==== PVE-SAS-SSD-fio ........ 4303.10 |=========== PVE-SATA-SSD-fio ....... 1751.68 |==== XCP-NVME-R1-fio ........ 1241.23 |=== PVE-NVME-R10-4DISK-fio . 17205.02 |============================================ Flexible IO Tester 3.35 Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better iSCSI XCP-NG ........... 691904.82 |==================================== NFS XCP-NG ............. 515012.43 |=========================== PVE-SAS-SSD-fio ........ 533191.80 |============================ PVE-SATA-SSD-fio ....... 331512.34 |================= XCP-NVME-R1-fio ........ 468597.96 |======================== PVE-NVME-R10-4DISK-fio . 825277.61 |=========================================== Flexible IO Tester 3.35 Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better iSCSI XCP-NG ........... 1440.74 |======= NFS XCP-NG ............. 1364.32 |======= PVE-SAS-SSD-fio ........ 4437.18 |======================= PVE-SATA-SSD-fio ....... 1644.91 |======== XCP-NVME-R1-fio ........ 1194.14 |====== PVE-NVME-R10-4DISK-fio . 8821.62 |============================================= Flexible IO Tester 3.35 Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better iSCSI XCP-NG ........... 1426.38 | NFS XCP-NG ............. 1232.61 | PVE-SAS-SSD-fio ........ 2579.66 | PVE-SATA-SSD-fio ....... 961583.68 |=========================================== XCP-NVME-R1-fio ........ 1057.44 | PVE-NVME-R10-4DISK-fio . 449049.27 |==================== Flexible IO Tester 3.35 Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better iSCSI XCP-NG ........... 608445.48 |=========================================== NFS XCP-NG ............. 479869.15 |================================== PVE-SAS-SSD-fio ........ 395704.27 |============================ PVE-SATA-SSD-fio ....... 303445.16 |===================== XCP-NVME-R1-fio ........ 462947.31 |================================= PVE-NVME-R10-4DISK-fio . 42783.45 |=== Flexible IO Tester 3.35 Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Job Count: 1 - Disk Target: Default Test Directory MiB/s > Higher Is Better iSCSI XCP-NG ........... 1353.39 | NFS XCP-NG ............. 1205.44 | PVE-SAS-SSD-fio ........ 2435.24 | PVE-SATA-SSD-fio ....... 961989.10 |=========================================== XCP-NVME-R1-fio ........ 270225.16 |============ PVE-NVME-R10-4DISK-fio . 253974.01 |===========