truenas VMware testing on Debian 12 via the Phoronix Test Suite. TrueNAS 13 NFS: Processor: AMD Ryzen 9 5900X 12-Core (8 Cores), Motherboard: Xen HVM domU v4.13, Chipset: Intel 440FX 82441FX PMC, Memory: 6GB, Disk: 29GB, Graphics: bochs-drmdrmfb OS: Ubuntu 22.04, Kernel: 5.15.0-60-generic (x86_64), Vulkan: 1.3.224, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1024x768, System Layer: Xen HVM domU 4.13 TrueNAS 13 iSCSI: Processor: AMD Ryzen 9 5900X 12-Core (8 Cores), Motherboard: Xen HVM domU v4.13, Chipset: Intel 440FX 82441FX PMC, Memory: 6GB, Disk: 29GB, Graphics: bochs-drmdrmfb OS: Ubuntu 22.04, Kernel: 5.15.0-60-generic (x86_64), Vulkan: 1.3.224, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1024x768, System Layer: Xen HVM domU 4.13 TrueNAS Scale 22.12 NFS: Processor: AMD Ryzen 9 5900X 12-Core (8 Cores), Motherboard: Xen HVM domU v4.13, Chipset: Intel 440FX 82441FX PMC, Memory: 6GB, Disk: 29GB, Graphics: bochs-drmdrmfb OS: Ubuntu 22.04, Kernel: 5.15.0-60-generic (x86_64), Vulkan: 1.3.224, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1024x768, System Layer: Xen HVM domU 4.13 TrueNAS Scale 22.12 iSCSI: Processor: AMD Ryzen 9 5900X 12-Core (8 Cores), Motherboard: Xen HVM domU v4.13, Chipset: Intel 440FX 82441FX PMC, Memory: 6GB, Disk: 29GB, Graphics: bochs-drmdrmfb OS: Ubuntu 22.04, Kernel: 5.15.0-60-generic (x86_64), Vulkan: 1.3.224, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1024x768, System Layer: Xen HVM domU 4.13 XCP-NG NFS: Processor: 8 x Intel Xeon E5645 (15 Cores), Motherboard: Xen HVM domU v4.13, Chipset: Intel 440FX 82441FX PMC, Memory: 1 x 8188 MB RAM, Disk: 11GB, Graphics: Cirrus Logic GD 5446 OS: Debian 12, Kernel: 6.1.0-11-amd64 (x86_64), Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1024x768, System Layer: Xen HVM domU 4.13 VMWare TrueNAS 13 NFS: Processor: 8 x Intel Xeon Gold 6226R (15 Cores), Motherboard: Intel 440BX (6.00 BIOS), Chipset: Intel 440BX/ZX/DX, Memory: 1 x 8 GB DRAM, Disk: 69GB Virtual disk + 107GB Virtual disk, Graphics: VMware SVGA II, Network: VMware VMXNET3 OS: Debian 12, Kernel: 6.1.0-11-amd64 (x86_64), Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 800x600, System Layer: VMware Flexible IO Tester 3.29 Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test Directory MB/s > Higher Is Better TrueNAS 13 NFS ............ 770 |============================== TrueNAS 13 iSCSI .......... 475 |================== TrueNAS Scale 22.12 NFS ... 1044 |======================================== TrueNAS Scale 22.12 iSCSI . 794 |=============================== XCP-NG NFS ................ 478 |================== VMWare TrueNAS 13 NFS ..... 1167 |============================================= Flexible IO Tester 3.29 Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test Directory IOPS > Higher Is Better TrueNAS 13 NFS ............ 766 |============================== TrueNAS 13 iSCSI .......... 471 |================== TrueNAS Scale 22.12 NFS ... 1041 |======================================== TrueNAS Scale 22.12 iSCSI . 791 |=============================== XCP-NG NFS ................ 474 |================== VMWare TrueNAS 13 NFS ..... 1164 |============================================= Flexible IO Tester 3.29 Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory MB/s > Higher Is Better TrueNAS 13 NFS ............ 231.0 |========================= TrueNAS 13 iSCSI .......... 252.0 |=========================== TrueNAS Scale 22.12 NFS ... 180.0 |==================== TrueNAS Scale 22.12 iSCSI . 226.0 |======================== XCP-NG NFS ................ 79.5 |========= VMWare TrueNAS 13 NFS ..... 406.0 |============================================ Flexible IO Tester 3.29 Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory IOPS > Higher Is Better TrueNAS 13 NFS ............ 59007 |======================== TrueNAS 13 iSCSI .......... 64487 |=========================== TrueNAS Scale 22.12 NFS ... 46100 |=================== TrueNAS Scale 22.12 iSCSI . 57967 |======================== XCP-NG NFS ................ 20335 |======== VMWare TrueNAS 13 NFS ..... 104000 |=========================================== Flexible IO Tester 3.29 Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 8MB - Disk Target: Default Test Directory MB/s > Higher Is Better TrueNAS 13 NFS ............ 860 |================================= TrueNAS 13 iSCSI .......... 541 |==================== TrueNAS Scale 22.12 NFS ... 1069 |======================================== TrueNAS Scale 22.12 iSCSI . 815 |=============================== XCP-NG NFS ................ 541 |==================== VMWare TrueNAS 13 NFS ..... 1190 |============================================= Flexible IO Tester 3.29 Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 8MB - Disk Target: Default Test Directory IOPS > Higher Is Better TrueNAS 13 NFS ............ 104 |================================= TrueNAS 13 iSCSI .......... 64 |==================== TrueNAS Scale 22.12 NFS ... 130 |========================================= TrueNAS Scale 22.12 iSCSI . 98 |=============================== XCP-NG NFS ................ 64 |==================== VMWare TrueNAS 13 NFS ..... 145 |============================================== Flexible IO Tester 3.29 Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test Directory MB/s > Higher Is Better TrueNAS 13 NFS ............ 654.00 |============================= TrueNAS 13 iSCSI .......... 957.00 |========================================== TrueNAS Scale 22.12 NFS ... 876.10 |======================================= TrueNAS Scale 22.12 iSCSI . 647.94 |============================= XCP-NG NFS ................ 423.00 |=================== VMWare TrueNAS 13 NFS ..... 972.00 |=========================================== Flexible IO Tester 3.29 Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test Directory IOPS > Higher Is Better TrueNAS 13 NFS ............ 650 |=============================== TrueNAS 13 iSCSI .......... 953 |============================================= TrueNAS Scale 22.12 NFS ... 872 |========================================= TrueNAS Scale 22.12 iSCSI . 644 |=============================== XCP-NG NFS ................ 420 |==================== VMWare TrueNAS 13 NFS ..... 969 |============================================== Flexible IO Tester 3.29 Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory MB/s > Higher Is Better TrueNAS 13 NFS ............ 202.00 |======================= TrueNAS 13 iSCSI .......... 377.00 |=========================================== TrueNAS Scale 22.12 NFS ... 184.00 |===================== TrueNAS Scale 22.12 iSCSI . 189.07 |====================== XCP-NG NFS ................ 54.40 |====== VMWare TrueNAS 13 NFS ..... 235.00 |=========================== Flexible IO Tester 3.29 Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory IOPS > Higher Is Better TrueNAS 13 NFS ............ 51713 |======================== TrueNAS 13 iSCSI .......... 96483 |============================================ TrueNAS Scale 22.12 NFS ... 47120 |===================== TrueNAS Scale 22.12 iSCSI . 48383 |====================== XCP-NG NFS ................ 13919 |====== VMWare TrueNAS 13 NFS ..... 60300 |=========================== Flexible IO Tester 3.29 Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 8MB - Disk Target: Default Test Directory MB/s > Higher Is Better TrueNAS 13 NFS ............ 680 |============================== TrueNAS 13 iSCSI .......... 845 |===================================== TrueNAS Scale 22.12 NFS ... 1022 |============================================= TrueNAS Scale 22.12 iSCSI . 782 |================================== XCP-NG NFS ................ 534 |======================= VMWare TrueNAS 13 NFS ..... 1029 |============================================= Flexible IO Tester 3.29 Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 8MB - Disk Target: Default Test Directory IOPS > Higher Is Better TrueNAS 13 NFS ............ 81 |============================== TrueNAS 13 iSCSI .......... 102 |====================================== TrueNAS Scale 22.12 NFS ... 124 |============================================== TrueNAS Scale 22.12 iSCSI . 94 |=================================== XCP-NG NFS ................ 63 |======================= VMWare TrueNAS 13 NFS ..... 125 |============================================== Flexible IO Tester 3.29 Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory MB/s > Higher Is Better TrueNAS 13 NFS ............ 459 |================== TrueNAS 13 iSCSI .......... 467 |================== TrueNAS Scale 22.12 NFS ... 1035 |======================================== TrueNAS Scale 22.12 iSCSI . 791 |=============================== XCP-NG NFS ................ 624 |======================== VMWare TrueNAS 13 NFS ..... 1162 |============================================= Flexible IO Tester 3.29 Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory IOPS > Higher Is Better TrueNAS 13 NFS ............ 3668 |================== TrueNAS 13 iSCSI .......... 3735 |================== TrueNAS Scale 22.12 NFS ... 8274 |======================================== TrueNAS Scale 22.12 iSCSI . 6324 |=============================== XCP-NG NFS ................ 4989 |======================== VMWare TrueNAS 13 NFS ..... 9296 |============================================= Flexible IO Tester 3.29 Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory MB/s > Higher Is Better TrueNAS 13 NFS ............ 624 |========================== TrueNAS 13 iSCSI .......... 876 |===================================== TrueNAS Scale 22.12 NFS ... 1007 |=========================================== TrueNAS Scale 22.12 iSCSI . 697 |============================== XCP-NG NFS ................ 523 |====================== VMWare TrueNAS 13 NFS ..... 1061 |============================================= Flexible IO Tester 3.29 Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory IOPS > Higher Is Better TrueNAS 13 NFS ............ 4992 |========================== TrueNAS 13 iSCSI .......... 7003 |===================================== TrueNAS Scale 22.12 NFS ... 8051 |=========================================== TrueNAS Scale 22.12 iSCSI . 5573 |============================== XCP-NG NFS ................ 4178 |====================== VMWare TrueNAS 13 NFS ..... 8479 |============================================= Flexible IO Tester 3.29 Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test Directory MB/s > Higher Is Better TrueNAS 13 NFS ............ 979 |====================================== TrueNAS 13 iSCSI .......... 898 |=================================== TrueNAS Scale 22.12 NFS ... 1051 |======================================== TrueNAS Scale 22.12 iSCSI . 801 |=============================== XCP-NG NFS ................ 655 |========================= VMWare TrueNAS 13 NFS ..... 1171 |============================================= Flexible IO Tester 3.29 Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test Directory IOPS > Higher Is Better TrueNAS 13 NFS ............ 976 |====================================== TrueNAS 13 iSCSI .......... 894 |================================== TrueNAS Scale 22.12 NFS ... 1047 |======================================== TrueNAS Scale 22.12 iSCSI . 798 |=============================== XCP-NG NFS ................ 651 |========================= VMWare TrueNAS 13 NFS ..... 1168 |============================================= Flexible IO Tester 3.29 Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory MB/s > Higher Is Better TrueNAS 13 NFS ............ 433 |============================================== TrueNAS 13 iSCSI .......... 383 |========================================= TrueNAS Scale 22.12 NFS ... 369 |======================================= TrueNAS Scale 22.12 iSCSI . 344 |===================================== XCP-NG NFS ................ 173 |================== Flexible IO Tester 3.29 Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory IOPS > Higher Is Better TrueNAS 13 NFS ............ 110927 |=========================================== TrueNAS 13 iSCSI .......... 98107 |====================================== TrueNAS Scale 22.12 NFS ... 94533 |===================================== TrueNAS Scale 22.12 iSCSI . 88200 |================================== XCP-NG NFS ................ 44186 |================= Flexible IO Tester 3.29 Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 8MB - Disk Target: Default Test Directory MB/s > Higher Is Better TrueNAS 13 NFS ............ 1012 |========================================== TrueNAS 13 iSCSI .......... 522 |====================== TrueNAS Scale 22.12 NFS ... 1077 |============================================= TrueNAS Scale 22.12 iSCSI . 810 |================================== XCP-NG NFS ................ 650 |=========================== Flexible IO Tester 3.29 Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 8MB - Disk Target: Default Test Directory IOPS > Higher Is Better TrueNAS 13 NFS ............ 123 |=========================================== TrueNAS 13 iSCSI .......... 62 |====================== TrueNAS Scale 22.12 NFS ... 131 |============================================== TrueNAS Scale 22.12 iSCSI . 98 |================================== XCP-NG NFS ................ 78 |=========================== Flexible IO Tester 3.29 Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test Directory MB/s > Higher Is Better TrueNAS 13 NFS ............ 669 |=============================== TrueNAS 13 iSCSI .......... 919 |========================================== TrueNAS Scale 22.12 NFS ... 995 |============================================== TrueNAS Scale 22.12 iSCSI . 713 |================================= XCP-NG NFS ................ 533 |========================= Flexible IO Tester 3.29 Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test Directory IOPS > Higher Is Better TrueNAS 13 NFS ............ 665 |=============================== TrueNAS 13 iSCSI .......... 915 |========================================== TrueNAS Scale 22.12 NFS ... 991 |============================================== TrueNAS Scale 22.12 iSCSI . 710 |================================= XCP-NG NFS ................ 529 |========================= Flexible IO Tester 3.29 Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory MB/s > Higher Is Better TrueNAS 13 NFS ............ 308 |====================== TrueNAS 13 iSCSI .......... 635 |============================================== TrueNAS Scale 22.12 NFS ... 366 |=========================== TrueNAS Scale 22.12 iSCSI . 386 |============================ XCP-NG NFS ................ 134 |========== Flexible IO Tester 3.29 Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test Directory IOPS > Higher Is Better TrueNAS 13 NFS ............ 78933 |===================== TrueNAS 13 iSCSI .......... 162667 |=========================================== TrueNAS Scale 22.12 NFS ... 93700 |========================= TrueNAS Scale 22.12 iSCSI . 98733 |========================== XCP-NG NFS ................ 34250 |========= Flexible IO Tester 3.29 Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 8MB - Disk Target: Default Test Directory MB/s > Higher Is Better TrueNAS 13 NFS ............ 683 |================================= TrueNAS 13 iSCSI .......... 964 |============================================== TrueNAS Scale 22.12 NFS ... 949 |============================================= TrueNAS Scale 22.12 iSCSI . 697 |================================= XCP-NG NFS ................ 595 |============================ Flexible IO Tester 3.29 Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 8MB - Disk Target: Default Test Directory IOPS > Higher Is Better TrueNAS 13 NFS ............ 82 |================================ TrueNAS 13 iSCSI .......... 117 |============================================== TrueNAS Scale 22.12 NFS ... 115 |============================================= TrueNAS Scale 22.12 iSCSI . 83 |================================= XCP-NG NFS ................ 71 |============================ Flexible IO Tester 3.29 Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory MB/s > Higher Is Better TrueNAS 13 NFS ............ 977 |========================================== TrueNAS 13 iSCSI .......... 589 |========================= TrueNAS Scale 22.12 NFS ... 1050 |============================================= TrueNAS Scale 22.12 iSCSI . 789 |================================== XCP-NG NFS ................ 672 |============================= Flexible IO Tester 3.29 Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory IOPS > Higher Is Better TrueNAS 13 NFS ............ 7810 |========================================== TrueNAS 13 iSCSI .......... 4706 |========================= TrueNAS Scale 22.12 NFS ... 8401 |============================================= TrueNAS Scale 22.12 iSCSI . 6310 |================================== XCP-NG NFS ................ 5370 |============================= Flexible IO Tester 3.29 Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory MB/s > Higher Is Better TrueNAS 13 NFS ............ 656.0 |============================== TrueNAS 13 iSCSI .......... 738.4 |================================== TrueNAS Scale 22.12 NFS ... 968.0 |============================================ TrueNAS Scale 22.12 iSCSI . 738.0 |================================== XCP-NG NFS ................ 557.0 |========================= Flexible IO Tester 3.29 Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 128KB - Disk Target: Default Test Directory IOPS > Higher Is Better TrueNAS 13 NFS ............ 5247 |=============================== TrueNAS 13 iSCSI .......... 5903 |================================== TrueNAS Scale 22.12 NFS ... 7741 |============================================= TrueNAS Scale 22.12 iSCSI . 5902 |================================== XCP-NG NFS ................ 4453 |==========================