truenas

VMware testing on Debian 12 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2403242-WBON-240323464
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
TrueNAS 13 NFS
February 11 2023
  3 Hours, 54 Minutes
TrueNAS 13 iSCSI
February 12 2023
  3 Hours, 9 Minutes
TrueNAS Scale 22.12 NFS
February 14 2023
  1 Hour, 49 Minutes
TrueNAS Scale 22.12 iSCSI
February 14 2023
  1 Hour, 43 Minutes
XCP-NG NFS
March 23
  2 Hours, 57 Minutes
XCP-NG TrueNAS 13 iSCSI
March 23
  1 Hour, 31 Minutes
VMWare TrueNAS 13 NFS
March 23
  1 Hour, 43 Minutes
VMWare TrueNAS 13 NFS green
March 24
  1 Hour, 58 Minutes
Invert Hiding All Results Option
  2 Hours, 20 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


truenasProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelVulkanCompilerFile-SystemScreen ResolutionSystem LayerTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFSVMWare TrueNAS 13 NFS greenAMD Ryzen 9 5900X 12-Core (8 Cores)Xen HVM domU v4.13Intel 440FX 82441FX PMC6GB29GBbochs-drmdrmfbUbuntu 22.045.15.0-60-generic (x86_64)1.3.224GCC 11.3.0ext41024x768Xen HVM domU 4.138 x Intel Xeon E5645 (15 Cores)1 x 8188 MB RAM11GBCirrus Logic GD 5446Debian 126.1.0-11-amd64 (x86_64)GCC 12.2.08 x Intel Xeon Gold 6226R (15 Cores)Intel 440BX (6.00 BIOS)Intel 440BX/ZX/DX1 x 8 GB DRAM69GB Virtual disk + 107GB Virtual diskVMware SVGA IIVMware VMXNET3800x600VMwareOpenBenchmarking.orgKernel Details- TrueNAS 13 NFS: Transparent Huge Pages: madvise- TrueNAS 13 iSCSI: Transparent Huge Pages: madvise- TrueNAS Scale 22.12 NFS: Transparent Huge Pages: madvise- TrueNAS Scale 22.12 iSCSI: Transparent Huge Pages: madvise- XCP-NG NFS: Transparent Huge Pages: always- XCP-NG TrueNAS 13 iSCSI: Transparent Huge Pages: always- VMWare TrueNAS 13 NFS: Transparent Huge Pages: always- VMWare TrueNAS 13 NFS green: Transparent Huge Pages: alwaysCompiler Details- TrueNAS 13 NFS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - TrueNAS 13 iSCSI: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - TrueNAS Scale 22.12 NFS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - TrueNAS Scale 22.12 iSCSI: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - XCP-NG NFS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-bTRWOB/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-bTRWOB/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - XCP-NG TrueNAS 13 iSCSI: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-bTRWOB/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-bTRWOB/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - VMWare TrueNAS 13 NFS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-bTRWOB/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-bTRWOB/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - VMWare TrueNAS 13 NFS green: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-bTRWOB/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-bTRWOB/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- TrueNAS 13 NFS: CPU Microcode: 0xa20120a- TrueNAS 13 iSCSI: CPU Microcode: 0xa20120a- TrueNAS Scale 22.12 NFS: CPU Microcode: 0xa20120a- TrueNAS Scale 22.12 iSCSI: CPU Microcode: 0xa20120a- XCP-NG NFS: CPU Microcode: 0x1f- XCP-NG TrueNAS 13 iSCSI: CPU Microcode: 0x1f- VMWare TrueNAS 13 NFS: CPU Microcode: 0x5003302- VMWare TrueNAS 13 NFS green: CPU Microcode: 0x5003302Disk Mount Options Details- TrueNAS 13 NFS: relatime,rw- TrueNAS 13 iSCSI: relatime,rw- TrueNAS Scale 22.12 NFS: relatime,rw- TrueNAS Scale 22.12 iSCSI: relatime,rw- XCP-NG NFS: errors=remount-ro,relatime,rw- XCP-NG TrueNAS 13 iSCSI: errors=remount-ro,relatime,rwDisk Details Details- TrueNAS 13 NFS, TrueNAS 13 iSCSI, TrueNAS Scale 22.12 NFS, TrueNAS Scale 22.12 iSCSI, XCP-NG NFS, XCP-NG TrueNAS 13 iSCSI: Block Size: 4096Security Details- TrueNAS 13 NFS: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - TrueNAS 13 iSCSI: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - TrueNAS Scale 22.12 NFS: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - TrueNAS Scale 22.12 iSCSI: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - XCP-NG NFS: gather_data_sampling: Not affected + itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Mitigation of PTE Inversion + mds: Vulnerable: Clear buffers attempted no microcode; SMT Host state unknown + meltdown: Mitigation of PTI + mmio_stale_data: Unknown: No mitigations + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - XCP-NG TrueNAS 13 iSCSI: gather_data_sampling: Not affected + itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Mitigation of PTE Inversion + mds: Vulnerable: Clear buffers attempted no microcode; SMT Host state unknown + meltdown: Mitigation of PTI + mmio_stale_data: Unknown: No mitigations + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - VMWare TrueNAS 13 NFS: gather_data_sampling: Unknown: Dependent on hypervisor status + itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT Host state unknown + retbleed: Mitigation of Enhanced IBRS + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - VMWare TrueNAS 13 NFS green: gather_data_sampling: Unknown: Dependent on hypervisor status + itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Vulnerable: Clear buffers attempted no microcode; SMT Host state unknown + retbleed: Mitigation of Enhanced IBRS + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected Disk Details- VMWare TrueNAS 13 NFS, VMWare TrueNAS 13 NFS green: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096

TrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFSVMWare TrueNAS 13 NFS greenLogarithmic Result OverviewPhoronix Test SuiteFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterRand Write - Linux AIO - No - No - 4KBRand Write - Linux AIO - No - No - 4KBRand Read - Linux AIO - No - No - 4KBRand Read - Linux AIO - No - No - 4KBSeq Read - Linux AIO - No - No - 4KBSeq Read - Linux AIO - No - No - 4KBRand Write - Linux AIO - No - No - 1MBRand Write - Linux AIO - No - No - 1MBRand Read - Linux AIO - No - No - 128KBRand Read - Linux AIO - No - No - 128KBRand Read - Linux AIO - No - No - 1MBRand Read - Linux AIO - No - No - 1MBSeq Read - Linux AIO - No - No - 8MBSeq Read - Linux AIO - No - No - 8MBRand Read - Linux AIO - No - No - 8MBRand Read - Linux AIO - No - No - 8MBRand Write - Linux AIO - No - No - 128KBRand Write - Linux AIO - No - No - 128KBSeq Write - Linux AIO - No - No - 4KBSeq Write - Linux AIO - No - No - 4KBRand Write - Linux AIO - No - No - 8MBSeq Write - Linux AIO - No - No - 1MBSeq Write - Linux AIO - No - No - 1MBRand Write - Linux AIO - No - No - 8MBSeq Read - Linux AIO - No - No - 1MBSeq Read - Linux AIO - No - No - 1MB

truenasfio: Rand Read - Linux AIO - No - No - 1MB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 1MB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 8MB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 8MB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 1MB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 1MB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 8MB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 8MB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 128KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 128KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 128KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 128KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 1MB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 1MB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 8MB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 8MB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 1MB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 1MB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 4KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 4KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 8MB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 8MB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 128KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 128KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 128KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 128KB - Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFSVMWare TrueNAS 13 NFS green7707662315900786010465465020251713680814593668624499297997643311092710121236696653087893368382977781065652474754712526448754164957953377964838451024673735876700389889438398107522629199156351626679641175894706738.4590310441041180461001069130876.1872184471201022124103582741007805110511047369945331077131995991366937009491151050840196877417947912265796781598647.941644189.068483837829479163246975573801798344882008109871371038698733697837896310738590247847479.5203355416442342054.4139195346362449895234178655651173441866507853352913434250595716725370557445376976564.6165338209994494143.6111699261127886301958766283883468.01740085210394293849.412633917111820655495376171123111941410566711731431075107221454808788951160927998178411178117537796567118914599198786.7222121173116942910970011761431076107223760653979119113590731100879911381134369945671166142103810352045213311331381152921710858674OpenBenchmarking.org

Flexible IO Tester

FIO, the Flexible I/O Tester, is an advanced Linux disk benchmark supporting multiple I/O engines and a wealth of options. FIO was written by Jens Axboe for testing of the Linux I/O subsystem and schedulers. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFSVMWare TrueNAS 13 NFS green30060090012001500SE +/- 16.65, N = 12SE +/- 18.98, N = 15SE +/- 2.52, N = 3SE +/- 3.18, N = 3SE +/- 41.64, N = 12SE +/- 9.57, N = 4SE +/- 17.59, N = 15SE +/- 4.10, N = 37704751044794478769112311731. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFSVMWare TrueNAS 13 NFS green30060090012001500SE +/- 16.61, N = 12SE +/- 18.95, N = 15SE +/- 2.85, N = 3SE +/- 3.18, N = 3SE +/- 41.68, N = 12SE +/- 9.67, N = 4SE +/- 17.59, N = 15SE +/- 4.10, N = 37664711041791474765111911691. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFSVMWare TrueNAS 13 NFS green90180270360450SE +/- 4.22, N = 15SE +/- 23.58, N = 15SE +/- 2.03, N = 3SE +/- 2.19, N = 3SE +/- 4.29, N = 12SE +/- 0.54, N = 3SE +/- 5.49, N = 3SE +/- 3.20, N = 10231.0252.0180.0226.079.564.6414.0429.01. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFSVMWare TrueNAS 13 NFS green20K40K60K80K100KSE +/- 1083.71, N = 15SE +/- 6036.04, N = 15SE +/- 493.29, N = 3SE +/- 545.69, N = 3SE +/- 1099.45, N = 12SE +/- 120.19, N = 3SE +/- 1452.97, N = 3SE +/- 803.46, N = 105900764487461005796720335165331056671097001. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 8MB - Disk Target: Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFSVMWare TrueNAS 13 NFS green30060090012001500SE +/- 19.07, N = 12SE +/- 42.04, N = 15SE +/- 4.18, N = 3SE +/- 3.18, N = 3SE +/- 22.92, N = 12SE +/- 15.35, N = 15SE +/- 12.44, N = 3SE +/- 1.86, N = 38605411069815541820117311761. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 8MB - Disk Target: Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFSVMWare TrueNAS 13 NFS green306090120150SE +/- 2.42, N = 12SE +/- 5.30, N = 15SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 2.83, N = 12SE +/- 1.91, N = 15SE +/- 1.53, N = 3SE +/- 0.33, N = 3104641309864991431431. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFSVMWare TrueNAS 13 NFS green2004006008001000SE +/- 20.33, N = 12SE +/- 11.59, N = 3SE +/- 72.50, N = 15SE +/- 59.84, N = 12SE +/- 22.93, N = 12SE +/- 1.45, N = 3SE +/- 15.21, N = 3SE +/- 6.84, N = 3654.00957.00876.10647.94423.00944.001075.001076.001. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFSVMWare TrueNAS 13 NFS green2004006008001000SE +/- 20.30, N = 12SE +/- 11.59, N = 3SE +/- 72.52, N = 15SE +/- 59.82, N = 12SE +/- 22.97, N = 12SE +/- 1.45, N = 3SE +/- 15.30, N = 3SE +/- 6.84, N = 3650953872644420941107210721. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFSVMWare TrueNAS 13 NFS green80160240320400SE +/- 6.08, N = 15SE +/- 17.49, N = 12SE +/- 4.51, N = 15SE +/- 24.97, N = 12SE +/- 2.09, N = 15SE +/- 0.51, N = 15SE +/- 7.86, N = 12SE +/- 3.08, N = 15202.00377.00184.00189.0754.4043.60214.00237.001. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFSVMWare TrueNAS 13 NFS green20K40K60K80K100KSE +/- 1545.16, N = 15SE +/- 4480.32, N = 12SE +/- 1151.16, N = 15SE +/- 6393.98, N = 12SE +/- 537.50, N = 15SE +/- 132.02, N = 15SE +/- 2014.28, N = 12SE +/- 786.97, N = 1551713964834712048383139191116954808606531. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 8MB - Disk Target: Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFSVMWare TrueNAS 13 NFS green2004006008001000SE +/- 17.22, N = 12SE +/- 47.94, N = 12SE +/- 14.10, N = 3SE +/- 4.26, N = 3SE +/- 16.37, N = 12SE +/- 6.36, N = 3SE +/- 83.04, N = 12SE +/- 33.48, N = 1268084510227825349267889791. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 8MB - Disk Target: Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFSVMWare TrueNAS 13 NFS green306090120150SE +/- 2.12, N = 12SE +/- 6.03, N = 12SE +/- 1.76, N = 3SE +/- 0.58, N = 3SE +/- 2.02, N = 12SE +/- 0.88, N = 3SE +/- 10.35, N = 12SE +/- 4.21, N = 12811021249463112951191. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 128KB - Disk Target: Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFSVMWare TrueNAS 13 NFS green2004006008001000SE +/- 15.51, N = 15SE +/- 45.71, N = 15SE +/- 4.73, N = 3SE +/- 4.37, N = 3SE +/- 5.54, N = 15SE +/- 9.53, N = 3SE +/- 4.98, N = 3SE +/- 11.26, N = 54594671035791624788116011351. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 128KB - Disk Target: Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFSVMWare TrueNAS 13 NFS green2K4K6K8K10KSE +/- 123.94, N = 15SE +/- 365.66, N = 15SE +/- 38.05, N = 3SE +/- 35.63, N = 3SE +/- 44.14, N = 15SE +/- 75.64, N = 3SE +/- 38.70, N = 3SE +/- 89.23, N = 5366837358274632449896301927990731. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 128KB - Disk Target: Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFSVMWare TrueNAS 13 NFS green2004006008001000SE +/- 20.32, N = 15SE +/- 42.50, N = 12SE +/- 6.11, N = 3SE +/- 16.05, N = 15SE +/- 5.24, N = 3SE +/- 4.33, N = 3SE +/- 20.07, N = 15SE +/- 14.25, N = 3624876100769752395898111001. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 128KB - Disk Target: Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFSVMWare TrueNAS 13 NFS green2K4K6K8K10KSE +/- 162.71, N = 15SE +/- 339.90, N = 12SE +/- 47.92, N = 3SE +/- 128.58, N = 15SE +/- 40.95, N = 3SE +/- 35.22, N = 3SE +/- 160.77, N = 15SE +/- 113.93, N = 3499270038051557341787662784187991. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFSVMWare TrueNAS 13 NFS green30060090012001500SE +/- 16.65, N = 15SE +/- 8.72, N = 3SE +/- 5.13, N = 3SE +/- 4.70, N = 3SE +/- 9.29, N = 3SE +/- 10.41, N = 3SE +/- 0.33, N = 3SE +/- 7.21, N = 39798981051801655838117811381. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFSVMWare TrueNAS 13 NFS green30060090012001500SE +/- 16.58, N = 15SE +/- 8.76, N = 3SE +/- 5.46, N = 3SE +/- 4.91, N = 3SE +/- 9.06, N = 3SE +/- 10.41, N = 3SE +/- 0.00, N = 3SE +/- 6.89, N = 39768941047798651834117511341. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFSVMWare TrueNAS 13 NFS green90180270360450SE +/- 10.49, N = 15SE +/- 24.75, N = 15SE +/- 2.73, N = 3SE +/- 4.18, N = 3SE +/- 2.75, N = 14SE +/- 0.18, N = 3SE +/- 3.18, N = 3SE +/- 2.33, N = 3433.0383.0369.0344.0173.068.0377.0369.01. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFSVMWare TrueNAS 13 NFS green20K40K60K80K100KSE +/- 2681.46, N = 15SE +/- 6360.60, N = 15SE +/- 676.59, N = 3SE +/- 1053.57, N = 3SE +/- 703.90, N = 14SE +/- 57.74, N = 3SE +/- 841.30, N = 3SE +/- 548.74, N = 3110927981079453388200441861740096567945671. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 8MB - Disk Target: Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFSVMWare TrueNAS 13 NFS green30060090012001500SE +/- 13.87, N = 15SE +/- 6.33, N = 3SE +/- 2.85, N = 3SE +/- 3.93, N = 3SE +/- 9.88, N = 15SE +/- 10.71, N = 3SE +/- 0.88, N = 3SE +/- 2.33, N = 310125221077810650852118911661. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 8MB - Disk Target: Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFSVMWare TrueNAS 13 NFS green306090120150SE +/- 1.75, N = 15SE +/- 0.88, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 1.27, N = 15SE +/- 1.45, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 31236213198781031451421. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFSVMWare TrueNAS 13 NFS green2004006008001000SE +/- 28.09, N = 12SE +/- 14.72, N = 15SE +/- 19.70, N = 12SE +/- 23.27, N = 12SE +/- 1.53, N = 3SE +/- 11.29, N = 3SE +/- 48.47, N = 12SE +/- 24.49, N = 1566991999571353394299110381. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFSVMWare TrueNAS 13 NFS green2004006008001000SE +/- 28.05, N = 12SE +/- 14.72, N = 15SE +/- 19.65, N = 12SE +/- 23.28, N = 12SE +/- 1.53, N = 3SE +/- 10.99, N = 3SE +/- 48.54, N = 12SE +/- 24.51, N = 1566591599171052993898710351. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFSVMWare TrueNAS 13 NFS green140280420560700SE +/- 13.70, N = 15SE +/- 0.88, N = 3SE +/- 2.52, N = 3SE +/- 3.46, N = 3SE +/- 0.94, N = 12SE +/- 0.32, N = 3SE +/- 19.63, N = 12SE +/- 7.36, N = 15308.0635.0366.0386.0134.049.486.7204.01. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFSVMWare TrueNAS 13 NFS green30K60K90K120K150KSE +/- 3517.18, N = 15SE +/- 333.33, N = 3SE +/- 602.77, N = 3SE +/- 783.87, N = 3SE +/- 235.65, N = 12SE +/- 66.67, N = 3SE +/- 5033.80, N = 12SE +/- 1876.41, N = 15789331626679370098733342501263322212521331. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 8MB - Disk Target: Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFS green2004006008001000SE +/- 21.84, N = 12SE +/- 13.21, N = 15SE +/- 51.79, N = 15SE +/- 38.81, N = 13SE +/- 2.85, N = 3SE +/- 1.45, N = 3SE +/- 3.00, N = 368396494969759591711331. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 8MB - Disk Target: Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFS green306090120150SE +/- 2.72, N = 12SE +/- 1.64, N = 15SE +/- 6.45, N = 15SE +/- 4.87, N = 13SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 38211711583711111381. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 128KB - Disk Target: Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFS green2004006008001000SE +/- 17.44, N = 15SE +/- 40.43, N = 15SE +/- 5.90, N = 3SE +/- 2.31, N = 3SE +/- 0.88, N = 3SE +/- 5.95, N = 15SE +/- 12.35, N = 3977589105078967282011521. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 128KB - Disk Target: Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFS green2K4K6K8K10KSE +/- 139.68, N = 15SE +/- 323.48, N = 15SE +/- 46.61, N = 3SE +/- 18.25, N = 3SE +/- 6.35, N = 3SE +/- 47.36, N = 15SE +/- 99.22, N = 378104706840163105370655492171. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 128KB - Disk Target: Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFS green2004006008001000SE +/- 31.12, N = 15SE +/- 83.40, N = 12SE +/- 18.50, N = 15SE +/- 6.69, N = 3SE +/- 6.19, N = 15SE +/- 10.67, N = 3SE +/- 11.94, N = 15656.0738.4968.0738.0557.0953.01085.01. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 128KB - Disk Target: Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIXCP-NG NFSXCP-NG TrueNAS 13 iSCSIVMWare TrueNAS 13 NFS green2K4K6K8K10KSE +/- 248.92, N = 15SE +/- 667.20, N = 12SE +/- 147.76, N = 15SE +/- 54.30, N = 3SE +/- 49.68, N = 15SE +/- 86.83, N = 3SE +/- 95.33, N = 1552475903774159024453761786741. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

32 Results Shown

Flexible IO Tester:
  Rand Read - Linux AIO - No - No - 1MB - Default Test Directory:
    MB/s
    IOPS
  Rand Read - Linux AIO - No - No - 4KB - Default Test Directory:
    MB/s
    IOPS
  Rand Read - Linux AIO - No - No - 8MB - Default Test Directory:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - No - 1MB - Default Test Directory:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - No - 4KB - Default Test Directory:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - No - 8MB - Default Test Directory:
    MB/s
    IOPS
  Rand Read - Linux AIO - No - No - 128KB - Default Test Directory:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - No - 128KB - Default Test Directory:
    MB/s
    IOPS
  Seq Read - Linux AIO - No - No - 1MB - Default Test Directory:
    MB/s
    IOPS
  Seq Read - Linux AIO - No - No - 4KB - Default Test Directory:
    MB/s
    IOPS
  Seq Read - Linux AIO - No - No - 8MB - Default Test Directory:
    MB/s
    IOPS
  Seq Write - Linux AIO - No - No - 1MB - Default Test Directory:
    MB/s
    IOPS
  Seq Write - Linux AIO - No - No - 4KB - Default Test Directory:
    MB/s
    IOPS
  Seq Write - Linux AIO - No - No - 8MB - Default Test Directory:
    MB/s
    IOPS
  Seq Read - Linux AIO - No - No - 128KB - Default Test Directory:
    MB/s
    IOPS
  Seq Write - Linux AIO - No - No - 128KB - Default Test Directory:
    MB/s
    IOPS