debian11-xcp-ng-truenas

Xen HVM domU 4.13 testing on Debian 11 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2109082-IB-DEBIAN11X49
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
TrueNAS Core
September 08 2021
  1 Hour, 4 Minutes
TrueNAS Core NFS
September 08 2021
  1 Hour, 4 Minutes
TrueNAS Core iSCSI
September 08 2021
  1 Hour, 16 Minutes
Invert Hiding All Results Option
  1 Hour, 8 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

TrueNAS Core

Kernel Notes: Transparent Huge Pages: always
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Disk Notes: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096
Processor Notes: CPU Microcode: 0x28
Security Notes: itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Mitigation of PTE Inversion + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Unknown: Dependent on hypervisor status + tsx_async_abort: Not affected

TrueNAS Core NFS

TrueNAS Core iSCSI

Processor: 8 x Intel Core i7-4790 (15 Cores), Motherboard: Xen HVM domU v4.13, Chipset: Intel 440FX 82441FX PMC, Memory: 1 x 4088 MB RAM, Disk: 57GB, Graphics: bochs-drmdrmfb

OS: Debian 11, Kernel: 5.10.0-8-amd64 (x86_64), Compiler: GCC 10.2.1 20210110, File-System: ext4, Screen Resolution: 1024x768, System Layer: Xen HVM domU 4.13

debian11-xcp-ng-truenasOpenBenchmarking.orgPhoronix Test Suite8 x Intel Core i7-4790 (15 Cores)Xen HVM domU v4.13Intel 440FX 82441FX PMC1 x 4088 MB RAM57GBbochs-drmdrmfbDebian 115.10.0-8-amd64 (x86_64)GCC 10.2.1 20210110ext41024x768Xen HVM domU 4.13ProcessorMotherboardChipsetMemoryDiskGraphicsOSKernelCompilerFile-SystemScreen ResolutionSystem LayerDebian11-xcp-ng-truenas PerformanceSystem Logs- Transparent Huge Pages: always- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096 - CPU Microcode: 0x28- itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Mitigation of PTE Inversion + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Unknown: Dependent on hypervisor status + tsx_async_abort: Not affected

TrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSIResult OverviewPhoronix Test Suite100%123%146%170%193%Flexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterRand Write - Linux AIO - No - No - 4KBRand Write - Linux AIO - No - No - 4KBRand Write - Linux AIO - No - No - 16KBRand Write - Linux AIO - No - No - 16KBRand Read - Linux AIO - No - No - 16KBRand Read - Linux AIO - No - No - 16KBRand Read - Linux AIO - No - No - 4KBRand Read - Linux AIO - No - No - 4KBSeq Read - Linux AIO - No - No - 4KBSeq Read - Linux AIO - No - No - 4KBSeq Read - Linux AIO - No - No - 16KBSeq Read - Linux AIO - No - No - 16KBSeq Write - Linux AIO - No - No - 64KBSeq Write - Linux AIO - No - No - 64KBSeq Write - Linux AIO - No - No - 256KBSeq Write - Linux AIO - No - No - 256KBSeq Write - Linux AIO - No - No - 1MBSeq Write - Linux AIO - No - No - 1MBSeq Write - Linux AIO - No - No - 4KBSeq Write - Linux AIO - No - No - 4KBSeq Write - Linux AIO - No - No - 16KBSeq Write - Linux AIO - No - No - 16KBRand Write - Linux AIO - No - No - 64KBRand Write - Linux AIO - No - No - 64KBSeq Read - Linux AIO - No - No - 1MBRand Write - Linux AIO - No - No - 1MBRand Write - Linux AIO - No - No - 1MBSeq Read - Linux AIO - No - No - 1MBSeq Read - Linux AIO - No - No - 64KBSeq Read - Linux AIO - No - No - 64KBSeq Read - Linux AIO - No - No - 256KBSeq Read - Linux AIO - No - No - 256KBRand Read - Linux AIO - No - No - 64KBRand Read - Linux AIO - No - No - 64KBRand Read - Linux AIO - No - No - 256KBRand Read - Linux AIO - No - No - 256KBRand Read - Linux AIO - No - No - 1MBRand Read - Linux AIO - No - No - 1MBRand Write - Linux AIO - No - No - 256KBRand Write - Linux AIO - No - No - 256KB

debian11-xcp-ng-truenasfio: Rand Read - Linux AIO - No - No - 1MB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 1MB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 16KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 16KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 64KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 64KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 1MB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 1MB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 256KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 256KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 16KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 16KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 64KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 64KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 256KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 256KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 1MB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 1MB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 16KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 16KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 64KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 64KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 1MB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 1MB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 4KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 256KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 256KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 16KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 16KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 64KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 64KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 256KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 256KB - Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI1068106517544733603386339351493359859469.11770010634251232148334657443577230592592127069133830527339471513355955525264433962384455035200543868356622601067106317544800600384009321460059759368.91760010694271232145334657442577230394093627369733829530679301486756155825264433957382354835067543869556522581030102625164133872557679931556754153713233933102340903382166751582465772303102210193619170010076446710251640047547128973633103141194923142745172164771903OpenBenchmarking.org

Flexible IO Tester

FIO, the Flexible I/O Tester, is an advanced Linux disk benchmark supporting multiple I/O engines and a wealth of options. FIO was written by Jens Axboe for testing of the Linux I/O subsystem and schedulers. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI2004006008001000SE +/- 4.10, N = 3SE +/- 1.20, N = 3SE +/- 2.00, N = 31068106710301. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI2004006008001000SE +/- 3.84, N = 3SE +/- 1.00, N = 3SE +/- 1.86, N = 31065106310261. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI50100150200250SE +/- 0.58, N = 3SE +/- 1.15, N = 31751752511. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI14K28K42K56K70KSE +/- 202.76, N = 3SE +/- 288.68, N = 3SE +/- 66.67, N = 34473344800641331. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI2004006008001000SE +/- 2.89, N = 3SE +/- 3.06, N = 36036008721. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI12K24K36K48K60KSE +/- 33.33, N = 3SE +/- 173.21, N = 3SE +/- 185.59, N = 33863338400557671. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI2004006008001000SE +/- 1.53, N = 3SE +/- 1.67, N = 3SE +/- 2.96, N = 39359329931. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI3K6K9K12K15KSE +/- 33.33, N = 3SE +/- 300.00, N = 3SE +/- 284.80, N = 31493314600155671. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI130260390520650SE +/- 0.33, N = 3SE +/- 2.89, N = 3SE +/- 1.67, N = 35985975411. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI130260390520650SE +/- 0.33, N = 3SE +/- 2.89, N = 3SE +/- 2.00, N = 35945935371. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI306090120150SE +/- 0.48, N = 3SE +/- 0.23, N = 3SE +/- 1.86, N = 369.168.9132.01. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI7K14K21K28K35KSE +/- 100.00, N = 3SE +/- 57.74, N = 3SE +/- 484.19, N = 31770017600339331. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 256KB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI2004006008001000SE +/- 2.73, N = 3SE +/- 1.20, N = 3SE +/- 6.01, N = 31063106910231. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 256KB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI9001800270036004500SE +/- 10.69, N = 3SE +/- 5.81, N = 3SE +/- 23.81, N = 34251427140901. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI70140210280350SE +/- 0.67, N = 3SE +/- 1.20, N = 3SE +/- 1.20, N = 32322323381. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI5K10K15K20K25KSE +/- 33.33, N = 3SE +/- 272.85, N = 3SE +/- 88.19, N = 31483314533216671. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI110220330440550SE +/- 2.03, N = 3SE +/- 2.33, N = 3SE +/- 4.67, N = 34654655151. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI2K4K6K8K10KSE +/- 29.45, N = 3SE +/- 36.36, N = 3SE +/- 72.42, N = 37443744282461. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 256KB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI120240360480600SE +/- 2.85, N = 3SE +/- 1.86, N = 35775775771. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 256KB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI5001000150020002500SE +/- 5.93, N = 3SE +/- 10.68, N = 3SE +/- 7.31, N = 32305230323031. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI2004006008001000SE +/- 9.17, N = 3SE +/- 3.76, N = 3SE +/- 7.97, N = 392594010221. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI2004006008001000SE +/- 9.33, N = 3SE +/- 3.46, N = 3SE +/- 7.86, N = 392193610191. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI80160240320400SE +/- 1.15, N = 3SE +/- 0.67, N = 3SE +/- 3.28, N = 32702733611. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI20K40K60K80K100KSE +/- 348.01, N = 3SE +/- 185.59, N = 3SE +/- 650.64, N = 36913369733917001. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI2004006008001000SE +/- 2.73, N = 3SE +/- 1.15, N = 3SE +/- 6.74, N = 383082910071. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI14K28K42K56K70KSE +/- 405.52, N = 3SE +/- 88.19, N = 3SE +/- 440.96, N = 35273353067644671. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI2004006008001000SE +/- 3.06, N = 3SE +/- 2.52, N = 3SE +/- 4.48, N = 394793010251. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI4K8K12K16K20KSE +/- 33.33, N = 3SE +/- 33.33, N = 3SE +/- 57.74, N = 31513314867164001. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI120240360480600SE +/- 1.86, N = 3SE +/- 1.53, N = 35595614751. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI120240360480600SE +/- 1.67, N = 35555584711. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI60120180240300SE +/- 2.65, N = 3SE +/- 0.88, N = 32522522891. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI16K32K48K64K80KSE +/- 712.59, N = 3SE +/- 176.38, N = 3SE +/- 536.45, N = 36443364433736331. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 256KB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI2004006008001000SE +/- 7.13, N = 3SE +/- 3.71, N = 396295710311. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 256KB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI9001800270036004500SE +/- 28.58, N = 3SE +/- 15.39, N = 3SE +/- 6.24, N = 33844382341191. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI120240360480600SE +/- 3.84, N = 3SE +/- 2.19, N = 3SE +/- 3.89, N = 155505484921. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI8K16K24K32K40KSE +/- 251.66, N = 3SE +/- 133.33, N = 3SE +/- 263.58, N = 153520035067314271. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI120240360480600SE +/- 3.79, N = 3SE +/- 2.96, N = 3SE +/- 1.76, N = 35435434511. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI2K4K6K8K10KSE +/- 56.48, N = 3SE +/- 48.20, N = 3SE +/- 23.86, N = 38683869572161. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 256KB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI120240360480600SE +/- 1.53, N = 3SE +/- 3.28, N = 3SE +/- 2.67, N = 35665654771. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 256KB - Disk Target: Default Test DirectoryTrueNAS CoreTrueNAS Core NFSTrueNAS Core iSCSI5001000150020002500SE +/- 6.98, N = 3SE +/- 12.25, N = 3SE +/- 10.17, N = 32260225819031. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

40 Results Shown

Flexible IO Tester:
  Rand Read - Linux AIO - No - No - 1MB - Default Test Directory:
    MB/s
    IOPS
  Rand Read - Linux AIO - No - No - 4KB - Default Test Directory:
    MB/s
    IOPS
  Rand Read - Linux AIO - No - No - 16KB - Default Test Directory:
    MB/s
    IOPS
  Rand Read - Linux AIO - No - No - 64KB - Default Test Directory:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - No - 1MB - Default Test Directory:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - No - 4KB - Default Test Directory:
    MB/s
    IOPS
  Rand Read - Linux AIO - No - No - 256KB - Default Test Directory:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - No - 16KB - Default Test Directory:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - No - 64KB - Default Test Directory:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - No - 256KB - Default Test Directory:
    MB/s
    IOPS
  Seq Read - Linux AIO - No - No - 1MB - Default Test Directory:
    MB/s
    IOPS
  Seq Read - Linux AIO - No - No - 4KB - Default Test Directory:
    MB/s
    IOPS
  Seq Read - Linux AIO - No - No - 16KB - Default Test Directory:
    MB/s
    IOPS
  Seq Read - Linux AIO - No - No - 64KB - Default Test Directory:
    MB/s
    IOPS
  Seq Write - Linux AIO - No - No - 1MB - Default Test Directory:
    MB/s
    IOPS
  Seq Write - Linux AIO - No - No - 4KB - Default Test Directory:
    MB/s
    IOPS
  Seq Read - Linux AIO - No - No - 256KB - Default Test Directory:
    MB/s
    IOPS
  Seq Write - Linux AIO - No - No - 16KB - Default Test Directory:
    MB/s
    IOPS
  Seq Write - Linux AIO - No - No - 64KB - Default Test Directory:
    MB/s
    IOPS
  Seq Write - Linux AIO - No - No - 256KB - Default Test Directory:
    MB/s
    IOPS

TrueNAS Core

Kernel Notes: Transparent Huge Pages: always
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Disk Notes: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096
Processor Notes: CPU Microcode: 0x28
Security Notes: itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Mitigation of PTE Inversion + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Unknown: Dependent on hypervisor status + tsx_async_abort: Not affected

Testing initiated at 8 September 2021 10:55 by user root.

TrueNAS Core NFS

Kernel Notes: Transparent Huge Pages: always
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Disk Notes: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096
Processor Notes: CPU Microcode: 0x28
Security Notes: itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Mitigation of PTE Inversion + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Unknown: Dependent on hypervisor status + tsx_async_abort: Not affected

Testing initiated at 8 September 2021 12:25 by user root.

TrueNAS Core iSCSI

Processor: 8 x Intel Core i7-4790 (15 Cores), Motherboard: Xen HVM domU v4.13, Chipset: Intel 440FX 82441FX PMC, Memory: 1 x 4088 MB RAM, Disk: 57GB, Graphics: bochs-drmdrmfb

OS: Debian 11, Kernel: 5.10.0-8-amd64 (x86_64), Compiler: GCC 10.2.1 20210110, File-System: ext4, Screen Resolution: 1024x768, System Layer: Xen HVM domU 4.13

Kernel Notes: Transparent Huge Pages: always
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Disk Notes: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096
Processor Notes: CPU Microcode: 0x28
Security Notes: itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Mitigation of PTE Inversion + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Unknown: Dependent on hypervisor status + tsx_async_abort: Not affected

Testing initiated at 8 September 2021 13:13 by user root.