Debian-XCP-ng-TrueNAS

Xen HVM domU 4.13 testing on Debian 11 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2108249-IB-DEBIANXCP11
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
NFS on TrueNAS
August 24 2021
  1 Hour, 31 Minutes
iSCSI on TrueNAS
August 24 2021
  1 Hour, 25 Minutes
Invert Hiding All Results Option
  1 Hour, 28 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

NFS on TrueNAS

Kernel Notes: Transparent Huge Pages: always
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Disk Notes: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096
Processor Notes: CPU Microcode: 0x28
Security Notes: itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Mitigation of PTE Inversion + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Unknown: Dependent on hypervisor status + tsx_async_abort: Not affected

iSCSI on TrueNAS

Processor: 8 x Intel Core i7-4790 (15 Cores), Motherboard: Xen HVM domU v4.13, Chipset: Intel 440FX 82441FX PMC, Memory: 1 x 4088 MB RAM, Disk: 57GB, Graphics: bochs-drmdrmfb

OS: Debian 11, Kernel: 5.10.0-8-amd64 (x86_64), Compiler: GCC 10.2.1 20210110, File-System: ext4, Screen Resolution: 1024x768, System Layer: Xen HVM domU 4.13

Debian-XCP-ng-TrueNASOpenBenchmarking.orgPhoronix Test Suite8 x Intel Core i7-4790 (15 Cores)Xen HVM domU v4.13Intel 440FX 82441FX PMC1 x 4088 MB RAM57GBbochs-drmdrmfbDebian 115.10.0-8-amd64 (x86_64)GCC 10.2.1 20210110ext41024x768Xen HVM domU 4.13ProcessorMotherboardChipsetMemoryDiskGraphicsOSKernelCompilerFile-SystemScreen ResolutionSystem LayerDebian-XCP-ng-TrueNAS BenchmarksSystem Logs- Transparent Huge Pages: always- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096 - CPU Microcode: 0x28- itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Mitigation of PTE Inversion + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Unknown: Dependent on hypervisor status + tsx_async_abort: Not affected

NFS on TrueNAS vs. iSCSI on TrueNAS ComparisonPhoronix Test SuiteBaseline+22.2%+22.2%+44.4%+44.4%+66.6%+66.6%+88.8%+88.8%88.9%88.6%46.3%46.2%44.8%44.1%40.3%40.3%34%34%27.4%24.4%22%18.9%17.1%17.1%13.3%13.2%11.4%11.4%9.8%9.7%7.9%7.7%7.7%7.6%7.4%2.7%Rand Write - Linux AIO - No - No - 4KBRand Write - Linux AIO - No - No - 4KBRand Write - Linux AIO - No - No - 16KBRand Write - Linux AIO - No - No - 16KBRand Read - Linux AIO - No - No - 4KBRand Read - Linux AIO - No - No - 4KBRand Read - Linux AIO - No - No - 16KBRand Read - Linux AIO - No - No - 16KBSeq Read - Linux AIO - No - No - 4KBSeq Read - Linux AIO - No - No - 4KB64Seq Write - Linux AIO - No - No - 64KB25.3%Seq Write - Linux AIO - No - No - 64KB25.1%12832Seq Write - Linux AIO - No - No - 1MB21.9%Seq Write - Linux AIO - No - No - 1MB21.8%Seq Write - Linux AIO - No - No - 256KB20.6%Seq Write - Linux AIO - No - No - 256KB20.4%8Seq Read - Linux AIO - No - No - 16KBSeq Read - Linux AIO - No - No - 16KBSeq Write - Linux AIO - No - No - 16KB14.9%Seq Write - Linux AIO - No - No - 16KB14.8%Seq Write - Linux AIO - No - No - 4KBSeq Write - Linux AIO - No - No - 4KBRand Write - Linux AIO - No - No - 1MB12.3%Rand Write - Linux AIO - No - No - 1MB12.2%Seq Read - Linux AIO - No - No - 1MBSeq Read - Linux AIO - No - No - 1MBRand Write - Linux AIO - No - No - 64KBRand Write - Linux AIO - No - No - 64KB1Seq Read - Linux AIO - No - No - 64KBSeq Read - Linux AIO - No - No - 64KBSeq Read - Linux AIO - No - No - 256KBRand Read - Linux AIO - No - No - 256KB7.5%Rand Read - Linux AIO - No - No - 256KB7.5%Seq Read - Linux AIO - No - No - 256KBRand Write - Linux AIO - No - No - 256KB3.6%Rand Write - Linux AIO - No - No - 256KB3.5%Rand Read - Linux AIO - No - No - 1MB3.3%Rand Read - Linux AIO - No - No - 1MB3.2%Rand Read - Linux AIO - No - No - 64KBFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterSQLiteFlexible IO TesterFlexible IO TesterSQLiteSQLiteFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterSQLiteFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterSQLiteFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterNFS on TrueNASiSCSI on TrueNAS

Debian-XCP-ng-TrueNASsqlite: 1sqlite: 8sqlite: 32sqlite: 64sqlite: 128fio: Rand Read - Linux AIO - No - No - 1MB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 1MB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 16KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 16KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 64KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 64KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 1MB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 1MB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 256KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 256KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 16KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 16KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 64KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 64KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 256KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 256KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 1MB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 1MB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 16KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 16KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 64KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 64KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 1MB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 1MB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 4KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 256KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 256KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 16KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 16KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 64KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 64KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 256KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 256KB - Default Test DirectoryNFS on TrueNASiSCSI on TrueNAS10.37540.78585.076130.145239.1311065106217444533605387009331490058758368.31750010674266229146334667448582232391591126567767825528009461513356355924963400956381854634900543868355522179.61934.30569.734102.152192.27210321028252641678495430095815000523519129330009933969335214005118177562224510191015355908339666183310191630046245928271800102741074753040043469314611838OpenBenchmarking.org

SQLite

This is a simple benchmark of SQLite. At present this test profile just measures the time to perform a pre-defined number of insertions on an indexed database. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Threads / Copies: 1iSCSI on TrueNASNFS on TrueNAS3691215SE +/- 0.127, N = 5SE +/- 0.140, N = 49.61910.3751. (CC) gcc options: -O2 -lz -lm -ldl -lpthread

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Threads / Copies: 8iSCSI on TrueNASNFS on TrueNAS918273645SE +/- 0.40, N = 3SE +/- 0.16, N = 334.3140.791. (CC) gcc options: -O2 -lz -lm -ldl -lpthread

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Threads / Copies: 32iSCSI on TrueNASNFS on TrueNAS20406080100SE +/- 0.28, N = 3SE +/- 0.20, N = 369.7385.081. (CC) gcc options: -O2 -lz -lm -ldl -lpthread

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Threads / Copies: 64iSCSI on TrueNASNFS on TrueNAS306090120150SE +/- 0.23, N = 3SE +/- 0.22, N = 3102.15130.151. (CC) gcc options: -O2 -lz -lm -ldl -lpthread

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Threads / Copies: 128iSCSI on TrueNASNFS on TrueNAS50100150200250SE +/- 0.33, N = 3SE +/- 0.26, N = 3192.27239.131. (CC) gcc options: -O2 -lz -lm -ldl -lpthread

Flexible IO Tester

FIO, the Flexible I/O Tester, is an advanced Linux disk benchmark supporting multiple I/O engines and a wealth of options. FIO was written by Jens Axboe for testing of the Linux I/O subsystem and schedulers. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS2004006008001000SE +/- 10.97, N = 3SE +/- 1.20, N = 3103210651. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS2004006008001000SE +/- 0.88, N = 3102810621. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS601201802403002521741. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS14K28K42K56K70KSE +/- 617.34, N = 3SE +/- 66.67, N = 364167445331. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS2004006008001000SE +/- 3.00, N = 3SE +/- 4.04, N = 38496051. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS12K24K36K48K60KSE +/- 200.00, N = 3SE +/- 251.66, N = 354300387001. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS2004006008001000SE +/- 11.24, N = 3SE +/- 2.91, N = 39589331. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS3K6K9K12K15KSE +/- 503.32, N = 315000149001. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS130260390520650SE +/- 2.73, N = 3SE +/- 2.73, N = 35235871. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS130260390520650SE +/- 2.52, N = 3SE +/- 2.52, N = 35195831. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS306090120150SE +/- 0.10, N = 3129.068.31. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS7K14K21K28K35KSE +/- 57.74, N = 333000175001. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 256KB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS2004006008001000SE +/- 3.18, N = 3SE +/- 1.45, N = 399310671. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 256KB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS9001800270036004500SE +/- 13.00, N = 3SE +/- 6.24, N = 3396942661. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS70140210280350SE +/- 0.88, N = 3SE +/- 1.20, N = 33352291. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS5K10K15K20K25KSE +/- 57.74, N = 3SE +/- 33.33, N = 321400146331. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS110220330440550SE +/- 1.53, N = 3SE +/- 3.33, N = 35114661. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS2K4K6K8K10KSE +/- 25.54, N = 3SE +/- 56.51, N = 3817774481. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 256KB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS130260390520650SE +/- 4.10, N = 3SE +/- 4.18, N = 35625821. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 256KB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS5001000150020002500SE +/- 16.29, N = 3SE +/- 16.01, N = 3224523231. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS2004006008001000SE +/- 10.27, N = 3SE +/- 6.77, N = 310199151. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS2004006008001000SE +/- 10.27, N = 3SE +/- 6.77, N = 310159111. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS80160240320400SE +/- 2.00, N = 3SE +/- 1.45, N = 33552651. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS20K40K60K80K100KSE +/- 533.33, N = 3SE +/- 317.98, N = 390833677671. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS2004006008001000SE +/- 10.73, N = 3SE +/- 0.88, N = 39668251. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS13K26K39K52K65KSE +/- 669.16, N = 3SE +/- 57.74, N = 361833528001. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS2004006008001000SE +/- 4.06, N = 3SE +/- 2.52, N = 310199461. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS3K6K9K12K15KSE +/- 57.74, N = 3SE +/- 66.67, N = 316300151331. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS120240360480600SE +/- 1.53, N = 3SE +/- 2.00, N = 34625631. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS120240360480600SE +/- 1.33, N = 3SE +/- 2.19, N = 34595591. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS60120180240300SE +/- 0.67, N = 3SE +/- 0.58, N = 32822491. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS15K30K45K60K75KSE +/- 416.33, N = 3SE +/- 230.94, N = 371800634001. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 256KB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS2004006008001000SE +/- 11.39, N = 3SE +/- 9.84, N = 310279561. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 256KB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS9001800270036004500SE +/- 45.96, N = 3SE +/- 39.67, N = 3410738181. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS120240360480600SE +/- 2.19, N = 3SE +/- 3.18, N = 34755461. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS7K14K21K28K35KSE +/- 152.75, N = 3SE +/- 200.00, N = 330400349001. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS120240360480600SE +/- 1.20, N = 34345431. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS2K4K6K8K10KSE +/- 3.38, N = 3SE +/- 19.46, N = 3693186831. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 256KB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS120240360480600SE +/- 3.18, N = 3SE +/- 7.44, N = 44615551. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 256KB - Disk Target: Default Test DirectoryiSCSI on TrueNASNFS on TrueNAS5001000150020002500SE +/- 12.77, N = 3SE +/- 30.03, N = 4183822171. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

45 Results Shown

SQLite:
  1
  8
  32
  64
  128
Flexible IO Tester:
  Rand Read - Linux AIO - No - No - 1MB - Default Test Directory:
    MB/s
    IOPS
  Rand Read - Linux AIO - No - No - 4KB - Default Test Directory:
    MB/s
    IOPS
  Rand Read - Linux AIO - No - No - 16KB - Default Test Directory:
    MB/s
    IOPS
  Rand Read - Linux AIO - No - No - 64KB - Default Test Directory:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - No - 1MB - Default Test Directory:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - No - 4KB - Default Test Directory:
    MB/s
    IOPS
  Rand Read - Linux AIO - No - No - 256KB - Default Test Directory:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - No - 16KB - Default Test Directory:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - No - 64KB - Default Test Directory:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - No - 256KB - Default Test Directory:
    MB/s
    IOPS
  Seq Read - Linux AIO - No - No - 1MB - Default Test Directory:
    MB/s
    IOPS
  Seq Read - Linux AIO - No - No - 4KB - Default Test Directory:
    MB/s
    IOPS
  Seq Read - Linux AIO - No - No - 16KB - Default Test Directory:
    MB/s
    IOPS
  Seq Read - Linux AIO - No - No - 64KB - Default Test Directory:
    MB/s
    IOPS
  Seq Write - Linux AIO - No - No - 1MB - Default Test Directory:
    MB/s
    IOPS
  Seq Write - Linux AIO - No - No - 4KB - Default Test Directory:
    MB/s
    IOPS
  Seq Read - Linux AIO - No - No - 256KB - Default Test Directory:
    MB/s
    IOPS
  Seq Write - Linux AIO - No - No - 16KB - Default Test Directory:
    MB/s
    IOPS
  Seq Write - Linux AIO - No - No - 64KB - Default Test Directory:
    MB/s
    IOPS
  Seq Write - Linux AIO - No - No - 256KB - Default Test Directory:
    MB/s
    IOPS

NFS on TrueNAS

Kernel Notes: Transparent Huge Pages: always
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Disk Notes: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096
Processor Notes: CPU Microcode: 0x28
Security Notes: itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Mitigation of PTE Inversion + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Unknown: Dependent on hypervisor status + tsx_async_abort: Not affected

Testing initiated at 24 August 2021 06:02 by user root.

iSCSI on TrueNAS

Processor: 8 x Intel Core i7-4790 (15 Cores), Motherboard: Xen HVM domU v4.13, Chipset: Intel 440FX 82441FX PMC, Memory: 1 x 4088 MB RAM, Disk: 57GB, Graphics: bochs-drmdrmfb

OS: Debian 11, Kernel: 5.10.0-8-amd64 (x86_64), Compiler: GCC 10.2.1 20210110, File-System: ext4, Screen Resolution: 1024x768, System Layer: Xen HVM domU 4.13

Kernel Notes: Transparent Huge Pages: always
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Disk Notes: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096
Processor Notes: CPU Microcode: 0x28
Security Notes: itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Mitigation of PTE Inversion + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Unknown: Dependent on hypervisor status + tsx_async_abort: Not affected

Testing initiated at 24 August 2021 06:58 by user root.