deb-xcp-ng-truenas

Xen HVM domU 4.13 testing on Debian 11 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2109269-IB-DEBXCPNGT86
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
TrueNAS Core NFS
September 25 2021
  39 Minutes
TrueNAS Core iSCSCI
September 25 2021
  39 Minutes
TrueNAS Scale iSCSI
September 26 2021
  1 Hour, 31 Minutes
TrueNAS Scale NFS
September 26 2021
  1 Hour, 47 Minutes
Invert Behavior (Only Show Selected Data)
  1 Hour, 9 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

TrueNAS Core NFS

Kernel Notes: Transparent Huge Pages: always
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Disk Notes: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096
Processor Notes: CPU Microcode: 0x28
Security Notes: itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Mitigation of PTE Inversion + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Unknown: Dependent on hypervisor status + tsx_async_abort: Not affected

TrueNAS Core iSCSCI

TrueNAS Scale iSCSI

TrueNAS Scale NFS

Processor: 8 x Intel Core i7-4790 (15 Cores), Motherboard: Xen HVM domU v4.13, Chipset: Intel 440FX 82441FX PMC, Memory: 1 x 4088 MB RAM, Disk: 57GB, Graphics: bochs-drmdrmfb

OS: Debian 11, Kernel: 5.10.0-8-amd64 (x86_64), Compiler: GCC 10.2.1 20210110, File-System: ext4, Screen Resolution: 1024x768, System Layer: Xen HVM domU 4.13

deb-xcp-ng-truenasOpenBenchmarking.orgPhoronix Test Suite8 x Intel Core i7-4790 (15 Cores)Xen HVM domU v4.13Intel 440FX 82441FX PMC1 x 4088 MB RAM57GBbochs-drmdrmfbDebian 115.10.0-8-amd64 (x86_64)GCC 10.2.1 20210110ext41024x768Xen HVM domU 4.13ProcessorMotherboardChipsetMemoryDiskGraphicsOSKernelCompilerFile-SystemScreen ResolutionSystem LayerDeb-xcp-ng-truenas PerformanceSystem Logs- Transparent Huge Pages: always- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096 - CPU Microcode: 0x28- itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Mitigation of PTE Inversion + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Unknown: Dependent on hypervisor status + tsx_async_abort: Not affected

TrueNAS Core NFSTrueNAS Core iSCSCITrueNAS Scale iSCSITrueNAS Scale NFSResult OverviewPhoronix Test Suite100%437%774%1111%1447%Flexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterRand Write - Linux AIO - No - No - 16KBRand Write - Linux AIO - No - No - 16KBSeq Write - Linux AIO - No - No - 4KBSeq Write - Linux AIO - No - No - 4KBRand Read - Linux AIO - No - No - 4KBRand Read - Linux AIO - No - No - 4KBRand Read - Linux AIO - No - No - 16KBRand Read - Linux AIO - No - No - 16KBRand Write - Linux AIO - No - No - 64KBRand Write - Linux AIO - No - No - 64KBRand Read - Linux AIO - No - No - 64KBRand Read - Linux AIO - No - No - 64KBSeq Write - Linux AIO - No - No - 16KBSeq Write - Linux AIO - No - No - 16KBSeq Write - Linux AIO - No - No - 64KBSeq Write - Linux AIO - No - No - 64KBSeq Read - Linux AIO - No - No - 16KBSeq Read - Linux AIO - No - No - 16KBSeq Read - Linux AIO - No - No - 64KBSeq Read - Linux AIO - No - No - 64KBSeq Read - Linux AIO - No - No - 4KBSeq Read - Linux AIO - No - No - 4KBRand Write - Linux AIO - No - No - 4KBRand Write - Linux AIO - No - No - 4KB

deb-xcp-ng-truenasfio: Rand Write - Linux AIO - No - No - 16KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 16KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 16KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 16KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 64KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 64KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 16KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 16KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 4KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 64KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 64KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 4KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 64KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 64KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 16KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 16KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 64KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 64KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 4KB - Default Test DirectoryTrueNAS Core NFSTrueNAS Core iSCSCITrueNAS Scale iSCSITrueNAS Scale NFS149672341784546761038400951152335553550070033274873554664600253156009745390084875094691793370.12166733925064067872554679981596748130767930673636880430735672871643310266316798782975193330013072181131263223352633633739118331991273352067203276117325967102.1117007304496770327721731235248.8221734.729.57566110704920132201257998643025.12078130828232.4461128815907248118074.0286811.304OpenBenchmarking.org

Flexible IO Tester

FIO, the Flexible I/O Tester, is an advanced Linux disk benchmark supporting multiple I/O engines and a wealth of options. FIO was written by Jens Axboe for testing of the Linux I/O subsystem and schedulers. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryTrueNAS Scale iSCSITrueNAS Scale NFSTrueNAS Core iSCSCITrueNAS Core NFS5K10K15K20K25KSE +/- 107.70, N = 15SE +/- 37.12, N = 3SE +/- 66.67, N = 3SE +/- 88.19, N = 37218221721667149671. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryTrueNAS Scale iSCSITrueNAS Scale NFSTrueNAS Core iSCSCITrueNAS Core NFS70140210280350SE +/- 1.66, N = 15SE +/- 0.57, N = 3SE +/- 0.67, N = 3SE +/- 1.33, N = 3113.034.7339.0234.01. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS Scale iSCSITrueNAS Scale NFSTrueNAS Core iSCSCITrueNAS Core NFS50100150200250SE +/- 1.00, N = 3SE +/- 0.35, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3126.029.5250.0178.01. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS Scale iSCSITrueNAS Scale NFSTrueNAS Core iSCSCITrueNAS Core NFS14K28K42K56K70KSE +/- 284.80, N = 3SE +/- 90.21, N = 3SE +/- 133.33, N = 3SE +/- 88.19, N = 332233756664067454671. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryTrueNAS Scale iSCSITrueNAS Scale NFSTrueNAS Core iSCSCITrueNAS Core NFS2004006008001000SE +/- 1.86, N = 3SE +/- 8.50, N = 3SE +/- 1.00, N = 35261108726101. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryTrueNAS Scale iSCSITrueNAS Scale NFSTrueNAS Core iSCSCITrueNAS Core NFS12K24K36K48K60KSE +/- 120.19, N = 3SE +/- 34.48, N = 3SE +/- 811.04, N = 3SE +/- 400.00, N = 333633704955467384001. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryTrueNAS Scale iSCSITrueNAS Scale NFSTrueNAS Core iSCSCITrueNAS Core NFS2004006008001000SE +/- 2.33, N = 3SE +/- 2.33, N = 3SE +/- 14.77, N = 37392019989511. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryTrueNAS Scale iSCSITrueNAS Scale NFSTrueNAS Core iSCSCITrueNAS Core NFS3K6K9K12K15KSE +/- 33.33, N = 3SE +/- 36.06, N = 3SE +/- 260.34, N = 3SE +/- 33.33, N = 311833322015967152331. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryTrueNAS Scale iSCSITrueNAS Scale NFSTrueNAS Core iSCSCITrueNAS Core NFS120240360480600SE +/- 2.33, N = 3SE +/- 1.15, N = 3SE +/- 1.00, N = 31991254815551. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryTrueNAS Scale iSCSITrueNAS Scale NFSTrueNAS Core iSCSCITrueNAS Core NFS8K16K24K32K40KSE +/- 166.67, N = 3SE +/- 91.22, N = 3SE +/- 66.67, N = 312733799830767355001. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS Scale iSCSITrueNAS Scale NFSTrueNAS Core iSCSCITrueNAS Core NFS20K40K60K80K100KSE +/- 296.27, N = 3SE +/- 105.41, N = 3SE +/- 940.45, N = 3SE +/- 466.67, N = 352067643093067700331. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS Scale iSCSITrueNAS Scale NFSTrueNAS Core iSCSCITrueNAS Core NFS80160240320400SE +/- 1.20, N = 3SE +/- 0.43, N = 3SE +/- 3.71, N = 3SE +/- 1.76, N = 3203.025.1363.0274.01. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryTrueNAS Scale iSCSITrueNAS Scale NFSTrueNAS Core iSCSCITrueNAS Core NFS2K4K6K8K10KSE +/- 46.86, N = 15SE +/- 33.82, N = 3SE +/- 48.48, N = 3SE +/- 43.00, N = 327612078688087351. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryTrueNAS Scale iSCSITrueNAS Scale NFSTrueNAS Core iSCSCITrueNAS Core NFS120240360480600SE +/- 2.93, N = 15SE +/- 3.21, N = 3SE +/- 2.73, N = 31731304305461. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS Scale iSCSITrueNAS Scale NFSTrueNAS Core iSCSCITrueNAS Core NFS16K32K48K64K80KSE +/- 2082.44, N = 12SE +/- 58.13, N = 3SE +/- 88.19, N = 3SE +/- 208.17, N = 325967828273567646001. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS Scale iSCSITrueNAS Scale NFSTrueNAS Core iSCSCITrueNAS Core NFS60120180240300SE +/- 8.09, N = 12SE +/- 0.23, N = 3SE +/- 0.88, N = 3102.132.4287.0253.01. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryTrueNAS Scale iSCSITrueNAS Scale NFSTrueNAS Core iSCSCITrueNAS Core NFS4K8K12K16K20KSE +/- 78.30, N = 15SE +/- 33.33, N = 311700461116433156001. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryTrueNAS Scale iSCSITrueNAS Scale NFSTrueNAS Core iSCSCITrueNAS Core NFS2004006008001000SE +/- 4.90, N = 15SE +/- 1.86, N = 373028810269741. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryTrueNAS Scale iSCSITrueNAS Scale NFSTrueNAS Core iSCSCITrueNAS Core NFS14K28K42K56K70KSE +/- 284.80, N = 3SE +/- 317.95, N = 15SE +/- 348.01, N = 3SE +/- 458.26, N = 3449671590763167539001. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryTrueNAS Scale iSCSITrueNAS Scale NFSTrueNAS Core iSCSCITrueNAS Core NFS2004006008001000SE +/- 4.51, N = 3SE +/- 5.03, N = 15SE +/- 5.51, N = 3SE +/- 2.33, N = 37032489878481. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryTrueNAS Scale iSCSITrueNAS Scale NFSTrueNAS Core iSCSCITrueNAS Core NFS2K4K6K8K10KSE +/- 27.28, N = 3SE +/- 33.78, N = 15SE +/- 19.50, N = 3SE +/- 18.58, N = 327721180829775091. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryTrueNAS Scale iSCSITrueNAS Scale NFSTrueNAS Core iSCSCITrueNAS Core NFS110220330440550SE +/- 1.76, N = 3SE +/- 2.11, N = 15SE +/- 1.15, N = 3SE +/- 1.20, N = 3173.074.0519.0469.01. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS Scale iSCSITrueNAS Scale NFSTrueNAS Core iSCSCITrueNAS Core NFS7K14K21K28K35KSE +/- 575.27, N = 15SE +/- 209.72, N = 15SE +/- 264.58, N = 3SE +/- 88.19, N = 312352286833300179331. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS Scale iSCSITrueNAS Scale NFSTrueNAS Core iSCSCITrueNAS Core NFS306090120150SE +/- 2.25, N = 15SE +/- 0.80, N = 15SE +/- 1.20, N = 3SE +/- 0.38, N = 348.8011.30130.0070.101. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

24 Results Shown

Flexible IO Tester:
  Rand Write - Linux AIO - No - No - 16KB - Default Test Directory:
    IOPS
    MB/s
  Rand Read - Linux AIO - No - No - 4KB - Default Test Directory:
    MB/s
    IOPS
  Rand Read - Linux AIO - No - No - 16KB - Default Test Directory:
    MB/s
    IOPS
  Rand Read - Linux AIO - No - No - 64KB - Default Test Directory:
    MB/s
    IOPS
  Seq Write - Linux AIO - No - No - 16KB - Default Test Directory:
    MB/s
    IOPS
  Seq Read - Linux AIO - No - No - 4KB - Default Test Directory:
    IOPS
    MB/s
  Seq Write - Linux AIO - No - No - 64KB - Default Test Directory:
    IOPS
    MB/s
  Seq Write - Linux AIO - No - No - 4KB - Default Test Directory:
    IOPS
    MB/s
  Seq Read - Linux AIO - No - No - 64KB - Default Test Directory:
    IOPS
    MB/s
  Seq Read - Linux AIO - No - No - 16KB - Default Test Directory:
    IOPS
    MB/s
  Rand Write - Linux AIO - No - No - 64KB - Default Test Directory:
    IOPS
    MB/s
  Rand Write - Linux AIO - No - No - 4KB - Default Test Directory:
    IOPS
    MB/s

TrueNAS Core NFS

Kernel Notes: Transparent Huge Pages: always
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Disk Notes: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096
Processor Notes: CPU Microcode: 0x28
Security Notes: itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Mitigation of PTE Inversion + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Unknown: Dependent on hypervisor status + tsx_async_abort: Not affected

Testing initiated at 25 September 2021 12:49 by user root.

TrueNAS Core iSCSCI

Kernel Notes: Transparent Huge Pages: always
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Disk Notes: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096
Processor Notes: CPU Microcode: 0x28
Security Notes: itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Mitigation of PTE Inversion + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Unknown: Dependent on hypervisor status + tsx_async_abort: Not affected

Testing initiated at 25 September 2021 13:23 by user root.

TrueNAS Scale iSCSI

Kernel Notes: Transparent Huge Pages: always
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Disk Notes: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096
Processor Notes: CPU Microcode: 0x28
Security Notes: itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Mitigation of PTE Inversion + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Unknown: Dependent on hypervisor status + tsx_async_abort: Not affected

Testing initiated at 26 September 2021 10:23 by user root.

TrueNAS Scale NFS

Processor: 8 x Intel Core i7-4790 (15 Cores), Motherboard: Xen HVM domU v4.13, Chipset: Intel 440FX 82441FX PMC, Memory: 1 x 4088 MB RAM, Disk: 57GB, Graphics: bochs-drmdrmfb

OS: Debian 11, Kernel: 5.10.0-8-amd64 (x86_64), Compiler: GCC 10.2.1 20210110, File-System: ext4, Screen Resolution: 1024x768, System Layer: Xen HVM domU 4.13

Kernel Notes: Transparent Huge Pages: always
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Disk Notes: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096
Processor Notes: CPU Microcode: 0x28
Security Notes: itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Mitigation of PTE Inversion + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Unknown: Dependent on hypervisor status + tsx_async_abort: Not affected

Testing initiated at 26 September 2021 11:46 by user root.