truenas

Xen HVM domU 4.13 testing on Ubuntu 22.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2302149-NE-TRUENAS8311
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
TrueNAS 13 NFS
February 11 2023
  3 Hours, 54 Minutes
TrueNAS 13 iSCSI
February 12 2023
  3 Hours, 9 Minutes
TrueNAS Scale 22.12 NFS
February 14 2023
  1 Hour, 49 Minutes
TrueNAS Scale 22.12 iSCSI
February 14 2023
  1 Hour, 43 Minutes
Invert Hiding All Results Option
  2 Hours, 39 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

TrueNAS 13 NFS

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: CPU Microcode: 0xa20120a
Disk Mount Options Notes: relatime,rw
Disk Details Notes: Block Size: 4096
Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

TrueNAS 13 iSCSI

TrueNAS Scale 22.12 NFS

TrueNAS Scale 22.12 iSCSI

Processor: AMD Ryzen 9 5900X 12-Core (8 Cores), Motherboard: Xen HVM domU v4.13, Chipset: Intel 440FX 82441FX PMC, Memory: 6GB, Disk: 29GB, Graphics: bochs-drmdrmfb

OS: Ubuntu 22.04, Kernel: 5.15.0-60-generic (x86_64), Vulkan: 1.3.224, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1024x768, System Layer: Xen HVM domU 4.13

truenasOpenBenchmarking.orgPhoronix Test SuiteAMD Ryzen 9 5900X 12-Core (8 Cores)Xen HVM domU v4.13Intel 440FX 82441FX PMC6GB29GBbochs-drmdrmfbUbuntu 22.045.15.0-60-generic (x86_64)1.3.224GCC 11.3.0ext41024x768Xen HVM domU 4.13ProcessorMotherboardChipsetMemoryDiskGraphicsOSKernelVulkanCompilerFile-SystemScreen ResolutionSystem LayerTruenas PerformanceSystem Logs- Transparent Huge Pages: madvise- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - CPU Microcode: 0xa20120a- relatime,rw- Block Size: 4096- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

TrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSIResult OverviewPhoronix Test Suite100%131%163%194%Flexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterRand Read - Linux AIO - No - No - 128KBRand Read - Linux AIO - No - No - 128KBRand Read - Linux AIO - No - No - 1MBRand Read - Linux AIO - No - No - 1MBSeq Read - Linux AIO - No - No - 8MBSeq Read - Linux AIO - No - No - 8MBSeq Write - Linux AIO - No - No - 4KBSeq Write - Linux AIO - No - No - 4KBRand Write - Linux AIO - No - No - 4KBRand Write - Linux AIO - No - No - 4KBRand Read - Linux AIO - No - No - 8MBRand Read - Linux AIO - No - No - 8MBSeq Read - Linux AIO - No - No - 128KBSeq Read - Linux AIO - No - No - 128KBRand Write - Linux AIO - No - No - 128KBRand Write - Linux AIO - No - No - 128KBRand Write - Linux AIO - No - No - 8MBRand Write - Linux AIO - No - No - 8MBSeq Write - Linux AIO - No - No - 1MBSeq Write - Linux AIO - No - No - 1MBRand Write - Linux AIO - No - No - 1MBRand Write - Linux AIO - No - No - 1MBSeq Write - Linux AIO - No - No - 128KBSeq Write - Linux AIO - No - No - 128KBSeq Write - Linux AIO - No - No - 8MBSeq Write - Linux AIO - No - No - 8MBRand Read - Linux AIO - No - No - 4KBRand Read - Linux AIO - No - No - 4KBSeq Read - Linux AIO - No - No - 1MBSeq Read - Linux AIO - No - No - 1MBSeq Read - Linux AIO - No - No - 4KBSeq Read - Linux AIO - No - No - 4KB

truenasfio: Rand Read - Linux AIO - No - No - 1MB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 8MB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 1MB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 8MB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 128KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 128KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 1MB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 8MB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 1MB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 4KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 8MB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 128KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 128KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 1MB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 8MB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 1MB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 8MB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 128KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 128KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 1MB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 8MB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 1MB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 4KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 8MB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 128KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 128KB - Default Test DirectoryTrueNAS 13 NFSTrueNAS 13 iSCSITrueNAS Scale 22.12 NFSTrueNAS Scale 22.12 iSCSI76659007104650517138136684992976110927123665789338278105247770231860654202680459624979433101266930868397765647164487649539648310237357003894981076291516266711747065903475252541957377845467876898383522919635964589738.41041461001308724712012482748051104794533131991937001158401774110441801069876.118410221035100710513691077995366949105096879157967986444838394632455737988820098710987338363105902794226815647.941189.068782791697801344810713386697789738OpenBenchmarking.org

Flexible IO Tester

FIO, the Flexible I/O Tester, is an advanced Linux disk benchmark supporting multiple I/O engines and a wealth of options. FIO was written by Jens Axboe for testing of the Linux I/O subsystem and schedulers. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryTrueNAS Scale 22.12 iSCSITrueNAS Scale 22.12 NFSTrueNAS 13 iSCSITrueNAS 13 NFS2004006008001000SE +/- 3.18, N = 3SE +/- 2.85, N = 3SE +/- 18.95, N = 15SE +/- 16.61, N = 1279110414717661. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS Scale 22.12 iSCSITrueNAS Scale 22.12 NFSTrueNAS 13 iSCSITrueNAS 13 NFS14K28K42K56K70KSE +/- 545.69, N = 3SE +/- 493.29, N = 3SE +/- 6036.04, N = 15SE +/- 1083.71, N = 15579674610064487590071. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 8MB - Disk Target: Default Test DirectoryTrueNAS Scale 22.12 iSCSITrueNAS Scale 22.12 NFSTrueNAS 13 iSCSITrueNAS 13 NFS306090120150SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 5.30, N = 15SE +/- 2.42, N = 1298130641041. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryTrueNAS Scale 22.12 iSCSITrueNAS Scale 22.12 NFSTrueNAS 13 iSCSITrueNAS 13 NFS2004006008001000SE +/- 59.82, N = 12SE +/- 72.52, N = 15SE +/- 11.59, N = 3SE +/- 20.30, N = 126448729536501. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS Scale 22.12 iSCSITrueNAS Scale 22.12 NFSTrueNAS 13 iSCSITrueNAS 13 NFS20K40K60K80K100KSE +/- 6393.98, N = 12SE +/- 1151.16, N = 15SE +/- 4480.32, N = 12SE +/- 1545.16, N = 15483834712096483517131. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 8MB - Disk Target: Default Test DirectoryTrueNAS Scale 22.12 iSCSITrueNAS Scale 22.12 NFSTrueNAS 13 iSCSITrueNAS 13 NFS306090120150SE +/- 0.58, N = 3SE +/- 1.76, N = 3SE +/- 6.03, N = 12SE +/- 2.12, N = 1294124102811. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 128KB - Disk Target: Default Test DirectoryTrueNAS Scale 22.12 iSCSITrueNAS Scale 22.12 NFSTrueNAS 13 iSCSITrueNAS 13 NFS2K4K6K8K10KSE +/- 35.63, N = 3SE +/- 38.05, N = 3SE +/- 365.66, N = 15SE +/- 123.94, N = 1563248274373536681. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 128KB - Disk Target: Default Test DirectoryTrueNAS Scale 22.12 iSCSITrueNAS Scale 22.12 NFSTrueNAS 13 iSCSITrueNAS 13 NFS2K4K6K8K10KSE +/- 128.58, N = 15SE +/- 47.92, N = 3SE +/- 339.90, N = 12SE +/- 162.71, N = 1555738051700349921. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryTrueNAS Scale 22.12 iSCSITrueNAS Scale 22.12 NFSTrueNAS 13 iSCSITrueNAS 13 NFS2004006008001000SE +/- 4.91, N = 3SE +/- 5.46, N = 3SE +/- 8.76, N = 3SE +/- 16.58, N = 1579810478949761. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS Scale 22.12 iSCSITrueNAS Scale 22.12 NFSTrueNAS 13 iSCSITrueNAS 13 NFS20K40K60K80K100KSE +/- 1053.57, N = 3SE +/- 676.59, N = 3SE +/- 6360.60, N = 15SE +/- 2681.46, N = 158820094533981071109271. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 8MB - Disk Target: Default Test DirectoryTrueNAS Scale 22.12 iSCSITrueNAS Scale 22.12 NFSTrueNAS 13 iSCSITrueNAS 13 NFS306090120150SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 0.88, N = 3SE +/- 1.75, N = 1598131621231. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryTrueNAS Scale 22.12 iSCSITrueNAS Scale 22.12 NFSTrueNAS 13 iSCSITrueNAS 13 NFS2004006008001000SE +/- 23.28, N = 12SE +/- 19.65, N = 12SE +/- 14.72, N = 15SE +/- 28.05, N = 127109919156651. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS Scale 22.12 iSCSITrueNAS Scale 22.12 NFSTrueNAS 13 iSCSITrueNAS 13 NFS30K60K90K120K150KSE +/- 783.87, N = 3SE +/- 602.77, N = 3SE +/- 333.33, N = 3SE +/- 3517.18, N = 159873393700162667789331. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 8MB - Disk Target: Default Test DirectoryTrueNAS Scale 22.12 iSCSITrueNAS Scale 22.12 NFSTrueNAS 13 iSCSITrueNAS 13 NFS306090120150SE +/- 4.87, N = 13SE +/- 6.45, N = 15SE +/- 1.64, N = 15SE +/- 2.72, N = 1283115117821. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 128KB - Disk Target: Default Test DirectoryTrueNAS Scale 22.12 iSCSITrueNAS Scale 22.12 NFSTrueNAS 13 iSCSITrueNAS 13 NFS2K4K6K8K10KSE +/- 18.25, N = 3SE +/- 46.61, N = 3SE +/- 323.48, N = 15SE +/- 139.68, N = 1563108401470678101. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 128KB - Disk Target: Default Test DirectoryTrueNAS Scale 22.12 iSCSITrueNAS Scale 22.12 NFSTrueNAS 13 iSCSITrueNAS 13 NFS17003400510068008500SE +/- 54.30, N = 3SE +/- 147.76, N = 15SE +/- 667.20, N = 12SE +/- 248.92, N = 1559027741590352471. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryTrueNAS Scale 22.12 iSCSITrueNAS Scale 22.12 NFSTrueNAS 13 iSCSITrueNAS 13 NFS2004006008001000SE +/- 3.18, N = 3SE +/- 2.52, N = 3SE +/- 18.98, N = 15SE +/- 16.65, N = 1279410444757701. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS Scale 22.12 iSCSITrueNAS Scale 22.12 NFSTrueNAS 13 iSCSITrueNAS 13 NFS60120180240300SE +/- 2.19, N = 3SE +/- 2.03, N = 3SE +/- 23.58, N = 15SE +/- 4.22, N = 152261802522311. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 8MB - Disk Target: Default Test DirectoryTrueNAS Scale 22.12 iSCSITrueNAS Scale 22.12 NFSTrueNAS 13 iSCSITrueNAS 13 NFS2004006008001000SE +/- 3.18, N = 3SE +/- 4.18, N = 3SE +/- 42.04, N = 15SE +/- 19.07, N = 1281510695418601. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryTrueNAS Scale 22.12 iSCSITrueNAS Scale 22.12 NFSTrueNAS 13 iSCSITrueNAS 13 NFS2004006008001000SE +/- 59.84, N = 12SE +/- 72.50, N = 15SE +/- 11.59, N = 3SE +/- 20.33, N = 12647.94876.10957.00654.001. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS Scale 22.12 iSCSITrueNAS Scale 22.12 NFSTrueNAS 13 iSCSITrueNAS 13 NFS80160240320400SE +/- 24.97, N = 12SE +/- 4.51, N = 15SE +/- 17.49, N = 12SE +/- 6.08, N = 15189.07184.00377.00202.001. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 8MB - Disk Target: Default Test DirectoryTrueNAS Scale 22.12 iSCSITrueNAS Scale 22.12 NFSTrueNAS 13 iSCSITrueNAS 13 NFS2004006008001000SE +/- 4.26, N = 3SE +/- 14.10, N = 3SE +/- 47.94, N = 12SE +/- 17.22, N = 1278210228456801. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 128KB - Disk Target: Default Test DirectoryTrueNAS Scale 22.12 iSCSITrueNAS Scale 22.12 NFSTrueNAS 13 iSCSITrueNAS 13 NFS2004006008001000SE +/- 4.37, N = 3SE +/- 4.73, N = 3SE +/- 45.71, N = 15SE +/- 15.51, N = 1579110354674591. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 128KB - Disk Target: Default Test DirectoryTrueNAS Scale 22.12 iSCSITrueNAS Scale 22.12 NFSTrueNAS 13 iSCSITrueNAS 13 NFS2004006008001000SE +/- 16.05, N = 15SE +/- 6.11, N = 3SE +/- 42.50, N = 12SE +/- 20.32, N = 1569710078766241. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryTrueNAS Scale 22.12 iSCSITrueNAS Scale 22.12 NFSTrueNAS 13 iSCSITrueNAS 13 NFS2004006008001000SE +/- 4.70, N = 3SE +/- 5.13, N = 3SE +/- 8.72, N = 3SE +/- 16.65, N = 1580110518989791. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS Scale 22.12 iSCSITrueNAS Scale 22.12 NFSTrueNAS 13 iSCSITrueNAS 13 NFS90180270360450SE +/- 4.18, N = 3SE +/- 2.73, N = 3SE +/- 24.75, N = 15SE +/- 10.49, N = 153443693834331. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 8MB - Disk Target: Default Test DirectoryTrueNAS Scale 22.12 iSCSITrueNAS Scale 22.12 NFSTrueNAS 13 iSCSITrueNAS 13 NFS2004006008001000SE +/- 3.93, N = 3SE +/- 2.85, N = 3SE +/- 6.33, N = 3SE +/- 13.87, N = 15810107752210121. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryTrueNAS Scale 22.12 iSCSITrueNAS Scale 22.12 NFSTrueNAS 13 iSCSITrueNAS 13 NFS2004006008001000SE +/- 23.27, N = 12SE +/- 19.70, N = 12SE +/- 14.72, N = 15SE +/- 28.09, N = 127139959196691. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS Scale 22.12 iSCSITrueNAS Scale 22.12 NFSTrueNAS 13 iSCSITrueNAS 13 NFS140280420560700SE +/- 3.46, N = 3SE +/- 2.52, N = 3SE +/- 0.88, N = 3SE +/- 13.70, N = 153863666353081. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 8MB - Disk Target: Default Test DirectoryTrueNAS Scale 22.12 iSCSITrueNAS Scale 22.12 NFSTrueNAS 13 iSCSITrueNAS 13 NFS2004006008001000SE +/- 38.81, N = 13SE +/- 51.79, N = 15SE +/- 13.21, N = 15SE +/- 21.84, N = 126979499646831. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 128KB - Disk Target: Default Test DirectoryTrueNAS Scale 22.12 iSCSITrueNAS Scale 22.12 NFSTrueNAS 13 iSCSITrueNAS 13 NFS2004006008001000SE +/- 2.31, N = 3SE +/- 5.90, N = 3SE +/- 40.43, N = 15SE +/- 17.44, N = 1578910505899771. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 128KB - Disk Target: Default Test DirectoryTrueNAS Scale 22.12 iSCSITrueNAS Scale 22.12 NFSTrueNAS 13 iSCSITrueNAS 13 NFS2004006008001000SE +/- 6.69, N = 3SE +/- 18.50, N = 15SE +/- 83.40, N = 12SE +/- 31.12, N = 15738.0968.0738.4656.01. (CC) gcc options: -rdynamic -lz -lm -lpthread -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

32 Results Shown

Flexible IO Tester:
  Rand Read - Linux AIO - No - No - 1MB - Default Test Directory
  Rand Read - Linux AIO - No - No - 4KB - Default Test Directory
  Rand Read - Linux AIO - No - No - 8MB - Default Test Directory
  Rand Write - Linux AIO - No - No - 1MB - Default Test Directory
  Rand Write - Linux AIO - No - No - 4KB - Default Test Directory
  Rand Write - Linux AIO - No - No - 8MB - Default Test Directory
  Rand Read - Linux AIO - No - No - 128KB - Default Test Directory
  Rand Write - Linux AIO - No - No - 128KB - Default Test Directory
  Seq Read - Linux AIO - No - No - 1MB - Default Test Directory
  Seq Read - Linux AIO - No - No - 4KB - Default Test Directory
  Seq Read - Linux AIO - No - No - 8MB - Default Test Directory
  Seq Write - Linux AIO - No - No - 1MB - Default Test Directory
  Seq Write - Linux AIO - No - No - 4KB - Default Test Directory
  Seq Write - Linux AIO - No - No - 8MB - Default Test Directory
  Seq Read - Linux AIO - No - No - 128KB - Default Test Directory
  Seq Write - Linux AIO - No - No - 128KB - Default Test Directory
  Rand Read - Linux AIO - No - No - 1MB - Default Test Directory
  Rand Read - Linux AIO - No - No - 4KB - Default Test Directory
  Rand Read - Linux AIO - No - No - 8MB - Default Test Directory
  Rand Write - Linux AIO - No - No - 1MB - Default Test Directory
  Rand Write - Linux AIO - No - No - 4KB - Default Test Directory
  Rand Write - Linux AIO - No - No - 8MB - Default Test Directory
  Rand Read - Linux AIO - No - No - 128KB - Default Test Directory
  Rand Write - Linux AIO - No - No - 128KB - Default Test Directory
  Seq Read - Linux AIO - No - No - 1MB - Default Test Directory
  Seq Read - Linux AIO - No - No - 4KB - Default Test Directory
  Seq Read - Linux AIO - No - No - 8MB - Default Test Directory
  Seq Write - Linux AIO - No - No - 1MB - Default Test Directory
  Seq Write - Linux AIO - No - No - 4KB - Default Test Directory
  Seq Write - Linux AIO - No - No - 8MB - Default Test Directory
  Seq Read - Linux AIO - No - No - 128KB - Default Test Directory
  Seq Write - Linux AIO - No - No - 128KB - Default Test Directory

TrueNAS 13 NFS

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: CPU Microcode: 0xa20120a
Disk Mount Options Notes: relatime,rw
Disk Details Notes: Block Size: 4096
Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 11 February 2023 15:09 by user lts.

TrueNAS 13 iSCSI

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: CPU Microcode: 0xa20120a
Disk Mount Options Notes: relatime,rw
Disk Details Notes: Block Size: 4096
Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 12 February 2023 12:22 by user lts.

TrueNAS Scale 22.12 NFS

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: CPU Microcode: 0xa20120a
Disk Mount Options Notes: relatime,rw
Disk Details Notes: Block Size: 4096
Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 14 February 2023 19:19 by user lts.

TrueNAS Scale 22.12 iSCSI

Processor: AMD Ryzen 9 5900X 12-Core (8 Cores), Motherboard: Xen HVM domU v4.13, Chipset: Intel 440FX 82441FX PMC, Memory: 6GB, Disk: 29GB, Graphics: bochs-drmdrmfb

OS: Ubuntu 22.04, Kernel: 5.15.0-60-generic (x86_64), Vulkan: 1.3.224, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1024x768, System Layer: Xen HVM domU 4.13

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: CPU Microcode: 0xa20120a
Disk Mount Options Notes: relatime,rw
Disk Details Notes: Block Size: 4096
Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 14 February 2023 20:44 by user lts.