TrueNAScore51922

mk

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2205247-NE-2205201NE84
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
Testing TrueNAS Core 12.0 performance
May 19 2022
  1 Hour, 44 Minutes
Testing TrueNAS Core 13 performace after in-place upgrade
May 19 2022
  1 Hour, 31 Minutes
Testing TrueNAS Core 13 after a ZFS pool feature flag update
May 19 2022
  1 Hour, 34 Minutes
Testing TrueNAS Scale 22.02 after in-place upgrade from Core
May 20 2022
  1 Hour, 58 Minutes
neu
May 24 2022
  1 Hour, 39 Minutes
Invert Behavior (Only Show Selected Data)
  1 Hour, 41 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

Testing TrueNAS Core 12.0 performance

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-Av3uEd/gcc-9-9.4.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: CPU Microcode: 0xa50000b
Disk Mount Options Notes: relatime,rw
Disk Details Notes: Block Size: 4096
Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Not affected + tsx_async_abort: Not affected

Testing TrueNAS Core 13 performace after in-place upgrade

Testing TrueNAS Core 13 after a ZFS pool feature flag update

Testing TrueNAS Scale 22.02 after in-place upgrade from Core

Processor: AMD Ryzen 5 5600G (8 Cores), Motherboard: Xen HVM domU v4.13, Chipset: Intel 440FX 82441FX PMC, Memory: 836MB, Disk: 29GB, Graphics: bochs-drmdrmfb

OS: Ubuntu 20.04, Kernel: 5.4.0-110-generic (x86_64), Vulkan: 1.1.182, Compiler: GCC 9.4.0, File-System: ext4, Screen Resolution: 1024x768, System Layer: Xen HVM domU 4.13

neu

Changed Processor to 8 x Intel Xeon E5-2430L v2 (15 Cores).

Changed Memory to 1 x 4088 MB RAM.

Changed Disk to 24GB.

Processor Change: CPU Microcode: 0x42e
Security Change: itlb_multihit: KVM: Vulnerable + l1tf: Mitigation of PTE Inversion + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Not affected + tsx_async_abort: Not affected

TrueNAScore51922ProcessorMotherboardChipsetMemoryDiskGraphicsOSKernelVulkanCompilerFile-SystemScreen ResolutionSystem LayerTesting TrueNAS Core 12.0 performanceTesting TrueNAS Core 13 performace after in-place upgradeTesting TrueNAS Core 13 after a ZFS pool feature flag updateTesting TrueNAS Scale 22.02 after in-place upgrade from CoreneuAMD Ryzen 5 5600G (8 Cores)Xen HVM domU v4.13Intel 440FX 82441FX PMC836MB29GBbochs-drmdrmfbUbuntu 20.045.4.0-110-generic (x86_64)1.1.182GCC 9.4.0ext41024x768Xen HVM domU 4.138 x Intel Xeon E5-2430L v2 (15 Cores)1 x 4088 MB RAM24GBOpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-Av3uEd/gcc-9-9.4.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Testing TrueNAS Core 12.0 performance: CPU Microcode: 0xa50000b- Testing TrueNAS Core 13 performace after in-place upgrade: CPU Microcode: 0xa50000b- Testing TrueNAS Core 13 after a ZFS pool feature flag update: CPU Microcode: 0xa50000b- Testing TrueNAS Scale 22.02 after in-place upgrade from Core: CPU Microcode: 0xa50000b- neu: CPU Microcode: 0x42eDisk Mount Options Details- relatime,rwDisk Details Details- Block Size: 4096Security Details- Testing TrueNAS Core 12.0 performance: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Not affected + tsx_async_abort: Not affected - Testing TrueNAS Core 13 performace after in-place upgrade: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Not affected + tsx_async_abort: Not affected - Testing TrueNAS Core 13 after a ZFS pool feature flag update: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Not affected + tsx_async_abort: Not affected - Testing TrueNAS Scale 22.02 after in-place upgrade from Core: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Not affected + tsx_async_abort: Not affected - neu: itlb_multihit: KVM: Vulnerable + l1tf: Mitigation of PTE Inversion + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Not affected + tsx_async_abort: Not affected

Testing TrueNAS Core 12.0 performanceTesting TrueNAS Core 13 performace after in-place upgradeTesting TrueNAS Core 13 after a ZFS pool feature flag updateTesting TrueNAS Scale 22.02 after in-place upgrade from CoreneuLogarithmic Result OverviewPhoronix Test SuiteFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterRand Write - Linux AIO - No - No - 4KBRand Write - Linux AIO - No - No - 4KBRand Read - Linux AIO - No - No - 4KBRand Read - Linux AIO - No - No - 4KBSeq Read - Linux AIO - No - No - 4KBSeq Read - Linux AIO - No - No - 4KBSeq Write - Linux AIO - No - No - 4KBSeq Write - Linux AIO - No - No - 4KBRand Write - Linux AIO - No - No - 128KBRand Write - Linux AIO - No - No - 128KBRand Read - Linux AIO - No - No - 128KBRand Read - Linux AIO - No - No - 128KBSeq Read - Linux AIO - No - No - 1MBSeq Read - Linux AIO - No - No - 1MBSeq Read - Linux AIO - No - No - 128KBSeq Read - Linux AIO - No - No - 128KBSeq Write - Linux AIO - No - No - 128KBSeq Write - Linux AIO - No - No - 128KBRand Read - Linux AIO - No - No - 1MBRand Read - Linux AIO - No - No - 1MBSeq Write - Linux AIO - No - No - 1MBSeq Write - Linux AIO - No - No - 1MBRand Write - Linux AIO - No - No - 1MBRand Write - Linux AIO - No - No - 1MB

TrueNAScore51922fio: Seq Write - Linux AIO - No - No - 1MB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 1MB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 1MB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 1MB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 128KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 128KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 128KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 128KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 4KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 4KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 128KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 128KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 1MB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 1MB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 128KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 128KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 1MB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 1MB - Default Test DirectoryTesting TrueNAS Core 12.0 performanceTesting TrueNAS Core 13 performace after in-place upgradeTesting TrueNAS Core 13 after a ZFS pool feature flag updateTesting TrueNAS Scale 22.02 after in-place upgrade from Coreneu7357388018046562821769896366964261.61326005188721109095400373107310778816110216433364110801083814817753757647881079589957074027613833354184881061887673471064106887571095165667647105010546936977537576303788791399073667288137000536852610668766734210631067883111041630006381074107863463770570859627463878485936136.563580672278509106436800144109310968753109511233344010891093465469473477365145737374681336752.35386721148436062213386.4594598458257353425209610614OpenBenchmarking.org

Flexible IO Tester

FIO, the Flexible I/O Tester, is an advanced Linux disk benchmark supporting multiple I/O engines and a wealth of options. FIO was written by Jens Axboe for testing of the Linux I/O subsystem and schedulers. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryTesting TrueNAS Core 12.0 performanceTesting TrueNAS Core 13 performace after in-place upgradeTesting TrueNAS Core 13 after a ZFS pool feature flag updateTesting TrueNAS Scale 22.02 after in-place upgrade from Coreneu2004006008001000SE +/- 30.87, N = 15SE +/- 13.95, N = 12SE +/- 34.41, N = 12SE +/- 41.00, N = 15SE +/- 12.12, N = 127358146936344651. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryTesting TrueNAS Core 12.0 performanceTesting TrueNAS Core 13 performace after in-place upgradeTesting TrueNAS Core 13 after a ZFS pool feature flag updateTesting TrueNAS Scale 22.02 after in-place upgrade from Coreneu2004006008001000SE +/- 30.85, N = 15SE +/- 13.89, N = 12SE +/- 34.33, N = 12SE +/- 41.01, N = 15SE +/- 12.09, N = 127388176976374691. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryTesting TrueNAS Core 12.0 performanceTesting TrueNAS Core 13 performace after in-place upgradeTesting TrueNAS Core 13 after a ZFS pool feature flag updateTesting TrueNAS Scale 22.02 after in-place upgrade from Coreneu2004006008001000SE +/- 51.26, N = 12SE +/- 33.68, N = 12SE +/- 39.43, N = 15SE +/- 32.70, N = 12SE +/- 19.09, N = 158017537537054731. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryTesting TrueNAS Core 12.0 performanceTesting TrueNAS Core 13 performace after in-place upgradeTesting TrueNAS Core 13 after a ZFS pool feature flag updateTesting TrueNAS Scale 22.02 after in-place upgrade from Coreneu2004006008001000SE +/- 51.24, N = 12SE +/- 33.70, N = 12SE +/- 39.44, N = 15SE +/- 32.72, N = 12SE +/- 19.06, N = 158047577577084771. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 128KB - Disk Target: Default Test DirectoryTesting TrueNAS Core 12.0 performanceTesting TrueNAS Core 13 performace after in-place upgradeTesting TrueNAS Core 13 after a ZFS pool feature flag updateTesting TrueNAS Scale 22.02 after in-place upgrade from Coreneu14002800420056007000SE +/- 81.07, N = 12SE +/- 61.72, N = 3SE +/- 146.47, N = 15SE +/- 230.20, N = 12SE +/- 86.20, N = 15656264786303596236511. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 128KB - Disk Target: Default Test DirectoryTesting TrueNAS Core 12.0 performanceTesting TrueNAS Core 13 performace after in-place upgradeTesting TrueNAS Core 13 after a ZFS pool feature flag updateTesting TrueNAS Scale 22.02 after in-place upgrade from Coreneu2004006008001000SE +/- 10.10, N = 12SE +/- 7.88, N = 3SE +/- 18.31, N = 15SE +/- 28.78, N = 12SE +/- 10.77, N = 158218107887464571. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 128KB - Disk Target: Default Test DirectoryTesting TrueNAS Core 12.0 performanceTesting TrueNAS Core 13 performace after in-place upgradeTesting TrueNAS Core 13 after a ZFS pool feature flag updateTesting TrueNAS Scale 22.02 after in-place upgrade from Coreneu2K4K6K8K10KSE +/- 110.79, N = 15SE +/- 93.35, N = 15SE +/- 67.44, N = 3SE +/- 302.42, N = 15SE +/- 46.86, N = 3769879587913387837371. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 128KB - Disk Target: Default Test DirectoryTesting TrueNAS Core 12.0 performanceTesting TrueNAS Core 13 performace after in-place upgradeTesting TrueNAS Core 13 after a ZFS pool feature flag updateTesting TrueNAS Scale 22.02 after in-place upgrade from Coreneu2004006008001000SE +/- 13.88, N = 15SE +/- 11.65, N = 15SE +/- 8.35, N = 3SE +/- 37.78, N = 15SE +/- 5.78, N = 39639959904854681. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTesting TrueNAS Core 12.0 performanceTesting TrueNAS Core 13 performace after in-place upgradeTesting TrueNAS Core 13 after a ZFS pool feature flag updateTesting TrueNAS Scale 22.02 after in-place upgrade from Coreneu16K32K48K64K80KSE +/- 3786.47, N = 14SE +/- 1538.24, N = 15SE +/- 733.33, N = 3SE +/- 899.10, N = 15SE +/- 133.33, N = 36696470740736679361133671. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTesting TrueNAS Core 12.0 performanceTesting TrueNAS Core 13 performace after in-place upgradeTesting TrueNAS Core 13 after a ZFS pool feature flag updateTesting TrueNAS Scale 22.02 after in-place upgrade from Coreneu60120180240300SE +/- 14.79, N = 14SE +/- 6.03, N = 15SE +/- 3.00, N = 3SE +/- 3.50, N = 15SE +/- 0.50, N = 3261.60276.00288.0036.5652.301. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTesting TrueNAS Core 12.0 performanceTesting TrueNAS Core 13 performace after in-place upgradeTesting TrueNAS Core 13 after a ZFS pool feature flag updateTesting TrueNAS Scale 22.02 after in-place upgrade from Coreneu30K60K90K120K150KSE +/- 2386.07, N = 15SE +/- 1201.85, N = 3SE +/- 2378.94, N = 14SE +/- 3102.82, N = 15SE +/- 648.93, N = 313260013833313700058067538671. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTesting TrueNAS Core 12.0 performanceTesting TrueNAS Core 13 performace after in-place upgradeTesting TrueNAS Core 13 after a ZFS pool feature flag updateTesting TrueNAS Scale 22.02 after in-place upgrade from Coreneu120240360480600SE +/- 9.26, N = 15SE +/- 4.73, N = 3SE +/- 9.25, N = 14SE +/- 12.09, N = 15SE +/- 2.33, N = 35185415362272111. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 128KB - Disk Target: Default Test DirectoryTesting TrueNAS Core 12.0 performanceTesting TrueNAS Core 13 performace after in-place upgradeTesting TrueNAS Core 13 after a ZFS pool feature flag updateTesting TrueNAS Scale 22.02 after in-place upgrade from Coreneu2K4K6K8K10KSE +/- 67.22, N = 3SE +/- 120.44, N = 3SE +/- 104.89, N = 3SE +/- 209.56, N = 12SE +/- 165.13, N = 14872184888526850948431. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 128KB - Disk Target: Default Test DirectoryTesting TrueNAS Core 12.0 performanceTesting TrueNAS Core 13 performace after in-place upgradeTesting TrueNAS Core 13 after a ZFS pool feature flag updateTesting TrueNAS Scale 22.02 after in-place upgrade from Coreneu2004006008001000SE +/- 8.21, N = 3SE +/- 15.06, N = 3SE +/- 13.12, N = 3SE +/- 26.16, N = 12SE +/- 20.63, N = 1410901061106610646061. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTesting TrueNAS Core 12.0 performanceTesting TrueNAS Core 13 performace after in-place upgradeTesting TrueNAS Core 13 after a ZFS pool feature flag updateTesting TrueNAS Scale 22.02 after in-place upgrade from Coreneu20K40K60K80K100KSE +/- 288.68, N = 3SE +/- 3328.28, N = 12SE +/- 3200.79, N = 12SE +/- 57.74, N = 3SE +/- 120.19, N = 395400887678766736800221331. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTesting TrueNAS Core 12.0 performanceTesting TrueNAS Core 13 performace after in-place upgradeTesting TrueNAS Core 13 after a ZFS pool feature flag updateTesting TrueNAS Scale 22.02 after in-place upgrade from Coreneu80160240320400SE +/- 1.15, N = 3SE +/- 13.04, N = 12SE +/- 12.53, N = 12SE +/- 0.33, N = 3SE +/- 0.50, N = 3373.0347.0342.0144.086.41. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryTesting TrueNAS Core 12.0 performanceTesting TrueNAS Core 13 performace after in-place upgradeTesting TrueNAS Core 13 after a ZFS pool feature flag updateTesting TrueNAS Scale 22.02 after in-place upgrade from Coreneu2004006008001000SE +/- 7.31, N = 3SE +/- 12.01, N = 3SE +/- 13.97, N = 3SE +/- 5.84, N = 3SE +/- 4.64, N = 1510731064106310935941. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryTesting TrueNAS Core 12.0 performanceTesting TrueNAS Core 13 performace after in-place upgradeTesting TrueNAS Core 13 after a ZFS pool feature flag updateTesting TrueNAS Scale 22.02 after in-place upgrade from Coreneu2004006008001000SE +/- 7.06, N = 3SE +/- 11.68, N = 3SE +/- 14.29, N = 3SE +/- 6.17, N = 3SE +/- 4.59, N = 1510771068106710965981. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 128KB - Disk Target: Default Test DirectoryTesting TrueNAS Core 12.0 performanceTesting TrueNAS Core 13 performace after in-place upgradeTesting TrueNAS Core 13 after a ZFS pool feature flag updateTesting TrueNAS Scale 22.02 after in-place upgrade from Coreneu2K4K6K8K10KSE +/- 30.88, N = 3SE +/- 60.12, N = 3SE +/- 25.44, N = 3SE +/- 25.83, N = 3SE +/- 17.13, N = 3881687578831875345821. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 128KB - Disk Target: Default Test DirectoryTesting TrueNAS Core 12.0 performanceTesting TrueNAS Core 13 performace after in-place upgradeTesting TrueNAS Core 13 after a ZFS pool feature flag updateTesting TrueNAS Scale 22.02 after in-place upgrade from Coreneu2004006008001000SE +/- 3.71, N = 3SE +/- 7.51, N = 3SE +/- 3.18, N = 3SE +/- 3.18, N = 3SE +/- 2.19, N = 311021095110410955731. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTesting TrueNAS Core 12.0 performanceTesting TrueNAS Core 13 performace after in-place upgradeTesting TrueNAS Core 13 after a ZFS pool feature flag updateTesting TrueNAS Scale 22.02 after in-place upgrade from Coreneu40K80K120K160K200KSE +/- 666.67, N = 3SE +/- 1763.83, N = 3SE +/- 577.35, N = 3SE +/- 881.92, N = 3SE +/- 604.67, N = 4164333165667163000112333534251. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTesting TrueNAS Core 12.0 performanceTesting TrueNAS Core 13 performace after in-place upgradeTesting TrueNAS Core 13 after a ZFS pool feature flag updateTesting TrueNAS Scale 22.02 after in-place upgrade from Coreneu140280420560700SE +/- 3.18, N = 3SE +/- 6.66, N = 3SE +/- 2.03, N = 3SE +/- 3.84, N = 3SE +/- 2.39, N = 46416476384402091. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.29Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryTesting TrueNAS Core 12.0 performanceTesting TrueNAS Core 13 performace after in-place upgradeTesting TrueNAS Core 13 after a ZFS pool feature flag updateTesting TrueNAS Scale 22.02 after in-place upgrade from Coreneu2004006008001000SE +/- 8.39, N = 3SE +/- 14.15, N = 3SE +/- 2.08, N = 3SE +/- 3.18, N = 310801050107410896101. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.29Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 1MB - Disk Target: Default Test DirectoryTesting TrueNAS Core 12.0 performanceTesting TrueNAS Core 13 performace after in-place upgradeTesting TrueNAS Core 13 after a ZFS pool feature flag updateTesting TrueNAS Scale 22.02 after in-place upgrade from Coreneu2004006008001000SE +/- 8.41, N = 3SE +/- 13.86, N = 3SE +/- 2.08, N = 3SE +/- 3.46, N = 310831054107810936141. (CC) gcc options: -rdynamic -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

24 Results Shown

Flexible IO Tester:
  Seq Write - Linux AIO - No - No - 1MB - Default Test Directory:
    IOPS
    MB/s
  Rand Write - Linux AIO - No - No - 1MB - Default Test Directory:
    IOPS
    MB/s
  Seq Write - Linux AIO - No - No - 128KB - Default Test Directory:
    IOPS
    MB/s
  Rand Write - Linux AIO - No - No - 128KB - Default Test Directory:
    IOPS
    MB/s
  Rand Write - Linux AIO - No - No - 4KB - Default Test Directory:
    IOPS
    MB/s
  Seq Write - Linux AIO - No - No - 4KB - Default Test Directory:
    IOPS
    MB/s
  Seq Read - Linux AIO - No - No - 128KB - Default Test Directory:
    IOPS
    MB/s
  Rand Read - Linux AIO - No - No - 4KB - Default Test Directory:
    IOPS
    MB/s
  Seq Read - Linux AIO - No - No - 1MB - Default Test Directory:
    IOPS
    MB/s
  Rand Read - Linux AIO - No - No - 128KB - Default Test Directory:
    IOPS
    MB/s
  Seq Read - Linux AIO - No - No - 4KB - Default Test Directory:
    IOPS
    MB/s
  Rand Read - Linux AIO - No - No - 1MB - Default Test Directory:
    IOPS
    MB/s

Testing TrueNAS Core 12.0 performance

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-Av3uEd/gcc-9-9.4.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: CPU Microcode: 0xa50000b
Disk Mount Options Notes: relatime,rw
Disk Details Notes: Block Size: 4096
Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 19 May 2022 16:20 by user lts.

Testing TrueNAS Core 13 performace after in-place upgrade

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-Av3uEd/gcc-9-9.4.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: CPU Microcode: 0xa50000b
Disk Mount Options Notes: relatime,rw
Disk Details Notes: Block Size: 4096
Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 19 May 2022 17:40 by user lts.

Testing TrueNAS Core 13 after a ZFS pool feature flag update

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-Av3uEd/gcc-9-9.4.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: CPU Microcode: 0xa50000b
Disk Mount Options Notes: relatime,rw
Disk Details Notes: Block Size: 4096
Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 19 May 2022 19:24 by user lts.

Testing TrueNAS Scale 22.02 after in-place upgrade from Core

Processor: AMD Ryzen 5 5600G (8 Cores), Motherboard: Xen HVM domU v4.13, Chipset: Intel 440FX 82441FX PMC, Memory: 836MB, Disk: 29GB, Graphics: bochs-drmdrmfb

OS: Ubuntu 20.04, Kernel: 5.4.0-110-generic (x86_64), Vulkan: 1.1.182, Compiler: GCC 9.4.0, File-System: ext4, Screen Resolution: 1024x768, System Layer: Xen HVM domU 4.13

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-Av3uEd/gcc-9-9.4.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: CPU Microcode: 0xa50000b
Disk Mount Options Notes: relatime,rw
Disk Details Notes: Block Size: 4096
Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 20 May 2022 16:46 by user lts.

neu

Processor: 8 x Intel Xeon E5-2430L v2 (15 Cores), Motherboard: Xen HVM domU v4.13, Chipset: Intel 440FX 82441FX PMC, Memory: 1 x 4088 MB RAM, Disk: 24GB, Graphics: bochs-drmdrmfb

OS: Ubuntu 20.04, Kernel: 5.4.0-110-generic (x86_64), Vulkan: 1.1.182, Compiler: GCC 9.4.0, File-System: ext4, Screen Resolution: 1024x768, System Layer: Xen HVM domU 4.13

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-Av3uEd/gcc-9-9.4.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: CPU Microcode: 0x42e
Disk Mount Options Notes: relatime,rw
Disk Details Notes: Block Size: 4096
Security Notes: itlb_multihit: KVM: Vulnerable + l1tf: Mitigation of PTE Inversion + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 24 May 2022 19:20 by user root.