deb-xcp-ng-truenas

r10

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2112018-TJ-2109269IB01
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Disable Color Branding
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
TrueNAS Core NFS
September 25 2021
  39 Minutes
TrueNAS Core iSCSCI
September 25 2021
  39 Minutes
TrueNAS Scale iSCSI
September 26 2021
  1 Hour, 31 Minutes
TrueNAS Scale NFS
September 26 2021
  1 Hour, 47 Minutes
truenascore
December 01 2021
 
Invert Hiding All Results Option
  55 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):


deb-xcp-ng-truenasProcessorMotherboardChipsetMemoryDiskGraphicsOSKernelCompilerFile-SystemScreen ResolutionSystem LayerTrueNAS Core NFSTrueNAS Core iSCSCITrueNAS Scale iSCSITrueNAS Scale NFStruenascore8 x Intel Core i7-4790 (15 Cores)Xen HVM domU v4.13Intel 440FX 82441FX PMC1 x 4088 MB RAM57GBbochs-drmdrmfbDebian 115.10.0-8-amd64 (x86_64)GCC 10.2.1 20210110ext41024x768Xen HVM domU 4.13Intel Xeon E5-2620 v3 @ 2.40GHz (24 Cores)Supermicro Super Server 012345678932GB64863GBFreeBSD12.2-RELEASE-p10 (x86_64)Clang 10.0.1zfsOpenBenchmarking.orgKernel Details- TrueNAS Core NFS, TrueNAS Core iSCSCI, TrueNAS Scale iSCSI, TrueNAS Scale NFS: Transparent Huge Pages: alwaysCompiler Details- TrueNAS Core NFS, TrueNAS Core iSCSCI, TrueNAS Scale iSCSI, TrueNAS Scale NFS: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-Km9U7s/gcc-10-10.2.1/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Disk Details- TrueNAS Core NFS, TrueNAS Core iSCSCI, TrueNAS Scale iSCSI, TrueNAS Scale NFS: MQ-DEADLINE / errors=remount-ro,relatime,rw / Block Size: 4096Processor Details- TrueNAS Core NFS, TrueNAS Core iSCSCI, TrueNAS Scale iSCSI, TrueNAS Scale NFS: CPU Microcode: 0x28Security Details- TrueNAS Core NFS: itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Mitigation of PTE Inversion + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Unknown: Dependent on hypervisor status + tsx_async_abort: Not affected - TrueNAS Core iSCSCI: itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Mitigation of PTE Inversion + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Unknown: Dependent on hypervisor status + tsx_async_abort: Not affected - TrueNAS Scale iSCSI: itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Mitigation of PTE Inversion + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Unknown: Dependent on hypervisor status + tsx_async_abort: Not affected - TrueNAS Scale NFS: itlb_multihit: KVM: Mitigation of VMX unsupported + l1tf: Mitigation of PTE Inversion + mds: Mitigation of Clear buffers; SMT Host state unknown + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: disabled RSB filling + srbds: Unknown: Dependent on hypervisor status + tsx_async_abort: Not affected - truenascore: KPTI

deb-xcp-ng-truenasfio: Rand Read - Linux AIO - No - No - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 16KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 64KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 16KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 64KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 16KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 64KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 4KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 16KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 64KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 16KB - Default Test Directoryfio: Rand Read - Linux AIO - No - No - 64KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 16KB - Default Test Directoryfio: Rand Write - Linux AIO - No - No - 64KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 16KB - Default Test Directoryfio: Seq Read - Linux AIO - No - No - 64KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 4KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 16KB - Default Test Directoryfio: Seq Write - Linux AIO - No - No - 64KB - Default Test DirectoryTrueNAS Core NFSTrueNAS Core iSCSCITrueNAS Scale iSCSITrueNAS Scale NFStruenascore454673840015233179331496775097003353900156006460035500873517861095170.12344692748489742535555466406755467159673330021667829793067631671643373567307676880250872998130339519363987102628748143032233336331183312352721827725206744967117002596712733276112652673948.8113173203703730102.1199173756670493220286822171180643015907461182827998207829.511020111.30434.774.025.124828832.4125130OpenBenchmarking.org

Flexible IO Tester

FIO, the Flexible I/O Tester, is an advanced Linux disk benchmark supporting multiple I/O engines and a wealth of options. FIO was written by Jens Axboe for testing of the Linux I/O subsystem and schedulers. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS14K28K42K56K70KSE +/- 90.21, N = 3SE +/- 284.80, N = 3SE +/- 133.33, N = 3SE +/- 88.19, N = 375663223364067454671. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS11K22K33K44K55KMin: 7402 / Avg: 7566.33 / Max: 7713Min: 31900 / Avg: 32233.33 / Max: 32800Min: 63800 / Avg: 64066.67 / Max: 64200Min: 45300 / Avg: 45466.67 / Max: 456001. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS12K24K36K48K60KSE +/- 34.48, N = 3SE +/- 120.19, N = 3SE +/- 811.04, N = 3SE +/- 400.00, N = 370493363355467384001. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS10K20K30K40K50KMin: 6985 / Avg: 7049.33 / Max: 7103Min: 33400 / Avg: 33633.33 / Max: 33800Min: 54000 / Avg: 55466.67 / Max: 56800Min: 38000 / Avg: 38400 / Max: 392001. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS3K6K9K12K15KSE +/- 36.06, N = 3SE +/- 33.33, N = 3SE +/- 260.34, N = 3SE +/- 33.33, N = 332201183315967152331. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS3K6K9K12K15KMin: 3154 / Avg: 3220.33 / Max: 3278Min: 11800 / Avg: 11833.33 / Max: 11900Min: 15500 / Avg: 15966.67 / Max: 16400Min: 15200 / Avg: 15233.33 / Max: 153001. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS7K14K21K28K35KSE +/- 209.72, N = 15SE +/- 575.27, N = 15SE +/- 264.58, N = 3SE +/- 88.19, N = 328681235233300179331. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS6K12K18K24K30KMin: 2010 / Avg: 2867.87 / Max: 4217Min: 6764 / Avg: 12352.27 / Max: 15100Min: 32800 / Avg: 33300 / Max: 33700Min: 17800 / Avg: 17933.33 / Max: 181001. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS5K10K15K20K25KSE +/- 37.12, N = 3SE +/- 107.70, N = 15SE +/- 66.67, N = 3SE +/- 88.19, N = 32217721821667149671. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS4K8K12K16K20KMin: 2145 / Avg: 2217.33 / Max: 2268Min: 6430 / Avg: 7217.93 / Max: 7916Min: 21600 / Avg: 21666.67 / Max: 21800Min: 14800 / Avg: 14966.67 / Max: 151001. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS2K4K6K8K10KSE +/- 33.78, N = 15SE +/- 27.28, N = 3SE +/- 19.50, N = 3SE +/- 18.58, N = 311802772829775091. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS14002800420056007000Min: 994 / Avg: 1180 / Max: 1479Min: 2721 / Avg: 2772.33 / Max: 2814Min: 8261 / Avg: 8297 / Max: 8328Min: 7475 / Avg: 7509 / Max: 75391. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS20K40K60K80K100KSE +/- 105.41, N = 3SE +/- 296.27, N = 3SE +/- 940.45, N = 3SE +/- 466.67, N = 364305206793067700331. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS16K32K48K64K80KMin: 6222 / Avg: 6429.67 / Max: 6565Min: 51500 / Avg: 52066.67 / Max: 52500Min: 91200 / Avg: 93066.67 / Max: 94200Min: 69300 / Avg: 70033.33 / Max: 709001. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS14K28K42K56K70KSE +/- 317.95, N = 15SE +/- 284.80, N = 3SE +/- 348.01, N = 3SE +/- 458.26, N = 3159074496763167539001. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS11K22K33K44K55KMin: 14400 / Avg: 15906.67 / Max: 18500Min: 44400 / Avg: 44966.67 / Max: 45300Min: 62600 / Avg: 63166.67 / Max: 63800Min: 53000 / Avg: 53900 / Max: 545001. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS4K8K12K16K20KSE +/- 78.30, N = 15SE +/- 33.33, N = 346111170016433156001. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS3K6K9K12K15KMin: 4013 / Avg: 4611.07 / Max: 5071Min: 16400 / Avg: 16433.33 / Max: 165001. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS16K32K48K64K80KSE +/- 58.13, N = 3SE +/- 2082.44, N = 12SE +/- 88.19, N = 3SE +/- 208.17, N = 382822596773567646001. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS13K26K39K52K65KMin: 8199 / Avg: 8282 / Max: 8394Min: 13700 / Avg: 25966.67 / Max: 33400Min: 73400 / Avg: 73566.67 / Max: 73700Min: 64200 / Avg: 64600 / Max: 649001. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS8K16K24K32K40KSE +/- 91.22, N = 3SE +/- 166.67, N = 3SE +/- 66.67, N = 379981273330767355001. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS6K12K18K24K30KMin: 7839 / Avg: 7997.67 / Max: 8155Min: 12400 / Avg: 12733.33 / Max: 12900Min: 30700 / Avg: 30766.67 / Max: 309001. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS2K4K6K8K10KSE +/- 33.82, N = 3SE +/- 46.86, N = 15SE +/- 48.48, N = 3SE +/- 43.00, N = 320782761688087351. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS15003000450060007500Min: 2021 / Avg: 2077.67 / Max: 2138Min: 2489 / Avg: 2760.93 / Max: 3242Min: 6804 / Avg: 6879.67 / Max: 6970Min: 8651 / Avg: 8735 / Max: 87931. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS50100150200250SE +/- 0.35, N = 3SE +/- 1.00, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 329.5126.0250.0178.01. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS50100150200250Min: 28.9 / Avg: 29.53 / Max: 30.1Min: 125 / Avg: 126 / Max: 128Min: 249 / Avg: 250.33 / Max: 251Min: 177 / Avg: 177.67 / Max: 1781. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS2004006008001000SE +/- 1.86, N = 3SE +/- 8.50, N = 3SE +/- 1.00, N = 31105268726101. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS150300450600750Min: 522 / Avg: 525.67 / Max: 528Min: 859 / Avg: 872 / Max: 888Min: 609 / Avg: 610 / Max: 6121. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS2004006008001000SE +/- 2.33, N = 3SE +/- 2.33, N = 3SE +/- 14.77, N = 32017399989511. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS2004006008001000Min: 197 / Avg: 201.33 / Max: 205Min: 735 / Avg: 739.33 / Max: 743Min: 971 / Avg: 997.67 / Max: 10221. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS306090120150SE +/- 0.80, N = 15SE +/- 2.25, N = 15SE +/- 1.20, N = 3SE +/- 0.38, N = 311.3048.80130.0070.101. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS20406080100Min: 8.06 / Avg: 11.3 / Max: 16.5Min: 26.4 / Avg: 48.77 / Max: 59Min: 128 / Avg: 130.33 / Max: 132Min: 69.7 / Avg: 70.13 / Max: 70.91. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS70140210280350SE +/- 0.57, N = 3SE +/- 1.66, N = 15SE +/- 0.67, N = 3SE +/- 1.33, N = 334.7113.0339.0234.01. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS60120180240300Min: 33.6 / Avg: 34.7 / Max: 35.5Min: 101 / Avg: 112.93 / Max: 124Min: 338 / Avg: 338.67 / Max: 340Min: 231 / Avg: 233.67 / Max: 2351. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS110220330440550SE +/- 2.11, N = 15SE +/- 1.76, N = 3SE +/- 1.15, N = 3SE +/- 1.20, N = 374.0173.0519.0469.01. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Random Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS90180270360450Min: 62.4 / Avg: 73.95 / Max: 92.6Min: 170 / Avg: 173.33 / Max: 176Min: 517 / Avg: 519 / Max: 521Min: 467 / Avg: 469.33 / Max: 4711. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS80160240320400SE +/- 0.43, N = 3SE +/- 1.20, N = 3SE +/- 3.71, N = 3SE +/- 1.76, N = 325.1203.0363.0274.01. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS60120180240300Min: 24.3 / Avg: 25.13 / Max: 25.7Min: 201 / Avg: 203.33 / Max: 205Min: 356 / Avg: 363.33 / Max: 368Min: 271 / Avg: 273.67 / Max: 2771. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS2004006008001000SE +/- 5.03, N = 15SE +/- 4.51, N = 3SE +/- 5.51, N = 3SE +/- 2.33, N = 32487039878481. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS2004006008001000Min: 225 / Avg: 248.4 / Max: 289Min: 694 / Avg: 703 / Max: 708Min: 978 / Avg: 987 / Max: 997Min: 844 / Avg: 847.67 / Max: 8521. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS2004006008001000SE +/- 4.90, N = 15SE +/- 1.86, N = 328873010269741. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Read - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS2004006008001000Min: 251 / Avg: 288.4 / Max: 317Min: 1024 / Avg: 1026.33 / Max: 10301. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS60120180240300SE +/- 0.23, N = 3SE +/- 8.09, N = 12SE +/- 0.88, N = 332.4102.1287.0253.01. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 4KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS50100150200250Min: 32 / Avg: 32.37 / Max: 32.8Min: 53.5 / Avg: 102.14 / Max: 131Min: 251 / Avg: 252.67 / Max: 2541. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS120240360480600SE +/- 1.15, N = 3SE +/- 2.33, N = 3SE +/- 1.00, N = 31251994815551. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 16KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS100200300400500Min: 123 / Avg: 125 / Max: 127Min: 194 / Avg: 198.67 / Max: 201Min: 480 / Avg: 481 / Max: 4831. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS120240360480600SE +/- 2.93, N = 15SE +/- 3.21, N = 3SE +/- 2.73, N = 31301734305461. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.25Type: Sequential Write - Engine: Linux AIO - Buffered: No - Direct: No - Block Size: 64KB - Disk Target: Default Test DirectoryTrueNAS Scale NFSTrueNAS Scale iSCSITrueNAS Core iSCSCITrueNAS Core NFS100200300400500Min: 156 / Avg: 172.87 / Max: 203Min: 425 / Avg: 430 / Max: 436Min: 541 / Avg: 546.33 / Max: 5501. (CC) gcc options: -rdynamic -ll -lrt -lz -lpthread -lm -ldl -laio -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native

24 Results Shown

Flexible IO Tester:
  Rand Read - Linux AIO - No - No - 4KB - Default Test Directory
  Rand Read - Linux AIO - No - No - 16KB - Default Test Directory
  Rand Read - Linux AIO - No - No - 64KB - Default Test Directory
  Rand Write - Linux AIO - No - No - 4KB - Default Test Directory
  Rand Write - Linux AIO - No - No - 16KB - Default Test Directory
  Rand Write - Linux AIO - No - No - 64KB - Default Test Directory
  Seq Read - Linux AIO - No - No - 4KB - Default Test Directory
  Seq Read - Linux AIO - No - No - 16KB - Default Test Directory
  Seq Read - Linux AIO - No - No - 64KB - Default Test Directory
  Seq Write - Linux AIO - No - No - 4KB - Default Test Directory
  Seq Write - Linux AIO - No - No - 16KB - Default Test Directory
  Seq Write - Linux AIO - No - No - 64KB - Default Test Directory
  Rand Read - Linux AIO - No - No - 4KB - Default Test Directory
  Rand Read - Linux AIO - No - No - 16KB - Default Test Directory
  Rand Read - Linux AIO - No - No - 64KB - Default Test Directory
  Rand Write - Linux AIO - No - No - 4KB - Default Test Directory
  Rand Write - Linux AIO - No - No - 16KB - Default Test Directory
  Rand Write - Linux AIO - No - No - 64KB - Default Test Directory
  Seq Read - Linux AIO - No - No - 4KB - Default Test Directory
  Seq Read - Linux AIO - No - No - 16KB - Default Test Directory
  Seq Read - Linux AIO - No - No - 64KB - Default Test Directory
  Seq Write - Linux AIO - No - No - 4KB - Default Test Directory
  Seq Write - Linux AIO - No - No - 16KB - Default Test Directory
  Seq Write - Linux AIO - No - No - 64KB - Default Test Directory