raid10nocache10disk

2 x Intel Xeon E5-2690 v3 testing with a Supermicro X10DRI-T (3.2 BIOS) and ASPEED on Ubuntu 20.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2010020-NE-2010018EI10
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
seebelow
September 30 2020
  2 Hours, 17 Minutes
raid5 cache 8hdd 1
October 02 2020
  1 Hour, 58 Minutes
Invert Hiding All Results Option
  2 Hours, 7 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

seebelow

Processor: 2 x Intel Xeon E5-2690 v3 @ 3.50GHz (24 Cores / 48 Threads), Motherboard: Supermicro X10DRI-T (3.2 BIOS), Chipset: Intel Xeon E7 v3/Xeon, Memory: 12 x 32 GB DDR4-2133MT/s, Disk: 1000GB DefaultValue0 + 19899GB iSCSI Storage, Graphics: ASPEED, Monitor: BenQ GL2450H, Network: Mellanox MT26448 + 2 x Intel 10-Gigabit X540-AT2

OS: Ubuntu 20.04, Kernel: 5.4.0-48-generic (x86_64), Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Disk Notes: MQ-DEADLINE / relatime,rw
Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x43
Python Notes: Python 3.8.2
Security Notes: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

raid5 cache 8hdd 1

Processor: 2 x Intel Xeon E5-2690 v3 @ 3.50GHz (24 Cores / 48 Threads), Motherboard: Supermicro X10DRI-T (3.2 BIOS), Chipset: Intel Xeon E7 v3/Xeon, Memory: 12 x 32 GB DDR4-2133MT/s, Disk: 1000GB DefaultValue0 + 27858GB iSCSI Storage, Graphics: ASPEED, Monitor: BenQ GL2450H, Network: Mellanox MT26448 + 2 x Intel 10-Gigabit X540-AT2

OS: Ubuntu 20.04, Kernel: 5.4.0-48-generic (x86_64), Display Server: X Server, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Disk Notes: MQ-DEADLINE / relatime,rw
Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x43
Security Notes: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

raid10nocache10diskProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelCompilerFile-SystemScreen ResolutionDisplay Serverseebelowraid5 cache 8hdd 12 x Intel Xeon E5-2690 v3 @ 3.50GHz (24 Cores / 48 Threads)Supermicro X10DRI-T (3.2 BIOS)Intel Xeon E7 v3/Xeon12 x 32 GB DDR4-2133MT/s1000GB DefaultValue0 + 19899GB iSCSI StorageASPEEDBenQ GL2450HMellanox MT26448 + 2 x Intel 10-Gigabit X540-AT2Ubuntu 20.045.4.0-48-generic (x86_64)GCC 9.3.0ext41920x10801000GB DefaultValue0 + 27858GB iSCSI StorageX ServerOpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Disk Details- MQ-DEADLINE / relatime,rwProcessor Details- Scaling Governor: intel_pstate powersave - CPU Microcode: 0x43Python Details- seebelow: Python 3.8.2Security Details- itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

seebelow vs. raid5 cache 8hdd 1 ComparisonPhoronix Test SuiteBaseline+8.5%+8.5%+17%+17%+25.5%+25.5%5.4%3.3%2.4%2%2%Rand Read - Linux AIO - No - Yes - 4KB33.9%Rand Read - Linux AIO - No - Yes - 4KB33%T.S.I31.7%4.F.3.S.D.1.SRand Write - Linux AIO - No - Yes - 4KB5.2%Rand Write - Linux AIO - No - Yes - 4KB5.2%1.F.1.S5.F.1.S.4.TSeq Write - Linux AIO - No - Yes - 4KB2.3%12 Clients2.2%Seq Write - Linux AIO - No - Yes - 4KB2.1%Rand Write - Linux AIO - No - Yes - 2MB2.1%Rand Read - Linux AIO - No - Yes - 2MBRand Read - Linux AIO - No - Yes - 2MBRand Write - Linux AIO - No - Yes - 2MB2%Flexible IO TesterFlexible IO TesterSQLiteFS-MarkFlexible IO TesterFlexible IO TesterFS-MarkFS-MarkFlexible IO TesterDbenchFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO Testerseebelowraid5 cache 8hdd 1

raid10nocache10disksqlite: Timed SQLite Insertionsfio: Rand Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Read - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Read - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Read - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Read - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Read - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Write - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Write - Linux AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Write - Linux AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Write - Linux AIO - No - Yes - 4KB - Default Test Directoryfs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizefs-mark: 1000 Files, 1MB Size, No Sync/FSyncdbench: 12 Clientsdbench: 1 Clientspostmark: Disk Transaction Performanceseebelowraid5 cache 8hdd 111.831987490300763331093543322824479914924231082671106550572146333242.8498.0236.71605.01842.11249.437443815.5791007500224574001072532306783679824874151063331107550559143333250.9510.1249.51579.91802.06252.4184385OpenBenchmarking.org

SQLite

This is a simple benchmark of SQLite. At present this test profile just measures the time to perform a pre-defined number of insertions on an indexed database. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Timed SQLite Insertionsseebelowraid5 cache 8hdd 148121620SE +/- 0.16, N = 15SE +/- 0.21, N = 511.8315.581. (CC) gcc options: -O2 -lz -lm -ldl -lpthread
OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.30.1Timed SQLite Insertionsseebelowraid5 cache 8hdd 148121620Min: 10.89 / Avg: 11.83 / Max: 12.69Min: 14.87 / Avg: 15.58 / Max: 16.041. (CC) gcc options: -O2 -lz -lm -ldl -lpthread

Flexible IO Tester

Fio is an advanced disk benchmark that depends upon the kernel's AIO access library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directoryseebelowraid5 cache 8hdd 12004006008001000SE +/- 4.04, N = 3SE +/- 0.88, N = 398710071. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directoryseebelowraid5 cache 8hdd 12004006008001000Min: 979 / Avg: 987 / Max: 992Min: 1006 / Avg: 1007.33 / Max: 10091. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directoryseebelowraid5 cache 8hdd 1110220330440550SE +/- 1.86, N = 34905001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directoryseebelowraid5 cache 8hdd 190180270360450Min: 486 / Avg: 489.67 / Max: 4921. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryseebelowraid5 cache 8hdd 170140210280350SE +/- 1.76, N = 33002241. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryseebelowraid5 cache 8hdd 150100150200250Min: 297 / Avg: 299.67 / Max: 3031. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryseebelowraid5 cache 8hdd 116K32K48K64K80KSE +/- 726.48, N = 376333574001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryseebelowraid5 cache 8hdd 113K26K39K52K65KMin: 75000 / Avg: 76333.33 / Max: 775001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directoryseebelowraid5 cache 8hdd 12004006008001000SE +/- 14.90, N = 3SE +/- 9.81, N = 15109310721. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directoryseebelowraid5 cache 8hdd 12004006008001000Min: 1063 / Avg: 1092.67 / Max: 1110Min: 984 / Avg: 1071.67 / Max: 11081. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directoryseebelowraid5 cache 8hdd 1120240360480600SE +/- 7.36, N = 3SE +/- 4.86, N = 155435321. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directoryseebelowraid5 cache 8hdd 1100200300400500Min: 528 / Avg: 542.67 / Max: 551Min: 489 / Avg: 532.2 / Max: 5501. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryseebelowraid5 cache 8hdd 170140210280350SE +/- 2.91, N = 153223061. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryseebelowraid5 cache 8hdd 160120180240300Min: 296 / Avg: 322.07 / Max: 3531. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryseebelowraid5 cache 8hdd 120K40K60K80K100KSE +/- 748.70, N = 15SE +/- 1010.50, N = 382447783671. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryseebelowraid5 cache 8hdd 114K28K42K56K70KMin: 75800 / Avg: 82446.67 / Max: 90500Min: 76600 / Avg: 78366.67 / Max: 801001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directoryseebelowraid5 cache 8hdd 12004006008001000SE +/- 4.00, N = 3SE +/- 1.20, N = 39919821. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directoryseebelowraid5 cache 8hdd 12004006008001000Min: 987 / Avg: 991 / Max: 999Min: 980 / Avg: 981.67 / Max: 9841. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directoryseebelowraid5 cache 8hdd 1110220330440550SE +/- 2.00, N = 34924871. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directoryseebelowraid5 cache 8hdd 190180270360450Min: 490 / Avg: 492 / Max: 4961. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryseebelowraid5 cache 8hdd 190180270360450SE +/- 7.25, N = 15SE +/- 3.79, N = 34234151. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryseebelowraid5 cache 8hdd 180160240320400Min: 395 / Avg: 423.27 / Max: 496Min: 409 / Avg: 415 / Max: 4221. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryseebelowraid5 cache 8hdd 120K40K60K80K100KSE +/- 1850.27, N = 15SE +/- 881.92, N = 31082671063331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryseebelowraid5 cache 8hdd 120K40K60K80K100KMin: 101000 / Avg: 108266.67 / Max: 127000Min: 105000 / Avg: 106333.33 / Max: 1080001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directoryseebelowraid5 cache 8hdd 12004006008001000SE +/- 0.58, N = 3SE +/- 1.15, N = 3110611071. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directoryseebelowraid5 cache 8hdd 12004006008001000Min: 1105 / Avg: 1106 / Max: 1107Min: 1105 / Avg: 1107 / Max: 11091. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directoryseebelowraid5 cache 8hdd 1120240360480600SE +/- 0.33, N = 3SE +/- 0.58, N = 35505501. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directoryseebelowraid5 cache 8hdd 1100200300400500Min: 549 / Avg: 549.67 / Max: 550Min: 549 / Avg: 550 / Max: 5511. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryseebelowraid5 cache 8hdd 1120240360480600SE +/- 2.08, N = 3SE +/- 3.48, N = 35725591. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryseebelowraid5 cache 8hdd 1100200300400500Min: 568 / Avg: 572 / Max: 575Min: 553 / Avg: 558.67 / Max: 5651. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryseebelowraid5 cache 8hdd 130K60K90K120K150KSE +/- 666.67, N = 3SE +/- 881.92, N = 31463331433331. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.18Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directoryseebelowraid5 cache 8hdd 130K60K90K120K150KMin: 145000 / Avg: 146333.33 / Max: 147000Min: 142000 / Avg: 143333.33 / Max: 1450001. (CC) gcc options: -rdynamic -std=gnu99 -ffast-math -include -O3 -fcommon -U_FORTIFY_SOURCE -march=native -lrt -laio -lz -lpthread -lm -ldl

FS-Mark

FS_Mark is designed to test a system's file-system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Sizeseebelowraid5 cache 8hdd 150100150200250SE +/- 7.72, N = 14SE +/- 1.54, N = 3242.8250.91. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Sizeseebelowraid5 cache 8hdd 150100150200250Min: 148.6 / Avg: 242.79 / Max: 260.7Min: 248.8 / Avg: 250.9 / Max: 253.91. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 Threadsseebelowraid5 cache 8hdd 1110220330440550SE +/- 6.29, N = 5SE +/- 1.07, N = 3498.0510.11. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 Threadsseebelowraid5 cache 8hdd 190180270360450Min: 479.6 / Avg: 497.98 / Max: 518.8Min: 508 / Avg: 510.13 / Max: 511.21. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB Sizeseebelowraid5 cache 8hdd 150100150200250SE +/- 2.80, N = 15SE +/- 2.50, N = 3236.7249.51. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB Sizeseebelowraid5 cache 8hdd 150100150200250Min: 207.6 / Avg: 236.67 / Max: 249Min: 245.5 / Avg: 249.5 / Max: 254.11. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size, No Sync/FSyncseebelowraid5 cache 8hdd 130060090012001500SE +/- 15.39, N = 3SE +/- 16.76, N = 31605.01579.91. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size, No Sync/FSyncseebelowraid5 cache 8hdd 130060090012001500Min: 1574.2 / Avg: 1604.97 / Max: 1621.1Min: 1552.5 / Avg: 1579.87 / Max: 1610.31. (CC) gcc options: -static

Dbench

Dbench is a benchmark designed by the Samba project as a free alternative to netbench, but dbench contains only file-system calls for testing the disk performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.012 Clientsseebelowraid5 cache 8hdd 1400800120016002000SE +/- 3.71, N = 3SE +/- 6.04, N = 31842.111802.061. (CC) gcc options: -lpopt -O2
OpenBenchmarking.orgMB/s, More Is BetterDbench 4.012 Clientsseebelowraid5 cache 8hdd 130060090012001500Min: 1837.19 / Avg: 1842.11 / Max: 1849.37Min: 1795.86 / Avg: 1802.06 / Max: 1814.131. (CC) gcc options: -lpopt -O2

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.01 Clientsseebelowraid5 cache 8hdd 160120180240300SE +/- 1.51, N = 3SE +/- 2.37, N = 3249.44252.421. (CC) gcc options: -lpopt -O2
OpenBenchmarking.orgMB/s, More Is BetterDbench 4.01 Clientsseebelowraid5 cache 8hdd 150100150200250Min: 246.47 / Avg: 249.44 / Max: 251.43Min: 248.84 / Avg: 252.42 / Max: 256.891. (CC) gcc options: -lpopt -O2

PostMark

This is a test of NetApp's PostMark benchmark designed to simulate small-file testing similar to the tasks endured by web and mail servers. This test profile will set PostMark to perform 25,000 transactions with 500 files simultaneously with the file sizes ranging between 5 and 512 kilobytes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction Performanceseebelowraid5 cache 8hdd 110002000300040005000SE +/- 26.33, N = 3443843851. (CC) gcc options: -O3
OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction Performanceseebelowraid5 cache 8hdd 18001600240032004000Min: 4385 / Avg: 4437.67 / Max: 44641. (CC) gcc options: -O3

24 Results Shown

SQLite
Flexible IO Tester:
  Rand Read - Linux AIO - No - Yes - 2MB - Default Test Directory:
    MB/s
    IOPS
  Rand Read - Linux AIO - No - Yes - 4KB - Default Test Directory:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - Yes - 2MB - Default Test Directory:
    MB/s
    IOPS
  Rand Write - Linux AIO - No - Yes - 4KB - Default Test Directory:
    MB/s
    IOPS
  Seq Read - Linux AIO - No - Yes - 2MB - Default Test Directory:
    MB/s
    IOPS
  Seq Read - Linux AIO - No - Yes - 4KB - Default Test Directory:
    MB/s
    IOPS
  Seq Write - Linux AIO - No - Yes - 2MB - Default Test Directory:
    MB/s
    IOPS
  Seq Write - Linux AIO - No - Yes - 4KB - Default Test Directory:
    MB/s
    IOPS
FS-Mark:
  1000 Files, 1MB Size
  5000 Files, 1MB Size, 4 Threads
  4000 Files, 32 Sub Dirs, 1MB Size
  1000 Files, 1MB Size, No Sync/FSync
Dbench:
  12 Clients
  1 Clients
PostMark

seebelow

Processor: 2 x Intel Xeon E5-2690 v3 @ 3.50GHz (24 Cores / 48 Threads), Motherboard: Supermicro X10DRI-T (3.2 BIOS), Chipset: Intel Xeon E7 v3/Xeon, Memory: 12 x 32 GB DDR4-2133MT/s, Disk: 1000GB DefaultValue0 + 19899GB iSCSI Storage, Graphics: ASPEED, Monitor: BenQ GL2450H, Network: Mellanox MT26448 + 2 x Intel 10-Gigabit X540-AT2

OS: Ubuntu 20.04, Kernel: 5.4.0-48-generic (x86_64), Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Disk Notes: MQ-DEADLINE / relatime,rw
Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x43
Python Notes: Python 3.8.2
Security Notes: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 30 September 2020 15:12 by user eikonabench.

raid5 cache 8hdd 1

Processor: 2 x Intel Xeon E5-2690 v3 @ 3.50GHz (24 Cores / 48 Threads), Motherboard: Supermicro X10DRI-T (3.2 BIOS), Chipset: Intel Xeon E7 v3/Xeon, Memory: 12 x 32 GB DDR4-2133MT/s, Disk: 1000GB DefaultValue0 + 27858GB iSCSI Storage, Graphics: ASPEED, Monitor: BenQ GL2450H, Network: Mellanox MT26448 + 2 x Intel 10-Gigabit X540-AT2

OS: Ubuntu 20.04, Kernel: 5.4.0-48-generic (x86_64), Display Server: X Server, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Disk Notes: MQ-DEADLINE / relatime,rw
Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x43
Security Notes: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 2 October 2020 06:31 by user root.