FreeBSD ZFS SSD RAID Benchmarks

Benchmarks for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1812080-SK-FREEBSDZF19
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

CPU Massive 3 Tests
Database Test Suite 2 Tests
Disk Test Suite 5 Tests
Common Kernel Benchmarks 3 Tests
Server 3 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
RAIDZ1 20 Disks
December 07 2018
  2 Hours, 36 Minutes
Stripe 20 Disks
December 07 2018
  2 Hours, 20 Minutes
RAIDZ3 20 Disks
December 08 2018
  1 Hour, 51 Minutes
Single Disk
December 08 2018
  2 Hours, 22 Minutes
RAID10 20 Disks
December 08 2018
  2 Hours, 18 Minutes
Invert Hiding All Results Option
  2 Hours, 18 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


FreeBSD ZFS SSD RAID BenchmarksProcessorMotherboardChipsetMemoryDisk ChipsetOSKernelCompilerFile-SystemScreen Resolution File-SystemRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 DisksAMD EPYC 7601 32-Core @ 2.20GHz (128 Cores)Dell PowerEdge R7425AMD [AMD] Family 17h (Models 00h-0fh) Root Complex524032MB20 x ATA Samsung SSD 860 1B6Q + DP BP14G+EXP 2.17 + SSDSCKJB120G7R N201DL43FreeBSD12.0-RC3 (x86_64)Clang 6.0.1 (SVN 335540)zfs1024x768zfszfsATA Samsung SSD 860 1B6Q + DP BP14G+EXP 2.17 + SSDSCKJB120G7R N201DL43AMD [AMD] Family 17h (Models 00h-0fh) Root Complex20 x ATA Samsung SSD 860 1B6Q + DP BP14G+EXP 2.17 + SSDSCKJB120G7R N201DL43OpenBenchmarking.orgPython Details- Python 2.7.15 + Python 3.6.6

RAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 DisksResult OverviewPhoronix Test Suite100%115%130%145%160%SQLitePostMarkPostgreSQL pgbenchFlexible IO TesterCompile BenchIOzoneOSBenchBlogBench

FreeBSD ZFS SSD RAID Benchmarkssqlite: Timed SQLite Insertionsfio: Rand Read - POSIX AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryblogbench: Readblogbench: Writeiozone: 1MB - 8GB - Read Performanceiozone: 4Kb - 8GB - Read Performanceiozone: 1MB - 8GB - Write Performanceiozone: 4Kb - 8GB - Write Performanceiozone: 64Kb - 8GB - Read Performanceiozone: 1MB - 512MB - Read Performanceiozone: 4Kb - 512MB - Read Performanceiozone: 64Kb - 8GB - Write Performanceiozone: 1MB - 512MB - Write Performanceiozone: 4Kb - 512MB - Write Performanceiozone: 64Kb - 512MB - Read Performanceiozone: 64Kb - 512MB - Write Performancecompilebench: Compilecompilebench: Initial Createpostmark: Disk Transaction Performancepgbench: Buffer Test - Normal Load - Read Onlypgbench: Buffer Test - Normal Load - Read Writeosbench: Create FilesRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks35.1419200238812592.2518900238808518016337231476639209625874456077638920851650204837159211372925136323241943191576.7326.1819100238657690.87193332456995179161812315666912107304339961076380207218031911388597213311045139331842403288080.5539.9119133238829079.1319133241820717115697030186694211125944196117644021171658167136156141342890133326041800187880.0725.021846724019218833240200161269320866462107349948860556630210922062370409569317281141140431242780214177.7126.5418967238679592.17191332416989186160529313066702116302645460216469211017912275421595014921043140333342388282877.26OpenBenchmarking.org

SQLite

This is a simple benchmark of SQLite. At present this test profile just measures the time to perform a pre-defined number of insertions on an indexed database. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite InsertionsRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks918273645SE +/- 0.55, N = 3SE +/- 0.17, N = 3SE +/- 0.27, N = 3SE +/- 0.03, N = 3SE +/- 0.15, N = 335.1426.1839.9125.0226.541. (CC) clang options: -O2 -lz -lpthread
OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite InsertionsRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks816243240Min: 34.42 / Avg: 35.14 / Max: 36.23Min: 25.93 / Avg: 26.18 / Max: 26.51Min: 39.46 / Avg: 39.91 / Max: 40.39Min: 24.97 / Avg: 25.02 / Max: 25.07Min: 26.3 / Avg: 26.54 / Max: 26.831. (CC) clang options: -O2 -lz -lpthread

Flexible IO Tester

Fio is an advanced disk benchmark that depends upon the kernel's AIO access library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks4K8K12K16K20KSE +/- 120.19, N = 3SE +/- 290.59, N = 3SE +/- 33.33, N = 319200191001913318467189671. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks3K6K9K12K15KMin: 18900 / Avg: 19133.33 / Max: 19300Min: 18000 / Avg: 18466.67 / Max: 19000Min: 18900 / Avg: 18966.67 / Max: 190001. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks50100150200250SE +/- 1.53, N = 3SE +/- 3.71, N = 3SE +/- 1.76, N = 3SE +/- 2.19, N = 32382382382402381. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks4080120160200Min: 235 / Avg: 238 / Max: 240Min: 231 / Avg: 238.33 / Max: 243Min: 235 / Avg: 237.67 / Max: 241Min: 237 / Avg: 239.67 / Max: 2441. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks13K26K39K52K65KSE +/- 384.42, N = 3SE +/- 916.52, N = 3SE +/- 472.58, N = 3SE +/- 578.31, N = 3SE +/- 57.74, N = 360933610006090061267610001. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks11K22K33K44K55KMin: 60200 / Avg: 60933.33 / Max: 61500Min: 59200 / Avg: 61000 / Max: 62200Min: 60200 / Avg: 60900 / Max: 61800Min: 60500 / Avg: 61266.67 / Max: 62400Min: 60900 / Avg: 61000 / Max: 611001. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksRAID10 20 Disks2K4K6K8K10KSE +/- 88.88, N = 10SE +/- 102.00, N = 12SE +/- 94.07, N = 12SE +/- 120.20, N = 1281256576829067951. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksRAID10 20 Disks14002800420056007000Min: 7538 / Avg: 8125.1 / Max: 8401Min: 6060 / Avg: 6575.92 / Max: 7067Min: 7612 / Avg: 8290.17 / Max: 8965Min: 6006 / Avg: 6794.5 / Max: 75051. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks4080120160200SE +/- 1.51, N = 4SE +/- 0.54, N = 3SE +/- 0.50, N = 3SE +/- 0.92, N = 392.2590.8779.13192.0092.171. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks4080120160200Min: 89.6 / Avg: 92.25 / Max: 96.5Min: 90.1 / Avg: 90.87 / Max: 91.9Min: 78.2 / Avg: 79.13 / Max: 79.9Min: 90.6 / Avg: 92.17 / Max: 93.81. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks11K22K33K44K55KSE +/- 393.70, N = 4SE +/- 120.19, N = 3SE +/- 145.30, N = 3SE +/- 33.33, N = 3SE +/- 176.38, N = 323600232672026749167232671. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks9K18K27K36K45KMin: 22900 / Avg: 23600 / Max: 24700Min: 23100 / Avg: 23266.67 / Max: 23500Min: 20000 / Avg: 20266.67 / Max: 20500Min: 49100 / Avg: 49166.67 / Max: 49200Min: 23000 / Avg: 23266.67 / Max: 236001. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks4K8K12K16K20KSE +/- 251.66, N = 3SE +/- 33.33, N = 3SE +/- 176.38, N = 3SE +/- 272.85, N = 3SE +/- 120.19, N = 318900193331913318833191331. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks3K6K9K12K15KMin: 18400 / Avg: 18900 / Max: 19200Min: 19300 / Avg: 19333.33 / Max: 19400Min: 18800 / Avg: 19133.33 / Max: 19400Min: 18300 / Avg: 18833.33 / Max: 19200Min: 18900 / Avg: 19133.33 / Max: 193001. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks50100150200250SE +/- 1.67, N = 3SE +/- 2.00, N = 3SE +/- 0.88, N = 3SE +/- 2.08, N = 32382452412402411. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks4080120160200Min: 236 / Avg: 237.67 / Max: 241Min: 243 / Avg: 245 / Max: 249Min: 238 / Avg: 239.67 / Max: 241Min: 237 / Avg: 241 / Max: 2441. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks13K26K39K52K65KSE +/- 470.22, N = 3SE +/- 566.67, N = 3SE +/- 145.30, N = 3SE +/- 233.33, N = 3SE +/- 589.73, N = 360867627676163361433614331. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks11K22K33K44K55KMin: 60300 / Avg: 60866.67 / Max: 61800Min: 62200 / Avg: 62766.67 / Max: 63900Min: 61400 / Avg: 61633.33 / Max: 61900Min: 61000 / Avg: 61433.33 / Max: 61800Min: 60700 / Avg: 61433.33 / Max: 626001. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksRAID10 20 Disks2K4K6K8K10KSE +/- 72.09, N = 3SE +/- 113.76, N = 12SE +/- 87.61, N = 12SE +/- 80.57, N = 1280856995820769891. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksRAID10 20 Disks14002800420056007000Min: 7948 / Avg: 8085.33 / Max: 8192Min: 6480 / Avg: 6995.17 / Max: 7621Min: 7873 / Avg: 8206.67 / Max: 8860Min: 6662 / Avg: 6989.08 / Max: 74461. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks4080120160200SE +/- 2.00, N = 3SE +/- 0.88, N = 3SE +/- 0.58, N = 31801791712001861. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt
OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks4080120160200Min: 167 / Avg: 171 / Max: 173Min: 199 / Avg: 200.33 / Max: 202Min: 185 / Avg: 186 / Max: 1871. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks11K22K33K44K55KSE +/- 145.30, N = 3SE +/- 470.22, N = 3SE +/- 166.67, N = 3SE +/- 120.19, N = 346133458004383351267475671. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks9K18K27K36K45KMin: 45900 / Avg: 46133.33 / Max: 46400Min: 42900 / Avg: 43833.33 / Max: 44400Min: 51100 / Avg: 51266.67 / Max: 51600Min: 47400 / Avg: 47566.67 / Max: 478001. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt

BlogBench

BlogBench is designed to replicate the load of a real-world busy file server by stressing the file-system with multiple threads of random reads, writes, and rewrites. The behavior is mimicked of that of a blog by creating blogs with content and pictures, modifying blog posts, adding comments to these blogs, and then reading the content of the blogs. All of these blogs generated are created locally with fake content and pictures. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.1Test: ReadRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks30K60K90K120K150KSE +/- 2001.90, N = 8SE +/- 1752.00, N = 3SE +/- 1041.60, N = 3SE +/- 2686.95, N = 3SE +/- 1266.85, N = 31633721618121569701612691605291. (CC) clang options: -O2 -pthread
OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.1Test: ReadRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks30K60K90K120K150KMin: 154322 / Avg: 163371.5 / Max: 171595Min: 158768 / Avg: 161812.33 / Max: 164837Min: 155621 / Avg: 156969.67 / Max: 159019Min: 157183 / Avg: 161269.33 / Max: 166335Min: 158973 / Avg: 160529.33 / Max: 1630391. (CC) clang options: -O2 -pthread

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.1Test: WriteRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks7001400210028003500SE +/- 90.82, N = 3SE +/- 42.15, N = 3SE +/- 33.71, N = 3SE +/- 52.94, N = 3SE +/- 20.88, N = 3314731563018320831301. (CC) clang options: -O2 -pthread
OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.1Test: WriteRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks6001200180024003000Min: 3047 / Avg: 3146.67 / Max: 3328Min: 3083 / Avg: 3156.33 / Max: 3229Min: 2978 / Avg: 3018 / Max: 3085Min: 3120 / Avg: 3208 / Max: 3303Min: 3107 / Avg: 3130.33 / Max: 31721. (CC) clang options: -O2 -pthread

IOzone

The IOzone benchmark tests the hard disk drive / file-system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Read PerformanceRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks14002800420056007000SE +/- 15.45, N = 3SE +/- 16.35, N = 3SE +/- 26.23, N = 3SE +/- 24.91, N = 3SE +/- 21.60, N = 366396691669466466670
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Read PerformanceRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks12002400360048006000Min: 6619.7 / Avg: 6639.21 / Max: 6669.72Min: 6663.65 / Avg: 6690.52 / Max: 6720.08Min: 6643.18 / Avg: 6693.52 / Max: 6731.47Min: 6615.04 / Avg: 6646.36 / Max: 6695.58Min: 6628.2 / Avg: 6670.02 / Max: 6700.3

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Read PerformanceRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks5001000150020002500SE +/- 4.29, N = 3SE +/- 4.94, N = 3SE +/- 5.35, N = 3SE +/- 6.80, N = 3SE +/- 0.22, N = 320962107211121072116
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Read PerformanceRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks400800120016002000Min: 2087.76 / Avg: 2096.21 / Max: 2101.78Min: 2101.05 / Avg: 2106.88 / Max: 2116.69Min: 2100.21 / Avg: 2110.82 / Max: 2117.39Min: 2094.81 / Avg: 2107.29 / Max: 2118.2Min: 2115.75 / Avg: 2116.16 / Max: 2116.51

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Write PerformanceRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks8001600240032004000SE +/- 35.29, N = 3SE +/- 21.58, N = 3SE +/- 11.48, N = 3SE +/- 67.16, N = 3SE +/- 30.39, N = 325873043259434993026
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Write PerformanceRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks6001200180024003000Min: 2517.91 / Avg: 2586.53 / Max: 2635.13Min: 3017.55 / Avg: 3043.01 / Max: 3085.92Min: 2570.86 / Avg: 2593.54 / Max: 2608.03Min: 3398.32 / Avg: 3499.2 / Max: 3626.44Min: 2987.27 / Avg: 3025.82 / Max: 3085.79

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Write PerformanceRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks110220330440550SE +/- 5.97, N = 3SE +/- 4.31, N = 12SE +/- 5.15, N = 12SE +/- 7.91, N = 3SE +/- 7.09, N = 12445399419488454
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Write PerformanceRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks90180270360450Min: 433.55 / Avg: 445.48 / Max: 451.6Min: 374.6 / Avg: 398.54 / Max: 416.23Min: 398.29 / Avg: 419.44 / Max: 445.34Min: 475.13 / Avg: 488.3 / Max: 502.48Min: 416.73 / Avg: 454.31 / Max: 491.44

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 8GB - Disk Test: Read PerformanceRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks13002600390052006500SE +/- 19.19, N = 3SE +/- 17.33, N = 3SE +/- 20.91, N = 3SE +/- 34.98, N = 3SE +/- 28.19, N = 360776107611760556021
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 8GB - Disk Test: Read PerformanceRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks11002200330044005500Min: 6040.3 / Avg: 6076.65 / Max: 6105.5Min: 6086.72 / Avg: 6106.57 / Max: 6141.1Min: 6075.37 / Avg: 6117.1 / Max: 6140.12Min: 5988.97 / Avg: 6054.93 / Max: 6108.1Min: 5983.83 / Avg: 6021.2 / Max: 6076.45

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 512MB - Disk Test: Read PerformanceRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks14002800420056007000SE +/- 93.30, N = 5SE +/- 64.15, N = 3SE +/- 82.98, N = 7SE +/- 26.95, N = 3SE +/- 34.83, N = 363896380644066306469
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 512MB - Disk Test: Read PerformanceRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks12002400360048006000Min: 6039.8 / Avg: 6389.13 / Max: 6556.89Min: 6252.29 / Avg: 6380.18 / Max: 6453.07Min: 5953 / Avg: 6440.08 / Max: 6581.32Min: 6579.71 / Avg: 6630.28 / Max: 6671.7Min: 6399.69 / Avg: 6469.19 / Max: 6507.87

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 512MB - Disk Test: Read PerformanceRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks5001000150020002500SE +/- 3.36, N = 3SE +/- 40.82, N = 3SE +/- 2.50, N = 3SE +/- 6.52, N = 3SE +/- 8.96, N = 320852072211721092110
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 512MB - Disk Test: Read PerformanceRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks400800120016002000Min: 2078.38 / Avg: 2084.77 / Max: 2089.76Min: 1990.62 / Avg: 2071.59 / Max: 2121.09Min: 2113.27 / Avg: 2116.85 / Max: 2121.66Min: 2096.26 / Avg: 2108.86 / Max: 2118.06Min: 2094.07 / Avg: 2110.37 / Max: 2124.95

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 8GB - Disk Test: Write PerformanceRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks5001000150020002500SE +/- 27.14, N = 3SE +/- 17.15, N = 3SE +/- 5.37, N = 3SE +/- 29.66, N = 3SE +/- 8.13, N = 316501803165822061791
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 8GB - Disk Test: Write PerformanceRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks400800120016002000Min: 1595.39 / Avg: 1649.63 / Max: 1678.58Min: 1769.75 / Avg: 1803.04 / Max: 1826.87Min: 1647.09 / Avg: 1657.75 / Max: 1664.22Min: 2162.69 / Avg: 2205.9 / Max: 2262.69Min: 1780.67 / Avg: 1791.11 / Max: 1807.14

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 512MB - Disk Test: Write PerformanceRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks5001000150020002500SE +/- 22.20, N = 3SE +/- 139.65, N = 12SE +/- 31.70, N = 3SE +/- 32.40, N = 12SE +/- 46.61, N = 1220481911167123702275
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 512MB - Disk Test: Write PerformanceRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks400800120016002000Min: 2018.32 / Avg: 2047.84 / Max: 2091.33Min: 851.45 / Avg: 1911.04 / Max: 2285.45Min: 1624.2 / Avg: 1671.36 / Max: 1731.63Min: 2154.65 / Avg: 2370.45 / Max: 2517.79Min: 2013.54 / Avg: 2275.21 / Max: 2528.79

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 512MB - Disk Test: Write PerformanceRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks90180270360450SE +/- 5.25, N = 12SE +/- 4.40, N = 3SE +/- 4.33, N = 8SE +/- 5.91, N = 12SE +/- 6.99, N = 12371388361409421
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 512MB - Disk Test: Write PerformanceRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks70140210280350Min: 341.78 / Avg: 371.05 / Max: 387.41Min: 382.37 / Avg: 387.64 / Max: 396.38Min: 339.5 / Avg: 360.94 / Max: 376.7Min: 376.45 / Avg: 408.69 / Max: 432.52Min: 386.3 / Avg: 420.77 / Max: 459.7

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 512MB - Disk Test: Read PerformanceRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks13002600390052006500SE +/- 55.94, N = 3SE +/- 37.94, N = 3SE +/- 197.26, N = 12SE +/- 128.37, N = 12SE +/- 48.43, N = 359215972561456935950
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 512MB - Disk Test: Read PerformanceRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks10002000300040005000Min: 5810.47 / Avg: 5921.15 / Max: 5990.62Min: 5903.92 / Avg: 5971.56 / Max: 6035.18Min: 4346.17 / Avg: 5614.31 / Max: 6033.74Min: 4836.57 / Avg: 5693.48 / Max: 6052.22Min: 5853.23 / Avg: 5950.06 / Max: 6000.44

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 512MB - Disk Test: Write PerformanceRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks400800120016002000SE +/- 22.97, N = 12SE +/- 17.14, N = 12SE +/- 17.84, N = 12SE +/- 19.26, N = 12SE +/- 21.82, N = 1213721331134217281492
OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 512MB - Disk Test: Write PerformanceRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks30060090012001500Min: 1164.32 / Avg: 1371.98 / Max: 1468.42Min: 1221.32 / Avg: 1331.43 / Max: 1451.63Min: 1255.64 / Avg: 1341.63 / Max: 1462.16Min: 1647.74 / Avg: 1728.45 / Max: 1872Min: 1385.26 / Avg: 1492.43 / Max: 1689.75

Compile Bench

Compilebench tries to age a filesystem by simulating some of the disk IO common in creating, compiling, patching, stating and reading kernel trees. It indirectly measures how well filesystems can maintain directory locality as the disk fills up and directories age. This current test is setup to use the makej mode with 10 initial directories Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks2004006008001000SE +/- 15.82, N = 4SE +/- 13.52, N = 3SE +/- 5.79, N = 3SE +/- 6.65, N = 3SE +/- 4.57, N = 3925104589011411043
OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks2004006008001000Min: 898.69 / Avg: 924.53 / Max: 965.65Min: 1027.81 / Avg: 1045.3 / Max: 1071.91Min: 878.64 / Avg: 889.55 / Max: 898.35Min: 1131.81 / Avg: 1141.33 / Max: 1154.14Min: 1037.17 / Avg: 1043.18 / Max: 1052.15

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks306090120150SE +/- 0.55, N = 3SE +/- 0.07, N = 3SE +/- 0.56, N = 3SE +/- 0.48, N = 3SE +/- 0.76, N = 3136139133140140
OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks306090120150Min: 134.65 / Avg: 135.73 / Max: 136.4Min: 139.14 / Avg: 139.27 / Max: 139.34Min: 131.44 / Avg: 132.56 / Max: 133.15Min: 139.41 / Avg: 140.29 / Max: 141.06Min: 138.13 / Avg: 139.57 / Max: 140.71

PostMark

This is a test of NetApp's PostMark benchmark designed to simulate small-file testing similar to the tasks endured by web and mail servers. This test profile will set PostMark to perform 25,000 transactions with 500 files simultaneously with the file sizes ranging between 5 and 512 kilobytes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks9001800270036004500SE +/- 13.67, N = 3SE +/- 14.67, N = 3SE +/- 14.33, N = 3SE +/- 99.00, N = 9323233183260431233331. (CC) clang options: -O3
OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks7001400210028003500Min: 3205 / Avg: 3232.33 / Max: 3246Min: 3289 / Avg: 3318.33 / Max: 3333Min: 3246 / Avg: 3260.33 / Max: 3289Min: 3787 / Avg: 4312.11 / Max: 47161. (CC) clang options: -O3

PostgreSQL pgbench

This is a simple benchmark of PostgreSQL using pgbench. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Buffer Test - Test: Normal Load - Mode: Read OnlyRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks9K18K27K36K45KSE +/- 113.65, N = 3SE +/- 259.57, N = 3SE +/- 64.59, N = 3SE +/- 280.54, N = 3SE +/- 311.71, N = 341943424034180042780423881. (CC) clang options: -fno-strict-aliasing -fwrapv -O2 -fPIC -lpgport -shared
OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Buffer Test - Test: Normal Load - Mode: Read OnlyRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks7K14K21K28K35KMin: 41806.43 / Avg: 41942.71 / Max: 42168.39Min: 41944.05 / Avg: 42402.56 / Max: 42842.65Min: 41698.75 / Avg: 41799.89 / Max: 41920.05Min: 42297.2 / Avg: 42780.31 / Max: 43268.98Min: 41782.68 / Avg: 42387.73 / Max: 42820.371. (CC) clang options: -fno-strict-aliasing -fwrapv -O2 -fPIC -lpgport -shared

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Buffer Test - Test: Normal Load - Mode: Read WriteRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks6001200180024003000SE +/- 24.99, N = 7SE +/- 68.03, N = 8SE +/- 32.38, N = 3SE +/- 32.07, N = 9SE +/- 33.38, N = 8191528801878214128281. (CC) clang options: -fno-strict-aliasing -fwrapv -O2 -fPIC -lpgport -shared
OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Buffer Test - Test: Normal Load - Mode: Read WriteRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks5001000150020002500Min: 1849.61 / Avg: 1914.86 / Max: 2011.46Min: 2534.41 / Avg: 2879.91 / Max: 3073.92Min: 1820.9 / Avg: 1878.28 / Max: 1932.97Min: 1958.16 / Avg: 2140.63 / Max: 2277.48Min: 2697.7 / Avg: 2827.76 / Max: 2970.881. (CC) clang options: -fno-strict-aliasing -fwrapv -O2 -fPIC -lpgport -shared

OSBench

OSBench is a collection of micro-benchmarks for measuring operating system primitives like time to create threads/processes, launching programs, creating files, and memory allocation. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create FilesRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks20406080100SE +/- 0.45, N = 3SE +/- 0.91, N = 3SE +/- 1.37, N = 3SE +/- 0.78, N = 3SE +/- 1.12, N = 376.7380.5580.0777.7177.261. (CC) clang options: -lm
OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create FilesRAIDZ1 20 DisksStripe 20 DisksRAIDZ3 20 DisksSingle DiskRAID10 20 Disks1530456075Min: 76.08 / Avg: 76.73 / Max: 77.59Min: 78.73 / Avg: 80.55 / Max: 81.62Min: 77.68 / Avg: 80.07 / Max: 82.42Min: 76.22 / Avg: 77.71 / Max: 78.87Min: 76.1 / Avg: 77.26 / Max: 79.51. (CC) clang options: -lm