FreeBSD ZFS RAID Benchmarks

AMD EPYC 7601 32-Core testing on FreeBSD via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1812073-SK-1812079SK09
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

CPU Massive 3 Tests
Database Test Suite 2 Tests
Disk Test Suite 5 Tests
Common Kernel Benchmarks 3 Tests
Server 3 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
RAIDZ1 20 Disks
December 07 2018
  2 Hours, 36 Minutes
Stripe 20 Disks
December 07 2018
  2 Hours, 20 Minutes
Invert Hiding All Results Option
  2 Hours, 28 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


FreeBSD ZFS RAID Benchmarks - Phoronix Test Suite

FreeBSD ZFS RAID Benchmarks

AMD EPYC 7601 32-Core testing on FreeBSD via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/1812073-SK-1812079SK09&grt&sro.

FreeBSD ZFS RAID BenchmarksProcessorMotherboardChipsetMemoryDiskOSKernelCompilerFile-SystemScreen ResolutionRAIDZ1 20 DisksStripe 20 DisksAMD EPYC 7601 32-Core @ 2.20GHz (128 Cores)Dell PowerEdge R7425AMD [AMD] Family 17h (Models 00h-0fh) Root Complex524032MB20 x ATA Samsung SSD 860 1B6Q + DP BP14G+EXP 2.17 + SSDSCKJB120G7R N201DL43FreeBSD12.0-RC3 (x86_64)Clang 6.0.1 (SVN 335540)zfs1024x768OpenBenchmarking.orgPython Details- Python 2.7.15 + Python 3.6.6

FreeBSD ZFS RAID Benchmarksblogbench: Readblogbench: Writecompilebench: Compilecompilebench: Initial Createfio: Rand Read - POSIX AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 2MB - Default Test Directoryfio: Rand Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Read - POSIX AIO - No - Yes - 4KB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 2MB - Default Test Directoryfio: Seq Write - POSIX AIO - No - Yes - 4KB - Default Test Directoryiozone: 1MB - 8GB - Read Performanceiozone: 4Kb - 8GB - Read Performanceiozone: 1MB - 8GB - Write Performanceiozone: 4Kb - 8GB - Write Performanceiozone: 64Kb - 8GB - Read Performanceiozone: 1MB - 512MB - Read Performanceiozone: 4Kb - 512MB - Read Performanceiozone: 64Kb - 8GB - Write Performanceiozone: 1MB - 512MB - Write Performanceiozone: 4Kb - 512MB - Write Performanceiozone: 64Kb - 512MB - Read Performanceiozone: 64Kb - 512MB - Write Performanceosbench: Create Filespgbench: Buffer Test - Normal Load - Read Onlypgbench: Buffer Test - Normal Load - Read Writepostmark: Disk Transaction Performancesqlite: Timed SQLite InsertionsRAIDZ1 20 DisksStripe 20 Disks163372314792513619200238812592.25189002388085180663920962587445607763892085165020483715921137276.73419431915323235.141618123156104513919100238657690.87193332456995179669121073043399610763802072180319113885972133180.55424032880331826.18OpenBenchmarking.org

BlogBench

Test: Read

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.1Test: ReadRAIDZ1 20 DisksStripe 20 Disks30K60K90K120K150KSE +/- 2001.90, N = 8SE +/- 1752.00, N = 31633721618121. (CC) clang options: -O2 -pthread

BlogBench

Test: Write

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.1Test: WriteRAIDZ1 20 DisksStripe 20 Disks7001400210028003500SE +/- 90.82, N = 3SE +/- 42.15, N = 3314731561. (CC) clang options: -O2 -pthread

Compile Bench

Test: Compile

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileRAIDZ1 20 DisksStripe 20 Disks2004006008001000SE +/- 15.82, N = 4SE +/- 13.52, N = 39251045

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateRAIDZ1 20 DisksStripe 20 Disks306090120150SE +/- 0.55, N = 3SE +/- 0.07, N = 3136139

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 Disks4K8K12K16K20K19200191001. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 Disks50100150200250SE +/- 1.53, N = 3SE +/- 3.71, N = 32382381. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt

Flexible IO Tester

Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Random Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 Disks13K26K39K52K65KSE +/- 384.42, N = 3SE +/- 916.52, N = 360933610001. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 Disks2K4K6K8K10KSE +/- 88.88, N = 10SE +/- 102.00, N = 12812565761. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 Disks20406080100SE +/- 1.51, N = 4SE +/- 0.54, N = 392.2590.871. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt

Flexible IO Tester

Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Random Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 Disks5K10K15K20K25KSE +/- 393.70, N = 4SE +/- 120.19, N = 323600232671. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 Disks4K8K12K16K20KSE +/- 251.66, N = 3SE +/- 33.33, N = 318900193331. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 Disks50100150200250SE +/- 1.67, N = 3SE +/- 2.00, N = 32382451. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt

Flexible IO Tester

Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Sequential Read - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 Disks13K26K39K52K65KSE +/- 470.22, N = 3SE +/- 566.67, N = 360867627671. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 Disks2K4K6K8K10KSE +/- 72.09, N = 3SE +/- 113.76, N = 12808569951. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 Disks40801201602001801791. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt

Flexible IO Tester

Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 3.1Type: Sequential Write - IO Engine: POSIX AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryRAIDZ1 20 DisksStripe 20 Disks10K20K30K40K50KSE +/- 145.30, N = 346133458001. (CC) clang options: -rdynamic -std=gnu99 -ffast-math -include -O3 -U_FORTIFY_SOURCE -ll -lrdmacm -libverbs -lz -lm -lpthread -lrt

IOzone

Record Size: 1MB - File Size: 8GB - Disk Test: Read Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Read PerformanceRAIDZ1 20 DisksStripe 20 Disks14002800420056007000SE +/- 15.45, N = 3SE +/- 16.35, N = 366396691

IOzone

Record Size: 4Kb - File Size: 8GB - Disk Test: Read Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Read PerformanceRAIDZ1 20 DisksStripe 20 Disks5001000150020002500SE +/- 4.29, N = 3SE +/- 4.94, N = 320962107

IOzone

Record Size: 1MB - File Size: 8GB - Disk Test: Write Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 8GB - Disk Test: Write PerformanceRAIDZ1 20 DisksStripe 20 Disks7001400210028003500SE +/- 35.29, N = 3SE +/- 21.58, N = 325873043

IOzone

Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Write PerformanceRAIDZ1 20 DisksStripe 20 Disks100200300400500SE +/- 5.97, N = 3SE +/- 4.31, N = 12445399

IOzone

Record Size: 64Kb - File Size: 8GB - Disk Test: Read Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 8GB - Disk Test: Read PerformanceRAIDZ1 20 DisksStripe 20 Disks13002600390052006500SE +/- 19.19, N = 3SE +/- 17.33, N = 360776107

IOzone

Record Size: 1MB - File Size: 512MB - Disk Test: Read Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 512MB - Disk Test: Read PerformanceRAIDZ1 20 DisksStripe 20 Disks14002800420056007000SE +/- 93.30, N = 5SE +/- 64.15, N = 363896380

IOzone

Record Size: 4Kb - File Size: 512MB - Disk Test: Read Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 512MB - Disk Test: Read PerformanceRAIDZ1 20 DisksStripe 20 Disks400800120016002000SE +/- 3.36, N = 3SE +/- 40.82, N = 320852072

IOzone

Record Size: 64Kb - File Size: 8GB - Disk Test: Write Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 8GB - Disk Test: Write PerformanceRAIDZ1 20 DisksStripe 20 Disks400800120016002000SE +/- 27.14, N = 3SE +/- 17.15, N = 316501803

IOzone

Record Size: 1MB - File Size: 512MB - Disk Test: Write Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 1MB - File Size: 512MB - Disk Test: Write PerformanceRAIDZ1 20 DisksStripe 20 Disks400800120016002000SE +/- 22.20, N = 3SE +/- 139.65, N = 1220481911

IOzone

Record Size: 4Kb - File Size: 512MB - Disk Test: Write Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 512MB - Disk Test: Write PerformanceRAIDZ1 20 DisksStripe 20 Disks80160240320400SE +/- 5.25, N = 12SE +/- 4.40, N = 3371388

IOzone

Record Size: 64Kb - File Size: 512MB - Disk Test: Read Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 512MB - Disk Test: Read PerformanceRAIDZ1 20 DisksStripe 20 Disks13002600390052006500SE +/- 55.94, N = 3SE +/- 37.94, N = 359215972

IOzone

Record Size: 64Kb - File Size: 512MB - Disk Test: Write Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 64Kb - File Size: 512MB - Disk Test: Write PerformanceRAIDZ1 20 DisksStripe 20 Disks30060090012001500SE +/- 22.97, N = 12SE +/- 17.14, N = 1213721331

OSBench

Test: Create Files

OpenBenchmarking.orgus Per Event, Fewer Is BetterOSBenchTest: Create FilesRAIDZ1 20 DisksStripe 20 Disks20406080100SE +/- 0.45, N = 3SE +/- 0.91, N = 376.7380.551. (CC) clang options: -lm

PostgreSQL pgbench

Scaling: Buffer Test - Test: Normal Load - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Buffer Test - Test: Normal Load - Mode: Read OnlyRAIDZ1 20 DisksStripe 20 Disks9K18K27K36K45KSE +/- 113.65, N = 3SE +/- 259.57, N = 341943424031. (CC) clang options: -fno-strict-aliasing -fwrapv -O2 -fPIC -lpgport -shared

PostgreSQL pgbench

Scaling: Buffer Test - Test: Normal Load - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.3Scaling: Buffer Test - Test: Normal Load - Mode: Read WriteRAIDZ1 20 DisksStripe 20 Disks6001200180024003000SE +/- 24.99, N = 7SE +/- 68.03, N = 8191528801. (CC) clang options: -fno-strict-aliasing -fwrapv -O2 -fPIC -lpgport -shared

PostMark

Disk Transaction Performance

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceRAIDZ1 20 DisksStripe 20 Disks7001400210028003500SE +/- 13.67, N = 3SE +/- 14.67, N = 3323233181. (CC) clang options: -O3

SQLite

Timed SQLite Insertions

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite InsertionsRAIDZ1 20 DisksStripe 20 Disks816243240SE +/- 0.55, N = 3SE +/- 0.17, N = 335.1426.181. (CC) clang options: -O2 -lz -lpthread


Phoronix Test Suite v10.8.4