Flash Drive Btrfs RAUD File-System Test

Four USB 3.0 flash drive tested in Btrfs RAID on Ubuntu Linux. Benchmarks by Michael Larabel for a future article on Phoronix.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1508154-HA-FLASHDRIV39
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
Single Drive
August 14 2015
 
Four Drive RAID0
August 14 2015
 
Four Drive RAID1
August 14 2015
 
Four Drive RAID5
August 14 2015
 
Four Drive RAID6
August 15 2015
 
Four Drive RAID10
August 15 2015
 
Invert Behavior (Only Show Selected Data)
 

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

Single Drive

Compiler Notes: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v
Disk Notes: DEADLINE / relatime,rw,space_cache,subvol=/,subvolid=5
Processor Notes: Scaling Governor: intel_pstate powersave
System Notes: Disk Scheduler: DEADLINE.

Four Drive RAID0

Disk Notes: DEADLINE / relatime,rw,space_cache,subvol=/,subvolid=5 / RAID0
Processor Notes: Scaling Governor: intel_pstate powersave

Four Drive RAID1

Disk Notes: DEADLINE / relatime,rw,space_cache,subvol=/,subvolid=5 / RAID1
Processor Notes: Scaling Governor: intel_pstate powersave

Four Drive RAID5

Disk Notes: DEADLINE / relatime,rw,space_cache,subvol=/,subvolid=5
Processor Notes: Scaling Governor: intel_pstate powersave

Four Drive RAID6

Four Drive RAID10

Processor: Intel Core i7-5960X @ 3.50GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 240GB OCZ VERTEX3, Graphics: NVIDIA GeForce GTX 760 2048MB, Audio: Realtek ALC1150, Monitor: SyncMaster, Network: Intel Connection

OS: Ubuntu 15.04, Kernel: 4.2.0-999-generic (x86_64) 20150811, Desktop: Unity 7.3.2, Display Server: X Server 1.17.1, Display Driver: nouveau 1.0.11, OpenGL: 3.3 Mesa 10.5.2 Gallium 0.4, Compiler: GCC 4.9.2, File-System: btrfs, Screen Resolution: 2560x1600

Compiler Notes: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v
Disk Notes: DEADLINE / relatime,rw,space_cache,subvol=/,subvolid=5 / RAID10
Processor Notes: Scaling Governor: intel_pstate powersave
System Notes: Disk Scheduler: DEADLINE.

Flash Drive Btrfs RAUD File-System TestOpenBenchmarking.orgPhoronix Test SuiteIntel Core i7-5960X @ 3.50GHz (16 Cores)Gigabyte X99-UD4-CFIntel Xeon E5 v3/Core16384MB240GB OCZ VERTEX3NVIDIA GeForce GTX 760 2048MBRealtek ALC1150SyncMasterIntel ConnectionUbuntu 15.044.2.0-999-generic (x86_64) 20150811Unity 7.3.2X Server 1.17.1nouveau 1.0.113.3 Mesa 10.5.2 Gallium 0.4GCC 4.9.2btrfs2560x1600ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionFlash Drive Btrfs RAUD File-System Test BenchmarksSystem Logs- Single Drive, Four Drive RAID10: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Single Drive: DEADLINE / relatime,rw,space_cache,subvol=/,subvolid=5- Four Drive RAID0: DEADLINE / relatime,rw,space_cache,subvol=/,subvolid=5 / RAID0 - Four Drive RAID1: DEADLINE / relatime,rw,space_cache,subvol=/,subvolid=5 / RAID1 - Four Drive RAID5: DEADLINE / relatime,rw,space_cache,subvol=/,subvolid=5- Four Drive RAID6: DEADLINE / relatime,rw,space_cache,subvol=/,subvolid=5- Four Drive RAID10: DEADLINE / relatime,rw,space_cache,subvol=/,subvolid=5 / RAID10 - Scaling Governor: intel_pstate powersave- Single Drive, Four Drive RAID10: Disk Scheduler: DEADLINE.

Single DriveFour Drive RAID0Four Drive RAID1Four Drive RAID5Four Drive RAID6Four Drive RAID10Result OverviewPhoronix Test Suite100%282%463%645%827%FS-MarkFS-MarkPostMarkIOzoneSQLiteFlexible IO TesterFlexible IO TesterFlexible IO TesterFlexible IO Tester4.F.3.S.D.1.S1.F.1.SD.T.P4Kb - 512MB - Write PerformanceD.T.DSeq Write - POSIX AIO - Yes - Yes - 4KB - MB/sSeq Read - POSIX AIO - Yes - Yes - 4KB - MB/sRand Write - POSIX AIO - Yes - Yes - 4KB - MB/sRand Read - POSIX AIO - Yes - Yes - 4KB - MB/s

Flash Drive Btrfs RAUD File-System Testpostmark: Disk Transaction Performanceiozone: 4Kb - 512MB - Write Performancefs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizefs-mark: 1000 Files, 1MB Sizefio: Seq Write - POSIX AIO - Yes - Yes - 4KB - Default Test Directory - MB/sfio: Seq Read - POSIX AIO - Yes - Yes - 4KB - Default Test Directory - MB/sfio: Rand Write - POSIX AIO - Yes - Yes - 4KB - Default Test Directory - MB/sfio: Rand Read - POSIX AIO - Yes - Yes - 4KB - Default Test Directory - MB/ssqlite: Default Test DirectorySingle DriveFour Drive RAID0Four Drive RAID1Four Drive RAID5Four Drive RAID6Four Drive RAID10386718.089.437.2825.9924.4610.405.76865.61492954.4015.1312.4073.78100.7418.505.37769.47358320.379.237.1729.5526.6810.815.191036.02179537.291.831.7026.8964.665.044.692012.67124816.684.454.0228.5060.235.494.922155.89376833.3212.7010.8751.1064.1219.045.14850.14OpenBenchmarking.org

PostMark

This is a test of NetApp's PostMark benchmark designed to simulate small-file testing similar to the tasks endured by web and mail servers. This test profile will set PostMark to perform 25,000 transactions with 500 files simultaneously with the file sizes ranging between 5 and 512 kilobytes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction PerformanceSingle DriveFour Drive RAID0Four Drive RAID1Four Drive RAID5Four Drive RAID6Four Drive RAID1011002200330044005500SE +/- 315.44, N = 6SE +/- 166.83, N = 6SE +/- 294.26, N = 6SE +/- 28.42, N = 3SE +/- 120.72, N = 6SE +/- 478.84, N = 63867492935831795124837681. (CC) gcc options: -O3

IOzone

The IOzone benchmark tests the hard disk drive / file-system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.405Record Size: 4Kb - File Size: 512MB - Disk Test: Write PerformanceSingle DriveFour Drive RAID0Four Drive RAID1Four Drive RAID5Four Drive RAID6Four Drive RAID101224364860SE +/- 0.94, N = 6SE +/- 5.07, N = 6SE +/- 0.55, N = 6SE +/- 5.28, N = 6SE +/- 3.32, N = 6SE +/- 1.56, N = 618.0854.4020.3737.2916.6833.321. (CC) gcc options: -O3

FS-Mark

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeSingle DriveFour Drive RAID0Four Drive RAID1Four Drive RAID5Four Drive RAID6Four Drive RAID1048121620SE +/- 0.09, N = 3SE +/- 0.69, N = 6SE +/- 0.27, N = 6SE +/- 0.03, N = 3SE +/- 0.21, N = 6SE +/- 0.34, N = 69.4315.139.231.834.4512.701. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeSingle DriveFour Drive RAID0Four Drive RAID1Four Drive RAID5Four Drive RAID6Four Drive RAID103691215SE +/- 0.72, N = 6SE +/- 0.33, N = 6SE +/- 0.28, N = 6SE +/- 0.06, N = 6SE +/- 0.28, N = 6SE +/- 0.62, N = 67.2812.407.171.704.0210.871. (CC) gcc options: -static

Flexible IO Tester

OpenBenchmarking.orgFlexible IO Tester 2.1.13Type: Sequential Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/sSingle DriveFour Drive RAID0Four Drive RAID1Four Drive RAID5Four Drive RAID6Four Drive RAID101632486480SE +/- 7.87, N = 6SE +/- 10.91, N = 6SE +/- 6.01, N = 6SE +/- 12.14, N = 6SE +/- 4.78, N = 6SE +/- 11.17, N = 625.9973.7829.5526.8928.5051.101. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

OpenBenchmarking.orgFlexible IO Tester 2.1.13Type: Sequential Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/sSingle DriveFour Drive RAID0Four Drive RAID1Four Drive RAID5Four Drive RAID6Four Drive RAID1020406080100SE +/- 1.11, N = 6SE +/- 0.13, N = 3SE +/- 1.21, N = 6SE +/- 1.08, N = 6SE +/- 1.26, N = 6SE +/- 8.34, N = 624.46100.7426.6864.6660.2364.121. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

OpenBenchmarking.orgFlexible IO Tester 2.1.13Type: Random Write - IO Engine: POSIX AIO - Buffered: Yes - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/sSingle DriveFour Drive RAID0Four Drive RAID1Four Drive RAID5Four Drive RAID6Four Drive RAID10510152025SE +/- 3.06, N = 6SE +/- 4.09, N = 6SE +/- 1.89, N = 6SE +/- 0.56, N = 6SE +/- 0.39, N = 6SE +/- 3.91, N = 610.4018.5010.815.045.4919.041. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

OpenBenchmarking.orgFlexible IO Tester 2.1.13Type: Random Read - IO Engine: POSIX AIO - Buffered: Yes - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/sSingle DriveFour Drive RAID0Four Drive RAID1Four Drive RAID5Four Drive RAID6Four Drive RAID101.2962.5923.8885.1846.48SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 6SE +/- 0.06, N = 3SE +/- 0.14, N = 6SE +/- 0.06, N = 35.765.375.194.694.925.141. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

SQLite

This is a simple benchmark of SQLite. At present this test profile just measures the time to perform a pre-defined number of insertions on an indexed database. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.8.10.2Test Target: Default Test DirectorySingle DriveFour Drive RAID0Four Drive RAID1Four Drive RAID5Four Drive RAID6Four Drive RAID105001000150020002500SE +/- 11.84, N = 3SE +/- 24.19, N = 6SE +/- 8.10, N = 3SE +/- 133.22, N = 3SE +/- 12.83, N = 5865.61769.471036.022012.672155.89850.141. (CC) gcc options: -O2 -ldl -lpthread

Single Drive

Compiler Notes: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v
Disk Notes: DEADLINE / relatime,rw,space_cache,subvol=/,subvolid=5
Processor Notes: Scaling Governor: intel_pstate powersave
System Notes: Disk Scheduler: DEADLINE.

Testing initiated at 14 August 2015 10:27 by user phoronix.

Four Drive RAID0

Disk Notes: DEADLINE / relatime,rw,space_cache,subvol=/,subvolid=5 / RAID0
Processor Notes: Scaling Governor: intel_pstate powersave

Testing initiated at 14 August 2015 14:33 by user phoronix.

Four Drive RAID1

Disk Notes: DEADLINE / relatime,rw,space_cache,subvol=/,subvolid=5 / RAID1
Processor Notes: Scaling Governor: intel_pstate powersave

Testing initiated at 14 August 2015 18:44 by user phoronix.

Four Drive RAID5

Disk Notes: DEADLINE / relatime,rw,space_cache,subvol=/,subvolid=5
Processor Notes: Scaling Governor: intel_pstate powersave

Testing initiated at 14 August 2015 23:05 by user phoronix.

Four Drive RAID6

Disk Notes: DEADLINE / relatime,rw,space_cache,subvol=/,subvolid=5
Processor Notes: Scaling Governor: intel_pstate powersave

Testing initiated at 15 August 2015 08:27 by user phoronix.

Four Drive RAID10

Processor: Intel Core i7-5960X @ 3.50GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 240GB OCZ VERTEX3, Graphics: NVIDIA GeForce GTX 760 2048MB, Audio: Realtek ALC1150, Monitor: SyncMaster, Network: Intel Connection

OS: Ubuntu 15.04, Kernel: 4.2.0-999-generic (x86_64) 20150811, Desktop: Unity 7.3.2, Display Server: X Server 1.17.1, Display Driver: nouveau 1.0.11, OpenGL: 3.3 Mesa 10.5.2 Gallium 0.4, Compiler: GCC 4.9.2, File-System: btrfs, Screen Resolution: 2560x1600

Compiler Notes: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v
Disk Notes: DEADLINE / relatime,rw,space_cache,subvol=/,subvolid=5 / RAID10
Processor Notes: Scaling Governor: intel_pstate powersave
System Notes: Disk Scheduler: DEADLINE.

Testing initiated at 15 August 2015 11:59 by user phoronix.