Btrfs RAID 0/1/5/6/10 Disk Testing

Btrfs RAID benchmarks with four Intel SSDs using RAID 0, 1, 5, 6, and 10 levels on Linux 3.18 kernel. Benchmarks by Michael Larabel for a future article on Phoronix.com.

HTML result view exported from: https://openbenchmarking.org/result/1410291-LI-BTRFSRAID01&grr&rdt.

Btrfs RAID 0/1/5/6/10 Disk TestingProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionSingle Disk4 Disks, Non-RAIDRAID 0RAID 1RAID 1+0RAID 5RAID 6Intel Core i7-5960X @ 4.00GHz (16 Cores)Gigabyte X99-UD4-CFIntel Xeon E5 v3/Core16384MB4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MBIntel C610/X99SyncMasterIntel ConnectionUbuntu 14.103.18.0-031800rc1-generic (x86_64)Unity 7.3.1X Server 1.16.0radeon 7.4.03.3 Mesa 10.3.0 Gallium 0.4GCC 4.9.1btrfs2560x1600OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v Disk Details- DEADLINE / relatime,rw,space_cache,ssdProcessor Details- Scaling Governor: intel_pstate powersaveSystem Details- Disk Scheduler: DEADLINE. Python 2.7.8.

Btrfs RAID 0/1/5/6/10 Disk Testingcompilebench: Initial Createiozone: 4Kb - 8GB - Write Performancefs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 1000 Files, 1MB Sizefio: Seq Write - Libaio - No - 16KB - Default Test Directory - MB/sfio: Seq Read - Libaio - No - 16KB - Default Test Directory - MB/sfio: Rand Write - Libaio - No - 16KB - Default Test Directory - MB/sfio: Rand Read - Libaio - No - 16KB - Default Test Directory - MB/sSingle Disk4 Disks, Non-RAIDRAID 0RAID 1RAID 1+0RAID 5RAID 6162.15481.7740.8079.9340.53169.40239.98170.35236.89176.581133.9141.0384.4041.20344.88796.84436.31787.97206.741142.4340.7383.7341.43319.41824.97497.23758.26187.72584.8535.6369.0335.10130.32323.80128.00233.00177.54599.3238.5077.0738.33272.19450.78267.48469.10189.59876.7739.1779.8738.87242.55869.68248.93742.06195.02598.4337.7375.4738.20208.96960.89214.56653.54OpenBenchmarking.org

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateSingle Disk4 Disks, Non-RAIDRAID 0RAID 1RAID 1+0RAID 5RAID 650100150200250SE +/- 3.45, N = 3SE +/- 0.57, N = 3SE +/- 3.10, N = 3SE +/- 9.02, N = 3SE +/- 0.81, N = 3SE +/- 9.32, N = 3SE +/- 2.89, N = 3162.15176.58206.74187.72177.54189.59195.02

IOzone

Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.405Record Size: 4Kb - File Size: 8GB - Disk Test: Write PerformanceSingle Disk4 Disks, Non-RAIDRAID 0RAID 1RAID 1+0RAID 5RAID 62004006008001000SE +/- 0.08, N = 3SE +/- 0.84, N = 3SE +/- 1.16, N = 3SE +/- 3.64, N = 3SE +/- 0.36, N = 3SE +/- 0.45, N = 3SE +/- 0.24, N = 3481.771133.911142.43584.85599.32876.77598.431. (CC) gcc options: -O3

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeSingle Disk4 Disks, Non-RAIDRAID 0RAID 1RAID 1+0RAID 5RAID 6918273645SE +/- 0.06, N = 3SE +/- 0.12, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.25, N = 3SE +/- 0.28, N = 3SE +/- 0.07, N = 340.8041.0340.7335.6338.5039.1737.731. (CC) gcc options: -static

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsSingle Disk4 Disks, Non-RAIDRAID 0RAID 1RAID 1+0RAID 5RAID 620406080100SE +/- 0.07, N = 3SE +/- 0.23, N = 3SE +/- 0.35, N = 3SE +/- 0.12, N = 3SE +/- 0.13, N = 3SE +/- 0.13, N = 3SE +/- 0.27, N = 379.9384.4083.7369.0377.0779.8775.471. (CC) gcc options: -static

FS-Mark

Test: 1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeSingle Disk4 Disks, Non-RAIDRAID 0RAID 1RAID 1+0RAID 5RAID 6918273645SE +/- 0.07, N = 3SE +/- 0.21, N = 3SE +/- 0.28, N = 3SE +/- 0.06, N = 3SE +/- 0.32, N = 3SE +/- 0.17, N = 3SE +/- 0.06, N = 340.5341.2041.4335.1038.3338.8738.201. (CC) gcc options: -static

Flexible IO Tester

Type: Sequential Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.11Type: Sequential Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/sSingle Disk4 Disks, Non-RAIDRAID 0RAID 1RAID 1+0RAID 5RAID 670140210280350SE +/- 0.04, N = 3SE +/- 5.97, N = 6SE +/- 3.82, N = 3SE +/- 2.46, N = 6SE +/- 0.90, N = 3SE +/- 0.41, N = 3SE +/- 1.21, N = 3169.40344.88319.41130.32272.19242.55208.961. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.11Type: Sequential Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/sSingle Disk4 Disks, Non-RAIDRAID 0RAID 1RAID 1+0RAID 5RAID 62004006008001000SE +/- 3.46, N = 3SE +/- 16.37, N = 6SE +/- 22.85, N = 6SE +/- 0.96, N = 3SE +/- 1.47, N = 3SE +/- 40.14, N = 6SE +/- 8.58, N = 3239.98796.84824.97323.80450.78869.68960.891. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.11Type: Random Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/sSingle Disk4 Disks, Non-RAIDRAID 0RAID 1RAID 1+0RAID 5RAID 6110220330440550SE +/- 0.33, N = 3SE +/- 16.68, N = 6SE +/- 13.92, N = 6SE +/- 0.39, N = 3SE +/- 2.33, N = 3SE +/- 3.37, N = 6SE +/- 2.95, N = 6170.35436.31497.23128.00267.48248.93214.561. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.11Type: Random Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/sSingle Disk4 Disks, Non-RAIDRAID 0RAID 1RAID 1+0RAID 5RAID 62004006008001000SE +/- 2.80, N = 3SE +/- 40.14, N = 6SE +/- 23.17, N = 6SE +/- 0.84, N = 3SE +/- 10.47, N = 6SE +/- 52.17, N = 6SE +/- 67.86, N = 6236.89787.97758.26233.00469.10742.06653.541. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Phoronix Test Suite v10.8.5