Native Btrfs vs. mdadm RAID

Btrfs RAID benchmarks with four Intel SSDs using RAID 0, 1, 5, 6, and 10 levels on Linux 3.18 kernel. Benchmarks by Michael Larabel for a future article on Phoronix.com.

HTML result view exported from: https://openbenchmarking.org/result/1410302-LI-BTRFSRAID97&grs&sro.

ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionNative Btrfs RAIDmdadm Btrfs RAID 0 RAID 1 RAID 10 RAID 5 RAID 6 RAID 0 RAID 1 RAID 10 RAID 5 RAID 6Intel Core i7-5960X @ 4.00GHz (16 Cores)Gigabyte X99-UD4-CFIntel Xeon E5 v3/Core16384MB4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MBIntel C610/X99SyncMasterIntel ConnectionUbuntu 14.103.18.0-031800rc1-generic (x86_64)Unity 7.3.1X Server 1.16.0radeon 7.4.03.3 Mesa 10.3.0 Gallium 0.4GCC 4.9.1btrfs2560x1600OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v Disk Details- Native Btrfs RAID: RAID 0: DEADLINE / relatime,rw,space_cache,ssd- Native Btrfs RAID: RAID 1: DEADLINE / relatime,rw,space_cache,ssd- Native Btrfs RAID: RAID 10: DEADLINE / relatime,rw,space_cache,ssd- Native Btrfs RAID: RAID 5: DEADLINE / relatime,rw,space_cache,ssd- Native Btrfs RAID: RAID 6: DEADLINE / relatime,rw,space_cache,ssd- mdadm Btrfs: RAID 0: DEADLINE / relatime,rw,space_cache- mdadm Btrfs: RAID 1: DEADLINE / relatime,rw,space_cache- mdadm Btrfs: RAID 10: DEADLINE / relatime,rw,space_cache- mdadm Btrfs: RAID 5: DEADLINE / relatime,rw,space_cache- mdadm Btrfs: RAID 6: DEADLINE / relatime,rw,space_cacheProcessor Details- Scaling Governor: intel_pstate powersaveSystem Details- Disk Scheduler: DEADLINE. Python 2.7.8.

fio: Rand Write - Libaio - No - 16KB - Default Test Directory - MB/siozone: 4Kb - 8GB - Write Performancefio: Seq Write - Libaio - No - 16KB - Default Test Directory - MB/sfio: Seq Read - Libaio - No - 16KB - Default Test Directory - MB/sfs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 1000 Files, 1MB Sizefs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizecompilebench: Initial Createfio: Rand Read - Libaio - No - 16KB - Default Test Directory - MB/sNative Btrfs RAIDmdadm Btrfs RAID 0 RAID 1 RAID 10 RAID 5 RAID 6 RAID 0 RAID 1 RAID 10 RAID 5 RAID 6497.231142.43319.41824.9783.7341.4340.73206.74758.26128.00584.85130.32323.8069.0335.1035.63187.72233.00267.48599.32272.19450.7877.0738.3338.50177.54469.10248.93876.77242.55869.6879.8738.8739.17189.59742.06214.56598.43208.96960.8975.4738.2037.73195.02653.54381.451141.18385.3492.0039.6039.43178.31816.02109.22280.39109.97854.9864.0034.0333.43160.58224.69159.53478.65161.90843.6875.6037.8036.93156.97695.44214.31438.55209.60879.0964.7333.3732.10156.21792.61179.73315.85172.72925.0556.8030.4330.63151.64909.98OpenBenchmarking.org

Flexible IO Tester

Type: Random Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s

MinAvgMaxNative Btrfs RAID128.0271.2497.2mdadm Btrfs109.2208.8381.5OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.11Type: Random Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/sRAID 0RAID 1RAID 10RAID 5RAID 6130260390520650

IOzone

Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance

MinAvgMaxNative Btrfs RAID5857601142mdadm Btrfs2805311141OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.405Record Size: 4Kb - File Size: 8GB - Disk Test: Write PerformanceRAID 0RAID 1RAID 10RAID 5RAID 62004006008001000

Flexible IO Tester

Type: Sequential Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s

MinAvgMaxNative Btrfs RAID130.3234.7319.4mdadm Btrfs110.0207.9385.3OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.11Type: Sequential Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/sRAID 0RAID 1RAID 10RAID 5RAID 6100200300400500

Flexible IO Tester

Type: Sequential Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s

MinAvgMaxNative Btrfs RAID324686961mdadm Btrfs844876925OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.11Type: Sequential Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/sRAID 0RAID 1RAID 10RAID 5RAID 62004006008001000

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

MinAvgMaxNative Btrfs RAID69.077.083.7mdadm Btrfs56.870.692.0OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsRAID 0RAID 1RAID 10RAID 5RAID 620406080100

FS-Mark

Test: 1000 Files, 1MB Size

MinAvgMaxNative Btrfs RAID35.138.441.4mdadm Btrfs30.435.039.6OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeRAID 0RAID 1RAID 10RAID 5RAID 61122334455

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

MinAvgMaxNative Btrfs RAID35.638.440.7mdadm Btrfs30.634.539.4OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeRAID 0RAID 1RAID 10RAID 5RAID 61122334455

Compile Bench

Test: Initial Create

MinAvgMaxNative Btrfs RAID177.5191.3206.7mdadm Btrfs151.6160.7178.3OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateRAID 0RAID 1RAID 10RAID 5RAID 660120180240300

Flexible IO Tester

Type: Random Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s

MinAvgMaxNative Btrfs RAID233571758mdadm Btrfs225688910OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.11Type: Random Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/sRAID 0RAID 1RAID 10RAID 5RAID 62004006008001000

Phoronix Test Suite v10.8.4