Btrfs vs. Linux Soft RAID Linux 4.7

Btrfs RAID tests on Linux 4.7 kernel. Benchmarks by Michael Larabel for a future article on Phoronix.com.

HTML result view exported from: https://openbenchmarking.org/result/1608073-LO-SOFTRAID920&grs&rdt.

ProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionBtrfsMDADM RAID0 2-Disk RAID1 2-Disk RAID0 4-Disk RAID1 4-Disk RAID10 4-Disk RAID0 2-Disk RAID1 2-Disk RAID0 4-Disk RAID1 4-Disk RAID10 4-DiskIntel Xeon E3-1280 v5 @ 4.00GHz (8 Cores)MSI C236A WORKSTATION (MS-7998) v1.0Intel Skylake16384MB4 x 120GB TOSHIBA-TR150 + Samsung SSD 950 PRO 256GBLLVMpipeRealtek ALC1150Intel ConnectionUbuntu 16.104.7.0-040700-generic (x86_64)Unity 7.5.0X Server 1.18.4nouveau 1.0.123.3 Mesa 12.0.1 Gallium 0.4GCC 6.1.1 20160724btrfs1024x768OpenBenchmarking.orgEnvironment Details- LIBGL_ALWAYS_SOFTWARE=1Compiler Details- --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v Disk Details- Btrfs: RAID0 2-Disk: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID0- Btrfs: RAID1 2-Disk: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID1- Btrfs: RAID0 4-Disk: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID0- Btrfs: RAID1 4-Disk: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID1- Btrfs: RAID10 4-Disk: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID10- MDADM: RAID0 2-Disk: CFQ / relatime,rw,space_cache,subvol=/,subvolid=5 / raid0 sdb[1] sda[0]- MDADM: RAID1 2-Disk: CFQ / relatime,rw,space_cache,subvol=/,subvolid=5 / raid1 sdb[1] sda[0]- MDADM: RAID0 4-Disk: CFQ / relatime,rw,space_cache,subvol=/,subvolid=5 / raid0 sdd[3] sdc[2] sdb[1] sda[0]- MDADM: RAID1 4-Disk: CFQ / relatime,rw,space_cache,subvol=/,subvolid=5 / raid1 sdd[3] sdc[2] sdb[1] sda[0]- MDADM: RAID10 4-Disk: CFQ / relatime,rw,space_cache,subvol=/,subvolid=5 / raid10 sdd[3] sdc[2] sdb[1] sda[0]Processor Details- Scaling Governor: intel_pstate performance

blogbench: Writefio: Rand Read - Libaio - No - Yes - 4KB - Default Test Directory - IOPSfio: Rand Read - Libaio - No - Yes - 4KB - Default Test Directory - MB/spgbench: On-Disk - Normal Load - Read Writefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 1000 Files, 1MB Sizefio: Seq Write - Libaio - No - Yes - 4KB - Default Test Directory - MB/sfio: Seq Write - Libaio - No - Yes - 4KB - Default Test Directory - IOPSfio: Seq Read - Libaio - No - Yes - 4KB - Default Test Directory - MB/sfio: Seq Read - Libaio - No - Yes - 4KB - Default Test Directory - IOPSfio: Rand Write - Libaio - No - Yes - 4KB - Default Test Directory - MB/sfio: Rand Write - Libaio - No - Yes - 4KB - Default Test Directory - IOPSBtrfsMDADM RAID0 2-Disk RAID1 2-Disk RAID0 4-Disk RAID1 4-Disk RAID10 4-Disk RAID0 2-Disk RAID1 2-Disk RAID0 4-Disk RAID1 4-Disk RAID10 4-Disk6277108296432.831389.5282.0087.03139.2230492483.27105346152.2032384422754299214.78983.2843.1361.9573.6518971349.748702681.11193527847164240667.681781.17141.73128.63162.0238625738.69181495149.8737291552171902283.991186.6560.8787.97116.0126303464.23114380101.34266455974108058431.171494.3767.6039.5090.7124596655.82162847100.51256985103107830430.031415.4271.7085.55152.1133849545.57136969165.71343282350108723435.5326.2813.1727.449890528.9613514433.6286896300163697668.471496.83113.02126.80174.4744141722.24185565192.13492221929119925665.17310.1412.5310.8527.756510596.0515216632.2374674352831359.131457.9964.1589.6292.741204271.211657837.9812002OpenBenchmarking.org

BlogBench

Test: Write

MinAvgMaxBtrfs422759697847MDADM192940076300OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: WriteRAID0 2-DiskRAID1 2-DiskRAID0 4-DiskRAID1 4-DiskRAID10 4-Disk2K4K6K8K10K

Flexible IO Tester

Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPS

MinAvgMaxBtrfs54299101359164240MDADM8313101698163697OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPSRAID0 2-DiskRAID1 2-DiskRAID0 4-DiskRAID1 4-DiskRAID10 4-Disk50K100K150K200K250K

Flexible IO Tester

Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/s

MinAvgMaxBtrfs215406668MDADM59452668OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/sRAID0 2-DiskRAID1 2-DiskRAID0 4-DiskRAID1 4-DiskRAID10 4-Disk2004006008001000

PostgreSQL pgbench

Scaling: On-Disk - Test: Normal Load - Mode: Read Write

MinAvgMaxBtrfs98313671781MDADM31011701497OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 9.4.3Scaling: On-Disk - Test: Normal Load - Mode: Read WriteRAID0 2-DiskRAID1 2-DiskRAID0 4-DiskRAID1 4-DiskRAID10 4-Disk5001000150020002500

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

MinAvgMaxBtrfs43.179.1141.7MDADM12.557.5113.0OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsRAID0 2-DiskRAID1 2-DiskRAID0 4-DiskRAID1 4-DiskRAID10 4-Disk4080120160200

FS-Mark

Test: 1000 Files, 1MB Size

MinAvgMaxBtrfs39.581.0128.6MDADM10.965.2126.8OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeRAID0 2-DiskRAID1 2-DiskRAID0 4-DiskRAID1 4-DiskRAID10 4-Disk4080120160200

Flexible IO Tester

Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/s

MinAvgMaxBtrfs73.7116.3162.0MDADM27.494.9174.5OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/sRAID0 2-DiskRAID1 2-DiskRAID0 4-DiskRAID1 4-DiskRAID10 4-Disk50100150200250

Flexible IO Tester

Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPS

MinAvgMaxBtrfs189712779738625MDADM65102128644141OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPSRAID0 2-DiskRAID1 2-DiskRAID0 4-DiskRAID1 4-DiskRAID10 4-Disk11K22K33K44K55K

Flexible IO Tester

Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/s

MinAvgMaxBtrfs350538739MDADM71493722OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/sRAID0 2-DiskRAID1 2-DiskRAID0 4-DiskRAID1 4-DiskRAID10 4-Disk2004006008001000

Flexible IO Tester

Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPS

MinAvgMaxBtrfs87026130219181495MDADM16578125284185565OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPSRAID0 2-DiskRAID1 2-DiskRAID0 4-DiskRAID1 4-DiskRAID10 4-Disk50K100K150K200K250K

Flexible IO Tester

Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/s

MinAvgMaxBtrfs81.1117.0152.2MDADM32.292.3192.1OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/sRAID0 2-DiskRAID1 2-DiskRAID0 4-DiskRAID1 4-DiskRAID10 4-Disk50100150200250

Flexible IO Tester

Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPS

MinAvgMaxBtrfs193522827437291MDADM74672234249222OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPSRAID0 2-DiskRAID1 2-DiskRAID0 4-DiskRAID1 4-DiskRAID10 4-Disk13K26K39K52K65K

Phoronix Test Suite v10.8.5