Btrfs vs. Linux Soft RAID Linux 4.7

Btrfs RAID tests on Linux 4.7 kernel. Benchmarks by Michael Larabel for a future article on Phoronix.com.

HTML result view exported from: https://openbenchmarking.org/result/1608073-LO-SOFTRAID920&grw.

ProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionBtrfsMDADM RAID0 2-Disk RAID1 2-Disk RAID0 4-Disk RAID1 4-Disk RAID10 4-Disk RAID0 2-Disk RAID1 2-Disk RAID0 4-Disk RAID1 4-Disk RAID10 4-DiskIntel Xeon E3-1280 v5 @ 4.00GHz (8 Cores)MSI C236A WORKSTATION (MS-7998) v1.0Intel Skylake16384MB4 x 120GB TOSHIBA-TR150 + Samsung SSD 950 PRO 256GBLLVMpipeRealtek ALC1150Intel ConnectionUbuntu 16.104.7.0-040700-generic (x86_64)Unity 7.5.0X Server 1.18.4nouveau 1.0.123.3 Mesa 12.0.1 Gallium 0.4GCC 6.1.1 20160724btrfs1024x768OpenBenchmarking.orgEnvironment Details- LIBGL_ALWAYS_SOFTWARE=1Compiler Details- --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v Disk Details- Btrfs: RAID0 2-Disk: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID0- Btrfs: RAID1 2-Disk: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID1- Btrfs: RAID0 4-Disk: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID0- Btrfs: RAID1 4-Disk: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID1- Btrfs: RAID10 4-Disk: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID10- MDADM: RAID0 2-Disk: CFQ / relatime,rw,space_cache,subvol=/,subvolid=5 / raid0 sdb[1] sda[0]- MDADM: RAID1 2-Disk: CFQ / relatime,rw,space_cache,subvol=/,subvolid=5 / raid1 sdb[1] sda[0]- MDADM: RAID0 4-Disk: CFQ / relatime,rw,space_cache,subvol=/,subvolid=5 / raid0 sdd[3] sdc[2] sdb[1] sda[0]- MDADM: RAID1 4-Disk: CFQ / relatime,rw,space_cache,subvol=/,subvolid=5 / raid1 sdd[3] sdc[2] sdb[1] sda[0]- MDADM: RAID10 4-Disk: CFQ / relatime,rw,space_cache,subvol=/,subvolid=5 / raid10 sdd[3] sdc[2] sdb[1] sda[0]Processor Details- Scaling Governor: intel_pstate performance

fio: Rand Read - Libaio - No - Yes - 4KB - Default Test Directory - IOPSfio: Rand Read - Libaio - No - Yes - 4KB - Default Test Directory - MB/sfio: Rand Write - Libaio - No - Yes - 4KB - Default Test Directory - IOPSfio: Rand Write - Libaio - No - Yes - 4KB - Default Test Directory - MB/sfio: Seq Read - Libaio - No - Yes - 4KB - Default Test Directory - IOPSfio: Seq Read - Libaio - No - Yes - 4KB - Default Test Directory - MB/sfio: Seq Write - Libaio - No - Yes - 4KB - Default Test Directory - IOPSfio: Seq Write - Libaio - No - Yes - 4KB - Default Test Directory - MB/sfs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsblogbench: Writepgbench: On-Disk - Normal Load - Read WriteBtrfsMDADM RAID0 2-Disk RAID1 2-Disk RAID0 4-Disk RAID1 4-Disk RAID10 4-Disk RAID0 2-Disk RAID1 2-Disk RAID0 4-Disk RAID1 4-Disk RAID10 4-Disk108296432.8332384152.20105346483.2730492139.2287.0382.0062771389.5254299214.781935281.1187026349.741897173.6561.9543.134227983.28164240667.6837291149.87181495738.6938625162.02128.63141.7378471781.1771902283.9926645101.34114380464.2326303116.0187.9760.8755211186.65108058431.1725698100.51162847655.822459690.7139.5067.6059741494.37107830430.0334328165.71136969545.5733849152.1185.5571.7051031415.42108723435.53868933.62135144528.96989027.4413.1726.282350163697668.4749222192.13185565722.2444141174.47126.80113.0263001496.83119925665.17746732.23152166596.05651027.7510.8512.531929310.14831359.131200237.981657871.211204292.7489.6264.1543521457.99OpenBenchmarking.org

Flexible IO Tester

Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPS

MinAvgMaxBtrfs54299101359164240MDADM8313101698163697OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPSRAID0 2-DiskRAID1 2-DiskRAID0 4-DiskRAID1 4-DiskRAID10 4-Disk50K100K150K200K250K

Flexible IO Tester

Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/s

MinAvgMaxBtrfs215406668MDADM59452668OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/sRAID0 2-DiskRAID1 2-DiskRAID0 4-DiskRAID1 4-DiskRAID10 4-Disk2004006008001000

Flexible IO Tester

Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPS

MinAvgMaxBtrfs193522827437291MDADM74672234249222OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPSRAID0 2-DiskRAID1 2-DiskRAID0 4-DiskRAID1 4-DiskRAID10 4-Disk13K26K39K52K65K

Flexible IO Tester

Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/s

MinAvgMaxBtrfs81.1117.0152.2MDADM32.292.3192.1OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/sRAID0 2-DiskRAID1 2-DiskRAID0 4-DiskRAID1 4-DiskRAID10 4-Disk50100150200250

Flexible IO Tester

Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPS

MinAvgMaxBtrfs87026130219181495MDADM16578125284185565OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPSRAID0 2-DiskRAID1 2-DiskRAID0 4-DiskRAID1 4-DiskRAID10 4-Disk50K100K150K200K250K

Flexible IO Tester

Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/s

MinAvgMaxBtrfs350538739MDADM71493722OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/sRAID0 2-DiskRAID1 2-DiskRAID0 4-DiskRAID1 4-DiskRAID10 4-Disk2004006008001000

Flexible IO Tester

Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPS

MinAvgMaxBtrfs189712779738625MDADM65102128644141OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPSRAID0 2-DiskRAID1 2-DiskRAID0 4-DiskRAID1 4-DiskRAID10 4-Disk11K22K33K44K55K

Flexible IO Tester

Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/s

MinAvgMaxBtrfs73.7116.3162.0MDADM27.494.9174.5OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/sRAID0 2-DiskRAID1 2-DiskRAID0 4-DiskRAID1 4-DiskRAID10 4-Disk50100150200250

FS-Mark

Test: 1000 Files, 1MB Size

MinAvgMaxBtrfs39.581.0128.6MDADM10.965.2126.8OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeRAID0 2-DiskRAID1 2-DiskRAID0 4-DiskRAID1 4-DiskRAID10 4-Disk4080120160200

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

MinAvgMaxBtrfs43.179.1141.7MDADM12.557.5113.0OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsRAID0 2-DiskRAID1 2-DiskRAID0 4-DiskRAID1 4-DiskRAID10 4-Disk4080120160200

BlogBench

Test: Write

MinAvgMaxBtrfs422759697847MDADM192940076300OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: WriteRAID0 2-DiskRAID1 2-DiskRAID0 4-DiskRAID1 4-DiskRAID10 4-Disk2K4K6K8K10K

PostgreSQL pgbench

Scaling: On-Disk - Test: Normal Load - Mode: Read Write

MinAvgMaxBtrfs98313671781MDADM31011701497OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 9.4.3Scaling: On-Disk - Test: Normal Load - Mode: Read WriteRAID0 2-DiskRAID1 2-DiskRAID0 4-DiskRAID1 4-DiskRAID10 4-Disk5001000150020002500

Phoronix Test Suite v10.8.4