Btrfs vs. Linux Soft RAID Linux 4.7 Btrfs RAID tests on Linux 4.7 kernel. Benchmarks by Michael Larabel for a future article on Phoronix.com. Btrfs: RAID0 2-Disk: Processor: Intel Xeon E3-1280 v5 @ 4.00GHz (8 Cores), Motherboard: MSI C236A WORKSTATION (MS-7998) v1.0, Chipset: Intel Skylake, Memory: 16384MB, Disk: 4 x 120GB TOSHIBA-TR150 + Samsung SSD 950 PRO 256GB, Graphics: LLVMpipe, Audio: Realtek ALC1150, Network: Intel Connection OS: Ubuntu 16.10, Kernel: 4.7.0-040700-generic (x86_64), Desktop: Unity 7.5.0, Display Server: X Server 1.18.4, Display Driver: nouveau 1.0.12, OpenGL: 3.3 Mesa 12.0.1 Gallium 0.4, Compiler: GCC 6.1.1 20160724, File-System: btrfs, Screen Resolution: 1024x768 Btrfs: RAID1 2-Disk: Processor: Intel Xeon E3-1280 v5 @ 4.00GHz (8 Cores), Motherboard: MSI C236A WORKSTATION (MS-7998) v1.0, Chipset: Intel Skylake, Memory: 16384MB, Disk: 4 x 120GB TOSHIBA-TR150 + Samsung SSD 950 PRO 256GB, Graphics: LLVMpipe, Audio: Realtek ALC1150, Network: Intel Connection OS: Ubuntu 16.10, Kernel: 4.7.0-040700-generic (x86_64), Desktop: Unity 7.5.0, Display Server: X Server 1.18.4, Display Driver: nouveau 1.0.12, OpenGL: 3.3 Mesa 12.0.1 Gallium 0.4, Compiler: GCC 6.1.1 20160724, File-System: btrfs, Screen Resolution: 1024x768 Btrfs: RAID0 4-Disk: Processor: Intel Xeon E3-1280 v5 @ 4.00GHz (8 Cores), Motherboard: MSI C236A WORKSTATION (MS-7998) v1.0, Chipset: Intel Skylake, Memory: 16384MB, Disk: 4 x 120GB TOSHIBA-TR150 + Samsung SSD 950 PRO 256GB, Graphics: LLVMpipe, Audio: Realtek ALC1150, Network: Intel Connection OS: Ubuntu 16.10, Kernel: 4.7.0-040700-generic (x86_64), Desktop: Unity 7.5.0, Display Server: X Server 1.18.4, Display Driver: nouveau 1.0.12, OpenGL: 3.3 Mesa 12.0.1 Gallium 0.4, Compiler: GCC 6.1.1 20160724, File-System: btrfs, Screen Resolution: 1024x768 Btrfs: RAID1 4-Disk: Processor: Intel Xeon E3-1280 v5 @ 4.00GHz (8 Cores), Motherboard: MSI C236A WORKSTATION (MS-7998) v1.0, Chipset: Intel Skylake, Memory: 16384MB, Disk: 4 x 120GB TOSHIBA-TR150 + Samsung SSD 950 PRO 256GB, Graphics: LLVMpipe, Audio: Realtek ALC1150, Network: Intel Connection OS: Ubuntu 16.10, Kernel: 4.7.0-040700-generic (x86_64), Desktop: Unity 7.5.0, Display Server: X Server 1.18.4, Display Driver: nouveau 1.0.12, OpenGL: 3.3 Mesa 12.0.1 Gallium 0.4, Compiler: GCC 6.1.1 20160724, File-System: btrfs, Screen Resolution: 1024x768 Btrfs: RAID10 4-Disk: Processor: Intel Xeon E3-1280 v5 @ 4.00GHz (8 Cores), Motherboard: MSI C236A WORKSTATION (MS-7998) v1.0, Chipset: Intel Skylake, Memory: 16384MB, Disk: 4 x 120GB TOSHIBA-TR150 + Samsung SSD 950 PRO 256GB, Graphics: LLVMpipe, Audio: Realtek ALC1150, Network: Intel Connection OS: Ubuntu 16.10, Kernel: 4.7.0-040700-generic (x86_64), Desktop: Unity 7.5.0, Display Server: X Server 1.18.4, Display Driver: nouveau 1.0.12, OpenGL: 3.3 Mesa 12.0.1 Gallium 0.4, Compiler: GCC 6.1.1 20160724, File-System: btrfs, Screen Resolution: 1024x768 MDADM: RAID0 2-Disk: Processor: Intel Xeon E3-1280 v5 @ 4.00GHz (8 Cores), Motherboard: MSI C236A WORKSTATION (MS-7998) v1.0, Chipset: Intel Skylake, Memory: 16384MB, Disk: 4 x 120GB TOSHIBA-TR150 + Samsung SSD 950 PRO 256GB, Graphics: LLVMpipe, Audio: Realtek ALC1150, Network: Intel Connection OS: Ubuntu 16.10, Kernel: 4.7.0-040700-generic (x86_64), Desktop: Unity 7.5.0, Display Server: X Server 1.18.4, Display Driver: nouveau 1.0.12, OpenGL: 3.3 Mesa 12.0.1 Gallium 0.4, Compiler: GCC 6.1.1 20160724, File-System: btrfs, Screen Resolution: 1024x768 MDADM: RAID1 2-Disk: Processor: Intel Xeon E3-1280 v5 @ 4.00GHz (8 Cores), Motherboard: MSI C236A WORKSTATION (MS-7998) v1.0, Chipset: Intel Skylake, Memory: 16384MB, Disk: 4 x 120GB TOSHIBA-TR150 + Samsung SSD 950 PRO 256GB, Graphics: LLVMpipe, Audio: Realtek ALC1150, Network: Intel Connection OS: Ubuntu 16.10, Kernel: 4.7.0-040700-generic (x86_64), Desktop: Unity 7.5.0, Display Server: X Server 1.18.4, Display Driver: nouveau 1.0.12, OpenGL: 3.3 Mesa 12.0.1 Gallium 0.4, Compiler: GCC 6.1.1 20160724, File-System: btrfs, Screen Resolution: 1024x768 MDADM: RAID0 4-Disk: Processor: Intel Xeon E3-1280 v5 @ 4.00GHz (8 Cores), Motherboard: MSI C236A WORKSTATION (MS-7998) v1.0, Chipset: Intel Skylake, Memory: 16384MB, Disk: 4 x 120GB TOSHIBA-TR150 + Samsung SSD 950 PRO 256GB, Graphics: LLVMpipe, Audio: Realtek ALC1150, Network: Intel Connection OS: Ubuntu 16.10, Kernel: 4.7.0-040700-generic (x86_64), Desktop: Unity 7.5.0, Display Server: X Server 1.18.4, Display Driver: nouveau 1.0.12, OpenGL: 3.3 Mesa 12.0.1 Gallium 0.4, Compiler: GCC 6.1.1 20160724, File-System: btrfs, Screen Resolution: 1024x768 MDADM: RAID1 4-Disk: Processor: Intel Xeon E3-1280 v5 @ 4.00GHz (8 Cores), Motherboard: MSI C236A WORKSTATION (MS-7998) v1.0, Chipset: Intel Skylake, Memory: 16384MB, Disk: 4 x 120GB TOSHIBA-TR150 + Samsung SSD 950 PRO 256GB, Graphics: LLVMpipe, Audio: Realtek ALC1150, Network: Intel Connection OS: Ubuntu 16.10, Kernel: 4.7.0-040700-generic (x86_64), Desktop: Unity 7.5.0, Display Server: X Server 1.18.4, Display Driver: nouveau 1.0.12, OpenGL: 3.3 Mesa 12.0.1 Gallium 0.4, Compiler: GCC 6.1.1 20160724, File-System: btrfs, Screen Resolution: 1024x768 MDADM: RAID10 4-Disk: Processor: Intel Xeon E3-1280 v5 @ 4.00GHz (8 Cores), Motherboard: MSI C236A WORKSTATION (MS-7998) v1.0, Chipset: Intel Skylake, Memory: 16384MB, Disk: 4 x 120GB TOSHIBA-TR150 + Samsung SSD 950 PRO 256GB, Graphics: LLVMpipe, Audio: Realtek ALC1150, Network: Intel Connection OS: Ubuntu 16.10, Kernel: 4.7.0-040700-generic (x86_64), Desktop: Unity 7.5.0, Display Server: X Server 1.18.4, Display Driver: nouveau 1.0.12, OpenGL: 3.3 Mesa 12.0.1 Gallium 0.4, Compiler: GCC 6.1.1 20160724, File-System: btrfs, Screen Resolution: 1024x768 FS-Mark 3.3 Test: 1000 Files, 1MB Size Files/s > Higher Is Better Btrfs: RAID0 2-Disk .. 87.03 |================================ Btrfs: RAID1 2-Disk .. 61.95 |======================= Btrfs: RAID0 4-Disk .. 128.63 |================================================ Btrfs: RAID1 4-Disk .. 87.97 |================================= Btrfs: RAID10 4-Disk . 39.50 |=============== MDADM: RAID0 2-Disk .. 85.55 |================================ MDADM: RAID1 2-Disk .. 13.17 |===== MDADM: RAID0 4-Disk .. 126.80 |=============================================== MDADM: RAID1 4-Disk .. 10.85 |==== MDADM: RAID10 4-Disk . 89.62 |================================= FS-Mark 3.3 Test: 5000 Files, 1MB Size, 4 Threads Files/s > Higher Is Better Btrfs: RAID0 2-Disk .. 82.00 |============================ Btrfs: RAID1 2-Disk .. 43.13 |=============== Btrfs: RAID0 4-Disk .. 141.73 |================================================ Btrfs: RAID1 4-Disk .. 60.87 |===================== Btrfs: RAID10 4-Disk . 67.60 |======================= MDADM: RAID0 2-Disk .. 71.70 |======================== MDADM: RAID1 2-Disk .. 26.28 |========= MDADM: RAID0 4-Disk .. 113.02 |====================================== MDADM: RAID1 4-Disk .. 12.53 |==== MDADM: RAID10 4-Disk . 64.15 |====================== BlogBench 1.0 Test: Write Final Score > Higher Is Better Btrfs: RAID0 2-Disk .. 6277 |======================================== Btrfs: RAID1 2-Disk .. 4227 |=========================== Btrfs: RAID0 4-Disk .. 7847 |================================================== Btrfs: RAID1 4-Disk .. 5521 |=================================== Btrfs: RAID10 4-Disk . 5974 |====================================== MDADM: RAID0 2-Disk .. 5103 |================================= MDADM: RAID1 2-Disk .. 2350 |=============== MDADM: RAID0 4-Disk .. 6300 |======================================== MDADM: RAID1 4-Disk .. 1929 |============ MDADM: RAID10 4-Disk . 4352 |============================ Flexible IO Tester 2.1.13 Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPS IOPS > Higher Is Better Btrfs: RAID0 2-Disk .. 108296 |================================ Btrfs: RAID1 2-Disk .. 54299 |================ Btrfs: RAID0 4-Disk .. 164240 |================================================ Btrfs: RAID1 4-Disk .. 71902 |===================== Btrfs: RAID10 4-Disk . 108058 |================================ MDADM: RAID0 2-Disk .. 107830 |================================ MDADM: RAID1 2-Disk .. 108723 |================================ MDADM: RAID0 4-Disk .. 163697 |================================================ MDADM: RAID1 4-Disk .. 119925 |=================================== MDADM: RAID10 4-Disk . 8313 |== Flexible IO Tester 2.1.13 Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPS IOPS > Higher Is Better Btrfs: RAID0 2-Disk .. 32384 |================================ Btrfs: RAID1 2-Disk .. 19352 |=================== Btrfs: RAID0 4-Disk .. 37291 |===================================== Btrfs: RAID1 4-Disk .. 26645 |=========================== Btrfs: RAID10 4-Disk . 25698 |========================== MDADM: RAID0 2-Disk .. 34328 |================================== MDADM: RAID1 2-Disk .. 8689 |========= MDADM: RAID0 4-Disk .. 49222 |================================================= MDADM: RAID1 4-Disk .. 7467 |======= MDADM: RAID10 4-Disk . 12002 |============ Flexible IO Tester 2.1.13 Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPS IOPS > Higher Is Better Btrfs: RAID0 2-Disk .. 105346 |=========================== Btrfs: RAID1 2-Disk .. 87026 |======================= Btrfs: RAID0 4-Disk .. 181495 |=============================================== Btrfs: RAID1 4-Disk .. 114380 |============================== Btrfs: RAID10 4-Disk . 162847 |========================================== MDADM: RAID0 2-Disk .. 136969 |=================================== MDADM: RAID1 2-Disk .. 135144 |=================================== MDADM: RAID0 4-Disk .. 185565 |================================================ MDADM: RAID1 4-Disk .. 152166 |======================================= MDADM: RAID10 4-Disk . 16578 |==== Flexible IO Tester 2.1.13 Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPS IOPS > Higher Is Better Btrfs: RAID0 2-Disk .. 30492 |================================== Btrfs: RAID1 2-Disk .. 18971 |===================== Btrfs: RAID0 4-Disk .. 38625 |=========================================== Btrfs: RAID1 4-Disk .. 26303 |============================= Btrfs: RAID10 4-Disk . 24596 |=========================== MDADM: RAID0 2-Disk .. 33849 |====================================== MDADM: RAID1 2-Disk .. 9890 |=========== MDADM: RAID0 4-Disk .. 44141 |================================================= MDADM: RAID1 4-Disk .. 6510 |======= MDADM: RAID10 4-Disk . 12042 |============= Flexible IO Tester 2.1.13 Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/s MB/s > Higher Is Better Btrfs: RAID0 2-Disk .. 432.83 |=============================== Btrfs: RAID1 2-Disk .. 214.78 |=============== Btrfs: RAID0 4-Disk .. 667.68 |================================================ Btrfs: RAID1 4-Disk .. 283.99 |==================== Btrfs: RAID10 4-Disk . 431.17 |=============================== MDADM: RAID0 2-Disk .. 430.03 |=============================== MDADM: RAID1 2-Disk .. 435.53 |=============================== MDADM: RAID0 4-Disk .. 668.47 |================================================ MDADM: RAID1 4-Disk .. 665.17 |================================================ MDADM: RAID10 4-Disk . 59.13 |==== Flexible IO Tester 2.1.13 Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/s MB/s > Higher Is Better Btrfs: RAID0 2-Disk .. 152.20 |====================================== Btrfs: RAID1 2-Disk .. 81.11 |==================== Btrfs: RAID0 4-Disk .. 149.87 |===================================== Btrfs: RAID1 4-Disk .. 101.34 |========================= Btrfs: RAID10 4-Disk . 100.51 |========================= MDADM: RAID0 2-Disk .. 165.71 |========================================= MDADM: RAID1 2-Disk .. 33.62 |======== MDADM: RAID0 4-Disk .. 192.13 |================================================ MDADM: RAID1 4-Disk .. 32.23 |======== MDADM: RAID10 4-Disk . 37.98 |========= Flexible IO Tester 2.1.13 Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/s MB/s > Higher Is Better Btrfs: RAID0 2-Disk .. 483.27 |=============================== Btrfs: RAID1 2-Disk .. 349.74 |======================= Btrfs: RAID0 4-Disk .. 738.69 |================================================ Btrfs: RAID1 4-Disk .. 464.23 |============================== Btrfs: RAID10 4-Disk . 655.82 |=========================================== MDADM: RAID0 2-Disk .. 545.57 |=================================== MDADM: RAID1 2-Disk .. 528.96 |================================== MDADM: RAID0 4-Disk .. 722.24 |=============================================== MDADM: RAID1 4-Disk .. 596.05 |======================================= MDADM: RAID10 4-Disk . 71.21 |===== Flexible IO Tester 2.1.13 Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/s MB/s > Higher Is Better Btrfs: RAID0 2-Disk .. 139.22 |====================================== Btrfs: RAID1 2-Disk .. 73.65 |==================== Btrfs: RAID0 4-Disk .. 162.02 |============================================= Btrfs: RAID1 4-Disk .. 116.01 |================================ Btrfs: RAID10 4-Disk . 90.71 |========================= MDADM: RAID0 2-Disk .. 152.11 |========================================== MDADM: RAID1 2-Disk .. 27.44 |======== MDADM: RAID0 4-Disk .. 174.47 |================================================ MDADM: RAID1 4-Disk .. 27.75 |======== MDADM: RAID10 4-Disk . 92.74 |========================== PostgreSQL pgbench 9.4.3 Scaling: On-Disk - Test: Normal Load - Mode: Read Write TPS > Higher Is Better Btrfs: RAID0 2-Disk .. 1389.52 |===================================== Btrfs: RAID1 2-Disk .. 983.28 |========================== Btrfs: RAID0 4-Disk .. 1781.17 |=============================================== Btrfs: RAID1 4-Disk .. 1186.65 |=============================== Btrfs: RAID10 4-Disk . 1494.37 |======================================= MDADM: RAID0 2-Disk .. 1415.42 |===================================== MDADM: RAID0 4-Disk .. 1496.83 |======================================= MDADM: RAID1 4-Disk .. 310.14 |======== MDADM: RAID10 4-Disk . 1457.99 |======================================