Btrfs Linux 4.10 RAID Btrfs multi-disk tests on the Linux 4.10 kernel with various RAID options. Tests by Michael Larabel for a future article on Phoronix.com. Single Disk: Processor: Intel Core i7-6800K @ 3.80GHz (12 Cores), Motherboard: MSI X99A WORKSTATION (MS-7A54) v1.0, Chipset: Intel Xeon E7 v4/Xeon, Memory: 16384MB, Disk: 120GB Samsung SSD 850 + 4 x 120GB TOSHIBA-TR150, Graphics: NVIDIA GeForce GTX TITAN X 12288MB, Audio: Realtek ALC1150, Monitor: ASUS PB278, Network: Intel Connection OS: Ubuntu 16.04, Kernel: 4.10.0-999-generic (x86_64) 20170126, Desktop: Unity 7.4.0, Display Server: X Server 1.18.4, Display Driver: nouveau 1.0.12, OpenGL: 3.3 Mesa 11.2.0 Gallium 0.4, Vulkan: 1.0.8, Compiler: GCC 5.4.0 20160609 + CUDA 8.0, File-System: btrfs, Screen Resolution: 2560x1440 2-Disk RAID0: Processor: Intel Core i7-6800K @ 3.80GHz (12 Cores), Motherboard: MSI X99A WORKSTATION (MS-7A54) v1.0, Chipset: Intel Xeon E7 v4/Xeon, Memory: 16384MB, Disk: 120GB Samsung SSD 850 + 4 x 120GB TOSHIBA-TR150, Graphics: NVIDIA GeForce GTX TITAN X 12288MB, Audio: Realtek ALC1150, Monitor: ASUS PB278, Network: Intel Connection OS: Ubuntu 16.04, Kernel: 4.10.0-999-generic (x86_64) 20170126, Desktop: Unity 7.4.0, Display Server: X Server 1.18.4, Display Driver: nouveau 1.0.12, OpenGL: 3.3 Mesa 11.2.0 Gallium 0.4, Vulkan: 1.0.8, Compiler: GCC 5.4.0 20160609 + CUDA 8.0, File-System: btrfs, Screen Resolution: 2560x1440 2-Disk RAID1: Processor: Intel Core i7-6800K @ 3.80GHz (12 Cores), Motherboard: MSI X99A WORKSTATION (MS-7A54) v1.0, Chipset: Intel Xeon E7 v4/Xeon, Memory: 16384MB, Disk: 120GB Samsung SSD 850 + 4 x 120GB TOSHIBA-TR150, Graphics: NVIDIA GeForce GTX TITAN X 12288MB, Audio: Realtek ALC1150, Monitor: ASUS PB278, Network: Intel Connection OS: Ubuntu 16.04, Kernel: 4.10.0-999-generic (x86_64) 20170126, Desktop: Unity 7.4.0, Display Server: X Server 1.18.4, Display Driver: nouveau 1.0.12, OpenGL: 3.3 Mesa 11.2.0 Gallium 0.4, Vulkan: 1.0.8, Compiler: GCC 5.4.0 20160609 + CUDA 8.0, File-System: btrfs, Screen Resolution: 2560x1440 4-Disk RAID0: Processor: Intel Core i7-6800K @ 3.80GHz (12 Cores), Motherboard: MSI X99A WORKSTATION (MS-7A54) v1.0, Chipset: Intel Xeon E7 v4/Xeon, Memory: 16384MB, Disk: 120GB Samsung SSD 850 + 4 x 120GB TOSHIBA-TR150, Graphics: NVIDIA GeForce GTX TITAN X 12288MB, Audio: Realtek ALC1150, Monitor: ASUS PB278, Network: Intel Connection OS: Ubuntu 16.04, Kernel: 4.10.0-999-generic (x86_64) 20170126, Desktop: Unity 7.4.0, Display Server: X Server 1.18.4, Display Driver: nouveau 1.0.12, OpenGL: 3.3 Mesa 11.2.0 Gallium 0.4, Vulkan: 1.0.8, Compiler: GCC 5.4.0 20160609 + CUDA 8.0, File-System: btrfs, Screen Resolution: 2560x1440 4-Disk RAID1: Processor: Intel Core i7-6800K @ 3.80GHz (12 Cores), Motherboard: MSI X99A WORKSTATION (MS-7A54) v1.0, Chipset: Intel Xeon E7 v4/Xeon, Memory: 16384MB, Disk: 120GB Samsung SSD 850 + 4 x 120GB TOSHIBA-TR150, Graphics: NVIDIA GeForce GTX TITAN X 12288MB, Audio: Realtek ALC1150, Monitor: ASUS PB278, Network: Intel Connection OS: Ubuntu 16.04, Kernel: 4.10.0-999-generic (x86_64) 20170126, Desktop: Unity 7.4.0, Display Server: X Server 1.18.4, Display Driver: nouveau 1.0.12, OpenGL: 3.3 Mesa 11.2.0 Gallium 0.4, Vulkan: 1.0.8, Compiler: GCC 5.4.0 20160609 + CUDA 8.0, File-System: btrfs, Screen Resolution: 2560x1440 4-Disk RAID10: Processor: Intel Core i7-6800K @ 3.80GHz (12 Cores), Motherboard: MSI X99A WORKSTATION (MS-7A54) v1.0, Chipset: Intel Xeon E7 v4/Xeon, Memory: 16384MB, Disk: 120GB Samsung SSD 850 + 4 x 120GB TOSHIBA-TR150, Graphics: NVIDIA GeForce GTX TITAN X 12288MB, Audio: Realtek ALC1150, Monitor: ASUS PB278, Network: Intel Connection OS: Ubuntu 16.04, Kernel: 4.10.0-999-generic (x86_64) 20170126, Desktop: Unity 7.4.0, Display Server: X Server 1.18.4, Display Driver: nouveau 1.0.12, OpenGL: 3.3 Mesa 11.2.0 Gallium 0.4, Vulkan: 1.0.8, Compiler: GCC 5.4.0 20160609 + CUDA 8.0, File-System: btrfs, Screen Resolution: 2560x1440 4-Disk RAID5: Processor: Intel Core i7-6800K @ 3.80GHz (12 Cores), Motherboard: MSI X99A WORKSTATION (MS-7A54) v1.0, Chipset: Intel Xeon E7 v4/Xeon, Memory: 16384MB, Disk: 120GB Samsung SSD 850 + 4 x 120GB TOSHIBA-TR150, Graphics: NVIDIA GeForce GTX TITAN X 12288MB, Audio: Realtek ALC1150, Monitor: ASUS PB278, Network: Intel Connection OS: Ubuntu 16.04, Kernel: 4.10.0-999-generic (x86_64) 20170126, Desktop: Unity 7.4.0, Display Server: X Server 1.18.4, Display Driver: nouveau 1.0.12, OpenGL: 3.3 Mesa 11.2.0 Gallium 0.4, Vulkan: 1.0.8, Compiler: GCC 5.4.0 20160609 + CUDA 8.0, File-System: btrfs, Screen Resolution: 2560x1440 4-Disk RAID6: Processor: Intel Core i7-6800K @ 3.80GHz (12 Cores), Motherboard: MSI X99A WORKSTATION (MS-7A54) v1.0, Chipset: Intel Xeon E7 v4/Xeon, Memory: 16384MB, Disk: 120GB Samsung SSD 850 + 4 x 120GB TOSHIBA-TR150, Graphics: NVIDIA GeForce GTX TITAN X 12288MB, Audio: Realtek ALC1150, Monitor: ASUS PB278, Network: Intel Connection OS: Ubuntu 16.04, Kernel: 4.10.0-999-generic (x86_64) 20170126, Desktop: Unity 7.4.0, Display Server: X Server 1.18.4, Display Driver: nouveau 1.0.12, OpenGL: 3.3 Mesa 11.2.0 Gallium 0.4, Vulkan: 1.0.8, Compiler: GCC 5.4.0 20160609 + CUDA 8.0, File-System: btrfs, Screen Resolution: 2560x1440 SQLite 3.8.10.2 Test Target: Default Test Directory Seconds < Lower Is Better Single Disk ... 85.56 |======================================= 2-Disk RAID0 .. 87.56 |======================================= 2-Disk RAID1 .. 105.90 |================================================ 4-Disk RAID0 .. 85.22 |====================================== 4-Disk RAID1 .. 91.33 |========================================= 4-Disk RAID10 . 97.09 |============================================ 4-Disk RAID5 .. 107.49 |================================================ 4-Disk RAID6 .. 122.07 |======================================================= Flexible IO Tester 2.1.13 Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/s MB/s > Higher Is Better Single Disk ... 210.37 |================ 2-Disk RAID0 .. 439.91 |================================== 2-Disk RAID1 .. 213.46 |================ 4-Disk RAID0 .. 720.89 |======================================================= 4-Disk RAID1 .. 413.46 |================================ 4-Disk RAID10 . 424.44 |================================ 4-Disk RAID5 .. 585.34 |============================================= 4-Disk RAID6 .. 422.97 |================================ Flexible IO Tester 2.1.13 Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/s MB/s > Higher Is Better Single Disk ... 91.71 |=============================== 2-Disk RAID0 .. 126.24 |=========================================== 2-Disk RAID1 .. 49.58 |================= 4-Disk RAID0 .. 160.19 |======================================================= 4-Disk RAID1 .. 95.64 |================================= 4-Disk RAID10 . 103.63 |==================================== 4-Disk RAID5 .. 156.98 |====================================================== 4-Disk RAID6 .. 119.44 |========================================= Flexible IO Tester 2.1.13 Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/s MB/s > Higher Is Better Single Disk ... 243.91 |=================== 2-Disk RAID0 .. 525.49 |======================================== 2-Disk RAID1 .. 331.32 |========================= 4-Disk RAID0 .. 719.56 |======================================================= 4-Disk RAID1 .. 267.38 |==================== 4-Disk RAID10 . 558.34 |=========================================== 4-Disk RAID5 .. 678.77 |==================================================== 4-Disk RAID6 .. 591.20 |============================================= Flexible IO Tester 2.1.13 Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/s MB/s > Higher Is Better Single Disk ... 90.36 |============================== 2-Disk RAID0 .. 125.88 |========================================= 2-Disk RAID1 .. 49.50 |================ 4-Disk RAID0 .. 166.98 |======================================================= 4-Disk RAID1 .. 105.29 |=================================== 4-Disk RAID10 . 116.27 |====================================== 4-Disk RAID5 .. 113.33 |===================================== 4-Disk RAID6 .. 101.58 |================================= FS-Mark 3.3 Test: 1000 Files, 1MB Size Files/s > Higher Is Better Single Disk ... 61.03 |============================ 2-Disk RAID0 .. 78.17 |=================================== 2-Disk RAID1 .. 59.35 |=========================== 4-Disk RAID0 .. 121.72 |======================================================= 4-Disk RAID1 .. 78.57 |==================================== 4-Disk RAID10 . 63.17 |============================= 4-Disk RAID5 .. 82.83 |===================================== 4-Disk RAID6 .. 83.70 |====================================== FS-Mark 3.3 Test: 5000 Files, 1MB Size, 4 Threads Files/s > Higher Is Better Single Disk ... 50.73 |===================== 2-Disk RAID0 .. 80.60 |================================== 2-Disk RAID1 .. 42.95 |================== 4-Disk RAID0 .. 132.25 |======================================================= 4-Disk RAID1 .. 61.37 |========================== 4-Disk RAID10 . 65.67 |=========================== 4-Disk RAID5 .. 100.83 |========================================== 4-Disk RAID6 .. 66.60 |============================ FS-Mark 3.3 Test: 4000 Files, 32 Sub Dirs, 1MB Size Files/s > Higher Is Better Single Disk ... 46.63 |=================== 2-Disk RAID0 .. 74.55 |============================== 2-Disk RAID1 .. 42.05 |================= 4-Disk RAID0 .. 135.77 |======================================================= 4-Disk RAID1 .. 61.42 |========================= 4-Disk RAID10 . 65.63 |=========================== 4-Disk RAID5 .. 84.28 |================================== 4-Disk RAID6 .. 57.65 |======================= BlogBench 1.0 Test: Write Final Score > Higher Is Better Single Disk ... 4942 |===================================== 2-Disk RAID0 .. 6617 |================================================== 2-Disk RAID1 .. 4939 |===================================== 4-Disk RAID0 .. 7537 |========================================================= 4-Disk RAID1 .. 5542 |========================================== 4-Disk RAID10 . 6420 |================================================= 4-Disk RAID5 .. 7079 |====================================================== 4-Disk RAID6 .. 5808 |============================================ Compile Bench 0.6 Test: Compile MB/s > Higher Is Better Single Disk ... 816.97 |=============================== 2-Disk RAID0 .. 986.31 |====================================== 2-Disk RAID1 .. 784.53 |============================== 4-Disk RAID0 .. 1413.04 |====================================================== 4-Disk RAID1 .. 915.54 |=================================== 4-Disk RAID10 . 903.57 |=================================== 4-Disk RAID5 .. 1001.93 |====================================== 4-Disk RAID6 .. 878.04 |================================== Compile Bench 0.6 Test: Initial Create MB/s > Higher Is Better Single Disk ... 126.47 |======================= 2-Disk RAID0 .. 271.68 |================================================== 2-Disk RAID1 .. 118.82 |====================== 4-Disk RAID0 .. 296.61 |======================================================= 4-Disk RAID1 .. 226.87 |========================================== 4-Disk RAID10 . 246.89 |============================================== 4-Disk RAID5 .. 263.94 |================================================= 4-Disk RAID6 .. 237.06 |============================================ PostMark 1.51 Disk Transaction Performance TPS > Higher Is Better Single Disk ... 6359 |========================================================= 2-Disk RAID0 .. 6410 |========================================================= 2-Disk RAID1 .. 6303 |======================================================== 4-Disk RAID0 .. 6357 |========================================================= 4-Disk RAID1 .. 6359 |========================================================= 4-Disk RAID10 . 6374 |========================================================= 4-Disk RAID5 .. 6410 |========================================================= 4-Disk RAID6 .. 6413 |========================================================= PostgreSQL pgbench 9.4.3 Scaling: On-Disk - Test: Normal Load - Mode: Read Write TPS > Higher Is Better Single Disk ... 1196.72 |====================== 2-Disk RAID0 .. 1626.47 |============================== 2-Disk RAID1 .. 1147.83 |===================== 4-Disk RAID0 .. 2887.00 |====================================================== 4-Disk RAID1 .. 972.52 |================== 4-Disk RAID10 . 1427.30 |=========================== 4-Disk RAID5 .. 2012.79 |====================================== 4-Disk RAID6 .. 1303.60 |======================== Memcached 1.3.34 mcperf 0.1.1 Method: Get Operations Per Second > Higher Is Better Single Disk ... 123117.20 |================================================= 2-Disk RAID0 .. 128206.73 |=================================================== 2-Disk RAID1 .. 127284.55 |================================================== 4-Disk RAID0 .. 126550.63 |================================================== 4-Disk RAID1 .. 131257.13 |==================================================== 4-Disk RAID10 . 126501.20 |================================================== 4-Disk RAID5 .. 126768.90 |================================================== 4-Disk RAID6 .. 130668.83 |==================================================== Memcached 1.3.34 mcperf 0.1.1 Method: Set Operations Per Second > Higher Is Better Single Disk ... 72553.77 |================================================= 2-Disk RAID0 .. 71691.73 |================================================= 2-Disk RAID1 .. 75791.37 |==================================================== 4-Disk RAID0 .. 75311.00 |=================================================== 4-Disk RAID1 .. 72707.60 |================================================== 4-Disk RAID10 . 74309.63 |=================================================== 4-Disk RAID5 .. 74259.57 |=================================================== 4-Disk RAID6 .. 77837.00 |=====================================================