Ubuntu Linux RAID 0/1/5/6/10 Disk Testing RAID mdadm benchmarks with four Intel SSDs using RAID 0, 1, 5, 6, and 10 levels on Linux 3.18 kernel with various file-systems. Benchmarks by Michael Larabel for a future article on Phoronix.com. Native Btrfs: RAID 0: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: btrfs, Screen Resolution: 2560x1600 Native Btrfs: RAID 1: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: btrfs, Screen Resolution: 2560x1600 Native Btrfs: RAID 10: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: btrfs, Screen Resolution: 2560x1600 Native Btrfs: RAID 5: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: btrfs, Screen Resolution: 2560x1600 Native Btrfs: RAID 6: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: btrfs, Screen Resolution: 2560x1600 mdadm Btrfs: RAID 0: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: btrfs, Screen Resolution: 2560x1600 mdadm Btrfs: RAID 1: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: btrfs, Screen Resolution: 2560x1600 mdadm Btrfs: RAID 10: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: btrfs, Screen Resolution: 2560x1600 mdadm Btrfs: RAID 5: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: btrfs, Screen Resolution: 2560x1600 mdadm Btrfs: RAID 6: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: btrfs, Screen Resolution: 2560x1600 mdadm EXT4: RAID 0: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: ext4, Screen Resolution: 2560x1600 mdadm EXT4: RAID 1: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: ext4, Screen Resolution: 2560x1600 mdadm EXT4: RAID 10: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: ext4, Screen Resolution: 2560x1600 mdadm EXT4: RAID 5: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: ext4, Screen Resolution: 2560x1600 mdadm EXT4: RAID 6: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: ext4, Screen Resolution: 2560x1600 mdadm XFS: RAID 0: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: xfs, Screen Resolution: 2560x1600 mdadm XFS: RAID 1: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: xfs, Screen Resolution: 2560x1600 mdadm XFS: RAID 10: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: xfs, Screen Resolution: 2560x1600 mdadm XFS: RAID 5: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: xfs, Screen Resolution: 2560x1600 mdadm XFS: RAID 6: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: xfs, Screen Resolution: 2560x1600 mdadm F2FS: RAID 0: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: f2fs, Screen Resolution: 2560x1600 mdadm F2FS: RAID 1: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: f2fs, Screen Resolution: 2560x1600 mdadm F2FS: RAID 10: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: f2fs, Screen Resolution: 2560x1600 mdadm F2FS: RAID 5: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: f2fs, Screen Resolution: 2560x1600 mdadm F2FS: RAID 6: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: f2fs, Screen Resolution: 2560x1600 Glusterfs-1G on XFS SSD via NFS-1G: Processor: AMD Phenom II X4 910e @ 2.60GHz (2 Cores), Memory: 1024MB, Disk: 31GB OS: Debian GNU/Linux 8, Kernel: 3.16.0-4-amd64 (x86_64), Compiler: GCC 4.9.2, File-System: ext4, System Layer: Xen 4.4.1-xs100654 Hypervisor Glusterfs-1G on XFS SSD via NFG-1G noop: Processor: AMD Phenom II X4 910e @ 2.60GHz (2 Cores), Memory: 1024MB, Disk: 31GB OS: Debian GNU/Linux 8, Kernel: 3.16.0-4-amd64 (x86_64), Compiler: GCC 4.9.2, File-System: ext4, System Layer: Xen 4.4.1-xs100654 Hypervisor Flexible IO Tester 2.1.11 Type: Random Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s MB/s > Higher Is Better Native Btrfs: RAID 0 .................... 758.26 |======================== Native Btrfs: RAID 1 .................... 233.00 |======= Native Btrfs: RAID 10 ................... 469.10 |=============== Native Btrfs: RAID 5 .................... 742.06 |======================= Native Btrfs: RAID 6 .................... 653.54 |==================== mdadm Btrfs: RAID 0 ..................... 816.02 |========================= mdadm Btrfs: RAID 1 ..................... 224.69 |======= mdadm Btrfs: RAID 10 .................... 695.44 |====================== mdadm Btrfs: RAID 5 ..................... 792.61 |========================= mdadm Btrfs: RAID 6 ..................... 909.98 |============================ mdadm EXT4: RAID 0 ...................... 818.33 |========================== mdadm EXT4: RAID 1 ...................... 214.45 |======= mdadm EXT4: RAID 10 ..................... 684.95 |===================== mdadm EXT4: RAID 5 ...................... 689.39 |====================== mdadm EXT4: RAID 6 ...................... 854.92 |=========================== mdadm XFS: RAID 0 ....................... 841.97 |========================== mdadm XFS: RAID 1 ....................... 236.43 |======= mdadm XFS: RAID 10 ...................... 384.53 |============ mdadm XFS: RAID 5 ....................... 751.77 |======================= mdadm XFS: RAID 6 ....................... 928.27 |============================= mdadm F2FS: RAID 0 ...................... 872.84 |=========================== mdadm F2FS: RAID 1 ...................... 239.73 |======= mdadm F2FS: RAID 10 ..................... 741.30 |======================= mdadm F2FS: RAID 5 ...................... 736.18 |======================= mdadm F2FS: RAID 6 ...................... 916.30 |============================= Glusterfs-1G on XFS SSD via NFS-1G ...... 71.74 |== Glusterfs-1G on XFS SSD via NFG-1G noop . 70.21 |== Flexible IO Tester 2.1.11 Type: Random Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s MB/s > Higher Is Better Native Btrfs: RAID 0 .................... 497.23 |============================= Native Btrfs: RAID 1 .................... 128.00 |======= Native Btrfs: RAID 10 ................... 267.48 |================ Native Btrfs: RAID 5 .................... 248.93 |=============== Native Btrfs: RAID 6 .................... 214.56 |============= mdadm Btrfs: RAID 0 ..................... 381.45 |====================== mdadm Btrfs: RAID 1 ..................... 109.22 |====== mdadm Btrfs: RAID 10 .................... 159.53 |========= mdadm Btrfs: RAID 5 ..................... 214.31 |============ mdadm Btrfs: RAID 6 ..................... 179.73 |========== mdadm EXT4: RAID 0 ...................... 421.37 |========================= mdadm EXT4: RAID 1 ...................... 110.32 |====== mdadm EXT4: RAID 10 ..................... 163.86 |========== mdadm EXT4: RAID 5 ...................... 146.07 |========= mdadm EXT4: RAID 6 ...................... 134.18 |======== mdadm XFS: RAID 0 ....................... 393.49 |======================= mdadm XFS: RAID 1 ....................... 115.51 |======= mdadm XFS: RAID 10 ...................... 166.75 |========== mdadm XFS: RAID 5 ....................... 151.05 |========= mdadm XFS: RAID 6 ....................... 129.62 |======== mdadm F2FS: RAID 0 ...................... 387.04 |======================= mdadm F2FS: RAID 1 ...................... 109.58 |====== mdadm F2FS: RAID 10 ..................... 177.32 |========== mdadm F2FS: RAID 5 ...................... 149.41 |========= mdadm F2FS: RAID 6 ...................... 131.26 |======== Glusterfs-1G on XFS SSD via NFS-1G ...... 13.50 |= Glusterfs-1G on XFS SSD via NFG-1G noop . 13.26 |= Flexible IO Tester 2.1.11 Type: Sequential Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s MB/s > Higher Is Better Native Btrfs: RAID 0 .................... 824.97 |======================== Native Btrfs: RAID 1 .................... 323.80 |========= Native Btrfs: RAID 10 ................... 450.78 |============= Native Btrfs: RAID 5 .................... 869.68 |========================= Native Btrfs: RAID 6 .................... 960.89 |============================ mdadm Btrfs: RAID 1 ..................... 854.98 |========================= mdadm Btrfs: RAID 10 .................... 843.68 |========================= mdadm Btrfs: RAID 5 ..................... 879.09 |========================== mdadm Btrfs: RAID 6 ..................... 925.05 |=========================== mdadm EXT4: RAID 1 ...................... 303.30 |========= mdadm EXT4: RAID 5 ...................... 957.59 |============================ mdadm XFS: RAID 1 ....................... 301.16 |========= mdadm F2FS: RAID 1 ...................... 299.58 |========= mdadm F2FS: RAID 6 ...................... 997.53 |============================= Glusterfs-1G on XFS SSD via NFS-1G ...... 112.69 |=== Glusterfs-1G on XFS SSD via NFG-1G noop . 113.57 |=== Flexible IO Tester 2.1.11 Type: Sequential Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s MB/s > Higher Is Better Native Btrfs: RAID 0 .................... 319.41 |================== Native Btrfs: RAID 1 .................... 130.32 |======= Native Btrfs: RAID 10 ................... 272.19 |================ Native Btrfs: RAID 5 .................... 242.55 |============== Native Btrfs: RAID 6 .................... 208.96 |============ mdadm Btrfs: RAID 0 ..................... 385.34 |====================== mdadm Btrfs: RAID 1 ..................... 109.97 |====== mdadm Btrfs: RAID 10 .................... 161.90 |========= mdadm Btrfs: RAID 5 ..................... 209.60 |============ mdadm Btrfs: RAID 6 ..................... 172.72 |========== mdadm EXT4: RAID 0 ...................... 508.73 |============================= mdadm EXT4: RAID 1 ...................... 115.34 |======= mdadm EXT4: RAID 10 ..................... 199.95 |=========== mdadm EXT4: RAID 5 ...................... 192.80 |=========== mdadm EXT4: RAID 6 ...................... 155.78 |========= mdadm XFS: RAID 0 ....................... 398.74 |======================= mdadm XFS: RAID 1 ....................... 115.82 |======= mdadm XFS: RAID 10 ...................... 214.94 |============ mdadm XFS: RAID 5 ....................... 197.19 |=========== mdadm XFS: RAID 6 ....................... 154.10 |========= mdadm F2FS: RAID 0 ...................... 419.29 |======================== mdadm F2FS: RAID 1 ...................... 113.35 |====== mdadm F2FS: RAID 10 ..................... 200.36 |=========== mdadm F2FS: RAID 5 ...................... 196.78 |=========== mdadm F2FS: RAID 6 ...................... 152.53 |========= Glusterfs-1G on XFS SSD via NFS-1G ...... 22.23 |= Glusterfs-1G on XFS SSD via NFG-1G noop . 22.03 |= FS-Mark 3.3 Test: 1000 Files, 1MB Size Files/s > Higher Is Better Native Btrfs: RAID 0 .................... 41.43 |=================== Native Btrfs: RAID 1 .................... 35.10 |================ Native Btrfs: RAID 10 ................... 38.33 |================= Native Btrfs: RAID 5 .................... 38.87 |================== Native Btrfs: RAID 6 .................... 38.20 |================= mdadm Btrfs: RAID 0 ..................... 39.60 |================== mdadm Btrfs: RAID 1 ..................... 34.03 |=============== mdadm Btrfs: RAID 10 .................... 37.80 |================= mdadm Btrfs: RAID 5 ..................... 33.37 |=============== mdadm Btrfs: RAID 6 ..................... 30.43 |============== mdadm EXT4: RAID 0 ...................... 38.97 |================== mdadm EXT4: RAID 1 ...................... 33.90 |=============== mdadm EXT4: RAID 10 ..................... 37.03 |================= mdadm EXT4: RAID 5 ...................... 31.10 |============== mdadm EXT4: RAID 6 ...................... 32.27 |=============== mdadm XFS: RAID 0 ....................... 42.43 |=================== mdadm XFS: RAID 1 ....................... 34.07 |================ mdadm XFS: RAID 10 ...................... 39.57 |================== mdadm XFS: RAID 5 ....................... 32.10 |=============== mdadm XFS: RAID 6 ....................... 30.93 |============== mdadm F2FS: RAID 0 ...................... 65.87 |============================== mdadm F2FS: RAID 1 ...................... 53.50 |======================== mdadm F2FS: RAID 10 ..................... 62.87 |============================= mdadm F2FS: RAID 5 ...................... 56.37 |========================== mdadm F2FS: RAID 6 ...................... 50.73 |======================= Glusterfs-1G on XFS SSD via NFS-1G ...... 11.72 |===== Glusterfs-1G on XFS SSD via NFG-1G noop . 12.00 |===== FS-Mark 3.3 Test: 5000 Files, 1MB Size, 4 Threads Files/s > Higher Is Better Native Btrfs: RAID 0 .................... 83.73 |========================= Native Btrfs: RAID 1 .................... 69.03 |===================== Native Btrfs: RAID 10 ................... 77.07 |======================= Native Btrfs: RAID 5 .................... 79.87 |======================== Native Btrfs: RAID 6 .................... 75.47 |======================= mdadm Btrfs: RAID 0 ..................... 92.00 |============================ mdadm Btrfs: RAID 1 ..................... 64.00 |=================== mdadm Btrfs: RAID 10 .................... 75.60 |======================= mdadm Btrfs: RAID 5 ..................... 64.73 |==================== mdadm Btrfs: RAID 6 ..................... 56.80 |================= mdadm EXT4: RAID 0 ...................... 90.40 |=========================== mdadm EXT4: RAID 1 ...................... 99.57 |============================== mdadm EXT4: RAID 10 ..................... 78.13 |======================== mdadm EXT4: RAID 5 ...................... 84.07 |========================= mdadm EXT4: RAID 6 ...................... 70.43 |===================== mdadm XFS: RAID 0 ....................... 88.73 |=========================== mdadm XFS: RAID 1 ....................... 68.90 |===================== mdadm XFS: RAID 10 ...................... 81.70 |========================= mdadm XFS: RAID 5 ....................... 58.10 |================== mdadm XFS: RAID 6 ....................... 53.83 |================ mdadm F2FS: RAID 0 ...................... 86.57 |========================== mdadm F2FS: RAID 1 ...................... 80.63 |======================== mdadm F2FS: RAID 10 ..................... 77.97 |======================= mdadm F2FS: RAID 5 ...................... 75.50 |======================= mdadm F2FS: RAID 6 ...................... 67.83 |==================== Glusterfs-1G on XFS SSD via NFS-1G ...... 19.43 |====== Glusterfs-1G on XFS SSD via NFG-1G noop . 14.20 |==== FS-Mark 3.3 Test: 4000 Files, 32 Sub Dirs, 1MB Size Files/s > Higher Is Better Native Btrfs: RAID 0 .................... 40.73 |================== Native Btrfs: RAID 1 .................... 35.63 |================ Native Btrfs: RAID 10 ................... 38.50 |================= Native Btrfs: RAID 5 .................... 39.17 |================== Native Btrfs: RAID 6 .................... 37.73 |================= mdadm Btrfs: RAID 0 ..................... 39.43 |================== mdadm Btrfs: RAID 1 ..................... 33.43 |=============== mdadm Btrfs: RAID 10 .................... 36.93 |================= mdadm Btrfs: RAID 5 ..................... 32.10 |=============== mdadm Btrfs: RAID 6 ..................... 30.63 |============== mdadm EXT4: RAID 0 ...................... 38.73 |================= mdadm EXT4: RAID 1 ...................... 34.80 |================ mdadm EXT4: RAID 10 ..................... 36.80 |================= mdadm EXT4: RAID 5 ...................... 31.00 |============== mdadm EXT4: RAID 6 ...................... 32.00 |============== mdadm XFS: RAID 0 ....................... 40.73 |================== mdadm XFS: RAID 1 ....................... 32.77 |=============== mdadm XFS: RAID 10 ...................... 35.83 |================ mdadm XFS: RAID 5 ....................... 30.33 |============== mdadm XFS: RAID 6 ....................... 29.23 |============= mdadm F2FS: RAID 0 ...................... 66.40 |============================== mdadm F2FS: RAID 1 ...................... 53.57 |======================== mdadm F2FS: RAID 10 ..................... 61.30 |============================ mdadm F2FS: RAID 5 ...................... 52.47 |======================== mdadm F2FS: RAID 6 ...................... 51.40 |======================= Glusterfs-1G on XFS SSD via NFS-1G ...... 14.82 |======= Glusterfs-1G on XFS SSD via NFG-1G noop . 11.28 |===== IOzone 3.405 Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance MB/s > Higher Is Better Native Btrfs: RAID 0 .................... 1142.43 |============================ Native Btrfs: RAID 1 .................... 584.85 |============== Native Btrfs: RAID 10 ................... 599.32 |=============== Native Btrfs: RAID 5 .................... 876.77 |===================== Native Btrfs: RAID 6 .................... 598.43 |=============== mdadm Btrfs: RAID 0 ..................... 1141.18 |============================ mdadm Btrfs: RAID 1 ..................... 280.39 |======= mdadm Btrfs: RAID 10 .................... 478.65 |============ mdadm Btrfs: RAID 5 ..................... 438.55 |=========== mdadm Btrfs: RAID 6 ..................... 315.85 |======== mdadm EXT4: RAID 0 ...................... 1111.26 |=========================== mdadm EXT4: RAID 1 ...................... 302.75 |======= mdadm EXT4: RAID 10 ..................... 585.30 |============== mdadm EXT4: RAID 5 ...................... 441.27 |=========== mdadm EXT4: RAID 6 ...................... 385.39 |========= mdadm XFS: RAID 0 ....................... 1111.56 |=========================== mdadm XFS: RAID 1 ....................... 303.50 |======= mdadm XFS: RAID 10 ...................... 588.42 |============== mdadm XFS: RAID 5 ....................... 580.95 |============== mdadm XFS: RAID 6 ....................... 473.17 |============ mdadm F2FS: RAID 0 ...................... 1100.42 |=========================== mdadm F2FS: RAID 1 ...................... 303.32 |======= mdadm F2FS: RAID 10 ..................... 566.14 |============== mdadm F2FS: RAID 5 ...................... 421.86 |========== mdadm F2FS: RAID 6 ...................... 350.84 |========= Glusterfs-1G on XFS SSD via NFS-1G ...... 12.97 | Glusterfs-1G on XFS SSD via NFG-1G noop . 8.77 | Compile Bench 0.6 Test: Initial Create MB/s > Higher Is Better Native Btrfs: RAID 0 .................... 206.74 |================ Native Btrfs: RAID 1 .................... 187.72 |============== Native Btrfs: RAID 10 ................... 177.54 |============== Native Btrfs: RAID 5 .................... 189.59 |=============== Native Btrfs: RAID 6 .................... 195.02 |=============== mdadm Btrfs: RAID 0 ..................... 178.31 |============== mdadm Btrfs: RAID 1 ..................... 160.58 |============ mdadm Btrfs: RAID 10 .................... 156.97 |============ mdadm Btrfs: RAID 5 ..................... 156.21 |============ mdadm Btrfs: RAID 6 ..................... 151.64 |============ mdadm EXT4: RAID 0 ...................... 325.18 |========================= mdadm EXT4: RAID 1 ...................... 303.04 |======================= mdadm EXT4: RAID 10 ..................... 306.37 |======================== mdadm EXT4: RAID 5 ...................... 316.17 |======================== mdadm EXT4: RAID 6 ...................... 320.82 |========================= mdadm XFS: RAID 0 ....................... 264.38 |==================== mdadm XFS: RAID 1 ....................... 228.19 |================== mdadm XFS: RAID 10 ...................... 228.20 |================== mdadm XFS: RAID 5 ....................... 255.99 |==================== mdadm XFS: RAID 6 ....................... 271.62 |===================== mdadm F2FS: RAID 0 ...................... 331.33 |========================= mdadm F2FS: RAID 1 ...................... 328.79 |========================= mdadm F2FS: RAID 10 ..................... 352.47 |=========================== mdadm F2FS: RAID 5 ...................... 377.77 |============================= mdadm F2FS: RAID 6 ...................... 348.76 |=========================== Glusterfs-1G on XFS SSD via NFS-1G ...... 14.89 |= Glusterfs-1G on XFS SSD via NFG-1G noop . 16.00 |=