Ubuntu Linux RAID 0/1/5/6/10 Disk Testing RAID mdadm benchmarks with four Intel SSDs using RAID 0, 1, 5, 6, and 10 levels on Linux 3.18 kernel with various file-systems. Benchmarks by Michael Larabel for a future article on Phoronix.com. Native Btrfs: RAID 0: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: btrfs, Screen Resolution: 2560x1600 Native Btrfs: RAID 1: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: btrfs, Screen Resolution: 2560x1600 Native Btrfs: RAID 10: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: btrfs, Screen Resolution: 2560x1600 Native Btrfs: RAID 5: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: btrfs, Screen Resolution: 2560x1600 Native Btrfs: RAID 6: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: btrfs, Screen Resolution: 2560x1600 mdadm Btrfs: RAID 0: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: btrfs, Screen Resolution: 2560x1600 mdadm Btrfs: RAID 1: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: btrfs, Screen Resolution: 2560x1600 mdadm Btrfs: RAID 10: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: btrfs, Screen Resolution: 2560x1600 mdadm Btrfs: RAID 5: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: btrfs, Screen Resolution: 2560x1600 mdadm Btrfs: RAID 6: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: btrfs, Screen Resolution: 2560x1600 mdadm EXT4: RAID 0: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: ext4, Screen Resolution: 2560x1600 mdadm EXT4: RAID 1: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: ext4, Screen Resolution: 2560x1600 mdadm EXT4: RAID 10: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: ext4, Screen Resolution: 2560x1600 mdadm EXT4: RAID 5: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: ext4, Screen Resolution: 2560x1600 mdadm EXT4: RAID 6: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: ext4, Screen Resolution: 2560x1600 mdadm XFS: RAID 0: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: xfs, Screen Resolution: 2560x1600 mdadm XFS: RAID 1: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: xfs, Screen Resolution: 2560x1600 mdadm XFS: RAID 10: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: xfs, Screen Resolution: 2560x1600 mdadm XFS: RAID 5: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: xfs, Screen Resolution: 2560x1600 mdadm XFS: RAID 6: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: xfs, Screen Resolution: 2560x1600 mdadm F2FS: RAID 0: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: f2fs, Screen Resolution: 2560x1600 mdadm F2FS: RAID 1: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: f2fs, Screen Resolution: 2560x1600 mdadm F2FS: RAID 10: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: f2fs, Screen Resolution: 2560x1600 mdadm F2FS: RAID 5: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: f2fs, Screen Resolution: 2560x1600 mdadm F2FS: RAID 6: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: f2fs, Screen Resolution: 2560x1600 Glusterfs-1G on XFS SSD via NFS-1G: Processor: AMD Phenom II X4 910e @ 2.60GHz (2 Cores), Memory: 1024MB, Disk: 31GB OS: Debian GNU/Linux 8, Kernel: 3.16.0-4-amd64 (x86_64), Compiler: GCC 4.9.2, File-System: ext4, System Layer: Xen 4.4.1-xs100654 Hypervisor Glusterfs-1G on XFS SSD via NFG-1G noop: Processor: AMD Phenom II X4 910e @ 2.60GHz (2 Cores), Memory: 1024MB, Disk: 31GB OS: Debian GNU/Linux 8, Kernel: 3.16.0-4-amd64 (x86_64), Compiler: GCC 4.9.2, File-System: ext4, System Layer: Xen 4.4.1-xs100654 Hypervisor Glusterfs-1G on XFS SSD via NFS-1G deadline tuned: Processor: AMD Phenom II X4 910e @ 2.60GHz (2 Cores), Memory: 1024MB, Disk: 31GB OS: Debian GNU/Linux 8, Kernel: 3.16.0-4-amd64 (x86_64), Compiler: GCC 4.9.2, File-System: ext4, System Layer: Xen 4.4.1-xs100654 Hypervisor Flexible IO Tester 2.1.11 Type: Random Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s MB/s > Higher Is Better Native Btrfs: RAID 0 .............................. 758.26 |================ Native Btrfs: RAID 1 .............................. 233.00 |===== Native Btrfs: RAID 10 ............................. 469.10 |========== Native Btrfs: RAID 5 .............................. 742.06 |=============== Native Btrfs: RAID 6 .............................. 653.54 |============= mdadm Btrfs: RAID 0 ............................... 816.02 |================= mdadm Btrfs: RAID 1 ............................... 224.69 |===== mdadm Btrfs: RAID 10 .............................. 695.44 |============== mdadm Btrfs: RAID 5 ............................... 792.61 |================ mdadm Btrfs: RAID 6 ............................... 909.98 |=================== mdadm EXT4: RAID 0 ................................ 818.33 |================= mdadm EXT4: RAID 1 ................................ 214.45 |==== mdadm EXT4: RAID 10 ............................... 684.95 |============== mdadm EXT4: RAID 5 ................................ 689.39 |============== mdadm EXT4: RAID 6 ................................ 854.92 |================= mdadm XFS: RAID 0 ................................. 841.97 |================= mdadm XFS: RAID 1 ................................. 236.43 |===== mdadm XFS: RAID 10 ................................ 384.53 |======== mdadm XFS: RAID 5 ................................. 751.77 |=============== mdadm XFS: RAID 6 ................................. 928.27 |=================== mdadm F2FS: RAID 0 ................................ 872.84 |================== mdadm F2FS: RAID 1 ................................ 239.73 |===== mdadm F2FS: RAID 10 ............................... 741.30 |=============== mdadm F2FS: RAID 5 ................................ 736.18 |=============== mdadm F2FS: RAID 6 ................................ 916.30 |=================== Glusterfs-1G on XFS SSD via NFS-1G ................ 71.74 |= Glusterfs-1G on XFS SSD via NFG-1G noop ........... 70.21 |= Glusterfs-1G on XFS SSD via NFS-1G deadline tuned . 69.72 |= Flexible IO Tester 2.1.11 Type: Random Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s MB/s > Higher Is Better Native Btrfs: RAID 0 .............................. 497.23 |=================== Native Btrfs: RAID 1 .............................. 128.00 |===== Native Btrfs: RAID 10 ............................. 267.48 |========== Native Btrfs: RAID 5 .............................. 248.93 |========== Native Btrfs: RAID 6 .............................. 214.56 |======== mdadm Btrfs: RAID 0 ............................... 381.45 |=============== mdadm Btrfs: RAID 1 ............................... 109.22 |==== mdadm Btrfs: RAID 10 .............................. 159.53 |====== mdadm Btrfs: RAID 5 ............................... 214.31 |======== mdadm Btrfs: RAID 6 ............................... 179.73 |======= mdadm EXT4: RAID 0 ................................ 421.37 |================ mdadm EXT4: RAID 1 ................................ 110.32 |==== mdadm EXT4: RAID 10 ............................... 163.86 |====== mdadm EXT4: RAID 5 ................................ 146.07 |====== mdadm EXT4: RAID 6 ................................ 134.18 |===== mdadm XFS: RAID 0 ................................. 393.49 |=============== mdadm XFS: RAID 1 ................................. 115.51 |==== mdadm XFS: RAID 10 ................................ 166.75 |====== mdadm XFS: RAID 5 ................................. 151.05 |====== mdadm XFS: RAID 6 ................................. 129.62 |===== mdadm F2FS: RAID 0 ................................ 387.04 |=============== mdadm F2FS: RAID 1 ................................ 109.58 |==== mdadm F2FS: RAID 10 ............................... 177.32 |======= mdadm F2FS: RAID 5 ................................ 149.41 |====== mdadm F2FS: RAID 6 ................................ 131.26 |===== Glusterfs-1G on XFS SSD via NFS-1G ................ 13.50 |= Glusterfs-1G on XFS SSD via NFG-1G noop ........... 13.26 |= Glusterfs-1G on XFS SSD via NFS-1G deadline tuned . 13.60 |= Flexible IO Tester 2.1.11 Type: Sequential Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s MB/s > Higher Is Better Native Btrfs: RAID 0 .............................. 824.97 |================ Native Btrfs: RAID 1 .............................. 323.80 |====== Native Btrfs: RAID 10 ............................. 450.78 |========= Native Btrfs: RAID 5 .............................. 869.68 |================= Native Btrfs: RAID 6 .............................. 960.89 |================== mdadm Btrfs: RAID 1 ............................... 854.98 |================ mdadm Btrfs: RAID 10 .............................. 843.68 |================ mdadm Btrfs: RAID 5 ............................... 879.09 |================= mdadm Btrfs: RAID 6 ............................... 925.05 |================== mdadm EXT4: RAID 1 ................................ 303.30 |====== mdadm EXT4: RAID 5 ................................ 957.59 |================== mdadm XFS: RAID 1 ................................. 301.16 |====== mdadm F2FS: RAID 1 ................................ 299.58 |====== mdadm F2FS: RAID 6 ................................ 997.53 |=================== Glusterfs-1G on XFS SSD via NFS-1G ................ 112.69 |== Glusterfs-1G on XFS SSD via NFG-1G noop ........... 113.57 |== Glusterfs-1G on XFS SSD via NFS-1G deadline tuned . 112.58 |== Flexible IO Tester 2.1.11 Type: Sequential Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s MB/s > Higher Is Better Native Btrfs: RAID 0 .............................. 319.41 |============ Native Btrfs: RAID 1 .............................. 130.32 |===== Native Btrfs: RAID 10 ............................. 272.19 |========== Native Btrfs: RAID 5 .............................. 242.55 |========= Native Btrfs: RAID 6 .............................. 208.96 |======== mdadm Btrfs: RAID 0 ............................... 385.34 |============== mdadm Btrfs: RAID 1 ............................... 109.97 |==== mdadm Btrfs: RAID 10 .............................. 161.90 |====== mdadm Btrfs: RAID 5 ............................... 209.60 |======== mdadm Btrfs: RAID 6 ............................... 172.72 |====== mdadm EXT4: RAID 0 ................................ 508.73 |=================== mdadm EXT4: RAID 1 ................................ 115.34 |==== mdadm EXT4: RAID 10 ............................... 199.95 |======= mdadm EXT4: RAID 5 ................................ 192.80 |======= mdadm EXT4: RAID 6 ................................ 155.78 |====== mdadm XFS: RAID 0 ................................. 398.74 |=============== mdadm XFS: RAID 1 ................................. 115.82 |==== mdadm XFS: RAID 10 ................................ 214.94 |======== mdadm XFS: RAID 5 ................................. 197.19 |======= mdadm XFS: RAID 6 ................................. 154.10 |====== mdadm F2FS: RAID 0 ................................ 419.29 |================ mdadm F2FS: RAID 1 ................................ 113.35 |==== mdadm F2FS: RAID 10 ............................... 200.36 |======= mdadm F2FS: RAID 5 ................................ 196.78 |======= mdadm F2FS: RAID 6 ................................ 152.53 |====== Glusterfs-1G on XFS SSD via NFS-1G ................ 22.23 |= Glusterfs-1G on XFS SSD via NFG-1G noop ........... 22.03 |= Glusterfs-1G on XFS SSD via NFS-1G deadline tuned . 22.28 |= FS-Mark 3.3 Test: 1000 Files, 1MB Size Files/s > Higher Is Better Native Btrfs: RAID 0 .............................. 41.43 |============= Native Btrfs: RAID 1 .............................. 35.10 |=========== Native Btrfs: RAID 10 ............................. 38.33 |============ Native Btrfs: RAID 5 .............................. 38.87 |============ Native Btrfs: RAID 6 .............................. 38.20 |============ mdadm Btrfs: RAID 0 ............................... 39.60 |============ mdadm Btrfs: RAID 1 ............................... 34.03 |========== mdadm Btrfs: RAID 10 .............................. 37.80 |=========== mdadm Btrfs: RAID 5 ............................... 33.37 |========== mdadm Btrfs: RAID 6 ............................... 30.43 |========= mdadm EXT4: RAID 0 ................................ 38.97 |============ mdadm EXT4: RAID 1 ................................ 33.90 |========== mdadm EXT4: RAID 10 ............................... 37.03 |=========== mdadm EXT4: RAID 5 ................................ 31.10 |========= mdadm EXT4: RAID 6 ................................ 32.27 |========== mdadm XFS: RAID 0 ................................. 42.43 |============= mdadm XFS: RAID 1 ................................. 34.07 |========== mdadm XFS: RAID 10 ................................ 39.57 |============ mdadm XFS: RAID 5 ................................. 32.10 |========== mdadm XFS: RAID 6 ................................. 30.93 |========= mdadm F2FS: RAID 0 ................................ 65.87 |==================== mdadm F2FS: RAID 1 ................................ 53.50 |================ mdadm F2FS: RAID 10 ............................... 62.87 |=================== mdadm F2FS: RAID 5 ................................ 56.37 |================= mdadm F2FS: RAID 6 ................................ 50.73 |=============== Glusterfs-1G on XFS SSD via NFS-1G ................ 11.72 |==== Glusterfs-1G on XFS SSD via NFG-1G noop ........... 12.00 |==== Glusterfs-1G on XFS SSD via NFS-1G deadline tuned . 11.15 |=== FS-Mark 3.3 Test: 5000 Files, 1MB Size, 4 Threads Files/s > Higher Is Better Native Btrfs: RAID 0 .............................. 83.73 |================= Native Btrfs: RAID 1 .............................. 69.03 |============== Native Btrfs: RAID 10 ............................. 77.07 |=============== Native Btrfs: RAID 5 .............................. 79.87 |================ Native Btrfs: RAID 6 .............................. 75.47 |=============== mdadm Btrfs: RAID 0 ............................... 92.00 |================== mdadm Btrfs: RAID 1 ............................... 64.00 |============= mdadm Btrfs: RAID 10 .............................. 75.60 |=============== mdadm Btrfs: RAID 5 ............................... 64.73 |============= mdadm Btrfs: RAID 6 ............................... 56.80 |=========== mdadm EXT4: RAID 0 ................................ 90.40 |================== mdadm EXT4: RAID 1 ................................ 99.57 |==================== mdadm EXT4: RAID 10 ............................... 78.13 |================ mdadm EXT4: RAID 5 ................................ 84.07 |================= mdadm EXT4: RAID 6 ................................ 70.43 |============== mdadm XFS: RAID 0 ................................. 88.73 |================== mdadm XFS: RAID 1 ................................. 68.90 |============== mdadm XFS: RAID 10 ................................ 81.70 |================ mdadm XFS: RAID 5 ................................. 58.10 |============ mdadm XFS: RAID 6 ................................. 53.83 |=========== mdadm F2FS: RAID 0 ................................ 86.57 |================= mdadm F2FS: RAID 1 ................................ 80.63 |================ mdadm F2FS: RAID 10 ............................... 77.97 |================ mdadm F2FS: RAID 5 ................................ 75.50 |=============== mdadm F2FS: RAID 6 ................................ 67.83 |============== Glusterfs-1G on XFS SSD via NFS-1G ................ 19.43 |==== Glusterfs-1G on XFS SSD via NFG-1G noop ........... 14.20 |=== Glusterfs-1G on XFS SSD via NFS-1G deadline tuned . 14.27 |=== FS-Mark 3.3 Test: 4000 Files, 32 Sub Dirs, 1MB Size Files/s > Higher Is Better Native Btrfs: RAID 0 .............................. 40.73 |============ Native Btrfs: RAID 1 .............................. 35.63 |=========== Native Btrfs: RAID 10 ............................. 38.50 |============ Native Btrfs: RAID 5 .............................. 39.17 |============ Native Btrfs: RAID 6 .............................. 37.73 |=========== mdadm Btrfs: RAID 0 ............................... 39.43 |============ mdadm Btrfs: RAID 1 ............................... 33.43 |========== mdadm Btrfs: RAID 10 .............................. 36.93 |=========== mdadm Btrfs: RAID 5 ............................... 32.10 |========== mdadm Btrfs: RAID 6 ............................... 30.63 |========= mdadm EXT4: RAID 0 ................................ 38.73 |============ mdadm EXT4: RAID 1 ................................ 34.80 |========== mdadm EXT4: RAID 10 ............................... 36.80 |=========== mdadm EXT4: RAID 5 ................................ 31.00 |========= mdadm EXT4: RAID 6 ................................ 32.00 |========== mdadm XFS: RAID 0 ................................. 40.73 |============ mdadm XFS: RAID 1 ................................. 32.77 |========== mdadm XFS: RAID 10 ................................ 35.83 |=========== mdadm XFS: RAID 5 ................................. 30.33 |========= mdadm XFS: RAID 6 ................................. 29.23 |========= mdadm F2FS: RAID 0 ................................ 66.40 |==================== mdadm F2FS: RAID 1 ................................ 53.57 |================ mdadm F2FS: RAID 10 ............................... 61.30 |================== mdadm F2FS: RAID 5 ................................ 52.47 |================ mdadm F2FS: RAID 6 ................................ 51.40 |=============== Glusterfs-1G on XFS SSD via NFS-1G ................ 14.82 |==== Glusterfs-1G on XFS SSD via NFG-1G noop ........... 11.28 |=== Glusterfs-1G on XFS SSD via NFS-1G deadline tuned . 11.68 |==== IOzone 3.405 Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance MB/s > Higher Is Better Native Btrfs: RAID 0 .............................. 1142.43 |================== Native Btrfs: RAID 1 .............................. 584.85 |========= Native Btrfs: RAID 10 ............................. 599.32 |========= Native Btrfs: RAID 5 .............................. 876.77 |============== Native Btrfs: RAID 6 .............................. 598.43 |========= mdadm Btrfs: RAID 0 ............................... 1141.18 |================== mdadm Btrfs: RAID 1 ............................... 280.39 |==== mdadm Btrfs: RAID 10 .............................. 478.65 |======== mdadm Btrfs: RAID 5 ............................... 438.55 |======= mdadm Btrfs: RAID 6 ............................... 315.85 |===== mdadm EXT4: RAID 0 ................................ 1111.26 |================== mdadm EXT4: RAID 1 ................................ 302.75 |===== mdadm EXT4: RAID 10 ............................... 585.30 |========= mdadm EXT4: RAID 5 ................................ 441.27 |======= mdadm EXT4: RAID 6 ................................ 385.39 |====== mdadm XFS: RAID 0 ................................. 1111.56 |================== mdadm XFS: RAID 1 ................................. 303.50 |===== mdadm XFS: RAID 10 ................................ 588.42 |========= mdadm XFS: RAID 5 ................................. 580.95 |========= mdadm XFS: RAID 6 ................................. 473.17 |======= mdadm F2FS: RAID 0 ................................ 1100.42 |================= mdadm F2FS: RAID 1 ................................ 303.32 |===== mdadm F2FS: RAID 10 ............................... 566.14 |========= mdadm F2FS: RAID 5 ................................ 421.86 |======= mdadm F2FS: RAID 6 ................................ 350.84 |====== Glusterfs-1G on XFS SSD via NFS-1G ................ 12.97 | Glusterfs-1G on XFS SSD via NFG-1G noop ........... 8.77 | Glusterfs-1G on XFS SSD via NFS-1G deadline tuned . 8.44 | Compile Bench 0.6 Test: Initial Create MB/s > Higher Is Better Native Btrfs: RAID 0 .............................. 206.74 |========== Native Btrfs: RAID 1 .............................. 187.72 |========= Native Btrfs: RAID 10 ............................. 177.54 |========= Native Btrfs: RAID 5 .............................. 189.59 |========== Native Btrfs: RAID 6 .............................. 195.02 |========== mdadm Btrfs: RAID 0 ............................... 178.31 |========= mdadm Btrfs: RAID 1 ............................... 160.58 |======== mdadm Btrfs: RAID 10 .............................. 156.97 |======== mdadm Btrfs: RAID 5 ............................... 156.21 |======== mdadm Btrfs: RAID 6 ............................... 151.64 |======== mdadm EXT4: RAID 0 ................................ 325.18 |================ mdadm EXT4: RAID 1 ................................ 303.04 |=============== mdadm EXT4: RAID 10 ............................... 306.37 |=============== mdadm EXT4: RAID 5 ................................ 316.17 |================ mdadm EXT4: RAID 6 ................................ 320.82 |================ mdadm XFS: RAID 0 ................................. 264.38 |============= mdadm XFS: RAID 1 ................................. 228.19 |=========== mdadm XFS: RAID 10 ................................ 228.20 |=========== mdadm XFS: RAID 5 ................................. 255.99 |============= mdadm XFS: RAID 6 ................................. 271.62 |============== mdadm F2FS: RAID 0 ................................ 331.33 |================= mdadm F2FS: RAID 1 ................................ 328.79 |================= mdadm F2FS: RAID 10 ............................... 352.47 |================== mdadm F2FS: RAID 5 ................................ 377.77 |=================== mdadm F2FS: RAID 6 ................................ 348.76 |================== Glusterfs-1G on XFS SSD via NFS-1G ................ 14.89 |= Glusterfs-1G on XFS SSD via NFG-1G noop ........... 16.00 |= Glusterfs-1G on XFS SSD via NFS-1G deadline tuned . 16.43 |=