Ubuntu Linux RAID 0/1/5/6/10 Disk Testing RAID mdadm benchmarks with four Intel SSDs using RAID 0, 1, 5, 6, and 10 levels on Linux 3.18 kernel with various file-systems. Benchmarks by Michael Larabel for a future article on Phoronix.com. Native Btrfs: RAID 0: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: btrfs, Screen Resolution: 2560x1600 Native Btrfs: RAID 1: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: btrfs, Screen Resolution: 2560x1600 Native Btrfs: RAID 10: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: btrfs, Screen Resolution: 2560x1600 Native Btrfs: RAID 5: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: btrfs, Screen Resolution: 2560x1600 Native Btrfs: RAID 6: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: btrfs, Screen Resolution: 2560x1600 mdadm Btrfs: RAID 0: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: btrfs, Screen Resolution: 2560x1600 mdadm Btrfs: RAID 1: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: btrfs, Screen Resolution: 2560x1600 mdadm Btrfs: RAID 10: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: btrfs, Screen Resolution: 2560x1600 mdadm Btrfs: RAID 5: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: btrfs, Screen Resolution: 2560x1600 mdadm Btrfs: RAID 6: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: btrfs, Screen Resolution: 2560x1600 mdadm EXT4: RAID 0: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: ext4, Screen Resolution: 2560x1600 mdadm EXT4: RAID 1: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: ext4, Screen Resolution: 2560x1600 mdadm EXT4: RAID 10: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: ext4, Screen Resolution: 2560x1600 mdadm EXT4: RAID 5: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: ext4, Screen Resolution: 2560x1600 mdadm EXT4: RAID 6: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: ext4, Screen Resolution: 2560x1600 mdadm XFS: RAID 0: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: xfs, Screen Resolution: 2560x1600 mdadm XFS: RAID 1: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: xfs, Screen Resolution: 2560x1600 mdadm XFS: RAID 10: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: xfs, Screen Resolution: 2560x1600 mdadm XFS: RAID 5: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: xfs, Screen Resolution: 2560x1600 mdadm XFS: RAID 6: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: xfs, Screen Resolution: 2560x1600 mdadm F2FS: RAID 0: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: f2fs, Screen Resolution: 2560x1600 mdadm F2FS: RAID 1: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: f2fs, Screen Resolution: 2560x1600 mdadm F2FS: RAID 10: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: f2fs, Screen Resolution: 2560x1600 mdadm F2FS: RAID 5: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: f2fs, Screen Resolution: 2560x1600 mdadm F2FS: RAID 6: Processor: Intel Core i7-5960X @ 4.00GHz (16 Cores), Motherboard: Gigabyte X99-UD4-CF, Chipset: Intel Xeon E5 v3/Core, Memory: 16384MB, Disk: 4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1, Graphics: XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MB, Audio: Intel C610/X99, Monitor: SyncMaster, Network: Intel Connection OS: Ubuntu 14.10, Kernel: 3.18.0-031800rc1-generic (x86_64), Desktop: Unity 7.3.1, Display Server: X Server 1.16.0, Display Driver: radeon 7.4.0, OpenGL: 3.3 Mesa 10.3.0 Gallium 0.4, Compiler: GCC 4.9.1, File-System: f2fs, Screen Resolution: 2560x1600 Glusterfs-1G on XFS SSD via NFS-1G: Processor: AMD Phenom II X4 910e @ 2.60GHz (2 Cores), Memory: 1024MB, Disk: 31GB OS: Debian GNU/Linux 8, Kernel: 3.16.0-4-amd64 (x86_64), Compiler: GCC 4.9.2, File-System: ext4, System Layer: Xen 4.4.1-xs100654 Hypervisor Flexible IO Tester 2.1.11 Type: Random Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s MB/s > Higher Is Better Native Btrfs: RAID 0 ............... 758.26 |============================ Native Btrfs: RAID 1 ............... 233.00 |========= Native Btrfs: RAID 10 .............. 469.10 |================= Native Btrfs: RAID 5 ............... 742.06 |=========================== Native Btrfs: RAID 6 ............... 653.54 |======================== mdadm Btrfs: RAID 0 ................ 816.02 |============================== mdadm Btrfs: RAID 1 ................ 224.69 |======== mdadm Btrfs: RAID 10 ............... 695.44 |========================= mdadm Btrfs: RAID 5 ................ 792.61 |============================= mdadm Btrfs: RAID 6 ................ 909.98 |================================= mdadm EXT4: RAID 0 ................. 818.33 |============================== mdadm EXT4: RAID 1 ................. 214.45 |======== mdadm EXT4: RAID 10 ................ 684.95 |========================= mdadm EXT4: RAID 5 ................. 689.39 |========================= mdadm EXT4: RAID 6 ................. 854.92 |=============================== mdadm XFS: RAID 0 .................. 841.97 |=============================== mdadm XFS: RAID 1 .................. 236.43 |========= mdadm XFS: RAID 10 ................. 384.53 |============== mdadm XFS: RAID 5 .................. 751.77 |============================ mdadm XFS: RAID 6 .................. 928.27 |================================== mdadm F2FS: RAID 0 ................. 872.84 |================================ mdadm F2FS: RAID 1 ................. 239.73 |========= mdadm F2FS: RAID 10 ................ 741.30 |=========================== mdadm F2FS: RAID 5 ................. 736.18 |=========================== mdadm F2FS: RAID 6 ................. 916.30 |================================== Glusterfs-1G on XFS SSD via NFS-1G . 71.74 |=== Flexible IO Tester 2.1.11 Type: Random Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s MB/s > Higher Is Better Native Btrfs: RAID 0 ............... 497.23 |================================== Native Btrfs: RAID 1 ............... 128.00 |========= Native Btrfs: RAID 10 .............. 267.48 |================== Native Btrfs: RAID 5 ............... 248.93 |================= Native Btrfs: RAID 6 ............... 214.56 |=============== mdadm Btrfs: RAID 0 ................ 381.45 |========================== mdadm Btrfs: RAID 1 ................ 109.22 |======= mdadm Btrfs: RAID 10 ............... 159.53 |=========== mdadm Btrfs: RAID 5 ................ 214.31 |=============== mdadm Btrfs: RAID 6 ................ 179.73 |============ mdadm EXT4: RAID 0 ................. 421.37 |============================= mdadm EXT4: RAID 1 ................. 110.32 |======== mdadm EXT4: RAID 10 ................ 163.86 |=========== mdadm EXT4: RAID 5 ................. 146.07 |========== mdadm EXT4: RAID 6 ................. 134.18 |========= mdadm XFS: RAID 0 .................. 393.49 |=========================== mdadm XFS: RAID 1 .................. 115.51 |======== mdadm XFS: RAID 10 ................. 166.75 |=========== mdadm XFS: RAID 5 .................. 151.05 |========== mdadm XFS: RAID 6 .................. 129.62 |========= mdadm F2FS: RAID 0 ................. 387.04 |========================== mdadm F2FS: RAID 1 ................. 109.58 |======= mdadm F2FS: RAID 10 ................ 177.32 |============ mdadm F2FS: RAID 5 ................. 149.41 |========== mdadm F2FS: RAID 6 ................. 131.26 |========= Glusterfs-1G on XFS SSD via NFS-1G . 13.50 |= Flexible IO Tester 2.1.11 Type: Sequential Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s MB/s > Higher Is Better Native Btrfs: RAID 0 ............... 824.97 |============================ Native Btrfs: RAID 1 ............... 323.80 |=========== Native Btrfs: RAID 10 .............. 450.78 |=============== Native Btrfs: RAID 5 ............... 869.68 |============================== Native Btrfs: RAID 6 ............... 960.89 |================================= mdadm Btrfs: RAID 1 ................ 854.98 |============================= mdadm Btrfs: RAID 10 ............... 843.68 |============================= mdadm Btrfs: RAID 5 ................ 879.09 |============================== mdadm Btrfs: RAID 6 ................ 925.05 |================================ mdadm EXT4: RAID 1 ................. 303.30 |========== mdadm EXT4: RAID 5 ................. 957.59 |================================= mdadm XFS: RAID 1 .................. 301.16 |========== mdadm F2FS: RAID 1 ................. 299.58 |========== mdadm F2FS: RAID 6 ................. 997.53 |================================== Glusterfs-1G on XFS SSD via NFS-1G . 112.69 |==== Flexible IO Tester 2.1.11 Type: Sequential Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s MB/s > Higher Is Better Native Btrfs: RAID 0 ............... 319.41 |===================== Native Btrfs: RAID 1 ............... 130.32 |========= Native Btrfs: RAID 10 .............. 272.19 |================== Native Btrfs: RAID 5 ............... 242.55 |================ Native Btrfs: RAID 6 ............... 208.96 |============== mdadm Btrfs: RAID 0 ................ 385.34 |========================== mdadm Btrfs: RAID 1 ................ 109.97 |======= mdadm Btrfs: RAID 10 ............... 161.90 |=========== mdadm Btrfs: RAID 5 ................ 209.60 |============== mdadm Btrfs: RAID 6 ................ 172.72 |============ mdadm EXT4: RAID 0 ................. 508.73 |================================== mdadm EXT4: RAID 1 ................. 115.34 |======== mdadm EXT4: RAID 10 ................ 199.95 |============= mdadm EXT4: RAID 5 ................. 192.80 |============= mdadm EXT4: RAID 6 ................. 155.78 |========== mdadm XFS: RAID 0 .................. 398.74 |=========================== mdadm XFS: RAID 1 .................. 115.82 |======== mdadm XFS: RAID 10 ................. 214.94 |============== mdadm XFS: RAID 5 .................. 197.19 |============= mdadm XFS: RAID 6 .................. 154.10 |========== mdadm F2FS: RAID 0 ................. 419.29 |============================ mdadm F2FS: RAID 1 ................. 113.35 |======== mdadm F2FS: RAID 10 ................ 200.36 |============= mdadm F2FS: RAID 5 ................. 196.78 |============= mdadm F2FS: RAID 6 ................. 152.53 |========== Glusterfs-1G on XFS SSD via NFS-1G . 22.23 |= FS-Mark 3.3 Test: 1000 Files, 1MB Size Files/s > Higher Is Better Native Btrfs: RAID 0 ............... 41.43 |====================== Native Btrfs: RAID 1 ............... 35.10 |=================== Native Btrfs: RAID 10 .............. 38.33 |==================== Native Btrfs: RAID 5 ............... 38.87 |===================== Native Btrfs: RAID 6 ............... 38.20 |==================== mdadm Btrfs: RAID 0 ................ 39.60 |===================== mdadm Btrfs: RAID 1 ................ 34.03 |================== mdadm Btrfs: RAID 10 ............... 37.80 |==================== mdadm Btrfs: RAID 5 ................ 33.37 |================== mdadm Btrfs: RAID 6 ................ 30.43 |================ mdadm EXT4: RAID 0 ................. 38.97 |===================== mdadm EXT4: RAID 1 ................. 33.90 |================== mdadm EXT4: RAID 10 ................ 37.03 |==================== mdadm EXT4: RAID 5 ................. 31.10 |================= mdadm EXT4: RAID 6 ................. 32.27 |================= mdadm XFS: RAID 0 .................. 42.43 |======================= mdadm XFS: RAID 1 .................. 34.07 |================== mdadm XFS: RAID 10 ................. 39.57 |===================== mdadm XFS: RAID 5 .................. 32.10 |================= mdadm XFS: RAID 6 .................. 30.93 |================ mdadm F2FS: RAID 0 ................. 65.87 |=================================== mdadm F2FS: RAID 1 ................. 53.50 |============================ mdadm F2FS: RAID 10 ................ 62.87 |================================= mdadm F2FS: RAID 5 ................. 56.37 |============================== mdadm F2FS: RAID 6 ................. 50.73 |=========================== Glusterfs-1G on XFS SSD via NFS-1G . 11.72 |====== FS-Mark 3.3 Test: 5000 Files, 1MB Size, 4 Threads Files/s > Higher Is Better Native Btrfs: RAID 0 ............... 83.73 |============================= Native Btrfs: RAID 1 ............... 69.03 |======================== Native Btrfs: RAID 10 .............. 77.07 |=========================== Native Btrfs: RAID 5 ............... 79.87 |============================ Native Btrfs: RAID 6 ............... 75.47 |=========================== mdadm Btrfs: RAID 0 ................ 92.00 |================================ mdadm Btrfs: RAID 1 ................ 64.00 |====================== mdadm Btrfs: RAID 10 ............... 75.60 |=========================== mdadm Btrfs: RAID 5 ................ 64.73 |======================= mdadm Btrfs: RAID 6 ................ 56.80 |==================== mdadm EXT4: RAID 0 ................. 90.40 |================================ mdadm EXT4: RAID 1 ................. 99.57 |=================================== mdadm EXT4: RAID 10 ................ 78.13 |=========================== mdadm EXT4: RAID 5 ................. 84.07 |============================== mdadm EXT4: RAID 6 ................. 70.43 |========================= mdadm XFS: RAID 0 .................. 88.73 |=============================== mdadm XFS: RAID 1 .................. 68.90 |======================== mdadm XFS: RAID 10 ................. 81.70 |============================= mdadm XFS: RAID 5 .................. 58.10 |==================== mdadm XFS: RAID 6 .................. 53.83 |=================== mdadm F2FS: RAID 0 ................. 86.57 |============================== mdadm F2FS: RAID 1 ................. 80.63 |============================ mdadm F2FS: RAID 10 ................ 77.97 |=========================== mdadm F2FS: RAID 5 ................. 75.50 |=========================== mdadm F2FS: RAID 6 ................. 67.83 |======================== Glusterfs-1G on XFS SSD via NFS-1G . 19.43 |======= FS-Mark 3.3 Test: 4000 Files, 32 Sub Dirs, 1MB Size Files/s > Higher Is Better Native Btrfs: RAID 0 ............... 40.73 |===================== Native Btrfs: RAID 1 ............... 35.63 |=================== Native Btrfs: RAID 10 .............. 38.50 |==================== Native Btrfs: RAID 5 ............... 39.17 |===================== Native Btrfs: RAID 6 ............... 37.73 |==================== mdadm Btrfs: RAID 0 ................ 39.43 |===================== mdadm Btrfs: RAID 1 ................ 33.43 |================== mdadm Btrfs: RAID 10 ............... 36.93 |=================== mdadm Btrfs: RAID 5 ................ 32.10 |================= mdadm Btrfs: RAID 6 ................ 30.63 |================ mdadm EXT4: RAID 0 ................. 38.73 |==================== mdadm EXT4: RAID 1 ................. 34.80 |================== mdadm EXT4: RAID 10 ................ 36.80 |=================== mdadm EXT4: RAID 5 ................. 31.00 |================ mdadm EXT4: RAID 6 ................. 32.00 |================= mdadm XFS: RAID 0 .................. 40.73 |===================== mdadm XFS: RAID 1 .................. 32.77 |================= mdadm XFS: RAID 10 ................. 35.83 |=================== mdadm XFS: RAID 5 .................. 30.33 |================ mdadm XFS: RAID 6 .................. 29.23 |=============== mdadm F2FS: RAID 0 ................. 66.40 |=================================== mdadm F2FS: RAID 1 ................. 53.57 |============================ mdadm F2FS: RAID 10 ................ 61.30 |================================ mdadm F2FS: RAID 5 ................. 52.47 |============================ mdadm F2FS: RAID 6 ................. 51.40 |=========================== Glusterfs-1G on XFS SSD via NFS-1G . 14.82 |======== IOzone 3.405 Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance MB/s > Higher Is Better Native Btrfs: RAID 0 ............... 1142.43 |================================= Native Btrfs: RAID 1 ............... 584.85 |================= Native Btrfs: RAID 10 .............. 599.32 |================= Native Btrfs: RAID 5 ............... 876.77 |========================= Native Btrfs: RAID 6 ............... 598.43 |================= mdadm Btrfs: RAID 0 ................ 1141.18 |================================= mdadm Btrfs: RAID 1 ................ 280.39 |======== mdadm Btrfs: RAID 10 ............... 478.65 |============== mdadm Btrfs: RAID 5 ................ 438.55 |============= mdadm Btrfs: RAID 6 ................ 315.85 |========= mdadm EXT4: RAID 0 ................. 1111.26 |================================ mdadm EXT4: RAID 1 ................. 302.75 |========= mdadm EXT4: RAID 10 ................ 585.30 |================= mdadm EXT4: RAID 5 ................. 441.27 |============= mdadm EXT4: RAID 6 ................. 385.39 |=========== mdadm XFS: RAID 0 .................. 1111.56 |================================ mdadm XFS: RAID 1 .................. 303.50 |========= mdadm XFS: RAID 10 ................. 588.42 |================= mdadm XFS: RAID 5 .................. 580.95 |================= mdadm XFS: RAID 6 .................. 473.17 |============== mdadm F2FS: RAID 0 ................. 1100.42 |================================ mdadm F2FS: RAID 1 ................. 303.32 |========= mdadm F2FS: RAID 10 ................ 566.14 |================ mdadm F2FS: RAID 5 ................. 421.86 |============ mdadm F2FS: RAID 6 ................. 350.84 |========== Glusterfs-1G on XFS SSD via NFS-1G . 12.97 | Compile Bench 0.6 Test: Initial Create MB/s > Higher Is Better Native Btrfs: RAID 0 ............... 206.74 |=================== Native Btrfs: RAID 1 ............... 187.72 |================= Native Btrfs: RAID 10 .............. 177.54 |================ Native Btrfs: RAID 5 ............... 189.59 |================= Native Btrfs: RAID 6 ............... 195.02 |================== mdadm Btrfs: RAID 0 ................ 178.31 |================ mdadm Btrfs: RAID 1 ................ 160.58 |============== mdadm Btrfs: RAID 10 ............... 156.97 |============== mdadm Btrfs: RAID 5 ................ 156.21 |============== mdadm Btrfs: RAID 6 ................ 151.64 |============== mdadm EXT4: RAID 0 ................. 325.18 |============================= mdadm EXT4: RAID 1 ................. 303.04 |=========================== mdadm EXT4: RAID 10 ................ 306.37 |============================ mdadm EXT4: RAID 5 ................. 316.17 |============================ mdadm EXT4: RAID 6 ................. 320.82 |============================= mdadm XFS: RAID 0 .................. 264.38 |======================== mdadm XFS: RAID 1 .................. 228.19 |===================== mdadm XFS: RAID 10 ................. 228.20 |===================== mdadm XFS: RAID 5 .................. 255.99 |======================= mdadm XFS: RAID 6 .................. 271.62 |======================== mdadm F2FS: RAID 0 ................. 331.33 |============================== mdadm F2FS: RAID 1 ................. 328.79 |============================== mdadm F2FS: RAID 10 ................ 352.47 |================================ mdadm F2FS: RAID 5 ................. 377.77 |================================== mdadm F2FS: RAID 6 ................. 348.76 |=============================== Glusterfs-1G on XFS SSD via NFS-1G . 14.89 |=