Ubuntu Linux RAID 0/1/5/6/10 Disk Testing

RAID mdadm benchmarks with four Intel SSDs using RAID 0, 1, 5, 6, and 10 levels on Linux 3.18 kernel with various file-systems. Benchmarks by Michael Larabel for a future article on Phoronix.com.

HTML result view exported from: https://openbenchmarking.org/result/1507134-BE-1411054LI10&grw&sor.

Ubuntu Linux RAID 0/1/5/6/10 Disk TestingProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionSystem LayerNative Btrfs: RAID 0Native Btrfs: RAID 1Native Btrfs: RAID 10Native Btrfs: RAID 5Native Btrfs: RAID 6mdadm Btrfs: RAID 0mdadm Btrfs: RAID 1mdadm Btrfs: RAID 10mdadm Btrfs: RAID 5mdadm Btrfs: RAID 6mdadm EXT4: RAID 0mdadm EXT4: RAID 1mdadm EXT4: RAID 10mdadm EXT4: RAID 5mdadm EXT4: RAID 6mdadm XFS: RAID 0mdadm XFS: RAID 1mdadm XFS: RAID 10mdadm XFS: RAID 5mdadm XFS: RAID 6mdadm F2FS: RAID 0mdadm F2FS: RAID 1mdadm F2FS: RAID 10mdadm F2FS: RAID 5mdadm F2FS: RAID 6Glusterfs-1G on XFS SSD via NFS-1GGlusterfs-1G on XFS SSD via NFG-1G noopGlusterfs-1G on XFS SSD via NFS-1G deadline tunedIntel Core i7-5960X @ 4.00GHz (16 Cores)Gigabyte X99-UD4-CFIntel Xeon E5 v3/Core16384MB4 x 120GB INTEL SSDSC2BW12 + 128GB Crucial_CT128MX1XFX AMD Radeon HD 7950/8950 OEM / R9 280 3072MBIntel C610/X99SyncMasterIntel ConnectionUbuntu 14.103.18.0-031800rc1-generic (x86_64)Unity 7.3.1X Server 1.16.0radeon 7.4.03.3 Mesa 10.3.0 Gallium 0.4GCC 4.9.1btrfs2560x1600ext4xfsf2fsAMD Phenom II X4 910e @ 2.60GHz (2 Cores)1024MB31GBDebian GNU/Linux 83.16.0-4-amd64 (x86_64)GCC 4.9.2ext4Xen 4.4.1-xs100654 HypervisorOpenBenchmarking.orgCompiler Details- Native Btrfs: RAID 0: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- Native Btrfs: RAID 1: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- Native Btrfs: RAID 10: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- Native Btrfs: RAID 5: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- Native Btrfs: RAID 6: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- mdadm Btrfs: RAID 0: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- mdadm Btrfs: RAID 1: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- mdadm Btrfs: RAID 10: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- mdadm Btrfs: RAID 5: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- mdadm Btrfs: RAID 6: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- mdadm EXT4: RAID 0: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- mdadm EXT4: RAID 1: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- mdadm EXT4: RAID 10: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- mdadm EXT4: RAID 5: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- mdadm EXT4: RAID 6: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- mdadm XFS: RAID 0: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- mdadm XFS: RAID 1: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- mdadm XFS: RAID 10: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- mdadm XFS: RAID 5: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- mdadm XFS: RAID 6: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- mdadm F2FS: RAID 0: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- mdadm F2FS: RAID 1: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- mdadm F2FS: RAID 10: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- mdadm F2FS: RAID 5: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- mdadm F2FS: RAID 6: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- Glusterfs-1G on XFS SSD via NFS-1G: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i586 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- Glusterfs-1G on XFS SSD via NFG-1G noop: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i586 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- Glusterfs-1G on XFS SSD via NFS-1G deadline tuned: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i586 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -vDisk Details- Native Btrfs: RAID 0: DEADLINE / relatime,rw,space_cache,ssd- Native Btrfs: RAID 1: DEADLINE / relatime,rw,space_cache,ssd- Native Btrfs: RAID 10: DEADLINE / relatime,rw,space_cache,ssd- Native Btrfs: RAID 5: DEADLINE / relatime,rw,space_cache,ssd- Native Btrfs: RAID 6: DEADLINE / relatime,rw,space_cache,ssd- mdadm Btrfs: RAID 0: DEADLINE / relatime,rw,space_cache- mdadm Btrfs: RAID 1: DEADLINE / relatime,rw,space_cache- mdadm Btrfs: RAID 10: DEADLINE / relatime,rw,space_cache- mdadm Btrfs: RAID 5: DEADLINE / relatime,rw,space_cache- mdadm Btrfs: RAID 6: DEADLINE / relatime,rw,space_cache- mdadm EXT4: RAID 0: DEADLINE / data=ordered,relatime,rw,stripe=512- mdadm EXT4: RAID 1: DEADLINE / data=ordered,relatime,rw- mdadm EXT4: RAID 10: DEADLINE / data=ordered,relatime,rw,stripe=256- mdadm EXT4: RAID 5: DEADLINE / data=ordered,relatime,rw,stripe=384- mdadm EXT4: RAID 6: DEADLINE / data=ordered,relatime,rw,stripe=256- mdadm XFS: RAID 0: DEADLINE / attr2,inode64,noquota,relatime,rw,sunit=1024,swidth=4096- mdadm XFS: RAID 1: DEADLINE / attr2,inode64,noquota,relatime,rw- mdadm XFS: RAID 10: DEADLINE / attr2,inode64,noquota,relatime,rw,sunit=1024,swidth=2048- mdadm XFS: RAID 5: DEADLINE / attr2,inode64,noquota,relatime,rw,sunit=1024,swidth=3072- mdadm XFS: RAID 6: DEADLINE / attr2,inode64,noquota,relatime,rw,sunit=1024,swidth=2048- mdadm F2FS: RAID 0: DEADLINE / acl,active_logs=6,background_gc=on,relatime,rw,user_xattr- mdadm F2FS: RAID 1: DEADLINE / acl,active_logs=6,background_gc=on,relatime,rw,user_xattr- mdadm F2FS: RAID 10: DEADLINE / acl,active_logs=6,background_gc=on,relatime,rw,user_xattr- mdadm F2FS: RAID 5: DEADLINE / acl,active_logs=6,background_gc=on,relatime,rw,user_xattr- mdadm F2FS: RAID 6: DEADLINE / acl,active_logs=6,background_gc=on,relatime,rw,user_xattr- Glusterfs-1G on XFS SSD via NFS-1G: CFQ / data=ordered,discard,noatime,rw- Glusterfs-1G on XFS SSD via NFG-1G noop: CFQ / data=ordered,discard,noatime,rw- Glusterfs-1G on XFS SSD via NFS-1G deadline tuned: CFQ / data=ordered,discard,noatime,rwProcessor Details- Native Btrfs: RAID 0, Native Btrfs: RAID 1, Native Btrfs: RAID 10, Native Btrfs: RAID 5, Native Btrfs: RAID 6, mdadm Btrfs: RAID 0, mdadm Btrfs: RAID 1, mdadm Btrfs: RAID 10, mdadm Btrfs: RAID 5, mdadm Btrfs: RAID 6, mdadm EXT4: RAID 0, mdadm EXT4: RAID 1, mdadm EXT4: RAID 10, mdadm EXT4: RAID 5, mdadm EXT4: RAID 6, mdadm XFS: RAID 0, mdadm XFS: RAID 1, mdadm XFS: RAID 10, mdadm XFS: RAID 5, mdadm XFS: RAID 6, mdadm F2FS: RAID 0, mdadm F2FS: RAID 1, mdadm F2FS: RAID 10, mdadm F2FS: RAID 5, mdadm F2FS: RAID 6: Scaling Governor: intel_pstate powersaveSystem Details- Native Btrfs: RAID 0: Disk Scheduler: DEADLINE. Python 2.7.8.- Native Btrfs: RAID 1: Disk Scheduler: DEADLINE. Python 2.7.8.- Native Btrfs: RAID 10: Disk Scheduler: DEADLINE. Python 2.7.8.- Native Btrfs: RAID 5: Disk Scheduler: DEADLINE. Python 2.7.8.- Native Btrfs: RAID 6: Disk Scheduler: DEADLINE. Python 2.7.8.- mdadm Btrfs: RAID 0: Disk Scheduler: DEADLINE. Python 2.7.8.- mdadm Btrfs: RAID 1: Disk Scheduler: DEADLINE. Python 2.7.8.- mdadm Btrfs: RAID 10: Disk Scheduler: DEADLINE. Python 2.7.8.- mdadm Btrfs: RAID 5: Disk Scheduler: DEADLINE. Python 2.7.8.- mdadm Btrfs: RAID 6: Disk Scheduler: DEADLINE. Python 2.7.8.- mdadm EXT4: RAID 0: Disk Scheduler: DEADLINE. Python 2.7.8.- mdadm EXT4: RAID 1: Disk Scheduler: DEADLINE. Python 2.7.8.- mdadm EXT4: RAID 10: Disk Scheduler: DEADLINE. Python 2.7.8.- mdadm EXT4: RAID 5: Disk Scheduler: DEADLINE. Python 2.7.8.- mdadm EXT4: RAID 6: Disk Scheduler: DEADLINE. Python 2.7.8.- mdadm XFS: RAID 0: Disk Scheduler: DEADLINE. Python 2.7.8.- mdadm XFS: RAID 1: Disk Scheduler: DEADLINE. Python 2.7.8.- mdadm XFS: RAID 10: Disk Scheduler: DEADLINE. Python 2.7.8.- mdadm XFS: RAID 5: Disk Scheduler: DEADLINE. Python 2.7.8.- mdadm XFS: RAID 6: Disk Scheduler: DEADLINE. Python 2.7.8.- mdadm F2FS: RAID 0: Disk Scheduler: DEADLINE. Python 2.7.8.- mdadm F2FS: RAID 1: Disk Scheduler: DEADLINE. Python 2.7.8.- mdadm F2FS: RAID 10: Disk Scheduler: DEADLINE. Python 2.7.8.- mdadm F2FS: RAID 5: Disk Scheduler: DEADLINE. Python 2.7.8.- mdadm F2FS: RAID 6: Disk Scheduler: DEADLINE. Python 2.7.8.- Glusterfs-1G on XFS SSD via NFS-1G: Disk Scheduler: CFQ. Python 2.7.9.- Glusterfs-1G on XFS SSD via NFG-1G noop: Disk Scheduler: CFQ. Python 2.7.9.- Glusterfs-1G on XFS SSD via NFS-1G deadline tuned: Disk Scheduler: CFQ. Python 2.7.9.

Ubuntu Linux RAID 0/1/5/6/10 Disk Testingcompilebench: Initial Createfio: Rand Read - Libaio - No - 16KB - Default Test Directory - MB/sfio: Rand Write - Libaio - No - 16KB - Default Test Directory - MB/sfio: Seq Read - Libaio - No - 16KB - Default Test Directory - MB/sfio: Seq Write - Libaio - No - 16KB - Default Test Directory - MB/sfs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizeiozone: 4Kb - 8GB - Write PerformanceNative Btrfs: RAID 0Native Btrfs: RAID 1Native Btrfs: RAID 10Native Btrfs: RAID 5Native Btrfs: RAID 6mdadm Btrfs: RAID 0mdadm Btrfs: RAID 1mdadm Btrfs: RAID 10mdadm Btrfs: RAID 5mdadm Btrfs: RAID 6mdadm EXT4: RAID 0mdadm EXT4: RAID 1mdadm EXT4: RAID 10mdadm EXT4: RAID 5mdadm EXT4: RAID 6mdadm XFS: RAID 0mdadm XFS: RAID 1mdadm XFS: RAID 10mdadm XFS: RAID 5mdadm XFS: RAID 6mdadm F2FS: RAID 0mdadm F2FS: RAID 1mdadm F2FS: RAID 10mdadm F2FS: RAID 5mdadm F2FS: RAID 6Glusterfs-1G on XFS SSD via NFS-1GGlusterfs-1G on XFS SSD via NFG-1G noopGlusterfs-1G on XFS SSD via NFS-1G deadline tuned206.74758.26497.23824.97319.4141.4383.7340.731142.43187.72233.00128.00323.80130.3235.1069.0335.63584.85177.54469.10267.48450.78272.1938.3377.0738.50599.32189.59742.06248.93869.68242.5538.8779.8739.17876.77195.02653.54214.56960.89208.9638.2075.4737.73598.43178.31816.02381.45385.3439.6092.0039.431141.18160.58224.69109.22854.98109.9734.0364.0033.43280.39156.97695.44159.53843.68161.9037.8075.6036.93478.65156.21792.61214.31879.09209.6033.3764.7332.10438.55151.64909.98179.73925.05172.7230.4356.8030.63315.85325.18818.33421.37508.7338.9790.4038.731111.26303.04214.45110.32303.30115.3433.9099.5734.80302.75306.37684.95163.86199.9537.0378.1336.80585.30316.17689.39146.07957.59192.8031.1084.0731441.27320.82854.92134.18155.7832.2770.4332.00385.39264.38841.97393.49398.7442.4388.7340.731111.56228.19236.43115.51301.16115.8234.0768.9032.77303.50228.20384.53166.75214.9439.5781.7035.83588.42255.99751.77151.05197.1932.1058.1030.33580.95271.62928.27129.62154.1030.9353.8329.23473.17331.33872.84387.04419.2965.8786.5766.401100.42328.79239.73109.58299.58113.3553.5080.6353.57303.32352.47741.30177.32200.3662.8777.9761.30566.14377.77736.18149.41196.7856.3775.5052.47421.86348.76916.30131.26997.53152.5350.7367.8351.40350.8414.8971.7413.50112.6922.2311.7219.4314.8212.9716.0070.2113.26113.5722.0312.0014.2011.288.7716.4369.7213.60112.5822.2811.1514.2711.688.44OpenBenchmarking.org

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial Createmdadm F2FS: RAID 5mdadm F2FS: RAID 10mdadm F2FS: RAID 6mdadm F2FS: RAID 0mdadm F2FS: RAID 1mdadm EXT4: RAID 0mdadm EXT4: RAID 6mdadm EXT4: RAID 5mdadm EXT4: RAID 10mdadm EXT4: RAID 1mdadm XFS: RAID 6mdadm XFS: RAID 0mdadm XFS: RAID 5mdadm XFS: RAID 10mdadm XFS: RAID 1Native Btrfs: RAID 0Native Btrfs: RAID 6Native Btrfs: RAID 5Native Btrfs: RAID 1mdadm Btrfs: RAID 0Native Btrfs: RAID 10mdadm Btrfs: RAID 1mdadm Btrfs: RAID 10mdadm Btrfs: RAID 5mdadm Btrfs: RAID 6Glusterfs-1G on XFS SSD via NFS-1G deadline tunedGlusterfs-1G on XFS SSD via NFG-1G noopGlusterfs-1G on XFS SSD via NFS-1G80160240320400SE +/- 8.55, N = 6SE +/- 19.79, N = 6SE +/- 1.51, N = 3SE +/- 15.41, N = 6SE +/- 21.66, N = 6SE +/- 3.29, N = 3SE +/- 5.64, N = 6SE +/- 2.02, N = 3SE +/- 5.36, N = 6SE +/- 7.03, N = 6SE +/- 1.18, N = 3SE +/- 3.82, N = 3SE +/- 7.74, N = 6SE +/- 4.97, N = 6SE +/- 0.77, N = 3SE +/- 3.10, N = 3SE +/- 2.89, N = 3SE +/- 9.32, N = 3SE +/- 9.02, N = 3SE +/- 3.07, N = 4SE +/- 0.81, N = 3SE +/- 1.16, N = 3SE +/- 2.90, N = 6SE +/- 3.51, N = 6SE +/- 5.10, N = 6SE +/- 1.52, N = 6SE +/- 1.79, N = 5SE +/- 2.89, N = 3377.77352.47348.76331.33328.79325.18320.82316.17306.37303.04271.62264.38255.99228.20228.19206.74195.02189.59187.72178.31177.54160.58156.97156.21151.6416.4316.0014.89

Flexible IO Tester

Type: Random Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.11Type: Random Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/smdadm XFS: RAID 6mdadm F2FS: RAID 6mdadm Btrfs: RAID 6mdadm F2FS: RAID 0mdadm EXT4: RAID 6mdadm XFS: RAID 0mdadm EXT4: RAID 0mdadm Btrfs: RAID 0mdadm Btrfs: RAID 5Native Btrfs: RAID 0mdadm XFS: RAID 5Native Btrfs: RAID 5mdadm F2FS: RAID 10mdadm F2FS: RAID 5mdadm Btrfs: RAID 10mdadm EXT4: RAID 5mdadm EXT4: RAID 10Native Btrfs: RAID 6Native Btrfs: RAID 10mdadm XFS: RAID 10mdadm F2FS: RAID 1mdadm XFS: RAID 1Native Btrfs: RAID 1mdadm Btrfs: RAID 1mdadm EXT4: RAID 1Glusterfs-1G on XFS SSD via NFS-1GGlusterfs-1G on XFS SSD via NFG-1G noopGlusterfs-1G on XFS SSD via NFS-1G deadline tuned2004006008001000SE +/- 3.92, N = 3SE +/- 0.71, N = 3SE +/- 0.40, N = 3SE +/- 0.65, N = 3SE +/- 11.08, N = 3SE +/- 1.37, N = 3SE +/- 2.16, N = 3SE +/- 5.75, N = 3SE +/- 1.74, N = 3SE +/- 23.17, N = 6SE +/- 1.14, N = 3SE +/- 52.17, N = 6SE +/- 0.23, N = 3SE +/- 8.91, N = 3SE +/- 10.68, N = 4SE +/- 6.99, N = 3SE +/- 7.97, N = 3SE +/- 67.86, N = 6SE +/- 10.47, N = 6SE +/- 0.09, N = 3SE +/- 0.15, N = 3SE +/- 0.11, N = 3SE +/- 0.84, N = 3SE +/- 0.93, N = 3SE +/- 1.17, N = 3SE +/- 1.18, N = 4SE +/- 2.60, N = 6SE +/- 2.45, N = 6928.27916.30909.98872.84854.92841.97818.33816.02792.61758.26751.77742.06741.30736.18695.44689.39684.95653.54469.10384.53239.73236.43233.00224.69214.4571.7470.2169.721. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.11Type: Random Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/sNative Btrfs: RAID 0mdadm EXT4: RAID 0mdadm XFS: RAID 0mdadm F2FS: RAID 0mdadm Btrfs: RAID 0Native Btrfs: RAID 10Native Btrfs: RAID 5Native Btrfs: RAID 6mdadm Btrfs: RAID 5mdadm Btrfs: RAID 6mdadm F2FS: RAID 10mdadm XFS: RAID 10mdadm EXT4: RAID 10mdadm Btrfs: RAID 10mdadm XFS: RAID 5mdadm F2FS: RAID 5mdadm EXT4: RAID 5mdadm EXT4: RAID 6mdadm F2FS: RAID 6mdadm XFS: RAID 6Native Btrfs: RAID 1mdadm XFS: RAID 1mdadm EXT4: RAID 1mdadm F2FS: RAID 1mdadm Btrfs: RAID 1Glusterfs-1G on XFS SSD via NFS-1G deadline tunedGlusterfs-1G on XFS SSD via NFS-1GGlusterfs-1G on XFS SSD via NFG-1G noop110220330440550SE +/- 13.92, N = 6SE +/- 8.96, N = 6SE +/- 2.43, N = 3SE +/- 6.30, N = 6SE +/- 2.87, N = 3SE +/- 2.33, N = 3SE +/- 3.37, N = 6SE +/- 2.95, N = 6SE +/- 1.15, N = 3SE +/- 1.22, N = 3SE +/- 1.42, N = 3SE +/- 2.20, N = 3SE +/- 1.01, N = 3SE +/- 2.15, N = 3SE +/- 0.17, N = 3SE +/- 0.27, N = 3SE +/- 0.72, N = 3SE +/- 2.63, N = 3SE +/- 1.94, N = 3SE +/- 1.90, N = 3SE +/- 0.39, N = 3SE +/- 0.58, N = 3SE +/- 1.68, N = 3SE +/- 2.03, N = 6SE +/- 2.01, N = 3SE +/- 0.20, N = 6SE +/- 0.31, N = 6SE +/- 0.27, N = 6497.23421.37393.49387.04381.45267.48248.93214.56214.31179.73177.32166.75163.86159.53151.05149.41146.07134.18131.26129.62128.00115.51110.32109.58109.2213.6013.5013.261. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.11Type: Sequential Read - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/smdadm F2FS: RAID 6Native Btrfs: RAID 6mdadm EXT4: RAID 5mdadm Btrfs: RAID 6mdadm Btrfs: RAID 5Native Btrfs: RAID 5mdadm Btrfs: RAID 1mdadm Btrfs: RAID 10Native Btrfs: RAID 0Native Btrfs: RAID 10Native Btrfs: RAID 1mdadm EXT4: RAID 1mdadm XFS: RAID 1mdadm F2FS: RAID 1Glusterfs-1G on XFS SSD via NFG-1G noopGlusterfs-1G on XFS SSD via NFS-1GGlusterfs-1G on XFS SSD via NFS-1G deadline tuned2004006008001000SE +/- 0.47, N = 2SE +/- 8.58, N = 3SE +/- 3.56, N = 3SE +/- 4.21, N = 3SE +/- 17.12, N = 6SE +/- 40.14, N = 6SE +/- 7.66, N = 3SE +/- 12.79, N = 6SE +/- 22.85, N = 6SE +/- 1.47, N = 3SE +/- 0.96, N = 3SE +/- 0.41, N = 3SE +/- 0.11, N = 3SE +/- 0.21, N = 3SE +/- 0.08, N = 3SE +/- 0.53, N = 3SE +/- 0.81, N = 3997.53960.89957.59925.05879.09869.68854.98843.68824.97450.78323.80303.30301.16299.58113.57112.69112.58-lz-lz-lz-lz-lz-lz-lz-lz-lz-lz-lz-lz-lz-lz1. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/s

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.11Type: Sequential Write - IO Engine: Libaio - Buffered: No - Block Size: 16KB - Disk Target: Default Test Directory - Result: MB/smdadm EXT4: RAID 0mdadm F2FS: RAID 0mdadm XFS: RAID 0mdadm Btrfs: RAID 0Native Btrfs: RAID 0Native Btrfs: RAID 10Native Btrfs: RAID 5mdadm XFS: RAID 10mdadm Btrfs: RAID 5Native Btrfs: RAID 6mdadm F2FS: RAID 10mdadm EXT4: RAID 10mdadm XFS: RAID 5mdadm F2FS: RAID 5mdadm EXT4: RAID 5mdadm Btrfs: RAID 6mdadm Btrfs: RAID 10mdadm EXT4: RAID 6mdadm XFS: RAID 6mdadm F2FS: RAID 6Native Btrfs: RAID 1mdadm XFS: RAID 1mdadm EXT4: RAID 1mdadm F2FS: RAID 1mdadm Btrfs: RAID 1Glusterfs-1G on XFS SSD via NFS-1G deadline tunedGlusterfs-1G on XFS SSD via NFS-1GGlusterfs-1G on XFS SSD via NFG-1G noop110220330440550SE +/- 3.94, N = 3SE +/- 4.92, N = 3SE +/- 1.66, N = 3SE +/- 2.45, N = 3SE +/- 3.82, N = 3SE +/- 0.90, N = 3SE +/- 0.41, N = 3SE +/- 4.61, N = 6SE +/- 0.53, N = 3SE +/- 1.21, N = 3SE +/- 0.29, N = 3SE +/- 0.95, N = 3SE +/- 0.31, N = 3SE +/- 1.25, N = 3SE +/- 0.41, N = 3SE +/- 1.40, N = 3SE +/- 1.02, N = 3SE +/- 0.87, N = 3SE +/- 0.31, N = 3SE +/- 1.37, N = 3SE +/- 2.46, N = 6SE +/- 1.29, N = 3SE +/- 1.61, N = 3SE +/- 2.04, N = 3SE +/- 1.26, N = 3SE +/- 0.34, N = 6SE +/- 0.46, N = 6SE +/- 0.35, N = 6508.73419.29398.74385.34319.41272.19242.55214.94209.60208.96200.36199.95197.19196.78192.80172.72161.90155.78154.10152.53130.32115.82115.34113.35109.9722.2822.2322.031. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl

FS-Mark

Test: 1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Sizemdadm F2FS: RAID 0mdadm F2FS: RAID 10mdadm F2FS: RAID 5mdadm F2FS: RAID 1mdadm F2FS: RAID 6mdadm XFS: RAID 0Native Btrfs: RAID 0mdadm Btrfs: RAID 0mdadm XFS: RAID 10mdadm EXT4: RAID 0Native Btrfs: RAID 5Native Btrfs: RAID 10Native Btrfs: RAID 6mdadm Btrfs: RAID 10mdadm EXT4: RAID 10Native Btrfs: RAID 1mdadm XFS: RAID 1mdadm Btrfs: RAID 1mdadm EXT4: RAID 1mdadm Btrfs: RAID 5mdadm EXT4: RAID 6mdadm XFS: RAID 5mdadm EXT4: RAID 5mdadm XFS: RAID 6mdadm Btrfs: RAID 6Glusterfs-1G on XFS SSD via NFG-1G noopGlusterfs-1G on XFS SSD via NFS-1GGlusterfs-1G on XFS SSD via NFS-1G deadline tuned1530456075SE +/- 0.26, N = 3SE +/- 0.55, N = 3SE +/- 0.74, N = 3SE +/- 0.36, N = 3SE +/- 0.23, N = 3SE +/- 0.68, N = 3SE +/- 0.28, N = 3SE +/- 0.23, N = 3SE +/- 0.24, N = 3SE +/- 0.03, N = 3SE +/- 0.17, N = 3SE +/- 0.32, N = 3SE +/- 0.06, N = 3SE +/- 0.21, N = 3SE +/- 0.22, N = 3SE +/- 0.06, N = 3SE +/- 0.12, N = 3SE +/- 0.19, N = 3SE +/- 0.17, N = 3SE +/- 0.13, N = 3SE +/- 0.18, N = 3SE +/- 0.15, N = 3SE +/- 0.06, N = 3SE +/- 0.12, N = 3SE +/- 0.35, N = 3SE +/- 1.74, N = 6SE +/- 1.49, N = 6SE +/- 1.86, N = 665.8762.8756.3753.5050.7342.4341.4339.6039.5738.9738.8738.3338.2037.8037.0335.1034.0734.0333.9033.3732.2732.1031.1030.9330.4312.0011.7211.151. (CC) gcc options: -static

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 Threadsmdadm EXT4: RAID 1mdadm Btrfs: RAID 0mdadm EXT4: RAID 0mdadm XFS: RAID 0mdadm F2FS: RAID 0mdadm EXT4: RAID 5Native Btrfs: RAID 0mdadm XFS: RAID 10mdadm F2FS: RAID 1Native Btrfs: RAID 5mdadm EXT4: RAID 10mdadm F2FS: RAID 10Native Btrfs: RAID 10mdadm Btrfs: RAID 10mdadm F2FS: RAID 5Native Btrfs: RAID 6mdadm EXT4: RAID 6Native Btrfs: RAID 1mdadm XFS: RAID 1mdadm F2FS: RAID 6mdadm Btrfs: RAID 5mdadm Btrfs: RAID 1mdadm XFS: RAID 5mdadm Btrfs: RAID 6mdadm XFS: RAID 6Glusterfs-1G on XFS SSD via NFS-1GGlusterfs-1G on XFS SSD via NFS-1G deadline tunedGlusterfs-1G on XFS SSD via NFG-1G noop20406080100SE +/- 1.92, N = 3SE +/- 0.12, N = 3SE +/- 0.40, N = 3SE +/- 0.92, N = 3SE +/- 0.58, N = 3SE +/- 0.73, N = 3SE +/- 0.35, N = 3SE +/- 0.56, N = 3SE +/- 1.33, N = 3SE +/- 0.13, N = 3SE +/- 1.14, N = 3SE +/- 0.43, N = 3SE +/- 0.13, N = 3SE +/- 0.15, N = 3SE +/- 0.26, N = 3SE +/- 0.27, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.36, N = 3SE +/- 0.35, N = 3SE +/- 0.12, N = 3SE +/- 0.51, N = 3SE +/- 0.12, N = 3SE +/- 0.17, N = 3SE +/- 0.38, N = 3SE +/- 0.60, N = 6SE +/- 0.81, N = 3SE +/- 0.64, N = 399.5792.0090.4088.7386.5784.0783.7381.7080.6379.8778.1377.9777.0775.6075.5075.4770.4369.0368.9067.8364.7364.0058.1056.8053.8319.4314.2714.201. (CC) gcc options: -static

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB Sizemdadm F2FS: RAID 0mdadm F2FS: RAID 10mdadm F2FS: RAID 1mdadm F2FS: RAID 5mdadm F2FS: RAID 6mdadm XFS: RAID 0Native Btrfs: RAID 0mdadm Btrfs: RAID 0Native Btrfs: RAID 5mdadm EXT4: RAID 0Native Btrfs: RAID 10Native Btrfs: RAID 6mdadm Btrfs: RAID 10mdadm EXT4: RAID 10mdadm XFS: RAID 10Native Btrfs: RAID 1mdadm EXT4: RAID 1mdadm Btrfs: RAID 1mdadm XFS: RAID 1mdadm Btrfs: RAID 5mdadm EXT4: RAID 6mdadm EXT4: RAID 5mdadm Btrfs: RAID 6mdadm XFS: RAID 5mdadm XFS: RAID 6Glusterfs-1G on XFS SSD via NFS-1GGlusterfs-1G on XFS SSD via NFS-1G deadline tunedGlusterfs-1G on XFS SSD via NFG-1G noop1530456075SE +/- 0.35, N = 3SE +/- 0.10, N = 3SE +/- 0.27, N = 3SE +/- 0.30, N = 3SE +/- 0.32, N = 3SE +/- 0.19, N = 3SE +/- 0.03, N = 3SE +/- 0.18, N = 3SE +/- 0.28, N = 3SE +/- 0.03, N = 3SE +/- 0.25, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.13, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.39, N = 3SE +/- 0.15, N = 3SE +/- 0.06, N = 3SE +/- 0.00, N = 3SE +/- 0.09, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.60, N = 6SE +/- 0.94, N = 6SE +/- 0.89, N = 666.4061.3053.5752.4751.4040.7340.7339.4339.1738.7338.5037.7336.9336.8035.8335.6334.8033.4332.7732.1032.0031.0030.6330.3329.2314.8211.6811.281. (CC) gcc options: -static

IOzone

Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.405Record Size: 4Kb - File Size: 8GB - Disk Test: Write PerformanceNative Btrfs: RAID 0mdadm Btrfs: RAID 0mdadm XFS: RAID 0mdadm EXT4: RAID 0mdadm F2FS: RAID 0Native Btrfs: RAID 5Native Btrfs: RAID 10Native Btrfs: RAID 6mdadm XFS: RAID 10mdadm EXT4: RAID 10Native Btrfs: RAID 1mdadm XFS: RAID 5mdadm F2FS: RAID 10mdadm Btrfs: RAID 10mdadm XFS: RAID 6mdadm EXT4: RAID 5mdadm Btrfs: RAID 5mdadm F2FS: RAID 5mdadm EXT4: RAID 6mdadm F2FS: RAID 6mdadm Btrfs: RAID 6mdadm XFS: RAID 1mdadm F2FS: RAID 1mdadm EXT4: RAID 1mdadm Btrfs: RAID 1Glusterfs-1G on XFS SSD via NFS-1GGlusterfs-1G on XFS SSD via NFG-1G noopGlusterfs-1G on XFS SSD via NFS-1G deadline tuned2004006008001000SE +/- 1.16, N = 3SE +/- 0.69, N = 3SE +/- 1.99, N = 3SE +/- 0.49, N = 3SE +/- 1.50, N = 3SE +/- 0.45, N = 3SE +/- 0.36, N = 3SE +/- 0.24, N = 3SE +/- 2.01, N = 3SE +/- 1.24, N = 3SE +/- 3.64, N = 3SE +/- 4.49, N = 3SE +/- 7.47, N = 3SE +/- 4.18, N = 3SE +/- 5.02, N = 3SE +/- 7.85, N = 3SE +/- 1.44, N = 3SE +/- 1.58, N = 3SE +/- 3.28, N = 3SE +/- 1.54, N = 3SE +/- 1.48, N = 3SE +/- 0.37, N = 3SE +/- 2.04, N = 3SE +/- 0.76, N = 3SE +/- 0.22, N = 3SE +/- 7.27, N = 3SE +/- 4.81, N = 3SE +/- 5.53, N = 31142.431141.181111.561111.261100.42876.77599.32598.43588.42585.30584.85580.95566.14478.65473.17441.27438.55421.86385.39350.84315.85303.50303.32302.75280.3912.978.778.441. (CC) gcc options: -O3

Phoronix Test Suite v10.8.4