Btrfs RAID, EXT4 MD RAID 4 x SSD Linux Tests

Btrfs RAID and EXT4 MDADM RAID tests on Linux 4.15 for a future article on Phoronix.

HTML result view exported from: https://openbenchmarking.org/result/1802206-FO-1712183AL80&grt&sor.

Btrfs RAID, EXT4 MD RAID 4 x SSD Linux TestsProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay DriverCompilerFile-SystemScreen ResolutionBtrfs 1 DiskBtrfs 2 Disk RAID0Btrfs 2 Disk RAID1Btrfs 4 Disk RAID0Btrfs 4 Disk RAID1Btrfs 4 Disk RAID10Btrfs 4 Disk RAID5Btrfs 4 Disk RAID6EXT4 1 DiskEXT4 2 Disk RAID1EXT4 2 Disk RAID0EXT4 4 Disk RAID0EXT4 4 Disk RAID1EXT4 4 Disk RAID5EXT4 4 Disk RAID6EXT4 4 Disk RAID10test1test2nvme_ext4_raid2nvme_xfs_raid2Intel Xeon Silver 4108 @ 3.00GHz (8 Cores / 16 Threads)TYAN S7100AG2NRIntel Device 20206 x 4096 MB DDR4-2400MHz Micron 9ASF51272PZ-2G6B14 x 120GB ADATA SU700 + 240GB Force MP500ASPEED ASPEED FamilyRealtek ALC892VE228Intel I350 Gigabit ConnectionUbuntu 17.044.15.0-999-generic (x86_64) 20171212Unity 7.5.0modesetting 1.19.3GCC 6.3.0 20170406btrfs1920x1080Unity 7.5.0ext42 x Intel Xeon E5-2690 v4 @ 3.50GHz (28 Cores / 56 Threads)Supermicro X10DRW-iT v1.10 (2.0b BIOS)Intel Xeon E7 v4/Xeon16 x 64 GB DDR4-2400MT/s Samsung M386A8K40BM1-CRC240GB SMC3108 + 4 x 1920GB SMC3108 + 2 x 1024GB SAMSUNG MZVKW1T0HMLH-00000Intel 10-Gigabit X540-AT2Fedora 274.15.3-300.fc27.x86_64 (x86_64)GCC 7.3.1 20180130btrfs1024x768ext4xfsOpenBenchmarking.orgCompiler Details- Btrfs 1 Disk: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - Btrfs 2 Disk RAID0: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - Btrfs 2 Disk RAID1: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - Btrfs 4 Disk RAID0: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - Btrfs 4 Disk RAID1: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - Btrfs 4 Disk RAID10: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - Btrfs 4 Disk RAID5: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - Btrfs 4 Disk RAID6: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - EXT4 1 Disk: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - EXT4 2 Disk RAID1: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - EXT4 2 Disk RAID0: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - EXT4 4 Disk RAID0: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - EXT4 4 Disk RAID1: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - EXT4 4 Disk RAID5: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - EXT4 4 Disk RAID6: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - EXT4 4 Disk RAID10: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - test1: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,fortran,ada,go,lto --enable-libmpx --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=i686 --with-gcc-major-version-only --with-isl --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver - test2: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,fortran,ada,go,lto --enable-libmpx --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=i686 --with-gcc-major-version-only --with-isl --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver - nvme_ext4_raid2: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,fortran,ada,go,lto --enable-libmpx --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=i686 --with-gcc-major-version-only --with-isl --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver - nvme_xfs_raid2: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,fortran,ada,go,lto --enable-libmpx --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=i686 --with-gcc-major-version-only --with-isl --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver Disk Details- Btrfs 1 Disk: NONE / data=ordered,errors=remount-ro,relatime,rw- Btrfs 2 Disk RAID0: NONE / data=ordered,errors=remount-ro,relatime,rw- Btrfs 2 Disk RAID1: NONE / data=ordered,errors=remount-ro,relatime,rw- Btrfs 4 Disk RAID0: NONE / data=ordered,errors=remount-ro,relatime,rw- Btrfs 4 Disk RAID1: NONE / data=ordered,errors=remount-ro,relatime,rw- Btrfs 4 Disk RAID10: NONE / data=ordered,errors=remount-ro,relatime,rw- Btrfs 4 Disk RAID5: NONE / data=ordered,errors=remount-ro,relatime,rw- Btrfs 4 Disk RAID6: NONE / data=ordered,errors=remount-ro,relatime,rw- EXT4 1 Disk: NONE / data=ordered,errors=remount-ro,relatime,rw- EXT4 2 Disk RAID1: NONE / data=ordered,errors=remount-ro,relatime,rw- EXT4 2 Disk RAID0: NONE / data=ordered,errors=remount-ro,relatime,rw- EXT4 4 Disk RAID0: NONE / data=ordered,errors=remount-ro,relatime,rw- EXT4 4 Disk RAID1: NONE / data=ordered,errors=remount-ro,relatime,rw- EXT4 4 Disk RAID5: NONE / data=ordered,errors=remount-ro,relatime,rw- EXT4 4 Disk RAID6: NONE / data=ordered,errors=remount-ro,relatime,rw- EXT4 4 Disk RAID10: NONE / data=ordered,errors=remount-ro,relatime,rw- test1: CFQ / relatime,rw,seclabel,space_cache,subvol=/root,subvolid=257- test2: CFQ / relatime,rw,seclabel,space_cache,subvol=/root,subvolid=257- nvme_ext4_raid2: CFQ / relatime,rw,seclabel,space_cache,subvol=/root,subvolid=257- nvme_xfs_raid2: CFQ / relatime,rw,seclabel,space_cache,subvol=/root,subvolid=257Processor Details- Btrfs 1 Disk: Scaling Governor: intel_pstate powersave- Btrfs 2 Disk RAID0: Scaling Governor: intel_pstate powersave- Btrfs 2 Disk RAID1: Scaling Governor: intel_pstate powersave- Btrfs 4 Disk RAID0: Scaling Governor: intel_pstate powersave- Btrfs 4 Disk RAID1: Scaling Governor: intel_pstate powersave- Btrfs 4 Disk RAID10: Scaling Governor: intel_pstate powersave- Btrfs 4 Disk RAID5: Scaling Governor: intel_pstate powersave- Btrfs 4 Disk RAID6: Scaling Governor: intel_pstate powersave- EXT4 1 Disk: Scaling Governor: intel_pstate powersave- EXT4 2 Disk RAID1: Scaling Governor: intel_pstate powersave- EXT4 2 Disk RAID0: Scaling Governor: intel_pstate powersave- EXT4 4 Disk RAID0: Scaling Governor: intel_pstate powersave- EXT4 4 Disk RAID1: Scaling Governor: intel_pstate powersave- EXT4 4 Disk RAID5: Scaling Governor: intel_pstate powersave- EXT4 4 Disk RAID6: Scaling Governor: intel_pstate powersave- EXT4 4 Disk RAID10: Scaling Governor: intel_pstate powersave- test1: Scaling Governor: intel_pstate performance- test2: Scaling Governor: intel_pstate performance- nvme_ext4_raid2: Scaling Governor: intel_pstate performance- nvme_xfs_raid2: Scaling Governor: intel_pstate performanceSecurity Details- test1, test2, nvme_ext4_raid2, nvme_xfs_raid2: SELinux + KPTI + __user pointer sanitization + Full generic retpoline Protection

Btrfs RAID, EXT4 MD RAID 4 x SSD Linux Testsblogbench: Readblogbench: Writedbench: 12fio: Rand Read - Libaio - No - Yes - 4KB - Default Test Directoryfio: Rand Write - Libaio - No - Yes - 4KB - Default Test Directoryfio: Seq Read - Libaio - No - Yes - 4KB - Default Test Directoryfio: Seq Write - Libaio - No - Yes - 4KB - Default Test Directoryfs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizeiozone: 4Kb - 8GB - Write Performancepgbench: Mostly RAM - Normal Load - Read Writesqlite: Default Test DirectoryBtrfs 1 DiskBtrfs 2 Disk RAID0Btrfs 2 Disk RAID1Btrfs 4 Disk RAID0Btrfs 4 Disk RAID1Btrfs 4 Disk RAID10Btrfs 4 Disk RAID5Btrfs 4 Disk RAID6EXT4 1 DiskEXT4 2 Disk RAID1EXT4 2 Disk RAID0EXT4 4 Disk RAID0EXT4 4 Disk RAID1EXT4 4 Disk RAID5EXT4 4 Disk RAID6EXT4 4 Disk RAID10test1test2nvme_ext4_raid2nvme_xfs_raid224023925079291.84124.3682.35109.2581.37133.87148.15131.4037.97881.0860.9023727355746309.27220.6664.76234.6469.23187.30322.97180.0376.161133.6359.2123882274773289.99124.1074.21123.4069.42140.87169.60133.8346.52628.3564.9324006755732328.55292.7066.17302.9361.04189.18445.50206.00900.571643.8962.1023630395397314.25241.6140.61188.2947.71137.77190.00132.33182.491642.7166.7323591055577348.16221.6434.41197.0443.08177.53287.30164.07142.131041.8566.9123263415136311.67384.5468.31402.8672.47124.42280.90135.73114.481370.47140.2721621154655302.24367.5468.21323.4873.17138.18258.10146.9375.62684.05139.0824775104212218.25123.76167.2476.04213.91119.1364.6741.3548.721086.0527.7424176064825160.56245.7133.5776.7036.7328.7335.4729.7543.68760.78394.4823890945610374.87242.12245.04144.92103.3771.9379.8753.13103.421771.2337.7215778708724605.34455.50279.03143.94171.16101.43175.33101.37168.871729.7741.222361663469291.30458.9235.4182.3033.0921.9327.0028.2342.090.10454.4225347796243129.00427.9625.93151.5033.2228.6052.1029.6780.431033.44418.5025854865135106.08416.8117.09196.7916.8924.8832.8038.4359.661020.35669.2423148837769302.57438.83116.34217.3471.2955.2070.2748.0094.161310.8748.2116.69351.91112.5217.10223589832810578.221150.801034.571152.831069.87151.40319.47147.671110.7750.8722693784936284.401169.90837.241169.60756.98137.37341.57139.23968.40234.7672.73OpenBenchmarking.org

BlogBench

Test: Read

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: ReadEXT4 4 Disk RAID6EXT4 4 Disk RAID5EXT4 1 DiskEXT4 2 Disk RAID1Btrfs 1 DiskBtrfs 4 Disk RAID0EXT4 2 Disk RAID0Btrfs 2 Disk RAID1Btrfs 2 Disk RAID0Btrfs 4 Disk RAID1EXT4 4 Disk RAID1Btrfs 4 Disk RAID10Btrfs 4 Disk RAID5EXT4 4 Disk RAID10nvme_xfs_raid2nvme_ext4_raid2Btrfs 4 Disk RAID6EXT4 4 Disk RAID0600K1200K1800K2400K3000KSE +/- 19996.16, N = 3SE +/- 20432.96, N = 3SE +/- 27696.50, N = 3SE +/- 53313.62, N = 6SE +/- 648.68, N = 3SE +/- 23301.34, N = 3SE +/- 13123.68, N = 3SE +/- 39766.83, N = 3SE +/- 15678.20, N = 3SE +/- 20419.15, N = 3SE +/- 59092.27, N = 6SE +/- 10253.07, N = 3SE +/- 18228.21, N = 3SE +/- 61488.72, N = 6SE +/- 24442.51, N = 3SE +/- 38736.50, N = 3SE +/- 7784.52, N = 3SE +/- 51904.97, N = 62585486253477924775102417606240239224006752389094238822723727352363039236166323591052326341231488322693782235898216211515778701. (CC) gcc options: -O2 -pthread

BlogBench

Test: Write

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: Writenvme_ext4_raid2EXT4 4 Disk RAID0EXT4 4 Disk RAID10EXT4 4 Disk RAID5Btrfs 2 Disk RAID0Btrfs 4 Disk RAID0EXT4 2 Disk RAID0Btrfs 4 Disk RAID10Btrfs 4 Disk RAID1Btrfs 4 Disk RAID5EXT4 4 Disk RAID6Btrfs 1 Disknvme_xfs_raid2EXT4 2 Disk RAID1Btrfs 2 Disk RAID1EXT4 4 Disk RAID1Btrfs 4 Disk RAID6EXT4 1 Disk7K14K21K28K35KSE +/- 2654.63, N = 3SE +/- 200.62, N = 3SE +/- 380.22, N = 3SE +/- 51.73, N = 3SE +/- 46.23, N = 3SE +/- 7.51, N = 3SE +/- 63.28, N = 3SE +/- 37.03, N = 3SE +/- 54.35, N = 3SE +/- 11.39, N = 3SE +/- 112.58, N = 3SE +/- 188.26, N = 3SE +/- 215.03, N = 3SE +/- 163.44, N = 3SE +/- 339.12, N = 3SE +/- 744.12, N = 3SE +/- 4.98, N = 3SE +/- 139.20, N = 332810872477696243574657325610557753975136513550794936482547734692465542121. (CC) gcc options: -O2 -pthread

Dbench

Client Count: 12

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 12EXT4 4 Disk RAID0nvme_ext4_raid2EXT4 2 Disk RAID0Btrfs 4 Disk RAID10Btrfs 4 Disk RAID0Btrfs 4 Disk RAID1Btrfs 4 Disk RAID5Btrfs 2 Disk RAID0EXT4 4 Disk RAID10Btrfs 4 Disk RAID6Btrfs 1 DiskBtrfs 2 Disk RAID1nvme_xfs_raid2EXT4 1 DiskEXT4 2 Disk RAID1EXT4 4 Disk RAID5EXT4 4 Disk RAID6EXT4 4 Disk RAID1130260390520650SE +/- 36.65, N = 6SE +/- 3.09, N = 3SE +/- 5.79, N = 5SE +/- 1.01, N = 3SE +/- 3.60, N = 3SE +/- 2.52, N = 3SE +/- 3.34, N = 3SE +/- 4.96, N = 3SE +/- 5.12, N = 6SE +/- 7.86, N = 6SE +/- 11.41, N = 6SE +/- 16.74, N = 6SE +/- 0.14, N = 3SE +/- 1.02, N = 3SE +/- 0.14, N = 3SE +/- 2.59, N = 3SE +/- 4.73, N = 6SE +/- 1.66, N = 6605.34578.22374.87348.16328.55314.25311.67309.27302.57302.24291.84289.99284.40218.25160.56129.00106.0891.301. (CC) gcc options: -lpopt -O2

Flexible IO Tester

Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directorynvme_xfs_raid2nvme_ext4_raid2EXT4 4 Disk RAID1EXT4 4 Disk RAID0EXT4 4 Disk RAID10EXT4 4 Disk RAID5EXT4 4 Disk RAID6Btrfs 4 Disk RAID5Btrfs 4 Disk RAID6test2Btrfs 4 Disk RAID0EXT4 2 Disk RAID1EXT4 2 Disk RAID0Btrfs 4 Disk RAID1Btrfs 4 Disk RAID10Btrfs 2 Disk RAID0Btrfs 1 DiskBtrfs 2 Disk RAID1EXT4 1 Disk30060090012001500SE +/- 13.12, N = 3SE +/- 8.28, N = 3SE +/- 0.88, N = 3SE +/- 0.78, N = 3SE +/- 0.94, N = 3SE +/- 3.22, N = 3SE +/- 1.68, N = 3SE +/- 1.91, N = 3SE +/- 3.21, N = 3SE +/- 0.22, N = 3SE +/- 1.21, N = 3SE +/- 0.05, N = 3SE +/- 0.18, N = 3SE +/- 0.39, N = 3SE +/- 0.50, N = 3SE +/- 0.41, N = 3SE +/- 0.02, N = 3SE +/- 0.40, N = 3SE +/- 0.15, N = 31169.901150.80458.92455.50438.83427.96416.81384.54367.54351.91292.70245.71242.12241.61221.64220.66124.36124.10123.76-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs1. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directorynvme_xfs_raid2nvme_ext4_raid2EXT4 4 Disk RAID1EXT4 4 Disk RAID0EXT4 4 Disk RAID10EXT4 4 Disk RAID5EXT4 4 Disk RAID6Btrfs 4 Disk RAID5Btrfs 4 Disk RAID6test2Btrfs 4 Disk RAID0EXT4 2 Disk RAID1EXT4 2 Disk RAID0Btrfs 4 Disk RAID1Btrfs 4 Disk RAID10Btrfs 2 Disk RAID0Btrfs 1 DiskBtrfs 2 Disk RAID1EXT4 1 Disk60K120K180K240K300KSE +/- 3343.93, N = 3SE +/- 2116.88, N = 3SE +/- 220.50, N = 3SE +/- 195.13, N = 3SE +/- 235.76, N = 3SE +/- 805.76, N = 3SE +/- 420.51, N = 3SE +/- 477.39, N = 3SE +/- 802.96, N = 3SE +/- 55.52, N = 3SE +/- 301.74, N = 3SE +/- 12.71, N = 3SE +/- 45.67, N = 3SE +/- 96.48, N = 3SE +/- 124.67, N = 3SE +/- 102.71, N = 3SE +/- 5.70, N = 3SE +/- 100.16, N = 3SE +/- 36.78, N = 3299445294592114726113870109704106986104198961329188187975731726142460527603995540655162310863102130936-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs1. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directorynvme_ext4_raid2nvme_xfs_raid2EXT4 4 Disk RAID0EXT4 2 Disk RAID0EXT4 1 DiskEXT4 4 Disk RAID10test2Btrfs 1 DiskBtrfs 2 Disk RAID1Btrfs 4 Disk RAID5Btrfs 4 Disk RAID6Btrfs 4 Disk RAID0Btrfs 2 Disk RAID0Btrfs 4 Disk RAID1EXT4 4 Disk RAID1Btrfs 4 Disk RAID10EXT4 2 Disk RAID1EXT4 4 Disk RAID5EXT4 4 Disk RAID62004006008001000SE +/- 3.72, N = 3SE +/- 2.66, N = 3SE +/- 33.90, N = 6SE +/- 29.62, N = 6SE +/- 0.08, N = 3SE +/- 19.68, N = 6SE +/- 8.36, N = 6SE +/- 1.16, N = 6SE +/- 1.65, N = 6SE +/- 3.00, N = 6SE +/- 2.71, N = 6SE +/- 4.30, N = 6SE +/- 1.65, N = 6SE +/- 2.63, N = 6SE +/- 0.15, N = 3SE +/- 1.33, N = 6SE +/- 0.66, N = 6SE +/- 0.96, N = 6SE +/- 0.16, N = 31034.57837.24279.03245.04167.24116.34112.5282.3574.2168.3168.2166.1764.7640.6135.4134.4133.5725.9317.09-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs1. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directorynvme_ext4_raid2nvme_xfs_raid2EXT4 4 Disk RAID0EXT4 2 Disk RAID0EXT4 1 DiskEXT4 4 Disk RAID10test2Btrfs 1 DiskBtrfs 2 Disk RAID1Btrfs 4 Disk RAID5Btrfs 4 Disk RAID6Btrfs 4 Disk RAID0Btrfs 2 Disk RAID0Btrfs 4 Disk RAID1EXT4 4 Disk RAID1Btrfs 4 Disk RAID10EXT4 2 Disk RAID1EXT4 4 Disk RAID5EXT4 4 Disk RAID660K120K180K240K300KSE +/- 948.88, N = 3SE +/- 665.04, N = 3SE +/- 8474.14, N = 6SE +/- 7406.16, N = 6SE +/- 20.28, N = 3SE +/- 4921.14, N = 6SE +/- 2091.26, N = 6SE +/- 290.12, N = 6SE +/- 412.51, N = 6SE +/- 750.71, N = 6SE +/- 677.52, N = 6SE +/- 1075.44, N = 6SE +/- 411.95, N = 6SE +/- 658.43, N = 6SE +/- 38.35, N = 3SE +/- 332.47, N = 6SE +/- 165.71, N = 6SE +/- 241.16, N = 6SE +/- 41.34, N = 326483020930569754612574180629080281262058318548170741704916540161861014988508599838964804270-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs1. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directorynvme_xfs_raid2nvme_ext4_raid2Btrfs 4 Disk RAID5Btrfs 4 Disk RAID6Btrfs 4 Disk RAID0Btrfs 2 Disk RAID0EXT4 4 Disk RAID10Btrfs 4 Disk RAID10EXT4 4 Disk RAID6Btrfs 4 Disk RAID1EXT4 4 Disk RAID5EXT4 2 Disk RAID0EXT4 4 Disk RAID0Btrfs 2 Disk RAID1Btrfs 1 DiskEXT4 4 Disk RAID1EXT4 2 Disk RAID1EXT4 1 Disk30060090012001500SE +/- 6.92, N = 3SE +/- 19.17, N = 3SE +/- 5.17, N = 3SE +/- 2.25, N = 3SE +/- 0.38, N = 3SE +/- 0.18, N = 3SE +/- 0.12, N = 3SE +/- 4.48, N = 6SE +/- 0.13, N = 3SE +/- 1.42, N = 3SE +/- 0.85, N = 3SE +/- 0.01, N = 3SE +/- 0.38, N = 3SE +/- 0.22, N = 3SE +/- 0.21, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 31169.601152.83402.86323.48302.93234.64217.34197.04196.79188.29151.50144.92143.94123.40109.2582.3076.7076.04-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs1. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directorynvme_xfs_raid2nvme_ext4_raid2Btrfs 4 Disk RAID5Btrfs 4 Disk RAID6Btrfs 4 Disk RAID0Btrfs 2 Disk RAID0EXT4 4 Disk RAID10Btrfs 4 Disk RAID10EXT4 4 Disk RAID6Btrfs 4 Disk RAID1EXT4 4 Disk RAID5EXT4 2 Disk RAID0EXT4 4 Disk RAID0Btrfs 2 Disk RAID1Btrfs 1 DiskEXT4 4 Disk RAID1EXT4 2 Disk RAID1EXT4 1 Disk60K120K180K240K300KSE +/- 1745.27, N = 3SE +/- 4888.02, N = 3SE +/- 1292.78, N = 3SE +/- 563.74, N = 3SE +/- 95.45, N = 3SE +/- 46.17, N = 3SE +/- 31.18, N = 3SE +/- 1120.00, N = 6SE +/- 33.39, N = 3SE +/- 353.81, N = 3SE +/- 211.67, N = 3SE +/- 96.19, N = 3SE +/- 56.04, N = 3SE +/- 53.30, N = 3SE +/- 10.26, N = 3SE +/- 16.15, N = 3SE +/- 9.87, N = 3299374295176100711808667573058657543314925549194470683787236226359813084727309205711917119008-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs1. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directorynvme_ext4_raid2nvme_xfs_raid2EXT4 1 DiskEXT4 4 Disk RAID0EXT4 2 Disk RAID0Btrfs 1 DiskBtrfs 4 Disk RAID6Btrfs 4 Disk RAID5EXT4 4 Disk RAID10Btrfs 2 Disk RAID1Btrfs 2 Disk RAID0Btrfs 4 Disk RAID0Btrfs 4 Disk RAID1Btrfs 4 Disk RAID10EXT4 2 Disk RAID1EXT4 4 Disk RAID5EXT4 4 Disk RAID1EXT4 4 Disk RAID62004006008001000SE +/- 5.72, N = 3SE +/- 4.34, N = 3SE +/- 1.22, N = 3SE +/- 2.17, N = 3SE +/- 1.66, N = 6SE +/- 0.71, N = 3SE +/- 5.08, N = 6SE +/- 6.88, N = 6SE +/- 0.38, N = 3SE +/- 1.08, N = 3SE +/- 1.06, N = 6SE +/- 6.41, N = 6SE +/- 1.87, N = 6SE +/- 1.47, N = 5SE +/- 0.95, N = 6SE +/- 1.06, N = 6SE +/- 1.81, N = 6SE +/- 0.57, N = 61069.87756.98213.91171.16103.3781.3773.1772.4771.2969.4269.2361.0447.7143.0836.7333.2233.0916.89-lnuma -libverbs-lnuma -libverbs1. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directorynvme_ext4_raid2nvme_xfs_raid2EXT4 1 DiskEXT4 4 Disk RAID0EXT4 2 Disk RAID0Btrfs 1 DiskBtrfs 4 Disk RAID6Btrfs 4 Disk RAID5EXT4 4 Disk RAID10Btrfs 2 Disk RAID1Btrfs 2 Disk RAID0Btrfs 4 Disk RAID0Btrfs 4 Disk RAID1Btrfs 4 Disk RAID10EXT4 2 Disk RAID1EXT4 4 Disk RAID5EXT4 4 Disk RAID1EXT4 4 Disk RAID660K120K180K240K300KSE +/- 1464.91, N = 3SE +/- 1085.21, N = 3SE +/- 304.49, N = 3SE +/- 543.30, N = 3SE +/- 415.76, N = 6SE +/- 177.16, N = 3SE +/- 1269.29, N = 6SE +/- 1720.72, N = 6SE +/- 95.10, N = 3SE +/- 269.37, N = 3SE +/- 264.98, N = 6SE +/- 1601.77, N = 6SE +/- 467.39, N = 6SE +/- 367.51, N = 5SE +/- 237.86, N = 6SE +/- 265.35, N = 6SE +/- 451.77, N = 6SE +/- 141.34, N = 62738731892415347342786258382034018289181131781817352173041525611923107679178830182684219-lnuma -libverbs-lnuma -libverbs1. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

FS-Mark

Test: 1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeBtrfs 4 Disk RAID0Btrfs 2 Disk RAID0Btrfs 4 Disk RAID10nvme_ext4_raid2Btrfs 2 Disk RAID1Btrfs 4 Disk RAID6Btrfs 4 Disk RAID1nvme_xfs_raid2Btrfs 1 DiskBtrfs 4 Disk RAID5EXT4 1 DiskEXT4 4 Disk RAID0EXT4 2 Disk RAID0EXT4 4 Disk RAID10EXT4 2 Disk RAID1EXT4 4 Disk RAID5EXT4 4 Disk RAID6EXT4 4 Disk RAID14080120160200SE +/- 22.24, N = 6SE +/- 1.82, N = 3SE +/- 0.26, N = 3SE +/- 0.60, N = 3SE +/- 0.63, N = 3SE +/- 12.61, N = 6SE +/- 1.12, N = 3SE +/- 0.26, N = 3SE +/- 0.93, N = 3SE +/- 12.60, N = 6SE +/- 1.64, N = 3SE +/- 1.30, N = 3SE +/- 0.07, N = 3SE +/- 0.65, N = 3SE +/- 0.20, N = 3SE +/- 0.92, N = 6SE +/- 2.04, N = 6SE +/- 0.34, N = 3189.18187.30177.53151.40140.87138.18137.77137.37133.87124.42119.13101.4371.9355.2028.7328.6024.8821.931. (CC) gcc options: -static

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsBtrfs 4 Disk RAID0nvme_xfs_raid2Btrfs 2 Disk RAID0nvme_ext4_raid2Btrfs 4 Disk RAID10Btrfs 4 Disk RAID5Btrfs 4 Disk RAID6Btrfs 4 Disk RAID1EXT4 4 Disk RAID0Btrfs 2 Disk RAID1Btrfs 1 DiskEXT4 2 Disk RAID0EXT4 4 Disk RAID10EXT4 1 DiskEXT4 4 Disk RAID5EXT4 2 Disk RAID1EXT4 4 Disk RAID6EXT4 4 Disk RAID1100200300400500SE +/- 3.41, N = 3SE +/- 7.89, N = 6SE +/- 0.87, N = 3SE +/- 1.09, N = 3SE +/- 0.32, N = 3SE +/- 0.85, N = 3SE +/- 0.85, N = 3SE +/- 0.32, N = 3SE +/- 0.35, N = 3SE +/- 8.74, N = 6SE +/- 18.73, N = 6SE +/- 5.45, N = 6SE +/- 0.93, N = 3SE +/- 26.21, N = 6SE +/- 0.82, N = 4SE +/- 0.27, N = 3SE +/- 2.11, N = 6SE +/- 0.99, N = 6445.50341.57322.97319.47287.30280.90258.10190.00175.33169.60148.1579.8770.2764.6752.1035.4732.8027.001. (CC) gcc options: -static

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeBtrfs 4 Disk RAID0Btrfs 2 Disk RAID0Btrfs 4 Disk RAID10nvme_ext4_raid2Btrfs 4 Disk RAID6nvme_xfs_raid2Btrfs 4 Disk RAID5Btrfs 2 Disk RAID1Btrfs 4 Disk RAID1Btrfs 1 DiskEXT4 4 Disk RAID0EXT4 2 Disk RAID0EXT4 4 Disk RAID10EXT4 1 DiskEXT4 4 Disk RAID6EXT4 2 Disk RAID1EXT4 4 Disk RAID5EXT4 4 Disk RAID150100150200250SE +/- 3.12, N = 3SE +/- 2.03, N = 3SE +/- 3.01, N = 3SE +/- 0.13, N = 3SE +/- 2.54, N = 3SE +/- 0.18, N = 3SE +/- 0.92, N = 3SE +/- 1.55, N = 3SE +/- 1.80, N = 3SE +/- 0.86, N = 3SE +/- 0.34, N = 3SE +/- 0.29, N = 3SE +/- 0.76, N = 6SE +/- 0.57, N = 6SE +/- 0.52, N = 3SE +/- 0.59, N = 6SE +/- 0.47, N = 3SE +/- 0.50, N = 3206.00180.03164.07147.67146.93139.23135.73133.83132.33131.40101.3753.1348.0041.3538.4329.7529.6728.231. (CC) gcc options: -static

IOzone

Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performancenvme_ext4_raid2nvme_xfs_raid2Btrfs 4 Disk RAID0Btrfs 4 Disk RAID1EXT4 4 Disk RAID0Btrfs 4 Disk RAID10Btrfs 4 Disk RAID5EXT4 2 Disk RAID0EXT4 4 Disk RAID10EXT4 4 Disk RAID5Btrfs 2 Disk RAID0Btrfs 4 Disk RAID6EXT4 4 Disk RAID6EXT4 1 DiskBtrfs 2 Disk RAID1EXT4 2 Disk RAID1EXT4 4 Disk RAID1Btrfs 1 Disk2004006008001000SE +/- 5.97, N = 3SE +/- 15.56, N = 4SE +/- 6.89, N = 3SE +/- 71.81, N = 6SE +/- 11.43, N = 6SE +/- 66.92, N = 6SE +/- 2.74, N = 6SE +/- 1.70, N = 4SE +/- 2.90, N = 6SE +/- 0.81, N = 3SE +/- 0.25, N = 3SE +/- 0.99, N = 3SE +/- 1.68, N = 6SE +/- 1.04, N = 6SE +/- 3.20, N = 6SE +/- 1.07, N = 6SE +/- 0.83, N = 3SE +/- 0.32, N = 31110.77968.40900.57182.49168.87142.13114.48103.4294.1680.4376.1675.6259.6648.7246.5243.6842.0937.971. (CC) gcc options: -O3

PostgreSQL pgbench

Scaling: Mostly RAM - Test: Normal Load - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.0Scaling: Mostly RAM - Test: Normal Load - Mode: Read WriteEXT4 2 Disk RAID0EXT4 4 Disk RAID0Btrfs 4 Disk RAID0Btrfs 4 Disk RAID1Btrfs 4 Disk RAID5EXT4 4 Disk RAID10Btrfs 2 Disk RAID0EXT4 1 DiskBtrfs 4 Disk RAID10EXT4 4 Disk RAID5EXT4 4 Disk RAID6Btrfs 1 DiskEXT4 2 Disk RAID1Btrfs 4 Disk RAID6Btrfs 2 Disk RAID1nvme_xfs_raid2EXT4 4 Disk RAID1400800120016002000SE +/- 7.69, N = 2SE +/- 66.52, N = 3SE +/- 0.15, N = 31771.231729.771643.891642.711370.471310.871133.631086.051041.851033.441020.35881.08760.78684.05628.35234.760.101. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -fPIC -lpgcommon -lpgport -lpthread -lrt -lcrypt -ldl -lm

SQLite

Test Target: Default Test Directory

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.8.10.2Test Target: Default Test Directorytest1test2EXT4 1 DiskEXT4 2 Disk RAID0EXT4 4 Disk RAID0EXT4 4 Disk RAID10nvme_ext4_raid2Btrfs 2 Disk RAID0Btrfs 1 DiskBtrfs 4 Disk RAID0Btrfs 2 Disk RAID1Btrfs 4 Disk RAID1Btrfs 4 Disk RAID10nvme_xfs_raid2Btrfs 4 Disk RAID6Btrfs 4 Disk RAID5EXT4 2 Disk RAID1EXT4 4 Disk RAID5EXT4 4 Disk RAID1EXT4 4 Disk RAID6140280420560700SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.16, N = 3SE +/- 3.23, N = 6SE +/- 5.47, N = 6SE +/- 5.22, N = 6SE +/- 0.19, N = 3SE +/- 0.16, N = 3SE +/- 0.38, N = 3SE +/- 0.20, N = 3SE +/- 0.60, N = 3SE +/- 0.47, N = 3SE +/- 0.17, N = 3SE +/- 0.49, N = 3SE +/- 2.35, N = 4SE +/- 2.12, N = 5SE +/- 284.13, N = 6SE +/- 339.88, N = 6SE +/- 276.42, N = 6SE +/- 459.69, N = 616.6917.1027.7437.7241.2248.2150.8759.2160.9062.1064.9366.7366.9172.73139.08140.27394.48418.50454.42669.241. (CC) gcc options: -O2 -ldl -lpthread

Phoronix Test Suite v10.8.4