Btrfs RAID, EXT4 MD RAID 4 x SSD Linux Tests

Btrfs RAID and EXT4 MDADM RAID tests on Linux 4.15 for a future article on Phoronix.

HTML result view exported from: https://openbenchmarking.org/result/1802194-FO-1712183AL20&grs.

Btrfs RAID, EXT4 MD RAID 4 x SSD Linux TestsProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay DriverCompilerFile-SystemScreen ResolutionBtrfs 1 DiskBtrfs 2 Disk RAID0Btrfs 2 Disk RAID1Btrfs 4 Disk RAID0Btrfs 4 Disk RAID1Btrfs 4 Disk RAID10Btrfs 4 Disk RAID5Btrfs 4 Disk RAID6EXT4 1 DiskEXT4 2 Disk RAID1EXT4 2 Disk RAID0EXT4 4 Disk RAID0EXT4 4 Disk RAID1EXT4 4 Disk RAID5EXT4 4 Disk RAID6EXT4 4 Disk RAID10xfs_intel_nvme_raid0_2diskIntel Xeon Silver 4108 @ 3.00GHz (8 Cores / 16 Threads)TYAN S7100AG2NRIntel Device 20206 x 4096 MB DDR4-2400MHz Micron 9ASF51272PZ-2G6B14 x 120GB ADATA SU700 + 240GB Force MP500ASPEED ASPEED FamilyRealtek ALC892VE228Intel I350 Gigabit ConnectionUbuntu 17.044.15.0-999-generic (x86_64) 20171212Unity 7.5.0modesetting 1.19.3GCC 6.3.0 20170406btrfs1920x1080Unity 7.5.0ext42 x Intel Xeon E5-2620 v4 @ 3.00GHz (16 Cores / 32 Threads)Supermicro X10DRU-i+ (2.0c BIOS)Intel Xeon E7 v4/Xeon16 x 64 GB DDR4-2133MT/s Micron 72ASS8G72LZ-2G6B22 x 128GB SAMSUNG MZ7LN128 + 2 x 2048GB Samsung SSD 850 + 2 x 1000GB INTEL SSDPE2KX010T7Intel 10-Gigabit X540-AT2Fedora 274.15.3-300.fc27.x86_64 (x86_64)GCC 7.3.1 20180130xfs1024x768OpenBenchmarking.orgCompiler Details- Btrfs 1 Disk: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v- Btrfs 2 Disk RAID0: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v- Btrfs 2 Disk RAID1: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v- Btrfs 4 Disk RAID0: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v- Btrfs 4 Disk RAID1: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v- Btrfs 4 Disk RAID10: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v- Btrfs 4 Disk RAID5: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v- Btrfs 4 Disk RAID6: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v- EXT4 1 Disk: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v- EXT4 2 Disk RAID1: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v- EXT4 2 Disk RAID0: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v- EXT4 4 Disk RAID0: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v- EXT4 4 Disk RAID1: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v- EXT4 4 Disk RAID5: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v- EXT4 4 Disk RAID6: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v- EXT4 4 Disk RAID10: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v- xfs_intel_nvme_raid0_2disk: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,objc,obj-c++,fortran,ada,go,lto --enable-libmpx --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=i686 --with-gcc-major-version-only --with-isl --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driverDisk Details- Btrfs 1 Disk: NONE / data=ordered,errors=remount-ro,relatime,rw- Btrfs 2 Disk RAID0: NONE / data=ordered,errors=remount-ro,relatime,rw- Btrfs 2 Disk RAID1: NONE / data=ordered,errors=remount-ro,relatime,rw- Btrfs 4 Disk RAID0: NONE / data=ordered,errors=remount-ro,relatime,rw- Btrfs 4 Disk RAID1: NONE / data=ordered,errors=remount-ro,relatime,rw- Btrfs 4 Disk RAID10: NONE / data=ordered,errors=remount-ro,relatime,rw- Btrfs 4 Disk RAID5: NONE / data=ordered,errors=remount-ro,relatime,rw- Btrfs 4 Disk RAID6: NONE / data=ordered,errors=remount-ro,relatime,rw- EXT4 1 Disk: NONE / data=ordered,errors=remount-ro,relatime,rw- EXT4 2 Disk RAID1: NONE / data=ordered,errors=remount-ro,relatime,rw- EXT4 2 Disk RAID0: NONE / data=ordered,errors=remount-ro,relatime,rw- EXT4 4 Disk RAID0: NONE / data=ordered,errors=remount-ro,relatime,rw- EXT4 4 Disk RAID1: NONE / data=ordered,errors=remount-ro,relatime,rw- EXT4 4 Disk RAID5: NONE / data=ordered,errors=remount-ro,relatime,rw- EXT4 4 Disk RAID6: NONE / data=ordered,errors=remount-ro,relatime,rw- EXT4 4 Disk RAID10: NONE / data=ordered,errors=remount-ro,relatime,rw- xfs_intel_nvme_raid0_2disk: NONE / attr2,inode64,noquota,relatime,rw,seclabelProcessor Details- Btrfs 1 Disk: Scaling Governor: intel_pstate powersave- Btrfs 2 Disk RAID0: Scaling Governor: intel_pstate powersave- Btrfs 2 Disk RAID1: Scaling Governor: intel_pstate powersave- Btrfs 4 Disk RAID0: Scaling Governor: intel_pstate powersave- Btrfs 4 Disk RAID1: Scaling Governor: intel_pstate powersave- Btrfs 4 Disk RAID10: Scaling Governor: intel_pstate powersave- Btrfs 4 Disk RAID5: Scaling Governor: intel_pstate powersave- Btrfs 4 Disk RAID6: Scaling Governor: intel_pstate powersave- EXT4 1 Disk: Scaling Governor: intel_pstate powersave- EXT4 2 Disk RAID1: Scaling Governor: intel_pstate powersave- EXT4 2 Disk RAID0: Scaling Governor: intel_pstate powersave- EXT4 4 Disk RAID0: Scaling Governor: intel_pstate powersave- EXT4 4 Disk RAID1: Scaling Governor: intel_pstate powersave- EXT4 4 Disk RAID5: Scaling Governor: intel_pstate powersave- EXT4 4 Disk RAID6: Scaling Governor: intel_pstate powersave- EXT4 4 Disk RAID10: Scaling Governor: intel_pstate powersave- xfs_intel_nvme_raid0_2disk: Scaling Governor: intel_pstate performanceSecurity Details- xfs_intel_nvme_raid0_2disk: SELinux + KPTI + __user pointer sanitization + Full generic retpoline Protection

Btrfs RAID, EXT4 MD RAID 4 x SSD Linux Testsfio: Seq Read - Libaio - No - Yes - 4KB - Default Test Directoryfio: Rand Read - Libaio - No - Yes - 4KB - Default Test Directoryblogbench: Writefs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizepgbench: Mostly RAM - Normal Load - Read Writeblogbench: Readiozone: 4Kb - 8GB - Write Performancedbench: 12fs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 1000 Files, 1MB Sizefio: Seq Write - Libaio - No - Yes - 4KB - Default Test Directoryfio: Rand Write - Libaio - No - Yes - 4KB - Default Test Directorysqlite: Default Test DirectoryBtrfs 1 DiskBtrfs 2 Disk RAID0Btrfs 2 Disk RAID1Btrfs 4 Disk RAID0Btrfs 4 Disk RAID1Btrfs 4 Disk RAID10Btrfs 4 Disk RAID5Btrfs 4 Disk RAID6EXT4 1 DiskEXT4 2 Disk RAID1EXT4 2 Disk RAID0EXT4 4 Disk RAID0EXT4 4 Disk RAID1EXT4 4 Disk RAID5EXT4 4 Disk RAID6EXT4 4 Disk RAID10xfs_intel_nvme_raid0_2disk109.25124.365079131.40881.08240239237.97291.84148.15133.8781.3782.3560.90234.64220.665746180.031133.63237273576.16309.27322.97187.3069.2364.7659.21123.40124.104773133.83628.35238822746.52289.99169.60140.8769.4274.2164.93302.93292.705732206.001643.892400675900.57328.55445.50189.1861.0466.1762.10188.29241.615397132.331642.712363039182.49314.25190.00137.7747.7140.6166.73197.04221.645577164.071041.852359105142.13348.16287.30177.5343.0834.4166.91402.86384.545136135.731370.472326341114.48311.67280.90124.4272.4768.31140.27323.48367.544655146.93684.05216211575.62302.24258.10138.1873.1768.21139.0876.04123.76421241.351086.05247751048.72218.2564.67119.13213.91167.2427.7476.70245.71482529.75760.78241760643.68160.5635.4728.7336.7333.57394.48144.92242.12561053.131771.232389094103.42374.8779.8771.93103.37245.0437.72143.94455.508724101.371729.771577870168.87605.34175.33101.43171.16279.0341.2282.30458.92469228.230.10236166342.0991.3027.0021.9333.0935.41454.42151.50427.96624329.671033.44253477980.43129.0052.1028.6033.2225.93418.50196.79416.81513538.431020.35258548659.66106.0832.8024.8816.8917.09669.24217.34438.83776948.001310.87231488394.16302.5770.2755.2071.29116.3448.21726.44710.3612916783.4098.972071704600.675271.351152.23794.10721.35701.616.21OpenBenchmarking.org

Flexible IO Tester

Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryBtrfs 1 DiskBtrfs 2 Disk RAID0Btrfs 2 Disk RAID1Btrfs 4 Disk RAID0Btrfs 4 Disk RAID1Btrfs 4 Disk RAID10Btrfs 4 Disk RAID5Btrfs 4 Disk RAID6EXT4 1 DiskEXT4 2 Disk RAID1EXT4 2 Disk RAID0EXT4 4 Disk RAID0EXT4 4 Disk RAID1EXT4 4 Disk RAID5EXT4 4 Disk RAID6EXT4 4 Disk RAID10xfs_intel_nvme_raid0_2disk40K80K120K160K200KSE +/- 53.30, N = 3SE +/- 46.17, N = 3SE +/- 56.04, N = 3SE +/- 95.45, N = 3SE +/- 353.81, N = 3SE +/- 1120.00, N = 6SE +/- 1292.78, N = 3SE +/- 563.74, N = 3SE +/- 9.87, N = 3SE +/- 16.15, N = 3SE +/- 96.19, N = 3SE +/- 10.26, N = 3SE +/- 211.67, N = 3SE +/- 33.39, N = 3SE +/- 31.18, N = 3SE +/- 312.18, N = 3273095865730847757304706849255100711808661900819171362263598120571378724919454331181606-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs1. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryBtrfs 1 DiskBtrfs 2 Disk RAID0Btrfs 2 Disk RAID1Btrfs 4 Disk RAID0Btrfs 4 Disk RAID1Btrfs 4 Disk RAID10Btrfs 4 Disk RAID5Btrfs 4 Disk RAID6EXT4 1 DiskEXT4 2 Disk RAID1EXT4 2 Disk RAID0EXT4 4 Disk RAID0EXT4 4 Disk RAID1EXT4 4 Disk RAID5EXT4 4 Disk RAID6EXT4 4 Disk RAID10xfs_intel_nvme_raid0_2disk160320480640800SE +/- 0.21, N = 3SE +/- 0.18, N = 3SE +/- 0.22, N = 3SE +/- 0.38, N = 3SE +/- 1.42, N = 3SE +/- 4.48, N = 6SE +/- 5.17, N = 3SE +/- 2.25, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.38, N = 3SE +/- 0.04, N = 3SE +/- 0.85, N = 3SE +/- 0.13, N = 3SE +/- 0.12, N = 3SE +/- 1.25, N = 3109.25234.64123.40302.93188.29197.04402.86323.4876.0476.70144.92143.9482.30151.50196.79217.34726.44-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs1. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryBtrfs 1 DiskBtrfs 2 Disk RAID0Btrfs 2 Disk RAID1Btrfs 4 Disk RAID0Btrfs 4 Disk RAID1Btrfs 4 Disk RAID10Btrfs 4 Disk RAID5Btrfs 4 Disk RAID6EXT4 1 DiskEXT4 2 Disk RAID1EXT4 2 Disk RAID0EXT4 4 Disk RAID0EXT4 4 Disk RAID1EXT4 4 Disk RAID5EXT4 4 Disk RAID6EXT4 4 Disk RAID10xfs_intel_nvme_raid0_2disk40K80K120K160K200KSE +/- 5.70, N = 3SE +/- 102.71, N = 3SE +/- 100.16, N = 3SE +/- 301.74, N = 3SE +/- 96.48, N = 3SE +/- 124.67, N = 3SE +/- 477.39, N = 3SE +/- 802.96, N = 3SE +/- 36.78, N = 3SE +/- 12.71, N = 3SE +/- 45.67, N = 3SE +/- 195.13, N = 3SE +/- 220.50, N = 3SE +/- 805.76, N = 3SE +/- 420.51, N = 3SE +/- 235.76, N = 3SE +/- 175.37, N = 33108655162310217317260399554069613291881309366142460527113870114726106986104198109704177586-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs1. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryBtrfs 1 DiskBtrfs 2 Disk RAID0Btrfs 2 Disk RAID1Btrfs 4 Disk RAID0Btrfs 4 Disk RAID1Btrfs 4 Disk RAID10Btrfs 4 Disk RAID5Btrfs 4 Disk RAID6EXT4 1 DiskEXT4 2 Disk RAID1EXT4 2 Disk RAID0EXT4 4 Disk RAID0EXT4 4 Disk RAID1EXT4 4 Disk RAID5EXT4 4 Disk RAID6EXT4 4 Disk RAID10xfs_intel_nvme_raid0_2disk150300450600750SE +/- 0.02, N = 3SE +/- 0.41, N = 3SE +/- 0.40, N = 3SE +/- 1.21, N = 3SE +/- 0.39, N = 3SE +/- 0.50, N = 3SE +/- 1.91, N = 3SE +/- 3.21, N = 3SE +/- 0.15, N = 3SE +/- 0.05, N = 3SE +/- 0.18, N = 3SE +/- 0.78, N = 3SE +/- 0.88, N = 3SE +/- 3.22, N = 3SE +/- 1.68, N = 3SE +/- 0.94, N = 3SE +/- 0.70, N = 3124.36220.66124.10292.70241.61221.64384.54367.54123.76245.71242.12455.50458.92427.96416.81438.83710.36-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs1. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

BlogBench

Test: Write

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: WriteBtrfs 1 DiskBtrfs 2 Disk RAID0Btrfs 2 Disk RAID1Btrfs 4 Disk RAID0Btrfs 4 Disk RAID1Btrfs 4 Disk RAID10Btrfs 4 Disk RAID5Btrfs 4 Disk RAID6EXT4 1 DiskEXT4 2 Disk RAID1EXT4 2 Disk RAID0EXT4 4 Disk RAID0EXT4 4 Disk RAID1EXT4 4 Disk RAID5EXT4 4 Disk RAID6EXT4 4 Disk RAID10xfs_intel_nvme_raid0_2disk3K6K9K12K15KSE +/- 188.26, N = 3SE +/- 46.23, N = 3SE +/- 339.12, N = 3SE +/- 7.51, N = 3SE +/- 54.35, N = 3SE +/- 37.03, N = 3SE +/- 11.39, N = 3SE +/- 4.98, N = 3SE +/- 139.20, N = 3SE +/- 163.44, N = 3SE +/- 63.28, N = 3SE +/- 200.62, N = 3SE +/- 744.12, N = 3SE +/- 51.73, N = 3SE +/- 112.58, N = 3SE +/- 380.22, N = 3SE +/- 12.99, N = 35079574647735732539755775136465542124825561087244692624351357769129161. (CC) gcc options: -O2 -pthread

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeBtrfs 1 DiskBtrfs 2 Disk RAID0Btrfs 2 Disk RAID1Btrfs 4 Disk RAID0Btrfs 4 Disk RAID1Btrfs 4 Disk RAID10Btrfs 4 Disk RAID5Btrfs 4 Disk RAID6EXT4 1 DiskEXT4 2 Disk RAID1EXT4 2 Disk RAID0EXT4 4 Disk RAID0EXT4 4 Disk RAID1EXT4 4 Disk RAID5EXT4 4 Disk RAID6EXT4 4 Disk RAID10xfs_intel_nvme_raid0_2disk2004006008001000SE +/- 0.86, N = 3SE +/- 2.03, N = 3SE +/- 1.55, N = 3SE +/- 3.12, N = 3SE +/- 1.80, N = 3SE +/- 3.01, N = 3SE +/- 0.92, N = 3SE +/- 2.54, N = 3SE +/- 0.57, N = 6SE +/- 0.59, N = 6SE +/- 0.29, N = 3SE +/- 0.34, N = 3SE +/- 0.50, N = 3SE +/- 0.47, N = 3SE +/- 0.52, N = 3SE +/- 0.76, N = 6SE +/- 1.87, N = 3131.40180.03133.83206.00132.33164.07135.73146.9341.3529.7553.13101.3728.2329.6738.4348.00783.401. (CC) gcc options: -static

PostgreSQL pgbench

Scaling: Mostly RAM - Test: Normal Load - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 10.0Scaling: Mostly RAM - Test: Normal Load - Mode: Read WriteBtrfs 1 DiskBtrfs 2 Disk RAID0Btrfs 2 Disk RAID1Btrfs 4 Disk RAID0Btrfs 4 Disk RAID1Btrfs 4 Disk RAID10Btrfs 4 Disk RAID5Btrfs 4 Disk RAID6EXT4 1 DiskEXT4 2 Disk RAID1EXT4 2 Disk RAID0EXT4 4 Disk RAID0EXT4 4 Disk RAID1EXT4 4 Disk RAID5EXT4 4 Disk RAID6EXT4 4 Disk RAID10xfs_intel_nvme_raid0_2disk400800120016002000SE +/- 66.52, N = 3SE +/- 7.69, N = 2SE +/- 0.08, N = 3881.081133.63628.351643.891642.711041.851370.47684.051086.05760.781771.231729.770.101033.441020.351310.8798.971. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -fPIC -lpgcommon -lpgport -lpthread -lrt -lcrypt -ldl -lm

BlogBench

Test: Read

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: ReadBtrfs 1 DiskBtrfs 2 Disk RAID0Btrfs 2 Disk RAID1Btrfs 4 Disk RAID0Btrfs 4 Disk RAID1Btrfs 4 Disk RAID10Btrfs 4 Disk RAID5Btrfs 4 Disk RAID6EXT4 1 DiskEXT4 2 Disk RAID1EXT4 2 Disk RAID0EXT4 4 Disk RAID0EXT4 4 Disk RAID1EXT4 4 Disk RAID5EXT4 4 Disk RAID6EXT4 4 Disk RAID10xfs_intel_nvme_raid0_2disk600K1200K1800K2400K3000KSE +/- 648.68, N = 3SE +/- 15678.20, N = 3SE +/- 39766.83, N = 3SE +/- 23301.34, N = 3SE +/- 20419.15, N = 3SE +/- 10253.07, N = 3SE +/- 18228.21, N = 3SE +/- 7784.52, N = 3SE +/- 27696.50, N = 3SE +/- 53313.62, N = 6SE +/- 13123.68, N = 3SE +/- 51904.97, N = 6SE +/- 59092.27, N = 6SE +/- 20432.96, N = 3SE +/- 19996.16, N = 3SE +/- 61488.72, N = 6SE +/- 18625.63, N = 3240239223727352388227240067523630392359105232634121621152477510241760623890941577870236166325347792585486231488320717041. (CC) gcc options: -O2 -pthread

IOzone

Record Size: 4Kb - File Size: 8GB - Disk Test: Write Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.465Record Size: 4Kb - File Size: 8GB - Disk Test: Write PerformanceBtrfs 1 DiskBtrfs 2 Disk RAID0Btrfs 2 Disk RAID1Btrfs 4 Disk RAID0Btrfs 4 Disk RAID1Btrfs 4 Disk RAID10Btrfs 4 Disk RAID5Btrfs 4 Disk RAID6EXT4 1 DiskEXT4 2 Disk RAID1EXT4 2 Disk RAID0EXT4 4 Disk RAID0EXT4 4 Disk RAID1EXT4 4 Disk RAID5EXT4 4 Disk RAID6EXT4 4 Disk RAID10xfs_intel_nvme_raid0_2disk2004006008001000SE +/- 0.32, N = 3SE +/- 0.25, N = 3SE +/- 3.20, N = 6SE +/- 6.89, N = 3SE +/- 71.81, N = 6SE +/- 66.92, N = 6SE +/- 2.74, N = 6SE +/- 0.99, N = 3SE +/- 1.04, N = 6SE +/- 1.07, N = 6SE +/- 1.70, N = 4SE +/- 11.43, N = 6SE +/- 0.83, N = 3SE +/- 0.81, N = 3SE +/- 1.68, N = 6SE +/- 2.90, N = 6SE +/- 4.36, N = 337.9776.1646.52900.57182.49142.13114.4875.6248.7243.68103.42168.8742.0980.4359.6694.16600.671. (CC) gcc options: -O3

Dbench

Client Count: 12

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 12Btrfs 1 DiskBtrfs 2 Disk RAID0Btrfs 2 Disk RAID1Btrfs 4 Disk RAID0Btrfs 4 Disk RAID1Btrfs 4 Disk RAID10Btrfs 4 Disk RAID5Btrfs 4 Disk RAID6EXT4 1 DiskEXT4 2 Disk RAID1EXT4 2 Disk RAID0EXT4 4 Disk RAID0EXT4 4 Disk RAID1EXT4 4 Disk RAID5EXT4 4 Disk RAID6EXT4 4 Disk RAID10xfs_intel_nvme_raid0_2disk11002200330044005500SE +/- 11.41, N = 6SE +/- 4.96, N = 3SE +/- 16.74, N = 6SE +/- 3.60, N = 3SE +/- 2.52, N = 3SE +/- 1.01, N = 3SE +/- 3.34, N = 3SE +/- 7.86, N = 6SE +/- 1.02, N = 3SE +/- 0.14, N = 3SE +/- 5.79, N = 5SE +/- 36.65, N = 6SE +/- 1.66, N = 6SE +/- 2.59, N = 3SE +/- 4.73, N = 6SE +/- 5.12, N = 6SE +/- 3.97, N = 3291.84309.27289.99328.55314.25348.16311.67302.24218.25160.56374.87605.3491.30129.00106.08302.575271.351. (CC) gcc options: -lpopt -O2

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsBtrfs 1 DiskBtrfs 2 Disk RAID0Btrfs 2 Disk RAID1Btrfs 4 Disk RAID0Btrfs 4 Disk RAID1Btrfs 4 Disk RAID10Btrfs 4 Disk RAID5Btrfs 4 Disk RAID6EXT4 1 DiskEXT4 2 Disk RAID1EXT4 2 Disk RAID0EXT4 4 Disk RAID0EXT4 4 Disk RAID1EXT4 4 Disk RAID5EXT4 4 Disk RAID6EXT4 4 Disk RAID10xfs_intel_nvme_raid0_2disk2004006008001000SE +/- 18.73, N = 6SE +/- 0.87, N = 3SE +/- 8.74, N = 6SE +/- 3.41, N = 3SE +/- 0.32, N = 3SE +/- 0.32, N = 3SE +/- 0.85, N = 3SE +/- 0.85, N = 3SE +/- 26.21, N = 6SE +/- 0.27, N = 3SE +/- 5.45, N = 6SE +/- 0.35, N = 3SE +/- 0.99, N = 6SE +/- 0.82, N = 4SE +/- 2.11, N = 6SE +/- 0.93, N = 3SE +/- 4.30, N = 3148.15322.97169.60445.50190.00287.30280.90258.1064.6735.4779.87175.3327.0052.1032.8070.271152.231. (CC) gcc options: -static

FS-Mark

Test: 1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeBtrfs 1 DiskBtrfs 2 Disk RAID0Btrfs 2 Disk RAID1Btrfs 4 Disk RAID0Btrfs 4 Disk RAID1Btrfs 4 Disk RAID10Btrfs 4 Disk RAID5Btrfs 4 Disk RAID6EXT4 1 DiskEXT4 2 Disk RAID1EXT4 2 Disk RAID0EXT4 4 Disk RAID0EXT4 4 Disk RAID1EXT4 4 Disk RAID5EXT4 4 Disk RAID6EXT4 4 Disk RAID10xfs_intel_nvme_raid0_2disk2004006008001000SE +/- 0.93, N = 3SE +/- 1.82, N = 3SE +/- 0.63, N = 3SE +/- 22.24, N = 6SE +/- 1.12, N = 3SE +/- 0.26, N = 3SE +/- 12.60, N = 6SE +/- 12.61, N = 6SE +/- 1.64, N = 3SE +/- 0.20, N = 3SE +/- 0.07, N = 3SE +/- 1.30, N = 3SE +/- 0.34, N = 3SE +/- 0.92, N = 6SE +/- 2.04, N = 6SE +/- 0.65, N = 3SE +/- 1.00, N = 3133.87187.30140.87189.18137.77177.53124.42138.18119.1328.7371.93101.4321.9328.6024.8855.20794.101. (CC) gcc options: -static

Flexible IO Tester

Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryBtrfs 1 DiskBtrfs 2 Disk RAID0Btrfs 2 Disk RAID1Btrfs 4 Disk RAID0Btrfs 4 Disk RAID1Btrfs 4 Disk RAID10Btrfs 4 Disk RAID5Btrfs 4 Disk RAID6EXT4 1 DiskEXT4 2 Disk RAID1EXT4 2 Disk RAID0EXT4 4 Disk RAID0EXT4 4 Disk RAID1EXT4 4 Disk RAID5EXT4 4 Disk RAID6EXT4 4 Disk RAID10xfs_intel_nvme_raid0_2disk40K80K120K160K200KSE +/- 177.16, N = 3SE +/- 264.98, N = 6SE +/- 269.37, N = 3SE +/- 1601.77, N = 6SE +/- 467.39, N = 6SE +/- 367.51, N = 5SE +/- 1720.72, N = 6SE +/- 1269.29, N = 6SE +/- 304.49, N = 3SE +/- 237.86, N = 6SE +/- 415.76, N = 6SE +/- 543.30, N = 3SE +/- 451.77, N = 6SE +/- 265.35, N = 6SE +/- 141.34, N = 6SE +/- 95.10, N = 3SE +/- 1736.78, N = 32034017304173521525611923107671811318289534739178258384278682688301421917818180333-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs1. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryBtrfs 1 DiskBtrfs 2 Disk RAID0Btrfs 2 Disk RAID1Btrfs 4 Disk RAID0Btrfs 4 Disk RAID1Btrfs 4 Disk RAID10Btrfs 4 Disk RAID5Btrfs 4 Disk RAID6EXT4 1 DiskEXT4 2 Disk RAID1EXT4 2 Disk RAID0EXT4 4 Disk RAID0EXT4 4 Disk RAID1EXT4 4 Disk RAID5EXT4 4 Disk RAID6EXT4 4 Disk RAID10xfs_intel_nvme_raid0_2disk160320480640800SE +/- 0.71, N = 3SE +/- 1.06, N = 6SE +/- 1.08, N = 3SE +/- 6.41, N = 6SE +/- 1.87, N = 6SE +/- 1.47, N = 5SE +/- 6.88, N = 6SE +/- 5.08, N = 6SE +/- 1.22, N = 3SE +/- 0.95, N = 6SE +/- 1.66, N = 6SE +/- 2.17, N = 3SE +/- 1.81, N = 6SE +/- 1.06, N = 6SE +/- 0.57, N = 6SE +/- 0.38, N = 3SE +/- 6.95, N = 381.3769.2369.4261.0447.7143.0872.4773.17213.9136.73103.37171.1633.0933.2216.8971.29721.35-lnuma -libverbs-lnuma -libverbs1. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryBtrfs 1 DiskBtrfs 2 Disk RAID0Btrfs 2 Disk RAID1Btrfs 4 Disk RAID0Btrfs 4 Disk RAID1Btrfs 4 Disk RAID10Btrfs 4 Disk RAID5Btrfs 4 Disk RAID6EXT4 1 DiskEXT4 2 Disk RAID1EXT4 2 Disk RAID0EXT4 4 Disk RAID0EXT4 4 Disk RAID1EXT4 4 Disk RAID5EXT4 4 Disk RAID6EXT4 4 Disk RAID10xfs_intel_nvme_raid0_2disk40K80K120K160K200KSE +/- 290.12, N = 6SE +/- 411.95, N = 6SE +/- 412.51, N = 6SE +/- 1075.44, N = 6SE +/- 658.43, N = 6SE +/- 332.47, N = 6SE +/- 750.71, N = 6SE +/- 677.52, N = 6SE +/- 20.28, N = 3SE +/- 165.71, N = 6SE +/- 7406.16, N = 6SE +/- 8474.14, N = 6SE +/- 38.35, N = 3SE +/- 241.16, N = 6SE +/- 41.34, N = 3SE +/- 4921.14, N = 6SE +/- 512.84, N = 3205831618618548165401014985991707417049418068389612576975488506480427029080175399-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs1. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryBtrfs 1 DiskBtrfs 2 Disk RAID0Btrfs 2 Disk RAID1Btrfs 4 Disk RAID0Btrfs 4 Disk RAID1Btrfs 4 Disk RAID10Btrfs 4 Disk RAID5Btrfs 4 Disk RAID6EXT4 1 DiskEXT4 2 Disk RAID1EXT4 2 Disk RAID0EXT4 4 Disk RAID0EXT4 4 Disk RAID1EXT4 4 Disk RAID5EXT4 4 Disk RAID6EXT4 4 Disk RAID10xfs_intel_nvme_raid0_2disk150300450600750SE +/- 1.16, N = 6SE +/- 1.65, N = 6SE +/- 1.65, N = 6SE +/- 4.30, N = 6SE +/- 2.63, N = 6SE +/- 1.33, N = 6SE +/- 3.00, N = 6SE +/- 2.71, N = 6SE +/- 0.08, N = 3SE +/- 0.66, N = 6SE +/- 29.62, N = 6SE +/- 33.90, N = 6SE +/- 0.15, N = 3SE +/- 0.96, N = 6SE +/- 0.16, N = 3SE +/- 19.68, N = 6SE +/- 2.05, N = 382.3564.7674.2166.1740.6134.4168.3168.21167.2433.57245.04279.0335.4125.9317.09116.34701.61-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs-lnuma -libverbs1. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lz -lm -lpthread -ldl

SQLite

Test Target: Default Test Directory

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.8.10.2Test Target: Default Test DirectoryBtrfs 1 DiskBtrfs 2 Disk RAID0Btrfs 2 Disk RAID1Btrfs 4 Disk RAID0Btrfs 4 Disk RAID1Btrfs 4 Disk RAID10Btrfs 4 Disk RAID5Btrfs 4 Disk RAID6EXT4 1 DiskEXT4 2 Disk RAID1EXT4 2 Disk RAID0EXT4 4 Disk RAID0EXT4 4 Disk RAID1EXT4 4 Disk RAID5EXT4 4 Disk RAID6EXT4 4 Disk RAID10xfs_intel_nvme_raid0_2disk140280420560700SE +/- 0.38, N = 3SE +/- 0.16, N = 3SE +/- 0.60, N = 3SE +/- 0.20, N = 3SE +/- 0.47, N = 3SE +/- 0.17, N = 3SE +/- 2.12, N = 5SE +/- 2.35, N = 4SE +/- 0.16, N = 3SE +/- 284.13, N = 6SE +/- 3.23, N = 6SE +/- 5.47, N = 6SE +/- 276.42, N = 6SE +/- 339.88, N = 6SE +/- 459.69, N = 6SE +/- 5.22, N = 6SE +/- 0.00, N = 360.9059.2164.9362.1066.7366.91140.27139.0827.74394.4837.7241.22454.42418.50669.2448.216.211. (CC) gcc options: -O2 -ldl -lpthread

Phoronix Test Suite v10.8.4