Btrfs Linux 4.10 RAID 4-Disk SSD

Btrfs multi-disk tests on the Linux 4.10 kernel with various RAID options. Tests by Michael Larabel for a future article on Phoronix.com.

HTML result view exported from: https://openbenchmarking.org/result/1708117-TR-1708101TR95.

Btrfs Linux 4.10 RAID 4-Disk SSDProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLVulkanCompilerFile-SystemScreen ResolutionSingle Disk2-Disk RAID02-Disk RAID14-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID6seistro-RAID5-8disks-ext4-4.12.14.12.1-seistro-raid10-4disks4.12.1-seistro-raid10-4disks-ext44.10.0-pangaia-ext4-hd-orderedseistro-RAID5-8Disks-ext4-4.12.1-upgradeFirmwareseistro-RAID10-4SSD-ext4-4.12.1-upgradeFirmwareseistro-RAID10-4SSD-ext4-4.12.5-WB-Direct-NORA4.10-pangain-ext4-hd-writebackIntel Core i7-6800K @ 3.80GHz (12 Cores)MSI X99A WORKSTATION (MS-7A54) v1.0Intel Xeon E7 v4/Xeon16384MB120GB Samsung SSD 850 + 4 x 120GB TOSHIBA-TR150NVIDIA GeForce GTX TITAN X 12288MBRealtek ALC1150ASUS PB278Intel ConnectionUbuntu 16.044.10.0-999-generic (x86_64) 20170126Unity 7.4.0X Server 1.18.4nouveau 1.0.123.3 Mesa 11.2.0 Gallium 0.41.0.8GCC 5.4.0 20160609 + CUDA 8.0btrfs2560x14402 x Intel Xeon E5-2630 0 @ 2.80GHz (24 Cores)Dell 0XH7F2Intel Xeon E5/Core387072MB6998GB PERC H710P + 1199GB PERC H710PMatrox s G200eR2Smart CableBroadcom NetXtreme BCM5720 Gigabit PCIeDebian 8.84.12.1-041201-generic (x86_64)GCC 5.3.1 20160224ext41024x768Intel Core i7-5820K @ 3.60GHz (12 Cores)ASUS X99-A/USB 3.1Intel Xeon E7 v3/Xeon16384MB2000GB TOSHIBA DT01ACA2 + 256GB KINGSTON SKC400SGigabyte NVIDIA GeForce GTX 960Realtek ALC1150Intel ConnectionUbuntu 17.044.10.0-20-generic (x86_64)KDE Frameworks 5modesetting 1.19.31.0.24GCC 5.4.1 20170304 + CUDA 8.01280x10242 x Intel Xeon E5-2630 0 @ 2.80GHz (24 Cores)Dell 0XH7F2Intel Xeon E5/Core387072MB6998GB PERC H710P + 1199GB PERC H710PMatrox s G200eR2Smart CableBroadcom NetXtreme BCM5720 Gigabit PCIeDebian 8.84.12.1-041201-generic (x86_64)GCC 5.3.1 201602241024x768Debian 8.94.12.5-041205-generic (x86_64)Intel Core i7-5820K @ 3.60GHz (12 Cores)ASUS X99-A/USB 3.1Intel Xeon E7 v3/Xeon16384MB2000GB TOSHIBA DT01ACA2 + 256GB KINGSTON SKC400SGigabyte NVIDIA GeForce GTX 960 4096MB (1215/3505MHz)Realtek ALC1150Intel ConnectionUbuntu 17.044.10.0-30-generic (x86_64)KDE Frameworks 5NVIDIA 375.664.5.01.0.24GCC 5.4.1 20170304 + CUDA 8.01280x1024OpenBenchmarking.orgCompiler Details- Single Disk: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- 2-Disk RAID0: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- 2-Disk RAID1: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- 4-Disk RAID0: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- 4-Disk RAID1: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- 4-Disk RAID10: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- 4-Disk RAID5: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- 4-Disk RAID6: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- seistro-RAID5-8disks-ext4-4.12.1: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i586 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- 4.12.1-seistro-raid10-4disks: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i586 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- 4.12.1-seistro-raid10-4disks-ext4: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i586 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- 4.10.0-pangaia-ext4-hd-ordered: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- seistro-RAID5-8Disks-ext4-4.12.1-upgradeFirmware: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i586 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- seistro-RAID10-4SSD-ext4-4.12.1-upgradeFirmware: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i586 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- seistro-RAID10-4SSD-ext4-4.12.5-WB-Direct-NORA: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i586 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v- 4.10-pangain-ext4-hd-writeback: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -vDisk Details- Single Disk: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5- 2-Disk RAID0: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID0- 2-Disk RAID1: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID1- 4-Disk RAID0: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID0- 4-Disk RAID1: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID1- 4-Disk RAID10: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID10- 4-Disk RAID5: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID5- 4-Disk RAID6: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID6- seistro-RAID5-8disks-ext4-4.12.1: DEADLINE / acl,block_validity,delalloc,discard,noatime,nodiratime,rw,stripe=112,user_xattr- 4.12.1-seistro-raid10-4disks: DEADLINE / acl,block_validity,delalloc,discard,noatime,nodiratime,rw,stripe=112,user_xattr- 4.12.1-seistro-raid10-4disks-ext4: DEADLINE / acl,block_validity,delalloc,discard,noatime,nodiratime,rw,stripe=112,user_xattr- 4.10.0-pangaia-ext4-hd-ordered: CFQ / data=ordered,errors=remount-ro,relatime,rw- seistro-RAID5-8Disks-ext4-4.12.1-upgradeFirmware: CFQ / acl,block_validity,delalloc,discard,noatime,nodiratime,rw,stripe=112,user_xattr- seistro-RAID10-4SSD-ext4-4.12.1-upgradeFirmware: CFQ / acl,block_validity,delalloc,discard,noatime,nodiratime,rw,stripe=112,user_xattr- seistro-RAID10-4SSD-ext4-4.12.5-WB-Direct-NORA: CFQ / acl,block_validity,delalloc,discard,noatime,nodiratime,rw,stripe=112,user_xattr- 4.10-pangain-ext4-hd-writeback: CFQ / errors=remount-ro,noatime,nobarrier,rwProcessor Details- Single Disk: Scaling Governor: intel_pstate powersave- 2-Disk RAID0: Scaling Governor: intel_pstate powersave- 2-Disk RAID1: Scaling Governor: intel_pstate powersave- 4-Disk RAID0: Scaling Governor: intel_pstate powersave- 4-Disk RAID1: Scaling Governor: intel_pstate powersave- 4-Disk RAID10: Scaling Governor: intel_pstate powersave- 4-Disk RAID5: Scaling Governor: intel_pstate powersave- 4-Disk RAID6: Scaling Governor: intel_pstate powersave- seistro-RAID5-8disks-ext4-4.12.1: Scaling Governor: intel_pstate performance- 4.12.1-seistro-raid10-4disks: Scaling Governor: intel_pstate performance- 4.12.1-seistro-raid10-4disks-ext4: Scaling Governor: intel_pstate performance- 4.10.0-pangaia-ext4-hd-ordered: Scaling Governor: intel_pstate powersave- seistro-RAID5-8Disks-ext4-4.12.1-upgradeFirmware: Scaling Governor: intel_pstate performance- seistro-RAID10-4SSD-ext4-4.12.1-upgradeFirmware: Scaling Governor: intel_pstate performance- seistro-RAID10-4SSD-ext4-4.12.5-WB-Direct-NORA: Scaling Governor: intel_pstate performance- 4.10-pangain-ext4-hd-writeback: Scaling Governor: intel_pstate powersaveSystem Details- Single Disk: Python 2.7.12.- 2-Disk RAID0: Python 2.7.12.- 2-Disk RAID1: Python 2.7.12.- 4-Disk RAID0: Python 2.7.12.- 4-Disk RAID1: Python 2.7.12.- 4-Disk RAID10: Python 2.7.12.- 4-Disk RAID5: Python 2.7.12.- 4-Disk RAID6: Python 2.7.12.- seistro-RAID5-8disks-ext4-4.12.1: Python 2.7.9.- 4.12.1-seistro-raid10-4disks: Python 2.7.9.- 4.12.1-seistro-raid10-4disks-ext4: Python 2.7.9.- 4.10.0-pangaia-ext4-hd-ordered: Python 2.7.13.- seistro-RAID5-8Disks-ext4-4.12.1-upgradeFirmware: Python 2.7.9.- seistro-RAID10-4SSD-ext4-4.12.1-upgradeFirmware: Python 2.7.9.- seistro-RAID10-4SSD-ext4-4.12.5-WB-Direct-NORA: Python 2.7.9.- 4.10-pangain-ext4-hd-writeback: Python 2.7.13.

Btrfs Linux 4.10 RAID 4-Disk SSDsqlite: Default Test Directoryfio: Rand Read - Libaio - No - Yes - 4KB - Default Test Directory - MB/sfio: Rand Write - Libaio - No - Yes - 4KB - Default Test Directory - MB/sfio: Seq Read - Libaio - No - Yes - 4KB - Default Test Directory - MB/sfio: Seq Write - Libaio - No - Yes - 4KB - Default Test Directory - MB/sfs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizeblogbench: Writecompilebench: Compilecompilebench: Initial Createpgbench: On-Disk - Normal Load - Read WriteSingle Disk2-Disk RAID02-Disk RAID14-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID6seistro-RAID5-8disks-ext4-4.12.14.12.1-seistro-raid10-4disks4.12.1-seistro-raid10-4disks-ext44.10.0-pangaia-ext4-hd-orderedseistro-RAID5-8Disks-ext4-4.12.1-upgradeFirmwareseistro-RAID10-4SSD-ext4-4.12.1-upgradeFirmwareseistro-RAID10-4SSD-ext4-4.12.5-WB-Direct-NORA4.10-pangain-ext4-hd-writeback85.56210.3791.71243.9190.3661.0350.7346.634942816.97126.471196.7287.56439.91126.24525.49125.8878.1780.6074.556617986.31271.681626.47105.90213.4649.58331.3249.5059.3542.9542.054939784.53118.821147.8385.22720.89160.19719.56166.98121.72132.25135.7775371413.04296.612887.0091.33413.4695.64267.38105.2978.5761.3761.425542915.54226.87972.5297.09424.44103.63558.34116.2763.1765.6765.636420903.57246.891427.30107.49585.34156.98678.77113.3382.83100.8384.2870791001.93263.942012.79122.07422.97119.44591.20101.5883.7066.6057.655808878.04237.061303.6012.992.326.282.40103.6761.90184.123.98245.69149.18254.28339.34399.68424.50354.45198761140.21177.50112.32549.141.791.09179.11149.0822.7064.8023.472043530.46369.6099.764.5115.319.06310.42346.28406.80567.43423.68182911179.78165.054.47232.14137.96250.58320.08372.45433.03359.57198841166.99176.61112.124.00421.30143.40424.76341.06358.70420.30348.63205911168.47170.80112.0516.371.861.02174.30148.72105.03152.93107.401935529.66355.19131.04OpenBenchmarking.org

SQLite

Test Target: Default Test Directory

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.8.10.2Test Target: Default Test DirectorySingle Disk2-Disk RAID02-Disk RAID14-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID6seistro-RAID5-8disks-ext4-4.12.14.12.1-seistro-raid10-4disks-ext44.10.0-pangaia-ext4-hd-orderedseistro-RAID5-8Disks-ext4-4.12.1-upgradeFirmwareseistro-RAID10-4SSD-ext4-4.12.1-upgradeFirmwareseistro-RAID10-4SSD-ext4-4.12.5-WB-Direct-NORA4.10-pangain-ext4-hd-writeback120240360480600SE +/- 1.23, N = 3SE +/- 1.66, N = 3SE +/- 0.24, N = 3SE +/- 1.37, N = 6SE +/- 2.29, N = 6SE +/- 2.82, N = 6SE +/- 1.92, N = 6SE +/- 2.42, N = 6SE +/- 1.72, N = 6SE +/- 0.03, N = 3SE +/- 9.28, N = 6SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.47, N = 685.5687.56105.9085.2291.3397.09107.49122.0712.993.98549.144.514.474.0016.371. (CC) gcc options: -O2 -ldl -lpthread

Flexible IO Tester

Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/s

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/sSingle Disk2-Disk RAID02-Disk RAID14-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID6seistro-RAID5-8disks-ext4-4.12.14.12.1-seistro-raid10-4disks-ext44.10.0-pangaia-ext4-hd-orderedseistro-RAID5-8Disks-ext4-4.12.1-upgradeFirmwareseistro-RAID10-4SSD-ext4-4.12.1-upgradeFirmwareseistro-RAID10-4SSD-ext4-4.12.5-WB-Direct-NORA4.10-pangain-ext4-hd-writeback160320480640800SE +/- 3.38, N = 3SE +/- 1.57, N = 3SE +/- 4.00, N = 3SE +/- 1.34, N = 3SE +/- 1.02, N = 3SE +/- 2.93, N = 3SE +/- 10.32, N = 6SE +/- 0.15, N = 3SE +/- 0.10, N = 6SE +/- 0.95, N = 3SE +/- 0.00, N = 3SE +/- 1.19, N = 6SE +/- 3.52, N = 3SE +/- 11.82, N = 6SE +/- 0.00, N = 3210.37439.91213.46720.89413.46424.44585.34422.972.32245.691.7915.31232.14421.301.86-ll-ll-ll-ll-ll-ll-ll-ll-ll-ll-ll1. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/s

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/sSingle Disk2-Disk RAID02-Disk RAID14-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID6seistro-RAID5-8disks-ext4-4.12.14.12.1-seistro-raid10-4disks-ext44.10.0-pangaia-ext4-hd-orderedseistro-RAID5-8Disks-ext4-4.12.1-upgradeFirmwareseistro-RAID10-4SSD-ext4-4.12.1-upgradeFirmwareseistro-RAID10-4SSD-ext4-4.12.5-WB-Direct-NORA4.10-pangain-ext4-hd-writeback4080120160200SE +/- 1.37, N = 3SE +/- 17.35, N = 6SE +/- 12.34, N = 6SE +/- 9.64, N = 6SE +/- 11.89, N = 6SE +/- 18.82, N = 6SE +/- 2.32, N = 3SE +/- 12.68, N = 6SE +/- 0.11, N = 6SE +/- 2.27, N = 4SE +/- 0.13, N = 3SE +/- 1.40, N = 3SE +/- 0.42, N = 391.71126.2449.58160.1995.64103.63156.98119.446.28149.181.099.06137.96143.401.02-ll-ll-ll-ll-ll-ll-ll-ll-ll-ll-ll1. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/s

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/sSingle Disk2-Disk RAID02-Disk RAID14-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID6seistro-RAID5-8disks-ext4-4.12.14.12.1-seistro-raid10-4disks-ext44.10.0-pangaia-ext4-hd-orderedseistro-RAID5-8Disks-ext4-4.12.1-upgradeFirmwareseistro-RAID10-4SSD-ext4-4.12.1-upgradeFirmwareseistro-RAID10-4SSD-ext4-4.12.5-WB-Direct-NORA4.10-pangain-ext4-hd-writeback160320480640800SE +/- 4.26, N = 4SE +/- 2.48, N = 3SE +/- 5.25, N = 3SE +/- 12.16, N = 3SE +/- 27.92, N = 6SE +/- 57.02, N = 6SE +/- 3.19, N = 3SE +/- 28.72, N = 6SE +/- 0.09, N = 6SE +/- 1.47, N = 3SE +/- 0.95, N = 3SE +/- 6.71, N = 6SE +/- 3.47, N = 6SE +/- 10.44, N = 6SE +/- 2.00, N = 3243.91525.49331.32719.56267.38558.34678.77591.202.40254.28179.11310.42250.58424.76174.30-ll-ll-ll-ll-ll-ll-ll-ll-ll-ll-ll-ll1. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/s

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/sSingle Disk2-Disk RAID02-Disk RAID14-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID6seistro-RAID5-8disks-ext4-4.12.14.12.1-seistro-raid10-4disks-ext44.10.0-pangaia-ext4-hd-orderedseistro-RAID5-8Disks-ext4-4.12.1-upgradeFirmwareseistro-RAID10-4SSD-ext4-4.12.1-upgradeFirmwareseistro-RAID10-4SSD-ext4-4.12.5-WB-Direct-NORA4.10-pangain-ext4-hd-writeback80160240320400SE +/- 1.49, N = 3SE +/- 9.93, N = 6SE +/- 10.95, N = 6SE +/- 2.96, N = 6SE +/- 17.02, N = 6SE +/- 15.32, N = 6SE +/- 14.60, N = 6SE +/- 10.38, N = 6SE +/- 10.76, N = 6SE +/- 5.46, N = 3SE +/- 0.32, N = 3SE +/- 1.97, N = 3SE +/- 4.65, N = 3SE +/- 8.30, N = 6SE +/- 0.31, N = 390.36125.8849.50166.98105.29116.27113.33101.58103.67339.34149.08346.28320.08341.06148.72-ll-ll-ll-ll-ll-ll-ll-ll-ll-ll-ll-ll1. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

FS-Mark

Test: 1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeSingle Disk2-Disk RAID02-Disk RAID14-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID6seistro-RAID5-8disks-ext4-4.12.14.12.1-seistro-raid10-4disks-ext44.10.0-pangaia-ext4-hd-orderedseistro-RAID5-8Disks-ext4-4.12.1-upgradeFirmwareseistro-RAID10-4SSD-ext4-4.12.1-upgradeFirmwareseistro-RAID10-4SSD-ext4-4.12.5-WB-Direct-NORA4.10-pangain-ext4-hd-writeback90180270360450SE +/- 11.55, N = 6SE +/- 3.66, N = 6SE +/- 16.45, N = 6SE +/- 21.94, N = 6SE +/- 16.14, N = 6SE +/- 9.26, N = 6SE +/- 10.74, N = 6SE +/- 15.67, N = 6SE +/- 3.67, N = 6SE +/- 11.77, N = 6SE +/- 0.25, N = 3SE +/- 11.31, N = 6SE +/- 15.85, N = 6SE +/- 16.72, N = 6SE +/- 1.68, N = 361.0378.1759.35121.7278.5763.1782.8383.7061.90399.6822.70406.80372.45358.70105.031. (CC) gcc options: -static

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsSingle Disk2-Disk RAID02-Disk RAID14-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID6seistro-RAID5-8disks-ext4-4.12.14.12.1-seistro-raid10-4disks-ext44.10.0-pangaia-ext4-hd-orderedseistro-RAID5-8Disks-ext4-4.12.1-upgradeFirmwareseistro-RAID10-4SSD-ext4-4.12.1-upgradeFirmwareseistro-RAID10-4SSD-ext4-4.12.5-WB-Direct-NORA4.10-pangain-ext4-hd-writeback120240360480600SE +/- 0.32, N = 3SE +/- 1.78, N = 6SE +/- 0.83, N = 6SE +/- 7.24, N = 6SE +/- 1.36, N = 6SE +/- 1.23, N = 6SE +/- 2.44, N = 6SE +/- 1.30, N = 3SE +/- 13.22, N = 6SE +/- 7.03, N = 3SE +/- 0.46, N = 3SE +/- 28.34, N = 6SE +/- 4.43, N = 3SE +/- 6.08, N = 3SE +/- 1.99, N = 350.7380.6042.95132.2561.3765.67100.8366.60184.12424.5064.80567.43433.03420.30152.931. (CC) gcc options: -static

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeSingle Disk2-Disk RAID02-Disk RAID14-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID64.12.1-seistro-raid10-4disks-ext44.10.0-pangaia-ext4-hd-orderedseistro-RAID5-8Disks-ext4-4.12.1-upgradeFirmwareseistro-RAID10-4SSD-ext4-4.12.1-upgradeFirmwareseistro-RAID10-4SSD-ext4-4.12.5-WB-Direct-NORA4.10-pangain-ext4-hd-writeback90180270360450SE +/- 0.66, N = 6SE +/- 7.08, N = 6SE +/- 2.07, N = 6SE +/- 19.35, N = 6SE +/- 5.71, N = 6SE +/- 5.47, N = 6SE +/- 3.17, N = 6SE +/- 4.24, N = 6SE +/- 23.81, N = 6SE +/- 0.13, N = 3SE +/- 13.86, N = 6SE +/- 17.89, N = 6SE +/- 16.19, N = 6SE +/- 1.22, N = 346.6374.5542.05135.7761.4265.6384.2857.65354.4523.47423.68359.57348.63107.401. (CC) gcc options: -static

BlogBench

Test: Write

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: WriteSingle Disk2-Disk RAID02-Disk RAID14-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID64.12.1-seistro-raid10-4disks-ext44.10.0-pangaia-ext4-hd-orderedseistro-RAID5-8Disks-ext4-4.12.1-upgradeFirmwareseistro-RAID10-4SSD-ext4-4.12.1-upgradeFirmwareseistro-RAID10-4SSD-ext4-4.12.5-WB-Direct-NORA4.10-pangain-ext4-hd-writeback4K8K12K16K20KSE +/- 38.37, N = 3SE +/- 39.06, N = 3SE +/- 20.76, N = 3SE +/- 92.04, N = 3SE +/- 50.28, N = 3SE +/- 106.36, N = 3SE +/- 88.83, N = 3SE +/- 89.05, N = 6SE +/- 856.14, N = 6SE +/- 31.38, N = 4SE +/- 1632.72, N = 6SE +/- 590.09, N = 6SE +/- 894.22, N = 6SE +/- 27.20, N = 34942661749397537554264207079580819876204318291198842059119351. (CC) gcc options: -O2 -pthread

Compile Bench

Test: Compile

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileSingle Disk2-Disk RAID02-Disk RAID14-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID64.12.1-seistro-raid10-4disks-ext44.10.0-pangaia-ext4-hd-orderedseistro-RAID5-8Disks-ext4-4.12.1-upgradeFirmwareseistro-RAID10-4SSD-ext4-4.12.1-upgradeFirmwareseistro-RAID10-4SSD-ext4-4.12.5-WB-Direct-NORA4.10-pangain-ext4-hd-writeback30060090012001500SE +/- 1.60, N = 3SE +/- 24.76, N = 6SE +/- 13.08, N = 4SE +/- 41.11, N = 6SE +/- 13.10, N = 6SE +/- 21.92, N = 6SE +/- 33.99, N = 6SE +/- 4.10, N = 3SE +/- 16.95, N = 5SE +/- 12.52, N = 6SE +/- 7.68, N = 3SE +/- 5.27, N = 3SE +/- 5.39, N = 3SE +/- 16.67, N = 6816.97986.31784.531413.04915.54903.571001.93878.041140.21530.461179.781166.991168.47529.66

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateSingle Disk2-Disk RAID02-Disk RAID14-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID64.12.1-seistro-raid10-4disks-ext44.10.0-pangaia-ext4-hd-orderedseistro-RAID5-8Disks-ext4-4.12.1-upgradeFirmwareseistro-RAID10-4SSD-ext4-4.12.1-upgradeFirmwareseistro-RAID10-4SSD-ext4-4.12.5-WB-Direct-NORA4.10-pangain-ext4-hd-writeback80160240320400SE +/- 30.50, N = 3SE +/- 7.91, N = 3SE +/- 8.51, N = 3SE +/- 4.29, N = 3SE +/- 22.14, N = 3SE +/- 18.71, N = 3SE +/- 9.00, N = 3SE +/- 18.38, N = 3SE +/- 4.64, N = 3SE +/- 7.87, N = 3SE +/- 10.51, N = 3SE +/- 3.79, N = 3SE +/- 6.58, N = 3SE +/- 29.43, N = 3126.47271.68118.82296.61226.87246.89263.94237.06177.50369.60165.05176.61170.80355.19

PostgreSQL pgbench

Scaling: On-Disk - Test: Normal Load - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 9.4.3Scaling: On-Disk - Test: Normal Load - Mode: Read WriteSingle Disk2-Disk RAID02-Disk RAID14-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID64.12.1-seistro-raid10-4disks-ext44.10.0-pangaia-ext4-hd-orderedseistro-RAID10-4SSD-ext4-4.12.1-upgradeFirmwareseistro-RAID10-4SSD-ext4-4.12.5-WB-Direct-NORA4.10-pangain-ext4-hd-writeback6001200180024003000SE +/- 52.22, N = 6SE +/- 94.97, N = 6SE +/- 0.11, N = 3SE +/- 1.09, N = 3SE +/- 0.15, N = 3SE +/- 0.11, N = 3SE +/- 1.49, N = 31196.721626.471147.832887.00972.521427.302012.791303.60112.3299.76112.12112.05131.041. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -pthread -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm


Phoronix Test Suite v10.8.4