Btrfs RAID Linux 4.12 Disk File-System Testing

Btrfs RAID 0/1/5/6/10 file-system testing on Toshiba TR-150 SSD with Linux 4.12. Tests for a future article on Phoronix.com.

HTML result view exported from: https://openbenchmarking.org/result/1710189-TY-1705189TR66.

Btrfs RAID Linux 4.12 Disk File-System TestingProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLVulkanCompilerFile-SystemScreen Resolution1-Disk2-Disk RAID02-Disk RAID14-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID63-Disk NVMe RAID0Intel Core i7-6800K @ 3.80GHz (12 Cores)MSI X99A WORKSTATION (MS-7A54) v1.0Intel Xeon E7 v4/Xeon16384MB120GB Samsung SSD 850 + 4 x 120GB TOSHIBA-TR150NVIDIA GeForce GTX TITAN X 12288MBRealtek ALC1150ASUS PB278Intel ConnectionUbuntu 17.044.12.0-999-generic (x86_64) 20170515Unity 7.5.0X Server 1.19.3nouveau 1.0.144.3 Mesa 17.0.3 Gallium 0.41.0.42GCC 6.3.0 20170406btrfs2560x1440AMD Ryzen Threadripper 1950X 16-Core @ 3.40GHz (32 Cores)ASRock X399 TaichiAMD Family 17h32768MB3 x 1000GB Samsung SSD 960 EVO 1TBAMD Radeon RX Vega 8176MBRealtek ALC1220OMEN by HP 32Intel I211 Gigabit Connection + Intel Device 24fbArch Linux4.13.0-e16e1739c334 (x86_64)GNOME Shell 3.26.1Waylandamdgpu 1.4.0GCC 7.2.0OpenBenchmarking.orgCompiler Details- 1-Disk: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - 2-Disk RAID0: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - 2-Disk RAID1: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - 4-Disk RAID0: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - 4-Disk RAID1: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - 4-Disk RAID10: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - 4-Disk RAID5: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - 4-Disk RAID6: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - 3-Disk NVMe RAID0: --disable-libssp --disable-libstdcxx-pch --disable-libunwind-exceptions --disable-multilib --disable-werror --enable-__cxa_atexit --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-default-ssp --enable-gnu-indirect-function --enable-gnu-unique-object --enable-install-libiberty --enable-languages=c,c++,ada,fortran,go,lto,objc,obj-c++ --enable-libmpx --enable-lto --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-isl --with-linker-hash-style=gnuDisk Details- 1-Disk: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5- 2-Disk RAID0: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID0- 2-Disk RAID1: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID1- 4-Disk RAID0: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID0- 4-Disk RAID1: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID1- 4-Disk RAID10: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID10- 4-Disk RAID5: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID5- 4-Disk RAID6: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID6- 3-Disk NVMe RAID0: NONE / compress=lzo,relatime,rw,space_cache,ssd,subvol=/@home,subvolid=259 / RAID0Processor Details- 1-Disk: Scaling Governor: intel_pstate powersave- 2-Disk RAID0: Scaling Governor: intel_pstate powersave- 2-Disk RAID1: Scaling Governor: intel_pstate powersave- 4-Disk RAID0: Scaling Governor: intel_pstate powersave- 4-Disk RAID1: Scaling Governor: intel_pstate powersave- 4-Disk RAID10: Scaling Governor: intel_pstate powersave- 4-Disk RAID5: Scaling Governor: intel_pstate powersave- 4-Disk RAID6: Scaling Governor: intel_pstate powersave- 3-Disk NVMe RAID0: Scaling Governor: acpi-cpufreq schedutilSystem Details- 1-Disk: Python 2.7.13.- 2-Disk RAID0: Python 2.7.13.- 2-Disk RAID1: Python 2.7.13.- 4-Disk RAID0: Python 2.7.13.- 4-Disk RAID1: Python 2.7.13.- 4-Disk RAID10: Python 2.7.13.- 4-Disk RAID5: Python 2.7.13.- 4-Disk RAID6: Python 2.7.13.- 3-Disk NVMe RAID0: Python 3.6.2.Environment Details- 3-Disk NVMe RAID0: GJS_DEBUG_OUTPUT=stderr GJS_DEBUG_TOPICS=JS ERROR;JS LOG

Btrfs RAID Linux 4.12 Disk File-System Testingsqlite: Default Test Directoryfs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizeblogbench: Writecompilebench: Initial Createpgbench: On-Disk - Normal Load - Read Write1-Disk2-Disk RAID02-Disk RAID14-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID63-Disk NVMe RAID086.3665.3850.4042.184908131.08923.3487.70124.6788.8380.856647227.781323.94102.6466.3743.4740.834858131.64980.7885.46168.12135.83119.477355256.483005.0488.6470.8060.6847.236036197.271018.5193.8695.7072.3764.276637205.871745.23103.16123.2597.1880.556735237.332183.54121.2692.9268.9362.875890234.371480.18119.14203.40490.17201.878098OpenBenchmarking.org

SQLite

Test Target: Default Test Directory

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.8.10.2Test Target: Default Test Directory1-Disk2-Disk RAID02-Disk RAID14-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID63-Disk NVMe RAID0306090120150SE +/- 1.31, N = 3SE +/- 1.66, N = 3SE +/- 0.78, N = 3SE +/- 1.64, N = 6SE +/- 2.01, N = 6SE +/- 1.57, N = 3SE +/- 1.98, N = 3SE +/- 3.06, N = 6SE +/- 0.18, N = 386.3687.70102.6485.4688.6493.86103.16121.26119.14-lreadline -lcurses1. (CC) gcc options: -O2 -ldl -lpthread

FS-Mark

Test: 1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Size1-Disk2-Disk RAID02-Disk RAID14-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID63-Disk NVMe RAID04080120160200SE +/- 12.76, N = 6SE +/- 20.08, N = 6SE +/- 16.13, N = 6SE +/- 13.14, N = 6SE +/- 16.22, N = 6SE +/- 16.36, N = 6SE +/- 14.31, N = 6SE +/- 12.64, N = 6SE +/- 1.87, N = 365.38124.6766.37168.1270.8095.70123.2592.92203.401. (CC) gcc options: -static

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 Threads1-Disk2-Disk RAID02-Disk RAID14-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID63-Disk NVMe RAID0110220330440550SE +/- 0.35, N = 3SE +/- 1.20, N = 3SE +/- 0.53, N = 3SE +/- 7.18, N = 6SE +/- 1.72, N = 6SE +/- 1.58, N = 6SE +/- 2.95, N = 6SE +/- 2.23, N = 6SE +/- 1.83, N = 350.4088.8343.47135.8360.6872.3797.1868.93490.171. (CC) gcc options: -static

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB Size1-Disk2-Disk RAID02-Disk RAID14-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID63-Disk NVMe RAID04080120160200SE +/- 0.57, N = 6SE +/- 5.44, N = 6SE +/- 1.61, N = 6SE +/- 11.17, N = 6SE +/- 0.82, N = 3SE +/- 3.29, N = 6SE +/- 5.53, N = 6SE +/- 7.86, N = 6SE +/- 2.53, N = 342.1880.8540.83119.4747.2364.2780.5562.87201.871. (CC) gcc options: -static

BlogBench

Test: Write

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: Write1-Disk2-Disk RAID02-Disk RAID14-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID63-Disk NVMe RAID02K4K6K8K10KSE +/- 49.01, N = 3SE +/- 40.84, N = 3SE +/- 89.86, N = 3SE +/- 112.64, N = 4SE +/- 97.00, N = 3SE +/- 40.00, N = 3SE +/- 131.98, N = 6SE +/- 168.16, N = 6SE +/- 29.59, N = 34908664748587355603666376735589080981. (CC) gcc options: -O2 -pthread

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial Create1-Disk2-Disk RAID02-Disk RAID14-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID660120180240300SE +/- 16.55, N = 6SE +/- 1.68, N = 3SE +/- 12.05, N = 6SE +/- 4.30, N = 3SE +/- 3.15, N = 4SE +/- 5.97, N = 6SE +/- 6.19, N = 6SE +/- 5.24, N = 6131.08227.78131.64256.48197.27205.87237.33234.37

PostgreSQL pgbench

Scaling: On-Disk - Test: Normal Load - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 9.4.3Scaling: On-Disk - Test: Normal Load - Mode: Read Write1-Disk2-Disk RAID02-Disk RAID14-Disk RAID04-Disk RAID14-Disk RAID104-Disk RAID54-Disk RAID66001200180024003000923.341323.94980.783005.041018.511745.232183.541480.181. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -pthread -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

Phoronix Test Suite v10.8.4