Linux 4.11 F2FS Multi-Disk Testing

F2FS multi disk tests on Toshiba TR-150 multiple SSDs with Linux 4.11 kernel and latest f2fs-tools. Tests for a future article on Phoronix.com.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1704220-TR-F2FSMULTI76
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

CPU Massive 3 Tests
Database Test Suite 2 Tests
Disk Test Suite 3 Tests
Server 3 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
Single Disk
April 19 2017
 
Two Disks
April 21 2017
 
Three Disks
April 21 2017
 
Four Disks
April 21 2017
 
Invert Hiding All Results Option
 

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

Single Disk

Environment Notes: LIBGL_ALWAYS_SOFTWARE=1
Compiler Notes: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v
Disk Notes: CFQ / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,relatime,rw,user_xattr
Processor Notes: Scaling Governor: intel_pstate powersave
System Notes: Python 2.7.13.

Two Disks

Three Disks

Four Disks

Processor: Intel Core i7-6800K @ 3.80GHz (12 Cores), Motherboard: MSI X99A WORKSTATION (MS-7A54) v1.0, Chipset: Intel Xeon E7 v4/Xeon, Memory: 16384MB, Disk: 120GB Samsung SSD 850 + 4 x 120GB TOSHIBA-TR150, Graphics: LLVMpipe, Audio: Realtek ALC1150, Monitor: ASUS PB278, Network: Intel Connection

OS: Ubuntu 17.04, Kernel: 4.11.0-999-generic (x86_64) 20170418, Desktop: Unity 7.5.0, Display Server: X Server 1.19.3, Display Driver: nouveau 1.0.14, OpenGL: 3.3 Mesa 17.0.3 Gallium 0.4 (LLVM 4.0 256 bits), Vulkan: 1.0.42, Compiler: GCC 6.3.0 20170406, File-System: f2fs, Screen Resolution: 2560x1440

Linux 4.11 F2FS Multi-Disk TestingOpenBenchmarking.orgPhoronix Test SuiteIntel Core i7-6800K @ 3.80GHz (12 Cores)MSI X99A WORKSTATION (MS-7A54) v1.0Intel Xeon E7 v4/Xeon16384MB120GB Samsung SSD 850 + 4 x 120GB TOSHIBA-TR150LLVMpipeRealtek ALC1150ASUS PB278Intel ConnectionUbuntu 17.044.11.0-999-generic (x86_64) 20170418Unity 7.5.0X Server 1.19.3nouveau 1.0.143.3 Mesa 17.0.3 Gallium 0.4 (LLVM 4.0 256 bits)1.0.42GCC 6.3.0 20170406f2fs2560x1440ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLVulkanCompilerFile-SystemScreen ResolutionLinux 4.11 F2FS Multi-Disk Testing BenchmarksSystem Logs- LIBGL_ALWAYS_SOFTWARE=1- --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - CFQ / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,relatime,rw,user_xattr - Scaling Governor: intel_pstate powersave- Python 2.7.13.

Single DiskTwo DisksThree DisksFour DisksResult OverviewPhoronix Test Suite100%145%191%236%PostgreSQL pgbenchSQLiteBlogBenchFS-MarkCompile BenchFS-MarkFS-MarkOn-Disk - Normal Load - Read WriteD.T.DWrite1.F.1.SInitial Create5.F.1.S.4.T4.F.3.S.D.1.S

Linux 4.11 F2FS Multi-Disk Testingsqlite: Default Test Directoryfs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizeblogbench: Writecompilebench: Initial Createpgbench: On-Disk - Normal Load - Read WriteSingle DiskTwo DisksThree DisksFour Disks39.7372.5252.6745.974249426.391281.8632.1777.1247.8744.974575409.721416.7531.1973.9748.0044.555144431.91577.4531.5265.7747.0044.185070480.081622.90OpenBenchmarking.org

SQLite

This is a simple benchmark of SQLite. At present this test profile just measures the time to perform a pre-defined number of insertions on an indexed database. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.8.10.2Test Target: Default Test DirectorySingle DiskTwo DisksThree DisksFour Disks918273645SE +/- 0.39, N = 3SE +/- 0.51, N = 3SE +/- 0.56, N = 3SE +/- 0.16, N = 339.7332.1731.1931.521. (CC) gcc options: -O2 -ldl -lpthread
OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.8.10.2Test Target: Default Test DirectorySingle DiskTwo DisksThree DisksFour Disks816243240Min: 38.96 / Avg: 39.73 / Max: 40.18Min: 31.34 / Avg: 32.17 / Max: 33.1Min: 30.44 / Avg: 31.19 / Max: 32.29Min: 31.27 / Avg: 31.52 / Max: 31.831. (CC) gcc options: -O2 -ldl -lpthread

FS-Mark

FS_Mark is designed to test a system's file-system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeSingle DiskTwo DisksThree DisksFour Disks20406080100SE +/- 16.03, N = 6SE +/- 19.95, N = 6SE +/- 18.21, N = 6SE +/- 13.51, N = 672.5277.1273.9765.771. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeSingle DiskTwo DisksThree DisksFour Disks1530456075Min: 45.9 / Avg: 72.52 / Max: 148.4Min: 44 / Avg: 77.12 / Max: 144.1Min: 39 / Avg: 73.97 / Max: 134Min: 43.6 / Avg: 65.77 / Max: 1121. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsSingle DiskTwo DisksThree DisksFour Disks1224364860SE +/- 0.27, N = 3SE +/- 0.58, N = 3SE +/- 0.40, N = 3SE +/- 1.22, N = 652.6747.8748.0047.001. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsSingle DiskTwo DisksThree DisksFour Disks1122334455Min: 52.4 / Avg: 52.67 / Max: 53.2Min: 46.8 / Avg: 47.87 / Max: 48.8Min: 47.6 / Avg: 48 / Max: 48.8Min: 44 / Avg: 47 / Max: 521. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeSingle DiskTwo DisksThree DisksFour Disks1020304050SE +/- 0.70, N = 6SE +/- 0.62, N = 6SE +/- 0.67, N = 6SE +/- 0.73, N = 645.9744.9744.5544.181. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeSingle DiskTwo DisksThree DisksFour Disks918273645Min: 45 / Avg: 45.97 / Max: 49.4Min: 43.4 / Avg: 44.97 / Max: 47.5Min: 43.2 / Avg: 44.55 / Max: 47.7Min: 42.7 / Avg: 44.18 / Max: 47.71. (CC) gcc options: -static

BlogBench

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: WriteSingle DiskTwo DisksThree DisksFour Disks11002200330044005500SE +/- 38.37, N = 3SE +/- 65.60, N = 5SE +/- 240.01, N = 6SE +/- 94.11, N = 342494575514450701. (CC) gcc options: -O2 -pthread
OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: WriteSingle DiskTwo DisksThree DisksFour Disks9001800270036004500Min: 4195 / Avg: 4248.67 / Max: 4323Min: 4400 / Avg: 4574.8 / Max: 4716Min: 4396 / Avg: 5143.83 / Max: 5740Min: 4884 / Avg: 5070 / Max: 51881. (CC) gcc options: -O2 -pthread

Compile Bench

Compilebench tries to age a filesystem by simulating some of the disk IO common in creating, compiling, patching, stating and reading kernel trees. It indirectly measures how well filesystems can maintain directory locality as the disk fills up and directories age. This current test is setup to use the makej mode with 10 initial directories Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateSingle DiskTwo DisksThree DisksFour Disks100200300400500SE +/- 34.60, N = 6SE +/- 23.46, N = 6SE +/- 24.26, N = 6SE +/- 28.20, N = 6426.39409.72431.91480.08
OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateSingle DiskTwo DisksThree DisksFour Disks90180270360450Min: 328.79 / Avg: 426.39 / Max: 530.75Min: 365.77 / Avg: 409.72 / Max: 493.33Min: 368.6 / Avg: 431.91 / Max: 504.23Min: 389.35 / Avg: 480.08 / Max: 542.5

PostgreSQL pgbench

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 9.4.3Scaling: On-Disk - Test: Normal Load - Mode: Read WriteSingle DiskTwo DisksThree DisksFour Disks300600900120015001281.861416.75577.451622.901. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -pthread -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

Single Disk

Environment Notes: LIBGL_ALWAYS_SOFTWARE=1
Compiler Notes: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v
Disk Notes: CFQ / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,relatime,rw,user_xattr
Processor Notes: Scaling Governor: intel_pstate powersave
System Notes: Python 2.7.13.

Testing initiated at 19 April 2017 15:48 by user pts.

Two Disks

Environment Notes: LIBGL_ALWAYS_SOFTWARE=1
Compiler Notes: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v
Disk Notes: CFQ / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,relatime,rw,user_xattr
Processor Notes: Scaling Governor: intel_pstate powersave
System Notes: Python 2.7.13.

Testing initiated at 21 April 2017 12:44 by user phoronix.

Three Disks

Environment Notes: LIBGL_ALWAYS_SOFTWARE=1
Compiler Notes: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v
Disk Notes: CFQ / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,relatime,rw,user_xattr
Processor Notes: Scaling Governor: intel_pstate powersave
System Notes: Python 2.7.13.

Testing initiated at 21 April 2017 14:53 by user phoronix.

Four Disks

Processor: Intel Core i7-6800K @ 3.80GHz (12 Cores), Motherboard: MSI X99A WORKSTATION (MS-7A54) v1.0, Chipset: Intel Xeon E7 v4/Xeon, Memory: 16384MB, Disk: 120GB Samsung SSD 850 + 4 x 120GB TOSHIBA-TR150, Graphics: LLVMpipe, Audio: Realtek ALC1150, Monitor: ASUS PB278, Network: Intel Connection

OS: Ubuntu 17.04, Kernel: 4.11.0-999-generic (x86_64) 20170418, Desktop: Unity 7.5.0, Display Server: X Server 1.19.3, Display Driver: nouveau 1.0.14, OpenGL: 3.3 Mesa 17.0.3 Gallium 0.4 (LLVM 4.0 256 bits), Vulkan: 1.0.42, Compiler: GCC 6.3.0 20170406, File-System: f2fs, Screen Resolution: 2560x1440

Environment Notes: LIBGL_ALWAYS_SOFTWARE=1
Compiler Notes: --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v
Disk Notes: CFQ / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,relatime,rw,user_xattr
Processor Notes: Scaling Governor: intel_pstate powersave
System Notes: Python 2.7.13.

Testing initiated at 21 April 2017 17:44 by user phoronix.