Linux 4.11 F2FS vs. Btrfs Multi-Disk Testing

F2FS multi disk tests on Toshiba TR-150 multiple SSDs with Linux 4.11 kernel and latest f2fs-tools. Tests for a future article on Phoronix.com.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1704236-TR-F2FSMULTI78
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

CPU Massive 3 Tests
Database Test Suite 2 Tests
Disk Test Suite 3 Tests
Server 3 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
F2FS - Single Disk
April 19 2017
 
F2FS - Two Disks
April 21 2017
 
F2FS - Three Disks
April 21 2017
 
F2FS - Four Disks
April 21 2017
 
Btrfs - Single Disk
April 21 2017
 
Btrfs - 2 Disk RAID0
April 22 2017
 
Btrfs - 4 Disk RAID0
April 22 2017
 
Btrfs - 4 Disk RAID10
April 22 2017
 
Btrfs - 4 Disk RAID1
April 22 2017
 
Invert Hiding All Results Option
 

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


Linux 4.11 F2FS vs. Btrfs Multi-Disk TestingOpenBenchmarking.orgPhoronix Test SuiteIntel Core i7-6800K @ 3.80GHz (12 Cores)MSI X99A WORKSTATION (MS-7A54) v1.0Intel Xeon E7 v4/Xeon16384MB120GB Samsung SSD 850 + 4 x 120GB TOSHIBA-TR150LLVMpipeRealtek ALC1150ASUS PB278Intel ConnectionUbuntu 17.044.11.0-999-generic (x86_64) 20170418Unity 7.5.0X Server 1.19.3nouveau 1.0.143.3 Mesa 17.0.3 Gallium 0.4 (LLVM 4.0 256 bits)1.0.42GCC 6.3.0 20170406f2fsbtrfs2560x1440ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLVulkanCompilerFile-SystemsScreen ResolutionLinux 4.11 F2FS Vs. Btrfs Multi-Disk Testing BenchmarksSystem Logs- LIBGL_ALWAYS_SOFTWARE=1- --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v - F2FS - Single Disk: CFQ / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,relatime,rw,user_xattr - F2FS - Two Disks: CFQ / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,relatime,rw,user_xattr - F2FS - Three Disks: CFQ / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,relatime,rw,user_xattr - F2FS - Four Disks: CFQ / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,relatime,rw,user_xattr - Btrfs - Single Disk: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5- Btrfs - 2 Disk RAID0: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID0- Btrfs - 4 Disk RAID0: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID0- Btrfs - 4 Disk RAID10: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID10- Btrfs - 4 Disk RAID1: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5 / RAID1- Scaling Governor: intel_pstate powersave- Python 2.7.13.

F2FS - Single DiskF2FS - Two DisksF2FS - Three DisksF2FS - Four DisksBtrfs - Single DiskBtrfs - 2 Disk RAID0Btrfs - 4 Disk RAID0Btrfs - 4 Disk RAID10Btrfs - 4 Disk RAID1Result OverviewPhoronix Test Suite100%171%241%312%PostgreSQL pgbenchCompile BenchSQLiteFS-MarkFS-MarkFS-MarkBlogBenchOn-Disk - Normal Load - Read WriteInitial CreateD.T.D5.F.1.S.4.T1.F.1.S4.F.3.S.D.1.SWrite

Linux 4.11 F2FS vs. Btrfs Multi-Disk Testingsqlite: Default Test Directoryfs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizeblogbench: Writecompilebench: Initial Createpgbench: On-Disk - Normal Load - Read WriteF2FS - Single DiskF2FS - Two DisksF2FS - Three DisksF2FS - Four DisksBtrfs - Single DiskBtrfs - 2 Disk RAID0Btrfs - 4 Disk RAID0Btrfs - 4 Disk RAID10Btrfs - 4 Disk RAID139.7372.5252.6745.974249426.391281.8632.1777.1247.8744.974575409.721416.7531.1973.9748.0044.555144431.91577.4531.5265.7747.0044.185070480.081622.9089.6059.5050.2046.284954148.301095.0689.30129.9584.2877.886651275.551524.5784.39169.07134.02116.577457294.412205.7296.7288.1772.5266.876269237.221435.8590.1175.5361.6856.675942240.611443.91OpenBenchmarking.org

SQLite

This is a simple benchmark of SQLite. At present this test profile just measures the time to perform a pre-defined number of insertions on an indexed database. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.8.10.2Test Target: Default Test DirectoryF2FS - Single DiskF2FS - Two DisksF2FS - Three DisksF2FS - Four DisksBtrfs - Single DiskBtrfs - 2 Disk RAID0Btrfs - 4 Disk RAID0Btrfs - 4 Disk RAID10Btrfs - 4 Disk RAID120406080100SE +/- 0.39, N = 3SE +/- 0.51, N = 3SE +/- 0.56, N = 3SE +/- 0.16, N = 3SE +/- 1.38, N = 6SE +/- 1.46, N = 6SE +/- 1.56, N = 6SE +/- 1.50, N = 6SE +/- 1.81, N = 639.7332.1731.1931.5289.6089.3084.3996.7290.111. (CC) gcc options: -O2 -ldl -lpthread
OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.8.10.2Test Target: Default Test DirectoryF2FS - Single DiskF2FS - Two DisksF2FS - Three DisksF2FS - Four DisksBtrfs - Single DiskBtrfs - 2 Disk RAID0Btrfs - 4 Disk RAID0Btrfs - 4 Disk RAID10Btrfs - 4 Disk RAID120406080100Min: 38.96 / Avg: 39.73 / Max: 40.18Min: 31.34 / Avg: 32.17 / Max: 33.1Min: 30.44 / Avg: 31.19 / Max: 32.29Min: 31.27 / Avg: 31.52 / Max: 31.83Min: 84.49 / Avg: 89.6 / Max: 93.27Min: 85.32 / Avg: 89.3 / Max: 95.48Min: 77.45 / Avg: 84.39 / Max: 88.43Min: 91.69 / Avg: 96.72 / Max: 101.86Min: 84.77 / Avg: 90.11 / Max: 96.581. (CC) gcc options: -O2 -ldl -lpthread

FS-Mark

FS_Mark is designed to test a system's file-system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeF2FS - Single DiskF2FS - Two DisksF2FS - Three DisksF2FS - Four DisksBtrfs - Single DiskBtrfs - 2 Disk RAID0Btrfs - 4 Disk RAID0Btrfs - 4 Disk RAID10Btrfs - 4 Disk RAID14080120160200SE +/- 16.03, N = 6SE +/- 19.95, N = 6SE +/- 18.21, N = 6SE +/- 13.51, N = 6SE +/- 5.93, N = 6SE +/- 19.90, N = 6SE +/- 23.94, N = 6SE +/- 14.83, N = 6SE +/- 15.72, N = 672.5277.1273.9765.7759.50129.95169.0788.1775.531. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeF2FS - Single DiskF2FS - Two DisksF2FS - Three DisksF2FS - Four DisksBtrfs - Single DiskBtrfs - 2 Disk RAID0Btrfs - 4 Disk RAID0Btrfs - 4 Disk RAID10Btrfs - 4 Disk RAID1306090120150Min: 45.9 / Avg: 72.52 / Max: 148.4Min: 44 / Avg: 77.12 / Max: 144.1Min: 39 / Avg: 73.97 / Max: 134Min: 43.6 / Avg: 65.77 / Max: 112Min: 41.2 / Avg: 59.5 / Max: 79.4Min: 76.4 / Avg: 129.95 / Max: 198.3Min: 51.9 / Avg: 169.07 / Max: 216.2Min: 69.3 / Avg: 88.17 / Max: 162Min: 45.6 / Avg: 75.53 / Max: 148.31. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsF2FS - Single DiskF2FS - Two DisksF2FS - Three DisksF2FS - Four DisksBtrfs - Single DiskBtrfs - 2 Disk RAID0Btrfs - 4 Disk RAID0Btrfs - 4 Disk RAID10Btrfs - 4 Disk RAID1306090120150SE +/- 0.27, N = 3SE +/- 0.58, N = 3SE +/- 0.40, N = 3SE +/- 1.22, N = 6SE +/- 0.26, N = 3SE +/- 1.83, N = 6SE +/- 6.52, N = 6SE +/- 1.91, N = 6SE +/- 2.13, N = 652.6747.8748.0047.0050.2084.28134.0272.5261.681. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsF2FS - Single DiskF2FS - Two DisksF2FS - Three DisksF2FS - Four DisksBtrfs - Single DiskBtrfs - 2 Disk RAID0Btrfs - 4 Disk RAID0Btrfs - 4 Disk RAID10Btrfs - 4 Disk RAID1306090120150Min: 52.4 / Avg: 52.67 / Max: 53.2Min: 46.8 / Avg: 47.87 / Max: 48.8Min: 47.6 / Avg: 48 / Max: 48.8Min: 44 / Avg: 47 / Max: 52Min: 49.8 / Avg: 50.2 / Max: 50.7Min: 80.4 / Avg: 84.28 / Max: 90Min: 116.5 / Avg: 134.02 / Max: 162Min: 68 / Avg: 72.52 / Max: 78Min: 56.4 / Avg: 61.68 / Max: 70.81. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeF2FS - Single DiskF2FS - Two DisksF2FS - Three DisksF2FS - Four DisksBtrfs - Single DiskBtrfs - 2 Disk RAID0Btrfs - 4 Disk RAID0Btrfs - 4 Disk RAID10Btrfs - 4 Disk RAID1306090120150SE +/- 0.70, N = 6SE +/- 0.62, N = 6SE +/- 0.67, N = 6SE +/- 0.73, N = 6SE +/- 1.69, N = 6SE +/- 2.77, N = 6SE +/- 9.37, N = 6SE +/- 5.80, N = 6SE +/- 7.02, N = 645.9744.9744.5544.1846.2877.88116.5766.8756.671. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeF2FS - Single DiskF2FS - Two DisksF2FS - Three DisksF2FS - Four DisksBtrfs - Single DiskBtrfs - 2 Disk RAID0Btrfs - 4 Disk RAID0Btrfs - 4 Disk RAID10Btrfs - 4 Disk RAID120406080100Min: 45 / Avg: 45.97 / Max: 49.4Min: 43.4 / Avg: 44.97 / Max: 47.5Min: 43.2 / Avg: 44.55 / Max: 47.7Min: 42.7 / Avg: 44.18 / Max: 47.7Min: 41.3 / Avg: 46.28 / Max: 53.6Min: 66.9 / Avg: 77.88 / Max: 87.6Min: 78.8 / Avg: 116.57 / Max: 150.6Min: 53.1 / Avg: 66.87 / Max: 88.9Min: 35.7 / Avg: 56.67 / Max: 85.41. (CC) gcc options: -static

BlogBench

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: WriteF2FS - Single DiskF2FS - Two DisksF2FS - Three DisksF2FS - Four DisksBtrfs - Single DiskBtrfs - 2 Disk RAID0Btrfs - 4 Disk RAID0Btrfs - 4 Disk RAID10Btrfs - 4 Disk RAID116003200480064008000SE +/- 38.37, N = 3SE +/- 65.60, N = 5SE +/- 240.01, N = 6SE +/- 94.11, N = 3SE +/- 60.92, N = 3SE +/- 81.26, N = 3SE +/- 122.86, N = 3SE +/- 115.85, N = 34249457551445070495466517457626959421. (CC) gcc options: -O2 -pthread
OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: WriteF2FS - Single DiskF2FS - Two DisksF2FS - Three DisksF2FS - Four DisksBtrfs - Single DiskBtrfs - 2 Disk RAID0Btrfs - 4 Disk RAID0Btrfs - 4 Disk RAID10Btrfs - 4 Disk RAID113002600390052006500Min: 4195 / Avg: 4248.67 / Max: 4323Min: 4400 / Avg: 4574.8 / Max: 4716Min: 4396 / Avg: 5143.83 / Max: 5740Min: 4884 / Avg: 5070 / Max: 5188Min: 4862 / Avg: 4953.67 / Max: 5069Min: 6490 / Avg: 6651.33 / Max: 6749Min: 6028 / Avg: 6269.33 / Max: 6430Min: 5720 / Avg: 5942.33 / Max: 61101. (CC) gcc options: -O2 -pthread

Compile Bench

Compilebench tries to age a filesystem by simulating some of the disk IO common in creating, compiling, patching, stating and reading kernel trees. It indirectly measures how well filesystems can maintain directory locality as the disk fills up and directories age. This current test is setup to use the makej mode with 10 initial directories Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateF2FS - Single DiskF2FS - Two DisksF2FS - Three DisksF2FS - Four DisksBtrfs - Single DiskBtrfs - 2 Disk RAID0Btrfs - 4 Disk RAID0Btrfs - 4 Disk RAID10Btrfs - 4 Disk RAID1100200300400500SE +/- 34.60, N = 6SE +/- 23.46, N = 6SE +/- 24.26, N = 6SE +/- 28.20, N = 6SE +/- 24.81, N = 6SE +/- 1.18, N = 3SE +/- 7.08, N = 6SE +/- 11.35, N = 6SE +/- 7.83, N = 6426.39409.72431.91480.08148.30275.55294.41237.22240.61
OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateF2FS - Single DiskF2FS - Two DisksF2FS - Three DisksF2FS - Four DisksBtrfs - Single DiskBtrfs - 2 Disk RAID0Btrfs - 4 Disk RAID0Btrfs - 4 Disk RAID10Btrfs - 4 Disk RAID190180270360450Min: 328.79 / Avg: 426.39 / Max: 530.75Min: 365.77 / Avg: 409.72 / Max: 493.33Min: 368.6 / Avg: 431.91 / Max: 504.23Min: 389.35 / Avg: 480.08 / Max: 542.5Min: 80.82 / Avg: 148.3 / Max: 227.49Min: 274.34 / Avg: 275.55 / Max: 277.91Min: 271.5 / Avg: 294.41 / Max: 318.43Min: 196.73 / Avg: 237.22 / Max: 265.32Min: 209.11 / Avg: 240.61 / Max: 259.63

PostgreSQL pgbench

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 9.4.3Scaling: On-Disk - Test: Normal Load - Mode: Read WriteF2FS - Single DiskF2FS - Two DisksF2FS - Three DisksF2FS - Four DisksBtrfs - Single DiskBtrfs - 2 Disk RAID0Btrfs - 4 Disk RAID0Btrfs - 4 Disk RAID10Btrfs - 4 Disk RAID150010001500200025001281.861416.75577.451622.901095.061524.572205.721435.851443.911. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -pthread -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm