File-System SSD Testing Debian Linux 4.14 XFS Btrfs EXT4 F2FS

Linux 4.14 kernel file-system testing for a future article on Phoronix.com.

HTML result view exported from: https://openbenchmarking.org/result/1711145-AL-FILESYSTE58&grs&rdt&rro.

ProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelDesktopCompilerFile-SystemScreen ResolutionLinux 4.13Linux 4.12Linux 4.14 EXT4 XFS Btrfs F2FS F2FS EXT4 XFS Btrfs Btrfs EXT4 XFS F2FS2 x Intel Xeon Gold 6138 @ 3.70GHz (40 Cores / 80 Threads)TYAN S7106Intel Device 202012 x 8192 MB DDR4-2666MHz Micron256GB Samsung SSD 850 + 2000GB Seagate ST2000DM006-2DM1 + 2 x 120GB TOSHIBA-TR150ASPEED ASPEED FamilyIntel I210 Gigabit ConnectionDebian 9.24.13.0-041300-generic (x86_64)GNOME Shell 3.22.3GCC 6.3.0 20170516ext41024x768xfsbtrfsf2fs4.12.0-041200-generic (x86_64)ext4xfsbtrfs4.14.0-041400-generic (x86_64)ext4xfsf2fsOpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v Disk Details- Linux 4.13: EXT4: CFQ / data=ordered,relatime,rw- Linux 4.13: XFS: CFQ / attr2,inode64,noquota,relatime,rw- Linux 4.13: Btrfs: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5- Linux 4.13: F2FS: CFQ / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr - Linux 4.12: F2FS: CFQ / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr - Linux 4.12: EXT4: CFQ / data=ordered,relatime,rw- Linux 4.12: XFS: CFQ / attr2,inode64,noquota,relatime,rw- Linux 4.12: Btrfs: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5- Linux 4.14: Btrfs: CFQ / relatime,rw,space_cache,ssd,subvol=/,subvolid=5- Linux 4.14: EXT4: CFQ / data=ordered,relatime,rw- Linux 4.14: XFS: CFQ / attr2,inode64,noquota,relatime,rw- Linux 4.14: F2FS: CFQ / acl,active_logs=6,background_gc=on,extent_cache,flush_merge,inline_data,inline_dentry,inline_xattr,lazytime,mode=adaptive,no_heap,relatime,rw,user_xattr Processor Details- Scaling Governor: intel_pstate performanceSystem Details- Python 2.7.13.

fio: Seq Write - Libaio - No - Yes - 4KB - Default Test Directoryfio: Rand Write - Libaio - No - Yes - 4KB - Default Test Directoryblogbench: Writesqlite: Default Test Directorydbench: 6dbench: 48tiobench: Write - 128MB - 8fio: Seq Read - Libaio - No - Yes - 4KB - Default Test Directoryfio: Rand Read - Libaio - No - Yes - 4KB - Default Test Directorycompilebench: Initial Createcompilebench: Compiletiobench: Rand Write - 128MB - 8Linux 4.13Linux 4.12Linux 4.14 EXT4 XFS Btrfs F2FS F2FS EXT4 XFS Btrfs Btrfs EXT4 XFS F2FS424.34287.461097436.78384.07752.886.22227.78214.52512.241801.17210.18422.90288.04324134.74610.092018.234.83235.33220.00379.421919.33254.1288.2680.67451281.46292.35155.165.69251.71210.40143.941146.27145.47426.31288.92775139.95402.16494.524.41221.88220.94620.752463.67276.09424.52287.59798539.98401.87481.344.58228.40217.78566.552362.66270.41423.36287.021024141.70432.71820.986.25225.13218.46473.381797.67242.10423.20286.94400835.49617.912055.594.96223.11219.19445.452137.59232.0291.3288.17446182.08291.90148.435.16263.78212.20151.601180.27140.5398.4391.00431979.56332.95153.446.65262.75211.88135.221251.59171.03421.34285.561034840.79412.92821.196.09212.16215.63516.761710.46239.30424.33286.50408134.30533.841792.365.38209.89235.54454.672145.55183.44423.79287.95766539.40350.66421.034.99236.67221.48600.382319.27231.46OpenBenchmarking.org

Flexible IO Tester

Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

Linux 4.14Linux 4.12Linux 4.13OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryF2FSXFSEXT4Btrfs20K40K60K80K100KSE +/- 460.02, N = 3SE +/- 53.17, N = 3SE +/- 440.80, N = 3SE +/- 1336.10, N = 6SE +/- 434.85, N = 3SE +/- 19.80, N = 3SE +/- 396.05, N = 3SE +/- 458.77, N = 3SE +/- 403.08, N = 3SE +/- 398.28, N = 6SE +/- 515.75, N = 3SE +/- 393.18, N = 31059431060791053312460422827105797105837106128106575220611057211060801. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

Linux 4.14Linux 4.12Linux 4.13OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryF2FSXFSEXT4Btrfs90180270360450SE +/- 1.84, N = 3SE +/- 0.21, N = 3SE +/- 1.76, N = 3SE +/- 5.34, N = 6SE +/- 1.74, N = 3SE +/- 0.08, N = 3SE +/- 1.58, N = 3SE +/- 1.83, N = 3SE +/- 1.61, N = 3SE +/- 1.59, N = 6SE +/- 2.06, N = 3SE +/- 1.57, N = 3423.79424.33421.3498.4391.32423.20423.36424.52426.3188.26422.90424.341. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

Linux 4.14Linux 4.12Linux 4.13OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryF2FSXFSEXT4Btrfs15K30K45K60K75KSE +/- 205.21, N = 3SE +/- 174.77, N = 3SE +/- 932.14, N = 6SE +/- 1322.22, N = 6SE +/- 380.25, N = 6SE +/- 171.10, N = 3SE +/- 120.50, N = 3SE +/- 141.95, N = 3SE +/- 220.91, N = 3SE +/- 1301.06, N = 6SE +/- 161.23, N = 3SE +/- 164.33, N = 37198471622713872274622039717327175171893722262016572006718611. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

Linux 4.14Linux 4.12Linux 4.13OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryF2FSXFSEXT4Btrfs60120180240300SE +/- 0.82, N = 3SE +/- 0.70, N = 3SE +/- 3.73, N = 6SE +/- 5.29, N = 6SE +/- 1.52, N = 6SE +/- 0.68, N = 3SE +/- 0.48, N = 3SE +/- 0.57, N = 3SE +/- 0.88, N = 3SE +/- 5.20, N = 6SE +/- 0.64, N = 3SE +/- 0.66, N = 3287.95286.50285.5691.0088.17286.94287.02287.59288.9280.67288.04287.461. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

BlogBench

Test: Write

Linux 4.14Linux 4.12Linux 4.13OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: WriteF2FSXFSEXT4Btrfs2K4K6K8K10KSE +/- 223.88, N = 6SE +/- 67.20, N = 6SE +/- 108.34, N = 3SE +/- 46.77, N = 3SE +/- 24.91, N = 3SE +/- 135.33, N = 3SE +/- 90.71, N = 3SE +/- 107.90, N = 3SE +/- 768.72, N = 3SE +/- 42.78, N = 3SE +/- 68.15, N = 3SE +/- 336.51, N = 37665408110348431944614008102417985775145123241109741. (CC) gcc options: -O2 -pthread

SQLite

Test Target: Default Test Directory

Linux 4.14Linux 4.12Linux 4.13OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.8.10.2Test Target: Default Test DirectoryF2FSXFSEXT4Btrfs20406080100SE +/- 0.30, N = 3SE +/- 0.10, N = 3SE +/- 1.26, N = 6SE +/- 0.81, N = 3SE +/- 1.21, N = 5SE +/- 0.54, N = 3SE +/- 1.29, N = 6SE +/- 0.80, N = 3SE +/- 0.39, N = 3SE +/- 1.43, N = 3SE +/- 0.52, N = 3SE +/- 0.74, N = 639.4034.3040.7979.5682.0835.4941.7039.9839.9581.4634.7436.781. (CC) gcc options: -O2 -ldl -lpthread

Dbench

Client Count: 6

Linux 4.14Linux 4.12Linux 4.13OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 6F2FSXFSEXT4Btrfs130260390520650SE +/- 4.79, N = 6SE +/- 4.50, N = 3SE +/- 7.99, N = 3SE +/- 0.78, N = 3SE +/- 3.03, N = 3SE +/- 4.44, N = 3SE +/- 10.55, N = 6SE +/- 1.45, N = 3SE +/- 2.83, N = 3SE +/- 4.48, N = 4SE +/- 1.63, N = 3SE +/- 0.53, N = 3350.66533.84412.92332.95291.90617.91432.71401.87402.16292.35610.09384.071. (CC) gcc options: -lpopt -O2

Dbench

Client Count: 48

Linux 4.14Linux 4.12Linux 4.13OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 48F2FSXFSEXT4Btrfs400800120016002000SE +/- 43.85, N = 6SE +/- 9.19, N = 3SE +/- 6.49, N = 3SE +/- 2.40, N = 3SE +/- 1.97, N = 3SE +/- 4.95, N = 3SE +/- 2.58, N = 3SE +/- 73.87, N = 6SE +/- 72.63, N = 6SE +/- 2.87, N = 3SE +/- 3.95, N = 3SE +/- 7.02, N = 3421.031792.36821.19153.44148.432055.59820.98481.34494.52155.162018.23752.881. (CC) gcc options: -lpopt -O2

Threaded I/O Tester

Test: Write - Size Per Thread: 128MB - Thread Count: 8

Linux 4.14Linux 4.12Linux 4.13OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 20170503Test: Write - Size Per Thread: 128MB - Thread Count: 8F2FSXFSEXT4Btrfs246810SE +/- 0.09, N = 3SE +/- 0.09, N = 6SE +/- 0.05, N = 3SE +/- 0.17, N = 6SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 4SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 34.995.386.096.655.164.966.254.584.415.694.836.221. (CC) gcc options: -O2

Flexible IO Tester

Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

Linux 4.14Linux 4.12Linux 4.13OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryF2FSXFSEXT4Btrfs60120180240300SE +/- 3.37, N = 5SE +/- 2.38, N = 3SE +/- 0.22, N = 3SE +/- 0.11, N = 3SE +/- 2.97, N = 3SE +/- 1.98, N = 3SE +/- 3.89, N = 4SE +/- 3.64, N = 6SE +/- 2.64, N = 3SE +/- 0.11, N = 3SE +/- 3.64, N = 3SE +/- 3.39, N = 3236.67209.89212.16262.75263.78223.11225.13228.40221.88251.71235.33227.781. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

Linux 4.14Linux 4.12Linux 4.13OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryF2FSXFSEXT4Btrfs14K28K42K56K70KSE +/- 843.77, N = 5SE +/- 594.49, N = 3SE +/- 55.13, N = 3SE +/- 28.00, N = 3SE +/- 742.76, N = 3SE +/- 495.18, N = 3SE +/- 973.22, N = 4SE +/- 909.00, N = 6SE +/- 659.28, N = 3SE +/- 27.83, N = 3SE +/- 910.09, N = 3SE +/- 846.33, N = 35916552470530376568465941557735627857096554666292458829569411. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

Linux 4.14Linux 4.12Linux 4.13OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryF2FSXFSEXT4Btrfs50100150200250SE +/- 0.03, N = 3SE +/- 0.54, N = 3SE +/- 0.01, N = 3SE +/- 3.87, N = 3SE +/- 3.23, N = 4SE +/- 0.03, N = 3SE +/- 3.58, N = 3SE +/- 0.13, N = 3SE +/- 0.36, N = 3SE +/- 3.71, N = 3SE +/- 0.03, N = 3SE +/- 2.32, N = 3221.48235.54215.63211.88212.20219.19218.46217.78220.94210.40220.00214.521. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Flexible IO Tester

Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory

Linux 4.14Linux 4.12Linux 4.13OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test DirectoryF2FSXFSEXT4Btrfs13K26K39K52K65KSE +/- 8.09, N = 3SE +/- 135.51, N = 3SE +/- 2.67, N = 3SE +/- 966.60, N = 3SE +/- 806.41, N = 4SE +/- 7.00, N = 3SE +/- 894.18, N = 3SE +/- 32.06, N = 3SE +/- 90.91, N = 3SE +/- 927.97, N = 3SE +/- 7.51, N = 3SE +/- 579.04, N = 35536658880539035296753047547935461254440552315259654996536271. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lnuma -libverbs -lrt -laio -lz -lm -lpthread -ldl

Compile Bench

Test: Initial Create

Linux 4.14Linux 4.12Linux 4.13OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial CreateF2FSXFSEXT4Btrfs130260390520650SE +/- 20.31, N = 3SE +/- 2.12, N = 3SE +/- 43.04, N = 3SE +/- 7.90, N = 3SE +/- 22.03, N = 3SE +/- 9.39, N = 3SE +/- 15.70, N = 3SE +/- 38.67, N = 3SE +/- 3.76, N = 3SE +/- 24.50, N = 3SE +/- 7.38, N = 3SE +/- 36.29, N = 3600.38454.67516.76135.22151.60445.45473.38566.55620.75143.94379.42512.24

Compile Bench

Test: Compile

Linux 4.14Linux 4.12Linux 4.13OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: CompileF2FSXFSEXT4Btrfs5001000150020002500SE +/- 73.87, N = 6SE +/- 18.54, N = 3SE +/- 58.81, N = 6SE +/- 13.04, N = 3SE +/- 25.15, N = 6SE +/- 31.74, N = 6SE +/- 9.35, N = 3SE +/- 59.70, N = 6SE +/- 23.39, N = 3SE +/- 27.28, N = 6SE +/- 48.13, N = 6SE +/- 9.91, N = 32319.272145.551710.461251.591180.272137.591797.672362.662463.671146.271919.331801.17

Threaded I/O Tester

Test: Random Write - Size Per Thread: 128MB - Thread Count: 8

Linux 4.14Linux 4.12Linux 4.13OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 20170503Test: Random Write - Size Per Thread: 128MB - Thread Count: 8F2FSXFSEXT4Btrfs60120180240300SE +/- 45.69, N = 6SE +/- 1.84, N = 3SE +/- 8.63, N = 6SE +/- 2.04, N = 3SE +/- 7.48, N = 6SE +/- 3.69, N = 4SE +/- 15.02, N = 6SE +/- 19.39, N = 6SE +/- 7.40, N = 6SE +/- 9.11, N = 6SE +/- 12.37, N = 6SE +/- 10.90, N = 6231.46183.44239.30171.03140.53232.02242.10270.41276.09145.47254.12210.181. (CC) gcc options: -O2

Phoronix Test Suite v10.8.5