Linux 4.7 - EXT4 vs. F2FS vs. Btrfs vs. XFS vs. NTFS

Linux file-system benchmarks by Michael Larabel for a future article on Phoronix.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1608041-LO-LINUX44BT99
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

CPU Massive 2 Tests
Database Test Suite 2 Tests
Disk Test Suite 4 Tests
Server 3 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
Btrfs
August 02 2016
 
EXT4
August 03 2016
 
F2FS
August 03 2016
 
XFS
August 03 2016
 
NTFS
August 04 2016
 
Invert Hiding All Results Option
  1 Minute

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):


Linux 4.7 - EXT4 vs. F2FS vs. Btrfs vs. XFS vs. NTFSOpenBenchmarking.orgPhoronix Test Suite 10.6.1Intel Xeon E3-1280 v5 @ 4.00GHz (8 Cores)MSI C236A WORKSTATION (MS-7998) v1.0Intel Skylake16384MBSamsung SSD 950 PRO 256GBLLVMpipeRealtek ALC1150Intel ConnectionUbuntu 16.104.7.0-040700-generic (x86_64)Unity 7.5.0X Server 1.18.4nouveau 1.0.123.3 Mesa 12.0.1 Gallium 0.4GCC 5.4.0 20160609btrfsext4f2fsxfsfuseblk1024x768ProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemsScreen ResolutionLinux 4.7 - EXT4 Vs. F2FS Vs. Btrfs Vs. XFS Vs. NTFS BenchmarksSystem Logs- LIBGL_ALWAYS_SOFTWARE=1- --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v - Scaling Governor: intel_pstate performance- Btrfs: relatime,rw,space_cache,ssd,subvol=/,subvolid=5- EXT4: data=ordered,relatime,rw- F2FS: acl,active_logs=6,background_gc=on,extent_cache,inline_data,relatime,rw,user_xattr- XFS: attr2,inode64,noquota,relatime,rw- NTFS: allow_other,blksize=4096,group_id=0,relatime,rw,user_id=0

BtrfsEXT4F2FSXFSNTFSLogarithmic Result OverviewPhoronix Test Suite 10.6.1BlogBenchFlexible IO TesterBlogBenchSQLiteFS-MarkDbenchFS-MarkFS-MarkFlexible IO TesterFlexible IO TesterFlexible IO TesterReadSeq Write - Libaio - No - Yes - 4KB - IOPSWriteD.T.D5.F.1.S.4.T14.F.3.S.D.1.S1.F.1.SSeq Read - Libaio - No - Yes - 4KB - IOPSRand Read - Libaio - No - Yes - 4KB - IOPSRand Write - Libaio - No - Yes - 4KB - IOPS

Linux 4.7 - EXT4 vs. F2FS vs. Btrfs vs. XFS vs. NTFSsqlite: Default Test Directoryfio: Rand Read - Libaio - No - Yes - 4KB - Default Test Directory - IOPSfio: Rand Write - Libaio - No - Yes - 4KB - Default Test Directory - IOPSfio: Seq Read - Libaio - No - Yes - 4KB - Default Test Directory - IOPSfio: Seq Write - Libaio - No - Yes - 4KB - Default Test Directory - IOPSfs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizeblogbench: Readblogbench: Writedbench: 1pgbench: On-Disk - Normal Load - Read WriteBtrfsEXT4F2FSXFSNTFS132.581926257339627034763910142.33280.67141.931721568914183.052227.4165.9421552080946283973231656142.23320.80143.535500311646184.943713.8776.2819427481407284781233585267.23291.87267.9722952804173187.183187.5962.3019416681350285041232590158.07284.07144.632188248620390.392788.4347.451375666313814076663680127.00119.13124.335160359391.17OpenBenchmarking.org

SQLite

This is a simple benchmark of SQLite. At present this test profile just measures the time to perform a pre-defined number of insertions on an indexed database. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.8.10.2Test Target: Default Test DirectoryBtrfsEXT4F2FSXFSNTFS306090120150SE +/- 0.13, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.01, N = 3132.5865.9476.2862.3047.451. (CC) gcc options: -O2 -ldl -lpthread
OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.8.10.2Test Target: Default Test DirectoryBtrfsEXT4F2FSXFSNTFS20406080100Min: 132.41 / Avg: 132.58 / Max: 132.84Min: 65.88 / Avg: 65.94 / Max: 66.03Min: 76.19 / Avg: 76.28 / Max: 76.4Min: 62.18 / Avg: 62.3 / Max: 62.46Min: 47.44 / Avg: 47.45 / Max: 47.461. (CC) gcc options: -O2 -ldl -lpthread

Flexible IO Tester

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPSBtrfsEXT4F2FSXFSNTFS50K100K150K200K250KSE +/- 16.17, N = 3SE +/- 65.08, N = 3SE +/- 109.86, N = 3SE +/- 17.90, N = 3SE +/- 781.27, N = 31926252155201942741941661375661. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPSBtrfsEXT4F2FSXFSNTFS40K80K120K160K200KMin: 192593 / Avg: 192625 / Max: 192645Min: 215398 / Avg: 215520.33 / Max: 215620Min: 194090 / Avg: 194274 / Max: 194470Min: 194142 / Avg: 194166 / Max: 194201Min: 136567 / Avg: 137566 / Max: 1391061. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPSBtrfsEXT4F2FSXFSNTFS20K40K60K80K100KSE +/- 474.84, N = 3SE +/- 58.46, N = 3SE +/- 95.69, N = 3SE +/- 26.86, N = 3SE +/- 831.96, N = 373396809468140781350631381. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPSBtrfsEXT4F2FSXFSNTFS14K28K42K56K70KMin: 72899 / Avg: 73395.67 / Max: 74345Min: 80853 / Avg: 80946.33 / Max: 81054Min: 81281 / Avg: 81407.33 / Max: 81595Min: 81313 / Avg: 81349.67 / Max: 81402Min: 61567 / Avg: 63138.33 / Max: 643981. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPSBtrfsEXT4F2FSXFSNTFS60K120K180K240K300KSE +/- 1073.84, N = 3SE +/- 43.50, N = 3SE +/- 73.04, N = 3SE +/- 51.39, N = 3SE +/- 329.89, N = 32703472839732847812850411407661. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPSBtrfsEXT4F2FSXFSNTFS50K100K150K200K250KMin: 268355 / Avg: 270347.33 / Max: 272038Min: 283912 / Avg: 283972.67 / Max: 284057Min: 284639 / Avg: 284781.33 / Max: 284881Min: 284979 / Avg: 285041 / Max: 285143Min: 140111 / Avg: 140765.67 / Max: 1411641. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl

OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPSBtrfsEXT4F2FSXFSNTFS50K100K150K200K250KSE +/- 1006.05, N = 3SE +/- 49.24, N = 3SE +/- 112.34, N = 3SE +/- 91.25, N = 3SE +/- 707.35, N = 363910231656233585232590636801. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl
OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPSBtrfsEXT4F2FSXFSNTFS40K80K120K160K200KMin: 61955 / Avg: 63910.33 / Max: 65299Min: 231559 / Avg: 231656.33 / Max: 231718Min: 233361 / Avg: 233584.67 / Max: 233715Min: 232430 / Avg: 232590.33 / Max: 232746Min: 62415 / Avg: 63680 / Max: 648611. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl

FS-Mark

FS_Mark is designed to test a system's file-system performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeBtrfsEXT4F2FSXFSNTFS60120180240300SE +/- 0.18, N = 3SE +/- 0.38, N = 3SE +/- 0.58, N = 3SE +/- 0.90, N = 3SE +/- 0.70, N = 3142.33142.23267.23158.07127.001. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeBtrfsEXT4F2FSXFSNTFS50100150200250Min: 142 / Avg: 142.33 / Max: 142.6Min: 141.5 / Avg: 142.23 / Max: 142.8Min: 266.3 / Avg: 267.23 / Max: 268.3Min: 156.8 / Avg: 158.07 / Max: 159.8Min: 125.9 / Avg: 127 / Max: 128.31. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsBtrfsEXT4F2FSXFSNTFS70140210280350SE +/- 0.35, N = 3SE +/- 2.01, N = 3SE +/- 3.93, N = 3SE +/- 1.27, N = 3SE +/- 0.41, N = 3280.67320.80291.87284.07119.131. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsBtrfsEXT4F2FSXFSNTFS60120180240300Min: 280 / Avg: 280.67 / Max: 281.2Min: 318.4 / Avg: 320.8 / Max: 324.8Min: 284.4 / Avg: 291.87 / Max: 297.7Min: 282.6 / Avg: 284.07 / Max: 286.6Min: 118.4 / Avg: 119.13 / Max: 119.81. (CC) gcc options: -static

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeBtrfsEXT4F2FSXFSNTFS60120180240300SE +/- 0.18, N = 3SE +/- 0.58, N = 3SE +/- 0.24, N = 3SE +/- 4.01, N = 6SE +/- 0.92, N = 3141.93143.53267.97144.63124.331. (CC) gcc options: -static
OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeBtrfsEXT4F2FSXFSNTFS50100150200250Min: 141.6 / Avg: 141.93 / Max: 142.2Min: 142.6 / Avg: 143.53 / Max: 144.6Min: 267.5 / Avg: 267.97 / Max: 268.3Min: 134 / Avg: 144.63 / Max: 156.8Min: 122.5 / Avg: 124.33 / Max: 125.31. (CC) gcc options: -static

BlogBench

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: ReadBtrfsEXT4F2FSXFSNTFS500K1000K1500K2000K2500KSE +/- 20785.44, N = 3SE +/- 11102.40, N = 6SE +/- 12704.41, N = 3SE +/- 10336.76, N = 3SE +/- 786.80, N = 4172156855003122952802188248516031. (CC) gcc options: -O2 -pthread
OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: ReadBtrfsEXT4F2FSXFSNTFS400K800K1200K1600K2000KMin: 1680549 / Avg: 1721568.33 / Max: 1747923Min: 527058 / Avg: 550031.33 / Max: 602900Min: 2280327 / Avg: 2295279.67 / Max: 2320547Min: 2167840 / Avg: 2188248.33 / Max: 2201311Min: 49391 / Avg: 51602.75 / Max: 530201. (CC) gcc options: -O2 -pthread

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: WriteBtrfsEXT4F2FSXFSNTFS4K8K12K16K20KSE +/- 135.08, N = 3SE +/- 1662.76, N = 3SE +/- 36.04, N = 3SE +/- 10.39, N = 3SE +/- 14.38, N = 3914116461417362035931. (CC) gcc options: -O2 -pthread
OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: WriteBtrfsEXT4F2FSXFSNTFS3K6K9K12K15KMin: 8916 / Avg: 9141 / Max: 9383Min: 13299 / Avg: 16461 / Max: 18934Min: 4105 / Avg: 4172.67 / Max: 4228Min: 6185 / Avg: 6203 / Max: 6221Min: 577 / Avg: 593.33 / Max: 6221. (CC) gcc options: -O2 -pthread

Dbench

Dbench is a benchmark designed by the Samba project as a free alternative to netbench, but dbench contains only file-system calls for testing the disk performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 1BtrfsEXT4F2FSXFSNTFS4080120160200SE +/- 0.30, N = 3SE +/- 0.07, N = 3SE +/- 3.57, N = 4SE +/- 0.15, N = 3SE +/- 0.19, N = 383.0584.94187.1890.3991.171. (CC) gcc options: -lpopt -O2
OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 1BtrfsEXT4F2FSXFSNTFS306090120150Min: 82.45 / Avg: 83.05 / Max: 83.37Min: 84.85 / Avg: 84.94 / Max: 85.07Min: 182.71 / Avg: 187.18 / Max: 197.72Min: 90.09 / Avg: 90.39 / Max: 90.55Min: 90.8 / Avg: 91.17 / Max: 91.41. (CC) gcc options: -lpopt -O2

PostgreSQL pgbench

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 9.4.3Scaling: On-Disk - Test: Normal Load - Mode: Read WriteBtrfsEXT4F2FSXFS8001600240032004000SE +/- 5.08, N = 3SE +/- 26.02, N = 3SE +/- 9.54, N = 3SE +/- 494.50, N = 62227.413713.873187.592788.431. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -pthread -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm
OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 9.4.3Scaling: On-Disk - Test: Normal Load - Mode: Read WriteBtrfsEXT4F2FSXFS6001200180024003000Min: 2220.01 / Avg: 2227.41 / Max: 2237.13Min: 3687.22 / Avg: 3713.87 / Max: 3765.9Min: 3169.14 / Avg: 3187.59 / Max: 3201.05Min: 1221.94 / Avg: 2788.43 / Max: 3604.231. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -pthread -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm