Linux 4.4 To Linux 4.7 - EXT4 vs. F2FS vs. Btrfs

Linux file-system benchmarks by Michael Larabel for a future article on Phoronix.

HTML result view exported from: https://openbenchmarking.org/result/1608041-LO-LINUX44BT31&grr.

ProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionLinux 4.4Linux 4.5Linux 4.6Linux 4.7Linux 4.4Linux 4.5Linux 4.6Linux 4.7Linux 4.4Linux 4.5Linux 4.6Linux 4.7 Btrfs Btrfs Btrfs Btrfs EXT4 EXT4 EXT4 EXT4 F2FS F2FS F2FS F2FSIntel Xeon E3-1280 v5 @ 4.00GHz (8 Cores)MSI C236A WORKSTATION (MS-7998) v1.0Intel Skylake16384MB115GBLLVMpipeRealtek ALC1150Intel ConnectionUbuntu 16.104.4.0-040400-generic (x86_64)Unity 7.5.0X Server 1.18.4nouveau 1.0.123.3 Mesa 12.0.1 Gallium 0.4GCC 5.4.0 20160609btrfs1024x768Samsung SSD 950 PRO 256GB4.5.0-040500-generic (x86_64)4.6.0-040600-generic (x86_64)4.7.0-040700-generic (x86_64)115GB4.4.0-040400-generic (x86_64)ext4Samsung SSD 950 PRO 256GB4.5.0-040500-generic (x86_64)4.6.0-040600-generic (x86_64)4.7.0-040700-generic (x86_64)115GB4.4.0-040400-generic (x86_64)f2fsSamsung SSD 950 PRO 256GB4.5.0-040500-generic (x86_64)4.6.0-040600-generic (x86_64)4.7.0-040700-generic (x86_64)OpenBenchmarking.orgEnvironment Details- LIBGL_ALWAYS_SOFTWARE=1Compiler Details- --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v Processor Details- Scaling Governor: intel_pstate performanceDisk Mount Options Details- Linux 4.4: Btrfs: relatime,rw,space_cache,ssd,subvol=/,subvolid=5- Linux 4.5: Btrfs: relatime,rw,space_cache,ssd,subvol=/,subvolid=5- Linux 4.6: Btrfs: relatime,rw,space_cache,ssd,subvol=/,subvolid=5- Linux 4.7: Btrfs: relatime,rw,space_cache,ssd,subvol=/,subvolid=5- Linux 4.4: EXT4: data=ordered,relatime,rw- Linux 4.5: EXT4: data=ordered,relatime,rw- Linux 4.6: EXT4: data=ordered,relatime,rw- Linux 4.7: EXT4: data=ordered,relatime,rw- Linux 4.4: F2FS: acl,active_logs=6,background_gc=on,extent_cache,inline_data,relatime,rw,user_xattr- Linux 4.5: F2FS: acl,active_logs=6,background_gc=on,extent_cache,inline_data,relatime,rw,user_xattr- Linux 4.6: F2FS: acl,active_logs=6,background_gc=on,extent_cache,inline_data,relatime,rw,user_xattr- Linux 4.7: F2FS: acl,active_logs=6,background_gc=on,extent_cache,inline_data,relatime,rw,user_xattr

redis: GETpgbench: On-Disk - Normal Load - Read Writedbench: 1blogbench: Writeblogbench: Readfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 1000 Files, 1MB Sizefio: Seq Write - Libaio - No - Yes - 4KB - Default Test Directory - IOPSfio: Seq Read - Libaio - No - Yes - 4KB - Default Test Directory - IOPSfio: Rand Write - Libaio - No - Yes - 4KB - Default Test Directory - IOPSfio: Rand Read - Libaio - No - Yes - 4KB - Default Test Directory - IOPSsqlite: Default Test DirectoryLinux 4.4Linux 4.5Linux 4.6Linux 4.7Linux 4.4Linux 4.5Linux 4.6Linux 4.7Linux 4.4Linux 4.5Linux 4.6Linux 4.7 Btrfs Btrfs Btrfs Btrfs EXT4 EXT4 EXT4 EXT4 F2FS F2FS F2FS F2FS2854247.292226.5777.0494491732380141.63281.03139.576430526434474797270161151.833151309.002217.0778.9692631746852141.87280.27142.006373825358869935220069150.743132359.422227.8182.7986641808748142.40279.87140.406364426360773246242857126.042782214.832227.4183.0591411721568141.93280.67142.336391027034773396192625132.583102801.063571.0584.4918422555506142.27310.70144.702331102846238109925974766.512834325.503597.3385.1018010573934141.83303.33144.402317882839808109019416065.643041782.383593.8084.7218575589041142.60303.97142.132330792834968131419449765.533148836.083713.8784.9416461550031143.53320.80142.232316562839738094621552065.942945344.293150.09188.02105701207927259.90294.97259.632334302854058173427562876.233102704.583472.08187.4338842202620260.67298.03262.732334862835928152019406276.873128367.833106.46187.2939432236338265.00295.37268.202330462853488166319453676.073027572.713187.59187.1841732295280267.97291.87267.232335852847818140719427476.28OpenBenchmarking.org

Redis

Test: GET

Linux 4.4Linux 4.5Linux 4.6Linux 4.7OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 3.0.1Test: GETBtrfsEXT4F2FS700K1400K2100K2800K3500KSE +/- 110138.79, N = 6SE +/- 46011.71, N = 4SE +/- 108968.99, N = 6SE +/- 8744.85, N = 3SE +/- 143824.61, N = 6SE +/- 22529.67, N = 3SE +/- 36384.42, N = 3SE +/- 47595.92, N = 4SE +/- 13103.08, N = 3SE +/- 154397.91, N = 6SE +/- 37301.93, N = 3SE +/- 113714.90, N = 62854247.293102801.062945344.293151309.002834325.503102704.583132359.423041782.383128367.832782214.833148836.083027572.711. (CC) gcc options: -ggdb -rdynamic -lm -pthread -ldl -std=gnu99 -pipe -g3 -O3 -funroll-loops

PostgreSQL pgbench

Scaling: On-Disk - Test: Normal Load - Mode: Read Write

Linux 4.4Linux 4.5Linux 4.6Linux 4.7OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 9.4.3Scaling: On-Disk - Test: Normal Load - Mode: Read WriteBtrfsEXT4F2FS8001600240032004000SE +/- 8.51, N = 3SE +/- 31.20, N = 3SE +/- 2.80, N = 3SE +/- 2.04, N = 3SE +/- 28.13, N = 3SE +/- 19.52, N = 3SE +/- 4.97, N = 3SE +/- 26.17, N = 3SE +/- 18.68, N = 3SE +/- 5.08, N = 3SE +/- 26.02, N = 3SE +/- 9.54, N = 32226.573571.053150.092217.073597.333472.082227.813593.803106.462227.413713.873187.591. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -pthread -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

Dbench

Client Count: 1

Linux 4.4Linux 4.5Linux 4.6Linux 4.7OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0Client Count: 1BtrfsEXT4F2FS4080120160200SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 2.79, N = 6SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 2.74, N = 5SE +/- 0.10, N = 3SE +/- 0.04, N = 3SE +/- 2.86, N = 5SE +/- 0.30, N = 3SE +/- 0.07, N = 3SE +/- 3.57, N = 477.0484.49188.0278.9685.10187.4382.7984.72187.2983.0584.94187.181. (CC) gcc options: -lpopt -O2

BlogBench

Test: Write

Linux 4.4Linux 4.5Linux 4.6Linux 4.7OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: WriteBtrfsEXT4F2FS4K8K12K16K20KSE +/- 110.00, N = 3SE +/- 1314.03, N = 3SE +/- 2319.75, N = 3SE +/- 66.19, N = 3SE +/- 1495.01, N = 3SE +/- 80.01, N = 3SE +/- 57.17, N = 3SE +/- 1693.08, N = 3SE +/- 108.00, N = 3SE +/- 135.08, N = 3SE +/- 1662.76, N = 3SE +/- 36.04, N = 3944918422105709263180103884866418575394391411646141731. (CC) gcc options: -O2 -pthread

BlogBench

Test: Read

Linux 4.4Linux 4.5Linux 4.6Linux 4.7OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: ReadBtrfsEXT4F2FS500K1000K1500K2000K2500KSE +/- 33989.92, N = 3SE +/- 18109.30, N = 6SE +/- 187835.89, N = 6SE +/- 16571.58, N = 3SE +/- 11922.94, N = 6SE +/- 15341.86, N = 3SE +/- 17391.57, N = 3SE +/- 15703.05, N = 6SE +/- 21281.10, N = 3SE +/- 20785.44, N = 3SE +/- 11102.40, N = 6SE +/- 12704.41, N = 3173238055550612079271746852573934220262018087485890412236338172156855003122952801. (CC) gcc options: -O2 -pthread

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

Linux 4.4Linux 4.5Linux 4.6Linux 4.7OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB SizeBtrfsEXT4F2FS60120180240300SE +/- 0.19, N = 3SE +/- 0.13, N = 3SE +/- 0.66, N = 3SE +/- 0.24, N = 3SE +/- 0.38, N = 3SE +/- 0.44, N = 3SE +/- 0.20, N = 3SE +/- 0.53, N = 3SE +/- 0.40, N = 3SE +/- 0.18, N = 3SE +/- 0.58, N = 3SE +/- 0.24, N = 3141.63142.27259.90141.87141.83260.67142.40142.60265.00141.93143.53267.971. (CC) gcc options: -static

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

Linux 4.4Linux 4.5Linux 4.6Linux 4.7OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 ThreadsBtrfsEXT4F2FS70140210280350SE +/- 0.30, N = 3SE +/- 1.55, N = 3SE +/- 1.55, N = 3SE +/- 0.18, N = 3SE +/- 0.87, N = 3SE +/- 3.79, N = 3SE +/- 0.35, N = 3SE +/- 1.19, N = 3SE +/- 3.40, N = 3SE +/- 0.35, N = 3SE +/- 2.01, N = 3SE +/- 3.93, N = 3281.03310.70294.97280.27303.33298.03279.87303.97295.37280.67320.80291.871. (CC) gcc options: -static

FS-Mark

Test: 1000 Files, 1MB Size

Linux 4.4Linux 4.5Linux 4.6Linux 4.7OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB SizeBtrfsEXT4F2FS60120180240300SE +/- 1.04, N = 3SE +/- 1.48, N = 3SE +/- 0.55, N = 3SE +/- 1.02, N = 3SE +/- 0.32, N = 3SE +/- 0.55, N = 3SE +/- 0.75, N = 3SE +/- 0.32, N = 3SE +/- 0.64, N = 3SE +/- 0.18, N = 3SE +/- 0.38, N = 3SE +/- 0.58, N = 3139.57144.70259.63142.00144.40262.73140.40142.13268.20142.33142.23267.231. (CC) gcc options: -static

Flexible IO Tester

Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPS

Linux 4.4Linux 4.5Linux 4.6Linux 4.7OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPSBtrfsEXT4F2FS50K100K150K200K250KSE +/- 1126.01, N = 3SE +/- 120.01, N = 3SE +/- 145.24, N = 3SE +/- 1185.59, N = 3SE +/- 210.42, N = 3SE +/- 44.54, N = 3SE +/- 555.15, N = 3SE +/- 110.96, N = 3SE +/- 73.87, N = 3SE +/- 1006.05, N = 3SE +/- 49.24, N = 3SE +/- 112.34, N = 3643052331102334306373823178823348663644233079233046639102316562335851. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPS

Linux 4.4Linux 4.5Linux 4.6Linux 4.7OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPSBtrfsEXT4F2FS60K120K180K240K300KSE +/- 3789.67, N = 3SE +/- 27.79, N = 3SE +/- 56.72, N = 3SE +/- 1349.38, N = 3SE +/- 73.42, N = 3SE +/- 19.08, N = 3SE +/- 3140.86, N = 3SE +/- 364.49, N = 3SE +/- 34.64, N = 3SE +/- 1073.84, N = 3SE +/- 43.50, N = 3SE +/- 73.04, N = 32643442846232854052535882839802835922636072834962853482703472839732847811. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPS

Linux 4.4Linux 4.5Linux 4.6Linux 4.7OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPSBtrfsEXT4F2FS20K40K60K80K100KSE +/- 1164.93, N = 3SE +/- 81.21, N = 3SE +/- 58.53, N = 3SE +/- 1159.30, N = 3SE +/- 78.88, N = 3SE +/- 49.70, N = 3SE +/- 1151.31, N = 4SE +/- 85.99, N = 3SE +/- 81.30, N = 3SE +/- 474.84, N = 3SE +/- 58.46, N = 3SE +/- 95.69, N = 37479781099817346993581090815207324681314816637339680946814071. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPS

Linux 4.4Linux 4.5Linux 4.6Linux 4.7OpenBenchmarking.orgIOPS, More Is BetterFlexible IO Tester 2.1.13Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: IOPSBtrfsEXT4F2FS60K120K180K240K300KSE +/- 382.19, N = 3SE +/- 84.41, N = 3SE +/- 179.27, N = 3SE +/- 6.69, N = 3SE +/- 31.42, N = 3SE +/- 69.91, N = 3SE +/- 27.20, N = 3SE +/- 44.60, N = 3SE +/- 60.01, N = 3SE +/- 16.17, N = 3SE +/- 65.08, N = 3SE +/- 109.86, N = 32701612597472756282200691941601940622428571944971945361926252155201942741. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl

SQLite

Test Target: Default Test Directory

Linux 4.4Linux 4.5Linux 4.6Linux 4.7OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.8.10.2Test Target: Default Test DirectoryBtrfsEXT4F2FS306090120150SE +/- 0.08, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.11, N = 3SE +/- 2.64, N = 6SE +/- 0.06, N = 3SE +/- 0.12, N = 3SE +/- 0.13, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3151.8366.5176.23150.7465.6476.87126.0465.5376.07132.5865.9476.281. (CC) gcc options: -O2 -ldl -lpthread


Phoronix Test Suite v10.8.5