Btrfs File-System Mount Option Testing On Linux 4.9

Btrfs Linux 4.9 file-system benchmarks with a variety of mount options. Benchmarks by Michael Larabel for a future article on Phoronix.com.

HTML result view exported from: https://openbenchmarking.org/result/1612196-TA-BTRFSBUTT59&grw&sro&rro.

Btrfs File-System Mount Option Testing On Linux 4.9ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionStockcompress=zlibcompress=lzodiscardnobarriernodatacownotreelogssd_spreadnoatimenodatasumnodatacow,compress=lzo,discardIntel Core i7-6800K @ 3.80GHz (12 Cores)MSI X99A WORKSTATION (MS-7A54) v1.0Intel Xeon E7 v4/Xeon16384MB120GB Samsung SSD 850 + 4 x 120GB TOSHIBA-TR150NVIDIA GeForce GTX TITAN X 12288MBRealtek ALC1150ASUS PB278Intel ConnectionUbuntu 16.104.9.0-040900-generic (x86_64)Unity 7.5.0X Server 1.18.4nouveau 1.0.123.3 Mesa 12.0.3 Gallium 0.4GCC 6.2.0 20161005btrfs2560x1440OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v Disk Details- Stock: DEADLINE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5- compress=zlib: DEADLINE / compress=zlib,relatime,rw,space_cache,ssd,subvol=/,subvolid=5- compress=lzo: DEADLINE / compress=lzo,relatime,rw,space_cache,ssd,subvol=/,subvolid=5- discard: DEADLINE / discard,relatime,rw,space_cache,ssd,subvol=/,subvolid=5- nobarrier: DEADLINE / nobarrier,relatime,rw,space_cache,ssd,subvol=/,subvolid=5- nodatacow: DEADLINE / nodatacow,nodatasum,relatime,rw,space_cache,ssd,subvol=/,subvolid=5- notreelog: DEADLINE / notreelog,relatime,rw,space_cache,ssd,subvol=/,subvolid=5- ssd_spread: DEADLINE / relatime,rw,space_cache,ssd_spread,subvol=/,subvolid=5- noatime: DEADLINE / noatime,rw,space_cache,ssd,subvol=/,subvolid=5- nodatasum: DEADLINE / nodatasum,relatime,rw,space_cache,ssd,subvol=/,subvolid=5- nodatacow,compress=lzo,discard: DEADLINE / compress=lzo,discard,relatime,rw,space_cache,ssd,subvol=/,subvolid=5Processor Details- Scaling Governor: intel_pstate powersaveSystem Details- Python 2.7.12+.

Btrfs File-System Mount Option Testing On Linux 4.9compilebench: Initial Createfio: Rand Read - Libaio - No - Yes - 4KB - Default Test Directory - MB/sfio: Rand Write - Libaio - No - Yes - 4KB - Default Test Directory - MB/sfio: Seq Read - Libaio - No - Yes - 4KB - Default Test Directory - MB/sfio: Seq Write - Libaio - No - Yes - 4KB - Default Test Directory - MB/sfs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizeblogbench: Readblogbench: Writesqlite: Default Test Directorypgbench: On-Disk - Normal Load - Read WriteStockcompress=zlibcompress=lzodiscardnobarriernodatacownotreelogssd_spreadnoatimenodatasumnodatacow,compress=lzo,discard176.97213.5886.26251.11100.2161.2050.7044.923065177472987.821094.54229.79211.9991.65251.8494.28133.43425.00135.972546022664486.531529.14298.72214.3592.00251.5694.56268.72573.77286.682443724674284.151334.36214.10215.92160.22286.6892.7273.6350.7052.382522742266980.051557.6996.32212.9295.81251.1593.3563.1852.9345.923041377468750.941165.48170.23212.60291.93229.81401.0762.0849.8042.922897154610883.011199.14178.87212.4291.50231.2692.4838.1236.5031.6231145104758191.68583.70123.70212.8089.48251.6399.9460.7851.2044.953064546463786.041109.95142.86211.9387.67240.3095.3958.5351.0343.903271235476885.991213.42164.47210.6491.24251.0089.2166.9250.9343.722884096585983.621120.36288.38214.82149.37347.1591.54267.12695.63304.103099137423181.791399.79OpenBenchmarking.org

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial Createssd_spreadnotreelognodatasumnodatacow,compress=lzo,discardnodatacownobarriernoatimediscardcompress=zlibcompress=lzoStock70140210280350SE +/- 15.22, N = 6SE +/- 2.69, N = 3SE +/- 3.81, N = 6SE +/- 11.98, N = 6SE +/- 12.27, N = 6SE +/- 16.09, N = 6SE +/- 14.79, N = 6SE +/- 8.38, N = 6SE +/- 3.67, N = 4SE +/- 3.13, N = 3SE +/- 16.49, N = 6123.70178.87164.47288.38170.2396.32142.86214.10229.79298.72176.97

Flexible IO Tester

Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/s

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/sssd_spreadnotreelognodatasumnodatacow,compress=lzo,discardnodatacownobarriernoatimediscardcompress=zlibcompress=lzoStock50100150200250SE +/- 3.28, N = 3SE +/- 2.48, N = 3SE +/- 3.54, N = 3SE +/- 0.06, N = 3SE +/- 3.72, N = 3SE +/- 3.68, N = 3SE +/- 3.35, N = 3SE +/- 0.06, N = 3SE +/- 2.82, N = 3SE +/- 2.89, N = 3SE +/- 3.25, N = 4212.80212.42210.64214.82212.60212.92211.93215.92211.99214.35213.581. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/s

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/sssd_spreadnotreelognodatasumnodatacow,compress=lzo,discardnodatacownobarriernoatimediscardcompress=zlibcompress=lzoStock60120180240300SE +/- 2.06, N = 6SE +/- 3.68, N = 6SE +/- 0.30, N = 3SE +/- 26.99, N = 6SE +/- 4.62, N = 3SE +/- 4.57, N = 6SE +/- 1.47, N = 3SE +/- 25.35, N = 6SE +/- 1.46, N = 3SE +/- 0.99, N = 3SE +/- 1.61, N = 389.4891.5091.24149.37291.9395.8187.67160.2291.6592.0086.261. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/s

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/sssd_spreadnotreelognodatasumnodatacow,compress=lzo,discardnodatacownobarriernoatimediscardcompress=zlibcompress=lzoStock80160240320400SE +/- 0.05, N = 3SE +/- 4.40, N = 3SE +/- 0.04, N = 3SE +/- 3.88, N = 3SE +/- 0.29, N = 3SE +/- 0.01, N = 3SE +/- 7.00, N = 6SE +/- 2.66, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3SE +/- 0.41, N = 3251.63231.26251.00347.15229.81251.15240.30286.68251.84251.56251.111. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/s

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/sssd_spreadnotreelognodatasumnodatacow,compress=lzo,discardnodatacownobarriernoatimediscardcompress=zlibcompress=lzoStock90180270360450SE +/- 6.59, N = 6SE +/- 1.96, N = 6SE +/- 1.33, N = 3SE +/- 0.83, N = 3SE +/- 10.42, N = 6SE +/- 2.87, N = 6SE +/- 2.68, N = 6SE +/- 1.87, N = 3SE +/- 2.38, N = 6SE +/- 0.98, N = 3SE +/- 6.41, N = 699.9492.4889.2191.54401.0793.3595.3992.7294.2894.56100.211. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl

FS-Mark

Test: 1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Sizessd_spreadnotreelognodatasumnodatacow,compress=lzo,discardnodatacownobarriernoatimediscardcompress=zlibcompress=lzoStock60120180240300SE +/- 10.98, N = 6SE +/- 1.01, N = 6SE +/- 8.00, N = 6SE +/- 48.27, N = 6SE +/- 12.58, N = 6SE +/- 8.99, N = 6SE +/- 8.52, N = 6SE +/- 18.12, N = 6SE +/- 5.63, N = 6SE +/- 23.90, N = 6SE +/- 11.98, N = 660.7838.1266.92267.1262.0863.1858.5373.63133.43268.7261.201. (CC) gcc options: -static

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 Threadsssd_spreadnotreelognodatasumnodatacow,compress=lzo,discardnodatacownobarriernoatimediscardcompress=zlibcompress=lzoStock150300450600750SE +/- 0.26, N = 3SE +/- 0.25, N = 3SE +/- 0.35, N = 3SE +/- 11.30, N = 6SE +/- 0.12, N = 3SE +/- 0.81, N = 3SE +/- 0.19, N = 3SE +/- 0.26, N = 3SE +/- 11.75, N = 6SE +/- 18.57, N = 6SE +/- 0.55, N = 351.2036.5050.93695.6349.8052.9351.0350.70425.00573.7750.701. (CC) gcc options: -static

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB Sizessd_spreadnotreelognodatasumnodatacow,compress=lzo,discardnodatacownobarriernoatimediscardcompress=zlibcompress=lzoStock70140210280350SE +/- 1.02, N = 6SE +/- 1.04, N = 6SE +/- 0.65, N = 5SE +/- 4.30, N = 6SE +/- 0.66, N = 6SE +/- 1.48, N = 6SE +/- 0.64, N = 3SE +/- 1.31, N = 6SE +/- 6.23, N = 6SE +/- 13.37, N = 6SE +/- 1.05, N = 644.9531.6243.72304.1042.9245.9243.9052.38135.97286.6844.921. (CC) gcc options: -static

BlogBench

Test: Read

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: Readssd_spreadnotreelognodatasumnodatacow,compress=lzo,discardnodatacownobarriernoatimediscardcompress=zlibcompress=lzoStock700K1400K2100K2800K3500KSE +/- 18961.67, N = 3SE +/- 15206.90, N = 3SE +/- 27573.77, N = 3SE +/- 49230.20, N = 4SE +/- 8178.79, N = 3SE +/- 60027.02, N = 3SE +/- 34584.88, N = 3SE +/- 115112.99, N = 6SE +/- 13500.47, N = 3SE +/- 28061.70, N = 3SE +/- 40440.94, N = 3306454631145102884096309913728971543041377327123525227422546022244372430651771. (CC) gcc options: -O2 -pthread

BlogBench

Test: Write

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: Writessd_spreadnotreelognodatasumnodatacow,compress=lzo,discardnodatacownobarriernoatimediscardcompress=zlibcompress=lzoStock14002800420056007000SE +/- 28.36, N = 3SE +/- 47.14, N = 3SE +/- 69.33, N = 3SE +/- 30.45, N = 3SE +/- 90.65, N = 3SE +/- 28.83, N = 3SE +/- 60.85, N = 3SE +/- 37.16, N = 3SE +/- 66.31, N = 3SE +/- 43.41, N = 3SE +/- 57.83, N = 3463747585859423161084687476826696644674247291. (CC) gcc options: -O2 -pthread

SQLite

Test Target: Default Test Directory

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.8.10.2Test Target: Default Test Directoryssd_spreadnotreelognodatasumnodatacow,compress=lzo,discardnodatacownobarriernoatimediscardcompress=zlibcompress=lzoStock4080120160200SE +/- 1.23, N = 3SE +/- 15.77, N = 6SE +/- 1.64, N = 3SE +/- 0.90, N = 3SE +/- 1.29, N = 3SE +/- 0.88, N = 6SE +/- 1.34, N = 3SE +/- 0.50, N = 3SE +/- 1.35, N = 3SE +/- 1.41, N = 4SE +/- 0.74, N = 386.04191.6883.6281.7983.0150.9485.9980.0586.5384.1587.821. (CC) gcc options: -O2 -ldl -lpthread

PostgreSQL pgbench

Scaling: On-Disk - Test: Normal Load - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 9.4.3Scaling: On-Disk - Test: Normal Load - Mode: Read Writessd_spreadnotreelognodatasumnodatacow,compress=lzo,discardnodatacownobarriernoatimediscardcompress=zlibcompress=lzoStock30060090012001500SE +/- 5.13, N = 3SE +/- 8.46, N = 3SE +/- 7.57, N = 3SE +/- 60.02, N = 6SE +/- 9.67, N = 3SE +/- 2.47, N = 3SE +/- 46.61, N = 6SE +/- 79.24, N = 3SE +/- 3.96, N = 3SE +/- 19.78, N = 6SE +/- 12.87, N = 31109.95583.701120.361399.791199.141165.481213.421557.691529.141334.361094.541. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -pthread -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

Phoronix Test Suite v10.8.5