Btrfs File-System Mount Option Testing On Linux 4.9

Btrfs Linux 4.9 file-system benchmarks with a variety of mount options. Benchmarks by Michael Larabel for a future article on Phoronix.com.

HTML result view exported from: https://openbenchmarking.org/result/1612196-TA-BTRFSBUTT59&gru&rdt&rro.

Btrfs File-System Mount Option Testing On Linux 4.9ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionStockcompress=zlibcompress=lzodiscardnobarriernodatacownotreelogssd_spreadnoatimenodatasumnodatacow,compress=lzo,discardIntel Core i7-6800K @ 3.80GHz (12 Cores)MSI X99A WORKSTATION (MS-7A54) v1.0Intel Xeon E7 v4/Xeon16384MB120GB Samsung SSD 850 + 4 x 120GB TOSHIBA-TR150NVIDIA GeForce GTX TITAN X 12288MBRealtek ALC1150ASUS PB278Intel ConnectionUbuntu 16.104.9.0-040900-generic (x86_64)Unity 7.5.0X Server 1.18.4nouveau 1.0.123.3 Mesa 12.0.3 Gallium 0.4GCC 6.2.0 20161005btrfs2560x1440OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v Disk Details- Stock: DEADLINE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5- compress=zlib: DEADLINE / compress=zlib,relatime,rw,space_cache,ssd,subvol=/,subvolid=5- compress=lzo: DEADLINE / compress=lzo,relatime,rw,space_cache,ssd,subvol=/,subvolid=5- discard: DEADLINE / discard,relatime,rw,space_cache,ssd,subvol=/,subvolid=5- nobarrier: DEADLINE / nobarrier,relatime,rw,space_cache,ssd,subvol=/,subvolid=5- nodatacow: DEADLINE / nodatacow,nodatasum,relatime,rw,space_cache,ssd,subvol=/,subvolid=5- notreelog: DEADLINE / notreelog,relatime,rw,space_cache,ssd,subvol=/,subvolid=5- ssd_spread: DEADLINE / relatime,rw,space_cache,ssd_spread,subvol=/,subvolid=5- noatime: DEADLINE / noatime,rw,space_cache,ssd,subvol=/,subvolid=5- nodatasum: DEADLINE / nodatasum,relatime,rw,space_cache,ssd,subvol=/,subvolid=5- nodatacow,compress=lzo,discard: DEADLINE / compress=lzo,discard,relatime,rw,space_cache,ssd,subvol=/,subvolid=5Processor Details- Scaling Governor: intel_pstate powersaveSystem Details- Python 2.7.12+.

Btrfs File-System Mount Option Testing On Linux 4.9fs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizeblogbench: Readblogbench: Writefio: Rand Read - Libaio - No - Yes - 4KB - Default Test Directory - MB/sfio: Rand Write - Libaio - No - Yes - 4KB - Default Test Directory - MB/sfio: Seq Read - Libaio - No - Yes - 4KB - Default Test Directory - MB/sfio: Seq Write - Libaio - No - Yes - 4KB - Default Test Directory - MB/scompilebench: Initial Createpgbench: On-Disk - Normal Load - Read Writesqlite: Default Test DirectoryStockcompress=zlibcompress=lzodiscardnobarriernodatacownotreelogssd_spreadnoatimenodatasumnodatacow,compress=lzo,discard61.2050.7044.9230651774729213.5886.26251.11100.21176.971094.5487.82133.43425.00135.9725460226644211.9991.65251.8494.28229.791529.1486.53268.72573.77286.6824437246742214.3592.00251.5694.56298.721334.3684.1573.6350.7052.3825227422669215.92160.22286.6892.72214.101557.6980.0563.1852.9345.9230413774687212.9295.81251.1593.3596.321165.4850.9462.0849.8042.9228971546108212.60291.93229.81401.07170.231199.1483.0138.1236.5031.6231145104758212.4291.50231.2692.48178.87583.70191.6860.7851.2044.9530645464637212.8089.48251.6399.94123.701109.9586.0458.5351.0343.9032712354768211.9387.67240.3095.39142.861213.4285.9966.9250.9343.7228840965859210.6491.24251.0089.21164.471120.3683.62267.12695.63304.1030991374231214.82149.37347.1591.54288.381399.7981.79OpenBenchmarking.org

FS-Mark

Test: 1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Sizenodatacow,compress=lzo,discardnodatasumnoatimessd_spreadnotreelognodatacownobarrierdiscardcompress=lzocompress=zlibStock60120180240300SE +/- 48.27, N = 6SE +/- 8.00, N = 6SE +/- 8.52, N = 6SE +/- 10.98, N = 6SE +/- 1.01, N = 6SE +/- 12.58, N = 6SE +/- 8.99, N = 6SE +/- 18.12, N = 6SE +/- 23.90, N = 6SE +/- 5.63, N = 6SE +/- 11.98, N = 6267.1266.9258.5360.7838.1262.0863.1873.63268.72133.4361.201. (CC) gcc options: -static

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 Threadsnodatacow,compress=lzo,discardnodatasumnoatimessd_spreadnotreelognodatacownobarrierdiscardcompress=lzocompress=zlibStock150300450600750SE +/- 11.30, N = 6SE +/- 0.35, N = 3SE +/- 0.19, N = 3SE +/- 0.26, N = 3SE +/- 0.25, N = 3SE +/- 0.12, N = 3SE +/- 0.81, N = 3SE +/- 0.26, N = 3SE +/- 18.57, N = 6SE +/- 11.75, N = 6SE +/- 0.55, N = 3695.6350.9351.0351.2036.5049.8052.9350.70573.77425.0050.701. (CC) gcc options: -static

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB Sizenodatacow,compress=lzo,discardnodatasumnoatimessd_spreadnotreelognodatacownobarrierdiscardcompress=lzocompress=zlibStock70140210280350SE +/- 4.30, N = 6SE +/- 0.65, N = 5SE +/- 0.64, N = 3SE +/- 1.02, N = 6SE +/- 1.04, N = 6SE +/- 0.66, N = 6SE +/- 1.48, N = 6SE +/- 1.31, N = 6SE +/- 13.37, N = 6SE +/- 6.23, N = 6SE +/- 1.05, N = 6304.1043.7243.9044.9531.6242.9245.9252.38286.68135.9744.921. (CC) gcc options: -static

BlogBench

Test: Read

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: Readnodatacow,compress=lzo,discardnodatasumnoatimessd_spreadnotreelognodatacownobarrierdiscardcompress=lzocompress=zlibStock700K1400K2100K2800K3500KSE +/- 49230.20, N = 4SE +/- 27573.77, N = 3SE +/- 34584.88, N = 3SE +/- 18961.67, N = 3SE +/- 15206.90, N = 3SE +/- 8178.79, N = 3SE +/- 60027.02, N = 3SE +/- 115112.99, N = 6SE +/- 28061.70, N = 3SE +/- 13500.47, N = 3SE +/- 40440.94, N = 3309913728840963271235306454631145102897154304137725227422443724254602230651771. (CC) gcc options: -O2 -pthread

BlogBench

Test: Write

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: Writenodatacow,compress=lzo,discardnodatasumnoatimessd_spreadnotreelognodatacownobarrierdiscardcompress=lzocompress=zlibStock14002800420056007000SE +/- 30.45, N = 3SE +/- 69.33, N = 3SE +/- 60.85, N = 3SE +/- 28.36, N = 3SE +/- 47.14, N = 3SE +/- 90.65, N = 3SE +/- 28.83, N = 3SE +/- 37.16, N = 3SE +/- 43.41, N = 3SE +/- 66.31, N = 3SE +/- 57.83, N = 3423158594768463747586108468726696742664447291. (CC) gcc options: -O2 -pthread

Flexible IO Tester

Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/s

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/snodatacow,compress=lzo,discardnodatasumnoatimessd_spreadnotreelognodatacownobarrierdiscardcompress=lzocompress=zlibStock50100150200250SE +/- 0.06, N = 3SE +/- 3.54, N = 3SE +/- 3.35, N = 3SE +/- 3.28, N = 3SE +/- 2.48, N = 3SE +/- 3.72, N = 3SE +/- 3.68, N = 3SE +/- 0.06, N = 3SE +/- 2.89, N = 3SE +/- 2.82, N = 3SE +/- 3.25, N = 4214.82210.64211.93212.80212.42212.60212.92215.92214.35211.99213.581. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/s

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/snodatacow,compress=lzo,discardnodatasumnoatimessd_spreadnotreelognodatacownobarrierdiscardcompress=lzocompress=zlibStock60120180240300SE +/- 26.99, N = 6SE +/- 0.30, N = 3SE +/- 1.47, N = 3SE +/- 2.06, N = 6SE +/- 3.68, N = 6SE +/- 4.62, N = 3SE +/- 4.57, N = 6SE +/- 25.35, N = 6SE +/- 0.99, N = 3SE +/- 1.46, N = 3SE +/- 1.61, N = 3149.3791.2487.6789.4891.50291.9395.81160.2292.0091.6586.261. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/s

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/snodatacow,compress=lzo,discardnodatasumnoatimessd_spreadnotreelognodatacownobarrierdiscardcompress=lzocompress=zlibStock80160240320400SE +/- 3.88, N = 3SE +/- 0.04, N = 3SE +/- 7.00, N = 6SE +/- 0.05, N = 3SE +/- 4.40, N = 3SE +/- 0.29, N = 3SE +/- 0.01, N = 3SE +/- 2.66, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.41, N = 3347.15251.00240.30251.63231.26229.81251.15286.68251.56251.84251.111. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/s

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/snodatacow,compress=lzo,discardnodatasumnoatimessd_spreadnotreelognodatacownobarrierdiscardcompress=lzocompress=zlibStock90180270360450SE +/- 0.83, N = 3SE +/- 1.33, N = 3SE +/- 2.68, N = 6SE +/- 6.59, N = 6SE +/- 1.96, N = 6SE +/- 10.42, N = 6SE +/- 2.87, N = 6SE +/- 1.87, N = 3SE +/- 0.98, N = 3SE +/- 2.38, N = 6SE +/- 6.41, N = 691.5489.2195.3999.9492.48401.0793.3592.7294.5694.28100.211. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial Createnodatacow,compress=lzo,discardnodatasumnoatimessd_spreadnotreelognodatacownobarrierdiscardcompress=lzocompress=zlibStock70140210280350SE +/- 11.98, N = 6SE +/- 3.81, N = 6SE +/- 14.79, N = 6SE +/- 15.22, N = 6SE +/- 2.69, N = 3SE +/- 12.27, N = 6SE +/- 16.09, N = 6SE +/- 8.38, N = 6SE +/- 3.13, N = 3SE +/- 3.67, N = 4SE +/- 16.49, N = 6288.38164.47142.86123.70178.87170.2396.32214.10298.72229.79176.97

PostgreSQL pgbench

Scaling: On-Disk - Test: Normal Load - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 9.4.3Scaling: On-Disk - Test: Normal Load - Mode: Read Writenodatacow,compress=lzo,discardnodatasumnoatimessd_spreadnotreelognodatacownobarrierdiscardcompress=lzocompress=zlibStock30060090012001500SE +/- 60.02, N = 6SE +/- 7.57, N = 3SE +/- 46.61, N = 6SE +/- 5.13, N = 3SE +/- 8.46, N = 3SE +/- 9.67, N = 3SE +/- 2.47, N = 3SE +/- 79.24, N = 3SE +/- 19.78, N = 6SE +/- 3.96, N = 3SE +/- 12.87, N = 31399.791120.361213.421109.95583.701199.141165.481557.691334.361529.141094.541. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -pthread -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm

SQLite

Test Target: Default Test Directory

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.8.10.2Test Target: Default Test Directorynodatacow,compress=lzo,discardnodatasumnoatimessd_spreadnotreelognodatacownobarrierdiscardcompress=lzocompress=zlibStock4080120160200SE +/- 0.90, N = 3SE +/- 1.64, N = 3SE +/- 1.34, N = 3SE +/- 1.23, N = 3SE +/- 15.77, N = 6SE +/- 1.29, N = 3SE +/- 0.88, N = 6SE +/- 0.50, N = 3SE +/- 1.41, N = 4SE +/- 1.35, N = 3SE +/- 0.74, N = 381.7983.6285.9986.04191.6883.0150.9480.0584.1586.5387.821. (CC) gcc options: -O2 -ldl -lpthread

Phoronix Test Suite v10.8.5