Btrfs File-System Mount Option Testing On Linux 4.9

Btrfs Linux 4.9 file-system benchmarks with a variety of mount options. Benchmarks by Michael Larabel for a future article on Phoronix.com.

HTML result view exported from: https://openbenchmarking.org/result/1612196-TA-BTRFSBUTT59&sor.

Btrfs File-System Mount Option Testing On Linux 4.9ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionStockcompress=zlibcompress=lzodiscardnobarriernodatacownotreelogssd_spreadnoatimenodatasumnodatacow,compress=lzo,discardIntel Core i7-6800K @ 3.80GHz (12 Cores)MSI X99A WORKSTATION (MS-7A54) v1.0Intel Xeon E7 v4/Xeon16384MB120GB Samsung SSD 850 + 4 x 120GB TOSHIBA-TR150NVIDIA GeForce GTX TITAN X 12288MBRealtek ALC1150ASUS PB278Intel ConnectionUbuntu 16.104.9.0-040900-generic (x86_64)Unity 7.5.0X Server 1.18.4nouveau 1.0.123.3 Mesa 12.0.3 Gallium 0.4GCC 6.2.0 20161005btrfs2560x1440OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v Disk Details- Stock: DEADLINE / relatime,rw,space_cache,ssd,subvol=/,subvolid=5- compress=zlib: DEADLINE / compress=zlib,relatime,rw,space_cache,ssd,subvol=/,subvolid=5- compress=lzo: DEADLINE / compress=lzo,relatime,rw,space_cache,ssd,subvol=/,subvolid=5- discard: DEADLINE / discard,relatime,rw,space_cache,ssd,subvol=/,subvolid=5- nobarrier: DEADLINE / nobarrier,relatime,rw,space_cache,ssd,subvol=/,subvolid=5- nodatacow: DEADLINE / nodatacow,nodatasum,relatime,rw,space_cache,ssd,subvol=/,subvolid=5- notreelog: DEADLINE / notreelog,relatime,rw,space_cache,ssd,subvol=/,subvolid=5- ssd_spread: DEADLINE / relatime,rw,space_cache,ssd_spread,subvol=/,subvolid=5- noatime: DEADLINE / noatime,rw,space_cache,ssd,subvol=/,subvolid=5- nodatasum: DEADLINE / nodatasum,relatime,rw,space_cache,ssd,subvol=/,subvolid=5- nodatacow,compress=lzo,discard: DEADLINE / compress=lzo,discard,relatime,rw,space_cache,ssd,subvol=/,subvolid=5Processor Details- Scaling Governor: intel_pstate powersaveSystem Details- Python 2.7.12+.

Btrfs File-System Mount Option Testing On Linux 4.9sqlite: Default Test Directoryfio: Rand Read - Libaio - No - Yes - 4KB - Default Test Directory - MB/sfio: Rand Write - Libaio - No - Yes - 4KB - Default Test Directory - MB/sfio: Seq Read - Libaio - No - Yes - 4KB - Default Test Directory - MB/sfio: Seq Write - Libaio - No - Yes - 4KB - Default Test Directory - MB/sfs-mark: 1000 Files, 1MB Sizefs-mark: 5000 Files, 1MB Size, 4 Threadsfs-mark: 4000 Files, 32 Sub Dirs, 1MB Sizeblogbench: Readblogbench: Writecompilebench: Initial Createpgbench: On-Disk - Normal Load - Read WriteStockcompress=zlibcompress=lzodiscardnobarriernodatacownotreelogssd_spreadnoatimenodatasumnodatacow,compress=lzo,discard87.82213.5886.26251.11100.2161.2050.7044.9230651774729176.971094.5486.53211.9991.65251.8494.28133.43425.00135.9725460226644229.791529.1484.15214.3592.00251.5694.56268.72573.77286.6824437246742298.721334.3680.05215.92160.22286.6892.7273.6350.7052.3825227422669214.101557.6950.94212.9295.81251.1593.3563.1852.9345.923041377468796.321165.4883.01212.60291.93229.81401.0762.0849.8042.9228971546108170.231199.14191.68212.4291.50231.2692.4838.1236.5031.6231145104758178.87583.7086.04212.8089.48251.6399.9460.7851.2044.9530645464637123.701109.9585.99211.9387.67240.3095.3958.5351.0343.9032712354768142.861213.4283.62210.6491.24251.0089.2166.9250.9343.7228840965859164.471120.3681.79214.82149.37347.1591.54267.12695.63304.1030991374231288.381399.79OpenBenchmarking.org

SQLite

Test Target: Default Test Directory

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.8.10.2Test Target: Default Test Directorynobarrierdiscardnodatacow,compress=lzo,discardnodatacownodatasumcompress=lzonoatimessd_spreadcompress=zlibStocknotreelog4080120160200SE +/- 0.88, N = 6SE +/- 0.50, N = 3SE +/- 0.90, N = 3SE +/- 1.29, N = 3SE +/- 1.64, N = 3SE +/- 1.41, N = 4SE +/- 1.34, N = 3SE +/- 1.23, N = 3SE +/- 1.35, N = 3SE +/- 0.74, N = 3SE +/- 15.77, N = 650.9480.0581.7983.0183.6284.1585.9986.0486.5387.82191.681. (CC) gcc options: -O2 -ldl -lpthread

Flexible IO Tester

Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/s

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Random Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/sdiscardnodatacow,compress=lzo,discardcompress=lzoStocknobarrierssd_spreadnodatacownotreelogcompress=zlibnoatimenodatasum50100150200250SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 2.89, N = 3SE +/- 3.25, N = 4SE +/- 3.68, N = 3SE +/- 3.28, N = 3SE +/- 3.72, N = 3SE +/- 2.48, N = 3SE +/- 2.82, N = 3SE +/- 3.35, N = 3SE +/- 3.54, N = 3215.92214.82214.35213.58212.92212.80212.60212.42211.99211.93210.641. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/s

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Random Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/snodatacowdiscardnodatacow,compress=lzo,discardnobarriercompress=lzocompress=zlibnotreelognodatasumssd_spreadnoatimeStock60120180240300SE +/- 4.62, N = 3SE +/- 25.35, N = 6SE +/- 26.99, N = 6SE +/- 4.57, N = 6SE +/- 0.99, N = 3SE +/- 1.46, N = 3SE +/- 3.68, N = 6SE +/- 0.30, N = 3SE +/- 2.06, N = 6SE +/- 1.47, N = 3SE +/- 1.61, N = 3291.93160.22149.3795.8192.0091.6591.5091.2489.4887.6786.261. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/s

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Read - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/snodatacow,compress=lzo,discarddiscardcompress=zlibssd_spreadcompress=lzonobarrierStocknodatasumnoatimenotreelognodatacow80160240320400SE +/- 3.88, N = 3SE +/- 2.66, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.41, N = 3SE +/- 0.04, N = 3SE +/- 7.00, N = 6SE +/- 4.40, N = 3SE +/- 0.29, N = 3347.15286.68251.84251.63251.56251.15251.11251.00240.30231.26229.811. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl

Flexible IO Tester

Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/s

OpenBenchmarking.orgMB/s, More Is BetterFlexible IO Tester 2.1.13Type: Sequential Write - IO Engine: Libaio - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory - Result: MB/snodatacowStockssd_spreadnoatimecompress=lzocompress=zlibnobarrierdiscardnotreelognodatacow,compress=lzo,discardnodatasum90180270360450SE +/- 10.42, N = 6SE +/- 6.41, N = 6SE +/- 6.59, N = 6SE +/- 2.68, N = 6SE +/- 0.98, N = 3SE +/- 2.38, N = 6SE +/- 2.87, N = 6SE +/- 1.87, N = 3SE +/- 1.96, N = 6SE +/- 0.83, N = 3SE +/- 1.33, N = 3401.07100.2199.9495.3994.5694.2893.3592.7292.4891.5489.211. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl

FS-Mark

Test: 1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 1000 Files, 1MB Sizecompress=lzonodatacow,compress=lzo,discardcompress=zlibdiscardnodatasumnobarriernodatacowStockssd_spreadnoatimenotreelog60120180240300SE +/- 23.90, N = 6SE +/- 48.27, N = 6SE +/- 5.63, N = 6SE +/- 18.12, N = 6SE +/- 8.00, N = 6SE +/- 8.99, N = 6SE +/- 12.58, N = 6SE +/- 11.98, N = 6SE +/- 10.98, N = 6SE +/- 8.52, N = 6SE +/- 1.01, N = 6268.72267.12133.4373.6366.9263.1862.0861.2060.7858.5338.121. (CC) gcc options: -static

FS-Mark

Test: 5000 Files, 1MB Size, 4 Threads

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 5000 Files, 1MB Size, 4 Threadsnodatacow,compress=lzo,discardcompress=lzocompress=zlibnobarrierssd_spreadnoatimenodatasumdiscardStocknodatacownotreelog150300450600750SE +/- 11.30, N = 6SE +/- 18.57, N = 6SE +/- 11.75, N = 6SE +/- 0.81, N = 3SE +/- 0.26, N = 3SE +/- 0.19, N = 3SE +/- 0.35, N = 3SE +/- 0.26, N = 3SE +/- 0.55, N = 3SE +/- 0.12, N = 3SE +/- 0.25, N = 3695.63573.77425.0052.9351.2051.0350.9350.7050.7049.8036.501. (CC) gcc options: -static

FS-Mark

Test: 4000 Files, 32 Sub Dirs, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.3Test: 4000 Files, 32 Sub Dirs, 1MB Sizenodatacow,compress=lzo,discardcompress=lzocompress=zlibdiscardnobarrierssd_spreadStocknoatimenodatasumnodatacownotreelog70140210280350SE +/- 4.30, N = 6SE +/- 13.37, N = 6SE +/- 6.23, N = 6SE +/- 1.31, N = 6SE +/- 1.48, N = 6SE +/- 1.02, N = 6SE +/- 1.05, N = 6SE +/- 0.64, N = 3SE +/- 0.65, N = 5SE +/- 0.66, N = 6SE +/- 1.04, N = 6304.10286.68135.9752.3845.9244.9544.9243.9043.7242.9231.621. (CC) gcc options: -static

BlogBench

Test: Read

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: Readnoatimenotreelognodatacow,compress=lzo,discardStockssd_spreadnobarriernodatacownodatasumcompress=zlibdiscardcompress=lzo700K1400K2100K2800K3500KSE +/- 34584.88, N = 3SE +/- 15206.90, N = 3SE +/- 49230.20, N = 4SE +/- 40440.94, N = 3SE +/- 18961.67, N = 3SE +/- 60027.02, N = 3SE +/- 8178.79, N = 3SE +/- 27573.77, N = 3SE +/- 13500.47, N = 3SE +/- 115112.99, N = 6SE +/- 28061.70, N = 3327123531145103099137306517730645463041377289715428840962546022252274224437241. (CC) gcc options: -O2 -pthread

BlogBench

Test: Write

OpenBenchmarking.orgFinal Score, More Is BetterBlogBench 1.0Test: Writecompress=lzocompress=zlibnodatacownodatasumnoatimenotreelogStocknobarrierssd_spreadnodatacow,compress=lzo,discarddiscard14002800420056007000SE +/- 43.41, N = 3SE +/- 66.31, N = 3SE +/- 90.65, N = 3SE +/- 69.33, N = 3SE +/- 60.85, N = 3SE +/- 47.14, N = 3SE +/- 57.83, N = 3SE +/- 28.83, N = 3SE +/- 28.36, N = 3SE +/- 30.45, N = 3SE +/- 37.16, N = 3674266446108585947684758472946874637423126691. (CC) gcc options: -O2 -pthread

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial Createcompress=lzonodatacow,compress=lzo,discardcompress=zlibdiscardnotreelogStocknodatacownodatasumnoatimessd_spreadnobarrier70140210280350SE +/- 3.13, N = 3SE +/- 11.98, N = 6SE +/- 3.67, N = 4SE +/- 8.38, N = 6SE +/- 2.69, N = 3SE +/- 16.49, N = 6SE +/- 12.27, N = 6SE +/- 3.81, N = 6SE +/- 14.79, N = 6SE +/- 15.22, N = 6SE +/- 16.09, N = 6298.72288.38229.79214.10178.87176.97170.23164.47142.86123.7096.32

PostgreSQL pgbench

Scaling: On-Disk - Test: Normal Load - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 9.4.3Scaling: On-Disk - Test: Normal Load - Mode: Read Writediscardcompress=zlibnodatacow,compress=lzo,discardcompress=lzonoatimenodatacownobarriernodatasumssd_spreadStocknotreelog30060090012001500SE +/- 79.24, N = 3SE +/- 3.96, N = 3SE +/- 60.02, N = 6SE +/- 19.78, N = 6SE +/- 46.61, N = 6SE +/- 9.67, N = 3SE +/- 2.47, N = 3SE +/- 7.57, N = 3SE +/- 5.13, N = 3SE +/- 12.87, N = 3SE +/- 8.46, N = 31557.691529.141399.791334.361213.421199.141165.481120.361109.951094.54583.701. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -pthread -lpgcommon -lpgport -lpq -lpthread -lrt -lcrypt -ldl -lm


Phoronix Test Suite v10.8.4