Filesystem SATA NCQ

Benchmarking disk write cache on a SATA2 NCQ capable configuration. I added a few generic CPU tests as a reference for the system performance. The tests are going to try different file systems with or without write barrier and w/ or w/out disk write cache. The default CFQ scheduler is being used.

HTML result view exported from: https://openbenchmarking.org/result/1105175-GR-FILESYSTE14&sro&grr.

Filesystem SATA NCQProcessorMotherboardChipsetMemoryDiskGraphicsOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen Resolutionext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocachebtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheIntel Core i5 650 @ 3.19GHz (4 Cores)LENOVO 5852CB6Intel Core7680MB320GB Western Digital WDC WD3200AAKX-0Intel Core IGP 256MBSUSE LINUX 112.6.32.12-0.7-default (x86_64)GNOME 2.28.2X Server 1.6.5intel 2.10.01.4 (2.1 Mesa 7.7)GCC 4.3ext31680x1050ext2/ext3BtrfsOpenBenchmarking.orgSystem Details- Disk Scheduler: CFQ. Python 2.6. Intel SpeedStep was enabled.

Filesystem SATA NCQunpack-linux: linux-2.6.32.tar.bz2aio-stress: Rand Writepostmark: Disk Transaction Performancetiobench: 64MB Rand Write - 32 Threadstiobench: 64MB Rand Read - 32 Threadsfio: Intel IOMeter File Server Access Patternfs-mark: 1000 Files, 1MB Sizedbench: 128 Clientsdbench: 48 Clientsdbench: 12 Clientsdbench: 1 Clientsiozone: 8GB Read Performanceiozone: 8GB Write Performancecompilebench: Initial Createpgbench: TPC-B Transactions Per Secondapache: Static Web Page Servingsqlite: 12,500 INSERTscompress-lzma: 256MB File Compressioncompress-pbzip2: 256MB File Compressioncompress-gzip: 2GB File Compressioncompress-7zip: Compress Speed Testjohn-the-ripper: Blowfishjohn-the-ripper: MD5john-the-ripper: Traditional DESgcrypt: CAMELLIA256-ECB Cipheropenssl: RSA 4096-bit Performancegnupg: 1GB File Encryptionext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocachebtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocache11.151158.3718952.366489.8687.4214.0513.7321.0419.9611.5460.7874.76138.17115.9512281.33880.33201.6120.9914.368041897152733246000344353.3815.8411.151113.4619361.456460.1787.9913.0780.7079.3138.1110.3260.8571.39134.35113.0212148.53864.26201.2420.9514.628076899151893248667344753.4315.9310.712031.7341663.406360.6252.7414.9570.1472.3250.8011.2366.27113.82200.49169.6812471.13854.89200.9920.8314.318076897152553243000344753.3515.9110.892024.5041661.736531.7361.2218.70162.69165.9577.1010.8366.09111.21188.43164.9212136.65840.08201.3021.4414.528085899152833251333343753.3815.9010.67309051.706464.8755.9814.62132.76107.1448.149.9179.86121.95117.6033.7811944.801204.92201.8321.7414.338045898152783249667344053.4015.9710.7630551.706481.5151.9816.7346.5450.4629.379.6985.53124.9495.5529.4812309.251485.46201.4720.7014.538032898152323250667343353.4015.87OpenBenchmarking.org

Unpacking The Linux Kernel

linux-2.6.32.tar.bz2

OpenBenchmarking.orgSeconds, Fewer Is BetterUnpacking The Linux Kernellinux-2.6.32.tar.bz2btrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache3691215SE +/- 0.13, N = 8SE +/- 0.10, N = 4SE +/- 0.42, N = 8SE +/- 0.19, N = 4SE +/- 0.09, N = 4SE +/- 0.14, N = 410.6710.7611.1511.1510.7110.89

AIO-Stress

Random Write

OpenBenchmarking.orgMB/s, More Is BetterAIO-Stress 0.21Random Writeext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache400800120016002000SE +/- 24.13, N = 6SE +/- 21.98, N = 3SE +/- 20.87, N = 3SE +/- 11.53, N = 31158.371113.462031.732024.50

PostMark

Disk Transaction Performance

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction Performancebtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache9001800270036004500SE +/- 34.80, N = 10SE +/- 46.40, N = 10SE +/- 27.60, N = 5SE +/- 141.32, N = 10SE +/- 0.00, N = 5SE +/- 0.00, N = 5309030551895193641664166

Threaded I/O Tester

64MB Random Write - 32 Threads

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 0.3.364MB Random Write - 32 Threadsbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache1224364860SE +/- 1.14, N = 8SE +/- 0.01, N = 4SE +/- 0.01, N = 4SE +/- 0.03, N = 8SE +/- 0.01, N = 4SE +/- 0.01, N = 451.701.702.361.453.401.73

Threaded I/O Tester

64MB Random Read - 32 Threads

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 0.3.364MB Random Read - 32 Threadsbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache14002800420056007000SE +/- 29.65, N = 4SE +/- 9.30, N = 4SE +/- 66.48, N = 4SE +/- 75.75, N = 4SE +/- 90.95, N = 4SE +/- 10.55, N = 46464.876481.516489.866460.176360.626531.73

Flexible IO Tester

Intel IOMeter File Server Access Pattern

OpenBenchmarking.orgSeconds (Run Time), Fewer Is BetterFlexible IO Tester 1.21Intel IOMeter File Server Access Patternbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache20406080100SE +/- 0.50, N = 3SE +/- 0.72, N = 6SE +/- 1.82, N = 6SE +/- 1.35, N = 3SE +/- 0.95, N = 3SE +/- 0.07, N = 355.9851.9887.4287.9952.7461.22

FS-Mark

1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.31000 Files, 1MB Sizebtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache510152025SE +/- 0.21, N = 5SE +/- 0.03, N = 3SE +/- 0.57, N = 6SE +/- 0.44, N = 6SE +/- 0.21, N = 6SE +/- 0.17, N = 314.6216.7314.0513.0714.9518.70

Dbench

128 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0128 Clientsbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache4080120160200SE +/- 4.84, N = 6SE +/- 0.54, N = 3SE +/- 0.67, N = 6SE +/- 3.75, N = 3SE +/- 1.05, N = 3SE +/- 1.83, N = 3132.7646.5413.7380.7070.14162.69

Dbench

48 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.048 Clientsbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache4080120160200SE +/- 0.18, N = 3SE +/- 0.74, N = 3SE +/- 0.14, N = 3SE +/- 0.77, N = 3SE +/- 0.51, N = 3SE +/- 1.96, N = 3107.1450.4621.0479.3172.32165.95

Dbench

12 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.012 Clientsbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache20406080100SE +/- 1.21, N = 6SE +/- 0.31, N = 3SE +/- 0.08, N = 3SE +/- 3.42, N = 6SE +/- 0.28, N = 3SE +/- 0.67, N = 348.1429.3719.9638.1150.8077.10

Dbench

1 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.01 Clientsbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache3691215SE +/- 0.03, N = 3SE +/- 0.16, N = 6SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 39.919.6911.5410.3211.2310.83

IOzone

8GB Read Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.3478GB Read Performancebtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache20406080100SE +/- 0.15, N = 3SE +/- 0.16, N = 3SE +/- 0.26, N = 3SE +/- 0.01, N = 3SE +/- 3.63, N = 6SE +/- 3.79, N = 679.8685.5360.7860.8566.2766.09

IOzone

8GB Write Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.3478GB Write Performancebtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache306090120150SE +/- 2.42, N = 3SE +/- 0.24, N = 3SE +/- 0.45, N = 3SE +/- 0.94, N = 3SE +/- 2.80, N = 6SE +/- 2.45, N = 6121.95124.9474.7671.39113.82111.21

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial Createbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache4080120160200SE +/- 3.04, N = 6SE +/- 1.85, N = 6SE +/- 11.37, N = 6SE +/- 3.85, N = 6SE +/- 5.58, N = 6SE +/- 4.64, N = 6117.6095.55138.17134.35200.49188.43

PostgreSQL pgbench

TPC-B Transactions Per Second

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 9.0.4TPC-B Transactions Per Secondbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache4080120160200SE +/- 0.39, N = 3SE +/- 0.16, N = 3SE +/- 0.51, N = 3SE +/- 2.73, N = 6SE +/- 0.43, N = 3SE +/- 1.18, N = 333.7829.48115.95113.02169.68164.92

Apache Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.2.17Static Web Page Servingbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache3K6K9K12K15KSE +/- 57.40, N = 3SE +/- 173.40, N = 3SE +/- 169.63, N = 5SE +/- 241.02, N = 3SE +/- 118.49, N = 3SE +/- 176.78, N = 611944.8012309.2512281.3312148.5312471.1312136.65

SQLite

12,500 INSERTs

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.7.312,500 INSERTsbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache30060090012001500SE +/- 15.76, N = 3SE +/- 18.75, N = 3SE +/- 13.25, N = 3SE +/- 11.99, N = 5SE +/- 2.53, N = 3SE +/- 4.84, N = 31204.921485.46880.33864.26854.89840.08

LZMA Compression

256MB File Compression

OpenBenchmarking.orgSeconds, Fewer Is BetterLZMA Compression256MB File Compressionbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache4080120160200SE +/- 0.66, N = 3SE +/- 0.21, N = 3SE +/- 0.34, N = 3SE +/- 0.04, N = 3SE +/- 0.40, N = 3SE +/- 0.23, N = 3201.83201.47201.61201.24200.99201.30

Parallel BZIP2 Compression

256MB File Compression

OpenBenchmarking.orgSeconds, Fewer Is BetterParallel BZIP2 Compression 1.0.5256MB File Compressionbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache510152025SE +/- 0.10, N = 3SE +/- 0.40, N = 6SE +/- 0.29, N = 5SE +/- 0.35, N = 4SE +/- 0.10, N = 3SE +/- 0.22, N = 321.7420.7020.9920.9520.8321.44

Gzip Compression

2GB File Compression

OpenBenchmarking.orgSeconds, Fewer Is BetterGzip Compression2GB File Compressionbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache48121620SE +/- 0.04, N = 3SE +/- 0.24, N = 3SE +/- 0.06, N = 3SE +/- 0.20, N = 3SE +/- 0.04, N = 3SE +/- 0.26, N = 314.3314.5314.3614.6214.3114.52

7-Zip Compression

Compress Speed Test

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 9.13Compress Speed Testbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache2K4K6K8K10KSE +/- 13.32, N = 3SE +/- 8.69, N = 3SE +/- 3.48, N = 3SE +/- 5.84, N = 3SE +/- 17.04, N = 3SE +/- 9.82, N = 3804580328041807680768085

John The Ripper

Test: Blowfish

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.3.1Test: Blowfishbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache2004006008001000SE +/- 0.33, N = 3SE +/- 1.00, N = 3SE +/- 1.20, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3898898897899897899

John The Ripper

Test: MD5

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.3.1Test: MD5btrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache3K6K9K12K15KSE +/- 8.69, N = 3SE +/- 60.84, N = 3SE +/- 10.48, N = 3SE +/- 41.80, N = 3SE +/- 6.89, N = 3SE +/- 6.08, N = 3152781523215273151891525515283

John The Ripper

Test: Traditional DES

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.3.1Test: Traditional DESbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache700K1400K2100K2800K3500KSE +/- 2333.33, N = 3SE +/- 1452.97, N = 3SE +/- 8185.35, N = 3SE +/- 1763.83, N = 3SE +/- 1154.70, N = 3SE +/- 881.92, N = 3324966732506673246000324866732430003251333

Gcrypt Library

CAMELLIA256-ECB Cipher

OpenBenchmarking.orgMicroseconds, Fewer Is BetterGcrypt Library 1.4.4CAMELLIA256-ECB Cipherbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache7001400210028003500SE +/- 0.00, N = 3SE +/- 3.33, N = 3SE +/- 3.33, N = 3SE +/- 3.33, N = 3SE +/- 6.67, N = 3SE +/- 3.33, N = 3344034333443344734473437

OpenSSL

RSA 4096-bit Performance

OpenBenchmarking.orgSigns Per Second, More Is BetterOpenSSL 1.0.0aRSA 4096-bit Performancebtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache1224364860SE +/- 0.07, N = 4SE +/- 0.00, N = 4SE +/- 0.06, N = 4SE +/- 0.05, N = 4SE +/- 0.03, N = 4SE +/- 0.03, N = 453.4053.4053.3853.4353.3553.38

GnuPG

1GB File Encryption

OpenBenchmarking.orgSeconds, Fewer Is BetterGnuPG 1.4.101GB File Encryptionbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache48121620SE +/- 0.08, N = 4SE +/- 0.02, N = 4SE +/- 0.01, N = 4SE +/- 0.09, N = 4SE +/- 0.04, N = 4SE +/- 0.06, N = 415.9715.8715.8415.9315.9115.90


Phoronix Test Suite v10.8.4