Filesystem SATA NCQ

Benchmarking disk write cache on a SATA2 NCQ capable configuration. I added a few generic CPU tests as a reference for the system performance. The tests are going to try different file systems with or without write barrier and w/ or w/out disk write cache. The default CFQ scheduler is being used.

HTML result view exported from: https://openbenchmarking.org/result/1105175-GR-FILESYSTE14&sor&grr.

Filesystem SATA NCQProcessorMotherboardChipsetMemoryDiskGraphicsOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen Resolutionext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocachebtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheIntel Core i5 650 @ 3.19GHz (4 Cores)LENOVO 5852CB6Intel Core7680MB320GB Western Digital WDC WD3200AAKX-0Intel Core IGP 256MBSUSE LINUX 112.6.32.12-0.7-default (x86_64)GNOME 2.28.2X Server 1.6.5intel 2.10.01.4 (2.1 Mesa 7.7)GCC 4.3ext31680x1050ext2/ext3BtrfsOpenBenchmarking.orgSystem Details- Disk Scheduler: CFQ. Python 2.6. Intel SpeedStep was enabled.

Filesystem SATA NCQunpack-linux: linux-2.6.32.tar.bz2aio-stress: Rand Writepostmark: Disk Transaction Performancetiobench: 64MB Rand Write - 32 Threadstiobench: 64MB Rand Read - 32 Threadsfio: Intel IOMeter File Server Access Patternfs-mark: 1000 Files, 1MB Sizedbench: 128 Clientsdbench: 48 Clientsdbench: 12 Clientsdbench: 1 Clientsiozone: 8GB Read Performanceiozone: 8GB Write Performancecompilebench: Initial Createpgbench: TPC-B Transactions Per Secondapache: Static Web Page Servingsqlite: 12,500 INSERTscompress-lzma: 256MB File Compressioncompress-pbzip2: 256MB File Compressioncompress-gzip: 2GB File Compressioncompress-7zip: Compress Speed Testjohn-the-ripper: Blowfishjohn-the-ripper: MD5john-the-ripper: Traditional DESgcrypt: CAMELLIA256-ECB Cipheropenssl: RSA 4096-bit Performancegnupg: 1GB File Encryptionext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocachebtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocache11.151158.3718952.366489.8687.4214.0513.7321.0419.9611.5460.7874.76138.17115.9512281.33880.33201.6120.9914.368041897152733246000344353.3815.8411.151113.4619361.456460.1787.9913.0780.7079.3138.1110.3260.8571.39134.35113.0212148.53864.26201.2420.9514.628076899151893248667344753.4315.9310.712031.7341663.406360.6252.7414.9570.1472.3250.8011.2366.27113.82200.49169.6812471.13854.89200.9920.8314.318076897152553243000344753.3515.9110.892024.5041661.736531.7361.2218.70162.69165.9577.1010.8366.09111.21188.43164.9212136.65840.08201.3021.4414.528085899152833251333343753.3815.9010.67309051.706464.8755.9814.62132.76107.1448.149.9179.86121.95117.6033.7811944.801204.92201.8321.7414.338045898152783249667344053.4015.9710.7630551.706481.5151.9816.7346.5450.4629.379.6985.53124.9495.5529.4812309.251485.46201.4720.7014.538032898152323250667343353.4015.87OpenBenchmarking.org

Unpacking The Linux Kernel

linux-2.6.32.tar.bz2

OpenBenchmarking.orgSeconds, Fewer Is BetterUnpacking The Linux Kernellinux-2.6.32.tar.bz2btrfs-cow-barrier-cacheext4-barrier-cachebtrfs-nocow-nobarrier-nocacheext4-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocache3691215SE +/- 0.13, N = 8SE +/- 0.09, N = 4SE +/- 0.10, N = 4SE +/- 0.14, N = 4SE +/- 0.42, N = 8SE +/- 0.19, N = 410.6710.7110.7610.8911.1511.15

AIO-Stress

Random Write

OpenBenchmarking.orgMB/s, More Is BetterAIO-Stress 0.21Random Writeext4-barrier-cacheext4-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocache400800120016002000SE +/- 20.87, N = 3SE +/- 11.53, N = 3SE +/- 24.13, N = 6SE +/- 21.98, N = 32031.732024.501158.371113.46

PostMark

Disk Transaction Performance

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction Performanceext4-nobarrier-nocacheext4-barrier-cachebtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-nobarrier-nocacheext3-barrier-cache9001800270036004500SE +/- 0.00, N = 5SE +/- 0.00, N = 5SE +/- 34.80, N = 10SE +/- 46.40, N = 10SE +/- 141.32, N = 10SE +/- 27.60, N = 5416641663090305519361895

Threaded I/O Tester

64MB Random Write - 32 Threads

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 0.3.364MB Random Write - 32 Threadsbtrfs-cow-barrier-cacheext4-barrier-cacheext3-barrier-cacheext4-nobarrier-nocachebtrfs-nocow-nobarrier-nocacheext3-nobarrier-nocache1224364860SE +/- 1.14, N = 8SE +/- 0.01, N = 4SE +/- 0.01, N = 4SE +/- 0.01, N = 4SE +/- 0.01, N = 4SE +/- 0.03, N = 851.703.402.361.731.701.45

Threaded I/O Tester

64MB Random Read - 32 Threads

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 0.3.364MB Random Read - 32 Threadsext4-nobarrier-nocacheext3-barrier-cachebtrfs-nocow-nobarrier-nocachebtrfs-cow-barrier-cacheext3-nobarrier-nocacheext4-barrier-cache14002800420056007000SE +/- 10.55, N = 4SE +/- 66.48, N = 4SE +/- 9.30, N = 4SE +/- 29.65, N = 4SE +/- 75.75, N = 4SE +/- 90.95, N = 46531.736489.866481.516464.876460.176360.62

Flexible IO Tester

Intel IOMeter File Server Access Pattern

OpenBenchmarking.orgSeconds (Run Time), Fewer Is BetterFlexible IO Tester 1.21Intel IOMeter File Server Access Patternbtrfs-nocow-nobarrier-nocacheext4-barrier-cachebtrfs-cow-barrier-cacheext4-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocache20406080100SE +/- 0.72, N = 6SE +/- 0.95, N = 3SE +/- 0.50, N = 3SE +/- 0.07, N = 3SE +/- 1.82, N = 6SE +/- 1.35, N = 351.9852.7455.9861.2287.4287.99

FS-Mark

1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.31000 Files, 1MB Sizeext4-nobarrier-nocachebtrfs-nocow-nobarrier-nocacheext4-barrier-cachebtrfs-cow-barrier-cacheext3-barrier-cacheext3-nobarrier-nocache510152025SE +/- 0.17, N = 3SE +/- 0.03, N = 3SE +/- 0.21, N = 6SE +/- 0.21, N = 5SE +/- 0.57, N = 6SE +/- 0.44, N = 618.7016.7314.9514.6214.0513.07

Dbench

128 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0128 Clientsext4-nobarrier-nocachebtrfs-cow-barrier-cacheext3-nobarrier-nocacheext4-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cache4080120160200SE +/- 1.83, N = 3SE +/- 4.84, N = 6SE +/- 3.75, N = 3SE +/- 1.05, N = 3SE +/- 0.54, N = 3SE +/- 0.67, N = 6162.69132.7680.7070.1446.5413.73

Dbench

48 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.048 Clientsext4-nobarrier-nocachebtrfs-cow-barrier-cacheext3-nobarrier-nocacheext4-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cache4080120160200SE +/- 1.96, N = 3SE +/- 0.18, N = 3SE +/- 0.77, N = 3SE +/- 0.51, N = 3SE +/- 0.74, N = 3SE +/- 0.14, N = 3165.95107.1479.3172.3250.4621.04

Dbench

12 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.012 Clientsext4-nobarrier-nocacheext4-barrier-cachebtrfs-cow-barrier-cacheext3-nobarrier-nocachebtrfs-nocow-nobarrier-nocacheext3-barrier-cache20406080100SE +/- 0.67, N = 3SE +/- 0.28, N = 3SE +/- 1.21, N = 6SE +/- 3.42, N = 6SE +/- 0.31, N = 3SE +/- 0.08, N = 377.1050.8048.1438.1129.3719.96

Dbench

1 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.01 Clientsext3-barrier-cacheext4-barrier-cacheext4-nobarrier-nocacheext3-nobarrier-nocachebtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocache3691215SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.16, N = 611.5411.2310.8310.329.919.69

IOzone

8GB Read Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.3478GB Read Performancebtrfs-nocow-nobarrier-nocachebtrfs-cow-barrier-cacheext4-barrier-cacheext4-nobarrier-nocacheext3-nobarrier-nocacheext3-barrier-cache20406080100SE +/- 0.16, N = 3SE +/- 0.15, N = 3SE +/- 3.63, N = 6SE +/- 3.79, N = 6SE +/- 0.01, N = 3SE +/- 0.26, N = 385.5379.8666.2766.0960.8560.78

IOzone

8GB Write Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.3478GB Write Performancebtrfs-nocow-nobarrier-nocachebtrfs-cow-barrier-cacheext4-barrier-cacheext4-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocache306090120150SE +/- 0.24, N = 3SE +/- 2.42, N = 3SE +/- 2.80, N = 6SE +/- 2.45, N = 6SE +/- 0.45, N = 3SE +/- 0.94, N = 3124.94121.95113.82111.2174.7671.39

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial Createext4-barrier-cacheext4-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocachebtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocache4080120160200SE +/- 5.58, N = 6SE +/- 4.64, N = 6SE +/- 11.37, N = 6SE +/- 3.85, N = 6SE +/- 3.04, N = 6SE +/- 1.85, N = 6200.49188.43138.17134.35117.6095.55

PostgreSQL pgbench

TPC-B Transactions Per Second

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 9.0.4TPC-B Transactions Per Secondext4-barrier-cacheext4-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocachebtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocache4080120160200SE +/- 0.43, N = 3SE +/- 1.18, N = 3SE +/- 0.51, N = 3SE +/- 2.73, N = 6SE +/- 0.39, N = 3SE +/- 0.16, N = 3169.68164.92115.95113.0233.7829.48

Apache Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.2.17Static Web Page Servingext4-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-nobarrier-nocachebtrfs-cow-barrier-cache3K6K9K12K15KSE +/- 118.49, N = 3SE +/- 173.40, N = 3SE +/- 169.63, N = 5SE +/- 241.02, N = 3SE +/- 176.78, N = 6SE +/- 57.40, N = 312471.1312309.2512281.3312148.5312136.6511944.80

SQLite

12,500 INSERTs

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.7.312,500 INSERTsext4-nobarrier-nocacheext4-barrier-cacheext3-nobarrier-nocacheext3-barrier-cachebtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocache30060090012001500SE +/- 4.84, N = 3SE +/- 2.53, N = 3SE +/- 11.99, N = 5SE +/- 13.25, N = 3SE +/- 15.76, N = 3SE +/- 18.75, N = 3840.08854.89864.26880.331204.921485.46

LZMA Compression

256MB File Compression

OpenBenchmarking.orgSeconds, Fewer Is BetterLZMA Compression256MB File Compressionext4-barrier-cacheext3-nobarrier-nocacheext4-nobarrier-nocachebtrfs-nocow-nobarrier-nocacheext3-barrier-cachebtrfs-cow-barrier-cache4080120160200SE +/- 0.40, N = 3SE +/- 0.04, N = 3SE +/- 0.23, N = 3SE +/- 0.21, N = 3SE +/- 0.34, N = 3SE +/- 0.66, N = 3200.99201.24201.30201.47201.61201.83

Parallel BZIP2 Compression

256MB File Compression

OpenBenchmarking.orgSeconds, Fewer Is BetterParallel BZIP2 Compression 1.0.5256MB File Compressionbtrfs-nocow-nobarrier-nocacheext4-barrier-cacheext3-nobarrier-nocacheext3-barrier-cacheext4-nobarrier-nocachebtrfs-cow-barrier-cache510152025SE +/- 0.40, N = 6SE +/- 0.10, N = 3SE +/- 0.35, N = 4SE +/- 0.29, N = 5SE +/- 0.22, N = 3SE +/- 0.10, N = 320.7020.8320.9520.9921.4421.74

Gzip Compression

2GB File Compression

OpenBenchmarking.orgSeconds, Fewer Is BetterGzip Compression2GB File Compressionext4-barrier-cachebtrfs-cow-barrier-cacheext3-barrier-cacheext4-nobarrier-nocachebtrfs-nocow-nobarrier-nocacheext3-nobarrier-nocache48121620SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.26, N = 3SE +/- 0.24, N = 3SE +/- 0.20, N = 314.3114.3314.3614.5214.5314.62

7-Zip Compression

Compress Speed Test

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 9.13Compress Speed Testext4-nobarrier-nocacheext4-barrier-cacheext3-nobarrier-nocachebtrfs-cow-barrier-cacheext3-barrier-cachebtrfs-nocow-nobarrier-nocache2K4K6K8K10KSE +/- 9.82, N = 3SE +/- 17.04, N = 3SE +/- 5.84, N = 3SE +/- 13.32, N = 3SE +/- 3.48, N = 3SE +/- 8.69, N = 3808580768076804580418032

John The Ripper

Test: Blowfish

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.3.1Test: Blowfishext4-nobarrier-nocacheext3-nobarrier-nocachebtrfs-nocow-nobarrier-nocachebtrfs-cow-barrier-cacheext4-barrier-cacheext3-barrier-cache2004006008001000SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 1.00, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 1.20, N = 3899899898898897897

John The Ripper

Test: MD5

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.3.1Test: MD5ext4-nobarrier-nocachebtrfs-cow-barrier-cacheext3-barrier-cacheext4-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-nobarrier-nocache3K6K9K12K15KSE +/- 6.08, N = 3SE +/- 8.69, N = 3SE +/- 10.48, N = 3SE +/- 6.89, N = 3SE +/- 60.84, N = 3SE +/- 41.80, N = 3152831527815273152551523215189

John The Ripper

Test: Traditional DES

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.3.1Test: Traditional DESext4-nobarrier-nocachebtrfs-nocow-nobarrier-nocachebtrfs-cow-barrier-cacheext3-nobarrier-nocacheext3-barrier-cacheext4-barrier-cache700K1400K2100K2800K3500KSE +/- 881.92, N = 3SE +/- 1452.97, N = 3SE +/- 2333.33, N = 3SE +/- 1763.83, N = 3SE +/- 8185.35, N = 3SE +/- 1154.70, N = 3325133332506673249667324866732460003243000

Gcrypt Library

CAMELLIA256-ECB Cipher

OpenBenchmarking.orgMicroseconds, Fewer Is BetterGcrypt Library 1.4.4CAMELLIA256-ECB Cipherbtrfs-nocow-nobarrier-nocacheext4-nobarrier-nocachebtrfs-cow-barrier-cacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cache7001400210028003500SE +/- 3.33, N = 3SE +/- 3.33, N = 3SE +/- 0.00, N = 3SE +/- 3.33, N = 3SE +/- 3.33, N = 3SE +/- 6.67, N = 3343334373440344334473447

OpenSSL

RSA 4096-bit Performance

OpenBenchmarking.orgSigns Per Second, More Is BetterOpenSSL 1.0.0aRSA 4096-bit Performanceext3-nobarrier-nocachebtrfs-nocow-nobarrier-nocachebtrfs-cow-barrier-cacheext4-nobarrier-nocacheext3-barrier-cacheext4-barrier-cache1224364860SE +/- 0.05, N = 4SE +/- 0.00, N = 4SE +/- 0.07, N = 4SE +/- 0.03, N = 4SE +/- 0.06, N = 4SE +/- 0.03, N = 453.4353.4053.4053.3853.3853.35

GnuPG

1GB File Encryption

OpenBenchmarking.orgSeconds, Fewer Is BetterGnuPG 1.4.101GB File Encryptionext3-barrier-cachebtrfs-nocow-nobarrier-nocacheext4-nobarrier-nocacheext4-barrier-cacheext3-nobarrier-nocachebtrfs-cow-barrier-cache48121620SE +/- 0.01, N = 4SE +/- 0.02, N = 4SE +/- 0.06, N = 4SE +/- 0.04, N = 4SE +/- 0.09, N = 4SE +/- 0.08, N = 415.8415.8715.9015.9115.9315.97


Phoronix Test Suite v10.8.4