Filesystem SATA NCQ

Benchmarking disk write cache on a SATA2 NCQ capable configuration. I added a few generic CPU tests as a reference for the system performance. The tests are going to try different file systems with or without write barrier and w/ or w/out disk write cache. The default CFQ scheduler is being used.

HTML result view exported from: https://openbenchmarking.org/result/1105175-GR-FILESYSTE14&sro.

Filesystem SATA NCQProcessorMotherboardChipsetMemoryDiskGraphicsOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen Resolutionext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocachebtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheIntel Core i5 650 @ 3.19GHz (4 Cores)LENOVO 5852CB6Intel Core7680MB320GB Western Digital WDC WD3200AAKX-0Intel Core IGP 256MBSUSE LINUX 112.6.32.12-0.7-default (x86_64)GNOME 2.28.2X Server 1.6.5intel 2.10.01.4 (2.1 Mesa 7.7)GCC 4.3ext31680x1050ext2/ext3BtrfsOpenBenchmarking.orgSystem Details- Disk Scheduler: CFQ. Python 2.6. Intel SpeedStep was enabled.

Filesystem SATA NCQgnupg: 1GB File Encryptionopenssl: RSA 4096-bit Performancegcrypt: CAMELLIA256-ECB Cipherjohn-the-ripper: Traditional DESjohn-the-ripper: MD5john-the-ripper: Blowfishcompress-7zip: Compress Speed Testcompress-gzip: 2GB File Compressioncompress-pbzip2: 256MB File Compressioncompress-lzma: 256MB File Compressionsqlite: 12,500 INSERTsapache: Static Web Page Servingpgbench: TPC-B Transactions Per Secondcompilebench: Initial Createiozone: 8GB Write Performanceiozone: 8GB Read Performancedbench: 1 Clientsdbench: 12 Clientsdbench: 48 Clientsdbench: 128 Clientsfs-mark: 1000 Files, 1MB Sizefio: Intel IOMeter File Server Access Patterntiobench: 64MB Rand Read - 32 Threadstiobench: 64MB Rand Write - 32 Threadspostmark: Disk Transaction Performanceaio-stress: Rand Writeunpack-linux: linux-2.6.32.tar.bz2ext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocachebtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocache15.8453.383443324600015273897804114.3620.99201.61880.3312281.33115.95138.1774.7660.7811.5419.9621.0413.7314.0587.426489.862.3618951158.3711.1515.9353.433447324866715189899807614.6220.95201.24864.2612148.53113.02134.3571.3960.8510.3238.1179.3180.7013.0787.996460.171.4519361113.4611.1515.9153.353447324300015255897807614.3120.83200.99854.8912471.13169.68200.49113.8266.2711.2350.8072.3270.1414.9552.746360.623.4041662031.7310.7115.9053.383437325133315283899808514.5221.44201.30840.0812136.65164.92188.43111.2166.0910.8377.10165.95162.6918.7061.226531.731.7341662024.5010.8915.9753.403440324966715278898804514.3321.74201.831204.9211944.8033.78117.60121.9579.869.9148.14107.14132.7614.6255.986464.8751.70309010.6715.8753.403433325066715232898803214.5320.70201.471485.4612309.2529.4895.55124.9485.539.6929.3750.4646.5416.7351.986481.511.70305510.76OpenBenchmarking.org

GnuPG

1GB File Encryption

OpenBenchmarking.orgSeconds, Fewer Is BetterGnuPG 1.4.101GB File Encryptionbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache48121620SE +/- 0.08, N = 4SE +/- 0.02, N = 4SE +/- 0.01, N = 4SE +/- 0.09, N = 4SE +/- 0.04, N = 4SE +/- 0.06, N = 415.9715.8715.8415.9315.9115.90

OpenSSL

RSA 4096-bit Performance

OpenBenchmarking.orgSigns Per Second, More Is BetterOpenSSL 1.0.0aRSA 4096-bit Performancebtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache1224364860SE +/- 0.07, N = 4SE +/- 0.00, N = 4SE +/- 0.06, N = 4SE +/- 0.05, N = 4SE +/- 0.03, N = 4SE +/- 0.03, N = 453.4053.4053.3853.4353.3553.38

Gcrypt Library

CAMELLIA256-ECB Cipher

OpenBenchmarking.orgMicroseconds, Fewer Is BetterGcrypt Library 1.4.4CAMELLIA256-ECB Cipherbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache7001400210028003500SE +/- 0.00, N = 3SE +/- 3.33, N = 3SE +/- 3.33, N = 3SE +/- 3.33, N = 3SE +/- 6.67, N = 3SE +/- 3.33, N = 3344034333443344734473437

John The Ripper

Test: Traditional DES

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.3.1Test: Traditional DESbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache700K1400K2100K2800K3500KSE +/- 2333.33, N = 3SE +/- 1452.97, N = 3SE +/- 8185.35, N = 3SE +/- 1763.83, N = 3SE +/- 1154.70, N = 3SE +/- 881.92, N = 3324966732506673246000324866732430003251333

John The Ripper

Test: MD5

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.3.1Test: MD5btrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache3K6K9K12K15KSE +/- 8.69, N = 3SE +/- 60.84, N = 3SE +/- 10.48, N = 3SE +/- 41.80, N = 3SE +/- 6.89, N = 3SE +/- 6.08, N = 3152781523215273151891525515283

John The Ripper

Test: Blowfish

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.7.3.1Test: Blowfishbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache2004006008001000SE +/- 0.33, N = 3SE +/- 1.00, N = 3SE +/- 1.20, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3898898897899897899

7-Zip Compression

Compress Speed Test

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 9.13Compress Speed Testbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache2K4K6K8K10KSE +/- 13.32, N = 3SE +/- 8.69, N = 3SE +/- 3.48, N = 3SE +/- 5.84, N = 3SE +/- 17.04, N = 3SE +/- 9.82, N = 3804580328041807680768085

Gzip Compression

2GB File Compression

OpenBenchmarking.orgSeconds, Fewer Is BetterGzip Compression2GB File Compressionbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache48121620SE +/- 0.04, N = 3SE +/- 0.24, N = 3SE +/- 0.06, N = 3SE +/- 0.20, N = 3SE +/- 0.04, N = 3SE +/- 0.26, N = 314.3314.5314.3614.6214.3114.52

Parallel BZIP2 Compression

256MB File Compression

OpenBenchmarking.orgSeconds, Fewer Is BetterParallel BZIP2 Compression 1.0.5256MB File Compressionbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache510152025SE +/- 0.10, N = 3SE +/- 0.40, N = 6SE +/- 0.29, N = 5SE +/- 0.35, N = 4SE +/- 0.10, N = 3SE +/- 0.22, N = 321.7420.7020.9920.9520.8321.44

LZMA Compression

256MB File Compression

OpenBenchmarking.orgSeconds, Fewer Is BetterLZMA Compression256MB File Compressionbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache4080120160200SE +/- 0.66, N = 3SE +/- 0.21, N = 3SE +/- 0.34, N = 3SE +/- 0.04, N = 3SE +/- 0.40, N = 3SE +/- 0.23, N = 3201.83201.47201.61201.24200.99201.30

SQLite

12,500 INSERTs

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.7.312,500 INSERTsbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache30060090012001500SE +/- 15.76, N = 3SE +/- 18.75, N = 3SE +/- 13.25, N = 3SE +/- 11.99, N = 5SE +/- 2.53, N = 3SE +/- 4.84, N = 31204.921485.46880.33864.26854.89840.08

Apache Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.2.17Static Web Page Servingbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache3K6K9K12K15KSE +/- 57.40, N = 3SE +/- 173.40, N = 3SE +/- 169.63, N = 5SE +/- 241.02, N = 3SE +/- 118.49, N = 3SE +/- 176.78, N = 611944.8012309.2512281.3312148.5312471.1312136.65

PostgreSQL pgbench

TPC-B Transactions Per Second

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 9.0.4TPC-B Transactions Per Secondbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache4080120160200SE +/- 0.39, N = 3SE +/- 0.16, N = 3SE +/- 0.51, N = 3SE +/- 2.73, N = 6SE +/- 0.43, N = 3SE +/- 1.18, N = 333.7829.48115.95113.02169.68164.92

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial Createbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache4080120160200SE +/- 3.04, N = 6SE +/- 1.85, N = 6SE +/- 11.37, N = 6SE +/- 3.85, N = 6SE +/- 5.58, N = 6SE +/- 4.64, N = 6117.6095.55138.17134.35200.49188.43

IOzone

8GB Write Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.3478GB Write Performancebtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache306090120150SE +/- 2.42, N = 3SE +/- 0.24, N = 3SE +/- 0.45, N = 3SE +/- 0.94, N = 3SE +/- 2.80, N = 6SE +/- 2.45, N = 6121.95124.9474.7671.39113.82111.21

IOzone

8GB Read Performance

OpenBenchmarking.orgMB/s, More Is BetterIOzone 3.3478GB Read Performancebtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache20406080100SE +/- 0.15, N = 3SE +/- 0.16, N = 3SE +/- 0.26, N = 3SE +/- 0.01, N = 3SE +/- 3.63, N = 6SE +/- 3.79, N = 679.8685.5360.7860.8566.2766.09

Dbench

1 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.01 Clientsbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache3691215SE +/- 0.03, N = 3SE +/- 0.16, N = 6SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 39.919.6911.5410.3211.2310.83

Dbench

12 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.012 Clientsbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache20406080100SE +/- 1.21, N = 6SE +/- 0.31, N = 3SE +/- 0.08, N = 3SE +/- 3.42, N = 6SE +/- 0.28, N = 3SE +/- 0.67, N = 348.1429.3719.9638.1150.8077.10

Dbench

48 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.048 Clientsbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache4080120160200SE +/- 0.18, N = 3SE +/- 0.74, N = 3SE +/- 0.14, N = 3SE +/- 0.77, N = 3SE +/- 0.51, N = 3SE +/- 1.96, N = 3107.1450.4621.0479.3172.32165.95

Dbench

128 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0128 Clientsbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache4080120160200SE +/- 4.84, N = 6SE +/- 0.54, N = 3SE +/- 0.67, N = 6SE +/- 3.75, N = 3SE +/- 1.05, N = 3SE +/- 1.83, N = 3132.7646.5413.7380.7070.14162.69

FS-Mark

1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.31000 Files, 1MB Sizebtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache510152025SE +/- 0.21, N = 5SE +/- 0.03, N = 3SE +/- 0.57, N = 6SE +/- 0.44, N = 6SE +/- 0.21, N = 6SE +/- 0.17, N = 314.6216.7314.0513.0714.9518.70

Flexible IO Tester

Intel IOMeter File Server Access Pattern

OpenBenchmarking.orgSeconds (Run Time), Fewer Is BetterFlexible IO Tester 1.21Intel IOMeter File Server Access Patternbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache20406080100SE +/- 0.50, N = 3SE +/- 0.72, N = 6SE +/- 1.82, N = 6SE +/- 1.35, N = 3SE +/- 0.95, N = 3SE +/- 0.07, N = 355.9851.9887.4287.9952.7461.22

Threaded I/O Tester

64MB Random Read - 32 Threads

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 0.3.364MB Random Read - 32 Threadsbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache14002800420056007000SE +/- 29.65, N = 4SE +/- 9.30, N = 4SE +/- 66.48, N = 4SE +/- 75.75, N = 4SE +/- 90.95, N = 4SE +/- 10.55, N = 46464.876481.516489.866460.176360.626531.73

Threaded I/O Tester

64MB Random Write - 32 Threads

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 0.3.364MB Random Write - 32 Threadsbtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache1224364860SE +/- 1.14, N = 8SE +/- 0.01, N = 4SE +/- 0.01, N = 4SE +/- 0.03, N = 8SE +/- 0.01, N = 4SE +/- 0.01, N = 451.701.702.361.453.401.73

PostMark

Disk Transaction Performance

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction Performancebtrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache9001800270036004500SE +/- 34.80, N = 10SE +/- 46.40, N = 10SE +/- 27.60, N = 5SE +/- 141.32, N = 10SE +/- 0.00, N = 5SE +/- 0.00, N = 5309030551895193641664166

AIO-Stress

Random Write

OpenBenchmarking.orgMB/s, More Is BetterAIO-Stress 0.21Random Writeext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache400800120016002000SE +/- 24.13, N = 6SE +/- 21.98, N = 3SE +/- 20.87, N = 3SE +/- 11.53, N = 31158.371113.462031.732024.50

Unpacking The Linux Kernel

linux-2.6.32.tar.bz2

OpenBenchmarking.orgSeconds, Fewer Is BetterUnpacking The Linux Kernellinux-2.6.32.tar.bz2btrfs-cow-barrier-cachebtrfs-nocow-nobarrier-nocacheext3-barrier-cacheext3-nobarrier-nocacheext4-barrier-cacheext4-nobarrier-nocache3691215SE +/- 0.13, N = 8SE +/- 0.10, N = 4SE +/- 0.42, N = 8SE +/- 0.19, N = 4SE +/- 0.09, N = 4SE +/- 0.14, N = 410.6710.7611.1511.1510.7110.89


Phoronix Test Suite v10.8.4