Filesystem SATA NCQ Benchmarking disk write cache on a SATA2 NCQ capable configuration. I added a few generic CPU tests as a reference for the system performance. The tests are going to try different file systems with or without write barrier and w/ or w/out disk write cache. The default CFQ scheduler is being used.
HTML result view exported from: https://openbenchmarking.org/result/1105175-GR-FILESYSTE14&grw&sro .
Filesystem SATA NCQ Processor Motherboard Chipset Memory Disk Graphics OS Kernel Desktop Display Server Display Driver OpenGL Compiler File-System Screen Resolution ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache Intel Core i5 650 @ 3.19GHz (4 Cores) LENOVO 5852CB6 Intel Core 7680MB 320GB Western Digital WDC WD3200AAKX-0 Intel Core IGP 256MB SUSE LINUX 11 2.6.32.12-0.7-default (x86_64) GNOME 2.28.2 X Server 1.6.5 intel 2.10.0 1.4 (2.1 Mesa 7.7) GCC 4.3 ext3 1680x1050 ext2/ext3 Btrfs OpenBenchmarking.org System Details - Disk Scheduler: CFQ. Python 2.6. Intel SpeedStep was enabled.
Filesystem SATA NCQ compress-lzma: 256MB File Compression aio-stress: Rand Write compilebench: Initial Create gcrypt: CAMELLIA256-ECB Cipher dbench: 1 Clients dbench: 12 Clients dbench: 48 Clients dbench: 128 Clients fio: Intel IOMeter File Server Access Pattern fs-mark: 1000 Files, 1MB Size iozone: 8GB Write Performance iozone: 8GB Read Performance postmark: Disk Transaction Performance tiobench: 64MB Rand Read - 32 Threads tiobench: 64MB Rand Write - 32 Threads compress-7zip: Compress Speed Test john-the-ripper: Traditional DES john-the-ripper: MD5 john-the-ripper: Blowfish compress-pbzip2: 256MB File Compression apache: Static Web Page Serving openssl: RSA 4096-bit Performance sqlite: 12,500 INSERTs pgbench: TPC-B Transactions Per Second compress-gzip: 2GB File Compression unpack-linux: linux-2.6.32.tar.bz2 gnupg: 1GB File Encryption ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache 201.61 1158.37 138.17 3443 11.54 19.96 21.04 13.73 87.42 14.05 74.76 60.78 1895 6489.86 2.36 8041 3246000 15273 897 20.99 12281.33 53.38 880.33 115.95 14.36 11.15 15.84 201.24 1113.46 134.35 3447 10.32 38.11 79.31 80.70 87.99 13.07 71.39 60.85 1936 6460.17 1.45 8076 3248667 15189 899 20.95 12148.53 53.43 864.26 113.02 14.62 11.15 15.93 200.99 2031.73 200.49 3447 11.23 50.80 72.32 70.14 52.74 14.95 113.82 66.27 4166 6360.62 3.40 8076 3243000 15255 897 20.83 12471.13 53.35 854.89 169.68 14.31 10.71 15.91 201.30 2024.50 188.43 3437 10.83 77.10 165.95 162.69 61.22 18.70 111.21 66.09 4166 6531.73 1.73 8085 3251333 15283 899 21.44 12136.65 53.38 840.08 164.92 14.52 10.89 15.90 201.83 117.60 3440 9.91 48.14 107.14 132.76 55.98 14.62 121.95 79.86 3090 6464.87 51.70 8045 3249667 15278 898 21.74 11944.80 53.40 1204.92 33.78 14.33 10.67 15.97 201.47 95.55 3433 9.69 29.37 50.46 46.54 51.98 16.73 124.94 85.53 3055 6481.51 1.70 8032 3250667 15232 898 20.70 12309.25 53.40 1485.46 29.48 14.53 10.76 15.87 OpenBenchmarking.org
LZMA Compression 256MB File Compression OpenBenchmarking.org Seconds, Fewer Is Better LZMA Compression 256MB File Compression btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 40 80 120 160 200 SE +/- 0.66, N = 3 SE +/- 0.21, N = 3 SE +/- 0.34, N = 3 SE +/- 0.04, N = 3 SE +/- 0.40, N = 3 SE +/- 0.23, N = 3 201.83 201.47 201.61 201.24 200.99 201.30
AIO-Stress Random Write OpenBenchmarking.org MB/s, More Is Better AIO-Stress 0.21 Random Write ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 400 800 1200 1600 2000 SE +/- 24.13, N = 6 SE +/- 21.98, N = 3 SE +/- 20.87, N = 3 SE +/- 11.53, N = 3 1158.37 1113.46 2031.73 2024.50
Compile Bench Test: Initial Create OpenBenchmarking.org MB/s, More Is Better Compile Bench 0.6 Test: Initial Create btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 40 80 120 160 200 SE +/- 3.04, N = 6 SE +/- 1.85, N = 6 SE +/- 11.37, N = 6 SE +/- 3.85, N = 6 SE +/- 5.58, N = 6 SE +/- 4.64, N = 6 117.60 95.55 138.17 134.35 200.49 188.43
Gcrypt Library CAMELLIA256-ECB Cipher OpenBenchmarking.org Microseconds, Fewer Is Better Gcrypt Library 1.4.4 CAMELLIA256-ECB Cipher btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 700 1400 2100 2800 3500 SE +/- 0.00, N = 3 SE +/- 3.33, N = 3 SE +/- 3.33, N = 3 SE +/- 3.33, N = 3 SE +/- 6.67, N = 3 SE +/- 3.33, N = 3 3440 3433 3443 3447 3447 3437
Dbench 1 Clients OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 1 Clients btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 3 6 9 12 15 SE +/- 0.03, N = 3 SE +/- 0.16, N = 6 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 9.91 9.69 11.54 10.32 11.23 10.83
Dbench 12 Clients OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 12 Clients btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 20 40 60 80 100 SE +/- 1.21, N = 6 SE +/- 0.31, N = 3 SE +/- 0.08, N = 3 SE +/- 3.42, N = 6 SE +/- 0.28, N = 3 SE +/- 0.67, N = 3 48.14 29.37 19.96 38.11 50.80 77.10
Dbench 48 Clients OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 48 Clients btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 40 80 120 160 200 SE +/- 0.18, N = 3 SE +/- 0.74, N = 3 SE +/- 0.14, N = 3 SE +/- 0.77, N = 3 SE +/- 0.51, N = 3 SE +/- 1.96, N = 3 107.14 50.46 21.04 79.31 72.32 165.95
Dbench 128 Clients OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 128 Clients btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 40 80 120 160 200 SE +/- 4.84, N = 6 SE +/- 0.54, N = 3 SE +/- 0.67, N = 6 SE +/- 3.75, N = 3 SE +/- 1.05, N = 3 SE +/- 1.83, N = 3 132.76 46.54 13.73 80.70 70.14 162.69
Flexible IO Tester Intel IOMeter File Server Access Pattern OpenBenchmarking.org Seconds (Run Time), Fewer Is Better Flexible IO Tester 1.21 Intel IOMeter File Server Access Pattern btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 20 40 60 80 100 SE +/- 0.50, N = 3 SE +/- 0.72, N = 6 SE +/- 1.82, N = 6 SE +/- 1.35, N = 3 SE +/- 0.95, N = 3 SE +/- 0.07, N = 3 55.98 51.98 87.42 87.99 52.74 61.22
FS-Mark 1000 Files, 1MB Size OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 1000 Files, 1MB Size btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 5 10 15 20 25 SE +/- 0.21, N = 5 SE +/- 0.03, N = 3 SE +/- 0.57, N = 6 SE +/- 0.44, N = 6 SE +/- 0.21, N = 6 SE +/- 0.17, N = 3 14.62 16.73 14.05 13.07 14.95 18.70
IOzone 8GB Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.347 8GB Write Performance btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 30 60 90 120 150 SE +/- 2.42, N = 3 SE +/- 0.24, N = 3 SE +/- 0.45, N = 3 SE +/- 0.94, N = 3 SE +/- 2.80, N = 6 SE +/- 2.45, N = 6 121.95 124.94 74.76 71.39 113.82 111.21
IOzone 8GB Read Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.347 8GB Read Performance btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 20 40 60 80 100 SE +/- 0.15, N = 3 SE +/- 0.16, N = 3 SE +/- 0.26, N = 3 SE +/- 0.01, N = 3 SE +/- 3.63, N = 6 SE +/- 3.79, N = 6 79.86 85.53 60.78 60.85 66.27 66.09
PostMark Disk Transaction Performance OpenBenchmarking.org TPS, More Is Better PostMark 1.51 Disk Transaction Performance btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 900 1800 2700 3600 4500 SE +/- 34.80, N = 10 SE +/- 46.40, N = 10 SE +/- 27.60, N = 5 SE +/- 141.32, N = 10 SE +/- 0.00, N = 5 SE +/- 0.00, N = 5 3090 3055 1895 1936 4166 4166
Threaded I/O Tester 64MB Random Read - 32 Threads OpenBenchmarking.org MB/s, More Is Better Threaded I/O Tester 0.3.3 64MB Random Read - 32 Threads btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 1400 2800 4200 5600 7000 SE +/- 29.65, N = 4 SE +/- 9.30, N = 4 SE +/- 66.48, N = 4 SE +/- 75.75, N = 4 SE +/- 90.95, N = 4 SE +/- 10.55, N = 4 6464.87 6481.51 6489.86 6460.17 6360.62 6531.73
Threaded I/O Tester 64MB Random Write - 32 Threads OpenBenchmarking.org MB/s, More Is Better Threaded I/O Tester 0.3.3 64MB Random Write - 32 Threads btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 12 24 36 48 60 SE +/- 1.14, N = 8 SE +/- 0.01, N = 4 SE +/- 0.01, N = 4 SE +/- 0.03, N = 8 SE +/- 0.01, N = 4 SE +/- 0.01, N = 4 51.70 1.70 2.36 1.45 3.40 1.73
7-Zip Compression Compress Speed Test OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 9.13 Compress Speed Test btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 2K 4K 6K 8K 10K SE +/- 13.32, N = 3 SE +/- 8.69, N = 3 SE +/- 3.48, N = 3 SE +/- 5.84, N = 3 SE +/- 17.04, N = 3 SE +/- 9.82, N = 3 8045 8032 8041 8076 8076 8085
John The Ripper Test: Traditional DES OpenBenchmarking.org Real C/S, More Is Better John The Ripper 1.7.3.1 Test: Traditional DES btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 700K 1400K 2100K 2800K 3500K SE +/- 2333.33, N = 3 SE +/- 1452.97, N = 3 SE +/- 8185.35, N = 3 SE +/- 1763.83, N = 3 SE +/- 1154.70, N = 3 SE +/- 881.92, N = 3 3249667 3250667 3246000 3248667 3243000 3251333
John The Ripper Test: MD5 OpenBenchmarking.org Real C/S, More Is Better John The Ripper 1.7.3.1 Test: MD5 btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 3K 6K 9K 12K 15K SE +/- 8.69, N = 3 SE +/- 60.84, N = 3 SE +/- 10.48, N = 3 SE +/- 41.80, N = 3 SE +/- 6.89, N = 3 SE +/- 6.08, N = 3 15278 15232 15273 15189 15255 15283
John The Ripper Test: Blowfish OpenBenchmarking.org Real C/S, More Is Better John The Ripper 1.7.3.1 Test: Blowfish btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 200 400 600 800 1000 SE +/- 0.33, N = 3 SE +/- 1.00, N = 3 SE +/- 1.20, N = 3 SE +/- 0.33, N = 3 SE +/- 0.67, N = 3 SE +/- 0.33, N = 3 898 898 897 899 897 899
Parallel BZIP2 Compression 256MB File Compression OpenBenchmarking.org Seconds, Fewer Is Better Parallel BZIP2 Compression 1.0.5 256MB File Compression btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 5 10 15 20 25 SE +/- 0.10, N = 3 SE +/- 0.40, N = 6 SE +/- 0.29, N = 5 SE +/- 0.35, N = 4 SE +/- 0.10, N = 3 SE +/- 0.22, N = 3 21.74 20.70 20.99 20.95 20.83 21.44
Apache Benchmark Static Web Page Serving OpenBenchmarking.org Requests Per Second, More Is Better Apache Benchmark 2.2.17 Static Web Page Serving btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 3K 6K 9K 12K 15K SE +/- 57.40, N = 3 SE +/- 173.40, N = 3 SE +/- 169.63, N = 5 SE +/- 241.02, N = 3 SE +/- 118.49, N = 3 SE +/- 176.78, N = 6 11944.80 12309.25 12281.33 12148.53 12471.13 12136.65
OpenSSL RSA 4096-bit Performance OpenBenchmarking.org Signs Per Second, More Is Better OpenSSL 1.0.0a RSA 4096-bit Performance btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 12 24 36 48 60 SE +/- 0.07, N = 4 SE +/- 0.00, N = 4 SE +/- 0.06, N = 4 SE +/- 0.05, N = 4 SE +/- 0.03, N = 4 SE +/- 0.03, N = 4 53.40 53.40 53.38 53.43 53.35 53.38
SQLite 12,500 INSERTs OpenBenchmarking.org Seconds, Fewer Is Better SQLite 3.7.3 12,500 INSERTs btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 300 600 900 1200 1500 SE +/- 15.76, N = 3 SE +/- 18.75, N = 3 SE +/- 13.25, N = 3 SE +/- 11.99, N = 5 SE +/- 2.53, N = 3 SE +/- 4.84, N = 3 1204.92 1485.46 880.33 864.26 854.89 840.08
PostgreSQL pgbench TPC-B Transactions Per Second OpenBenchmarking.org TPS, More Is Better PostgreSQL pgbench 9.0.4 TPC-B Transactions Per Second btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 40 80 120 160 200 SE +/- 0.39, N = 3 SE +/- 0.16, N = 3 SE +/- 0.51, N = 3 SE +/- 2.73, N = 6 SE +/- 0.43, N = 3 SE +/- 1.18, N = 3 33.78 29.48 115.95 113.02 169.68 164.92
Gzip Compression 2GB File Compression OpenBenchmarking.org Seconds, Fewer Is Better Gzip Compression 2GB File Compression btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 4 8 12 16 20 SE +/- 0.04, N = 3 SE +/- 0.24, N = 3 SE +/- 0.06, N = 3 SE +/- 0.20, N = 3 SE +/- 0.04, N = 3 SE +/- 0.26, N = 3 14.33 14.53 14.36 14.62 14.31 14.52
Unpacking The Linux Kernel linux-2.6.32.tar.bz2 OpenBenchmarking.org Seconds, Fewer Is Better Unpacking The Linux Kernel linux-2.6.32.tar.bz2 btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 3 6 9 12 15 SE +/- 0.13, N = 8 SE +/- 0.10, N = 4 SE +/- 0.42, N = 8 SE +/- 0.19, N = 4 SE +/- 0.09, N = 4 SE +/- 0.14, N = 4 10.67 10.76 11.15 11.15 10.71 10.89
GnuPG 1GB File Encryption OpenBenchmarking.org Seconds, Fewer Is Better GnuPG 1.4.10 1GB File Encryption btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 4 8 12 16 20 SE +/- 0.08, N = 4 SE +/- 0.02, N = 4 SE +/- 0.01, N = 4 SE +/- 0.09, N = 4 SE +/- 0.04, N = 4 SE +/- 0.06, N = 4 15.97 15.87 15.84 15.93 15.91 15.90
Phoronix Test Suite v10.8.4