Filesystem SATA NCQ Benchmarking disk write cache on a SATA2 NCQ capable configuration. I added a few generic CPU tests as a reference for the system performance. The tests are going to try different file systems with or without write barrier and w/ or w/out disk write cache. The default CFQ scheduler is being used.
HTML result view exported from: https://openbenchmarking.org/result/1105175-GR-FILESYSTE14&gru&sro .
Filesystem SATA NCQ Processor Motherboard Chipset Memory Disk Graphics OS Kernel Desktop Display Server Display Driver OpenGL Compiler File-System Screen Resolution ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache Intel Core i5 650 @ 3.19GHz (4 Cores) LENOVO 5852CB6 Intel Core 7680MB 320GB Western Digital WDC WD3200AAKX-0 Intel Core IGP 256MB SUSE LINUX 11 2.6.32.12-0.7-default (x86_64) GNOME 2.28.2 X Server 1.6.5 intel 2.10.0 1.4 (2.1 Mesa 7.7) GCC 4.3 ext3 1680x1050 ext2/ext3 Btrfs OpenBenchmarking.org System Details - Disk Scheduler: CFQ. Python 2.6. Intel SpeedStep was enabled.
Filesystem SATA NCQ fs-mark: 1000 Files, 1MB Size compilebench: Initial Create iozone: 8GB Write Performance iozone: 8GB Read Performance dbench: 1 Clients dbench: 12 Clients dbench: 48 Clients dbench: 128 Clients tiobench: 64MB Rand Read - 32 Threads tiobench: 64MB Rand Write - 32 Threads aio-stress: Rand Write compress-7zip: Compress Speed Test john-the-ripper: Traditional DES john-the-ripper: MD5 john-the-ripper: Blowfish apache: Static Web Page Serving openssl: RSA 4096-bit Performance pgbench: TPC-B Transactions Per Second postmark: Disk Transaction Performance gcrypt: CAMELLIA256-ECB Cipher fio: Intel IOMeter File Server Access Pattern gnupg: 1GB File Encryption compress-gzip: 2GB File Compression compress-pbzip2: 256MB File Compression compress-lzma: 256MB File Compression sqlite: 12,500 INSERTs unpack-linux: linux-2.6.32.tar.bz2 ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache 14.05 138.17 74.76 60.78 11.54 19.96 21.04 13.73 6489.86 2.36 1158.37 8041 3246000 15273 897 12281.33 53.38 115.95 1895 3443 87.42 15.84 14.36 20.99 201.61 880.33 11.15 13.07 134.35 71.39 60.85 10.32 38.11 79.31 80.70 6460.17 1.45 1113.46 8076 3248667 15189 899 12148.53 53.43 113.02 1936 3447 87.99 15.93 14.62 20.95 201.24 864.26 11.15 14.95 200.49 113.82 66.27 11.23 50.80 72.32 70.14 6360.62 3.40 2031.73 8076 3243000 15255 897 12471.13 53.35 169.68 4166 3447 52.74 15.91 14.31 20.83 200.99 854.89 10.71 18.70 188.43 111.21 66.09 10.83 77.10 165.95 162.69 6531.73 1.73 2024.50 8085 3251333 15283 899 12136.65 53.38 164.92 4166 3437 61.22 15.90 14.52 21.44 201.30 840.08 10.89 14.62 117.60 121.95 79.86 9.91 48.14 107.14 132.76 6464.87 51.70 8045 3249667 15278 898 11944.80 53.40 33.78 3090 3440 55.98 15.97 14.33 21.74 201.83 1204.92 10.67 16.73 95.55 124.94 85.53 9.69 29.37 50.46 46.54 6481.51 1.70 8032 3250667 15232 898 12309.25 53.40 29.48 3055 3433 51.98 15.87 14.53 20.70 201.47 1485.46 10.76 OpenBenchmarking.org
FS-Mark 1000 Files, 1MB Size OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 1000 Files, 1MB Size btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 5 10 15 20 25 SE +/- 0.21, N = 5 SE +/- 0.03, N = 3 SE +/- 0.57, N = 6 SE +/- 0.44, N = 6 SE +/- 0.21, N = 6 SE +/- 0.17, N = 3 14.62 16.73 14.05 13.07 14.95 18.70
Compile Bench Test: Initial Create OpenBenchmarking.org MB/s, More Is Better Compile Bench 0.6 Test: Initial Create btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 40 80 120 160 200 SE +/- 3.04, N = 6 SE +/- 1.85, N = 6 SE +/- 11.37, N = 6 SE +/- 3.85, N = 6 SE +/- 5.58, N = 6 SE +/- 4.64, N = 6 117.60 95.55 138.17 134.35 200.49 188.43
IOzone 8GB Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.347 8GB Write Performance btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 30 60 90 120 150 SE +/- 2.42, N = 3 SE +/- 0.24, N = 3 SE +/- 0.45, N = 3 SE +/- 0.94, N = 3 SE +/- 2.80, N = 6 SE +/- 2.45, N = 6 121.95 124.94 74.76 71.39 113.82 111.21
IOzone 8GB Read Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.347 8GB Read Performance btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 20 40 60 80 100 SE +/- 0.15, N = 3 SE +/- 0.16, N = 3 SE +/- 0.26, N = 3 SE +/- 0.01, N = 3 SE +/- 3.63, N = 6 SE +/- 3.79, N = 6 79.86 85.53 60.78 60.85 66.27 66.09
Dbench 1 Clients OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 1 Clients btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 3 6 9 12 15 SE +/- 0.03, N = 3 SE +/- 0.16, N = 6 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 9.91 9.69 11.54 10.32 11.23 10.83
Dbench 12 Clients OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 12 Clients btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 20 40 60 80 100 SE +/- 1.21, N = 6 SE +/- 0.31, N = 3 SE +/- 0.08, N = 3 SE +/- 3.42, N = 6 SE +/- 0.28, N = 3 SE +/- 0.67, N = 3 48.14 29.37 19.96 38.11 50.80 77.10
Dbench 48 Clients OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 48 Clients btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 40 80 120 160 200 SE +/- 0.18, N = 3 SE +/- 0.74, N = 3 SE +/- 0.14, N = 3 SE +/- 0.77, N = 3 SE +/- 0.51, N = 3 SE +/- 1.96, N = 3 107.14 50.46 21.04 79.31 72.32 165.95
Dbench 128 Clients OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 128 Clients btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 40 80 120 160 200 SE +/- 4.84, N = 6 SE +/- 0.54, N = 3 SE +/- 0.67, N = 6 SE +/- 3.75, N = 3 SE +/- 1.05, N = 3 SE +/- 1.83, N = 3 132.76 46.54 13.73 80.70 70.14 162.69
Threaded I/O Tester 64MB Random Read - 32 Threads OpenBenchmarking.org MB/s, More Is Better Threaded I/O Tester 0.3.3 64MB Random Read - 32 Threads btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 1400 2800 4200 5600 7000 SE +/- 29.65, N = 4 SE +/- 9.30, N = 4 SE +/- 66.48, N = 4 SE +/- 75.75, N = 4 SE +/- 90.95, N = 4 SE +/- 10.55, N = 4 6464.87 6481.51 6489.86 6460.17 6360.62 6531.73
Threaded I/O Tester 64MB Random Write - 32 Threads OpenBenchmarking.org MB/s, More Is Better Threaded I/O Tester 0.3.3 64MB Random Write - 32 Threads btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 12 24 36 48 60 SE +/- 1.14, N = 8 SE +/- 0.01, N = 4 SE +/- 0.01, N = 4 SE +/- 0.03, N = 8 SE +/- 0.01, N = 4 SE +/- 0.01, N = 4 51.70 1.70 2.36 1.45 3.40 1.73
AIO-Stress Random Write OpenBenchmarking.org MB/s, More Is Better AIO-Stress 0.21 Random Write ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 400 800 1200 1600 2000 SE +/- 24.13, N = 6 SE +/- 21.98, N = 3 SE +/- 20.87, N = 3 SE +/- 11.53, N = 3 1158.37 1113.46 2031.73 2024.50
7-Zip Compression Compress Speed Test OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 9.13 Compress Speed Test btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 2K 4K 6K 8K 10K SE +/- 13.32, N = 3 SE +/- 8.69, N = 3 SE +/- 3.48, N = 3 SE +/- 5.84, N = 3 SE +/- 17.04, N = 3 SE +/- 9.82, N = 3 8045 8032 8041 8076 8076 8085
John The Ripper Test: Traditional DES OpenBenchmarking.org Real C/S, More Is Better John The Ripper 1.7.3.1 Test: Traditional DES btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 700K 1400K 2100K 2800K 3500K SE +/- 2333.33, N = 3 SE +/- 1452.97, N = 3 SE +/- 8185.35, N = 3 SE +/- 1763.83, N = 3 SE +/- 1154.70, N = 3 SE +/- 881.92, N = 3 3249667 3250667 3246000 3248667 3243000 3251333
John The Ripper Test: MD5 OpenBenchmarking.org Real C/S, More Is Better John The Ripper 1.7.3.1 Test: MD5 btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 3K 6K 9K 12K 15K SE +/- 8.69, N = 3 SE +/- 60.84, N = 3 SE +/- 10.48, N = 3 SE +/- 41.80, N = 3 SE +/- 6.89, N = 3 SE +/- 6.08, N = 3 15278 15232 15273 15189 15255 15283
John The Ripper Test: Blowfish OpenBenchmarking.org Real C/S, More Is Better John The Ripper 1.7.3.1 Test: Blowfish btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 200 400 600 800 1000 SE +/- 0.33, N = 3 SE +/- 1.00, N = 3 SE +/- 1.20, N = 3 SE +/- 0.33, N = 3 SE +/- 0.67, N = 3 SE +/- 0.33, N = 3 898 898 897 899 897 899
Apache Benchmark Static Web Page Serving OpenBenchmarking.org Requests Per Second, More Is Better Apache Benchmark 2.2.17 Static Web Page Serving btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 3K 6K 9K 12K 15K SE +/- 57.40, N = 3 SE +/- 173.40, N = 3 SE +/- 169.63, N = 5 SE +/- 241.02, N = 3 SE +/- 118.49, N = 3 SE +/- 176.78, N = 6 11944.80 12309.25 12281.33 12148.53 12471.13 12136.65
OpenSSL RSA 4096-bit Performance OpenBenchmarking.org Signs Per Second, More Is Better OpenSSL 1.0.0a RSA 4096-bit Performance btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 12 24 36 48 60 SE +/- 0.07, N = 4 SE +/- 0.00, N = 4 SE +/- 0.06, N = 4 SE +/- 0.05, N = 4 SE +/- 0.03, N = 4 SE +/- 0.03, N = 4 53.40 53.40 53.38 53.43 53.35 53.38
PostgreSQL pgbench TPC-B Transactions Per Second OpenBenchmarking.org TPS, More Is Better PostgreSQL pgbench 9.0.4 TPC-B Transactions Per Second btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 40 80 120 160 200 SE +/- 0.39, N = 3 SE +/- 0.16, N = 3 SE +/- 0.51, N = 3 SE +/- 2.73, N = 6 SE +/- 0.43, N = 3 SE +/- 1.18, N = 3 33.78 29.48 115.95 113.02 169.68 164.92
PostMark Disk Transaction Performance OpenBenchmarking.org TPS, More Is Better PostMark 1.51 Disk Transaction Performance btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 900 1800 2700 3600 4500 SE +/- 34.80, N = 10 SE +/- 46.40, N = 10 SE +/- 27.60, N = 5 SE +/- 141.32, N = 10 SE +/- 0.00, N = 5 SE +/- 0.00, N = 5 3090 3055 1895 1936 4166 4166
Gcrypt Library CAMELLIA256-ECB Cipher OpenBenchmarking.org Microseconds, Fewer Is Better Gcrypt Library 1.4.4 CAMELLIA256-ECB Cipher btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 700 1400 2100 2800 3500 SE +/- 0.00, N = 3 SE +/- 3.33, N = 3 SE +/- 3.33, N = 3 SE +/- 3.33, N = 3 SE +/- 6.67, N = 3 SE +/- 3.33, N = 3 3440 3433 3443 3447 3447 3437
Flexible IO Tester Intel IOMeter File Server Access Pattern OpenBenchmarking.org Seconds (Run Time), Fewer Is Better Flexible IO Tester 1.21 Intel IOMeter File Server Access Pattern btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 20 40 60 80 100 SE +/- 0.50, N = 3 SE +/- 0.72, N = 6 SE +/- 1.82, N = 6 SE +/- 1.35, N = 3 SE +/- 0.95, N = 3 SE +/- 0.07, N = 3 55.98 51.98 87.42 87.99 52.74 61.22
GnuPG 1GB File Encryption OpenBenchmarking.org Seconds, Fewer Is Better GnuPG 1.4.10 1GB File Encryption btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 4 8 12 16 20 SE +/- 0.08, N = 4 SE +/- 0.02, N = 4 SE +/- 0.01, N = 4 SE +/- 0.09, N = 4 SE +/- 0.04, N = 4 SE +/- 0.06, N = 4 15.97 15.87 15.84 15.93 15.91 15.90
Gzip Compression 2GB File Compression OpenBenchmarking.org Seconds, Fewer Is Better Gzip Compression 2GB File Compression btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 4 8 12 16 20 SE +/- 0.04, N = 3 SE +/- 0.24, N = 3 SE +/- 0.06, N = 3 SE +/- 0.20, N = 3 SE +/- 0.04, N = 3 SE +/- 0.26, N = 3 14.33 14.53 14.36 14.62 14.31 14.52
Parallel BZIP2 Compression 256MB File Compression OpenBenchmarking.org Seconds, Fewer Is Better Parallel BZIP2 Compression 1.0.5 256MB File Compression btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 5 10 15 20 25 SE +/- 0.10, N = 3 SE +/- 0.40, N = 6 SE +/- 0.29, N = 5 SE +/- 0.35, N = 4 SE +/- 0.10, N = 3 SE +/- 0.22, N = 3 21.74 20.70 20.99 20.95 20.83 21.44
LZMA Compression 256MB File Compression OpenBenchmarking.org Seconds, Fewer Is Better LZMA Compression 256MB File Compression btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 40 80 120 160 200 SE +/- 0.66, N = 3 SE +/- 0.21, N = 3 SE +/- 0.34, N = 3 SE +/- 0.04, N = 3 SE +/- 0.40, N = 3 SE +/- 0.23, N = 3 201.83 201.47 201.61 201.24 200.99 201.30
SQLite 12,500 INSERTs OpenBenchmarking.org Seconds, Fewer Is Better SQLite 3.7.3 12,500 INSERTs btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 300 600 900 1200 1500 SE +/- 15.76, N = 3 SE +/- 18.75, N = 3 SE +/- 13.25, N = 3 SE +/- 11.99, N = 5 SE +/- 2.53, N = 3 SE +/- 4.84, N = 3 1204.92 1485.46 880.33 864.26 854.89 840.08
Unpacking The Linux Kernel linux-2.6.32.tar.bz2 OpenBenchmarking.org Seconds, Fewer Is Better Unpacking The Linux Kernel linux-2.6.32.tar.bz2 btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache 3 6 9 12 15 SE +/- 0.13, N = 8 SE +/- 0.10, N = 4 SE +/- 0.42, N = 8 SE +/- 0.19, N = 4 SE +/- 0.09, N = 4 SE +/- 0.14, N = 4 10.67 10.76 11.15 11.15 10.71 10.89
Phoronix Test Suite v10.8.4