Filesystem SATA NCQ Benchmarking disk write cache on a SATA2 NCQ capable configuration. I added a few generic CPU tests as a reference for the system performance. The tests are going to try different file systems with or without write barrier and w/ or w/out disk write cache. The default CFQ scheduler is being used.
HTML result view exported from: https://openbenchmarking.org/result/1105175-GR-FILESYSTE14&gru&sor .
Filesystem SATA NCQ Processor Motherboard Chipset Memory Disk Graphics OS Kernel Desktop Display Server Display Driver OpenGL Compiler File-System Screen Resolution ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache Intel Core i5 650 @ 3.19GHz (4 Cores) LENOVO 5852CB6 Intel Core 7680MB 320GB Western Digital WDC WD3200AAKX-0 Intel Core IGP 256MB SUSE LINUX 11 2.6.32.12-0.7-default (x86_64) GNOME 2.28.2 X Server 1.6.5 intel 2.10.0 1.4 (2.1 Mesa 7.7) GCC 4.3 ext3 1680x1050 ext2/ext3 Btrfs OpenBenchmarking.org System Details - Disk Scheduler: CFQ. Python 2.6. Intel SpeedStep was enabled.
Filesystem SATA NCQ fs-mark: 1000 Files, 1MB Size compilebench: Initial Create iozone: 8GB Write Performance iozone: 8GB Read Performance dbench: 1 Clients dbench: 12 Clients dbench: 48 Clients dbench: 128 Clients tiobench: 64MB Rand Read - 32 Threads tiobench: 64MB Rand Write - 32 Threads aio-stress: Rand Write compress-7zip: Compress Speed Test john-the-ripper: Traditional DES john-the-ripper: MD5 john-the-ripper: Blowfish apache: Static Web Page Serving openssl: RSA 4096-bit Performance pgbench: TPC-B Transactions Per Second postmark: Disk Transaction Performance gcrypt: CAMELLIA256-ECB Cipher fio: Intel IOMeter File Server Access Pattern gnupg: 1GB File Encryption compress-gzip: 2GB File Compression compress-pbzip2: 256MB File Compression compress-lzma: 256MB File Compression sqlite: 12,500 INSERTs unpack-linux: linux-2.6.32.tar.bz2 ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache 14.05 138.17 74.76 60.78 11.54 19.96 21.04 13.73 6489.86 2.36 1158.37 8041 3246000 15273 897 12281.33 53.38 115.95 1895 3443 87.42 15.84 14.36 20.99 201.61 880.33 11.15 13.07 134.35 71.39 60.85 10.32 38.11 79.31 80.70 6460.17 1.45 1113.46 8076 3248667 15189 899 12148.53 53.43 113.02 1936 3447 87.99 15.93 14.62 20.95 201.24 864.26 11.15 14.95 200.49 113.82 66.27 11.23 50.80 72.32 70.14 6360.62 3.40 2031.73 8076 3243000 15255 897 12471.13 53.35 169.68 4166 3447 52.74 15.91 14.31 20.83 200.99 854.89 10.71 18.70 188.43 111.21 66.09 10.83 77.10 165.95 162.69 6531.73 1.73 2024.50 8085 3251333 15283 899 12136.65 53.38 164.92 4166 3437 61.22 15.90 14.52 21.44 201.30 840.08 10.89 14.62 117.60 121.95 79.86 9.91 48.14 107.14 132.76 6464.87 51.70 8045 3249667 15278 898 11944.80 53.40 33.78 3090 3440 55.98 15.97 14.33 21.74 201.83 1204.92 10.67 16.73 95.55 124.94 85.53 9.69 29.37 50.46 46.54 6481.51 1.70 8032 3250667 15232 898 12309.25 53.40 29.48 3055 3433 51.98 15.87 14.53 20.70 201.47 1485.46 10.76 OpenBenchmarking.org
FS-Mark 1000 Files, 1MB Size OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 1000 Files, 1MB Size ext4-nobarrier-nocache btrfs-nocow-nobarrier-nocache ext4-barrier-cache btrfs-cow-barrier-cache ext3-barrier-cache ext3-nobarrier-nocache 5 10 15 20 25 SE +/- 0.17, N = 3 SE +/- 0.03, N = 3 SE +/- 0.21, N = 6 SE +/- 0.21, N = 5 SE +/- 0.57, N = 6 SE +/- 0.44, N = 6 18.70 16.73 14.95 14.62 14.05 13.07
Compile Bench Test: Initial Create OpenBenchmarking.org MB/s, More Is Better Compile Bench 0.6 Test: Initial Create ext4-barrier-cache ext4-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache 40 80 120 160 200 SE +/- 5.58, N = 6 SE +/- 4.64, N = 6 SE +/- 11.37, N = 6 SE +/- 3.85, N = 6 SE +/- 3.04, N = 6 SE +/- 1.85, N = 6 200.49 188.43 138.17 134.35 117.60 95.55
IOzone 8GB Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.347 8GB Write Performance btrfs-nocow-nobarrier-nocache btrfs-cow-barrier-cache ext4-barrier-cache ext4-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache 30 60 90 120 150 SE +/- 0.24, N = 3 SE +/- 2.42, N = 3 SE +/- 2.80, N = 6 SE +/- 2.45, N = 6 SE +/- 0.45, N = 3 SE +/- 0.94, N = 3 124.94 121.95 113.82 111.21 74.76 71.39
IOzone 8GB Read Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.347 8GB Read Performance btrfs-nocow-nobarrier-nocache btrfs-cow-barrier-cache ext4-barrier-cache ext4-nobarrier-nocache ext3-nobarrier-nocache ext3-barrier-cache 20 40 60 80 100 SE +/- 0.16, N = 3 SE +/- 0.15, N = 3 SE +/- 3.63, N = 6 SE +/- 3.79, N = 6 SE +/- 0.01, N = 3 SE +/- 0.26, N = 3 85.53 79.86 66.27 66.09 60.85 60.78
Dbench 1 Clients OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 1 Clients ext3-barrier-cache ext4-barrier-cache ext4-nobarrier-nocache ext3-nobarrier-nocache btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.16, N = 6 11.54 11.23 10.83 10.32 9.91 9.69
Dbench 12 Clients OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 12 Clients ext4-nobarrier-nocache ext4-barrier-cache btrfs-cow-barrier-cache ext3-nobarrier-nocache btrfs-nocow-nobarrier-nocache ext3-barrier-cache 20 40 60 80 100 SE +/- 0.67, N = 3 SE +/- 0.28, N = 3 SE +/- 1.21, N = 6 SE +/- 3.42, N = 6 SE +/- 0.31, N = 3 SE +/- 0.08, N = 3 77.10 50.80 48.14 38.11 29.37 19.96
Dbench 48 Clients OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 48 Clients ext4-nobarrier-nocache btrfs-cow-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache 40 80 120 160 200 SE +/- 1.96, N = 3 SE +/- 0.18, N = 3 SE +/- 0.77, N = 3 SE +/- 0.51, N = 3 SE +/- 0.74, N = 3 SE +/- 0.14, N = 3 165.95 107.14 79.31 72.32 50.46 21.04
Dbench 128 Clients OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 128 Clients ext4-nobarrier-nocache btrfs-cow-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache 40 80 120 160 200 SE +/- 1.83, N = 3 SE +/- 4.84, N = 6 SE +/- 3.75, N = 3 SE +/- 1.05, N = 3 SE +/- 0.54, N = 3 SE +/- 0.67, N = 6 162.69 132.76 80.70 70.14 46.54 13.73
Threaded I/O Tester 64MB Random Read - 32 Threads OpenBenchmarking.org MB/s, More Is Better Threaded I/O Tester 0.3.3 64MB Random Read - 32 Threads ext4-nobarrier-nocache ext3-barrier-cache btrfs-nocow-nobarrier-nocache btrfs-cow-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache 1400 2800 4200 5600 7000 SE +/- 10.55, N = 4 SE +/- 66.48, N = 4 SE +/- 9.30, N = 4 SE +/- 29.65, N = 4 SE +/- 75.75, N = 4 SE +/- 90.95, N = 4 6531.73 6489.86 6481.51 6464.87 6460.17 6360.62
Threaded I/O Tester 64MB Random Write - 32 Threads OpenBenchmarking.org MB/s, More Is Better Threaded I/O Tester 0.3.3 64MB Random Write - 32 Threads btrfs-cow-barrier-cache ext4-barrier-cache ext3-barrier-cache ext4-nobarrier-nocache btrfs-nocow-nobarrier-nocache ext3-nobarrier-nocache 12 24 36 48 60 SE +/- 1.14, N = 8 SE +/- 0.01, N = 4 SE +/- 0.01, N = 4 SE +/- 0.01, N = 4 SE +/- 0.01, N = 4 SE +/- 0.03, N = 8 51.70 3.40 2.36 1.73 1.70 1.45
AIO-Stress Random Write OpenBenchmarking.org MB/s, More Is Better AIO-Stress 0.21 Random Write ext4-barrier-cache ext4-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache 400 800 1200 1600 2000 SE +/- 20.87, N = 3 SE +/- 11.53, N = 3 SE +/- 24.13, N = 6 SE +/- 21.98, N = 3 2031.73 2024.50 1158.37 1113.46
7-Zip Compression Compress Speed Test OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 9.13 Compress Speed Test ext4-nobarrier-nocache ext4-barrier-cache ext3-nobarrier-nocache btrfs-cow-barrier-cache ext3-barrier-cache btrfs-nocow-nobarrier-nocache 2K 4K 6K 8K 10K SE +/- 9.82, N = 3 SE +/- 17.04, N = 3 SE +/- 5.84, N = 3 SE +/- 13.32, N = 3 SE +/- 3.48, N = 3 SE +/- 8.69, N = 3 8085 8076 8076 8045 8041 8032
John The Ripper Test: Traditional DES OpenBenchmarking.org Real C/S, More Is Better John The Ripper 1.7.3.1 Test: Traditional DES ext4-nobarrier-nocache btrfs-nocow-nobarrier-nocache btrfs-cow-barrier-cache ext3-nobarrier-nocache ext3-barrier-cache ext4-barrier-cache 700K 1400K 2100K 2800K 3500K SE +/- 881.92, N = 3 SE +/- 1452.97, N = 3 SE +/- 2333.33, N = 3 SE +/- 1763.83, N = 3 SE +/- 8185.35, N = 3 SE +/- 1154.70, N = 3 3251333 3250667 3249667 3248667 3246000 3243000
John The Ripper Test: MD5 OpenBenchmarking.org Real C/S, More Is Better John The Ripper 1.7.3.1 Test: MD5 ext4-nobarrier-nocache btrfs-cow-barrier-cache ext3-barrier-cache ext4-barrier-cache btrfs-nocow-nobarrier-nocache ext3-nobarrier-nocache 3K 6K 9K 12K 15K SE +/- 6.08, N = 3 SE +/- 8.69, N = 3 SE +/- 10.48, N = 3 SE +/- 6.89, N = 3 SE +/- 60.84, N = 3 SE +/- 41.80, N = 3 15283 15278 15273 15255 15232 15189
John The Ripper Test: Blowfish OpenBenchmarking.org Real C/S, More Is Better John The Ripper 1.7.3.1 Test: Blowfish ext4-nobarrier-nocache ext3-nobarrier-nocache btrfs-nocow-nobarrier-nocache btrfs-cow-barrier-cache ext4-barrier-cache ext3-barrier-cache 200 400 600 800 1000 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 1.00, N = 3 SE +/- 0.33, N = 3 SE +/- 0.67, N = 3 SE +/- 1.20, N = 3 899 899 898 898 897 897
Apache Benchmark Static Web Page Serving OpenBenchmarking.org Requests Per Second, More Is Better Apache Benchmark 2.2.17 Static Web Page Serving ext4-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-nobarrier-nocache btrfs-cow-barrier-cache 3K 6K 9K 12K 15K SE +/- 118.49, N = 3 SE +/- 173.40, N = 3 SE +/- 169.63, N = 5 SE +/- 241.02, N = 3 SE +/- 176.78, N = 6 SE +/- 57.40, N = 3 12471.13 12309.25 12281.33 12148.53 12136.65 11944.80
OpenSSL RSA 4096-bit Performance OpenBenchmarking.org Signs Per Second, More Is Better OpenSSL 1.0.0a RSA 4096-bit Performance ext3-nobarrier-nocache btrfs-nocow-nobarrier-nocache btrfs-cow-barrier-cache ext4-nobarrier-nocache ext3-barrier-cache ext4-barrier-cache 12 24 36 48 60 SE +/- 0.05, N = 4 SE +/- 0.00, N = 4 SE +/- 0.07, N = 4 SE +/- 0.03, N = 4 SE +/- 0.06, N = 4 SE +/- 0.03, N = 4 53.43 53.40 53.40 53.38 53.38 53.35
PostgreSQL pgbench TPC-B Transactions Per Second OpenBenchmarking.org TPS, More Is Better PostgreSQL pgbench 9.0.4 TPC-B Transactions Per Second ext4-barrier-cache ext4-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache 40 80 120 160 200 SE +/- 0.43, N = 3 SE +/- 1.18, N = 3 SE +/- 0.51, N = 3 SE +/- 2.73, N = 6 SE +/- 0.39, N = 3 SE +/- 0.16, N = 3 169.68 164.92 115.95 113.02 33.78 29.48
PostMark Disk Transaction Performance OpenBenchmarking.org TPS, More Is Better PostMark 1.51 Disk Transaction Performance ext4-nobarrier-nocache ext4-barrier-cache btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-nobarrier-nocache ext3-barrier-cache 900 1800 2700 3600 4500 SE +/- 0.00, N = 5 SE +/- 0.00, N = 5 SE +/- 34.80, N = 10 SE +/- 46.40, N = 10 SE +/- 141.32, N = 10 SE +/- 27.60, N = 5 4166 4166 3090 3055 1936 1895
Gcrypt Library CAMELLIA256-ECB Cipher OpenBenchmarking.org Microseconds, Fewer Is Better Gcrypt Library 1.4.4 CAMELLIA256-ECB Cipher btrfs-nocow-nobarrier-nocache ext4-nobarrier-nocache btrfs-cow-barrier-cache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache 700 1400 2100 2800 3500 SE +/- 3.33, N = 3 SE +/- 3.33, N = 3 SE +/- 0.00, N = 3 SE +/- 3.33, N = 3 SE +/- 3.33, N = 3 SE +/- 6.67, N = 3 3433 3437 3440 3443 3447 3447
Flexible IO Tester Intel IOMeter File Server Access Pattern OpenBenchmarking.org Seconds (Run Time), Fewer Is Better Flexible IO Tester 1.21 Intel IOMeter File Server Access Pattern btrfs-nocow-nobarrier-nocache ext4-barrier-cache btrfs-cow-barrier-cache ext4-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache 20 40 60 80 100 SE +/- 0.72, N = 6 SE +/- 0.95, N = 3 SE +/- 0.50, N = 3 SE +/- 0.07, N = 3 SE +/- 1.82, N = 6 SE +/- 1.35, N = 3 51.98 52.74 55.98 61.22 87.42 87.99
GnuPG 1GB File Encryption OpenBenchmarking.org Seconds, Fewer Is Better GnuPG 1.4.10 1GB File Encryption ext3-barrier-cache btrfs-nocow-nobarrier-nocache ext4-nobarrier-nocache ext4-barrier-cache ext3-nobarrier-nocache btrfs-cow-barrier-cache 4 8 12 16 20 SE +/- 0.01, N = 4 SE +/- 0.02, N = 4 SE +/- 0.06, N = 4 SE +/- 0.04, N = 4 SE +/- 0.09, N = 4 SE +/- 0.08, N = 4 15.84 15.87 15.90 15.91 15.93 15.97
Gzip Compression 2GB File Compression OpenBenchmarking.org Seconds, Fewer Is Better Gzip Compression 2GB File Compression ext4-barrier-cache btrfs-cow-barrier-cache ext3-barrier-cache ext4-nobarrier-nocache btrfs-nocow-nobarrier-nocache ext3-nobarrier-nocache 4 8 12 16 20 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.06, N = 3 SE +/- 0.26, N = 3 SE +/- 0.24, N = 3 SE +/- 0.20, N = 3 14.31 14.33 14.36 14.52 14.53 14.62
Parallel BZIP2 Compression 256MB File Compression OpenBenchmarking.org Seconds, Fewer Is Better Parallel BZIP2 Compression 1.0.5 256MB File Compression btrfs-nocow-nobarrier-nocache ext4-barrier-cache ext3-nobarrier-nocache ext3-barrier-cache ext4-nobarrier-nocache btrfs-cow-barrier-cache 5 10 15 20 25 SE +/- 0.40, N = 6 SE +/- 0.10, N = 3 SE +/- 0.35, N = 4 SE +/- 0.29, N = 5 SE +/- 0.22, N = 3 SE +/- 0.10, N = 3 20.70 20.83 20.95 20.99 21.44 21.74
LZMA Compression 256MB File Compression OpenBenchmarking.org Seconds, Fewer Is Better LZMA Compression 256MB File Compression ext4-barrier-cache ext3-nobarrier-nocache ext4-nobarrier-nocache btrfs-nocow-nobarrier-nocache ext3-barrier-cache btrfs-cow-barrier-cache 40 80 120 160 200 SE +/- 0.40, N = 3 SE +/- 0.04, N = 3 SE +/- 0.23, N = 3 SE +/- 0.21, N = 3 SE +/- 0.34, N = 3 SE +/- 0.66, N = 3 200.99 201.24 201.30 201.47 201.61 201.83
SQLite 12,500 INSERTs OpenBenchmarking.org Seconds, Fewer Is Better SQLite 3.7.3 12,500 INSERTs ext4-nobarrier-nocache ext4-barrier-cache ext3-nobarrier-nocache ext3-barrier-cache btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache 300 600 900 1200 1500 SE +/- 4.84, N = 3 SE +/- 2.53, N = 3 SE +/- 11.99, N = 5 SE +/- 13.25, N = 3 SE +/- 15.76, N = 3 SE +/- 18.75, N = 3 840.08 854.89 864.26 880.33 1204.92 1485.46
Unpacking The Linux Kernel linux-2.6.32.tar.bz2 OpenBenchmarking.org Seconds, Fewer Is Better Unpacking The Linux Kernel linux-2.6.32.tar.bz2 btrfs-cow-barrier-cache ext4-barrier-cache btrfs-nocow-nobarrier-nocache ext4-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache 3 6 9 12 15 SE +/- 0.13, N = 8 SE +/- 0.09, N = 4 SE +/- 0.10, N = 4 SE +/- 0.14, N = 4 SE +/- 0.42, N = 8 SE +/- 0.19, N = 4 10.67 10.71 10.76 10.89 11.15 11.15
Phoronix Test Suite v10.8.4