Filesystem SATA NCQ Benchmarking disk write cache on a SATA2 NCQ capable configuration. I added a few generic CPU tests as a reference for the system performance. The tests are going to try different file systems with or without write barrier and w/ or w/out disk write cache. The default CFQ scheduler is being used.
HTML result view exported from: https://openbenchmarking.org/result/1105175-GR-FILESYSTE14&sor&grw .
Filesystem SATA NCQ Processor Motherboard Chipset Memory Disk Graphics OS Kernel Desktop Display Server Display Driver OpenGL Compiler File-System Screen Resolution ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache Intel Core i5 650 @ 3.19GHz (4 Cores) LENOVO 5852CB6 Intel Core 7680MB 320GB Western Digital WDC WD3200AAKX-0 Intel Core IGP 256MB SUSE LINUX 11 2.6.32.12-0.7-default (x86_64) GNOME 2.28.2 X Server 1.6.5 intel 2.10.0 1.4 (2.1 Mesa 7.7) GCC 4.3 ext3 1680x1050 ext2/ext3 Btrfs OpenBenchmarking.org System Details - Disk Scheduler: CFQ. Python 2.6. Intel SpeedStep was enabled.
Filesystem SATA NCQ compress-lzma: 256MB File Compression aio-stress: Rand Write compilebench: Initial Create gcrypt: CAMELLIA256-ECB Cipher dbench: 1 Clients dbench: 12 Clients dbench: 48 Clients dbench: 128 Clients fio: Intel IOMeter File Server Access Pattern fs-mark: 1000 Files, 1MB Size iozone: 8GB Write Performance iozone: 8GB Read Performance postmark: Disk Transaction Performance tiobench: 64MB Rand Read - 32 Threads tiobench: 64MB Rand Write - 32 Threads compress-7zip: Compress Speed Test john-the-ripper: Traditional DES john-the-ripper: MD5 john-the-ripper: Blowfish compress-pbzip2: 256MB File Compression apache: Static Web Page Serving openssl: RSA 4096-bit Performance sqlite: 12,500 INSERTs pgbench: TPC-B Transactions Per Second compress-gzip: 2GB File Compression unpack-linux: linux-2.6.32.tar.bz2 gnupg: 1GB File Encryption ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache 201.61 1158.37 138.17 3443 11.54 19.96 21.04 13.73 87.42 14.05 74.76 60.78 1895 6489.86 2.36 8041 3246000 15273 897 20.99 12281.33 53.38 880.33 115.95 14.36 11.15 15.84 201.24 1113.46 134.35 3447 10.32 38.11 79.31 80.70 87.99 13.07 71.39 60.85 1936 6460.17 1.45 8076 3248667 15189 899 20.95 12148.53 53.43 864.26 113.02 14.62 11.15 15.93 200.99 2031.73 200.49 3447 11.23 50.80 72.32 70.14 52.74 14.95 113.82 66.27 4166 6360.62 3.40 8076 3243000 15255 897 20.83 12471.13 53.35 854.89 169.68 14.31 10.71 15.91 201.30 2024.50 188.43 3437 10.83 77.10 165.95 162.69 61.22 18.70 111.21 66.09 4166 6531.73 1.73 8085 3251333 15283 899 21.44 12136.65 53.38 840.08 164.92 14.52 10.89 15.90 201.83 117.60 3440 9.91 48.14 107.14 132.76 55.98 14.62 121.95 79.86 3090 6464.87 51.70 8045 3249667 15278 898 21.74 11944.80 53.40 1204.92 33.78 14.33 10.67 15.97 201.47 95.55 3433 9.69 29.37 50.46 46.54 51.98 16.73 124.94 85.53 3055 6481.51 1.70 8032 3250667 15232 898 20.70 12309.25 53.40 1485.46 29.48 14.53 10.76 15.87 OpenBenchmarking.org
LZMA Compression 256MB File Compression OpenBenchmarking.org Seconds, Fewer Is Better LZMA Compression 256MB File Compression ext4-barrier-cache ext3-nobarrier-nocache ext4-nobarrier-nocache btrfs-nocow-nobarrier-nocache ext3-barrier-cache btrfs-cow-barrier-cache 40 80 120 160 200 SE +/- 0.40, N = 3 SE +/- 0.04, N = 3 SE +/- 0.23, N = 3 SE +/- 0.21, N = 3 SE +/- 0.34, N = 3 SE +/- 0.66, N = 3 200.99 201.24 201.30 201.47 201.61 201.83
AIO-Stress Random Write OpenBenchmarking.org MB/s, More Is Better AIO-Stress 0.21 Random Write ext4-barrier-cache ext4-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache 400 800 1200 1600 2000 SE +/- 20.87, N = 3 SE +/- 11.53, N = 3 SE +/- 24.13, N = 6 SE +/- 21.98, N = 3 2031.73 2024.50 1158.37 1113.46
Compile Bench Test: Initial Create OpenBenchmarking.org MB/s, More Is Better Compile Bench 0.6 Test: Initial Create ext4-barrier-cache ext4-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache 40 80 120 160 200 SE +/- 5.58, N = 6 SE +/- 4.64, N = 6 SE +/- 11.37, N = 6 SE +/- 3.85, N = 6 SE +/- 3.04, N = 6 SE +/- 1.85, N = 6 200.49 188.43 138.17 134.35 117.60 95.55
Gcrypt Library CAMELLIA256-ECB Cipher OpenBenchmarking.org Microseconds, Fewer Is Better Gcrypt Library 1.4.4 CAMELLIA256-ECB Cipher btrfs-nocow-nobarrier-nocache ext4-nobarrier-nocache btrfs-cow-barrier-cache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache 700 1400 2100 2800 3500 SE +/- 3.33, N = 3 SE +/- 3.33, N = 3 SE +/- 0.00, N = 3 SE +/- 3.33, N = 3 SE +/- 3.33, N = 3 SE +/- 6.67, N = 3 3433 3437 3440 3443 3447 3447
Dbench 1 Clients OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 1 Clients ext3-barrier-cache ext4-barrier-cache ext4-nobarrier-nocache ext3-nobarrier-nocache btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.16, N = 6 11.54 11.23 10.83 10.32 9.91 9.69
Dbench 12 Clients OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 12 Clients ext4-nobarrier-nocache ext4-barrier-cache btrfs-cow-barrier-cache ext3-nobarrier-nocache btrfs-nocow-nobarrier-nocache ext3-barrier-cache 20 40 60 80 100 SE +/- 0.67, N = 3 SE +/- 0.28, N = 3 SE +/- 1.21, N = 6 SE +/- 3.42, N = 6 SE +/- 0.31, N = 3 SE +/- 0.08, N = 3 77.10 50.80 48.14 38.11 29.37 19.96
Dbench 48 Clients OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 48 Clients ext4-nobarrier-nocache btrfs-cow-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache 40 80 120 160 200 SE +/- 1.96, N = 3 SE +/- 0.18, N = 3 SE +/- 0.77, N = 3 SE +/- 0.51, N = 3 SE +/- 0.74, N = 3 SE +/- 0.14, N = 3 165.95 107.14 79.31 72.32 50.46 21.04
Dbench 128 Clients OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 128 Clients ext4-nobarrier-nocache btrfs-cow-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache 40 80 120 160 200 SE +/- 1.83, N = 3 SE +/- 4.84, N = 6 SE +/- 3.75, N = 3 SE +/- 1.05, N = 3 SE +/- 0.54, N = 3 SE +/- 0.67, N = 6 162.69 132.76 80.70 70.14 46.54 13.73
Flexible IO Tester Intel IOMeter File Server Access Pattern OpenBenchmarking.org Seconds (Run Time), Fewer Is Better Flexible IO Tester 1.21 Intel IOMeter File Server Access Pattern btrfs-nocow-nobarrier-nocache ext4-barrier-cache btrfs-cow-barrier-cache ext4-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache 20 40 60 80 100 SE +/- 0.72, N = 6 SE +/- 0.95, N = 3 SE +/- 0.50, N = 3 SE +/- 0.07, N = 3 SE +/- 1.82, N = 6 SE +/- 1.35, N = 3 51.98 52.74 55.98 61.22 87.42 87.99
FS-Mark 1000 Files, 1MB Size OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 1000 Files, 1MB Size ext4-nobarrier-nocache btrfs-nocow-nobarrier-nocache ext4-barrier-cache btrfs-cow-barrier-cache ext3-barrier-cache ext3-nobarrier-nocache 5 10 15 20 25 SE +/- 0.17, N = 3 SE +/- 0.03, N = 3 SE +/- 0.21, N = 6 SE +/- 0.21, N = 5 SE +/- 0.57, N = 6 SE +/- 0.44, N = 6 18.70 16.73 14.95 14.62 14.05 13.07
IOzone 8GB Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.347 8GB Write Performance btrfs-nocow-nobarrier-nocache btrfs-cow-barrier-cache ext4-barrier-cache ext4-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache 30 60 90 120 150 SE +/- 0.24, N = 3 SE +/- 2.42, N = 3 SE +/- 2.80, N = 6 SE +/- 2.45, N = 6 SE +/- 0.45, N = 3 SE +/- 0.94, N = 3 124.94 121.95 113.82 111.21 74.76 71.39
IOzone 8GB Read Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.347 8GB Read Performance btrfs-nocow-nobarrier-nocache btrfs-cow-barrier-cache ext4-barrier-cache ext4-nobarrier-nocache ext3-nobarrier-nocache ext3-barrier-cache 20 40 60 80 100 SE +/- 0.16, N = 3 SE +/- 0.15, N = 3 SE +/- 3.63, N = 6 SE +/- 3.79, N = 6 SE +/- 0.01, N = 3 SE +/- 0.26, N = 3 85.53 79.86 66.27 66.09 60.85 60.78
PostMark Disk Transaction Performance OpenBenchmarking.org TPS, More Is Better PostMark 1.51 Disk Transaction Performance ext4-nobarrier-nocache ext4-barrier-cache btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-nobarrier-nocache ext3-barrier-cache 900 1800 2700 3600 4500 SE +/- 0.00, N = 5 SE +/- 0.00, N = 5 SE +/- 34.80, N = 10 SE +/- 46.40, N = 10 SE +/- 141.32, N = 10 SE +/- 27.60, N = 5 4166 4166 3090 3055 1936 1895
Threaded I/O Tester 64MB Random Read - 32 Threads OpenBenchmarking.org MB/s, More Is Better Threaded I/O Tester 0.3.3 64MB Random Read - 32 Threads ext4-nobarrier-nocache ext3-barrier-cache btrfs-nocow-nobarrier-nocache btrfs-cow-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache 1400 2800 4200 5600 7000 SE +/- 10.55, N = 4 SE +/- 66.48, N = 4 SE +/- 9.30, N = 4 SE +/- 29.65, N = 4 SE +/- 75.75, N = 4 SE +/- 90.95, N = 4 6531.73 6489.86 6481.51 6464.87 6460.17 6360.62
Threaded I/O Tester 64MB Random Write - 32 Threads OpenBenchmarking.org MB/s, More Is Better Threaded I/O Tester 0.3.3 64MB Random Write - 32 Threads btrfs-cow-barrier-cache ext4-barrier-cache ext3-barrier-cache ext4-nobarrier-nocache btrfs-nocow-nobarrier-nocache ext3-nobarrier-nocache 12 24 36 48 60 SE +/- 1.14, N = 8 SE +/- 0.01, N = 4 SE +/- 0.01, N = 4 SE +/- 0.01, N = 4 SE +/- 0.01, N = 4 SE +/- 0.03, N = 8 51.70 3.40 2.36 1.73 1.70 1.45
7-Zip Compression Compress Speed Test OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 9.13 Compress Speed Test ext4-nobarrier-nocache ext4-barrier-cache ext3-nobarrier-nocache btrfs-cow-barrier-cache ext3-barrier-cache btrfs-nocow-nobarrier-nocache 2K 4K 6K 8K 10K SE +/- 9.82, N = 3 SE +/- 17.04, N = 3 SE +/- 5.84, N = 3 SE +/- 13.32, N = 3 SE +/- 3.48, N = 3 SE +/- 8.69, N = 3 8085 8076 8076 8045 8041 8032
John The Ripper Test: Traditional DES OpenBenchmarking.org Real C/S, More Is Better John The Ripper 1.7.3.1 Test: Traditional DES ext4-nobarrier-nocache btrfs-nocow-nobarrier-nocache btrfs-cow-barrier-cache ext3-nobarrier-nocache ext3-barrier-cache ext4-barrier-cache 700K 1400K 2100K 2800K 3500K SE +/- 881.92, N = 3 SE +/- 1452.97, N = 3 SE +/- 2333.33, N = 3 SE +/- 1763.83, N = 3 SE +/- 8185.35, N = 3 SE +/- 1154.70, N = 3 3251333 3250667 3249667 3248667 3246000 3243000
John The Ripper Test: MD5 OpenBenchmarking.org Real C/S, More Is Better John The Ripper 1.7.3.1 Test: MD5 ext4-nobarrier-nocache btrfs-cow-barrier-cache ext3-barrier-cache ext4-barrier-cache btrfs-nocow-nobarrier-nocache ext3-nobarrier-nocache 3K 6K 9K 12K 15K SE +/- 6.08, N = 3 SE +/- 8.69, N = 3 SE +/- 10.48, N = 3 SE +/- 6.89, N = 3 SE +/- 60.84, N = 3 SE +/- 41.80, N = 3 15283 15278 15273 15255 15232 15189
John The Ripper Test: Blowfish OpenBenchmarking.org Real C/S, More Is Better John The Ripper 1.7.3.1 Test: Blowfish ext4-nobarrier-nocache ext3-nobarrier-nocache btrfs-nocow-nobarrier-nocache btrfs-cow-barrier-cache ext4-barrier-cache ext3-barrier-cache 200 400 600 800 1000 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 1.00, N = 3 SE +/- 0.33, N = 3 SE +/- 0.67, N = 3 SE +/- 1.20, N = 3 899 899 898 898 897 897
Parallel BZIP2 Compression 256MB File Compression OpenBenchmarking.org Seconds, Fewer Is Better Parallel BZIP2 Compression 1.0.5 256MB File Compression btrfs-nocow-nobarrier-nocache ext4-barrier-cache ext3-nobarrier-nocache ext3-barrier-cache ext4-nobarrier-nocache btrfs-cow-barrier-cache 5 10 15 20 25 SE +/- 0.40, N = 6 SE +/- 0.10, N = 3 SE +/- 0.35, N = 4 SE +/- 0.29, N = 5 SE +/- 0.22, N = 3 SE +/- 0.10, N = 3 20.70 20.83 20.95 20.99 21.44 21.74
Apache Benchmark Static Web Page Serving OpenBenchmarking.org Requests Per Second, More Is Better Apache Benchmark 2.2.17 Static Web Page Serving ext4-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-nobarrier-nocache btrfs-cow-barrier-cache 3K 6K 9K 12K 15K SE +/- 118.49, N = 3 SE +/- 173.40, N = 3 SE +/- 169.63, N = 5 SE +/- 241.02, N = 3 SE +/- 176.78, N = 6 SE +/- 57.40, N = 3 12471.13 12309.25 12281.33 12148.53 12136.65 11944.80
OpenSSL RSA 4096-bit Performance OpenBenchmarking.org Signs Per Second, More Is Better OpenSSL 1.0.0a RSA 4096-bit Performance ext3-nobarrier-nocache btrfs-nocow-nobarrier-nocache btrfs-cow-barrier-cache ext4-nobarrier-nocache ext3-barrier-cache ext4-barrier-cache 12 24 36 48 60 SE +/- 0.05, N = 4 SE +/- 0.00, N = 4 SE +/- 0.07, N = 4 SE +/- 0.03, N = 4 SE +/- 0.06, N = 4 SE +/- 0.03, N = 4 53.43 53.40 53.40 53.38 53.38 53.35
SQLite 12,500 INSERTs OpenBenchmarking.org Seconds, Fewer Is Better SQLite 3.7.3 12,500 INSERTs ext4-nobarrier-nocache ext4-barrier-cache ext3-nobarrier-nocache ext3-barrier-cache btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache 300 600 900 1200 1500 SE +/- 4.84, N = 3 SE +/- 2.53, N = 3 SE +/- 11.99, N = 5 SE +/- 13.25, N = 3 SE +/- 15.76, N = 3 SE +/- 18.75, N = 3 840.08 854.89 864.26 880.33 1204.92 1485.46
PostgreSQL pgbench TPC-B Transactions Per Second OpenBenchmarking.org TPS, More Is Better PostgreSQL pgbench 9.0.4 TPC-B Transactions Per Second ext4-barrier-cache ext4-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache 40 80 120 160 200 SE +/- 0.43, N = 3 SE +/- 1.18, N = 3 SE +/- 0.51, N = 3 SE +/- 2.73, N = 6 SE +/- 0.39, N = 3 SE +/- 0.16, N = 3 169.68 164.92 115.95 113.02 33.78 29.48
Gzip Compression 2GB File Compression OpenBenchmarking.org Seconds, Fewer Is Better Gzip Compression 2GB File Compression ext4-barrier-cache btrfs-cow-barrier-cache ext3-barrier-cache ext4-nobarrier-nocache btrfs-nocow-nobarrier-nocache ext3-nobarrier-nocache 4 8 12 16 20 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.06, N = 3 SE +/- 0.26, N = 3 SE +/- 0.24, N = 3 SE +/- 0.20, N = 3 14.31 14.33 14.36 14.52 14.53 14.62
Unpacking The Linux Kernel linux-2.6.32.tar.bz2 OpenBenchmarking.org Seconds, Fewer Is Better Unpacking The Linux Kernel linux-2.6.32.tar.bz2 btrfs-cow-barrier-cache ext4-barrier-cache btrfs-nocow-nobarrier-nocache ext4-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache 3 6 9 12 15 SE +/- 0.13, N = 8 SE +/- 0.09, N = 4 SE +/- 0.10, N = 4 SE +/- 0.14, N = 4 SE +/- 0.42, N = 8 SE +/- 0.19, N = 4 10.67 10.71 10.76 10.89 11.15 11.15
GnuPG 1GB File Encryption OpenBenchmarking.org Seconds, Fewer Is Better GnuPG 1.4.10 1GB File Encryption ext3-barrier-cache btrfs-nocow-nobarrier-nocache ext4-nobarrier-nocache ext4-barrier-cache ext3-nobarrier-nocache btrfs-cow-barrier-cache 4 8 12 16 20 SE +/- 0.01, N = 4 SE +/- 0.02, N = 4 SE +/- 0.06, N = 4 SE +/- 0.04, N = 4 SE +/- 0.09, N = 4 SE +/- 0.08, N = 4 15.84 15.87 15.90 15.91 15.93 15.97
Phoronix Test Suite v10.8.5