Filesystem SATA NCQ Benchmarking disk write cache on a SATA2 NCQ capable configuration. I added a few generic CPU tests as a reference for the system performance. The tests are going to try different file systems with or without write barrier and w/ or w/out disk write cache. The default CFQ scheduler is being used.
HTML result view exported from: https://openbenchmarking.org/result/1105175-GR-FILESYSTE14&sor&grs .
Filesystem SATA NCQ Processor Motherboard Chipset Memory Disk Graphics OS Kernel Desktop Display Server Display Driver OpenGL Compiler File-System Screen Resolution ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache Intel Core i5 650 @ 3.19GHz (4 Cores) LENOVO 5852CB6 Intel Core 7680MB 320GB Western Digital WDC WD3200AAKX-0 Intel Core IGP 256MB SUSE LINUX 11 2.6.32.12-0.7-default (x86_64) GNOME 2.28.2 X Server 1.6.5 intel 2.10.0 1.4 (2.1 Mesa 7.7) GCC 4.3 ext3 1680x1050 ext2/ext3 Btrfs OpenBenchmarking.org System Details - Disk Scheduler: CFQ. Python 2.6. Intel SpeedStep was enabled.
Filesystem SATA NCQ dbench: 48 Clients pgbench: TPC-B Transactions Per Second tiobench: 64MB Rand Write - 32 Threads dbench: 12 Clients postmark: Disk Transaction Performance aio-stress: Rand Write sqlite: 12,500 INSERTs iozone: 8GB Write Performance fio: Intel IOMeter File Server Access Pattern fs-mark: 1000 Files, 1MB Size iozone: 8GB Read Performance dbench: 1 Clients compress-pbzip2: 256MB File Compression unpack-linux: linux-2.6.32.tar.bz2 apache: Static Web Page Serving tiobench: 64MB Rand Read - 32 Threads compress-gzip: 2GB File Compression gnupg: 1GB File Encryption compress-7zip: Compress Speed Test john-the-ripper: MD5 compress-lzma: 256MB File Compression gcrypt: CAMELLIA256-ECB Cipher john-the-ripper: Traditional DES john-the-ripper: Blowfish openssl: RSA 4096-bit Performance dbench: 128 Clients compilebench: Initial Create ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache ext4-nobarrier-nocache btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache 21.04 115.95 2.36 19.96 1895 1158.37 880.33 74.76 87.42 14.05 60.78 11.54 20.99 11.15 12281.33 6489.86 14.36 15.84 8041 15273 201.61 3443 3246000 897 53.38 13.73 138.17 79.31 113.02 1.45 38.11 1936 1113.46 864.26 71.39 87.99 13.07 60.85 10.32 20.95 11.15 12148.53 6460.17 14.62 15.93 8076 15189 201.24 3447 3248667 899 53.43 80.70 134.35 72.32 169.68 3.40 50.80 4166 2031.73 854.89 113.82 52.74 14.95 66.27 11.23 20.83 10.71 12471.13 6360.62 14.31 15.91 8076 15255 200.99 3447 3243000 897 53.35 70.14 200.49 165.95 164.92 1.73 77.10 4166 2024.50 840.08 111.21 61.22 18.70 66.09 10.83 21.44 10.89 12136.65 6531.73 14.52 15.90 8085 15283 201.30 3437 3251333 899 53.38 162.69 188.43 107.14 33.78 51.70 48.14 3090 1204.92 121.95 55.98 14.62 79.86 9.91 21.74 10.67 11944.80 6464.87 14.33 15.97 8045 15278 201.83 3440 3249667 898 53.40 132.76 117.60 50.46 29.48 1.70 29.37 3055 1485.46 124.94 51.98 16.73 85.53 9.69 20.70 10.76 12309.25 6481.51 14.53 15.87 8032 15232 201.47 3433 3250667 898 53.40 46.54 95.55 OpenBenchmarking.org
Dbench 48 Clients OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 48 Clients ext4-nobarrier-nocache btrfs-cow-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache 40 80 120 160 200 SE +/- 1.96, N = 3 SE +/- 0.18, N = 3 SE +/- 0.77, N = 3 SE +/- 0.51, N = 3 SE +/- 0.74, N = 3 SE +/- 0.14, N = 3 165.95 107.14 79.31 72.32 50.46 21.04
PostgreSQL pgbench TPC-B Transactions Per Second OpenBenchmarking.org TPS, More Is Better PostgreSQL pgbench 9.0.4 TPC-B Transactions Per Second ext4-barrier-cache ext4-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache 40 80 120 160 200 SE +/- 0.43, N = 3 SE +/- 1.18, N = 3 SE +/- 0.51, N = 3 SE +/- 2.73, N = 6 SE +/- 0.39, N = 3 SE +/- 0.16, N = 3 169.68 164.92 115.95 113.02 33.78 29.48
Threaded I/O Tester 64MB Random Write - 32 Threads OpenBenchmarking.org MB/s, More Is Better Threaded I/O Tester 0.3.3 64MB Random Write - 32 Threads btrfs-cow-barrier-cache ext4-barrier-cache ext3-barrier-cache ext4-nobarrier-nocache btrfs-nocow-nobarrier-nocache ext3-nobarrier-nocache 12 24 36 48 60 SE +/- 1.14, N = 8 SE +/- 0.01, N = 4 SE +/- 0.01, N = 4 SE +/- 0.01, N = 4 SE +/- 0.01, N = 4 SE +/- 0.03, N = 8 51.70 3.40 2.36 1.73 1.70 1.45
Dbench 12 Clients OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 12 Clients ext4-nobarrier-nocache ext4-barrier-cache btrfs-cow-barrier-cache ext3-nobarrier-nocache btrfs-nocow-nobarrier-nocache ext3-barrier-cache 20 40 60 80 100 SE +/- 0.67, N = 3 SE +/- 0.28, N = 3 SE +/- 1.21, N = 6 SE +/- 3.42, N = 6 SE +/- 0.31, N = 3 SE +/- 0.08, N = 3 77.10 50.80 48.14 38.11 29.37 19.96
PostMark Disk Transaction Performance OpenBenchmarking.org TPS, More Is Better PostMark 1.51 Disk Transaction Performance ext4-nobarrier-nocache ext4-barrier-cache btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache ext3-nobarrier-nocache ext3-barrier-cache 900 1800 2700 3600 4500 SE +/- 0.00, N = 5 SE +/- 0.00, N = 5 SE +/- 34.80, N = 10 SE +/- 46.40, N = 10 SE +/- 141.32, N = 10 SE +/- 27.60, N = 5 4166 4166 3090 3055 1936 1895
AIO-Stress Random Write OpenBenchmarking.org MB/s, More Is Better AIO-Stress 0.21 Random Write ext4-barrier-cache ext4-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache 400 800 1200 1600 2000 SE +/- 20.87, N = 3 SE +/- 11.53, N = 3 SE +/- 24.13, N = 6 SE +/- 21.98, N = 3 2031.73 2024.50 1158.37 1113.46
SQLite 12,500 INSERTs OpenBenchmarking.org Seconds, Fewer Is Better SQLite 3.7.3 12,500 INSERTs ext4-nobarrier-nocache ext4-barrier-cache ext3-nobarrier-nocache ext3-barrier-cache btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache 300 600 900 1200 1500 SE +/- 4.84, N = 3 SE +/- 2.53, N = 3 SE +/- 11.99, N = 5 SE +/- 13.25, N = 3 SE +/- 15.76, N = 3 SE +/- 18.75, N = 3 840.08 854.89 864.26 880.33 1204.92 1485.46
IOzone 8GB Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.347 8GB Write Performance btrfs-nocow-nobarrier-nocache btrfs-cow-barrier-cache ext4-barrier-cache ext4-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache 30 60 90 120 150 SE +/- 0.24, N = 3 SE +/- 2.42, N = 3 SE +/- 2.80, N = 6 SE +/- 2.45, N = 6 SE +/- 0.45, N = 3 SE +/- 0.94, N = 3 124.94 121.95 113.82 111.21 74.76 71.39
Flexible IO Tester Intel IOMeter File Server Access Pattern OpenBenchmarking.org Seconds (Run Time), Fewer Is Better Flexible IO Tester 1.21 Intel IOMeter File Server Access Pattern btrfs-nocow-nobarrier-nocache ext4-barrier-cache btrfs-cow-barrier-cache ext4-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache 20 40 60 80 100 SE +/- 0.72, N = 6 SE +/- 0.95, N = 3 SE +/- 0.50, N = 3 SE +/- 0.07, N = 3 SE +/- 1.82, N = 6 SE +/- 1.35, N = 3 51.98 52.74 55.98 61.22 87.42 87.99
FS-Mark 1000 Files, 1MB Size OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 1000 Files, 1MB Size ext4-nobarrier-nocache btrfs-nocow-nobarrier-nocache ext4-barrier-cache btrfs-cow-barrier-cache ext3-barrier-cache ext3-nobarrier-nocache 5 10 15 20 25 SE +/- 0.17, N = 3 SE +/- 0.03, N = 3 SE +/- 0.21, N = 6 SE +/- 0.21, N = 5 SE +/- 0.57, N = 6 SE +/- 0.44, N = 6 18.70 16.73 14.95 14.62 14.05 13.07
IOzone 8GB Read Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.347 8GB Read Performance btrfs-nocow-nobarrier-nocache btrfs-cow-barrier-cache ext4-barrier-cache ext4-nobarrier-nocache ext3-nobarrier-nocache ext3-barrier-cache 20 40 60 80 100 SE +/- 0.16, N = 3 SE +/- 0.15, N = 3 SE +/- 3.63, N = 6 SE +/- 3.79, N = 6 SE +/- 0.01, N = 3 SE +/- 0.26, N = 3 85.53 79.86 66.27 66.09 60.85 60.78
Dbench 1 Clients OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 1 Clients ext3-barrier-cache ext4-barrier-cache ext4-nobarrier-nocache ext3-nobarrier-nocache btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.16, N = 6 11.54 11.23 10.83 10.32 9.91 9.69
Parallel BZIP2 Compression 256MB File Compression OpenBenchmarking.org Seconds, Fewer Is Better Parallel BZIP2 Compression 1.0.5 256MB File Compression btrfs-nocow-nobarrier-nocache ext4-barrier-cache ext3-nobarrier-nocache ext3-barrier-cache ext4-nobarrier-nocache btrfs-cow-barrier-cache 5 10 15 20 25 SE +/- 0.40, N = 6 SE +/- 0.10, N = 3 SE +/- 0.35, N = 4 SE +/- 0.29, N = 5 SE +/- 0.22, N = 3 SE +/- 0.10, N = 3 20.70 20.83 20.95 20.99 21.44 21.74
Unpacking The Linux Kernel linux-2.6.32.tar.bz2 OpenBenchmarking.org Seconds, Fewer Is Better Unpacking The Linux Kernel linux-2.6.32.tar.bz2 btrfs-cow-barrier-cache ext4-barrier-cache btrfs-nocow-nobarrier-nocache ext4-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache 3 6 9 12 15 SE +/- 0.13, N = 8 SE +/- 0.09, N = 4 SE +/- 0.10, N = 4 SE +/- 0.14, N = 4 SE +/- 0.42, N = 8 SE +/- 0.19, N = 4 10.67 10.71 10.76 10.89 11.15 11.15
Apache Benchmark Static Web Page Serving OpenBenchmarking.org Requests Per Second, More Is Better Apache Benchmark 2.2.17 Static Web Page Serving ext4-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache ext4-nobarrier-nocache btrfs-cow-barrier-cache 3K 6K 9K 12K 15K SE +/- 118.49, N = 3 SE +/- 173.40, N = 3 SE +/- 169.63, N = 5 SE +/- 241.02, N = 3 SE +/- 176.78, N = 6 SE +/- 57.40, N = 3 12471.13 12309.25 12281.33 12148.53 12136.65 11944.80
Threaded I/O Tester 64MB Random Read - 32 Threads OpenBenchmarking.org MB/s, More Is Better Threaded I/O Tester 0.3.3 64MB Random Read - 32 Threads ext4-nobarrier-nocache ext3-barrier-cache btrfs-nocow-nobarrier-nocache btrfs-cow-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache 1400 2800 4200 5600 7000 SE +/- 10.55, N = 4 SE +/- 66.48, N = 4 SE +/- 9.30, N = 4 SE +/- 29.65, N = 4 SE +/- 75.75, N = 4 SE +/- 90.95, N = 4 6531.73 6489.86 6481.51 6464.87 6460.17 6360.62
Gzip Compression 2GB File Compression OpenBenchmarking.org Seconds, Fewer Is Better Gzip Compression 2GB File Compression ext4-barrier-cache btrfs-cow-barrier-cache ext3-barrier-cache ext4-nobarrier-nocache btrfs-nocow-nobarrier-nocache ext3-nobarrier-nocache 4 8 12 16 20 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.06, N = 3 SE +/- 0.26, N = 3 SE +/- 0.24, N = 3 SE +/- 0.20, N = 3 14.31 14.33 14.36 14.52 14.53 14.62
GnuPG 1GB File Encryption OpenBenchmarking.org Seconds, Fewer Is Better GnuPG 1.4.10 1GB File Encryption ext3-barrier-cache btrfs-nocow-nobarrier-nocache ext4-nobarrier-nocache ext4-barrier-cache ext3-nobarrier-nocache btrfs-cow-barrier-cache 4 8 12 16 20 SE +/- 0.01, N = 4 SE +/- 0.02, N = 4 SE +/- 0.06, N = 4 SE +/- 0.04, N = 4 SE +/- 0.09, N = 4 SE +/- 0.08, N = 4 15.84 15.87 15.90 15.91 15.93 15.97
7-Zip Compression Compress Speed Test OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 9.13 Compress Speed Test ext4-nobarrier-nocache ext4-barrier-cache ext3-nobarrier-nocache btrfs-cow-barrier-cache ext3-barrier-cache btrfs-nocow-nobarrier-nocache 2K 4K 6K 8K 10K SE +/- 9.82, N = 3 SE +/- 17.04, N = 3 SE +/- 5.84, N = 3 SE +/- 13.32, N = 3 SE +/- 3.48, N = 3 SE +/- 8.69, N = 3 8085 8076 8076 8045 8041 8032
John The Ripper Test: MD5 OpenBenchmarking.org Real C/S, More Is Better John The Ripper 1.7.3.1 Test: MD5 ext4-nobarrier-nocache btrfs-cow-barrier-cache ext3-barrier-cache ext4-barrier-cache btrfs-nocow-nobarrier-nocache ext3-nobarrier-nocache 3K 6K 9K 12K 15K SE +/- 6.08, N = 3 SE +/- 8.69, N = 3 SE +/- 10.48, N = 3 SE +/- 6.89, N = 3 SE +/- 60.84, N = 3 SE +/- 41.80, N = 3 15283 15278 15273 15255 15232 15189
LZMA Compression 256MB File Compression OpenBenchmarking.org Seconds, Fewer Is Better LZMA Compression 256MB File Compression ext4-barrier-cache ext3-nobarrier-nocache ext4-nobarrier-nocache btrfs-nocow-nobarrier-nocache ext3-barrier-cache btrfs-cow-barrier-cache 40 80 120 160 200 SE +/- 0.40, N = 3 SE +/- 0.04, N = 3 SE +/- 0.23, N = 3 SE +/- 0.21, N = 3 SE +/- 0.34, N = 3 SE +/- 0.66, N = 3 200.99 201.24 201.30 201.47 201.61 201.83
Gcrypt Library CAMELLIA256-ECB Cipher OpenBenchmarking.org Microseconds, Fewer Is Better Gcrypt Library 1.4.4 CAMELLIA256-ECB Cipher btrfs-nocow-nobarrier-nocache ext4-nobarrier-nocache btrfs-cow-barrier-cache ext3-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache 700 1400 2100 2800 3500 SE +/- 3.33, N = 3 SE +/- 3.33, N = 3 SE +/- 0.00, N = 3 SE +/- 3.33, N = 3 SE +/- 3.33, N = 3 SE +/- 6.67, N = 3 3433 3437 3440 3443 3447 3447
John The Ripper Test: Traditional DES OpenBenchmarking.org Real C/S, More Is Better John The Ripper 1.7.3.1 Test: Traditional DES ext4-nobarrier-nocache btrfs-nocow-nobarrier-nocache btrfs-cow-barrier-cache ext3-nobarrier-nocache ext3-barrier-cache ext4-barrier-cache 700K 1400K 2100K 2800K 3500K SE +/- 881.92, N = 3 SE +/- 1452.97, N = 3 SE +/- 2333.33, N = 3 SE +/- 1763.83, N = 3 SE +/- 8185.35, N = 3 SE +/- 1154.70, N = 3 3251333 3250667 3249667 3248667 3246000 3243000
John The Ripper Test: Blowfish OpenBenchmarking.org Real C/S, More Is Better John The Ripper 1.7.3.1 Test: Blowfish ext4-nobarrier-nocache ext3-nobarrier-nocache btrfs-nocow-nobarrier-nocache btrfs-cow-barrier-cache ext4-barrier-cache ext3-barrier-cache 200 400 600 800 1000 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 1.00, N = 3 SE +/- 0.33, N = 3 SE +/- 0.67, N = 3 SE +/- 1.20, N = 3 899 899 898 898 897 897
OpenSSL RSA 4096-bit Performance OpenBenchmarking.org Signs Per Second, More Is Better OpenSSL 1.0.0a RSA 4096-bit Performance ext3-nobarrier-nocache btrfs-nocow-nobarrier-nocache btrfs-cow-barrier-cache ext4-nobarrier-nocache ext3-barrier-cache ext4-barrier-cache 12 24 36 48 60 SE +/- 0.05, N = 4 SE +/- 0.00, N = 4 SE +/- 0.07, N = 4 SE +/- 0.03, N = 4 SE +/- 0.06, N = 4 SE +/- 0.03, N = 4 53.43 53.40 53.40 53.38 53.38 53.35
Dbench 128 Clients OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 128 Clients ext4-nobarrier-nocache btrfs-cow-barrier-cache ext3-nobarrier-nocache ext4-barrier-cache btrfs-nocow-nobarrier-nocache ext3-barrier-cache 40 80 120 160 200 SE +/- 1.83, N = 3 SE +/- 4.84, N = 6 SE +/- 3.75, N = 3 SE +/- 1.05, N = 3 SE +/- 0.54, N = 3 SE +/- 0.67, N = 6 162.69 132.76 80.70 70.14 46.54 13.73
Compile Bench Test: Initial Create OpenBenchmarking.org MB/s, More Is Better Compile Bench 0.6 Test: Initial Create ext4-barrier-cache ext4-nobarrier-nocache ext3-barrier-cache ext3-nobarrier-nocache btrfs-cow-barrier-cache btrfs-nocow-nobarrier-nocache 40 80 120 160 200 SE +/- 5.58, N = 6 SE +/- 4.64, N = 6 SE +/- 11.37, N = 6 SE +/- 3.85, N = 6 SE +/- 3.04, N = 6 SE +/- 1.85, N = 6 200.49 188.43 138.17 134.35 117.60 95.55
Phoronix Test Suite v10.8.4