rbd-xfs-noatime RBD cluster of 3 Optiplex 9020 with 500GB 7200RPM dedicated drive with colocated journal. Ceph 0.80.5. Ubuntu 14.04. Single 1gbit network connection. TrendNET 8port. Test machine Optiplex 780 Intel Core 2 Quad Q9400, 8GB RAM. This run is with XFS on RBD with noatime. Not a fresh boot...
HTML result view exported from: https://openbenchmarking.org/result/1408095-COLO-RBD1XFS68&rdt&grs .
rbd-xfs-noatime Processor Motherboard Chipset Memory Disk Graphics Audio Network OS Kernel Compiler File-System Screen Resolution rbs-xfs-noatime rbd1xfs1 Intel Core 2 Quad Q9400 @ 2.66GHz (4 Cores) Dell 0C27VV Intel 4 DRAM + ICH10DO 4 x 2048 MB DDR3-1066MHz 320GB Western Digital WD3200AAKS-7 NVIDIA GeForce 9300 GE 256MB Analog Devices AD1984A Intel 82567LM-3 Gigabit Connection Ubuntu 14.04 3.13.0-32-generic (x86_64) GCC 4.8.2 xfs 1680x1050 320GB Western Digital WD3200AAKS-7 + 80GB Western Digital WD800JD-75MS OpenBenchmarking.org Compiler Details - --build=x86_64-linux-gnu --disable-browser-plugin --disable-libmudflap --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v Disk Details - DEADLINE / data=ordered,errors=remount-ro,relatime,rw System Details - Disk Scheduler: DEADLINE. Python 2.7.6.
rbd-xfs-noatime compilebench: Initial Create postmark: Disk Transaction Performance compilebench: Read Compiled Tree tiobench: Rand Write - 128MB - 16 iozone: 64Kb - 512MB - Read Performance iozone: 1MB - 512MB - Write Performance iozone: 64Kb - 4GB - Write Performance iozone: 4Kb - 512MB - Read Performance iozone: 1MB - 512MB - Read Performance iozone: 64Kb - 4GB - Read Performance iozone: 4Kb - 4GB - Write Performance iozone: 4Kb - 4GB - Read Performance iozone: 1MB - 4GB - Read Performance dbench: 128 dbench: 6 fs-mark: 1000 Files, 1MB Size, No Sync/FSync fs-mark: 4000 Files, 32 Sub Dirs, 1MB Size fs-mark: 5000 Files, 1MB Size, 4 Threads fs-mark: 1000 Files, 1MB Size fio: Intel IOMeter File Server Access Pattern - Default Test Directory aio-stress: Rand Write apache: Static Web Page Serving compress-gzip: 2GB File Compression tiobench: 64MB Rand Write - 32 Threads tiobench: 64MB Rand Read - 32 Threads iozone: 8GB Write Performance iozone: 8GB Read Performance dbench: 48 Clients dbench: 12 Clients fs-mark: 1000 Files, 1MB Size sqlite: 12,500 INSERTs aio-stress: Rand Write tiobench: Rand Write - 32MB - 4 iozone: 64Kb - 512MB - Write Performance iozone: 4Kb - 512MB - Write Performance iozone: 1MB - 4GB - Write Performance dbench: 1 unpack-linux: linux-2.6.32.tar.bz2 compilebench: Compile dbench: 1 Clients dbench: 128 Clients rbs-xfs-noatime rbd1xfs1 66.13 2191 324.22 12704.83 19.49 0.46 4162.74 38.83 89.76 79.52 50.48 9.90 1398.92 1048.44 15.10 111.28 10.81 66.54 64.20 2219 322.88 0.39 4873.67 42.58 35.23 2452.25 4973.67 4970.56 35.86 2460.20 5217.68 65.61 38.41 1086.93 8.47 13.97 9.57 4560.24 1063.78 0.27 37.77 37.24 34.22 10.98 14.69 108.44 OpenBenchmarking.org
Compile Bench Test: Initial Create OpenBenchmarking.org MB/s, More Is Better Compile Bench 0.6 Test: Initial Create rbs-xfs-noatime rbd1xfs1 15 30 45 60 75 SE +/- 0.73, N = 3 SE +/- 0.45, N = 3 66.13 64.20
PostMark Disk Transaction Performance OpenBenchmarking.org TPS, More Is Better PostMark 1.51 Disk Transaction Performance rbs-xfs-noatime rbd1xfs1 500 1000 1500 2000 2500 SE +/- 42.39, N = 6 SE +/- 41.78, N = 6 2191 2219 1. (CC) gcc options: -O3
Compile Bench Test: Read Compiled Tree OpenBenchmarking.org MB/s, More Is Better Compile Bench 0.6 Test: Read Compiled Tree rbs-xfs-noatime rbd1xfs1 70 140 210 280 350 SE +/- 2.17, N = 3 SE +/- 1.05, N = 3 324.22 322.88
Threaded I/O Tester Test: Random Write - Size Per Thread: 128MB - Thread Count: 16 OpenBenchmarking.org MB/s, More Is Better Threaded I/O Tester 0.3.3 Test: Random Write - Size Per Thread: 128MB - Thread Count: 16 rbd1xfs1 0.0878 0.1756 0.2634 0.3512 0.439 SE +/- 0.01, N = 3 0.39
IOzone Record Size: 64Kb - File Size: 512MB - Disk Test: Read Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.405 Record Size: 64Kb - File Size: 512MB - Disk Test: Read Performance rbd1xfs1 1000 2000 3000 4000 5000 SE +/- 5.56, N = 3 4873.67 1. (CC) gcc options: -O3
IOzone Record Size: 1MB - File Size: 512MB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.405 Record Size: 1MB - File Size: 512MB - Disk Test: Write Performance rbd1xfs1 10 20 30 40 50 SE +/- 0.76, N = 3 42.58 1. (CC) gcc options: -O3
IOzone Record Size: 64Kb - File Size: 4GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.405 Record Size: 64Kb - File Size: 4GB - Disk Test: Write Performance rbd1xfs1 8 16 24 32 40 SE +/- 0.20, N = 3 35.23 1. (CC) gcc options: -O3
IOzone Record Size: 4Kb - File Size: 512MB - Disk Test: Read Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.405 Record Size: 4Kb - File Size: 512MB - Disk Test: Read Performance rbd1xfs1 500 1000 1500 2000 2500 SE +/- 4.41, N = 3 2452.25 1. (CC) gcc options: -O3
IOzone Record Size: 1MB - File Size: 512MB - Disk Test: Read Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.405 Record Size: 1MB - File Size: 512MB - Disk Test: Read Performance rbd1xfs1 1100 2200 3300 4400 5500 SE +/- 5.42, N = 3 4973.67 1. (CC) gcc options: -O3
IOzone Record Size: 64Kb - File Size: 4GB - Disk Test: Read Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.405 Record Size: 64Kb - File Size: 4GB - Disk Test: Read Performance rbd1xfs1 1100 2200 3300 4400 5500 SE +/- 12.20, N = 3 4970.56 1. (CC) gcc options: -O3
IOzone Record Size: 4Kb - File Size: 4GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.405 Record Size: 4Kb - File Size: 4GB - Disk Test: Write Performance rbd1xfs1 8 16 24 32 40 SE +/- 0.48, N = 3 35.86 1. (CC) gcc options: -O3
IOzone Record Size: 4Kb - File Size: 4GB - Disk Test: Read Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.405 Record Size: 4Kb - File Size: 4GB - Disk Test: Read Performance rbd1xfs1 500 1000 1500 2000 2500 SE +/- 3.66, N = 3 2460.20 1. (CC) gcc options: -O3
IOzone Record Size: 1MB - File Size: 4GB - Disk Test: Read Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.405 Record Size: 1MB - File Size: 4GB - Disk Test: Read Performance rbd1xfs1 1100 2200 3300 4400 5500 SE +/- 16.29, N = 3 5217.68 1. (CC) gcc options: -O3
Dbench Client Count: 128 OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 Client Count: 128 rbd1xfs1 15 30 45 60 75 SE +/- 0.73, N = 3 65.61 1. (CC) gcc options: -lpopt -O2
Dbench Client Count: 6 OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 Client Count: 6 rbd1xfs1 9 18 27 36 45 SE +/- 0.20, N = 3 38.41 1. (CC) gcc options: -lpopt -O2
FS-Mark Test: 1000 Files, 1MB Size, No Sync/FSync OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 1000 Files, 1MB Size, No Sync/FSync rbd1xfs1 200 400 600 800 1000 SE +/- 3.20, N = 3 1086.93 1. (CC) gcc options: -static
FS-Mark Test: 4000 Files, 32 Sub Dirs, 1MB Size OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 4000 Files, 32 Sub Dirs, 1MB Size rbd1xfs1 2 4 6 8 10 SE +/- 0.13, N = 3 8.47 1. (CC) gcc options: -static
FS-Mark Test: 5000 Files, 1MB Size, 4 Threads OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 5000 Files, 1MB Size, 4 Threads rbd1xfs1 4 8 12 16 20 SE +/- 0.19, N = 3 13.97 1. (CC) gcc options: -static
FS-Mark Test: 1000 Files, 1MB Size OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 1000 Files, 1MB Size rbd1xfs1 3 6 9 12 15 SE +/- 0.17, N = 3 9.57 1. (CC) gcc options: -static
Flexible IO Tester Test: Intel IOMeter File Server Access Pattern - Disk Target: Default Test Directory OpenBenchmarking.org Seconds (Run Time), Fewer Is Better Flexible IO Tester 2.1.11 Test: Intel IOMeter File Server Access Pattern - Disk Target: Default Test Directory rbd1xfs1 1000 2000 3000 4000 5000 SE +/- 51.71, N = 3 4560.24 1. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl
AIO-Stress Test: Random Write OpenBenchmarking.org MB/s, More Is Better AIO-Stress 0.21 Test: Random Write rbd1xfs1 200 400 600 800 1000 SE +/- 3.16, N = 3 1063.78 1. (CC) gcc options: -pthread -laio
Apache Benchmark Static Web Page Serving OpenBenchmarking.org Requests Per Second, More Is Better Apache Benchmark 2.4.7 Static Web Page Serving rbs-xfs-noatime 3K 6K 9K 12K 15K SE +/- 21.28, N = 3 12704.83 1. (CC) gcc options: -shared -fPIC -O2 -pthread
Gzip Compression 2GB File Compression OpenBenchmarking.org Seconds, Fewer Is Better Gzip Compression 2GB File Compression rbs-xfs-noatime 5 10 15 20 25 SE +/- 0.07, N = 3 19.49
Threaded I/O Tester 64MB Random Write - 32 Threads OpenBenchmarking.org MB/s, More Is Better Threaded I/O Tester 0.3.3 64MB Random Write - 32 Threads rbs-xfs-noatime 0.1035 0.207 0.3105 0.414 0.5175 SE +/- 0.01, N = 3 0.46
Threaded I/O Tester 64MB Random Read - 32 Threads OpenBenchmarking.org MB/s, More Is Better Threaded I/O Tester 0.3.3 64MB Random Read - 32 Threads rbs-xfs-noatime 900 1800 2700 3600 4500 SE +/- 1.88, N = 3 4162.74
IOzone 8GB Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.405 8GB Write Performance rbs-xfs-noatime 9 18 27 36 45 SE +/- 0.75, N = 3 38.83 1. (CC) gcc options: -O3
IOzone 8GB Read Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.405 8GB Read Performance rbs-xfs-noatime 20 40 60 80 100 SE +/- 1.24, N = 3 89.76 1. (CC) gcc options: -O3
Dbench 48 Clients OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 48 Clients rbs-xfs-noatime 20 40 60 80 100 SE +/- 1.49, N = 3 79.52 1. (CC) gcc options: -lpopt -O2
Dbench 12 Clients OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 12 Clients rbs-xfs-noatime 11 22 33 44 55 SE +/- 0.94, N = 6 50.48 1. (CC) gcc options: -lpopt -O2
FS-Mark 1000 Files, 1MB Size OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 1000 Files, 1MB Size rbs-xfs-noatime 3 6 9 12 15 SE +/- 0.15, N = 3 9.90 1. (CC) gcc options: -static
SQLite 12,500 INSERTs OpenBenchmarking.org Seconds, Fewer Is Better SQLite 3.7.3 12,500 INSERTs rbs-xfs-noatime 300 600 900 1200 1500 SE +/- 39.40, N = 3 1398.92 1. (CC) gcc options: -O2 -ldl -lpthread
AIO-Stress Random Write OpenBenchmarking.org MB/s, More Is Better AIO-Stress 0.21 Random Write rbs-xfs-noatime 200 400 600 800 1000 SE +/- 10.56, N = 3 1048.44 1. (CC) gcc options: -pthread -laio
Threaded I/O Tester Test: Random Write - Size Per Thread: 32MB - Thread Count: 4 OpenBenchmarking.org MB/s, More Is Better Threaded I/O Tester 0.3.3 Test: Random Write - Size Per Thread: 32MB - Thread Count: 4 rbd1xfs1 0.0608 0.1216 0.1824 0.2432 0.304 SE +/- 0.01, N = 6 0.27
IOzone Record Size: 64Kb - File Size: 512MB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.405 Record Size: 64Kb - File Size: 512MB - Disk Test: Write Performance rbd1xfs1 9 18 27 36 45 SE +/- 1.22, N = 6 37.77 1. (CC) gcc options: -O3
IOzone Record Size: 4Kb - File Size: 512MB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.405 Record Size: 4Kb - File Size: 512MB - Disk Test: Write Performance rbd1xfs1 9 18 27 36 45 SE +/- 3.41, N = 6 37.24 1. (CC) gcc options: -O3
IOzone Record Size: 1MB - File Size: 4GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.405 Record Size: 1MB - File Size: 4GB - Disk Test: Write Performance rbd1xfs1 8 16 24 32 40 SE +/- 1.56, N = 6 34.22 1. (CC) gcc options: -O3
Dbench Client Count: 1 OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 Client Count: 1 rbd1xfs1 3 6 9 12 15 SE +/- 0.30, N = 6 10.98 1. (CC) gcc options: -lpopt -O2
Unpacking The Linux Kernel linux-2.6.32.tar.bz2 OpenBenchmarking.org Seconds, Fewer Is Better Unpacking The Linux Kernel linux-2.6.32.tar.bz2 rbs-xfs-noatime rbd1xfs1 4 8 12 16 20 SE +/- 0.61, N = 8 SE +/- 0.68, N = 8 15.10 14.69
Compile Bench Test: Compile OpenBenchmarking.org MB/s, More Is Better Compile Bench 0.6 Test: Compile rbs-xfs-noatime rbd1xfs1 20 40 60 80 100 SE +/- 0.37, N = 3 SE +/- 5.08, N = 6 111.28 108.44
Dbench 1 Clients OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 1 Clients rbs-xfs-noatime 3 6 9 12 15 SE +/- 0.37, N = 6 10.81 1. (CC) gcc options: -lpopt -O2
Dbench 128 Clients OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 128 Clients rbs-xfs-noatime 15 30 45 60 75 SE +/- 2.13, N = 6 66.54 1. (CC) gcc options: -lpopt -O2
Phoronix Test Suite v10.8.5