rbd-xfs-noatime RBD cluster of 3 Optiplex 9020 with 500GB 7200RPM dedicated drive with colocated journal. Ceph 0.80.5. Ubuntu 14.04. Single 1gbit network connection. TrendNET 8port. Test machine Optiplex 780 Intel Core 2 Quad Q9400, 8GB RAM. This run is with XFS on RBD with noatime. Not a fresh boot...
HTML result view exported from: https://openbenchmarking.org/result/1408095-COLO-RBD1XFS68 .
rbd-xfs-noatime Processor Motherboard Chipset Memory Disk Graphics Audio Network OS Kernel Compiler File-System Screen Resolution rbs-xfs-noatime rbd1xfs1 Intel Core 2 Quad Q9400 @ 2.66GHz (4 Cores) Dell 0C27VV Intel 4 DRAM + ICH10DO 4 x 2048 MB DDR3-1066MHz 320GB Western Digital WD3200AAKS-7 NVIDIA GeForce 9300 GE 256MB Analog Devices AD1984A Intel 82567LM-3 Gigabit Connection Ubuntu 14.04 3.13.0-32-generic (x86_64) GCC 4.8.2 xfs 1680x1050 320GB Western Digital WD3200AAKS-7 + 80GB Western Digital WD800JD-75MS OpenBenchmarking.org Compiler Details - --build=x86_64-linux-gnu --disable-browser-plugin --disable-libmudflap --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-multilib-list=m32,m64,mx32 --with-tune=generic -v Disk Details - DEADLINE / data=ordered,errors=remount-ro,relatime,rw System Details - Disk Scheduler: DEADLINE. Python 2.7.6.
rbd-xfs-noatime aio-stress: Rand Write sqlite: 12,500 INSERTs fs-mark: 1000 Files, 1MB Size dbench: 12 Clients dbench: 48 Clients dbench: 128 Clients dbench: 1 Clients iozone: 8GB Read Performance iozone: 8GB Write Performance tiobench: 64MB Rand Read - 32 Threads tiobench: 64MB Rand Write - 32 Threads compilebench: Compile compilebench: Initial Create compilebench: Read Compiled Tree unpack-linux: linux-2.6.32.tar.bz2 postmark: Disk Transaction Performance compress-gzip: 2GB File Compression apache: Static Web Page Serving aio-stress: Rand Write fio: Intel IOMeter File Server Access Pattern - Default Test Directory fs-mark: 1000 Files, 1MB Size fs-mark: 5000 Files, 1MB Size, 4 Threads fs-mark: 4000 Files, 32 Sub Dirs, 1MB Size fs-mark: 1000 Files, 1MB Size, No Sync/FSync dbench: 1 dbench: 6 dbench: 128 iozone: 1MB - 4GB - Read Performance iozone: 4Kb - 4GB - Read Performance iozone: 1MB - 4GB - Write Performance iozone: 4Kb - 4GB - Write Performance iozone: 64Kb - 4GB - Read Performance iozone: 1MB - 512MB - Read Performance iozone: 4Kb - 512MB - Read Performance iozone: 64Kb - 4GB - Write Performance iozone: 1MB - 512MB - Write Performance iozone: 4Kb - 512MB - Write Performance iozone: 64Kb - 512MB - Read Performance iozone: 64Kb - 512MB - Write Performance tiobench: Rand Write - 32MB - 4 tiobench: Rand Write - 128MB - 16 rbs-xfs-noatime rbd1xfs1 1048.44 1398.92 9.90 50.48 79.52 66.54 10.81 89.76 38.83 4162.74 0.46 111.28 66.13 324.22 15.10 2191 19.49 12704.83 108.44 64.20 322.88 14.69 2219 1063.78 4560.24 9.57 13.97 8.47 1086.93 10.98 38.41 65.61 5217.68 2460.20 34.22 35.86 4970.56 4973.67 2452.25 35.23 42.58 37.24 4873.67 37.77 0.27 0.39 OpenBenchmarking.org
AIO-Stress Random Write OpenBenchmarking.org MB/s, More Is Better AIO-Stress 0.21 Random Write rbs-xfs-noatime 200 400 600 800 1000 SE +/- 10.56, N = 3 1048.44 1. (CC) gcc options: -pthread -laio
SQLite 12,500 INSERTs OpenBenchmarking.org Seconds, Fewer Is Better SQLite 3.7.3 12,500 INSERTs rbs-xfs-noatime 300 600 900 1200 1500 SE +/- 39.40, N = 3 1398.92 1. (CC) gcc options: -O2 -ldl -lpthread
FS-Mark 1000 Files, 1MB Size OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 1000 Files, 1MB Size rbs-xfs-noatime 3 6 9 12 15 SE +/- 0.15, N = 3 9.90 1. (CC) gcc options: -static
Dbench 12 Clients OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 12 Clients rbs-xfs-noatime 11 22 33 44 55 SE +/- 0.94, N = 6 50.48 1. (CC) gcc options: -lpopt -O2
Dbench 48 Clients OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 48 Clients rbs-xfs-noatime 20 40 60 80 100 SE +/- 1.49, N = 3 79.52 1. (CC) gcc options: -lpopt -O2
Dbench 128 Clients OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 128 Clients rbs-xfs-noatime 15 30 45 60 75 SE +/- 2.13, N = 6 66.54 1. (CC) gcc options: -lpopt -O2
Dbench 1 Clients OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 1 Clients rbs-xfs-noatime 3 6 9 12 15 SE +/- 0.37, N = 6 10.81 1. (CC) gcc options: -lpopt -O2
IOzone 8GB Read Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.405 8GB Read Performance rbs-xfs-noatime 20 40 60 80 100 SE +/- 1.24, N = 3 89.76 1. (CC) gcc options: -O3
IOzone 8GB Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.405 8GB Write Performance rbs-xfs-noatime 9 18 27 36 45 SE +/- 0.75, N = 3 38.83 1. (CC) gcc options: -O3
Threaded I/O Tester 64MB Random Read - 32 Threads OpenBenchmarking.org MB/s, More Is Better Threaded I/O Tester 0.3.3 64MB Random Read - 32 Threads rbs-xfs-noatime 900 1800 2700 3600 4500 SE +/- 1.88, N = 3 4162.74
Threaded I/O Tester 64MB Random Write - 32 Threads OpenBenchmarking.org MB/s, More Is Better Threaded I/O Tester 0.3.3 64MB Random Write - 32 Threads rbs-xfs-noatime 0.1035 0.207 0.3105 0.414 0.5175 SE +/- 0.01, N = 3 0.46
Compile Bench Test: Compile OpenBenchmarking.org MB/s, More Is Better Compile Bench 0.6 Test: Compile rbs-xfs-noatime rbd1xfs1 20 40 60 80 100 SE +/- 0.37, N = 3 SE +/- 5.08, N = 6 111.28 108.44
Compile Bench Test: Initial Create OpenBenchmarking.org MB/s, More Is Better Compile Bench 0.6 Test: Initial Create rbs-xfs-noatime rbd1xfs1 15 30 45 60 75 SE +/- 0.73, N = 3 SE +/- 0.45, N = 3 66.13 64.20
Compile Bench Test: Read Compiled Tree OpenBenchmarking.org MB/s, More Is Better Compile Bench 0.6 Test: Read Compiled Tree rbs-xfs-noatime rbd1xfs1 70 140 210 280 350 SE +/- 2.17, N = 3 SE +/- 1.05, N = 3 324.22 322.88
Unpacking The Linux Kernel linux-2.6.32.tar.bz2 OpenBenchmarking.org Seconds, Fewer Is Better Unpacking The Linux Kernel linux-2.6.32.tar.bz2 rbs-xfs-noatime rbd1xfs1 4 8 12 16 20 SE +/- 0.61, N = 8 SE +/- 0.68, N = 8 15.10 14.69
PostMark Disk Transaction Performance OpenBenchmarking.org TPS, More Is Better PostMark 1.51 Disk Transaction Performance rbs-xfs-noatime rbd1xfs1 500 1000 1500 2000 2500 SE +/- 42.39, N = 6 SE +/- 41.78, N = 6 2191 2219 1. (CC) gcc options: -O3
Gzip Compression 2GB File Compression OpenBenchmarking.org Seconds, Fewer Is Better Gzip Compression 2GB File Compression rbs-xfs-noatime 5 10 15 20 25 SE +/- 0.07, N = 3 19.49
Apache Benchmark Static Web Page Serving OpenBenchmarking.org Requests Per Second, More Is Better Apache Benchmark 2.4.7 Static Web Page Serving rbs-xfs-noatime 3K 6K 9K 12K 15K SE +/- 21.28, N = 3 12704.83 1. (CC) gcc options: -shared -fPIC -O2 -pthread
AIO-Stress Test: Random Write OpenBenchmarking.org MB/s, More Is Better AIO-Stress 0.21 Test: Random Write rbd1xfs1 200 400 600 800 1000 SE +/- 3.16, N = 3 1063.78 1. (CC) gcc options: -pthread -laio
Flexible IO Tester Test: Intel IOMeter File Server Access Pattern - Disk Target: Default Test Directory OpenBenchmarking.org Seconds (Run Time), Fewer Is Better Flexible IO Tester 2.1.11 Test: Intel IOMeter File Server Access Pattern - Disk Target: Default Test Directory rbd1xfs1 1000 2000 3000 4000 5000 SE +/- 51.71, N = 3 4560.24 1. (CC) gcc options: -rdynamic -std=gnu99 -O3 -ffast-math -include -lrt -laio -lm -lpthread -ldl
FS-Mark Test: 1000 Files, 1MB Size OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 1000 Files, 1MB Size rbd1xfs1 3 6 9 12 15 SE +/- 0.17, N = 3 9.57 1. (CC) gcc options: -static
FS-Mark Test: 5000 Files, 1MB Size, 4 Threads OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 5000 Files, 1MB Size, 4 Threads rbd1xfs1 4 8 12 16 20 SE +/- 0.19, N = 3 13.97 1. (CC) gcc options: -static
FS-Mark Test: 4000 Files, 32 Sub Dirs, 1MB Size OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 4000 Files, 32 Sub Dirs, 1MB Size rbd1xfs1 2 4 6 8 10 SE +/- 0.13, N = 3 8.47 1. (CC) gcc options: -static
FS-Mark Test: 1000 Files, 1MB Size, No Sync/FSync OpenBenchmarking.org Files/s, More Is Better FS-Mark 3.3 Test: 1000 Files, 1MB Size, No Sync/FSync rbd1xfs1 200 400 600 800 1000 SE +/- 3.20, N = 3 1086.93 1. (CC) gcc options: -static
Dbench Client Count: 1 OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 Client Count: 1 rbd1xfs1 3 6 9 12 15 SE +/- 0.30, N = 6 10.98 1. (CC) gcc options: -lpopt -O2
Dbench Client Count: 6 OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 Client Count: 6 rbd1xfs1 9 18 27 36 45 SE +/- 0.20, N = 3 38.41 1. (CC) gcc options: -lpopt -O2
Dbench Client Count: 128 OpenBenchmarking.org MB/s, More Is Better Dbench 4.0 Client Count: 128 rbd1xfs1 15 30 45 60 75 SE +/- 0.73, N = 3 65.61 1. (CC) gcc options: -lpopt -O2
IOzone Record Size: 1MB - File Size: 4GB - Disk Test: Read Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.405 Record Size: 1MB - File Size: 4GB - Disk Test: Read Performance rbd1xfs1 1100 2200 3300 4400 5500 SE +/- 16.29, N = 3 5217.68 1. (CC) gcc options: -O3
IOzone Record Size: 4Kb - File Size: 4GB - Disk Test: Read Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.405 Record Size: 4Kb - File Size: 4GB - Disk Test: Read Performance rbd1xfs1 500 1000 1500 2000 2500 SE +/- 3.66, N = 3 2460.20 1. (CC) gcc options: -O3
IOzone Record Size: 1MB - File Size: 4GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.405 Record Size: 1MB - File Size: 4GB - Disk Test: Write Performance rbd1xfs1 8 16 24 32 40 SE +/- 1.56, N = 6 34.22 1. (CC) gcc options: -O3
IOzone Record Size: 4Kb - File Size: 4GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.405 Record Size: 4Kb - File Size: 4GB - Disk Test: Write Performance rbd1xfs1 8 16 24 32 40 SE +/- 0.48, N = 3 35.86 1. (CC) gcc options: -O3
IOzone Record Size: 64Kb - File Size: 4GB - Disk Test: Read Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.405 Record Size: 64Kb - File Size: 4GB - Disk Test: Read Performance rbd1xfs1 1100 2200 3300 4400 5500 SE +/- 12.20, N = 3 4970.56 1. (CC) gcc options: -O3
IOzone Record Size: 1MB - File Size: 512MB - Disk Test: Read Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.405 Record Size: 1MB - File Size: 512MB - Disk Test: Read Performance rbd1xfs1 1100 2200 3300 4400 5500 SE +/- 5.42, N = 3 4973.67 1. (CC) gcc options: -O3
IOzone Record Size: 4Kb - File Size: 512MB - Disk Test: Read Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.405 Record Size: 4Kb - File Size: 512MB - Disk Test: Read Performance rbd1xfs1 500 1000 1500 2000 2500 SE +/- 4.41, N = 3 2452.25 1. (CC) gcc options: -O3
IOzone Record Size: 64Kb - File Size: 4GB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.405 Record Size: 64Kb - File Size: 4GB - Disk Test: Write Performance rbd1xfs1 8 16 24 32 40 SE +/- 0.20, N = 3 35.23 1. (CC) gcc options: -O3
IOzone Record Size: 1MB - File Size: 512MB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.405 Record Size: 1MB - File Size: 512MB - Disk Test: Write Performance rbd1xfs1 10 20 30 40 50 SE +/- 0.76, N = 3 42.58 1. (CC) gcc options: -O3
IOzone Record Size: 4Kb - File Size: 512MB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.405 Record Size: 4Kb - File Size: 512MB - Disk Test: Write Performance rbd1xfs1 9 18 27 36 45 SE +/- 3.41, N = 6 37.24 1. (CC) gcc options: -O3
IOzone Record Size: 64Kb - File Size: 512MB - Disk Test: Read Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.405 Record Size: 64Kb - File Size: 512MB - Disk Test: Read Performance rbd1xfs1 1000 2000 3000 4000 5000 SE +/- 5.56, N = 3 4873.67 1. (CC) gcc options: -O3
IOzone Record Size: 64Kb - File Size: 512MB - Disk Test: Write Performance OpenBenchmarking.org MB/s, More Is Better IOzone 3.405 Record Size: 64Kb - File Size: 512MB - Disk Test: Write Performance rbd1xfs1 9 18 27 36 45 SE +/- 1.22, N = 6 37.77 1. (CC) gcc options: -O3
Threaded I/O Tester Test: Random Write - Size Per Thread: 32MB - Thread Count: 4 OpenBenchmarking.org MB/s, More Is Better Threaded I/O Tester 0.3.3 Test: Random Write - Size Per Thread: 32MB - Thread Count: 4 rbd1xfs1 0.0608 0.1216 0.1824 0.2432 0.304 SE +/- 0.01, N = 6 0.27
Threaded I/O Tester Test: Random Write - Size Per Thread: 128MB - Thread Count: 16 OpenBenchmarking.org MB/s, More Is Better Threaded I/O Tester 0.3.3 Test: Random Write - Size Per Thread: 128MB - Thread Count: 16 rbd1xfs1 0.0878 0.1756 0.2634 0.3512 0.439 SE +/- 0.01, N = 3 0.39
Phoronix Test Suite v10.8.4