rbd-xfs-noatime RBD cluster of 3 Optiplex 9020 with 500GB 7200RPM dedicated drive with colocated journal. Ceph 0.80.5. Ubuntu 14.04. Single 1gbit network connection. TrendNET 8port. Test machine Optiplex 780 Intel Core 2 Quad Q9400, 8GB RAM. This run is with XFS on RBD with noatime. Not a fresh boot... rbs-xfs-noatime: Processor: Intel Core 2 Quad Q9400 @ 2.66GHz (4 Cores), Motherboard: Dell 0C27VV, Chipset: Intel 4 DRAM + ICH10DO, Memory: 4 x 2048 MB DDR3-1066MHz, Disk: 320GB Western Digital WD3200AAKS-7, Graphics: NVIDIA GeForce 9300 GE 256MB, Audio: Analog Devices AD1984A, Network: Intel 82567LM-3 Gigabit Connection OS: Ubuntu 14.04, Kernel: 3.13.0-32-generic (x86_64), Compiler: GCC 4.8.2, File-System: xfs, Screen Resolution: 1680x1050 rbd1xfs1: Processor: Intel Core 2 Quad Q9400 @ 2.66GHz (4 Cores), Motherboard: Dell 0C27VV, Chipset: Intel 4 DRAM + ICH10DO, Memory: 4 x 2048 MB DDR3-1066MHz, Disk: 320GB Western Digital WD3200AAKS-7 + 80GB Western Digital WD800JD-75MS, Graphics: NVIDIA GeForce 9300 GE 256MB, Audio: Analog Devices AD1984A, Network: Intel 82567LM-3 Gigabit Connection OS: Ubuntu 14.04, Kernel: 3.13.0-32-generic (x86_64), Compiler: GCC 4.8.2, File-System: xfs, Screen Resolution: 1680x1050 AIO-Stress 0.21 Random Write MB/s > Higher Is Better rbs-xfs-noatime . 1048.44 |==================================================== SQLite 3.7.3 12,500 INSERTs Seconds < Lower Is Better rbs-xfs-noatime . 1398.92 |==================================================== FS-Mark 3.3 1000 Files, 1MB Size Files/s > Higher Is Better rbs-xfs-noatime . 9.90 |======================================================= Dbench 4.0 12 Clients MB/s > Higher Is Better rbs-xfs-noatime . 50.48 |====================================================== Dbench 4.0 48 Clients MB/s > Higher Is Better rbs-xfs-noatime . 79.52 |====================================================== Dbench 4.0 128 Clients MB/s > Higher Is Better rbs-xfs-noatime . 66.54 |====================================================== Dbench 4.0 1 Clients MB/s > Higher Is Better rbs-xfs-noatime . 10.81 |====================================================== IOzone 3.405 8GB Read Performance MB/s > Higher Is Better rbs-xfs-noatime . 89.76 |====================================================== IOzone 3.405 8GB Write Performance MB/s > Higher Is Better rbs-xfs-noatime . 38.83 |====================================================== Threaded I/O Tester 0.3.3 64MB Random Read - 32 Threads MB/s > Higher Is Better rbs-xfs-noatime . 4162.74 |==================================================== Threaded I/O Tester 0.3.3 64MB Random Write - 32 Threads MB/s > Higher Is Better rbs-xfs-noatime . 0.46 |======================================================= Compile Bench 0.6 Test: Compile MB/s > Higher Is Better rbs-xfs-noatime . 111.28 |===================================================== rbd1xfs1 ........ 108.44 |==================================================== Compile Bench 0.6 Test: Initial Create MB/s > Higher Is Better rbs-xfs-noatime . 66.13 |====================================================== rbd1xfs1 ........ 64.20 |==================================================== Compile Bench 0.6 Test: Read Compiled Tree MB/s > Higher Is Better rbs-xfs-noatime . 324.22 |===================================================== rbd1xfs1 ........ 322.88 |===================================================== Unpacking The Linux Kernel linux-2.6.32.tar.bz2 Seconds < Lower Is Better rbs-xfs-noatime . 15.10 |====================================================== rbd1xfs1 ........ 14.69 |===================================================== PostMark 1.51 Disk Transaction Performance TPS > Higher Is Better rbs-xfs-noatime . 2191 |====================================================== rbd1xfs1 ........ 2219 |======================================================= Gzip Compression 2GB File Compression Seconds < Lower Is Better rbs-xfs-noatime . 19.49 |====================================================== Apache Benchmark 2.4.7 Static Web Page Serving Requests Per Second > Higher Is Better rbs-xfs-noatime . 12704.83 |=================================================== AIO-Stress 0.21 Test: Random Write MB/s > Higher Is Better rbd1xfs1 . 1063.78 |=========================================================== Flexible IO Tester 2.1.11 Test: Intel IOMeter File Server Access Pattern - Disk Target: Default Test Directory Seconds (Run Time) < Lower Is Better rbd1xfs1 . 4560.24 |=========================================================== FS-Mark 3.3 Test: 1000 Files, 1MB Size Files/s > Higher Is Better rbd1xfs1 . 9.57 |============================================================== FS-Mark 3.3 Test: 5000 Files, 1MB Size, 4 Threads Files/s > Higher Is Better rbd1xfs1 . 13.97 |============================================================= FS-Mark 3.3 Test: 4000 Files, 32 Sub Dirs, 1MB Size Files/s > Higher Is Better rbd1xfs1 . 8.47 |============================================================== FS-Mark 3.3 Test: 1000 Files, 1MB Size, No Sync/FSync Files/s > Higher Is Better rbd1xfs1 . 1086.93 |=========================================================== Dbench 4.0 Client Count: 1 MB/s > Higher Is Better rbd1xfs1 . 10.98 |============================================================= Dbench 4.0 Client Count: 6 MB/s > Higher Is Better rbd1xfs1 . 38.41 |============================================================= Dbench 4.0 Client Count: 128 MB/s > Higher Is Better rbd1xfs1 . 65.61 |============================================================= IOzone 3.405 Record Size: 1MB - File Size: 4GB - Disk Test: Read Performance MB/s > Higher Is Better rbd1xfs1 . 5217.68 |=========================================================== IOzone 3.405 Record Size: 4Kb - File Size: 4GB - Disk Test: Read Performance MB/s > Higher Is Better rbd1xfs1 . 2460.20 |=========================================================== IOzone 3.405 Record Size: 1MB - File Size: 4GB - Disk Test: Write Performance MB/s > Higher Is Better rbd1xfs1 . 34.22 |============================================================= IOzone 3.405 Record Size: 4Kb - File Size: 4GB - Disk Test: Write Performance MB/s > Higher Is Better rbd1xfs1 . 35.86 |============================================================= IOzone 3.405 Record Size: 64Kb - File Size: 4GB - Disk Test: Read Performance MB/s > Higher Is Better rbd1xfs1 . 4970.56 |=========================================================== IOzone 3.405 Record Size: 1MB - File Size: 512MB - Disk Test: Read Performance MB/s > Higher Is Better rbd1xfs1 . 4973.67 |=========================================================== IOzone 3.405 Record Size: 4Kb - File Size: 512MB - Disk Test: Read Performance MB/s > Higher Is Better rbd1xfs1 . 2452.25 |=========================================================== IOzone 3.405 Record Size: 64Kb - File Size: 4GB - Disk Test: Write Performance MB/s > Higher Is Better rbd1xfs1 . 35.23 |============================================================= IOzone 3.405 Record Size: 1MB - File Size: 512MB - Disk Test: Write Performance MB/s > Higher Is Better rbd1xfs1 . 42.58 |============================================================= IOzone 3.405 Record Size: 4Kb - File Size: 512MB - Disk Test: Write Performance MB/s > Higher Is Better rbd1xfs1 . 37.24 |============================================================= IOzone 3.405 Record Size: 64Kb - File Size: 512MB - Disk Test: Read Performance MB/s > Higher Is Better rbd1xfs1 . 4873.67 |=========================================================== IOzone 3.405 Record Size: 64Kb - File Size: 512MB - Disk Test: Write Performance MB/s > Higher Is Better rbd1xfs1 . 37.77 |============================================================= Threaded I/O Tester 0.3.3 Test: Random Write - Size Per Thread: 32MB - Thread Count: 4 MB/s > Higher Is Better rbd1xfs1 . 0.27 |============================================================== Threaded I/O Tester 0.3.3 Test: Random Write - Size Per Thread: 128MB - Thread Count: 16 MB/s > Higher Is Better rbd1xfs1 . 0.39 |==============================================================