Ceph RBD 512G Testing of the RBD with 512, this use bigger pg and more replice Baisc rbd testing: Processor: 2 x Intel Xeon E5-2660 0 @ 2.20GHz (32 Cores), Motherboard: Supermicro X9DRT v1.21, Chipset: Intel Sandy Bridge DMI2, Memory: 8 x 16384 MB DDR3-1333MHz Samsung, Disk: 4 x 600GB Western Digital WD6000HLHX-0, Graphics: Matrox MGA G200eW WPCM450, Network: Intel I350 Gigabit Connection OS: Ubuntu 12.04, Kernel: 3.5.0-27-generic (x86_64), Compiler: GCC 4.6, File-System: ext4, Screen Resolution: 640x480 Western Digital WD6000HLHX-0: Processor: 2 x Intel Xeon E5-2660 0 @ 2.20GHz (32 Cores), Motherboard: Supermicro X9DRT v1.21, Chipset: Intel Sandy Bridge DMI2, Memory: 8 x 16384 MB DDR3-1333MHz Samsung, Disk: 4 x 600GB Western Digital WD6000HLHX-0, Graphics: Matrox MGA G200eW WPCM450, Network: Intel I350 Gigabit Connection OS: Ubuntu 12.04, Kernel: 3.5.0-27-generic (x86_64), Compiler: GCC 4.6, File-System: ext4, Screen Resolution: 640x480 Flexible IO Tester 1.57 Test: Example Network Job Seconds (Run Time) < Lower Is Better Baisc rbd testing . 11.71 |==================================================== Flexible IO Tester 1.57 Test: Intel IOMeter File Server Access Pattern Seconds (Run Time) < Lower Is Better Baisc rbd testing . 738.70 |=================================================== BlogBench 1.0 Test: Read Final Score > Higher Is Better Western Digital WD6000HLHX-0 . 1154097 |======================================= Unpacking The Linux Kernel linux-2.6.32.tar.bz2 Seconds < Lower Is Better Western Digital WD6000HLHX-0 . 12.81 |========================================= Threaded I/O Tester 0.3.3 Test: Read - Size Per Thread: 32MB - Thread Count: 4 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 17491.23 |====================================== Western Digital WD6000HLHX-0 . 16684.71 |==================================== Threaded I/O Tester 0.3.3 Test: Read - Size Per Thread: 32MB - Thread Count: 8 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 30031.04 |====================================== Western Digital WD6000HLHX-0 . 25268.43 |================================ Threaded I/O Tester 0.3.3 Test: Read - Size Per Thread: 64MB - Thread Count: 4 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 16438.43 |====================================== Western Digital WD6000HLHX-0 . 16422.19 |====================================== Threaded I/O Tester 0.3.3 Test: Read - Size Per Thread: 64MB - Thread Count: 8 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 31528.43 |====================================== Western Digital WD6000HLHX-0 . 27701.78 |================================= Threaded I/O Tester 0.3.3 Test: Read - Size Per Thread: 128MB - Thread Count: 4 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 18498.75 |====================================== Western Digital WD6000HLHX-0 . 16623.90 |================================== Threaded I/O Tester 0.3.3 Test: Read - Size Per Thread: 128MB - Thread Count: 8 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 32257.78 |====================================== Western Digital WD6000HLHX-0 . 25471.44 |============================== Threaded I/O Tester 0.3.3 Test: Read - Size Per Thread: 256MB - Thread Count: 4 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 16749.92 |==================================== Western Digital WD6000HLHX-0 . 17771.64 |====================================== Threaded I/O Tester 0.3.3 Test: Read - Size Per Thread: 256MB - Thread Count: 8 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 29677.14 |====================================== Western Digital WD6000HLHX-0 . 26603.71 |================================== Threaded I/O Tester 0.3.3 Test: Read - Size Per Thread: 32MB - Thread Count: 16 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 42925.99 |===================================== Western Digital WD6000HLHX-0 . 43641.82 |====================================== Threaded I/O Tester 0.3.3 Test: Read - Size Per Thread: 32MB - Thread Count: 32 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 39895.59 |====================================== Western Digital WD6000HLHX-0 . 37460.41 |==================================== Threaded I/O Tester 0.3.3 Test: Read - Size Per Thread: 64MB - Thread Count: 16 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 39214.79 |====================================== Western Digital WD6000HLHX-0 . 37094.52 |==================================== Threaded I/O Tester 0.3.3 Test: Read - Size Per Thread: 64MB - Thread Count: 32 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 40021.14 |====================================== Western Digital WD6000HLHX-0 . 40551.18 |====================================== Threaded I/O Tester 0.3.3 Test: Write - Size Per Thread: 32MB - Thread Count: 4 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 226.70 |====================================== Western Digital WD6000HLHX-0 . 236.18 |======================================== Threaded I/O Tester 0.3.3 Test: Write - Size Per Thread: 32MB - Thread Count: 8 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 75.39 |============ Western Digital WD6000HLHX-0 . 251.95 |======================================== Threaded I/O Tester 0.3.3 Test: Write - Size Per Thread: 64MB - Thread Count: 4 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 198.11 |============================= Western Digital WD6000HLHX-0 . 275.23 |======================================== Threaded I/O Tester 0.3.3 Test: Write - Size Per Thread: 64MB - Thread Count: 8 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 201.80 |======================================== Western Digital WD6000HLHX-0 . 119.10 |======================== Threaded I/O Tester 0.3.3 Test: Read - Size Per Thread: 128MB - Thread Count: 16 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 39059.61 |====================================== Western Digital WD6000HLHX-0 . 39262.91 |====================================== Threaded I/O Tester 0.3.3 Test: Read - Size Per Thread: 128MB - Thread Count: 32 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 40847.96 |====================================== Western Digital WD6000HLHX-0 . 41363.73 |====================================== Threaded I/O Tester 0.3.3 Test: Read - Size Per Thread: 256MB - Thread Count: 16 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 39353.92 |====================================== Western Digital WD6000HLHX-0 . 36879.62 |==================================== Threaded I/O Tester 0.3.3 Test: Read - Size Per Thread: 256MB - Thread Count: 32 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 36850.00 |================================== Western Digital WD6000HLHX-0 . 40795.91 |====================================== Threaded I/O Tester 0.3.3 Test: Write - Size Per Thread: 128MB - Thread Count: 4 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 154.09 |======================================== Western Digital WD6000HLHX-0 . 122.73 |================================ Threaded I/O Tester 0.3.3 Test: Write - Size Per Thread: 128MB - Thread Count: 8 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 148.23 |================================== Western Digital WD6000HLHX-0 . 175.83 |======================================== Threaded I/O Tester 0.3.3 Test: Write - Size Per Thread: 256MB - Thread Count: 4 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 187.43 |======================================== Western Digital WD6000HLHX-0 . 175.73 |====================================== Threaded I/O Tester 0.3.3 Test: Write - Size Per Thread: 256MB - Thread Count: 8 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 240.94 |======================================== Western Digital WD6000HLHX-0 . 147.71 |========================= Threaded I/O Tester 0.3.3 Test: Write - Size Per Thread: 32MB - Thread Count: 16 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 213.57 |======================================== Western Digital WD6000HLHX-0 . 127.57 |======================== Threaded I/O Tester 0.3.3 Test: Write - Size Per Thread: 32MB - Thread Count: 32 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 273.72 |======================================== Western Digital WD6000HLHX-0 . 169.38 |========================= Threaded I/O Tester 0.3.3 Test: Write - Size Per Thread: 64MB - Thread Count: 16 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 189.53 |======================================== Western Digital WD6000HLHX-0 . 183.29 |======================================= Threaded I/O Tester 0.3.3 Test: Write - Size Per Thread: 64MB - Thread Count: 32 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 163.92 |======================================== Western Digital WD6000HLHX-0 . 69.11 |================= Threaded I/O Tester 0.3.3 Test: Write - Size Per Thread: 128MB - Thread Count: 16 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 206.43 |======================================== Western Digital WD6000HLHX-0 . 70.04 |============== Threaded I/O Tester 0.3.3 Test: Write - Size Per Thread: 128MB - Thread Count: 32 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 188.84 |======================================== Western Digital WD6000HLHX-0 . 104.21 |====================== Threaded I/O Tester 0.3.3 Test: Write - Size Per Thread: 256MB - Thread Count: 16 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 197.61 |======================================== Western Digital WD6000HLHX-0 . 83.42 |================= Threaded I/O Tester 0.3.3 Test: Write - Size Per Thread: 256MB - Thread Count: 32 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 150.44 |======================================== Western Digital WD6000HLHX-0 . 143.24 |====================================== Threaded I/O Tester 0.3.3 Test: Random Read - Size Per Thread: 32MB - Thread Count: 4 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 11302.81 |====================================== Western Digital WD6000HLHX-0 . 11140.76 |===================================== Threaded I/O Tester 0.3.3 Test: Random Read - Size Per Thread: 32MB - Thread Count: 8 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 18343.58 |====================================== Western Digital WD6000HLHX-0 . 17999.88 |===================================== Threaded I/O Tester 0.3.3 Test: Random Read - Size Per Thread: 64MB - Thread Count: 4 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 10230.33 |==================================== Western Digital WD6000HLHX-0 . 10896.43 |====================================== Threaded I/O Tester 0.3.3 Test: Random Read - Size Per Thread: 64MB - Thread Count: 8 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 17187.95 |===================================== Western Digital WD6000HLHX-0 . 17684.75 |====================================== Threaded I/O Tester 0.3.3 Test: Random Read - Size Per Thread: 128MB - Thread Count: 4 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 10833.76 |====================================== Western Digital WD6000HLHX-0 . 10066.64 |=================================== Threaded I/O Tester 0.3.3 Test: Random Read - Size Per Thread: 128MB - Thread Count: 8 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 15119.68 |====================================== Western Digital WD6000HLHX-0 . 15164.98 |====================================== Threaded I/O Tester 0.3.3 Test: Random Read - Size Per Thread: 256MB - Thread Count: 4 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 9679.47 |==================================== Western Digital WD6000HLHX-0 . 10175.33 |====================================== Threaded I/O Tester 0.3.3 Test: Random Read - Size Per Thread: 256MB - Thread Count: 8 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 14081.78 |====================================== Western Digital WD6000HLHX-0 . 13370.68 |==================================== Threaded I/O Tester 0.3.3 Test: Random Read - Size Per Thread: 32MB - Thread Count: 16 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 22819.28 |====================================== Western Digital WD6000HLHX-0 . 21267.13 |=================================== Threaded I/O Tester 0.3.3 Test: Random Read - Size Per Thread: 32MB - Thread Count: 32 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 18068.38 |====================================== Western Digital WD6000HLHX-0 . 18307.01 |====================================== Threaded I/O Tester 0.3.3 Test: Random Read - Size Per Thread: 64MB - Thread Count: 16 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 19014.57 |====================================== Western Digital WD6000HLHX-0 . 18669.67 |===================================== Threaded I/O Tester 0.3.3 Test: Random Read - Size Per Thread: 64MB - Thread Count: 32 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 15763.01 |=================================== Western Digital WD6000HLHX-0 . 16895.47 |====================================== Threaded I/O Tester 0.3.3 Test: Random Write - Size Per Thread: 32MB - Thread Count: 4 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 12.57 |================================== Western Digital WD6000HLHX-0 . 15.11 |========================================= Threaded I/O Tester 0.3.3 Test: Random Write - Size Per Thread: 32MB - Thread Count: 8 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 15.24 |================================= Western Digital WD6000HLHX-0 . 19.18 |========================================= Threaded I/O Tester 0.3.3 Test: Random Write - Size Per Thread: 64MB - Thread Count: 4 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 15.80 |===================================== Western Digital WD6000HLHX-0 . 17.60 |========================================= Threaded I/O Tester 0.3.3 Test: Random Write - Size Per Thread: 64MB - Thread Count: 8 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 19.60 |========================================= Western Digital WD6000HLHX-0 . 15.09 |================================ Threaded I/O Tester 0.3.3 Test: Random Read - Size Per Thread: 128MB - Thread Count: 16 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 16584.06 |================================== Western Digital WD6000HLHX-0 . 18355.10 |====================================== Threaded I/O Tester 0.3.3 Test: Random Read - Size Per Thread: 128MB - Thread Count: 32 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 15864.45 |====================================== Western Digital WD6000HLHX-0 . 15434.64 |===================================== Threaded I/O Tester 0.3.3 Test: Random Read - Size Per Thread: 256MB - Thread Count: 16 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 16374.93 |====================================== Western Digital WD6000HLHX-0 . 16436.50 |====================================== Threaded I/O Tester 0.3.3 Test: Random Read - Size Per Thread: 256MB - Thread Count: 32 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 13945.92 |==================================== Western Digital WD6000HLHX-0 . 14627.02 |====================================== Threaded I/O Tester 0.3.3 Test: Random Write - Size Per Thread: 128MB - Thread Count: 4 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 17.51 |======================================== Western Digital WD6000HLHX-0 . 18.02 |========================================= Threaded I/O Tester 0.3.3 Test: Random Write - Size Per Thread: 128MB - Thread Count: 8 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 19.30 |========================================= Western Digital WD6000HLHX-0 . 14.65 |=============================== Threaded I/O Tester 0.3.3 Test: Random Write - Size Per Thread: 256MB - Thread Count: 4 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 17.78 |====================================== Western Digital WD6000HLHX-0 . 19.23 |========================================= Threaded I/O Tester 0.3.3 Test: Random Write - Size Per Thread: 256MB - Thread Count: 8 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 6.79 |================== Western Digital WD6000HLHX-0 . 15.53 |========================================= Threaded I/O Tester 0.3.3 Test: Random Write - Size Per Thread: 32MB - Thread Count: 16 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 13.90 |===================================== Western Digital WD6000HLHX-0 . 15.42 |========================================= Threaded I/O Tester 0.3.3 Test: Random Write - Size Per Thread: 32MB - Thread Count: 32 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 11.21 |===================================== Western Digital WD6000HLHX-0 . 12.57 |========================================= Threaded I/O Tester 0.3.3 Test: Random Write - Size Per Thread: 64MB - Thread Count: 16 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 11.72 |======================================= Western Digital WD6000HLHX-0 . 12.42 |========================================= Threaded I/O Tester 0.3.3 Test: Random Write - Size Per Thread: 64MB - Thread Count: 32 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 9.37 |========================================== Western Digital WD6000HLHX-0 . 8.18 |===================================== Threaded I/O Tester 0.3.3 Test: Random Write - Size Per Thread: 128MB - Thread Count: 16 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 9.21 |======================================== Western Digital WD6000HLHX-0 . 9.77 |========================================== Threaded I/O Tester 0.3.3 Test: Random Write - Size Per Thread: 128MB - Thread Count: 32 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 8.40 |========================================= Western Digital WD6000HLHX-0 . 8.68 |========================================== Threaded I/O Tester 0.3.3 Test: Random Write - Size Per Thread: 256MB - Thread Count: 16 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 6.89 |========================================== Western Digital WD6000HLHX-0 . 6.49 |======================================== Threaded I/O Tester 0.3.3 Test: Random Write - Size Per Thread: 256MB - Thread Count: 32 MB/s > Higher Is Better Western Digital WD6000HLHX-0 . 6.98 |===================================== Western Digital WD6000HLHX-0 . 7.99 |==========================================