fio-oort Running pts/fio-1.8.2 via the Phoronix Test Suite. Ceph Normal: Processor: 2 x Intel Xeon E312xx (Sandy Bridge) @ 2.70GHz (2 Cores), Motherboard: QEMU Standard PC (i440FX + PIIX 1996), Chipset: Intel 440FX- 82441FX PMC, Memory: 1 x 2048 MB RAM QEMU, Disk: 9GB, Graphics: Cirrus Logic GD 5446, Network: Red Hat Virtio device OS: Ubuntu 14.04, Kernel: 3.13.0-55-generic (x86_64), Compiler: GCC 4.8.4, File-System: ext4, Screen Resolution: 1024x768 Ceph Luks: Processor: 2 x Intel Xeon E312xx (Sandy Bridge) @ 2.70GHz (2 Cores), Motherboard: QEMU Standard PC (i440FX + PIIX 1996), Chipset: Intel 440FX- 82441FX PMC, Memory: 1 x 2048 MB RAM QEMU, Disk: 9GB, Graphics: Cirrus Logic GD 5446, Network: Red Hat Virtio device OS: Ubuntu 14.04, Kernel: 3.13.0-55-generic (x86_64), Compiler: GCC 4.8.4, File-System: ext4, Screen Resolution: 1024x768 Ceph Luks 2: Processor: 2 x Intel Xeon E312xx (Sandy Bridge) @ 2.70GHz (2 Cores), Motherboard: QEMU Standard PC (i440FX + PIIX 1996), Chipset: Intel 440FX- 82441FX PMC, Memory: 1 x 2048 MB RAM QEMU, Disk: 9GB, Graphics: Cirrus Logic GD 5446, Network: Red Hat Virtio device OS: Ubuntu 14.04, Kernel: 3.13.0-55-generic (x86_64), Compiler: GCC 4.8.4, File-System: ext4, Screen Resolution: 1024x768 Ceph Real: Processor: 2 x Intel Xeon E312xx (Sandy Bridge) @ 2.70GHz (2 Cores), Motherboard: QEMU Standard PC (i440FX + PIIX 1996), Chipset: Intel 440FX- 82441FX PMC, Memory: 1 x 2048 MB RAM QEMU, Disk: 9GB, Graphics: Cirrus Logic GD 5446, Network: Red Hat Virtio device OS: Ubuntu 14.04, Kernel: 3.13.0-55-generic (x86_64), Compiler: GCC 4.8.4, File-System: ext4, Screen Resolution: 1024x768 Ceph Luks Real: Processor: 2 x Intel Xeon E312xx (Sandy Bridge) @ 2.70GHz (2 Cores), Motherboard: QEMU Standard PC (i440FX + PIIX 1996), Chipset: Intel 440FX- 82441FX PMC, Memory: 1 x 2048 MB RAM QEMU, Disk: 9GB, Graphics: Cirrus Logic GD 5446, Network: Red Hat Virtio device OS: Ubuntu 14.04, Kernel: 3.13.0-55-generic (x86_64), Compiler: GCC 4.8.4, File-System: ext4, Screen Resolution: 1024x768 Flexible IO Tester 2.1.13 Type: Random Read - IO Engine: Sync - Buffered: No - Direct: No - Block Size: 4MB - Disk Target: Default Test Directory - Result: MB/s MB/s > Higher Is Better Ceph Normal . 1197.33 |======================================================== Ceph Luks ... 1056.77 |================================================= Flexible IO Tester 2.1.13 Type: Random Write - IO Engine: Sync - Buffered: No - Direct: No - Block Size: 4MB - Disk Target: Default Test Directory - Result: MB/s MB/s > Higher Is Better Ceph Normal . 640.64 |========================================================= Ceph Luks ... 637.99 |========================================================= Flexible IO Tester 2.1.13 Type: Sequential Read - IO Engine: Sync - Buffered: No - Direct: No - Block Size: 4MB - Disk Target: Default Test Directory - Result: MB/s MB/s > Higher Is Better Ceph Normal . 1218.53 |======================================================== Ceph Luks ... 1206.80 |======================================================= Flexible IO Tester 2.1.13 Type: Sequential Write - IO Engine: Sync - Buffered: No - Direct: No - Block Size: 4MB - Disk Target: Default Test Directory - Result: MB/s MB/s > Higher Is Better Ceph Normal . 636.46 |========================================================= Ceph Luks ... 638.13 |========================================================= Flexible IO Tester 2.1.13 Type: Random Read - IO Engine: Sync - Buffered: No - Direct: No - Block Size: 4MB - Disk Target: /root - Result: MB/s MB/s > Higher Is Better Ceph Luks 2 .... 660.02 |====================================================== Ceph Real ...... 433.84 |=================================== Ceph Luks Real . 427.83 |=================================== Flexible IO Tester 2.1.13 Type: Random Write - IO Engine: Sync - Buffered: No - Direct: No - Block Size: 4MB - Disk Target: /root - Result: MB/s MB/s > Higher Is Better Ceph Luks 2 .... 646.68 |====================================================== Ceph Real ...... 267.00 |====================== Ceph Luks Real . 245.74 |===================== Flexible IO Tester 2.1.13 Type: Sequential Read - IO Engine: Sync - Buffered: No - Direct: No - Block Size: 4MB - Disk Target: /root - Result: MB/s MB/s > Higher Is Better Ceph Luks 2 .... 677.10 |====================================================== Ceph Real ...... 466.49 |===================================== Ceph Luks Real . 450.07 |==================================== Flexible IO Tester 2.1.13 Type: Sequential Write - IO Engine: Sync - Buffered: No - Direct: No - Block Size: 4MB - Disk Target: /root - Result: MB/s MB/s > Higher Is Better Ceph Luks 2 .... 638.43 |====================================================== Ceph Real ...... 120.56 |========== Ceph Luks Real . 104.45 |=========