benchmark_disk_proxmox_ceph qemu testing on Debian 9.12 via the Phoronix Test Suite. proxmox ceph cluster: Processor: 4 x Intel Xeon E7 4830 (16 Cores), Motherboard: QEMU Standard PC (i440FX + PIIX 1996) (rel-1.12.1-0-ga5cab58e9a3f-prebuilt.qemu.org BIOS), Chipset: Intel 440FX 82441FX PMC, Memory: 2 x 16384 MB RAM QEMU, Disk: 490GB, Graphics: bochsdrmfb, Network: Red Hat Virtio device OS: Debian 9.12, Kernel: 4.9.0-12-amd64 (x86_64), Compiler: GCC 6.3.0 20170516, File-System: ext4, Screen Resolution: 1024x768, System Layer: qemu SQLite 3.30.1 Timed SQLite Insertions Seconds < Lower Is Better proxmox ceph cluster . 186.81 |================================================ Flexible IO Tester 3.18 Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory MB/s > Higher Is Better proxmox ceph cluster . 1548 |================================================== Flexible IO Tester 3.18 Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory IOPS > Higher Is Better proxmox ceph cluster . 770 |=================================================== Flexible IO Tester 3.18 Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory MB/s > Higher Is Better proxmox ceph cluster . 114 |=================================================== Flexible IO Tester 3.18 Type: Random Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory IOPS > Higher Is Better proxmox ceph cluster . 29131 |================================================= Flexible IO Tester 3.18 Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory MB/s > Higher Is Better proxmox ceph cluster . 567 |=================================================== Flexible IO Tester 3.18 Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory IOPS > Higher Is Better proxmox ceph cluster . 280 |=================================================== Flexible IO Tester 3.18 Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory MB/s > Higher Is Better proxmox ceph cluster . 52.5 |================================================== Flexible IO Tester 3.18 Type: Random Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory IOPS > Higher Is Better proxmox ceph cluster . 13380 |================================================= Flexible IO Tester 3.18 Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory MB/s > Higher Is Better proxmox ceph cluster . 1552 |================================================== Flexible IO Tester 3.18 Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory IOPS > Higher Is Better proxmox ceph cluster . 772 |=================================================== Flexible IO Tester 3.18 Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory MB/s > Higher Is Better proxmox ceph cluster . 104.3 |================================================= Flexible IO Tester 3.18 Type: Sequential Read - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory IOPS > Higher Is Better proxmox ceph cluster . 26720 |================================================= Flexible IO Tester 3.18 Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory MB/s > Higher Is Better proxmox ceph cluster . 637 |=================================================== Flexible IO Tester 3.18 Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 2MB - Disk Target: Default Test Directory IOPS > Higher Is Better proxmox ceph cluster . 315 |=================================================== Flexible IO Tester 3.18 Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory MB/s > Higher Is Better proxmox ceph cluster . 33.3 |================================================== Flexible IO Tester 3.18 Type: Sequential Write - IO Engine: Linux AIO - Buffered: No - Direct: Yes - Block Size: 4KB - Disk Target: Default Test Directory IOPS > Higher Is Better proxmox ceph cluster . 8537 |================================================== FS-Mark 3.3 Test: 1000 Files, 1MB Size Files/s > Higher Is Better proxmox ceph cluster . 41.1 |================================================== FS-Mark 3.3 Test: 5000 Files, 1MB Size, 4 Threads Files/s > Higher Is Better proxmox ceph cluster . 109.3 |================================================= FS-Mark 3.3 Test: 4000 Files, 32 Sub Dirs, 1MB Size Files/s > Higher Is Better proxmox ceph cluster . 42.5 |================================================== FS-Mark 3.3 Test: 1000 Files, 1MB Size, No Sync/FSync Files/s > Higher Is Better proxmox ceph cluster . 689.0 |================================================= Dbench 4.0 12 Clients MB/s > Higher Is Better proxmox ceph cluster . 203.43 |================================================ Dbench 4.0 1 Clients MB/s > Higher Is Better proxmox ceph cluster . 28.20 |================================================= Compile Bench 0.6 Test: Compile MB/s > Higher Is Better proxmox ceph cluster . 538.61 |================================================ Compile Bench 0.6 Test: Initial Create MB/s > Higher Is Better proxmox ceph cluster . 95.72 |================================================= Compile Bench 0.6 Test: Read Compiled Tree MB/s > Higher Is Better proxmox ceph cluster . 205.74 |================================================ PostMark 1.51 Disk Transaction Performance TPS > Higher Is Better proxmox ceph cluster . 1677 |==================================================