proxmox-disk

qemu testing on Debian 9.8 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/1902266-FO-PROXMOXDI72&sor&grw.

proxmox-diskProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionSystem Layerproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebacktau-ceph-raw-nonetau-ceph-raw-writebackuranus-ceph-raw-writebackuranus-nfs-qcow2-writebackuranus-nfs-qcow2-writeback-4coresproxima-ceph-raw-writebackproxima-ceph-raw-writeback-10GbCommon KVM @ 2.90GHz (2 Cores)QEMU Standard PC (i440FX + PIIX 1996) (rel-1.9.3-0-ge2fc41e-prebuilt.qemu-project.org BIOS)Intel 440FX- 82441FX PMC1 x 2048 MB RAM QEMU30GBbochsdrmfbRed Hat Virtio deviceDebian 9.44.9.0-6-amd64 (x86_64)GCC 6.3.0 20170516ext41024x768qemuCommon KVM @ 2.20GHz (2 Cores)QEMU Standard PC (i440FX + PIIX 1996) (rel-1.11.0-0-g63451fca13-prebuilt.qemu-project.org BIOS)Common KVM @ 2.60GHz (2 Cores)Common KVM @ 2.60GHz (4 Cores)Common KVM @ 2.20GHz (2 Cores)QEMU Standard PC (i440FX + PIIX 1996) (rel-1.11.1-0-g0551a4be2c-prebuilt.qemu-project.org BIOS)Debian 9.6Debian 9.84.9.0-8-amd64 (x86_64)OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -v Disk Details- none / data=ordered,errors=remount-ro,relatime,rwPython Details- Python 2.7.13 + Python 3.5.3Security Details- KPTI + __user pointer sanitization + Full generic retpoline Protection

proxmox-diskcompilebench: Compileunpack-linux: linux-4.15.tar.xzcompilebench: Initial Createcompilebench: Read Compiled Treetiobench: 64MB Rand Read - 32 Threadstiobench: 64MB Rand Write - 32 Threadsdbench: 12 Clientsdbench: 48 Clientsdbench: 128 Clientsdbench: 1 Clientsfs-mark: 1000 Files, 1MB Sizepostmark: Disk Transaction Performanceapache: Static Web Page Servingsqlite: Timed SQLite Insertionscompress-gzip: Linux Source Tree Archiving To .tar.gzaio-stress: Rand Writeproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebacktau-ceph-raw-nonetau-ceph-raw-writebackuranus-ceph-raw-writebackuranus-nfs-qcow2-writebackuranus-nfs-qcow2-writeback-4coresproxima-ceph-raw-writebackproxima-ceph-raw-writeback-10Gb549.5417.6878.17228.2110835.30236.49271.40496.30311.1366.9435.7317692257.4950.1464.73360.3087.0126.2242.72224.879167.5229.56105.99210.38209.3324.5051.476112290.98233.8064.85400.1684.9515.1458.77270.29437.839.4527.4759.4868.827.759.9310298133.75634.36293.4278.4573.2713.7056.04291.32486.607.4727.4559.1379.8711.6510.43115810051.44571.01224.7890.8269.4523.0047.67129.15539.844.9230.4053.1174.0212.8010.337092883.65436.54305.6375.37143.6119.7560.85173.5211393.61552.26368.99527.81502.4180.44101.689172866.0941.5374.51124.82176.6818.8162.29195.6019855.48394.22441.27834.581032.5096.19114.879888567.6838.0162.58209.1667.2115.1752.31394.08405.445.0425.5242.1973.699.879.9510699355.29667.79268.5875.35164.0811.5392.22360.36540.055.7534.1462.2985.3012.7814.7015568502.50461.44153.84113.40OpenBenchmarking.org

Compile Bench

Test: Compile

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Compileproxmox1-iscsi-raw-writebackuranus-nfs-qcow2-writeback-4coresproxima-ceph-raw-writeback-10Gburanus-nfs-qcow2-writebackproxmox1-local-qcow2-writebacktau-ceph-raw-nonetau-ceph-raw-writebackuranus-ceph-raw-writebackproxima-ceph-raw-writeback120240360480600SE +/- 20.59, N = 6SE +/- 29.17, N = 6SE +/- 5.24, N = 6SE +/- 11.81, N = 6SE +/- 40.64, N = 6SE +/- 2.46, N = 6SE +/- 1.10, N = 3SE +/- 0.83, N = 3SE +/- 1.22, N = 6549.54176.68164.08143.6187.0184.9573.2769.4567.21

Unpacking The Linux Kernel

linux-4.15.tar.xz

OpenBenchmarking.orgSeconds, Fewer Is BetterUnpacking The Linux Kernellinux-4.15.tar.xzproxima-ceph-raw-writeback-10Gbtau-ceph-raw-writebacktau-ceph-raw-noneproxima-ceph-raw-writebackproxmox1-iscsi-raw-writebackuranus-nfs-qcow2-writeback-4coresuranus-nfs-qcow2-writebackuranus-ceph-raw-writebackproxmox1-local-qcow2-writeback612182430SE +/- 0.36, N = 8SE +/- 0.79, N = 8SE +/- 0.85, N = 8SE +/- 0.80, N = 8SE +/- 0.42, N = 8SE +/- 0.83, N = 8SE +/- 1.00, N = 8SE +/- 1.73, N = 8SE +/- 3.21, N = 811.5313.7015.1415.1717.6818.8119.7523.0026.22

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial Createproxima-ceph-raw-writeback-10Gbproxmox1-iscsi-raw-writebackuranus-nfs-qcow2-writeback-4coresuranus-nfs-qcow2-writebacktau-ceph-raw-nonetau-ceph-raw-writebackproxima-ceph-raw-writebackuranus-ceph-raw-writebackproxmox1-local-qcow2-writeback20406080100SE +/- 7.11, N = 3SE +/- 5.34, N = 3SE +/- 3.64, N = 3SE +/- 6.77, N = 3SE +/- 2.91, N = 3SE +/- 0.88, N = 3SE +/- 2.47, N = 3SE +/- 2.75, N = 3SE +/- 8.10, N = 392.2278.1762.2960.8558.7756.0452.3147.6742.72

Compile Bench

Test: Read Compiled Tree

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Read Compiled Treeproxima-ceph-raw-writebackproxima-ceph-raw-writeback-10Gbtau-ceph-raw-writebacktau-ceph-raw-noneproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebackuranus-nfs-qcow2-writeback-4coresuranus-nfs-qcow2-writebackuranus-ceph-raw-writeback90180270360450SE +/- 9.18, N = 3SE +/- 8.42, N = 3SE +/- 16.55, N = 3SE +/- 2.43, N = 3SE +/- 8.47, N = 3SE +/- 23.85, N = 3SE +/- 14.43, N = 3SE +/- 4.29, N = 3SE +/- 5.71, N = 3394.08360.36291.32270.29228.21224.87195.60173.52129.15

Threaded I/O Tester

64MB Random Read - 32 Threads

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 2017050364MB Random Read - 32 Threadsuranus-nfs-qcow2-writeback-4coresuranus-nfs-qcow2-writebackproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebackproxima-ceph-raw-writeback-10Gburanus-ceph-raw-writebacktau-ceph-raw-writebacktau-ceph-raw-noneproxima-ceph-raw-writeback4K8K12K16K20KSE +/- 1301.43, N = 6SE +/- 387.45, N = 6SE +/- 160.41, N = 3SE +/- 280.82, N = 6SE +/- 113.49, N = 6SE +/- 37.91, N = 6SE +/- 47.98, N = 6SE +/- 53.46, N = 5SE +/- 30.26, N = 319855.4811393.6110835.309167.52540.05539.84486.60437.83405.441. (CC) gcc options: -O2

Threaded I/O Tester

64MB Random Write - 32 Threads

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 2017050364MB Random Write - 32 Threadsuranus-nfs-qcow2-writebackuranus-nfs-qcow2-writeback-4coresproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebacktau-ceph-raw-nonetau-ceph-raw-writebackproxima-ceph-raw-writeback-10Gbproxima-ceph-raw-writebackuranus-ceph-raw-writeback120240360480600SE +/- 128.09, N = 6SE +/- 1.03, N = 3SE +/- 4.51, N = 3SE +/- 2.56, N = 6SE +/- 0.20, N = 3SE +/- 0.79, N = 3SE +/- 0.52, N = 4SE +/- 0.22, N = 3SE +/- 0.59, N = 3552.26394.22236.4929.569.457.475.755.044.921. (CC) gcc options: -O2

Dbench

12 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.012 Clientsuranus-nfs-qcow2-writeback-4coresuranus-nfs-qcow2-writebackproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebackproxima-ceph-raw-writeback-10Gburanus-ceph-raw-writebacktau-ceph-raw-nonetau-ceph-raw-writebackproxima-ceph-raw-writeback100200300400500SE +/- 8.59, N = 3SE +/- 6.95, N = 3SE +/- 0.36, N = 3SE +/- 0.62, N = 3SE +/- 1.58, N = 6SE +/- 1.21, N = 6SE +/- 1.69, N = 6SE +/- 2.16, N = 6SE +/- 1.09, N = 6441.27368.99271.40105.9934.1430.4027.4727.4525.521. (CC) gcc options: -lpopt -O2

Dbench

48 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.048 Clientsuranus-nfs-qcow2-writeback-4coresuranus-nfs-qcow2-writebackproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebackproxima-ceph-raw-writeback-10Gbtau-ceph-raw-nonetau-ceph-raw-writebackuranus-ceph-raw-writebackproxima-ceph-raw-writeback2004006008001000SE +/- 24.83, N = 6SE +/- 19.16, N = 6SE +/- 1.11, N = 3SE +/- 4.34, N = 6SE +/- 4.87, N = 6SE +/- 5.21, N = 6SE +/- 2.48, N = 6SE +/- 2.55, N = 6SE +/- 4.93, N = 6834.58527.81496.30210.3862.2959.4859.1353.1142.191. (CC) gcc options: -lpopt -O2

Dbench

128 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0128 Clientsuranus-nfs-qcow2-writeback-4coresuranus-nfs-qcow2-writebackproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebackproxima-ceph-raw-writeback-10Gbtau-ceph-raw-writebackuranus-ceph-raw-writebackproxima-ceph-raw-writebacktau-ceph-raw-none2004006008001000SE +/- 32.29, N = 6SE +/- 19.34, N = 6SE +/- 2.17, N = 3SE +/- 3.26, N = 6SE +/- 9.37, N = 6SE +/- 3.83, N = 6SE +/- 1.24, N = 3SE +/- 3.42, N = 6SE +/- 5.25, N = 61032.50502.41311.13209.3385.3079.8774.0273.6968.821. (CC) gcc options: -lpopt -O2

Dbench

1 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.01 Clientsuranus-nfs-qcow2-writeback-4coresuranus-nfs-qcow2-writebackproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebackuranus-ceph-raw-writebackproxima-ceph-raw-writeback-10Gbtau-ceph-raw-writebackproxima-ceph-raw-writebacktau-ceph-raw-none20406080100SE +/- 0.81, N = 3SE +/- 1.07, N = 6SE +/- 0.18, N = 3SE +/- 0.09, N = 3SE +/- 0.38, N = 6SE +/- 0.39, N = 6SE +/- 0.50, N = 6SE +/- 0.55, N = 6SE +/- 0.30, N = 696.1980.4466.9424.5012.8012.7811.659.877.751. (CC) gcc options: -lpopt -O2

FS-Mark

1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.31000 Files, 1MB Sizeuranus-nfs-qcow2-writeback-4coresuranus-nfs-qcow2-writebackproxmox1-local-qcow2-writebackproxmox1-iscsi-raw-writebackproxima-ceph-raw-writeback-10Gbtau-ceph-raw-writebackuranus-ceph-raw-writebackproxima-ceph-raw-writebacktau-ceph-raw-none306090120150SE +/- 9.78, N = 6SE +/- 8.10, N = 6SE +/- 1.19, N = 6SE +/- 0.12, N = 3SE +/- 0.48, N = 6SE +/- 0.15, N = 3SE +/- 1.02, N = 6SE +/- 0.32, N = 6SE +/- 0.36, N = 6114.87101.6851.4735.7314.7010.4310.339.959.931. (CC) gcc options: -static

PostMark

Disk Transaction Performance

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction Performanceproxmox1-iscsi-raw-writebackproxima-ceph-raw-writeback-10Gbtau-ceph-raw-writebackproxima-ceph-raw-writebacktau-ceph-raw-noneuranus-nfs-qcow2-writeback-4coresuranus-nfs-qcow2-writebackuranus-ceph-raw-writebackproxmox1-local-qcow2-writeback400800120016002000SE +/- 15.07, N = 3SE +/- 19.73, N = 3SE +/- 16.15, N = 3SE +/- 1.33, N = 3SE +/- 16.90, N = 6SE +/- 15.88, N = 3SE +/- 17.78, N = 3SE +/- 4.37, N = 3SE +/- 16.41, N = 6176915561158106910299889177096111. (CC) gcc options: -O3

Apache Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.4.29Static Web Page Servingtau-ceph-raw-writebackproxima-ceph-raw-writebackuranus-nfs-qcow2-writeback-4coresproxima-ceph-raw-writeback-10Gbtau-ceph-raw-noneuranus-ceph-raw-writebackuranus-nfs-qcow2-writebackproxmox1-local-qcow2-writebackproxmox1-iscsi-raw-writeback2K4K6K8K10KSE +/- 22.41, N = 3SE +/- 62.37, N = 3SE +/- 385.83, N = 6SE +/- 46.72, N = 3SE +/- 28.92, N = 3SE +/- 59.51, N = 6SE +/- 22.74, N = 3SE +/- 23.09, N = 3SE +/- 23.92, N = 310051.449355.298567.688502.508133.752883.652866.092290.982257.491. (CC) gcc options: -shared -fPIC -O2 -pthread

SQLite

Timed SQLite Insertions

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite Insertionsuranus-nfs-qcow2-writeback-4coresuranus-nfs-qcow2-writebackproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebackuranus-ceph-raw-writebackproxima-ceph-raw-writeback-10Gbtau-ceph-raw-writebacktau-ceph-raw-noneproxima-ceph-raw-writeback140280420560700SE +/- 2.12, N = 6SE +/- 2.97, N = 6SE +/- 0.42, N = 3SE +/- 1.97, N = 3SE +/- 33.08, N = 6SE +/- 22.36, N = 6SE +/- 48.37, N = 6SE +/- 40.98, N = 6SE +/- 27.45, N = 638.0141.5350.14233.80436.54461.44571.01634.36667.791. (CC) gcc options: -O2 -ldl -lpthread

Gzip Compression

Linux Source Tree Archiving To .tar.gz

OpenBenchmarking.orgSeconds, Fewer Is BetterGzip CompressionLinux Source Tree Archiving To .tar.gzuranus-nfs-qcow2-writeback-4coresproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebackuranus-nfs-qcow2-writebackproxima-ceph-raw-writeback-10Gbtau-ceph-raw-writebackproxima-ceph-raw-writebacktau-ceph-raw-noneuranus-ceph-raw-writeback70140210280350SE +/- 1.81, N = 6SE +/- 1.68, N = 6SE +/- 2.18, N = 6SE +/- 1.71, N = 6SE +/- 11.87, N = 6SE +/- 18.11, N = 6SE +/- 16.28, N = 6SE +/- 17.09, N = 6SE +/- 11.87, N = 662.5864.7364.8574.51153.84224.78268.58293.42305.63

AIO-Stress

Random Write

OpenBenchmarking.orgMB/s, More Is BetterAIO-Stress 0.21Random Writeproxmox1-local-qcow2-writebackproxmox1-iscsi-raw-writebackuranus-nfs-qcow2-writeback-4coresuranus-nfs-qcow2-writebackproxima-ceph-raw-writeback-10Gbtau-ceph-raw-writebacktau-ceph-raw-noneuranus-ceph-raw-writebackproxima-ceph-raw-writeback90180270360450SE +/- 22.46, N = 6SE +/- 27.84, N = 6SE +/- 88.79, N = 6SE +/- 7.91, N = 6SE +/- 1.18, N = 3SE +/- 2.47, N = 6SE +/- 1.35, N = 6SE +/- 4.34, N = 6SE +/- 2.19, N = 6400.16360.30209.16124.82113.4090.8278.4575.3775.351. (CC) gcc options: -pthread -laio

Phoronix Test Suite v10.8.4