proxmox-disk

qemu testing on Debian 9.8 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/1902262-FO-PROXMOXDI17&sor&grs.

proxmox-diskProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionSystem Layerproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebacktau-ceph-raw-nonetau-ceph-raw-writebackuranus-ceph-raw-writebackuranus-nfs-qcow2-writebackuranus-nfs-qcow2-writeback-4corestau-nfs-qcow2-nonetau-nfs-raw-writebacktau-nfs-qcow2-writeback-512MBtau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-qcow2-writebacktau-nfs-qcow2-writeback-swappiness0tau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-writeback-8GBtau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-writeback-2x4corestau-nfs-qcow2-writeback-1x8coresproxima-ceph-raw-writebackproxima-ceph-raw-writeback-10GbCommon KVM @ 2.90GHz (2 Cores)QEMU Standard PC (i440FX + PIIX 1996) (rel-1.9.3-0-ge2fc41e-prebuilt.qemu-project.org BIOS)Intel 440FX- 82441FX PMC1 x 2048 MB RAM QEMU30GBbochsdrmfbRed Hat Virtio deviceDebian 9.44.9.0-6-amd64 (x86_64)GCC 6.3.0 20170516ext41024x768qemuCommon KVM @ 2.20GHz (2 Cores)QEMU Standard PC (i440FX + PIIX 1996) (rel-1.11.0-0-g63451fca13-prebuilt.qemu-project.org BIOS)Common KVM @ 2.60GHz (2 Cores)Common KVM @ 2.60GHz (4 Cores)Common KVM @ 2.20GHz (2 Cores)1 x 512 MB RAM QEMU1 x 2048 MB RAM QEMU1 x 4096 MB RAM QEMU1 x 8192 MB RAM QEMUCommon KVM @ 2.20GHz (4 Cores)1 x 2048 MB RAM QEMU2 x Common KVM @ 2.20GHz (8 Cores)Common KVM @ 2.20GHz (8 Cores)Common KVM @ 2.20GHz (2 Cores)QEMU Standard PC (i440FX + PIIX 1996) (rel-1.11.1-0-g0551a4be2c-prebuilt.qemu-project.org BIOS)Debian 9.6Debian 9.84.9.0-8-amd64 (x86_64)OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-target-system-zlib --with-tune=generic -vDisk Details- none / data=ordered,errors=remount-ro,relatime,rwPython Details- Python 2.7.13 + Python 3.5.3Security Details- KPTI + __user pointer sanitization + Full generic retpoline Protection

proxmox-diskapache: Static Web Page Servingpostmark: Disk Transaction Performancecompress-gzip: Linux Source Tree Archiving To .tar.gzunpack-linux: linux-4.15.tar.xzcompilebench: Read Compiled Treecompilebench: Initial Createcompilebench: Compiletiobench: 64MB Rand Write - 32 Threadstiobench: 64MB Rand Read - 32 Threadsdbench: 1 Clientsdbench: 128 Clientsdbench: 48 Clientsdbench: 12 Clientsfs-mark: 1000 Files, 1MB Sizesqlite: Timed SQLite Insertionsaio-stress: Rand Writeproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebacktau-ceph-raw-nonetau-ceph-raw-writebackuranus-ceph-raw-writebackuranus-nfs-qcow2-writebackuranus-nfs-qcow2-writeback-4corestau-nfs-qcow2-nonetau-nfs-raw-writebacktau-nfs-qcow2-writeback-512MBtau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-qcow2-writebacktau-nfs-qcow2-writeback-swappiness0tau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-writeback-8GBtau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-writeback-2x4corestau-nfs-qcow2-writeback-1x8coresproxima-ceph-raw-writebackproxima-ceph-raw-writeback-10Gb2257.49176964.7317.68228.2178.17549.54236.4910835.3066.94311.13496.30271.4035.7350.14360.302290.9861164.8526.22224.8742.7287.0129.569167.5224.50209.33210.38105.9951.47233.80400.168133.751029293.4215.14270.2958.7784.959.45437.837.7568.8259.4827.479.93634.3678.4510051.441158224.7813.70291.3256.0473.277.47486.6011.6579.8759.1327.4510.43571.0190.822883.65709305.6323.00129.1547.6769.454.92539.8412.8074.0253.1130.4010.33436.5475.372866.0991774.5119.75173.5260.85143.61552.2611393.6180.44502.41527.81368.99101.6841.53124.828567.6898862.5818.81195.6062.29176.68394.2219855.4896.191032.50834.58441.27114.8738.01209.169514.15225657.339.21350.62143.00256.292193.9714397.92317.31735.00811.21793.33359.6513.57240.118489.36215551.539.69381.07126.12479.501454.6910509.83237.21579.78811.43736.88192.3311.43314.2210785.49165952.3310.43129.84163.97295.292560.597312.68295.07693.32839.71863.80404.5216.19278.308612.01132755.6410.06133.61131.30473.252375.657714.92285.48613.28773.05790.26385.4714.75311.099564.74237351.309.24317.47131.96432.452655.8215152.77304.15853.23882.50834.32365.0317.89254.3410212.68229351.219.16320.70139.69410.961592.4716701.01298.45886.91904.05870.20317.4016.96324.899651.52285147.849.00355.84138.23378.291173.9825844.39304.40753.05877.11871.29385.8216.54371.3913008.62211951.259.40368.87127.86460.951975.7220854.76283.061229.431274.621201.33340.9316.60343.3210774.98216151.069.52357.30137.37359.592234.1222338.17270.161186.161276.551148.90340.9017.70294.9611010.71205551.269.43361.40116.37374.371868.6126506.21257.641723.911874.731455.09294.0718.40253.6810701.30218050.739.34362.30132.61392.861385.7523408.94273.041792.131904.751464.16308.7717.57335.199355.291069268.5815.17394.0852.3167.215.04405.449.8773.6942.1925.529.95667.7975.358502.501556153.8411.53360.3692.22164.085.75540.0512.7885.3062.2934.1414.70461.44113.40OpenBenchmarking.org

Apache Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.4.29Static Web Page Servingtau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-2x4corestau-nfs-qcow2-writeback-512MBtau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-swappiness0tau-ceph-raw-writebacktau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-writebacktau-nfs-qcow2-noneproxima-ceph-raw-writebacktau-nfs-qcow2-writeback-512MB-swappiness0uranus-nfs-qcow2-writeback-4coresproxima-ceph-raw-writeback-10Gbtau-nfs-raw-writebacktau-ceph-raw-noneuranus-ceph-raw-writebackuranus-nfs-qcow2-writebackproxmox1-local-qcow2-writebackproxmox1-iscsi-raw-writeback3K6K9K12K15KSE +/- 471.43, N = 6SE +/- 20.33, N = 3SE +/- 20.81, N = 3SE +/- 97.03, N = 3SE +/- 34.29, N = 3SE +/- 34.13, N = 3SE +/- 22.41, N = 3SE +/- 44.51, N = 3SE +/- 36.16, N = 3SE +/- 44.44, N = 3SE +/- 62.37, N = 3SE +/- 31.17, N = 3SE +/- 385.83, N = 6SE +/- 46.72, N = 3SE +/- 33.10, N = 3SE +/- 28.92, N = 3SE +/- 59.51, N = 6SE +/- 22.74, N = 3SE +/- 23.09, N = 3SE +/- 23.92, N = 313008.6211010.7110785.4910774.9810701.3010212.6810051.449651.529564.749514.159355.298612.018567.688502.508489.368133.752883.652866.092290.982257.491. (CC) gcc options: -shared -fPIC -O2 -pthread

PostMark

Disk Transaction Performance

OpenBenchmarking.orgTPS, More Is BetterPostMark 1.51Disk Transaction Performancetau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-writebacktau-nfs-qcow2-writeback-swappiness0tau-nfs-qcow2-nonetau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-raw-writebacktau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-2x4coresproxmox1-iscsi-raw-writebacktau-nfs-qcow2-writeback-512MBproxima-ceph-raw-writeback-10Gbtau-nfs-qcow2-writeback-512MB-swappiness0tau-ceph-raw-writebackproxima-ceph-raw-writebacktau-ceph-raw-noneuranus-nfs-qcow2-writeback-4coresuranus-nfs-qcow2-writebackuranus-ceph-raw-writebackproxmox1-local-qcow2-writeback6001200180024003000SE +/- 28.85, N = 3SE +/- 7.33, N = 3SE +/- 21.33, N = 3SE +/- 43.53, N = 6SE +/- 16.82, N = 3SE +/- 16.44, N = 3SE +/- 10.68, N = 3SE +/- 20.79, N = 3SE +/- 5.67, N = 3SE +/- 15.07, N = 3SE +/- 9.70, N = 3SE +/- 19.73, N = 3SE +/- 31.33, N = 6SE +/- 16.15, N = 3SE +/- 1.33, N = 3SE +/- 16.90, N = 6SE +/- 15.88, N = 3SE +/- 17.78, N = 3SE +/- 4.37, N = 3SE +/- 16.41, N = 628512373229322562180216121552119205517691659155613271158106910299889177096111. (CC) gcc options: -O3

Gzip Compression

Linux Source Tree Archiving To .tar.gz

OpenBenchmarking.orgSeconds, Fewer Is BetterGzip CompressionLinux Source Tree Archiving To .tar.gztau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-writeback-swappiness0tau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-2x4corestau-nfs-qcow2-writebacktau-nfs-raw-writebacktau-nfs-qcow2-writeback-512MBtau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-qcow2-noneuranus-nfs-qcow2-writeback-4coresproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebackuranus-nfs-qcow2-writebackproxima-ceph-raw-writeback-10Gbtau-ceph-raw-writebackproxima-ceph-raw-writebacktau-ceph-raw-noneuranus-ceph-raw-writeback70140210280350SE +/- 0.40, N = 3SE +/- 0.08, N = 3SE +/- 0.76, N = 3SE +/- 0.49, N = 3SE +/- 0.06, N = 3SE +/- 0.84, N = 3SE +/- 0.93, N = 3SE +/- 0.29, N = 3SE +/- 0.79, N = 5SE +/- 0.70, N = 3SE +/- 0.70, N = 3SE +/- 1.81, N = 6SE +/- 1.68, N = 6SE +/- 2.18, N = 6SE +/- 1.71, N = 6SE +/- 11.87, N = 6SE +/- 18.11, N = 6SE +/- 16.28, N = 6SE +/- 17.09, N = 6SE +/- 11.87, N = 647.8450.7351.0651.2151.2551.2651.3051.5352.3355.6457.3362.5864.7364.8574.51153.84224.78268.58293.42305.63

Unpacking The Linux Kernel

linux-4.15.tar.xz

OpenBenchmarking.orgSeconds, Fewer Is BetterUnpacking The Linux Kernellinux-4.15.tar.xztau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-writeback-swappiness0tau-nfs-qcow2-nonetau-nfs-qcow2-writebacktau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-2x4corestau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-raw-writebacktau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-qcow2-writeback-512MBproxima-ceph-raw-writeback-10Gbtau-ceph-raw-writebacktau-ceph-raw-noneproxima-ceph-raw-writebackproxmox1-iscsi-raw-writebackuranus-nfs-qcow2-writeback-4coresuranus-nfs-qcow2-writebackuranus-ceph-raw-writebackproxmox1-local-qcow2-writeback612182430SE +/- 0.07, N = 4SE +/- 0.11, N = 4SE +/- 0.14, N = 8SE +/- 0.17, N = 8SE +/- 0.21, N = 8SE +/- 0.16, N = 8SE +/- 0.14, N = 5SE +/- 0.12, N = 4SE +/- 0.14, N = 4SE +/- 0.12, N = 4SE +/- 0.33, N = 8SE +/- 0.36, N = 8SE +/- 0.79, N = 8SE +/- 0.85, N = 8SE +/- 0.80, N = 8SE +/- 0.42, N = 8SE +/- 0.83, N = 8SE +/- 1.00, N = 8SE +/- 1.73, N = 8SE +/- 3.21, N = 89.009.169.219.249.349.409.439.529.6910.0610.4311.5313.7015.1415.1717.6818.8119.7523.0026.22

Compile Bench

Test: Read Compiled Tree

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Read Compiled Treeproxima-ceph-raw-writebacktau-nfs-raw-writebacktau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-2x4coresproxima-ceph-raw-writeback-10Gbtau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-nonetau-nfs-qcow2-writeback-swappiness0tau-nfs-qcow2-writebacktau-ceph-raw-writebacktau-ceph-raw-noneproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebackuranus-nfs-qcow2-writeback-4coresuranus-nfs-qcow2-writebacktau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-qcow2-writeback-512MBuranus-ceph-raw-writeback90180270360450SE +/- 9.18, N = 3SE +/- 18.45, N = 3SE +/- 29.15, N = 3SE +/- 28.05, N = 3SE +/- 38.10, N = 3SE +/- 8.42, N = 3SE +/- 11.95, N = 3SE +/- 10.33, N = 3SE +/- 43.62, N = 3SE +/- 9.06, N = 3SE +/- 11.31, N = 3SE +/- 16.55, N = 3SE +/- 2.43, N = 3SE +/- 8.47, N = 3SE +/- 23.85, N = 3SE +/- 14.43, N = 3SE +/- 4.29, N = 3SE +/- 3.34, N = 3SE +/- 7.24, N = 3SE +/- 5.71, N = 3394.08381.07368.87362.30361.40360.36357.30355.84350.62320.70317.47291.32270.29228.21224.87195.60173.52133.61129.84129.15

Compile Bench

Test: Initial Create

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Initial Createtau-nfs-qcow2-writeback-512MBtau-nfs-qcow2-nonetau-nfs-qcow2-writeback-swappiness0tau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writebacktau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-qcow2-writeback-4corestau-nfs-raw-writebacktau-nfs-qcow2-writeback-2x4coresproxima-ceph-raw-writeback-10Gbproxmox1-iscsi-raw-writebackuranus-nfs-qcow2-writeback-4coresuranus-nfs-qcow2-writebacktau-ceph-raw-nonetau-ceph-raw-writebackproxima-ceph-raw-writebackuranus-ceph-raw-writebackproxmox1-local-qcow2-writeback4080120160200SE +/- 5.34, N = 3SE +/- 3.24, N = 3SE +/- 6.72, N = 3SE +/- 3.97, N = 3SE +/- 7.46, N = 3SE +/- 4.41, N = 3SE +/- 5.03, N = 3SE +/- 2.41, N = 3SE +/- 2.15, N = 3SE +/- 3.13, N = 3SE +/- 7.52, N = 3SE +/- 7.11, N = 3SE +/- 5.34, N = 3SE +/- 3.64, N = 3SE +/- 6.77, N = 3SE +/- 2.91, N = 3SE +/- 0.88, N = 3SE +/- 2.47, N = 3SE +/- 2.75, N = 3SE +/- 8.10, N = 3163.97143.00139.69138.23137.37132.61131.96131.30127.86126.12116.3792.2278.1762.2960.8558.7756.0452.3147.6742.72

Compile Bench

Test: Compile

OpenBenchmarking.orgMB/s, More Is BetterCompile Bench 0.6Test: Compileproxmox1-iscsi-raw-writebacktau-nfs-raw-writebacktau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writebacktau-nfs-qcow2-writeback-swappiness0tau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-writeback-2x4corestau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-writeback-512MBtau-nfs-qcow2-noneuranus-nfs-qcow2-writeback-4coresproxima-ceph-raw-writeback-10Gburanus-nfs-qcow2-writebackproxmox1-local-qcow2-writebacktau-ceph-raw-nonetau-ceph-raw-writebackuranus-ceph-raw-writebackproxima-ceph-raw-writeback120240360480600SE +/- 20.59, N = 6SE +/- 32.65, N = 6SE +/- 10.22, N = 6SE +/- 15.07, N = 6SE +/- 23.12, N = 6SE +/- 14.65, N = 6SE +/- 24.96, N = 6SE +/- 26.64, N = 6SE +/- 11.22, N = 6SE +/- 25.53, N = 6SE +/- 22.76, N = 6SE +/- 17.75, N = 6SE +/- 29.17, N = 6SE +/- 5.24, N = 6SE +/- 11.81, N = 6SE +/- 40.64, N = 6SE +/- 2.46, N = 6SE +/- 1.10, N = 3SE +/- 0.83, N = 3SE +/- 1.22, N = 6549.54479.50473.25460.95432.45410.96392.86378.29374.37359.59295.29256.29176.68164.08143.6187.0184.9573.2769.4567.21

Threaded I/O Tester

64MB Random Write - 32 Threads

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 2017050364MB Random Write - 32 Threadstau-nfs-qcow2-writebacktau-nfs-qcow2-writeback-512MBtau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-nonetau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-2x4corestau-nfs-qcow2-writeback-swappiness0tau-nfs-raw-writebacktau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-4GBuranus-nfs-qcow2-writebackuranus-nfs-qcow2-writeback-4coresproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebacktau-ceph-raw-nonetau-ceph-raw-writebackproxima-ceph-raw-writeback-10Gbproxima-ceph-raw-writebackuranus-ceph-raw-writeback6001200180024003000SE +/- 402.73, N = 6SE +/- 534.57, N = 6SE +/- 458.33, N = 6SE +/- 471.96, N = 6SE +/- 697.63, N = 6SE +/- 366.85, N = 6SE +/- 361.45, N = 6SE +/- 254.19, N = 6SE +/- 28.09, N = 3SE +/- 218.60, N = 6SE +/- 171.06, N = 6SE +/- 128.09, N = 6SE +/- 1.03, N = 3SE +/- 4.51, N = 3SE +/- 2.56, N = 6SE +/- 0.20, N = 3SE +/- 0.79, N = 3SE +/- 0.52, N = 4SE +/- 0.22, N = 3SE +/- 0.59, N = 32655.822560.592375.652234.122193.971975.721868.611592.471454.691385.751173.98552.26394.22236.4929.569.457.475.755.044.921. (CC) gcc options: -O2

Threaded I/O Tester

64MB Random Read - 32 Threads

OpenBenchmarking.orgMB/s, More Is BetterThreaded I/O Tester 2017050364MB Random Read - 32 Threadstau-nfs-qcow2-writeback-2x4corestau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-writeback-4coresuranus-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-swappiness0tau-nfs-qcow2-writebacktau-nfs-qcow2-noneuranus-nfs-qcow2-writebackproxmox1-iscsi-raw-writebacktau-nfs-raw-writebackproxmox1-local-qcow2-writebacktau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-qcow2-writeback-512MBproxima-ceph-raw-writeback-10Gburanus-ceph-raw-writebacktau-ceph-raw-writebacktau-ceph-raw-noneproxima-ceph-raw-writeback6K12K18K24K30KSE +/- 1314.96, N = 6SE +/- 391.33, N = 3SE +/- 538.07, N = 6SE +/- 1332.13, N = 6SE +/- 1396.84, N = 6SE +/- 1301.43, N = 6SE +/- 318.12, N = 3SE +/- 714.51, N = 6SE +/- 947.64, N = 6SE +/- 387.45, N = 6SE +/- 160.41, N = 3SE +/- 1608.65, N = 6SE +/- 280.82, N = 6SE +/- 317.29, N = 6SE +/- 1298.31, N = 6SE +/- 113.49, N = 6SE +/- 37.91, N = 6SE +/- 47.98, N = 6SE +/- 53.46, N = 5SE +/- 30.26, N = 326506.2125844.3923408.9422338.1720854.7619855.4816701.0115152.7714397.9211393.6110835.3010509.839167.527714.927312.68540.05539.84486.60437.83405.441. (CC) gcc options: -O2

Dbench

1 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.01 Clientstau-nfs-qcow2-nonetau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-writebacktau-nfs-qcow2-writeback-swappiness0tau-nfs-qcow2-writeback-512MBtau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-writeback-2x4corestau-nfs-raw-writebackuranus-nfs-qcow2-writeback-4coresuranus-nfs-qcow2-writebackproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebackuranus-ceph-raw-writebackproxima-ceph-raw-writeback-10Gbtau-ceph-raw-writebackproxima-ceph-raw-writebacktau-ceph-raw-none70140210280350SE +/- 2.51, N = 3SE +/- 0.85, N = 3SE +/- 1.61, N = 3SE +/- 1.21, N = 3SE +/- 4.50, N = 3SE +/- 0.63, N = 3SE +/- 1.16, N = 3SE +/- 1.04, N = 3SE +/- 1.13, N = 3SE +/- 0.73, N = 3SE +/- 1.08, N = 3SE +/- 0.81, N = 3SE +/- 1.07, N = 6SE +/- 0.18, N = 3SE +/- 0.09, N = 3SE +/- 0.38, N = 6SE +/- 0.39, N = 6SE +/- 0.50, N = 6SE +/- 0.55, N = 6SE +/- 0.30, N = 6317.31304.40304.15298.45295.07285.48283.06273.04270.16257.64237.2196.1980.4466.9424.5012.8012.7811.659.877.751. (CC) gcc options: -lpopt -O2

Dbench

128 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.0128 Clientstau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-2x4corestau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-4cores-swappiness15uranus-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-swappiness0tau-nfs-qcow2-writebacktau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-nonetau-nfs-qcow2-writeback-512MBtau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-raw-writebackuranus-nfs-qcow2-writebackproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebackproxima-ceph-raw-writeback-10Gbtau-ceph-raw-writebackuranus-ceph-raw-writebackproxima-ceph-raw-writebacktau-ceph-raw-none400800120016002000SE +/- 26.38, N = 3SE +/- 11.25, N = 3SE +/- 1.63, N = 3SE +/- 9.30, N = 3SE +/- 32.29, N = 6SE +/- 1.95, N = 3SE +/- 2.08, N = 3SE +/- 5.88, N = 3SE +/- 13.98, N = 3SE +/- 10.58, N = 6SE +/- 3.39, N = 3SE +/- 42.22, N = 6SE +/- 19.34, N = 6SE +/- 2.17, N = 3SE +/- 3.26, N = 6SE +/- 9.37, N = 6SE +/- 3.83, N = 6SE +/- 1.24, N = 3SE +/- 3.42, N = 6SE +/- 5.25, N = 61792.131723.911229.431186.161032.50886.91853.23753.05735.00693.32613.28579.78502.41311.13209.3385.3079.8774.0273.6968.821. (CC) gcc options: -lpopt -O2

Dbench

48 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.048 Clientstau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-2x4corestau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-swappiness0tau-nfs-qcow2-writebacktau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-writeback-512MBuranus-nfs-qcow2-writeback-4corestau-nfs-raw-writebacktau-nfs-qcow2-nonetau-nfs-qcow2-writeback-512MB-swappiness0uranus-nfs-qcow2-writebackproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebackproxima-ceph-raw-writeback-10Gbtau-ceph-raw-nonetau-ceph-raw-writebackuranus-ceph-raw-writebackproxima-ceph-raw-writeback400800120016002000SE +/- 27.38, N = 3SE +/- 5.73, N = 3SE +/- 4.41, N = 3SE +/- 7.67, N = 3SE +/- 7.13, N = 3SE +/- 3.66, N = 3SE +/- 7.40, N = 3SE +/- 8.16, N = 3SE +/- 24.83, N = 6SE +/- 7.72, N = 3SE +/- 5.87, N = 3SE +/- 3.65, N = 3SE +/- 19.16, N = 6SE +/- 1.11, N = 3SE +/- 4.34, N = 6SE +/- 4.87, N = 6SE +/- 5.21, N = 6SE +/- 2.48, N = 6SE +/- 2.55, N = 6SE +/- 4.93, N = 61904.751874.731276.551274.62904.05882.50877.11839.71834.58811.43811.21773.05527.81496.30210.3862.2959.4859.1353.1142.191. (CC) gcc options: -lpopt -O2

Dbench

12 Clients

OpenBenchmarking.orgMB/s, More Is BetterDbench 4.012 Clientstau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-2x4corestau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-writeback-swappiness0tau-nfs-qcow2-writeback-512MBtau-nfs-qcow2-writebacktau-nfs-qcow2-nonetau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-raw-writebackuranus-nfs-qcow2-writeback-4coresuranus-nfs-qcow2-writebackproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebackproxima-ceph-raw-writeback-10Gburanus-ceph-raw-writebacktau-ceph-raw-nonetau-ceph-raw-writebackproxima-ceph-raw-writeback30060090012001500SE +/- 14.52, N = 3SE +/- 11.57, N = 3SE +/- 5.99, N = 3SE +/- 16.43, N = 3SE +/- 5.31, N = 3SE +/- 5.26, N = 3SE +/- 1.96, N = 3SE +/- 8.73, N = 3SE +/- 8.70, N = 3SE +/- 2.11, N = 3SE +/- 56.22, N = 6SE +/- 8.59, N = 3SE +/- 6.95, N = 3SE +/- 0.36, N = 3SE +/- 0.62, N = 3SE +/- 1.58, N = 6SE +/- 1.21, N = 6SE +/- 1.69, N = 6SE +/- 2.16, N = 6SE +/- 1.09, N = 61464.161455.091201.331148.90871.29870.20863.80834.32793.33790.26736.88441.27368.99271.40105.9934.1430.4027.4727.4525.521. (CC) gcc options: -lpopt -O2

FS-Mark

1000 Files, 1MB Size

OpenBenchmarking.orgFiles/s, More Is BetterFS-Mark 3.31000 Files, 1MB Sizetau-nfs-qcow2-writeback-512MBtau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-qcow2-writebacktau-nfs-qcow2-nonetau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-writeback-swappiness0tau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-2x4corestau-nfs-raw-writebackuranus-nfs-qcow2-writeback-4coresuranus-nfs-qcow2-writebackproxmox1-local-qcow2-writebackproxmox1-iscsi-raw-writebackproxima-ceph-raw-writeback-10Gbtau-ceph-raw-writebackuranus-ceph-raw-writebackproxima-ceph-raw-writebacktau-ceph-raw-none90180270360450SE +/- 15.16, N = 6SE +/- 14.31, N = 6SE +/- 14.81, N = 6SE +/- 22.63, N = 6SE +/- 26.35, N = 6SE +/- 13.57, N = 6SE +/- 34.41, N = 6SE +/- 10.22, N = 6SE +/- 2.74, N = 3SE +/- 24.26, N = 6SE +/- 6.75, N = 6SE +/- 9.78, N = 6SE +/- 8.10, N = 6SE +/- 1.19, N = 6SE +/- 0.12, N = 3SE +/- 0.48, N = 6SE +/- 0.15, N = 3SE +/- 1.02, N = 6SE +/- 0.32, N = 6SE +/- 0.36, N = 6404.52385.82385.47365.03359.65340.93340.90317.40308.77294.07192.33114.87101.6851.4735.7314.7010.4310.339.959.931. (CC) gcc options: -static

SQLite

Timed SQLite Insertions

OpenBenchmarking.orgSeconds, Fewer Is BetterSQLite 3.22Timed SQLite Insertionstau-nfs-raw-writebacktau-nfs-qcow2-nonetau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-qcow2-writeback-512MBtau-nfs-qcow2-writeback-4GBtau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-swappiness0tau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-writebacktau-nfs-qcow2-writeback-2x4coresuranus-nfs-qcow2-writeback-4coresuranus-nfs-qcow2-writebackproxmox1-iscsi-raw-writebackproxmox1-local-qcow2-writebackuranus-ceph-raw-writebackproxima-ceph-raw-writeback-10Gbtau-ceph-raw-writebacktau-ceph-raw-noneproxima-ceph-raw-writeback140280420560700SE +/- 0.19, N = 3SE +/- 0.05, N = 3SE +/- 1.05, N = 6SE +/- 0.30, N = 3SE +/- 0.70, N = 6SE +/- 0.51, N = 6SE +/- 0.73, N = 6SE +/- 0.89, N = 6SE +/- 0.53, N = 6SE +/- 1.21, N = 6SE +/- 0.79, N = 6SE +/- 2.12, N = 6SE +/- 2.97, N = 6SE +/- 0.42, N = 3SE +/- 1.97, N = 3SE +/- 33.08, N = 6SE +/- 22.36, N = 6SE +/- 48.37, N = 6SE +/- 40.98, N = 6SE +/- 27.45, N = 611.4313.5714.7516.1916.5416.6016.9617.5717.7017.8918.4038.0141.5350.14233.80436.54461.44571.01634.36667.791. (CC) gcc options: -O2 -ldl -lpthread

AIO-Stress

Random Write

OpenBenchmarking.orgMB/s, More Is BetterAIO-Stress 0.21Random Writeproxmox1-local-qcow2-writebacktau-nfs-qcow2-writeback-4GBproxmox1-iscsi-raw-writebacktau-nfs-qcow2-writeback-4corestau-nfs-qcow2-writeback-1x8corestau-nfs-qcow2-writeback-swappiness0tau-nfs-raw-writebacktau-nfs-qcow2-writeback-512MB-swappiness0tau-nfs-qcow2-writeback-4cores-swappiness15tau-nfs-qcow2-writeback-512MBtau-nfs-qcow2-writebacktau-nfs-qcow2-writeback-2x4corestau-nfs-qcow2-noneuranus-nfs-qcow2-writeback-4coresuranus-nfs-qcow2-writebackproxima-ceph-raw-writeback-10Gbtau-ceph-raw-writebacktau-ceph-raw-noneuranus-ceph-raw-writebackproxima-ceph-raw-writeback90180270360450SE +/- 22.46, N = 6SE +/- 111.52, N = 6SE +/- 27.84, N = 6SE +/- 100.94, N = 6SE +/- 131.41, N = 6SE +/- 116.61, N = 6SE +/- 102.50, N = 6SE +/- 82.15, N = 6SE +/- 119.83, N = 6SE +/- 97.35, N = 6SE +/- 81.52, N = 6SE +/- 92.54, N = 6SE +/- 37.62, N = 6SE +/- 88.79, N = 6SE +/- 7.91, N = 6SE +/- 1.18, N = 3SE +/- 2.47, N = 6SE +/- 1.35, N = 6SE +/- 4.34, N = 6SE +/- 2.19, N = 6400.16371.39360.30343.32335.19324.89314.22311.09294.96278.30254.34253.68240.11209.16124.82113.4090.8278.4575.3775.351. (CC) gcc options: -pthread -laio

Phoronix Test Suite v10.8.4