CloudSol EC2/VMware comparison

EC2/VMware testing via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/1309168-SO-1309164SO83&sro&grr.

CloudSol EC2/VMware comparisonProcessorMemoryDiskMotherboardChipsetGraphicsNetworkOSKernelCompilerFile-SystemSystem Layerm1.smallM420_1CPU_800MHzm1.mediumM420_1CPU_1700MHzm1.largeM420_2CPU_2600MHzZen_MCS_1CPUm1.xlargeM420_4CPU_3500MHzZen_MCS_2CPUM420_4CPU_4500MHzZen_MCS_4CPUm3.xlargeM420_1CPU_UnlimitedIntel Xeon E5-2650 0 @ 1.80GHz (1 Core)2048MB8GBUbuntu 12.043.2.0-40-virtual (x86_64)GCC 4.6ext4Xen 3.4.3.amazon HypervisorIntel Xeon E5-2450 0 @ 2.10GHz (1 Core)Intel 440BXIntel 440BX/ZX/DX1 x 1024 MB DRAM9GB Virtual diskVMware SVGA IIVMware VMXNET3Debian Linux 7.13.2.0-4-amd64 (x86_64)GCC 4.7VMwareIntel Xeon E5645 @ 2.00GHz (1 Core)4096MB8GBUbuntu 12.043.2.0-40-virtual (x86_64)GCC 4.6Xen 3.4.3.amazon HypervisorIntel Xeon E5-2450 0 @ 2.10GHz (1 Core)Intel 440BXIntel 440BX/ZX/DX1 x 1024 MB DRAM9GB Virtual diskVMware SVGA IIVMware VMXNET3Debian Linux 7.13.2.0-4-amd64 (x86_64)GCC 4.7VMwareIntel Xeon E5-2650 0 @ 1.80GHz (2 Cores)8192MB8GBUbuntu 12.043.2.0-40-virtual (x86_64)GCC 4.6Xen 3.4.3.amazon HypervisorIntel Xeon E5-2450 0 @ 2.10GHz (2 Cores)Intel 440BXIntel 440BX/ZX/DX1 x 1024 MB DRAM9GB Virtual diskVMware SVGA IIVMware VMXNET3Debian Linux 7.13.2.0-4-amd64 (x86_64)GCC 4.7VMwareIntel Xeon X5660 @ 2.79GHz (1 Core)27GB Virtual disk + 32GB Virtual diskUbuntu 12.043.2.0-53-generic (x86_64)GCC 4.6ext3Intel Xeon E5-2650 0 @ 1.80GHz (4 Cores)15360MB8GB3.2.0-40-virtual (x86_64)ext4Xen 3.4.3.amazon HypervisorIntel Xeon E5-2450 0 @ 2.10GHz (4 Cores)Intel 440BXIntel 440BX/ZX/DX1 x 1024 MB DRAM9GB Virtual diskVMware SVGA IIVMware VMXNET3Debian Linux 7.13.2.0-4-amd64 (x86_64)GCC 4.7VMwareIntel Xeon X5660 @ 2.79GHz (2 Cores)1 x 2048 MB DRAM54GB Virtual disk + 32GB Virtual diskUbuntu 12.043.2.0-53-generic (x86_64)GCC 4.6ext3Intel Xeon E5-2450 0 @ 2.10GHz (4 Cores)1 x 4096 MB DRAM9GB Virtual diskDebian Linux 7.13.2.0-4-amd64 (x86_64)GCC 4.7ext4Intel Xeon X5660 @ 2.79GHz (4 Cores)107GB Virtual disk + 32GB Virtual diskUbuntu 12.043.2.0-53-generic (x86_64)GCC 4.6ext3Intel Xeon E5-2670 0 @ 2.60GHz (4 Cores)15360MB8GB3.2.0-40-virtual (x86_64)ext4Xen 3.4.3.amazon HypervisorIntel Xeon E5-2450 0 @ 2.10GHz (1 Core)Intel 440BXIntel 440BX/ZX/DX1 x 1024 MB DRAM9GB Virtual diskVMware SVGA IIVMware VMXNET3Debian Linux 7.13.2.0-4-amd64 (x86_64)GCC 4.7VMwareOpenBenchmarking.orgCompiler Details- m1.small: --build=x86_64-linux-gnu --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-languages=c,c++,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-arch-32=i686 --with-tune=generic -v- M420_1CPU_800MHz: --build=x86_64-linux-gnu --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-languages=c,c++,go,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-arch-32=i586 --with-tune=generic -v- m1.medium: --build=x86_64-linux-gnu --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-languages=c,c++,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-arch-32=i686 --with-tune=generic -v- M420_1CPU_1700MHz: --build=x86_64-linux-gnu --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-languages=c,c++,go,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-arch-32=i586 --with-tune=generic -v- m1.large: --build=x86_64-linux-gnu --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-languages=c,c++,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-arch-32=i686 --with-tune=generic -v- M420_2CPU_2600MHz: --build=x86_64-linux-gnu --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-languages=c,c++,go,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-arch-32=i586 --with-tune=generic -v- Zen_MCS_1CPU: --build=x86_64-linux-gnu --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-languages=c,c++,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-arch-32=i686 --with-tune=generic -v- m1.xlarge: --build=x86_64-linux-gnu --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-languages=c,c++,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-arch-32=i686 --with-tune=generic -v- M420_4CPU_3500MHz: --build=x86_64-linux-gnu --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-languages=c,c++,go,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-arch-32=i586 --with-tune=generic -v- Zen_MCS_2CPU: --build=x86_64-linux-gnu --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-languages=c,c++,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-arch-32=i686 --with-tune=generic -v- M420_4CPU_4500MHz: --build=x86_64-linux-gnu --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-languages=c,c++,go,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-arch-32=i586 --with-tune=generic -v- Zen_MCS_4CPU: --build=x86_64-linux-gnu --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-languages=c,c++,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-arch-32=i686 --with-tune=generic -v- M420_1CPU_Unlimited: --build=x86_64-linux-gnu --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-languages=c,c++,go,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-arch-32=i586 --with-tune=generic -v

CloudSol EC2/VMware comparisonapache: Static Web Page Servingopenssl: RSA 4096-bit Performancecompress-pbzip2: 256MB File Compressiongraphics-magick: Local Adaptive Thresholdinggraphics-magick: HWB Color Spacegraphics-magick: Resizinggraphics-magick: Sharpengraphics-magick: Blurm1.smallM420_1CPU_800MHzm1.mediumM420_1CPU_1700MHzm1.largeM420_2CPU_2600MHzZen_MCS_1CPUm1.xlargeM420_4CPU_3500MHzZen_MCS_2CPUM420_4CPU_4500MHzZen_MCS_4CPUm3.xlargeM420_1CPU_Unlimited1354.9427.30177.101024144101824.8730.02174.861023134102885.1044.4088.012150309223914.0461.8381.592148288215097.8855.5340.0832634414325024.1978.1752.4031724212325804.5167.8759.64337845143510067.9355.9320.2946766025436539.7578.4338.1342965715439885.1467.8030.10531026926528354.7378.7029.48518270204024098.1867.8715.087712495447410451.4693.0718.64611149239705855.6178.2354.473170411131OpenBenchmarking.org

Apache Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterApache Benchmark 2.4.3Static Web Page ServingM420_1CPU_1700MHzM420_1CPU_800MHzM420_1CPU_UnlimitedM420_2CPU_2600MHzM420_4CPU_3500MHzM420_4CPU_4500MHzZen_MCS_1CPUZen_MCS_2CPUZen_MCS_4CPUm1.largem1.mediumm1.smallm1.xlargem3.xlarge5K10K15K20K25KSE +/- 8.85, N = 3SE +/- 26.58, N = 3SE +/- 82.04, N = 5SE +/- 70.38, N = 6SE +/- 119.28, N = 6SE +/- 151.02, N = 6SE +/- 59.36, N = 3SE +/- 171.06, N = 4SE +/- 358.42, N = 5SE +/- 39.65, N = 3SE +/- 2.18, N = 3SE +/- 8.51, N = 3SE +/- 59.26, N = 3SE +/- 89.24, N = 33914.041824.875855.615024.196539.758354.735804.519885.1424098.185097.882885.101354.9410067.9310451.461. (CC) gcc options: -shared -fPIC -O2 -pthread

OpenSSL

RSA 4096-bit Performance

OpenBenchmarking.orgSigns Per Second, More Is BetterOpenSSL 1.0.1cRSA 4096-bit PerformanceM420_1CPU_1700MHzM420_1CPU_800MHzM420_1CPU_UnlimitedM420_2CPU_2600MHzM420_4CPU_3500MHzM420_4CPU_4500MHzZen_MCS_1CPUZen_MCS_2CPUZen_MCS_4CPUm1.largem1.mediumm1.smallm1.xlargem3.xlarge20406080100SE +/- 1.44, N = 6SE +/- 1.18, N = 6SE +/- 0.12, N = 3SE +/- 0.12, N = 3SE +/- 0.33, N = 3SE +/- 0.61, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.18, N = 3SE +/- 0.06, N = 3SE +/- 0.12, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 361.8330.0278.2378.1778.4378.7067.8767.8067.8755.5344.4027.3055.9393.071. (CC) gcc options: -m64 -O3 -lssl -lcrypto -ldl

Parallel BZIP2 Compression

256MB File Compression

OpenBenchmarking.orgSeconds, Fewer Is BetterParallel BZIP2 Compression 1.1.6256MB File CompressionM420_1CPU_1700MHzM420_1CPU_800MHzM420_1CPU_UnlimitedM420_2CPU_2600MHzM420_4CPU_3500MHzM420_4CPU_4500MHzZen_MCS_1CPUZen_MCS_2CPUZen_MCS_4CPUm1.largem1.mediumm1.smallm1.xlargem3.xlarge4080120160200SE +/- 0.36, N = 3SE +/- 0.14, N = 3SE +/- 0.15, N = 3SE +/- 0.36, N = 3SE +/- 0.73, N = 3SE +/- 0.57, N = 6SE +/- 0.16, N = 3SE +/- 0.13, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 2.52, N = 3SE +/- 0.03, N = 3SE +/- 0.05, N = 381.59174.8654.4752.4038.1329.4859.6430.1015.0840.0888.01177.1020.2918.641. (CXX) g++ options: -O2 -pthread -lbz2 -lpthread

GraphicsMagick

Operation: Local Adaptive Thresholding

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.16Operation: Local Adaptive ThresholdingM420_1CPU_1700MHzM420_1CPU_800MHzM420_1CPU_UnlimitedM420_2CPU_2600MHzM420_4CPU_3500MHzM420_4CPU_4500MHzZen_MCS_1CPUZen_MCS_2CPUZen_MCS_4CPUm1.largem1.mediumm1.smallm1.xlargem3.xlarge20406080100SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 321103131425133537732211046611. (CC) gcc options: -std=gnu99 -fopenmp -O2 -pthread -lz -lm -lgomp -lpthread

GraphicsMagick

Operation: HWB Color Space

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.16Operation: HWB Color SpaceM420_1CPU_1700MHzM420_1CPU_800MHzM420_1CPU_UnlimitedM420_2CPU_2600MHzM420_4CPU_3500MHzM420_4CPU_4500MHzZen_MCS_1CPUZen_MCS_2CPUZen_MCS_4CPUm1.largem1.mediumm1.smallm1.xlargem3.xlarge306090120150SE +/- 0.67, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.67, N = 3SE +/- 0.67, N = 3SE +/- 1.20, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 348237072968278102124635024761141. (CC) gcc options: -std=gnu99 -fopenmp -O2 -pthread -lz -lm -lgomp -lpthread

GraphicsMagick

Operation: Resizing

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.16Operation: ResizingM420_1CPU_1700MHzM420_1CPU_800MHzM420_1CPU_UnlimitedM420_2CPU_2600MHzM420_4CPU_3500MHzM420_4CPU_4500MHzZen_MCS_1CPUZen_MCS_2CPUZen_MCS_4CPUm1.largem1.mediumm1.smallm1.xlargem3.xlarge20406080100SE +/- 0.00, N = 3SE +/- 0.20, N = 5SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.67, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 1.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.20, N = 5SE +/- 0.00, N = 3SE +/- 0.00, N = 328134142577045699544301460921. (CC) gcc options: -std=gnu99 -fopenmp -O2 -pthread -lz -lm -lgomp -lpthread

GraphicsMagick

Operation: Sharpen

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.16Operation: SharpenM420_1CPU_1700MHzM420_1CPU_800MHzM420_1CPU_UnlimitedM420_2CPU_2600MHzM420_4CPU_3500MHzM420_4CPU_4500MHzZen_MCS_1CPUZen_MCS_2CPUZen_MCS_4CPUm1.largem1.mediumm1.smallm1.xlargem3.xlarge1020304050SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.25, N = 4SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.34, N = 6SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 38411121520142644149425391. (CC) gcc options: -std=gnu99 -fopenmp -O2 -pthread -lz -lm -lgomp -lpthread

GraphicsMagick

Operation: Blur

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.16Operation: BlurM420_1CPU_1700MHzM420_1CPU_800MHzM420_1CPU_UnlimitedM420_2CPU_2600MHzM420_4CPU_3500MHzM420_4CPU_4500MHzZen_MCS_1CPUZen_MCS_2CPUZen_MCS_4CPUm1.largem1.mediumm1.smallm1.xlargem3.xlarge1632486480SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.50, N = 4SE +/- 0.60, N = 5SE +/- 0.60, N = 6SE +/- 0.00, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.17, N = 6SE +/- 0.00, N = 3SE +/- 0.00, N = 321103132434035527432221043701. (CC) gcc options: -std=gnu99 -fopenmp -O2 -pthread -lz -lm -lgomp -lpthread


Phoronix Test Suite v10.8.4