Google Compute Engine, Amazon EC2, Microsoft Azure Public Compute Cloud Benchmarks

Various instance type benchmarks of different setups on Microsoft Azure, Amazon Elastic Compute Cloud, and Google Compute Engine. Benchmarks by Michael Larabel.

HTML result view exported from: https://openbenchmarking.org/result/1803148-FO-1802221FO54.

Google Compute Engine, Amazon EC2, Microsoft Azure Public Compute Cloud BenchmarksProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemSystem LayerScreen ResolutionEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v2FOrange Flexible Engine s1.large2 x Intel Xeon E5-2666 v3 @ 3.50GHz (18 Cores / 36 Threads)Xen HVM domU (4.2.amazon BIOS)Intel 440FX- 82441FX PMC60416MB28GBCirrus Logic GD 5446Intel 82599 Virtual FunctionUbuntu 16.044.4.0-1050-aws (x86_64)GCC 5.4.0 20160609ext4Xen HVM domU 4.2.amazonIntel Xeon Platinum 8124M @ 3.00GHz (18 Cores / 36 Threads)Amazon EC2 c5.9xlarge (1.0 BIOS)70656MB30GB Amazon Elastic Block StoreDevice 1d0f:ec20KVM2 x Intel Xeon Platinum 8124M @ 3.00GHz (36 Cores / 72 Threads)Amazon EC2 c5.18xlarge (1.0 BIOS)141312MBIntel Xeon Platinum 8175M @ 2.50GHz (8 Cores / 16 Threads)Amazon EC2 m5.4xlarge (1.0 BIOS)63488MBIntel Xeon Platinum 8175M @ 2.50GHz (24 Cores / 48 Threads)Amazon EC2 m5.12xlarge (1.0 BIOS)189440MB2 x Intel Xeon E5-2676 v3 @ 3.00GHz (20 Cores / 40 Threads)Xen HVM domU (4.2.amazon BIOS)161792MB28GBCirrus Logic GD 5446Intel 82599 Virtual FunctionXen HVM domU 4.2.amazon2 x Intel Xeon E5-2686 v4 @ 3.00GHz (32 Cores / 64 Threads)258048MBDevice 1d0f:ec20Intel Xeon Platinum 8175M @ 2.50GHz (1 Core / 2 Threads)Amazon EC2 m5.large (1.0 BIOS)8192MB30GB Amazon Elastic Block StoreKVMIntel Xeon E5-2676 v3 @ 2.39GHz (8 Cores)Xen HVM domU (4.2.amazon BIOS)32768MB28GBCirrus Logic GD 5446Xen HVM domU 4.2.amazonIntel Xeon @ 2.30GHz (4 Cores / 8 Threads)Google Compute Engine8192MB32GB PersistentDiskRed Hat Virtio device4.13.0-1008-gcp (x86_64)KVMIntel Xeon @ 2.30GHz (8 Cores / 16 Threads)15360MBIntel Xeon @ 2.30GHz (4 Cores / 8 Threads)30720MBIntel Xeon @ 2.30GHz (8 Cores / 16 Threads)60416MB11GB PersistentDiskIntel Xeon E5-2673 v3 @ 2.39GHz (2 Cores / 4 Threads)Microsoft Virtual Machine v7.0 (090007 BIOS)Intel 440BX/ZX/DX16384MB32GB Virtual Disk + 34GB Virtual DiskMicrosoft Hyper-V virtual VGA4.13.0-1009-azure (x86_64)1152x864Microsoft Hyper-V ServerIntel Xeon E5-2673 v3 @ 2.39GHz (4 Cores / 8 Threads)32768MB32GB Virtual Disk + 69GB Virtual DiskIntel Xeon E5-2673 v3 @ 2.39GHz (8 Cores / 16 Threads)64512MB32GB Virtual Disk + 137GB Virtual Disk2 x Intel Xeon E5-2673 v3 @ 2.39GHz (16 Cores / 32 Threads)129024MB32GB Virtual Disk + 275GB Virtual Disk2 x Intel Xeon E5-2673 v4 @ 2.29GHz (32 Cores / 64 Threads)258048MB32GB Virtual Disk + 550GB Virtual Disk4.13.0-1011-azure (x86_64)Intel Xeon E5-2673 v4 @ 2.29GHz (2 Cores / 4 Threads)32768MB32GB Virtual Disk + 69GB Virtual Disk4.13.0-1009-azure (x86_64)2 x Intel Xeon E5-2673 v4 @ 2.29GHz (16 Cores / 32 Threads)258048MB32GB Virtual Disk + 550GB Virtual Disk4.13.0-1011-azure (x86_64)Intel Xeon Platinum 8168 @ 2.69GHz (4 Cores / 8 Threads)16384MB32GB Virtual Disk + 69GB Virtual DiskIntel Xeon E5-2658 v4 @ 2.29GHz (2 Cores)Xen HVM domU (4.1.2_115-908.792. BIOS)Intel 440FX- 82441FX PMC1 x 8184 MB RAM39GBCirrus Logic GD 54464.4.0-116-generic (x86_64)Xen HVM domU 4.1.2_115-908.792.OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -vProcessor Details- EC2 c4.8xlarge, EC2 m4.10xlarge, EC2 m4.16xlarge: Scaling Governor: intel_pstate powersavePython Details- Python 2.7.12 + Python 3.5.2Security Details- EC2 c4.8xlarge: KPTI Protection- EC2 c5.9xlarge: KPTI Protection- EC2 c5.18xlarge: KPTI Protection- EC2 m5.4xlarge: KPTI Protection- EC2 m5.12xlarge: KPTI Protection- EC2 m4.10xlarge: KPTI Protection- EC2 m4.16xlarge: KPTI Protection- EC2 m5.large: KPTI Protection- EC2 t2.2xlarge: KPTI Protection- Google n1-highcpu-8: KPTI Protection- Google n1-highcpu-16: KPTI Protection- Google n1-standard-8: KPTI Protection- Google n1-standard-16: KPTI Protection- Microsoft Azure D4s v3: KPTI Protection- Microsoft Azure D8s v3: KPTI Protection- Microsoft Azure D16s v3: KPTI Protection- Microsoft Azure D32s v3: KPTI Protection- Microsoft Azure D64s v3: KPTI + OSB (observable speculation barrier Intel v6) + Full generic retpoline Protection- Microsoft Azure E4s v3: KPTI Protection- Microsoft Azure E32s v3: KPTI + OSB (observable speculation barrier Intel v6) + Full generic retpoline Protection- Microsoft Azure F8s v2: KPTI + OSB (observable speculation barrier Intel v6) + Full generic retpoline Protection- FOrange Flexible Engine s1.large: KPTI + OSB (observable speculation barrier Intel v6) + Full generic retpoline ProtectionKernel Details- EC2 c5.9xlarge, EC2 c5.18xlarge, EC2 m5.4xlarge, EC2 m5.12xlarge, EC2 m5.large: nvme.io_timeout=4294967295

Google Compute Engine, Amazon EC2, Microsoft Azure Public Compute Cloud Benchmarksnpb: EP.Cparboil: OpenMP CUTCProdinia: OpenMP LavaMDmafft: Multiple Sequence Alignmentjohn-the-ripper: Blowfishnero2d: Total Timettsiod-renderer: Phong Rendering With Soft-Shadow Mappingx264: H.264 Video Encodingcompress-7zip: Compress Speed Testbuild-linux-kernel: Time To Compilec-ray: Total Timepovray: Trace Timeencode-mp3: WAV To MP3openssl: RSA 4096-bit Performancejava-jmh: Throughputpybench: Total For Average Test Timesnginx: Static Web Page Servingpybench: Total For Average Test Timesscikit-learn: aobench: 2048 x 2048 - Total Timecrafty: Elapsed TimeEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v2FOrange Flexible Engine s1.large673.144.3952.794.422534136.91419.30107.997808743.516.0935.0837.622579.5756603426109.55164323090.771819164.0955.3964801041256.196.1744.562.723059360.15460.27134.109193337.9911.0032.3535.634671.5060940889045.98145929999.021607190.0858.7069688012512.813.7522.774.236030532.19336.76176.0316082224.485.7217.7435.629303.67121829911181.01145324619.231609190.5258.426974942459.3516.11115.204.3512094115.44184.8355.463664285.7729.4887.1043.901860.9324447443003.95163720160.691792211.8665.4860239921385.495.8039.533.183706948.78504.82129.6611269935.619.9429.8743.575669.1374086333554.07160425555.241777204.5566.216372596627.624.6356.595.782363241.18394.5297.437576245.916.4637.4445.512410.5752821381652.06198721579.292225191.6767.2453696511034.943.1834.108.843909126.13465.90115.3411559833.904.1624.1245.223962.6784002323902.87199221410.502239182.9264.56537806260.9998.07828.9720.001562534.0826.8811.025090641.51152.07617.2841.09242.003178036199.44155912132.511721214.7765.515691579146.2011.46213.704.26606787.04231.0738.4323917106.8316.52563.3342.12174.834217431038.72183718175.242044179.0362.185824045235.7527.80246.307.445256198.33124.6625.9214996164.1640.08152.9345.81540.7010642422187.43187521203.082069272.7474.774839203464.5514.16122.904.9110501130.21234.9652.413025383.2320.8475.8745.561078.8721349296898.72187624005.342063264.8874.224932898233.8727.54245.747.305311193.69129.8126.9316136155.5039.77150.5344.72554.9710676070774.18184625255.902035260.1573.655040959477.9514.16123.244.9610649126.67238.8852.073022984.1720.7675.9244.851091.7321381785010.72185826556.482036252.1472.86525368764.0037.92550.0211.892323391.2174.6413.959144381.9763.05346.1046.62242.105267511004.58196514328.832191196.9668.855106438125.3719.56279.786.614621177.01142.4326.8217015192.6031.97172.1745.77478.4010474890150.44195415431.682193192.6667.425201506243.0010.35144.605.888016100.00249.3346.4830273119.9516.4989.8647.04929.4720355987704.49200713495.312201199.1869.505032857487.265.6572.416.941379257.39381.1981.645702868.618.1645.7245.881889.0041237574200.22194913352.912183199.0867.285120858996.943.2535.2010.041423734.06141.9882.049754946.995.1525.8741.015826.2379724759013.03178312687.561986171.1056.84598587564.9037.25529.8911.862419351.8375.1412.088708386.8063.95378.5246.44376.405147334632.54195915480.882171187.8065.325042429495.735.7169.616.801387852.48381.8771.745654464.628.4648.8543.772893.6039975500322.53184312574.342015181.4963.815029618256.2328.33206.126.335912174.93106.4331.4421252160.2553.48163.1040.511017.4713410992384.58147316486.681631193.8860.80656271449.58921.5015.94136753.0211.305225471.4176.64466.2853.70206.574485811577.68237717902.572636221.8575.544390236OpenBenchmarking.org

NAS Parallel Benchmarks

Test / Class: EP.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: EP.CEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v25001000150020002500SE +/- 3.43, N = 3SE +/- 19.93, N = 3SE +/- 29.39, N = 3SE +/- 1.09, N = 3SE +/- 1.50, N = 3SE +/- 0.96, N = 3SE +/- 1.06, N = 3SE +/- 3.02, N = 3SE +/- 0.08, N = 3SE +/- 2.09, N = 3SE +/- 17.11, N = 3SE +/- 1.37, N = 3SE +/- 3.92, N = 3SE +/- 0.23, N = 3SE +/- 0.54, N = 3SE +/- 1.01, N = 3SE +/- 0.74, N = 3SE +/- 1.86, N = 3SE +/- 0.06, N = 3SE +/- 0.98, N = 3SE +/- 1.49, N = 3673.141256.192512.81459.351385.49627.621034.9460.99146.20235.75464.55233.87477.9564.00125.37243.00487.26996.9464.90495.73256.231. (F9X) gfortran options: -O3 -march=native -pthread -lmpi_usempif08 -lmpi_mpifh -lmpi2. Open MPI 1.10.2

Parboil

Test: OpenMP CUTCP

OpenBenchmarking.orgSeconds, Fewer Is BetterParboil 2.5Test: OpenMP CUTCPEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v2FOrange Flexible Engine s1.large20406080100SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.46, N = 3SE +/- 0.00, N = 3SE +/- 0.09, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.16, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.09, N = 3SE +/- 0.01, N = 3SE +/- 0.11, N = 3SE +/- 0.03, N = 34.396.173.7516.115.804.633.1898.0711.4627.8014.1627.5414.1637.9219.5610.355.653.2537.255.7128.3349.581. (CXX) g++ options: -lm -lpthread -lgomp -ffast-math -fopenmp

Rodinia

Test: OpenMP LavaMD

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 2.4Test: OpenMP LavaMDEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v2FOrange Flexible Engine s1.large2004006008001000SE +/- 0.11, N = 3SE +/- 0.33, N = 3SE +/- 0.16, N = 3SE +/- 2.22, N = 3SE +/- 0.81, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 7.59, N = 3SE +/- 0.03, N = 3SE +/- 0.54, N = 3SE +/- 0.47, N = 3SE +/- 0.90, N = 3SE +/- 0.19, N = 3SE +/- 1.53, N = 3SE +/- 0.06, N = 3SE +/- 0.32, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 2.20, N = 3SE +/- 0.04, N = 3SE +/- 1.61, N = 3SE +/- 0.58, N = 352.7944.5622.77115.2039.5356.5934.10828.97213.70246.30122.90245.74123.24550.02279.78144.6072.4135.20529.8969.61206.12921.501. (CXX) g++ options: -O2 -lOpenCL

Timed MAFFT Alignment

Multiple Sequence Alignment

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MAFFT Alignment 6.864Multiple Sequence AlignmentEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v2FOrange Flexible Engine s1.large510152025SE +/- 0.15, N = 3SE +/- 0.05, N = 3SE +/- 0.21, N = 3SE +/- 0.24, N = 3SE +/- 0.13, N = 3SE +/- 0.59, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.16, N = 3SE +/- 0.10, N = 3SE +/- 0.41, N = 3SE +/- 0.04, N = 3SE +/- 0.26, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.18, N = 3SE +/- 0.13, N = 3SE +/- 0.56, N = 3SE +/- 0.22, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 34.422.724.234.353.185.788.8420.004.267.444.917.304.9611.896.615.886.9410.0411.866.806.3315.941. (CC) gcc options: -O3 -lm -lpthread

John The Ripper

Test: Blowfish

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.8.0Test: BlowfishEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v2FOrange Flexible Engine s1.large13K26K39K52K65KSE +/- 40.45, N = 3SE +/- 26.19, N = 3SE +/- 33.25, N = 3SE +/- 21.00, N = 3SE +/- 41.59, N = 3SE +/- 16.00, N = 3SE +/- 193.12, N = 3SE +/- 23.86, N = 3SE +/- 8.50, N = 3SE +/- 21.36, N = 3SE +/- 6.51, N = 3SE +/- 25.67, N = 3SE +/- 30.95, N = 3SE +/- 22.84, N = 3SE +/- 45.99, N = 3SE +/- 504.49, N = 3SE +/- 166.51, N = 3SE +/- 2.89, N = 3SE +/- 629.45, N = 3SE +/- 29.67, N = 325341305936030512094370692363239091156260675256105015311106492323462180161379214237241913878591213671. (CC) gcc options: -fopenmp -lcrypt

Open FMM Nero2D

Total Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpen FMM Nero2D 2.0.2Total TimeEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v2120240360480600SE +/- 0.13, N = 3SE +/- 0.96, N = 3SE +/- 4.84, N = 3SE +/- 5.00, N = 3SE +/- 7.90, N = 3SE +/- 0.80, N = 3SE +/- 0.13, N = 3SE +/- 8.89, N = 3SE +/- 0.42, N = 3SE +/- 0.57, N = 3SE +/- 6.47, N = 3SE +/- 0.90, N = 3SE +/- 1.34, N = 3SE +/- 0.35, N = 3SE +/- 0.89, N = 3SE +/- 0.02, N = 3SE +/- 0.13, N = 3SE +/- 0.33, N = 3SE +/- 0.74, N = 3SE +/- 0.33, N = 3SE +/- 1.35, N = 336.9160.1532.19115.4448.7841.1826.13534.0887.04198.33130.21193.69126.67391.21177.01100.0057.3934.06351.8352.48174.931. (CXX) g++ options: -O2 -lfftw3 -llapack -lblas -lgfortran -lquadmath -lm -pthread -lmpi_cxx -lmpi

TTSIOD 3D Renderer

Phong Rendering With Soft-Shadow Mapping

OpenBenchmarking.orgFPS, More Is BetterTTSIOD 3D Renderer 2.3aPhong Rendering With Soft-Shadow MappingEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v2FOrange Flexible Engine s1.large110220330440550SE +/- 3.14, N = 3SE +/- 4.23, N = 3SE +/- 12.51, N = 3SE +/- 0.49, N = 3SE +/- 4.78, N = 3SE +/- 3.29, N = 3SE +/- 20.68, N = 3SE +/- 2.30, N = 3SE +/- 0.39, N = 3SE +/- 0.39, N = 3SE +/- 2.14, N = 3SE +/- 0.50, N = 3SE +/- 1.87, N = 3SE +/- 0.19, N = 3SE +/- 0.38, N = 3SE +/- 1.45, N = 3SE +/- 5.69, N = 3SE +/- 1.98, N = 3SE +/- 0.10, N = 3SE +/- 4.11, N = 3SE +/- 0.20, N = 3SE +/- 0.11, N = 3419.30460.27336.76184.83504.82394.52465.9026.88231.07124.66234.96129.81238.8874.64142.43249.33381.19141.9875.14381.87106.4353.021. (CXX) g++ options: -O3 -fomit-frame-pointer -ffast-math -mtune=native -flto -msse -mrecip -mfpmath=sse -msse2 -mssse3 -lSDL -lstdc++

x264

H.264 Video Encoding

OpenBenchmarking.orgFrames Per Second, More Is Betterx264 2018-02-05H.264 Video EncodingEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v2FOrange Flexible Engine s1.large4080120160200SE +/- 0.30, N = 3SE +/- 0.49, N = 3SE +/- 1.46, N = 3SE +/- 0.55, N = 3SE +/- 0.28, N = 3SE +/- 0.19, N = 3SE +/- 1.25, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.14, N = 3SE +/- 0.12, N = 3SE +/- 0.05, N = 3SE +/- 0.24, N = 3SE +/- 0.06, N = 3SE +/- 0.06, N = 3SE +/- 0.18, N = 3SE +/- 0.27, N = 3SE +/- 0.61, N = 3SE +/- 0.01, N = 3SE +/- 0.23, N = 3SE +/- 0.27, N = 3SE +/- 0.02, N = 3107.99134.10176.0355.46129.6697.43115.3411.0238.4325.9252.4126.9352.0713.9526.8246.4881.6482.0412.0871.7431.4411.301. (CC) gcc options: -ldl -m64 -lm -lpthread -O3 -ffast-math -std=gnu99 -fPIC -fomit-frame-pointer -fno-tree-vectorize

7-Zip Compression

Compress Speed Test

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 9.20.1Compress Speed TestEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v2FOrange Flexible Engine s1.large30K60K90K120K150KSE +/- 380.57, N = 3SE +/- 226.61, N = 3SE +/- 319.70, N = 3SE +/- 282.94, N = 3SE +/- 480.06, N = 3SE +/- 280.19, N = 3SE +/- 482.44, N = 3SE +/- 28.62, N = 3SE +/- 86.00, N = 3SE +/- 16.90, N = 3SE +/- 132.53, N = 3SE +/- 75.03, N = 3SE +/- 130.52, N = 3SE +/- 90.16, N = 3SE +/- 88.33, N = 3SE +/- 231.20, N = 3SE +/- 268.12, N = 3SE +/- 416.92, N = 3SE +/- 16.02, N = 3SE +/- 60.61, N = 3SE +/- 244.04, N = 3SE +/- 22.50, N = 378087919331608223664211269975762115598509023917149963025316136302299144170153027357028975498708565442125252251. (CXX) g++ options: -pipe -lpthread

Timed Linux Kernel Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 4.13Time To CompileEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v2FOrange Flexible Engine s1.large140280420560700SE +/- 1.05, N = 3SE +/- 1.57, N = 3SE +/- 1.47, N = 3SE +/- 1.41, N = 3SE +/- 1.57, N = 3SE +/- 1.16, N = 3SE +/- 1.14, N = 3SE +/- 46.62, N = 3SE +/- 0.79, N = 3SE +/- 2.20, N = 3SE +/- 1.19, N = 3SE +/- 1.36, N = 3SE +/- 1.08, N = 3SE +/- 14.52, N = 3SE +/- 1.81, N = 3SE +/- 5.75, N = 3SE +/- 7.94, N = 3SE +/- 11.84, N = 3SE +/- 13.44, N = 3SE +/- 4.86, N = 3SE +/- 14.41, N = 3SE +/- 1.17, N = 343.5137.9924.4885.7735.6145.9133.90641.51106.83164.1683.23155.5084.17381.97192.60119.9568.6146.99386.8064.62160.25471.41

C-Ray

Total Time

OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 1.1Total TimeEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v2FOrange Flexible Engine s1.large306090120150SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 5.71, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.14, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.42, N = 3SE +/- 0.11, N = 3SE +/- 0.02, N = 3SE +/- 0.23, N = 3SE +/- 0.02, N = 36.0911.005.7229.489.946.464.16152.0716.5240.0820.8439.7720.7663.0531.9716.498.165.1563.958.4653.4876.641. (CC) gcc options: -lm -lpthread -O3

POV-Ray

Trace Time

OpenBenchmarking.orgSeconds, Fewer Is BetterPOV-Ray 3.7.0.7Trace TimeEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v2FOrange Flexible Engine s1.large130260390520650SE +/- 0.14, N = 3SE +/- 0.18, N = 3SE +/- 0.13, N = 3SE +/- 0.14, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 40.66, N = 3SE +/- 29.42, N = 3SE +/- 0.04, N = 3SE +/- 0.10, N = 3SE +/- 0.31, N = 3SE +/- 0.28, N = 3SE +/- 0.27, N = 3SE +/- 0.04, N = 3SE +/- 0.27, N = 3SE +/- 0.04, N = 3SE +/- 0.16, N = 3SE +/- 0.16, N = 3SE +/- 0.18, N = 3SE +/- 0.17, N = 3SE +/- 1.03, N = 335.0832.3517.7487.1029.8737.4424.12617.28563.33152.9375.87150.5375.92346.10172.1789.8645.7225.87378.5248.85163.10466.281. (CXX) g++ options: -pipe -O3 -ffast-math -march=native -pthread -lSDL -lSM -lICE -lX11 -ltiff -ljpeg -lpng -lz -lrt -lm -lboost_thread -lboost_system

LAME MP3 Encoding

WAV To MP3

OpenBenchmarking.orgSeconds, Fewer Is BetterLAME MP3 Encoding 3.100WAV To MP3EC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v2FOrange Flexible Engine s1.large1224364860SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.17, N = 3SE +/- 1.71, N = 3SE +/- 0.03, N = 3SE +/- 0.36, N = 3SE +/- 0.05, N = 3SE +/- 0.11, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 0.04, N = 3SE +/- 0.10, N = 3SE +/- 0.32, N = 3SE +/- 0.33, N = 3SE +/- 0.03, N = 337.6235.6335.6243.9043.5745.5145.2241.0942.1245.8145.5644.7244.8546.6245.7747.0445.8841.0146.4443.7740.5153.701. (CC) gcc options: -lm

OpenSSL

RSA 4096-bit Performance

OpenBenchmarking.orgSigns Per Second, More Is BetterOpenSSL 1.1.0fRSA 4096-bit PerformanceEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v2FOrange Flexible Engine s1.large2K4K6K8K10KSE +/- 2.55, N = 3SE +/- 1.27, N = 3SE +/- 19.65, N = 3SE +/- 2.33, N = 3SE +/- 13.34, N = 3SE +/- 2.05, N = 3SE +/- 4.00, N = 3SE +/- 0.95, N = 3SE +/- 1.37, N = 3SE +/- 21.05, N = 3SE +/- 37.17, N = 3SE +/- 34.32, N = 3SE +/- 49.53, N = 3SE +/- 2.80, N = 3SE +/- 0.31, N = 3SE +/- 1.62, N = 3SE +/- 1.96, N = 3SE +/- 35.20, N = 3SE +/- 0.35, N = 3SE +/- 4.11, N = 3SE +/- 3.69, N = 3SE +/- 0.43, N = 32579.574671.509303.671860.935669.132410.573962.67242.00174.83540.701078.87554.971091.73242.10478.40929.471889.005826.23376.402893.601017.47206.571. (CC) gcc options: -O3 -pthread -m64 -lssl -lcrypto -ldl

Java JMH

Throughput

OpenBenchmarking.orgOps/s, More Is BetterJava JMHThroughputEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v2FOrange Flexible Engine s1.large30000M60000M90000M120000M150000M56603426109.5560940889045.98121829911181.0124447443003.9574086333554.0752821381652.0684002323902.873178036199.444217431038.7210642422187.4321349296898.7210676070774.1821381785010.725267511004.5810474890150.4420355987704.4941237574200.2279724759013.035147334632.5439975500322.5313410992384.584485811577.68

PyBench

Total For Average Test Times

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyBench 2008-08-14Total For Average Test TimesEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v2FOrange Flexible Engine s1.large5001000150020002500SE +/- 6.00, N = 3SE +/- 4.41, N = 3SE +/- 7.42, N = 3SE +/- 8.33, N = 3SE +/- 11.46, N = 3SE +/- 6.23, N = 3SE +/- 2.03, N = 3SE +/- 4.91, N = 3SE +/- 5.93, N = 3SE +/- 1.33, N = 3SE +/- 10.17, N = 3SE +/- 9.50, N = 3SE +/- 3.61, N = 3SE +/- 0.58, N = 3SE +/- 14.74, N = 3SE +/- 13.86, N = 3SE +/- 2.73, N = 3SE +/- 2.85, N = 31643145914531637160419871992155918371875187618461858196519542007194917831959184314732377

NGINX Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterNGINX Benchmark 1.9.9Static Web Page ServingEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v2FOrange Flexible Engine s1.large6K12K18K24K30KSE +/- 451.84, N = 3SE +/- 54.82, N = 3SE +/- 78.50, N = 3SE +/- 92.03, N = 3SE +/- 146.75, N = 3SE +/- 101.19, N = 3SE +/- 279.06, N = 3SE +/- 188.83, N = 3SE +/- 798.70, N = 3SE +/- 341.39, N = 3SE +/- 91.80, N = 3SE +/- 98.84, N = 3SE +/- 73.63, N = 3SE +/- 1.63, N = 3SE +/- 25.54, N = 3SE +/- 117.02, N = 3SE +/- 619.74, N = 2SE +/- 226.15, N = 3SE +/- 142.39, N = 3SE +/- 297.47, N = 3SE +/- 150.79, N = 3SE +/- 94.93, N = 323090.7729999.0224619.2320160.6925555.2421579.2921410.5012132.5118175.2421203.0824005.3425255.9026556.4814328.8315431.6813495.3113352.9112687.5615480.8812574.3416486.6817902.571. (CC) gcc options: -lpthread -lcrypt -lcrypto -lz -O3 -march=native

NAS Parallel Benchmarks

Performance / Cost - Test / Class: EP.C

OpenBenchmarking.orgTotal Mop/s Per Dollar, More Is BetterNAS Parallel Benchmarks 3.3Performance / Cost - Test / Class: EP.CEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v250K100K150K200K250K33657.00125619.00251281.0045935.0069274.5020920.6734498.006099.007310.0023575.0046455.0023387.0047795.003200.006268.5012150.0024363.0024923.501081.6716524.3325623.001. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 43 Seconds: cost approximately 0.02 dollar.2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 26 Seconds: cost approximately 0.01 dollar.3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 16 Seconds: cost approximately 0.01 dollar.4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute: cost approximately 0.01 dollar.5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 24 Seconds: cost approximately 0.02 dollar.6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 47 Seconds: cost approximately 0.03 dollar.7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 30 Seconds: cost approximately 0.03 dollar.8. EC2 m5.large: $0.096 reported cost per hour, test consumed 7 Minutes, 9 Seconds: cost approximately 0.01 dollar.9. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 3 Minutes, 1 Second: cost approximately 0.02 dollar.10. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 1 Minute, 54 Seconds: cost approximately 0.01 dollar. 11. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 1 Minute: cost approximately 0.01 dollar.12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.01 dollar. 13. Google n1-standard-16: $0.533 reported cost per hour, test consumed 58 Seconds: cost approximately 0.01 dollar.14. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 6 Minutes, 47 Seconds: cost approximately 0.02 dollar. 15. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 3 Minutes, 30 Seconds: cost approximately 0.02 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 1 Minute, 50 Seconds: cost approximately 0.02 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 58 Seconds: cost approximately 0.02 dollar.18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 52 Seconds: cost approximately 0.04 dollar.19. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 6 Minutes, 41 Seconds: cost approximately 0.06 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 57 Seconds: cost approximately 0.03 dollar.21. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 45 Seconds: cost approximately 0.01 dollar.

Rodinia

Performance / Cost - Test: OpenMP LavaMD

OpenBenchmarking.orgSeconds x Dollar, Fewer Is BetterRodinia 2.4Performance / Cost - Test: OpenMP LavaMDEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v23060901201503.702.671.378.063.165.663.4158.0314.969.854.9214.747.3949.5025.1813.016.523.17116.589.0512.371. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 2 Minutes, 42 Seconds: cost approximately 0.07 dollar.2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.06 dollar.3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 12 Seconds: cost approximately 0.06 dollar.4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 5 Minutes, 50 Seconds: cost approximately 0.07 dollar.5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 3 Seconds: cost approximately 0.08 dollar.6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 54 Seconds: cost approximately 0.1 dollar.7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 47 Seconds: cost approximately 0.1 dollar.8. EC2 m5.large: $0.096 reported cost per hour, test consumed 41 Minutes, 30 Seconds: cost approximately 0.07 dollar.9. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 10 Minutes, 46 Seconds: cost approximately 0.07 dollar. 10. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 12 Minutes, 23 Seconds: cost approximately 0.04 dollar. 11. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 6 Minutes, 12 Seconds: cost approximately 0.04 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 12 Minutes, 21 Seconds: cost approximately 0.06 dollar. 13. Google n1-standard-16: $0.533 reported cost per hour, test consumed 6 Minutes, 14 Seconds: cost approximately 0.06 dollar. 14. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 27 Minutes, 34 Seconds: cost approximately 0.09 dollar. 15. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 14 Minutes, 4 Seconds: cost approximately 0.09 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 7 Minutes, 18 Seconds: cost approximately 0.09 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 3 Minutes, 41 Seconds: cost approximately 0.09 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 1 Minute, 50 Seconds: cost approximately 0.09 dollar. 19. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 26 Minutes, 34 Seconds: cost approximately 0.22 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 3 Minutes, 33 Seconds: cost approximately 0.13 dollar. 21. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 10 Minutes, 22 Seconds: cost approximately 0.06 dollar.

John The Ripper

Performance / Cost - Test: Blowfish

OpenBenchmarking.orgReal C/S Per Dollar, More Is BetterJohn The Ripper 1.8.0Performance / Cost - Test: BlowfishEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v2110K220K330K440K550K281566.67339922.22354735.29302350.00285146.15214836.36217172.22156200.00303350.00525600.00525050.00531100.00354966.67232300.00231050.00200400.00153244.4479094.4480633.33115650.00295600.001. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.09 dollar.2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.09 dollar.3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 3 Minutes, 22 Seconds: cost approximately 0.17 dollar.4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.04 dollar.5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.13 dollar. 6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 3 Minutes, 22 Seconds: cost approximately 0.11 dollar.7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.18 dollar.8. EC2 m5.large: $0.096 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.01 dollar.9. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 3 Minutes, 19 Seconds: cost approximately 0.02 dollar. 10. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.01 dollar. 11. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.02 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.01 dollar. 13. Google n1-standard-16: $0.533 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.03 dollar. 14. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.01 dollar. 15. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.02 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.04 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 3 Minutes, 23 Seconds: cost approximately 0.09 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 3 Minutes, 27 Seconds: cost approximately 0.18 dollar. 19. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.03 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 3 Minutes, 23 Seconds: cost approximately 0.12 dollar. 21. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.02 dollar.

Open FMM Nero2D

Performance / Cost - Total Time

OpenBenchmarking.orgSeconds x Dollar, Fewer Is BetterOpen FMM Nero2D 2.0.2Performance / Cost - Total TimeEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v212243648601.854.812.908.084.882.881.8321.362.615.955.217.757.6023.4710.626.004.593.0752.775.258.751. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.05 dollar.2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 3 Minutes, 5 Seconds: cost approximately 0.08 dollar.3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 40 Seconds: cost approximately 0.09 dollar.4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 5 Minutes, 51 Seconds: cost approximately 0.07 dollar.5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 30 Seconds: cost approximately 0.1 dollar.6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.07 dollar.7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 23 Seconds: cost approximately 0.07 dollar.8. EC2 m5.large: $0.096 reported cost per hour, test consumed 26 Minutes, 47 Seconds: cost approximately 0.04 dollar.9. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 4 Minutes, 26 Seconds: cost approximately 0.03 dollar. 10. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 9 Minutes, 59 Seconds: cost approximately 0.03 dollar. 11. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 6 Minutes, 35 Seconds: cost approximately 0.04 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 9 Minutes, 45 Seconds: cost approximately 0.04 dollar. 13. Google n1-standard-16: $0.533 reported cost per hour, test consumed 6 Minutes, 24 Seconds: cost approximately 0.06 dollar. 14. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 19 Minutes, 38 Seconds: cost approximately 0.06 dollar. 15. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 8 Minutes, 55 Seconds: cost approximately 0.06 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 5 Minutes, 4 Seconds: cost approximately 0.06 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 56 Seconds: cost approximately 0.08 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 1 Minute, 46 Seconds: cost approximately 0.09 dollar. 19. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 17 Minutes, 39 Seconds: cost approximately 0.15 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 42 Seconds: cost approximately 0.1 dollar. 21. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 8 Minutes, 49 Seconds: cost approximately 0.05 dollar.

TTSIOD 3D Renderer

Performance / Cost - Phong Rendering With Soft-Shadow Mapping

OpenBenchmarking.orgFPS Per Dollar, More Is BetterTTSIOD 3D Renderer 2.3aPerformance / Cost - Phong Rendering With Soft-Shadow MappingEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v25K10K15K20K25K13976.6723013.505612.679241.5016827.3313150.679318.001344.0023107.0012466.0023496.0012981.0023888.007464.0014243.0012466.5012706.331290.732504.679546.755321.501. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 58 Seconds: cost approximately 0.03 dollar.2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 53 Seconds: cost approximately 0.02 dollar.3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 10 Seconds: cost approximately 0.06 dollar.4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 42 Seconds: cost approximately 0.02 dollar.5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 50 Seconds: cost approximately 0.03 dollar.6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 1 Minute: cost approximately 0.03 dollar.7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 54 Seconds: cost approximately 0.05 dollar.8. EC2 m5.large: $0.096 reported cost per hour, test consumed 9 Minutes, 47 Seconds: cost approximately 0.02 dollar.9. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 1 Minute, 26 Seconds: cost approximately 0.01 dollar.10. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 22 Seconds: cost approximately 0.01 dollar. 11. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 1 Minute, 25 Seconds: cost approximately 0.01 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 17 Seconds: cost approximately 0.01 dollar. 13. Google n1-standard-16: $0.533 reported cost per hour, test consumed 1 Minute, 24 Seconds: cost approximately 0.01 dollar. 14. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 3 Minutes, 41 Seconds: cost approximately 0.01 dollar. 15. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 2 Minutes, 6 Seconds: cost approximately 0.01 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 1 Minute, 21 Seconds: cost approximately 0.02 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 1 Minute, 1 Second: cost approximately 0.03 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 13 Seconds: cost approximately 0.11 dollar. 19. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 3 Minutes, 40 Seconds: cost approximately 0.03 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 1 Minute: cost approximately 0.04 dollar.21. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 2 Minutes, 42 Seconds: cost approximately 0.02 dollar.

x264

Performance / Cost - H.264 Video Encoding

OpenBenchmarking.orgFrames Per Second Per Dollar, More Is Betterx264 2018-02-05Performance / Cost - H.264 Video EncodingEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 t2.2xlargeGoogle n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v24K8K12K16K20K10799.0013410.0017603.005546.0012966.009743.005767.003843.002693.005207.001395.002682.004648.008164.004102.00604.003587.003144.001. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 21 Seconds: cost approximately 0.01 dollar.2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar.3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 15 Seconds: cost approximately 0.01 dollar.4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 37 Seconds: cost approximately 0.01 dollar.5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar.6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 23 Seconds: cost approximately 0.01 dollar.7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 20 Seconds: cost approximately 0.02 dollar.8. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 51 Seconds: cost approximately 0.01 dollar.9. Google n1-standard-8: $0.268 reported cost per hour, test consumed 1 Minute, 11 Seconds: cost approximately 0.01 dollar. 10. Google n1-standard-16: $0.533 reported cost per hour, test consumed 39 Seconds: cost approximately 0.01 dollar.11. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 2 Minutes, 13 Seconds: cost approximately 0.01 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 11 Seconds: cost approximately 0.01 dollar. 13. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 43 Seconds: cost approximately 0.01 dollar.14. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 26 Seconds: cost approximately 0.01 dollar.15. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 27 Seconds: cost approximately 0.02 dollar.16. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 2 Minutes, 33 Seconds: cost approximately 0.02 dollar. 17. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 29 Seconds: cost approximately 0.02 dollar.18. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 1 Second: cost approximately 0.01 dollar.

7-Zip Compression

Performance / Cost - Compress Speed Test

OpenBenchmarking.orgMIPS Per Dollar, More Is Better7-Zip Compression 9.20.1Performance / Cost - Compress Speed TestEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v2600K1200K1800K2400K3000K1561740.002298325.001462018.181832100.001609985.711082314.29770653.332391700.001499600.003025300.001613600.001511450.00914400.001701500.001513650.00950466.67750376.92870800.00706800.002125200.001. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 51 Seconds: cost approximately 0.05 dollar.2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 39 Seconds: cost approximately 0.04 dollar.3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 2 Minutes, 6 Seconds: cost approximately 0.11 dollar.4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 38 Seconds: cost approximately 0.02 dollar.5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.07 dollar.6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 14 Seconds: cost approximately 0.07 dollar.7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 45 Seconds: cost approximately 0.15 dollar.8. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 1 Minute, 14 Seconds: cost approximately 0.01 dollar.9. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 1 Minute, 52 Seconds: cost approximately 0.01 dollar. 10. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.01 dollar. 11. Google n1-standard-8: $0.268 reported cost per hour, test consumed 1 Minute, 46 Seconds: cost approximately 0.01 dollar. 12. Google n1-standard-16: $0.533 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.02 dollar. 13. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 1 Minute, 36 Seconds: cost approximately 0.01 dollar. 14. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 42 Seconds: cost approximately 0.01 dollar. 15. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.02 dollar. 16. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 11 Seconds: cost approximately 0.06 dollar. 17. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 37 Seconds: cost approximately 0.13 dollar. 18. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 1 Minute, 39 Seconds: cost approximately 0.01 dollar. 19. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 12 Seconds: cost approximately 0.08 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 24 Seconds: cost approximately 0.01 dollar.

Timed Linux Kernel Compilation

Performance / Cost - Time To Compile

OpenBenchmarking.orgSeconds x Dollar, Fewer Is BetterTimed Linux Kernel Compilation 4.13Performance / Cost - Time To CompileEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v214284256703.052.281.965.152.854.133.7332.084.274.922.506.223.3722.9211.569.606.866.5861.898.408.011. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 2 Minutes, 35 Seconds: cost approximately 0.07 dollar.2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 2 Minutes, 13 Seconds: cost approximately 0.06 dollar.3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 36 Seconds: cost approximately 0.08 dollar.4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 4 Minutes, 41 Seconds: cost approximately 0.06 dollar.5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 9 Seconds: cost approximately 0.08 dollar.6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 43 Seconds: cost approximately 0.09 dollar.7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 8 Seconds: cost approximately 0.11 dollar.8. EC2 m5.large: $0.096 reported cost per hour, test consumed 32 Minutes, 29 Seconds: cost approximately 0.05 dollar.9. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 5 Minutes, 41 Seconds: cost approximately 0.04 dollar. 10. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 8 Minutes, 37 Seconds: cost approximately 0.03 dollar. 11. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 4 Minutes, 33 Seconds: cost approximately 0.03 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 8 Minutes, 10 Seconds: cost approximately 0.04 dollar. 13. Google n1-standard-16: $0.533 reported cost per hour, test consumed 4 Minutes, 42 Seconds: cost approximately 0.04 dollar. 14. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 19 Minutes, 32 Seconds: cost approximately 0.06 dollar. 15. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 10 Minutes, 4 Seconds: cost approximately 0.06 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 6 Minutes, 27 Seconds: cost approximately 0.08 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 3 Minutes, 52 Seconds: cost approximately 0.1 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 47 Seconds: cost approximately 0.14 dollar. 19. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 19 Minutes, 46 Seconds: cost approximately 0.16 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 3 Minutes, 40 Seconds: cost approximately 0.13 dollar. 21. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 8 Minutes, 24 Seconds: cost approximately 0.05 dollar.

C-Ray

Performance / Cost - Total Time

OpenBenchmarking.orgSeconds x Dollar, Fewer Is BetterC-Ray 1.1Performance / Cost - Total TimeEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v20.4320.8641.2961.7282.160.060.220.110.590.200.060.081.520.170.400.210.400.210.630.320.160.080.101.920.171.071. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 23 Seconds: cost approximately 0.01 dollar.2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 38 Seconds: cost approximately 0.02 dollar.3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 21 Seconds: cost approximately 0.02 dollar.4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 33 Seconds: cost approximately 0.02 dollar.5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 34 Seconds: cost approximately 0.02 dollar.6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 23 Seconds: cost approximately 0.01 dollar.7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 17 Seconds: cost approximately 0.02 dollar.8. EC2 m5.large: $0.096 reported cost per hour, test consumed 7 Minutes, 40 Seconds: cost approximately 0.01 dollar.9. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 54 Seconds: cost approximately 0.01 dollar.10. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 5 Seconds: cost approximately 0.01 dollar. 11. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 1 Minute, 7 Seconds: cost approximately 0.01 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 3 Seconds: cost approximately 0.01 dollar. 13. Google n1-standard-16: $0.533 reported cost per hour, test consumed 1 Minute, 7 Seconds: cost approximately 0.01 dollar. 14. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 3 Minutes, 14 Seconds: cost approximately 0.01 dollar. 15. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 40 Seconds: cost approximately 0.01 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 54 Seconds: cost approximately 0.01 dollar.17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 29 Seconds: cost approximately 0.01 dollar.18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 20 Seconds: cost approximately 0.02 dollar.19. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 3 Minutes, 16 Seconds: cost approximately 0.03 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 30 Seconds: cost approximately 0.02 dollar.21. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 2 Minutes, 45 Seconds: cost approximately 0.02 dollar.

POV-Ray

Performance / Cost - Trace Time

OpenBenchmarking.orgSeconds x Dollar, Fewer Is BetterPOV-Ray 3.7.0.7Performance / Cost - Trace TimeEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v2204060801001.751.621.065.232.092.621.9330.86101.404.592.284.523.0420.7710.335.392.742.0760.564.898.161. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 57 Seconds: cost approximately 0.05 dollar.2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 48 Seconds: cost approximately 0.05 dollar.3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.06 dollar.4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 4 Minutes, 34 Seconds: cost approximately 0.06 dollar.5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 42 Seconds: cost approximately 0.07 dollar.6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 5 Seconds: cost approximately 0.07 dollar.7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 25 Seconds: cost approximately 0.08 dollar.8. EC2 m5.large: $0.096 reported cost per hour, test consumed 31 Minutes, 4 Seconds: cost approximately 0.05 dollar.9. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 28 Minutes, 22 Seconds: cost approximately 0.18 dollar. 10. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 7 Minutes, 51 Seconds: cost approximately 0.03 dollar. 11. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 3 Minutes, 59 Seconds: cost approximately 0.03 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 7 Minutes, 44 Seconds: cost approximately 0.03 dollar. 13. Google n1-standard-16: $0.533 reported cost per hour, test consumed 4 Minutes: cost approximately 0.04 dollar.14. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 17 Minutes, 31 Seconds: cost approximately 0.06 dollar. 15. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 8 Minutes, 50 Seconds: cost approximately 0.06 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 4 Minutes, 42 Seconds: cost approximately 0.06 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 30 Seconds: cost approximately 0.06 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 1 Minute, 31 Seconds: cost approximately 0.08 dollar. 19. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 19 Minutes, 9 Seconds: cost approximately 0.16 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 41 Seconds: cost approximately 0.1 dollar. 21. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 8 Minutes, 22 Seconds: cost approximately 0.05 dollar.

LAME MP3 Encoding

Performance / Cost - WAV To MP3

OpenBenchmarking.orgSeconds x Dollar, Fewer Is BetterLAME MP3 Encoding 3.100Performance / Cost - WAV To MP3EC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v21.22182.44363.66544.88726.1091.881.783.211.323.923.645.430.420.460.910.450.900.470.921.412.754.510.933.500.411. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.05 dollar.2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 51 Seconds: cost approximately 0.05 dollar.3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 51 Seconds: cost approximately 0.09 dollar.4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 2 Minutes, 16 Seconds: cost approximately 0.03 dollar.5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 14 Seconds: cost approximately 0.09 dollar. 6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 21 Seconds: cost approximately 0.08 dollar.7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 19 Seconds: cost approximately 0.12 dollar.8. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 2 Minutes, 10 Seconds: cost approximately 0.01 dollar. 9. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 21 Seconds: cost approximately 0.01 dollar. 10. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 2 Minutes, 21 Seconds: cost approximately 0.02 dollar. 11. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.01 dollar. 12. Google n1-standard-16: $0.533 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.02 dollar. 13. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 2 Minutes, 24 Seconds: cost approximately 0.01 dollar. 14. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 2 Minutes, 21 Seconds: cost approximately 0.02 dollar. 15. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 2 Minutes, 25 Seconds: cost approximately 0.03 dollar. 16. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 22 Seconds: cost approximately 0.06 dollar. 17. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.11 dollar. 18. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 2 Minutes, 23 Seconds: cost approximately 0.02 dollar. 19. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 15 Seconds: cost approximately 0.08 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 2 Minutes, 6 Seconds: cost approximately 0.01 dollar.

OpenSSL

Performance / Cost - RSA 4096-bit Performance

OpenBenchmarking.orgSigns Per Second Per Dollar, More Is BetterOpenSSL 1.1.0fPerformance / Cost - RSA 4096-bit PerformanceEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 t2.2xlargeGoogle n1-highcpu-16Google n1-standard-16Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v240K80K120K160K200K85985.67155716.67155061.17186093.00141728.2560264.2566044.5017483.00107887.00109173.0047840.0092947.0062966.67116524.6037640.0072340.00101747.001. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.03 dollar.2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.03 dollar.3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.06 dollar.4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar.5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.04 dollar.6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.04 dollar.7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.06 dollar.8. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.01 dollar.9. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 10. Google n1-standard-16: $0.533 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.01 dollar. 11. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 12. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 13. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.03 dollar. 14. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.05 dollar. 15. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 16. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.04 dollar. 17. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar.

Java JMH

Performance / Cost - Throughput

OpenBenchmarking.orgOps/s Per Dollar, More Is BetterJava JMHPerformance / Cost - ThroughputEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v2110000M220000M330000M440000M550000M314463478386.39338560494699.89338416419947.25271638255599.44274393827978.04229658181095.91221058747112.82317803619944.00105435775968.00532121109371.50426985937974.40355869025806.00356363083512.00263375550229.00261872253761.00226177641161.00229097634445.67181192634120.5285788910542.33159902001290.12335274809614.501. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 6 Minutes, 58 Seconds: cost approximately 0.18 dollar.2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 6 Minutes, 55 Seconds: cost approximately 0.18 dollar.3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 7 Minutes, 1 Second: cost approximately 0.36 dollar.4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 6 Minutes, 53 Seconds: cost approximately 0.09 dollar.5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 6 Minutes, 57 Seconds: cost approximately 0.27 dollar. 6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 6 Minutes, 59 Seconds: cost approximately 0.23 dollar.7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 7 Minutes, 4 Seconds: cost approximately 0.38 dollar.8. EC2 m5.large: $0.096 reported cost per hour, test consumed 6 Minutes, 47 Seconds: cost approximately 0.01 dollar.9. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 7 Minutes, 14 Seconds: cost approximately 0.04 dollar. 10. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 6 Minutes, 49 Seconds: cost approximately 0.02 dollar. 11. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 6 Minutes, 49 Seconds: cost approximately 0.05 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 6 Minutes, 48 Seconds: cost approximately 0.03 dollar. 13. Google n1-standard-16: $0.533 reported cost per hour, test consumed 6 Minutes, 48 Seconds: cost approximately 0.06 dollar. 14. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 6 Minutes, 49 Seconds: cost approximately 0.02 dollar. 15. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 6 Minutes, 49 Seconds: cost approximately 0.04 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 6 Minutes, 52 Seconds: cost approximately 0.09 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 7 Minutes, 3 Seconds: cost approximately 0.18 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 8 Minutes, 35 Seconds: cost approximately 0.44 dollar. 19. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 6 Minutes, 49 Seconds: cost approximately 0.06 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 7 Minutes, 4 Seconds: cost approximately 0.25 dollar. 21. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 6 Minutes, 48 Seconds: cost approximately 0.04 dollar.

PyBench

Performance / Cost - Total For Average Test Times

OpenBenchmarking.orgMilliseconds x Dollar, Fewer Is BetterPyBench 2008-08-14Performance / Cost - Total For Average Test TimesEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v25010015020025082.1558.36130.7732.74112.28158.96239.0418.3718.7518.7618.4637.1619.6519.5460.21116.94196.1339.18147.4414.731. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 54 Seconds: cost approximately 0.05 dollar.2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 42 Seconds: cost approximately 0.04 dollar.3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 41 Seconds: cost approximately 0.09 dollar.4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.02 dollar.5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 52 Seconds: cost approximately 0.07 dollar.6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.08 dollar.7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 17 Seconds: cost approximately 0.12 dollar.8. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 2 Minutes, 8 Seconds: cost approximately 0.01 dollar.9. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 13 Seconds: cost approximately 0.01 dollar. 10. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 2 Minutes, 11 Seconds: cost approximately 0.01 dollar. 11. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 8 Seconds: cost approximately 0.01 dollar. 12. Google n1-standard-16: $0.533 reported cost per hour, test consumed 2 Minutes, 9 Seconds: cost approximately 0.02 dollar. 13. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 2 Minutes, 20 Seconds: cost approximately 0.01 dollar. 14. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.01 dollar. 15. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 2 Minutes, 25 Seconds: cost approximately 0.03 dollar. 16. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.06 dollar. 17. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 4 Seconds: cost approximately 0.11 dollar. 18. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 2 Minutes, 22 Seconds: cost approximately 0.02 dollar. 19. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 16 Seconds: cost approximately 0.08 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 44 Seconds: cost approximately 0.01 dollar.

NGINX Benchmark

Performance / Cost - Static Web Page Serving

OpenBenchmarking.orgRequests Per Second Per Dollar, More Is BetterNGINX Benchmark 1.9.9Performance / Cost - Static Web Page ServingEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v2300K600K900K1200K1500K192423.08333322.44111905.59288009.86159720.25126937.0079298.151213251.00454381.001060154.00800178.001262795.00663912.00716441.50385792.00134953.1074182.8330208.48258014.6743359.79412167.001. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 4 Minutes, 37 Seconds: cost approximately 0.12 dollar.2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 3 Minutes, 37 Seconds: cost approximately 0.09 dollar.3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 4 Minutes, 22 Seconds: cost approximately 0.22 dollar.4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 5 Minutes, 16 Seconds: cost approximately 0.07 dollar.5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 4 Minutes, 12 Seconds: cost approximately 0.16 dollar. 6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 4 Minutes, 57 Seconds: cost approximately 0.17 dollar.7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 5 Minutes: cost approximately 0.27 dollar.8. EC2 m5.large: $0.096 reported cost per hour, test consumed 8 Minutes, 35 Seconds: cost approximately 0.01 dollar.9. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 5 Minutes, 50 Seconds: cost approximately 0.04 dollar. 10. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 5 Minutes, 3 Seconds: cost approximately 0.02 dollar. 11. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 4 Minutes, 29 Seconds: cost approximately 0.03 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 4 Minutes, 17 Seconds: cost approximately 0.02 dollar. 13. Google n1-standard-16: $0.533 reported cost per hour, test consumed 4 Minutes, 5 Seconds: cost approximately 0.04 dollar. 14. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 7 Minutes, 18 Seconds: cost approximately 0.02 dollar. 15. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 6 Minutes, 47 Seconds: cost approximately 0.04 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 7 Minutes, 44 Seconds: cost approximately 0.1 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 7 Minutes, 5 Seconds: cost approximately 0.18 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 8 Minutes, 12 Seconds: cost approximately 0.42 dollar. 19. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 6 Minutes, 47 Seconds: cost approximately 0.06 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 8 Minutes, 17 Seconds: cost approximately 0.29 dollar. 21. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 6 Minutes, 22 Seconds: cost approximately 0.04 dollar.

PyBench

Total For Average Test Times

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyBench 2018-02-16Total For Average Test TimesEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v2FOrange Flexible Engine s1.large6001200180024003000SE +/- 8.66, N = 3SE +/- 3.48, N = 3SE +/- 3.53, N = 3SE +/- 3.84, N = 3SE +/- 4.51, N = 3SE +/- 4.16, N = 3SE +/- 2.40, N = 3SE +/- 14.67, N = 3SE +/- 0.33, N = 3SE +/- 1.45, N = 3SE +/- 2.52, N = 3SE +/- 4.73, N = 3SE +/- 4.91, N = 3SE +/- 0.88, N = 3SE +/- 12.44, N = 3SE +/- 5.24, N = 3SE +/- 6.08, N = 3SE +/- 11.57, N = 3SE +/- 1.53, N = 3SE +/- 7.51, N = 3SE +/- 2.73, N = 31819160716091792177722252239172120442069206320352036219121932201218319862171201516312636

PyBench

Performance / Cost - Total For Average Test Times

OpenBenchmarking.orgMilliseconds x Dollar, Fewer Is BetterPyBench 2018-02-16Performance / Cost - Total For Average Test TimesEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v270140210280350109.1480.35160.9053.76142.16200.25313.4620.4420.6941.2620.3540.7221.9143.8666.03152.81238.3243.42181.3516.311. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.06 dollar.2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 53 Seconds: cost approximately 0.05 dollar.3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 53 Seconds: cost approximately 0.1 dollar.4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.03 dollar.5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 5 Seconds: cost approximately 0.08 dollar.6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 35 Seconds: cost approximately 0.09 dollar.7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 36 Seconds: cost approximately 0.14 dollar.8. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 2 Minutes, 24 Seconds: cost approximately 0.01 dollar. 9. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 29 Seconds: cost approximately 0.01 dollar. 10. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 2 Minutes, 25 Seconds: cost approximately 0.02 dollar. 11. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 23 Seconds: cost approximately 0.01 dollar. 12. Google n1-standard-16: $0.533 reported cost per hour, test consumed 2 Minutes, 22 Seconds: cost approximately 0.02 dollar. 13. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 2 Minutes, 38 Seconds: cost approximately 0.01 dollar. 14. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 2 Minutes, 37 Seconds: cost approximately 0.02 dollar. 15. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 2 Minutes, 37 Seconds: cost approximately 0.03 dollar. 16. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 36 Seconds: cost approximately 0.07 dollar. 17. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 21 Seconds: cost approximately 0.12 dollar. 18. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 2 Minutes, 40 Seconds: cost approximately 0.02 dollar. 19. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 28 Seconds: cost approximately 0.09 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.01 dollar.

Scikit-Learn

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 0.17.1EC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v2FOrange Flexible Engine s1.large60120180240300SE +/- 0.56, N = 3SE +/- 0.05, N = 3SE +/- 0.17, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 1.48, N = 3SE +/- 0.14, N = 3SE +/- 9.88, N = 3SE +/- 0.08, N = 3SE +/- 0.80, N = 3SE +/- 0.83, N = 3SE +/- 0.62, N = 3SE +/- 0.47, N = 3SE +/- 0.35, N = 3SE +/- 0.52, N = 3SE +/- 0.92, N = 3SE +/- 2.98, N = 3SE +/- 1.42, N = 3SE +/- 1.78, N = 3SE +/- 2.86, N = 3SE +/- 0.09, N = 3SE +/- 0.44, N = 3164.09190.08190.52211.86204.55191.67182.92214.77179.03272.74264.88260.15252.14196.96192.66199.18199.08171.10187.80181.49193.88221.85

Scikit-Learn

Performance / Cost -

OpenBenchmarking.orgSeconds x Dollar, Fewer Is BetterScikit-Learn 0.17.1Performance / Cost -EC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v22040608010036.1045.6293.3529.6679.7761.3389.634.3010.7413.6423.8415.6127.745.9111.5625.8951.7675.2815.0258.089.691. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 8 Minutes, 17 Seconds: cost approximately 0.22 dollar.2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 9 Minutes, 35 Seconds: cost approximately 0.24 dollar.3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 9 Minutes, 36 Seconds: cost approximately 0.49 dollar.4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 10 Minutes, 40 Seconds: cost approximately 0.14 dollar. 5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 10 Minutes, 17 Seconds: cost approximately 0.39 dollar. 6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 9 Minutes, 39 Seconds: cost approximately 0.32 dollar.7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 9 Minutes, 13 Seconds: cost approximately 0.49 dollar.8. EC2 m5.large: $0.096 reported cost per hour, test consumed 10 Minutes, 49 Seconds: cost approximately 0.02 dollar.9. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 9 Minutes, 2 Seconds: cost approximately 0.06 dollar.10. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 13 Minutes, 43 Seconds: cost approximately 0.05 dollar. 11. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 13 Minutes, 19 Seconds: cost approximately 0.09 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 13 Minutes, 4 Seconds: cost approximately 0.06 dollar. 13. Google n1-standard-16: $0.533 reported cost per hour, test consumed 12 Minutes, 40 Seconds: cost approximately 0.11 dollar. 14. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 9 Minutes, 55 Seconds: cost approximately 0.03 dollar. 15. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 9 Minutes, 42 Seconds: cost approximately 0.06 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 10 Minutes, 2 Seconds: cost approximately 0.13 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 10 Minutes, 1 Second: cost approximately 0.26 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 8 Minutes, 37 Seconds: cost approximately 0.44 dollar. 19. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 9 Minutes, 27 Seconds: cost approximately 0.08 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 9 Minutes, 8 Seconds: cost approximately 0.32 dollar. 21. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 9 Minutes, 45 Seconds: cost approximately 0.05 dollar.

AOBench

Size: 2048 x 2048 - Total Time

OpenBenchmarking.orgSeconds, Fewer Is BetterAOBenchSize: 2048 x 2048 - Total TimeEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v2FOrange Flexible Engine s1.large20406080100SE +/- 0.11, N = 3SE +/- 0.38, N = 3SE +/- 0.12, N = 3SE +/- 0.16, N = 3SE +/- 1.07, N = 3SE +/- 0.20, N = 3SE +/- 1.04, N = 3SE +/- 0.50, N = 3SE +/- 0.04, N = 3SE +/- 0.12, N = 3SE +/- 0.10, N = 3SE +/- 0.11, N = 3SE +/- 0.03, N = 3SE +/- 0.22, N = 3SE +/- 0.09, N = 3SE +/- 0.22, N = 3SE +/- 0.07, N = 3SE +/- 0.36, N = 3SE +/- 0.52, N = 3SE +/- 0.57, N = 3SE +/- 0.52, N = 3SE +/- 0.07, N = 355.3958.7058.4265.4866.2167.2464.5665.5162.1874.7774.2273.6572.8668.8567.4269.5067.2856.8465.3263.8160.8075.541. (CC) gcc options: -lm -O3

AOBench

Performance / Cost - Size: 2048 x 2048 - Total Time

OpenBenchmarking.orgSeconds x Dollar, Fewer Is BetterAOBenchPerformance / Cost - Size: 2048 x 2048 - Total TimeEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v236912154.434.708.762.628.617.4011.620.661.240.752.231.472.190.691.353.486.068.531.967.661.221. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 2 Minutes, 50 Seconds: cost approximately 0.08 dollar.2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 3 Minutes: cost approximately 0.08 dollar.3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 2 Minutes, 59 Seconds: cost approximately 0.15 dollar.4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.04 dollar.5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 3 Minutes, 22 Seconds: cost approximately 0.13 dollar. 6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 3 Minutes, 26 Seconds: cost approximately 0.11 dollar.7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 3 Minutes, 18 Seconds: cost approximately 0.18 dollar.8. EC2 m5.large: $0.096 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.01 dollar.9. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 3 Minutes, 11 Seconds: cost approximately 0.02 dollar. 10. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 3 Minutes, 48 Seconds: cost approximately 0.01 dollar. 11. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 3 Minutes, 47 Seconds: cost approximately 0.03 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 3 Minutes, 45 Seconds: cost approximately 0.02 dollar. 13. Google n1-standard-16: $0.533 reported cost per hour, test consumed 3 Minutes, 43 Seconds: cost approximately 0.03 dollar. 14. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 3 Minutes, 31 Seconds: cost approximately 0.01 dollar. 15. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 3 Minutes, 26 Seconds: cost approximately 0.02 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 3 Minutes, 32 Seconds: cost approximately 0.05 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 3 Minutes, 26 Seconds: cost approximately 0.09 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 54 Seconds: cost approximately 0.15 dollar. 19. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.03 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 3 Minutes, 16 Seconds: cost approximately 0.12 dollar. 21. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 3 Minutes, 6 Seconds: cost approximately 0.02 dollar.

Crafty

Elapsed Time

OpenBenchmarking.orgNodes Per Second, More Is BetterCrafty 25.2Elapsed TimeEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v2FOrange Flexible Engine s1.large1.5M3M4.5M6M7.5MSE +/- 24158.72, N = 3SE +/- 7226.78, N = 3SE +/- 7074.19, N = 3SE +/- 7362.69, N = 3SE +/- 2343.50, N = 3SE +/- 24686.39, N = 3SE +/- 14246.76, N = 3SE +/- 87880.44, N = 3SE +/- 3484.54, N = 3SE +/- 18368.33, N = 3SE +/- 3776.53, N = 3SE +/- 7660.06, N = 3SE +/- 33738.56, N = 3SE +/- 22944.13, N = 3SE +/- 30240.43, N = 3SE +/- 22783.95, N = 3SE +/- 65958.25, N = 3SE +/- 4663.73, N = 3SE +/- 35943.27, N = 3SE +/- 108291.70, N = 3SE +/- 27207.60, N = 3SE +/- 6305.85, N = 364801046968801697494260239926372596536965153780625691579582404548392034932898504095952536875106438520150650328575120858598587550424295029618656271443902361. (CC) gcc options: -lstdc++ -fprofile-use -pthread -lm

Crafty

Performance / Cost - Elapsed Time

OpenBenchmarking.orgNodes Per Second Per Dollar, More Is BetterCrafty 25.2Performance / Cost - Elapsed TimeEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 t2.2xlargeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v2140M280M420M560M700M162002600.00174220025.0087186775.00301199600.00106209933.3389494183.3353780620.00582404500.00483920300.00493289800.00504095900.00262684350.00510643800.00520150600.00167761900.00102417160.0066509722.22252121450.0071851685.71656271400.001. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 36 Seconds: cost approximately 0.04 dollar.2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 29 Seconds: cost approximately 0.04 dollar.3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 29 Seconds: cost approximately 0.08 dollar.4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 43 Seconds: cost approximately 0.02 dollar.5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 37 Seconds: cost approximately 0.06 dollar.6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.06 dollar.7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 54 Seconds: cost approximately 0.1 dollar.8. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 1 Minute, 49 Seconds: cost approximately 0.01 dollar.9. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.01 dollar. 10. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 2 Minutes, 5 Seconds: cost approximately 0.01 dollar. 11. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 1 Second: cost approximately 0.01 dollar. 12. Google n1-standard-16: $0.533 reported cost per hour, test consumed 1 Minute, 58 Seconds: cost approximately 0.02 dollar. 13. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 2 Minutes: cost approximately 0.01 dollar.14. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 58 Seconds: cost approximately 0.01 dollar. 15. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 2 Minutes, 2 Seconds: cost approximately 0.03 dollar. 16. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 1 Minute, 59 Seconds: cost approximately 0.05 dollar. 17. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 1 Minute, 43 Seconds: cost approximately 0.09 dollar. 18. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 2 Minutes, 2 Seconds: cost approximately 0.02 dollar. 19. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 2 Seconds: cost approximately 0.07 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 35 Seconds: cost approximately 0.01 dollar.

Parboil

Performance / Cost - Test: OpenMP CUTCP

OpenBenchmarking.orgSeconds x Dollar, Fewer Is BetterParboil 2.5Performance / Cost - Test: OpenMP CUTCPEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeGoogle n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v20.22050.4410.66150.8821.10250.040.060.040.160.060.050.030.980.140.280.140.380.200.100.060.070.750.060.281. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar.2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 22 Seconds: cost approximately 0.01 dollar.3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 16 Seconds: cost approximately 0.01 dollar.4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 53 Seconds: cost approximately 0.01 dollar.5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 21 Seconds: cost approximately 0.01 dollar.6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar.7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 14 Seconds: cost approximately 0.01 dollar.8. EC2 m5.large: $0.096 reported cost per hour, test consumed 4 Minutes, 58 Seconds: cost approximately 0.01 dollar.9. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 47 Seconds: cost approximately 0.01 dollar.10. Google n1-standard-8: $0.268 reported cost per hour, test consumed 1 Minute, 27 Seconds: cost approximately 0.01 dollar. 11. Google n1-standard-16: $0.533 reported cost per hour, test consumed 47 Seconds: cost approximately 0.01 dollar.12. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 1 Minute, 58 Seconds: cost approximately 0.01 dollar. 13. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 3 Seconds: cost approximately 0.01 dollar. 14. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 35 Seconds: cost approximately 0.01 dollar.15. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 23 Seconds: cost approximately 0.01 dollar.16. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 20 Seconds: cost approximately 0.02 dollar.17. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.02 dollar. 18. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 21 Seconds: cost approximately 0.01 dollar.19. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 29 Seconds: cost approximately 0.01 dollar.

Cost To Run Tests

Cost / Price Per Hour

OpenBenchmarking.orgCost / Price Per Hour, Fewer Is BetterCost To Run TestsCost / Price Per HourEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.4xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeEC2 m5.largeGoogle n1-highcpu-8Google n1-highcpu-16Google n1-standard-8Google n1-standard-16Microsoft Azure D4s v3Microsoft Azure D8s v3Microsoft Azure D16s v3Microsoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v3Microsoft Azure F8s v20.67281.34562.01842.69123.3641.351.282.430.892.001.862.810.340.320.480.410.630.470.610.961.592.991.202.190.491. EC2 c4.8xlarge: $1.591 reported cost per hour, running tests consumed 50 Minutes, 46 Seconds: cost approximately 1.35 dollar. 2. EC2 c5.9xlarge: $1.53 reported cost per hour, running tests consumed 50 Minutes, 21 Seconds: cost approximately 1.28 dollar. 3. EC2 c5.18xlarge: $3.06 reported cost per hour, running tests consumed 47 Minutes, 35 Seconds: cost approximately 2.43 dollar. 4. EC2 m5.4xlarge: $0.768 reported cost per hour, running tests consumed 1 Hour, 9 Minutes, 15 Seconds: cost approximately 0.89 dollar. 5. EC2 m5.12xlarge: $2.304 reported cost per hour, running tests consumed 52 Minutes, 9 Seconds: cost approximately 2 dollar. 6. EC2 m4.10xlarge: $2.00 reported cost per hour, running tests consumed 55 Minutes, 55 Seconds: cost approximately 1.86 dollar. 7. EC2 m4.16xlarge: $3.20 reported cost per hour, running tests consumed 52 Minutes, 42 Seconds: cost approximately 2.81 dollar. 8. EC2 m5.large: $0.096 reported cost per hour, running tests consumed 3 Hours, 30 Minutes, 28 Seconds: cost approximately 0.34 dollar. 9. Google n1-highcpu-8: $0.199 reported cost per hour, running tests consumed 1 Hour, 35 Minutes, 11 Seconds: cost approximately 0.32 dollar. 10. Google n1-highcpu-16: $0.399 reported cost per hour, running tests consumed 1 Hour, 12 Minutes, 24 Seconds: cost approximately 0.48 dollar. 11. Google n1-standard-8: $0.268 reported cost per hour, running tests consumed 1 Hour, 32 Minutes, 18 Seconds: cost approximately 0.41 dollar. 12. Google n1-standard-16: $0.533 reported cost per hour, running tests consumed 1 Hour, 11 Minutes, 1 Second: cost approximately 0.63 dollar. 13. Microsoft Azure D4s v3: $0.1920 reported cost per hour, running tests consumed 2 Hours, 27 Minutes, 44 Seconds: cost approximately 0.47 dollar. 14. Microsoft Azure D8s v3: $0.3840 reported cost per hour, running tests consumed 1 Hour, 35 Minutes, 54 Seconds: cost approximately 0.61 dollar. 15. Microsoft Azure D16s v3: $0.7680 reported cost per hour, running tests consumed 1 Hour, 15 Minutes, 19 Seconds: cost approximately 0.96 dollar. 16. Microsoft Azure D32s v3: $1.5360 reported cost per hour, running tests consumed 1 Hour, 2 Minutes, 12 Seconds: cost approximately 1.59 dollar. 17. Microsoft Azure D64s v3: $3.0720 reported cost per hour, running tests consumed 58 Minutes, 25 Seconds: cost approximately 2.99 dollar. 18. Microsoft Azure E4s v3: $0.495 reported cost per hour, running tests consumed 2 Hours, 25 Minutes, 51 Seconds: cost approximately 1.2 dollar. 19. Microsoft Azure E32s v3: $2.1280 reported cost per hour, running tests consumed 1 Hour, 1 Minute, 44 Seconds: cost approximately 2.19 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, running tests consumed 1 Hour, 27 Minutes, 16 Seconds: cost approximately 0.49 dollar.

Timed MAFFT Alignment

Performance / Cost - Multiple Sequence Alignment

OpenBenchmarking.orgSeconds x Dollar, Fewer Is BetterTimed MAFFT Alignment 6.864Performance / Cost - Multiple Sequence AlignmentEC2 c4.8xlargeEC2 c5.9xlargeEC2 c5.18xlargeEC2 m5.12xlargeEC2 m4.10xlargeEC2 m4.16xlargeMicrosoft Azure D32s v3Microsoft Azure D64s v3Microsoft Azure E4s v3Microsoft Azure E32s v30.06750.1350.20250.270.33750.040.030.040.030.060.270.070.300.120.071. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar.2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 12 Seconds: cost approximately 0.01 dollar.3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 17 Seconds: cost approximately 0.01 dollar.4. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 14 Seconds: cost approximately 0.01 dollar.5. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 21 Seconds: cost approximately 0.01 dollar.6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 31 Seconds: cost approximately 0.03 dollar.7. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 24 Seconds: cost approximately 0.01 dollar.8. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 34 Seconds: cost approximately 0.03 dollar.9. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 40 Seconds: cost approximately 0.01 dollar.10. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 25 Seconds: cost approximately 0.01 dollar.


Phoronix Test Suite v10.8.4