Google Compute Engine, Amazon EC2, Microsoft Azure Public Compute Cloud Benchmarks Various instance type benchmarks of different setups on Microsoft Azure, Amazon Elastic Compute Cloud, and Google Compute Engine. Benchmarks by Michael Larabel.
HTML result view exported from: https://openbenchmarking.org/result/1803148-FO-1802221FO10&rdt .
Google Compute Engine, Amazon EC2, Microsoft Azure Public Compute Cloud Benchmarks Processor Motherboard Chipset Memory Disk Graphics Network OS Kernel Compiler File-System System Layer Screen Resolution EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge Intel Xeon E5-2676 v3 @ 2.39GHz (8 Cores) Xen HVM domU (4.2.amazon BIOS) Intel 440FX- 82441FX PMC 32768MB 28GB Cirrus Logic GD 5446 Ubuntu 16.04 4.4.0-1050-aws (x86_64) GCC 5.4.0 20160609 ext4 Xen HVM domU 4.2.amazon Intel Xeon Platinum 8175M @ 2.50GHz (8 Cores / 16 Threads) Amazon EC2 m5.4xlarge (1.0 BIOS) 63488MB 30GB Amazon Elastic Block Store Device 1d0f:ec20 KVM Intel Xeon Platinum 8175M @ 2.50GHz (24 Cores / 48 Threads) Amazon EC2 m5.12xlarge (1.0 BIOS) 189440MB Intel Xeon Platinum 8124M @ 3.00GHz (18 Cores / 36 Threads) Amazon EC2 c5.9xlarge (1.0 BIOS) 70656MB 2 x Intel Xeon Platinum 8124M @ 3.00GHz (36 Cores / 72 Threads) Amazon EC2 c5.18xlarge (1.0 BIOS) 141312MB 2 x Intel Xeon E5-2686 v4 @ 3.00GHz (32 Cores / 64 Threads) Xen HVM domU (4.2.amazon BIOS) 258048MB 28GB Cirrus Logic GD 5446 Xen HVM domU 4.2.amazon Intel Xeon Platinum 8175M @ 2.50GHz (1 Core / 2 Threads) Amazon EC2 m5.large (1.0 BIOS) 8192MB 30GB Amazon Elastic Block Store KVM 2 x Intel Xeon E5-2666 v3 @ 3.50GHz (18 Cores / 36 Threads) Xen HVM domU (4.2.amazon BIOS) 60416MB 28GB Cirrus Logic GD 5446 Intel 82599 Virtual Function Xen HVM domU 4.2.amazon 2 x Intel Xeon E5-2676 v3 @ 3.00GHz (20 Cores / 40 Threads) 161792MB Intel Xeon E5-2673 v3 @ 2.39GHz (2 Cores / 4 Threads) Microsoft Virtual Machine v7.0 (090007 BIOS) Intel 440BX/ZX/DX 16384MB 32GB Virtual Disk + 34GB Virtual Disk Microsoft Hyper-V virtual VGA 4.13.0-1009-azure (x86_64) 1152x864 Microsoft Hyper-V Server Intel Xeon E5-2673 v4 @ 2.29GHz (2 Cores / 4 Threads) 32768MB 32GB Virtual Disk + 69GB Virtual Disk Intel Xeon E5-2673 v3 @ 2.39GHz (4 Cores / 8 Threads) Intel Xeon @ 2.30GHz (4 Cores / 8 Threads) Google Compute Engine Intel 440FX- 82441FX PMC 30720MB 32GB PersistentDisk Red Hat Virtio device 4.13.0-1008-gcp (x86_64) KVM 8192MB Intel Xeon @ 2.30GHz (8 Cores / 16 Threads) 60416MB 11GB PersistentDisk 15360MB 32GB PersistentDisk Intel Xeon E5-2673 v3 @ 2.39GHz (8 Cores / 16 Threads) Microsoft Virtual Machine v7.0 (090007 BIOS) Intel 440BX/ZX/DX 64512MB 32GB Virtual Disk + 137GB Virtual Disk Microsoft Hyper-V virtual VGA 4.13.0-1009-azure (x86_64) 1152x864 Microsoft Hyper-V Server 2 x Intel Xeon E5-2673 v3 @ 2.39GHz (16 Cores / 32 Threads) 129024MB 32GB Virtual Disk + 275GB Virtual Disk 2 x Intel Xeon E5-2673 v4 @ 2.29GHz (32 Cores / 64 Threads) 258048MB 32GB Virtual Disk + 550GB Virtual Disk 4.13.0-1011-azure (x86_64) Intel Xeon Platinum 8168 @ 2.69GHz (4 Cores / 8 Threads) 16384MB 32GB Virtual Disk + 69GB Virtual Disk 2 x Intel Xeon E5-2673 v4 @ 2.29GHz (16 Cores / 32 Threads) 258048MB 32GB Virtual Disk + 550GB Virtual Disk Intel Xeon E5-2658 v4 @ 2.29GHz (4 Cores) Xen HVM domU (4.1.2_115-908.792. BIOS) Intel 440FX- 82441FX PMC 1 x 16376 MB RAM 39GB Cirrus Logic GD 5446 4.4.0-116-generic (x86_64) Xen HVM domU 4.1.2_115-908.792. OpenBenchmarking.org Compiler Details - --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v Python Details - Python 2.7.12 + Python 3.5.2 Security Details - EC2 t2.2xlarge: KPTI Protection - EC2 m5.4xlarge: KPTI Protection - EC2 m5.12xlarge: KPTI Protection - EC2 c5.9xlarge: KPTI Protection - EC2 c5.18xlarge: KPTI Protection - EC2 m4.16xlarge: KPTI Protection - EC2 m5.large: KPTI Protection - EC2 c4.8xlarge: KPTI Protection - EC2 m4.10xlarge: KPTI Protection - Microsoft Azure D4s v3: KPTI Protection - Microsoft Azure E4s v3: KPTI Protection - Microsoft Azure D8s v3: KPTI Protection - Google n1-standard-8: KPTI Protection - Google n1-highcpu-8: KPTI Protection - Google n1-standard-16: KPTI Protection - Google n1-highcpu-16: KPTI Protection - Microsoft Azure D16s v3: KPTI Protection - Microsoft Azure D32s v3: KPTI Protection - Microsoft Azure D64s v3: KPTI + OSB (observable speculation barrier Intel v6) + Full generic retpoline Protection - Microsoft Azure F8s v2: KPTI + OSB (observable speculation barrier Intel v6) + Full generic retpoline Protection - Microsoft Azure E32s v3: KPTI + OSB (observable speculation barrier Intel v6) + Full generic retpoline Protection - COrange DFFlexible Engine s1.xlarge: KPTI + OSB (observable speculation barrier Intel v6) + Full generic retpoline Protection Kernel Details - EC2 m5.4xlarge, EC2 m5.12xlarge, EC2 c5.9xlarge, EC2 c5.18xlarge, EC2 m5.large: nvme.io_timeout=4294967295 Processor Details - EC2 m4.16xlarge, EC2 c4.8xlarge, EC2 m4.10xlarge: Scaling Governor: intel_pstate powersave
Google Compute Engine, Amazon EC2, Microsoft Azure Public Compute Cloud Benchmarks npb: EP.C parboil: OpenMP CUTCP rodinia: OpenMP LavaMD mafft: Multiple Sequence Alignment john-the-ripper: Blowfish nero2d: Total Time ttsiod-renderer: Phong Rendering With Soft-Shadow Mapping x264: H.264 Video Encoding compress-7zip: Compress Speed Test build-linux-kernel: Time To Compile c-ray: Total Time povray: Trace Time encode-mp3: WAV To MP3 openssl: RSA 4096-bit Performance java-jmh: Throughput pybench: Total For Average Test Times nginx: Static Web Page Serving pybench: Total For Average Test Times scikit-learn: aobench: 2048 x 2048 - Total Time crafty: Elapsed Time EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 146.20 11.46 213.70 4.26 6067 87.04 231.07 38.43 23917 106.83 16.52 563.33 42.12 174.83 4217431038.72 1837 18175.24 2044 179.03 62.18 5824045 459.35 16.11 115.20 4.35 12094 115.44 184.83 55.46 36642 85.77 29.48 87.10 43.90 1860.93 24447443003.95 1637 20160.69 1792 211.86 65.48 6023992 1385.49 5.80 39.53 3.18 37069 48.78 504.82 129.66 112699 35.61 9.94 29.87 43.57 5669.13 74086333554.07 1604 25555.24 1777 204.55 66.21 6372596 1256.19 6.17 44.56 2.72 30593 60.15 460.27 134.10 91933 37.99 11.00 32.35 35.63 4671.50 60940889045.98 1459 29999.02 1607 190.08 58.70 6968801 2512.81 3.75 22.77 4.23 60305 32.19 336.76 176.03 160822 24.48 5.72 17.74 35.62 9303.67 121829911181.01 1453 24619.23 1609 190.52 58.42 6974942 1034.94 3.18 34.10 8.84 39091 26.13 465.90 115.34 115598 33.90 4.16 24.12 45.22 3962.67 84002323902.87 1992 21410.50 2239 182.92 64.56 5378062 60.99 98.07 828.97 20.00 1562 534.08 26.88 11.02 5090 641.51 152.07 617.28 41.09 242.00 3178036199.44 1559 12132.51 1721 214.77 65.51 5691579 673.14 4.39 52.79 4.42 25341 36.91 419.30 107.99 78087 43.51 6.09 35.08 37.62 2579.57 56603426109.55 1643 23090.77 1819 164.09 55.39 6480104 627.62 4.63 56.59 5.78 23632 41.18 394.52 97.43 75762 45.91 6.46 37.44 45.51 2410.57 52821381652.06 1987 21579.29 2225 191.67 67.24 5369651 64.00 37.92 550.02 11.89 2323 391.21 74.64 13.95 9144 381.97 63.05 346.10 46.62 242.10 5267511004.58 1965 14328.83 2191 196.96 68.85 5106438 64.90 37.25 529.89 11.86 2419 351.83 75.14 12.08 8708 386.80 63.95 378.52 46.44 376.40 5147334632.54 1959 15480.88 2171 187.80 65.32 5042429 125.37 19.56 279.78 6.61 4621 177.01 142.43 26.82 17015 192.60 31.97 172.17 45.77 478.40 10474890150.44 1954 15431.68 2193 192.66 67.42 5201506 233.87 27.54 245.74 7.30 5311 193.69 129.81 26.93 16136 155.50 39.77 150.53 44.72 554.97 10676070774.18 1846 25255.90 2035 260.15 73.65 5040959 235.75 27.80 246.30 7.44 5256 198.33 124.66 25.92 14996 164.16 40.08 152.93 45.81 540.70 10642422187.43 1875 21203.08 2069 272.74 74.77 4839203 477.95 14.16 123.24 4.96 10649 126.67 238.88 52.07 30229 84.17 20.76 75.92 44.85 1091.73 21381785010.72 1858 26556.48 2036 252.14 72.86 5253687 464.55 14.16 122.90 4.91 10501 130.21 234.96 52.41 30253 83.23 20.84 75.87 45.56 1078.87 21349296898.72 1876 24005.34 2063 264.88 74.22 4932898 243.00 10.35 144.60 5.88 8016 100.00 249.33 46.48 30273 119.95 16.49 89.86 47.04 929.47 20355987704.49 2007 13495.31 2201 199.18 69.50 5032857 487.26 5.65 72.41 6.94 13792 57.39 381.19 81.64 57028 68.61 8.16 45.72 45.88 1889.00 41237574200.22 1949 13352.91 2183 199.08 67.28 5120858 996.94 3.25 35.20 10.04 14237 34.06 141.98 82.04 97549 46.99 5.15 25.87 41.01 5826.23 79724759013.03 1783 12687.56 1986 171.10 56.84 5985875 256.23 28.33 206.12 6.33 5912 174.93 106.43 31.44 21252 160.25 53.48 163.10 40.51 1017.47 13410992384.58 1473 16486.68 1631 193.88 60.80 6562714 495.73 5.71 69.61 6.80 13878 52.48 381.87 71.74 56544 64.62 8.46 48.85 43.77 2893.60 39975500322.53 1843 12574.34 2015 181.49 63.81 5029618 26.68 470.58 8.85 2658 98.75 16.46 10121 245.93 38.78 235.04 53.83 404.93 8842237904.79 2382 17661.61 2639 222.51 76.44 4324494 OpenBenchmarking.org
NAS Parallel Benchmarks Test / Class: EP.C OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.3 Test / Class: EP.C EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 500 1000 1500 2000 2500 SE +/- 0.08, N = 3 SE +/- 1.09, N = 3 SE +/- 1.50, N = 3 SE +/- 19.93, N = 3 SE +/- 29.39, N = 3 SE +/- 1.06, N = 3 SE +/- 3.02, N = 3 SE +/- 3.43, N = 3 SE +/- 0.96, N = 3 SE +/- 0.23, N = 3 SE +/- 0.06, N = 3 SE +/- 0.54, N = 3 SE +/- 1.37, N = 3 SE +/- 2.09, N = 3 SE +/- 3.92, N = 3 SE +/- 17.11, N = 3 SE +/- 1.01, N = 3 SE +/- 0.74, N = 3 SE +/- 1.86, N = 3 SE +/- 1.49, N = 3 SE +/- 0.98, N = 3 146.20 459.35 1385.49 1256.19 2512.81 1034.94 60.99 673.14 627.62 64.00 64.90 125.37 233.87 235.75 477.95 464.55 243.00 487.26 996.94 256.23 495.73 1. (F9X) gfortran options: -O3 -march=native -pthread -lmpi_usempif08 -lmpi_mpifh -lmpi 2. Open MPI 1.10.2
Parboil Test: OpenMP CUTCP OpenBenchmarking.org Seconds, Fewer Is Better Parboil 2.5 Test: OpenMP CUTCP EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 20 40 60 80 100 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.06, N = 3 SE +/- 0.46, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.16, N = 3 SE +/- 0.09, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.09, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.11, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 11.46 16.11 5.80 6.17 3.75 3.18 98.07 4.39 4.63 37.92 37.25 19.56 27.54 27.80 14.16 14.16 10.35 5.65 3.25 28.33 5.71 26.68 1. (CXX) g++ options: -lm -lpthread -lgomp -ffast-math -fopenmp
Rodinia Test: OpenMP LavaMD OpenBenchmarking.org Seconds, Fewer Is Better Rodinia 2.4 Test: OpenMP LavaMD EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 200 400 600 800 1000 SE +/- 0.03, N = 3 SE +/- 2.22, N = 3 SE +/- 0.81, N = 3 SE +/- 0.33, N = 3 SE +/- 0.16, N = 3 SE +/- 0.05, N = 3 SE +/- 7.59, N = 3 SE +/- 0.11, N = 3 SE +/- 0.02, N = 3 SE +/- 1.53, N = 3 SE +/- 2.20, N = 3 SE +/- 0.06, N = 3 SE +/- 0.90, N = 3 SE +/- 0.54, N = 3 SE +/- 0.19, N = 3 SE +/- 0.47, N = 3 SE +/- 0.32, N = 3 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 SE +/- 1.61, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 213.70 115.20 39.53 44.56 22.77 34.10 828.97 52.79 56.59 550.02 529.89 279.78 245.74 246.30 123.24 122.90 144.60 72.41 35.20 206.12 69.61 470.58 1. (CXX) g++ options: -O2 -lOpenCL
Timed MAFFT Alignment Multiple Sequence Alignment OpenBenchmarking.org Seconds, Fewer Is Better Timed MAFFT Alignment 6.864 Multiple Sequence Alignment EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 5 10 15 20 25 SE +/- 0.01, N = 3 SE +/- 0.24, N = 3 SE +/- 0.13, N = 3 SE +/- 0.05, N = 3 SE +/- 0.21, N = 3 SE +/- 0.08, N = 3 SE +/- 0.07, N = 3 SE +/- 0.15, N = 3 SE +/- 0.59, N = 3 SE +/- 0.26, N = 3 SE +/- 0.56, N = 3 SE +/- 0.02, N = 3 SE +/- 0.41, N = 3 SE +/- 0.16, N = 3 SE +/- 0.04, N = 3 SE +/- 0.10, N = 3 SE +/- 0.02, N = 3 SE +/- 0.18, N = 3 SE +/- 0.13, N = 3 SE +/- 0.05, N = 3 SE +/- 0.22, N = 3 SE +/- 0.00, N = 3 4.26 4.35 3.18 2.72 4.23 8.84 20.00 4.42 5.78 11.89 11.86 6.61 7.30 7.44 4.96 4.91 5.88 6.94 10.04 6.33 6.80 8.85 1. (CC) gcc options: -O3 -lm -lpthread
John The Ripper Test: Blowfish OpenBenchmarking.org Real C/S, More Is Better John The Ripper 1.8.0 Test: Blowfish EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 13K 26K 39K 52K 65K SE +/- 21.00, N = 3 SE +/- 41.59, N = 3 SE +/- 26.19, N = 3 SE +/- 33.25, N = 3 SE +/- 193.12, N = 3 SE +/- 23.86, N = 3 SE +/- 40.45, N = 3 SE +/- 16.00, N = 3 SE +/- 30.95, N = 3 SE +/- 2.89, N = 3 SE +/- 22.84, N = 3 SE +/- 6.51, N = 3 SE +/- 8.50, N = 3 SE +/- 25.67, N = 3 SE +/- 21.36, N = 3 SE +/- 45.99, N = 3 SE +/- 504.49, N = 3 SE +/- 166.51, N = 3 SE +/- 29.67, N = 3 SE +/- 629.45, N = 3 SE +/- 12.66, N = 3 6067 12094 37069 30593 60305 39091 1562 25341 23632 2323 2419 4621 5311 5256 10649 10501 8016 13792 14237 5912 13878 2658 1. (CC) gcc options: -fopenmp -lcrypt
Open FMM Nero2D Total Time OpenBenchmarking.org Seconds, Fewer Is Better Open FMM Nero2D 2.0.2 Total Time EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 120 240 360 480 600 SE +/- 0.42, N = 3 SE +/- 5.00, N = 3 SE +/- 7.90, N = 3 SE +/- 0.96, N = 3 SE +/- 4.84, N = 3 SE +/- 0.13, N = 3 SE +/- 8.89, N = 3 SE +/- 0.13, N = 3 SE +/- 0.80, N = 3 SE +/- 0.35, N = 3 SE +/- 0.74, N = 3 SE +/- 0.89, N = 3 SE +/- 0.90, N = 3 SE +/- 0.57, N = 3 SE +/- 1.34, N = 3 SE +/- 6.47, N = 3 SE +/- 0.02, N = 3 SE +/- 0.13, N = 3 SE +/- 0.33, N = 3 SE +/- 1.35, N = 3 SE +/- 0.33, N = 3 87.04 115.44 48.78 60.15 32.19 26.13 534.08 36.91 41.18 391.21 351.83 177.01 193.69 198.33 126.67 130.21 100.00 57.39 34.06 174.93 52.48 1. (CXX) g++ options: -O2 -lfftw3 -llapack -lblas -lgfortran -lquadmath -lm -pthread -lmpi_cxx -lmpi
TTSIOD 3D Renderer Phong Rendering With Soft-Shadow Mapping OpenBenchmarking.org FPS, More Is Better TTSIOD 3D Renderer 2.3a Phong Rendering With Soft-Shadow Mapping EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 110 220 330 440 550 SE +/- 0.39, N = 3 SE +/- 0.49, N = 3 SE +/- 4.78, N = 3 SE +/- 4.23, N = 3 SE +/- 12.51, N = 3 SE +/- 20.68, N = 3 SE +/- 2.30, N = 3 SE +/- 3.14, N = 3 SE +/- 3.29, N = 3 SE +/- 0.19, N = 3 SE +/- 0.10, N = 3 SE +/- 0.38, N = 3 SE +/- 0.50, N = 3 SE +/- 0.39, N = 3 SE +/- 1.87, N = 3 SE +/- 2.14, N = 3 SE +/- 1.45, N = 3 SE +/- 5.69, N = 3 SE +/- 1.98, N = 3 SE +/- 0.20, N = 3 SE +/- 4.11, N = 3 SE +/- 0.41, N = 3 231.07 184.83 504.82 460.27 336.76 465.90 26.88 419.30 394.52 74.64 75.14 142.43 129.81 124.66 238.88 234.96 249.33 381.19 141.98 106.43 381.87 98.75 1. (CXX) g++ options: -O3 -fomit-frame-pointer -ffast-math -mtune=native -flto -msse -mrecip -mfpmath=sse -msse2 -mssse3 -lSDL -lstdc++
x264 H.264 Video Encoding OpenBenchmarking.org Frames Per Second, More Is Better x264 2018-02-05 H.264 Video Encoding EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 40 80 120 160 200 SE +/- 0.03, N = 3 SE +/- 0.55, N = 3 SE +/- 0.28, N = 3 SE +/- 0.49, N = 3 SE +/- 1.46, N = 3 SE +/- 1.25, N = 3 SE +/- 0.02, N = 3 SE +/- 0.30, N = 3 SE +/- 0.19, N = 3 SE +/- 0.06, N = 3 SE +/- 0.01, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.14, N = 3 SE +/- 0.24, N = 3 SE +/- 0.12, N = 3 SE +/- 0.18, N = 3 SE +/- 0.27, N = 3 SE +/- 0.61, N = 3 SE +/- 0.27, N = 3 SE +/- 0.23, N = 3 SE +/- 0.06, N = 3 38.43 55.46 129.66 134.10 176.03 115.34 11.02 107.99 97.43 13.95 12.08 26.82 26.93 25.92 52.07 52.41 46.48 81.64 82.04 31.44 71.74 16.46 1. (CC) gcc options: -ldl -m64 -lm -lpthread -O3 -ffast-math -std=gnu99 -fPIC -fomit-frame-pointer -fno-tree-vectorize
7-Zip Compression Compress Speed Test OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 9.20.1 Compress Speed Test EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 30K 60K 90K 120K 150K SE +/- 86.00, N = 3 SE +/- 282.94, N = 3 SE +/- 480.06, N = 3 SE +/- 226.61, N = 3 SE +/- 319.70, N = 3 SE +/- 482.44, N = 3 SE +/- 28.62, N = 3 SE +/- 380.57, N = 3 SE +/- 280.19, N = 3 SE +/- 90.16, N = 3 SE +/- 16.02, N = 3 SE +/- 88.33, N = 3 SE +/- 75.03, N = 3 SE +/- 16.90, N = 3 SE +/- 130.52, N = 3 SE +/- 132.53, N = 3 SE +/- 231.20, N = 3 SE +/- 268.12, N = 3 SE +/- 416.92, N = 3 SE +/- 244.04, N = 3 SE +/- 60.61, N = 3 SE +/- 35.51, N = 3 23917 36642 112699 91933 160822 115598 5090 78087 75762 9144 8708 17015 16136 14996 30229 30253 30273 57028 97549 21252 56544 10121 1. (CXX) g++ options: -pipe -lpthread
Timed Linux Kernel Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 4.13 Time To Compile EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 140 280 420 560 700 SE +/- 0.79, N = 3 SE +/- 1.41, N = 3 SE +/- 1.57, N = 3 SE +/- 1.57, N = 3 SE +/- 1.47, N = 3 SE +/- 1.14, N = 3 SE +/- 46.62, N = 3 SE +/- 1.05, N = 3 SE +/- 1.16, N = 3 SE +/- 14.52, N = 3 SE +/- 13.44, N = 3 SE +/- 1.81, N = 3 SE +/- 1.36, N = 3 SE +/- 2.20, N = 3 SE +/- 1.08, N = 3 SE +/- 1.19, N = 3 SE +/- 5.75, N = 3 SE +/- 7.94, N = 3 SE +/- 11.84, N = 3 SE +/- 14.41, N = 3 SE +/- 4.86, N = 3 SE +/- 1.42, N = 3 106.83 85.77 35.61 37.99 24.48 33.90 641.51 43.51 45.91 381.97 386.80 192.60 155.50 164.16 84.17 83.23 119.95 68.61 46.99 160.25 64.62 245.93
C-Ray Total Time OpenBenchmarking.org Seconds, Fewer Is Better C-Ray 1.1 Total Time EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 30 60 90 120 150 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 5.71, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.14, N = 3 SE +/- 0.11, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.42, N = 3 SE +/- 0.23, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 16.52 29.48 9.94 11.00 5.72 4.16 152.07 6.09 6.46 63.05 63.95 31.97 39.77 40.08 20.76 20.84 16.49 8.16 5.15 53.48 8.46 38.78 1. (CC) gcc options: -lm -lpthread -O3
POV-Ray Trace Time OpenBenchmarking.org Seconds, Fewer Is Better POV-Ray 3.7.0.7 Trace Time EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 130 260 390 520 650 SE +/- 29.42, N = 3 SE +/- 0.14, N = 3 SE +/- 0.03, N = 3 SE +/- 0.18, N = 3 SE +/- 0.13, N = 3 SE +/- 0.07, N = 3 SE +/- 40.66, N = 3 SE +/- 0.14, N = 3 SE +/- 0.02, N = 3 SE +/- 0.27, N = 3 SE +/- 0.16, N = 3 SE +/- 0.04, N = 3 SE +/- 0.31, N = 3 SE +/- 0.04, N = 3 SE +/- 0.28, N = 3 SE +/- 0.10, N = 3 SE +/- 0.27, N = 3 SE +/- 0.04, N = 3 SE +/- 0.16, N = 3 SE +/- 0.17, N = 3 SE +/- 0.18, N = 3 SE +/- 0.18, N = 3 563.33 87.10 29.87 32.35 17.74 24.12 617.28 35.08 37.44 346.10 378.52 172.17 150.53 152.93 75.92 75.87 89.86 45.72 25.87 163.10 48.85 235.04 1. (CXX) g++ options: -pipe -O3 -ffast-math -march=native -pthread -lSDL -lSM -lICE -lX11 -ltiff -ljpeg -lpng -lz -lrt -lm -lboost_thread -lboost_system
LAME MP3 Encoding WAV To MP3 OpenBenchmarking.org Seconds, Fewer Is Better LAME MP3 Encoding 3.100 WAV To MP3 EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 12 24 36 48 60 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.17, N = 3 SE +/- 1.71, N = 3 SE +/- 0.04, N = 3 SE +/- 0.08, N = 3 SE +/- 0.02, N = 3 SE +/- 0.10, N = 3 SE +/- 0.02, N = 3 SE +/- 0.11, N = 3 SE +/- 0.36, N = 3 SE +/- 0.00, N = 3 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 SE +/- 0.33, N = 3 SE +/- 0.32, N = 3 SE +/- 0.02, N = 3 42.12 43.90 43.57 35.63 35.62 45.22 41.09 37.62 45.51 46.62 46.44 45.77 44.72 45.81 44.85 45.56 47.04 45.88 41.01 40.51 43.77 53.83 1. (CC) gcc options: -lm
OpenSSL RSA 4096-bit Performance OpenBenchmarking.org Signs Per Second, More Is Better OpenSSL 1.1.0f RSA 4096-bit Performance EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 2K 4K 6K 8K 10K SE +/- 1.37, N = 3 SE +/- 2.33, N = 3 SE +/- 13.34, N = 3 SE +/- 1.27, N = 3 SE +/- 19.65, N = 3 SE +/- 4.00, N = 3 SE +/- 0.95, N = 3 SE +/- 2.55, N = 3 SE +/- 2.05, N = 3 SE +/- 2.80, N = 3 SE +/- 0.35, N = 3 SE +/- 0.31, N = 3 SE +/- 34.32, N = 3 SE +/- 21.05, N = 3 SE +/- 49.53, N = 3 SE +/- 37.17, N = 3 SE +/- 1.62, N = 3 SE +/- 1.96, N = 3 SE +/- 35.20, N = 3 SE +/- 3.69, N = 3 SE +/- 4.11, N = 3 SE +/- 1.85, N = 3 174.83 1860.93 5669.13 4671.50 9303.67 3962.67 242.00 2579.57 2410.57 242.10 376.40 478.40 554.97 540.70 1091.73 1078.87 929.47 1889.00 5826.23 1017.47 2893.60 404.93 1. (CC) gcc options: -O3 -pthread -m64 -lssl -lcrypto -ldl
Java JMH Throughput OpenBenchmarking.org Ops/s, More Is Better Java JMH Throughput EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 30000M 60000M 90000M 120000M 150000M 4217431038.72 24447443003.95 74086333554.07 60940889045.98 121829911181.01 84002323902.87 3178036199.44 56603426109.55 52821381652.06 5267511004.58 5147334632.54 10474890150.44 10676070774.18 10642422187.43 21381785010.72 21349296898.72 20355987704.49 41237574200.22 79724759013.03 13410992384.58 39975500322.53 8842237904.79
PyBench Total For Average Test Times OpenBenchmarking.org Milliseconds, Fewer Is Better PyBench 2008-08-14 Total For Average Test Times EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 500 1000 1500 2000 2500 SE +/- 4.91, N = 3 SE +/- 8.33, N = 3 SE +/- 11.46, N = 3 SE +/- 4.41, N = 3 SE +/- 7.42, N = 3 SE +/- 6.23, N = 3 SE +/- 2.03, N = 3 SE +/- 6.00, N = 3 SE +/- 14.74, N = 3 SE +/- 9.50, N = 3 SE +/- 10.17, N = 3 SE +/- 5.93, N = 3 SE +/- 1.33, N = 3 SE +/- 3.61, N = 3 SE +/- 0.58, N = 3 SE +/- 2.73, N = 3 SE +/- 13.86, N = 3 SE +/- 2.03, N = 3 1837 1637 1604 1459 1453 1992 1559 1643 1987 1965 1959 1954 1846 1875 1858 1876 2007 1949 1783 1473 1843 2382
NGINX Benchmark Static Web Page Serving OpenBenchmarking.org Requests Per Second, More Is Better NGINX Benchmark 1.9.9 Static Web Page Serving EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 6K 12K 18K 24K 30K SE +/- 798.70, N = 3 SE +/- 92.03, N = 3 SE +/- 146.75, N = 3 SE +/- 54.82, N = 3 SE +/- 78.50, N = 3 SE +/- 279.06, N = 3 SE +/- 188.83, N = 3 SE +/- 451.84, N = 3 SE +/- 101.19, N = 3 SE +/- 1.63, N = 3 SE +/- 142.39, N = 3 SE +/- 25.54, N = 3 SE +/- 98.84, N = 3 SE +/- 341.39, N = 3 SE +/- 73.63, N = 3 SE +/- 91.80, N = 3 SE +/- 117.02, N = 3 SE +/- 619.74, N = 2 SE +/- 226.15, N = 3 SE +/- 150.79, N = 3 SE +/- 297.47, N = 3 SE +/- 38.17, N = 3 18175.24 20160.69 25555.24 29999.02 24619.23 21410.50 12132.51 23090.77 21579.29 14328.83 15480.88 15431.68 25255.90 21203.08 26556.48 24005.34 13495.31 13352.91 12687.56 16486.68 12574.34 17661.61 1. (CC) gcc options: -lpthread -lcrypt -lcrypto -lz -O3 -march=native
NAS Parallel Benchmarks Performance / Cost - Test / Class: EP.C OpenBenchmarking.org Total Mop/s Per Dollar, More Is Better NAS Parallel Benchmarks 3.3 Performance / Cost - Test / Class: EP.C EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 50K 100K 150K 200K 250K 7310.00 45935.00 69274.50 125619.00 251281.00 34498.00 6099.00 33657.00 20920.67 3200.00 1081.67 6268.50 23387.00 23575.00 47795.00 46455.00 12150.00 24363.00 24923.50 25623.00 16524.33 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 3 Minutes, 1 Second: cost approximately 0.02 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute: cost approximately 0.01 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 24 Seconds: cost approximately 0.02 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 26 Seconds: cost approximately 0.01 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 16 Seconds: cost approximately 0.01 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 30 Seconds: cost approximately 0.03 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 7 Minutes, 9 Seconds: cost approximately 0.01 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 43 Seconds: cost approximately 0.02 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 47 Seconds: cost approximately 0.03 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 6 Minutes, 47 Seconds: cost approximately 0.02 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 6 Minutes, 41 Seconds: cost approximately 0.06 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 3 Minutes, 30 Seconds: cost approximately 0.02 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.01 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 1 Minute, 54 Seconds: cost approximately 0.01 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 58 Seconds: cost approximately 0.01 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 1 Minute: cost approximately 0.01 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 1 Minute, 50 Seconds: cost approximately 0.02 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 58 Seconds: cost approximately 0.02 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 52 Seconds: cost approximately 0.04 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 45 Seconds: cost approximately 0.01 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 57 Seconds: cost approximately 0.03 dollar.
Rodinia Performance / Cost - Test: OpenMP LavaMD OpenBenchmarking.org Seconds x Dollar, Fewer Is Better Rodinia 2.4 Performance / Cost - Test: OpenMP LavaMD EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 30 60 90 120 150 14.96 8.06 3.16 2.67 1.37 3.41 58.03 3.70 5.66 49.50 116.58 25.18 14.74 9.85 7.39 4.92 13.01 6.52 3.17 12.37 9.05 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 10 Minutes, 46 Seconds: cost approximately 0.07 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 5 Minutes, 50 Seconds: cost approximately 0.07 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 3 Seconds: cost approximately 0.08 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.06 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 12 Seconds: cost approximately 0.06 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 47 Seconds: cost approximately 0.1 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 41 Minutes, 30 Seconds: cost approximately 0.07 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 2 Minutes, 42 Seconds: cost approximately 0.07 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 54 Seconds: cost approximately 0.1 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 27 Minutes, 34 Seconds: cost approximately 0.09 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 26 Minutes, 34 Seconds: cost approximately 0.22 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 14 Minutes, 4 Seconds: cost approximately 0.09 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 12 Minutes, 21 Seconds: cost approximately 0.06 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 12 Minutes, 23 Seconds: cost approximately 0.04 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 6 Minutes, 14 Seconds: cost approximately 0.06 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 6 Minutes, 12 Seconds: cost approximately 0.04 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 7 Minutes, 18 Seconds: cost approximately 0.09 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 3 Minutes, 41 Seconds: cost approximately 0.09 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 1 Minute, 50 Seconds: cost approximately 0.09 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 10 Minutes, 22 Seconds: cost approximately 0.06 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 3 Minutes, 33 Seconds: cost approximately 0.13 dollar.
John The Ripper Performance / Cost - Test: Blowfish OpenBenchmarking.org Real C/S Per Dollar, More Is Better John The Ripper 1.8.0 Performance / Cost - Test: Blowfish EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 110K 220K 330K 440K 550K 303350.00 302350.00 285146.15 339922.22 354735.29 217172.22 156200.00 281566.67 214836.36 232300.00 80633.33 231050.00 531100.00 525600.00 354966.67 525050.00 200400.00 153244.44 79094.44 295600.00 115650.00 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 3 Minutes, 19 Seconds: cost approximately 0.02 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.04 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.13 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.09 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 3 Minutes, 22 Seconds: cost approximately 0.17 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.18 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.01 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.09 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 3 Minutes, 22 Seconds: cost approximately 0.11 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.01 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.03 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.02 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.01 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.01 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.03 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.02 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.04 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 3 Minutes, 23 Seconds: cost approximately 0.09 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 3 Minutes, 27 Seconds: cost approximately 0.18 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.02 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 3 Minutes, 23 Seconds: cost approximately 0.12 dollar.
Open FMM Nero2D Performance / Cost - Total Time OpenBenchmarking.org Seconds x Dollar, Fewer Is Better Open FMM Nero2D 2.0.2 Performance / Cost - Total Time EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 12 24 36 48 60 2.61 8.08 4.88 4.81 2.90 1.83 21.36 1.85 2.88 23.47 52.77 10.62 7.75 5.95 7.60 5.21 6.00 4.59 3.07 8.75 5.25 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 4 Minutes, 26 Seconds: cost approximately 0.03 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 5 Minutes, 51 Seconds: cost approximately 0.07 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 30 Seconds: cost approximately 0.1 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 3 Minutes, 5 Seconds: cost approximately 0.08 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 40 Seconds: cost approximately 0.09 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 23 Seconds: cost approximately 0.07 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 26 Minutes, 47 Seconds: cost approximately 0.04 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.05 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.07 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 19 Minutes, 38 Seconds: cost approximately 0.06 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 17 Minutes, 39 Seconds: cost approximately 0.15 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 8 Minutes, 55 Seconds: cost approximately 0.06 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 9 Minutes, 45 Seconds: cost approximately 0.04 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 9 Minutes, 59 Seconds: cost approximately 0.03 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 6 Minutes, 24 Seconds: cost approximately 0.06 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 6 Minutes, 35 Seconds: cost approximately 0.04 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 5 Minutes, 4 Seconds: cost approximately 0.06 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 56 Seconds: cost approximately 0.08 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 1 Minute, 46 Seconds: cost approximately 0.09 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 8 Minutes, 49 Seconds: cost approximately 0.05 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 42 Seconds: cost approximately 0.1 dollar.
TTSIOD 3D Renderer Performance / Cost - Phong Rendering With Soft-Shadow Mapping OpenBenchmarking.org FPS Per Dollar, More Is Better TTSIOD 3D Renderer 2.3a Performance / Cost - Phong Rendering With Soft-Shadow Mapping EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 5K 10K 15K 20K 25K 23107.00 9241.50 16827.33 23013.50 5612.67 9318.00 1344.00 13976.67 13150.67 7464.00 2504.67 14243.00 12981.00 12466.00 23888.00 23496.00 12466.50 12706.33 1290.73 5321.50 9546.75 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 1 Minute, 26 Seconds: cost approximately 0.01 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 42 Seconds: cost approximately 0.02 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 50 Seconds: cost approximately 0.03 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 53 Seconds: cost approximately 0.02 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 10 Seconds: cost approximately 0.06 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 54 Seconds: cost approximately 0.05 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 9 Minutes, 47 Seconds: cost approximately 0.02 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 58 Seconds: cost approximately 0.03 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 1 Minute: cost approximately 0.03 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 3 Minutes, 41 Seconds: cost approximately 0.01 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 3 Minutes, 40 Seconds: cost approximately 0.03 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 2 Minutes, 6 Seconds: cost approximately 0.01 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 17 Seconds: cost approximately 0.01 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 22 Seconds: cost approximately 0.01 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 1 Minute, 24 Seconds: cost approximately 0.01 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 1 Minute, 25 Seconds: cost approximately 0.01 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 1 Minute, 21 Seconds: cost approximately 0.02 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 1 Minute, 1 Second: cost approximately 0.03 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 13 Seconds: cost approximately 0.11 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 2 Minutes, 42 Seconds: cost approximately 0.02 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 1 Minute: cost approximately 0.04 dollar.
x264 Performance / Cost - H.264 Video Encoding OpenBenchmarking.org Frames Per Second Per Dollar, More Is Better x264 2018-02-05 Performance / Cost - H.264 Video Encoding EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 4K 8K 12K 16K 20K 3843.00 5546.00 12966.00 13410.00 17603.00 5767.00 10799.00 9743.00 1395.00 604.00 2682.00 2693.00 5207.00 4648.00 8164.00 4102.00 3144.00 3587.00 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 51 Seconds: cost approximately 0.01 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 37 Seconds: cost approximately 0.01 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 15 Seconds: cost approximately 0.01 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 20 Seconds: cost approximately 0.02 dollar. 7. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 21 Seconds: cost approximately 0.01 dollar. 8. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 23 Seconds: cost approximately 0.01 dollar. 9. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 2 Minutes, 13 Seconds: cost approximately 0.01 dollar. 10. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 2 Minutes, 33 Seconds: cost approximately 0.02 dollar. 11. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 11 Seconds: cost approximately 0.01 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 1 Minute, 11 Seconds: cost approximately 0.01 dollar. 13. Google n1-standard-16: $0.533 reported cost per hour, test consumed 39 Seconds: cost approximately 0.01 dollar. 14. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 43 Seconds: cost approximately 0.01 dollar. 15. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 26 Seconds: cost approximately 0.01 dollar. 16. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 27 Seconds: cost approximately 0.02 dollar. 17. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 1 Second: cost approximately 0.01 dollar. 18. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 29 Seconds: cost approximately 0.02 dollar.
7-Zip Compression Performance / Cost - Compress Speed Test OpenBenchmarking.org MIPS Per Dollar, More Is Better 7-Zip Compression 9.20.1 Performance / Cost - Compress Speed Test EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 600K 1200K 1800K 2400K 3000K 2391700.00 1832100.00 1609985.71 2298325.00 1462018.18 770653.33 1561740.00 1082314.29 914400.00 870800.00 1701500.00 1613600.00 1499600.00 1511450.00 3025300.00 1513650.00 950466.67 750376.92 2125200.00 706800.00 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 1 Minute, 14 Seconds: cost approximately 0.01 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 38 Seconds: cost approximately 0.02 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.07 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 39 Seconds: cost approximately 0.04 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 2 Minutes, 6 Seconds: cost approximately 0.11 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 45 Seconds: cost approximately 0.15 dollar. 7. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 51 Seconds: cost approximately 0.05 dollar. 8. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 14 Seconds: cost approximately 0.07 dollar. 9. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 1 Minute, 36 Seconds: cost approximately 0.01 dollar. 10. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 1 Minute, 39 Seconds: cost approximately 0.01 dollar. 11. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 42 Seconds: cost approximately 0.01 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 1 Minute, 46 Seconds: cost approximately 0.01 dollar. 13. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 1 Minute, 52 Seconds: cost approximately 0.01 dollar. 14. Google n1-standard-16: $0.533 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.02 dollar. 15. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.01 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.02 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 11 Seconds: cost approximately 0.06 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 37 Seconds: cost approximately 0.13 dollar. 19. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 24 Seconds: cost approximately 0.01 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 12 Seconds: cost approximately 0.08 dollar.
Timed Linux Kernel Compilation Performance / Cost - Time To Compile OpenBenchmarking.org Seconds x Dollar, Fewer Is Better Timed Linux Kernel Compilation 4.13 Performance / Cost - Time To Compile EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 14 28 42 56 70 4.27 5.15 2.85 2.28 1.96 3.73 32.08 3.05 4.13 22.92 61.89 11.56 6.22 4.92 3.37 2.50 9.60 6.86 6.58 8.01 8.40 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 5 Minutes, 41 Seconds: cost approximately 0.04 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 4 Minutes, 41 Seconds: cost approximately 0.06 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 9 Seconds: cost approximately 0.08 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 2 Minutes, 13 Seconds: cost approximately 0.06 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 36 Seconds: cost approximately 0.08 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 8 Seconds: cost approximately 0.11 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 32 Minutes, 29 Seconds: cost approximately 0.05 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 2 Minutes, 35 Seconds: cost approximately 0.07 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 43 Seconds: cost approximately 0.09 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 19 Minutes, 32 Seconds: cost approximately 0.06 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 19 Minutes, 46 Seconds: cost approximately 0.16 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 10 Minutes, 4 Seconds: cost approximately 0.06 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 8 Minutes, 10 Seconds: cost approximately 0.04 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 8 Minutes, 37 Seconds: cost approximately 0.03 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 4 Minutes, 42 Seconds: cost approximately 0.04 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 4 Minutes, 33 Seconds: cost approximately 0.03 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 6 Minutes, 27 Seconds: cost approximately 0.08 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 3 Minutes, 52 Seconds: cost approximately 0.1 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 47 Seconds: cost approximately 0.14 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 8 Minutes, 24 Seconds: cost approximately 0.05 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 3 Minutes, 40 Seconds: cost approximately 0.13 dollar.
C-Ray Performance / Cost - Total Time OpenBenchmarking.org Seconds x Dollar, Fewer Is Better C-Ray 1.1 Performance / Cost - Total Time EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 0.432 0.864 1.296 1.728 2.16 0.17 0.59 0.20 0.22 0.11 0.08 1.52 0.06 0.06 0.63 1.92 0.32 0.40 0.40 0.21 0.21 0.16 0.08 0.10 1.07 0.17 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 54 Seconds: cost approximately 0.01 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 33 Seconds: cost approximately 0.02 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 34 Seconds: cost approximately 0.02 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 38 Seconds: cost approximately 0.02 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 21 Seconds: cost approximately 0.02 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 17 Seconds: cost approximately 0.02 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 7 Minutes, 40 Seconds: cost approximately 0.01 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 23 Seconds: cost approximately 0.01 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 23 Seconds: cost approximately 0.01 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 3 Minutes, 14 Seconds: cost approximately 0.01 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 3 Minutes, 16 Seconds: cost approximately 0.03 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 40 Seconds: cost approximately 0.01 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 3 Seconds: cost approximately 0.01 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 5 Seconds: cost approximately 0.01 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 1 Minute, 7 Seconds: cost approximately 0.01 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 1 Minute, 7 Seconds: cost approximately 0.01 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 54 Seconds: cost approximately 0.01 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 29 Seconds: cost approximately 0.01 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 20 Seconds: cost approximately 0.02 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 2 Minutes, 45 Seconds: cost approximately 0.02 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 30 Seconds: cost approximately 0.02 dollar.
POV-Ray Performance / Cost - Trace Time OpenBenchmarking.org Seconds x Dollar, Fewer Is Better POV-Ray 3.7.0.7 Performance / Cost - Trace Time EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 20 40 60 80 100 101.40 5.23 2.09 1.62 1.06 1.93 30.86 1.75 2.62 20.77 60.56 10.33 4.52 4.59 3.04 2.28 5.39 2.74 2.07 8.16 4.89 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 28 Minutes, 22 Seconds: cost approximately 0.18 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 4 Minutes, 34 Seconds: cost approximately 0.06 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 42 Seconds: cost approximately 0.07 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 48 Seconds: cost approximately 0.05 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.06 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 25 Seconds: cost approximately 0.08 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 31 Minutes, 4 Seconds: cost approximately 0.05 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 57 Seconds: cost approximately 0.05 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 5 Seconds: cost approximately 0.07 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 17 Minutes, 31 Seconds: cost approximately 0.06 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 19 Minutes, 9 Seconds: cost approximately 0.16 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 8 Minutes, 50 Seconds: cost approximately 0.06 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 7 Minutes, 44 Seconds: cost approximately 0.03 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 7 Minutes, 51 Seconds: cost approximately 0.03 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 4 Minutes: cost approximately 0.04 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 3 Minutes, 59 Seconds: cost approximately 0.03 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 4 Minutes, 42 Seconds: cost approximately 0.06 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 30 Seconds: cost approximately 0.06 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 1 Minute, 31 Seconds: cost approximately 0.08 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 8 Minutes, 22 Seconds: cost approximately 0.05 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 41 Seconds: cost approximately 0.1 dollar.
LAME MP3 Encoding Performance / Cost - WAV To MP3 OpenBenchmarking.org Seconds x Dollar, Fewer Is Better LAME MP3 Encoding 3.100 Performance / Cost - WAV To MP3 EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 1.2218 2.4436 3.6654 4.8872 6.109 0.42 1.32 3.92 1.78 3.21 5.43 1.88 3.64 0.47 0.93 0.92 0.45 0.46 0.90 0.91 1.41 2.75 4.51 0.41 3.50 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 2 Minutes, 10 Seconds: cost approximately 0.01 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 2 Minutes, 16 Seconds: cost approximately 0.03 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 14 Seconds: cost approximately 0.09 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 51 Seconds: cost approximately 0.05 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 51 Seconds: cost approximately 0.09 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 19 Seconds: cost approximately 0.12 dollar. 7. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.05 dollar. 8. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 21 Seconds: cost approximately 0.08 dollar. 9. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 2 Minutes, 24 Seconds: cost approximately 0.01 dollar. 10. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 2 Minutes, 23 Seconds: cost approximately 0.02 dollar. 11. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 2 Minutes, 21 Seconds: cost approximately 0.02 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.01 dollar. 13. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 21 Seconds: cost approximately 0.01 dollar. 14. Google n1-standard-16: $0.533 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.02 dollar. 15. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 2 Minutes, 21 Seconds: cost approximately 0.02 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 2 Minutes, 25 Seconds: cost approximately 0.03 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 22 Seconds: cost approximately 0.06 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.11 dollar. 19. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 2 Minutes, 6 Seconds: cost approximately 0.01 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 15 Seconds: cost approximately 0.08 dollar.
OpenSSL Performance / Cost - RSA 4096-bit Performance OpenBenchmarking.org Signs Per Second Per Dollar, More Is Better OpenSSL 1.1.0f Performance / Cost - RSA 4096-bit Performance EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 40K 80K 120K 160K 200K 17483.00 186093.00 141728.25 155716.67 155061.17 66044.50 85985.67 60264.25 37640.00 47840.00 109173.00 107887.00 92947.00 62966.67 116524.60 101747.00 72340.00 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.01 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.04 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.03 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.06 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.06 dollar. 7. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.03 dollar. 8. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.04 dollar. 9. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 10. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 11. Google n1-standard-16: $0.533 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.01 dollar. 12. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 13. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 14. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.03 dollar. 15. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.05 dollar. 16. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 17. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.04 dollar.
Java JMH Performance / Cost - Throughput OpenBenchmarking.org Ops/s Per Dollar, More Is Better Java JMH Performance / Cost - Throughput EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 110000M 220000M 330000M 440000M 550000M 105435775968.00 271638255599.44 274393827978.04 338560494699.89 338416419947.25 221058747112.82 317803619944.00 314463478386.39 229658181095.91 263375550229.00 85788910542.33 261872253761.00 355869025806.00 532121109371.50 356363083512.00 426985937974.40 226177641161.00 229097634445.67 181192634120.52 335274809614.50 159902001290.12 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 7 Minutes, 14 Seconds: cost approximately 0.04 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 6 Minutes, 53 Seconds: cost approximately 0.09 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 6 Minutes, 57 Seconds: cost approximately 0.27 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 6 Minutes, 55 Seconds: cost approximately 0.18 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 7 Minutes, 1 Second: cost approximately 0.36 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 7 Minutes, 4 Seconds: cost approximately 0.38 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 6 Minutes, 47 Seconds: cost approximately 0.01 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 6 Minutes, 58 Seconds: cost approximately 0.18 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 6 Minutes, 59 Seconds: cost approximately 0.23 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 6 Minutes, 49 Seconds: cost approximately 0.02 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 6 Minutes, 49 Seconds: cost approximately 0.06 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 6 Minutes, 49 Seconds: cost approximately 0.04 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 6 Minutes, 48 Seconds: cost approximately 0.03 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 6 Minutes, 49 Seconds: cost approximately 0.02 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 6 Minutes, 48 Seconds: cost approximately 0.06 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 6 Minutes, 49 Seconds: cost approximately 0.05 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 6 Minutes, 52 Seconds: cost approximately 0.09 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 7 Minutes, 3 Seconds: cost approximately 0.18 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 8 Minutes, 35 Seconds: cost approximately 0.44 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 6 Minutes, 48 Seconds: cost approximately 0.04 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 7 Minutes, 4 Seconds: cost approximately 0.25 dollar.
PyBench Performance / Cost - Total For Average Test Times OpenBenchmarking.org Milliseconds x Dollar, Fewer Is Better PyBench 2008-08-14 Performance / Cost - Total For Average Test Times EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 50 100 150 200 250 18.37 32.74 112.28 58.36 130.77 239.04 82.15 158.96 19.65 39.18 19.54 18.46 18.75 37.16 18.76 60.21 116.94 196.13 14.73 147.44 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 2 Minutes, 8 Seconds: cost approximately 0.01 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.02 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 52 Seconds: cost approximately 0.07 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 42 Seconds: cost approximately 0.04 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 41 Seconds: cost approximately 0.09 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 17 Seconds: cost approximately 0.12 dollar. 7. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 54 Seconds: cost approximately 0.05 dollar. 8. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.08 dollar. 9. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 2 Minutes, 20 Seconds: cost approximately 0.01 dollar. 10. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 2 Minutes, 22 Seconds: cost approximately 0.02 dollar. 11. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.01 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 8 Seconds: cost approximately 0.01 dollar. 13. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 13 Seconds: cost approximately 0.01 dollar. 14. Google n1-standard-16: $0.533 reported cost per hour, test consumed 2 Minutes, 9 Seconds: cost approximately 0.02 dollar. 15. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 2 Minutes, 11 Seconds: cost approximately 0.01 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 2 Minutes, 25 Seconds: cost approximately 0.03 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.06 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 4 Seconds: cost approximately 0.11 dollar. 19. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 44 Seconds: cost approximately 0.01 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 16 Seconds: cost approximately 0.08 dollar.
NGINX Benchmark Performance / Cost - Static Web Page Serving OpenBenchmarking.org Requests Per Second Per Dollar, More Is Better NGINX Benchmark 1.9.9 Performance / Cost - Static Web Page Serving EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 300K 600K 900K 1200K 1500K 454381.00 288009.86 159720.25 333322.44 111905.59 79298.15 1213251.00 192423.08 126937.00 716441.50 258014.67 385792.00 1262795.00 1060154.00 663912.00 800178.00 134953.10 74182.83 30208.48 412167.00 43359.79 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 5 Minutes, 50 Seconds: cost approximately 0.04 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 5 Minutes, 16 Seconds: cost approximately 0.07 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 4 Minutes, 12 Seconds: cost approximately 0.16 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 3 Minutes, 37 Seconds: cost approximately 0.09 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 4 Minutes, 22 Seconds: cost approximately 0.22 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 5 Minutes: cost approximately 0.27 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 8 Minutes, 35 Seconds: cost approximately 0.01 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 4 Minutes, 37 Seconds: cost approximately 0.12 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 4 Minutes, 57 Seconds: cost approximately 0.17 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 7 Minutes, 18 Seconds: cost approximately 0.02 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 6 Minutes, 47 Seconds: cost approximately 0.06 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 6 Minutes, 47 Seconds: cost approximately 0.04 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 4 Minutes, 17 Seconds: cost approximately 0.02 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 5 Minutes, 3 Seconds: cost approximately 0.02 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 4 Minutes, 5 Seconds: cost approximately 0.04 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 4 Minutes, 29 Seconds: cost approximately 0.03 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 7 Minutes, 44 Seconds: cost approximately 0.1 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 7 Minutes, 5 Seconds: cost approximately 0.18 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 8 Minutes, 12 Seconds: cost approximately 0.42 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 6 Minutes, 22 Seconds: cost approximately 0.04 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 8 Minutes, 17 Seconds: cost approximately 0.29 dollar.
PyBench Total For Average Test Times OpenBenchmarking.org Milliseconds, Fewer Is Better PyBench 2018-02-16 Total For Average Test Times EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 600 1200 1800 2400 3000 SE +/- 0.33, N = 3 SE +/- 3.84, N = 3 SE +/- 4.51, N = 3 SE +/- 3.48, N = 3 SE +/- 3.53, N = 3 SE +/- 2.40, N = 3 SE +/- 14.67, N = 3 SE +/- 8.66, N = 3 SE +/- 4.16, N = 3 SE +/- 0.88, N = 3 SE +/- 11.57, N = 3 SE +/- 12.44, N = 3 SE +/- 4.73, N = 3 SE +/- 1.45, N = 3 SE +/- 4.91, N = 3 SE +/- 2.52, N = 3 SE +/- 5.24, N = 3 SE +/- 6.08, N = 3 SE +/- 7.51, N = 3 SE +/- 1.53, N = 3 SE +/- 2.00, N = 3 2044 1792 1777 1607 1609 2239 1721 1819 2225 2191 2171 2193 2035 2069 2036 2063 2201 2183 1986 1631 2015 2639
PyBench Performance / Cost - Total For Average Test Times OpenBenchmarking.org Milliseconds x Dollar, Fewer Is Better PyBench 2018-02-16 Performance / Cost - Total For Average Test Times EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 70 140 210 280 350 20.44 53.76 142.16 80.35 160.90 313.46 109.14 200.25 21.91 43.42 43.86 20.35 20.69 40.72 41.26 66.03 152.81 238.32 16.31 181.35 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 2 Minutes, 24 Seconds: cost approximately 0.01 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.03 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 5 Seconds: cost approximately 0.08 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 53 Seconds: cost approximately 0.05 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 53 Seconds: cost approximately 0.1 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 36 Seconds: cost approximately 0.14 dollar. 7. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.06 dollar. 8. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 35 Seconds: cost approximately 0.09 dollar. 9. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 2 Minutes, 38 Seconds: cost approximately 0.01 dollar. 10. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 2 Minutes, 40 Seconds: cost approximately 0.02 dollar. 11. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 2 Minutes, 37 Seconds: cost approximately 0.02 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 23 Seconds: cost approximately 0.01 dollar. 13. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 29 Seconds: cost approximately 0.01 dollar. 14. Google n1-standard-16: $0.533 reported cost per hour, test consumed 2 Minutes, 22 Seconds: cost approximately 0.02 dollar. 15. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 2 Minutes, 25 Seconds: cost approximately 0.02 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 2 Minutes, 37 Seconds: cost approximately 0.03 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 36 Seconds: cost approximately 0.07 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 21 Seconds: cost approximately 0.12 dollar. 19. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.01 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 28 Seconds: cost approximately 0.09 dollar.
Scikit-Learn OpenBenchmarking.org Seconds, Fewer Is Better Scikit-Learn 0.17.1 EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 60 120 180 240 300 SE +/- 0.08, N = 3 SE +/- 0.07, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.17, N = 3 SE +/- 0.14, N = 3 SE +/- 9.88, N = 3 SE +/- 0.56, N = 3 SE +/- 1.48, N = 3 SE +/- 0.35, N = 3 SE +/- 1.78, N = 3 SE +/- 0.52, N = 3 SE +/- 0.62, N = 3 SE +/- 0.80, N = 3 SE +/- 0.47, N = 3 SE +/- 0.83, N = 3 SE +/- 0.92, N = 3 SE +/- 2.98, N = 3 SE +/- 1.42, N = 3 SE +/- 0.09, N = 3 SE +/- 2.86, N = 3 SE +/- 0.13, N = 3 179.03 211.86 204.55 190.08 190.52 182.92 214.77 164.09 191.67 196.96 187.80 192.66 260.15 272.74 252.14 264.88 199.18 199.08 171.10 193.88 181.49 222.51
Scikit-Learn Performance / Cost - OpenBenchmarking.org Seconds x Dollar, Fewer Is Better Scikit-Learn 0.17.1 Performance / Cost - EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 20 40 60 80 100 10.74 29.66 79.77 45.62 93.35 89.63 4.30 36.10 61.33 5.91 15.02 11.56 15.61 13.64 27.74 23.84 25.89 51.76 75.28 9.69 58.08 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 9 Minutes, 2 Seconds: cost approximately 0.06 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 10 Minutes, 40 Seconds: cost approximately 0.14 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 10 Minutes, 17 Seconds: cost approximately 0.39 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 9 Minutes, 35 Seconds: cost approximately 0.24 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 9 Minutes, 36 Seconds: cost approximately 0.49 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 9 Minutes, 13 Seconds: cost approximately 0.49 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 10 Minutes, 49 Seconds: cost approximately 0.02 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 8 Minutes, 17 Seconds: cost approximately 0.22 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 9 Minutes, 39 Seconds: cost approximately 0.32 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 9 Minutes, 55 Seconds: cost approximately 0.03 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 9 Minutes, 27 Seconds: cost approximately 0.08 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 9 Minutes, 42 Seconds: cost approximately 0.06 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 13 Minutes, 4 Seconds: cost approximately 0.06 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 13 Minutes, 43 Seconds: cost approximately 0.05 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 12 Minutes, 40 Seconds: cost approximately 0.11 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 13 Minutes, 19 Seconds: cost approximately 0.09 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 10 Minutes, 2 Seconds: cost approximately 0.13 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 10 Minutes, 1 Second: cost approximately 0.26 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 8 Minutes, 37 Seconds: cost approximately 0.44 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 9 Minutes, 45 Seconds: cost approximately 0.05 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 9 Minutes, 8 Seconds: cost approximately 0.32 dollar.
AOBench Size: 2048 x 2048 - Total Time OpenBenchmarking.org Seconds, Fewer Is Better AOBench Size: 2048 x 2048 - Total Time EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 20 40 60 80 100 SE +/- 0.04, N = 3 SE +/- 0.16, N = 3 SE +/- 1.07, N = 3 SE +/- 0.38, N = 3 SE +/- 0.12, N = 3 SE +/- 1.04, N = 3 SE +/- 0.50, N = 3 SE +/- 0.11, N = 3 SE +/- 0.20, N = 3 SE +/- 0.22, N = 3 SE +/- 0.52, N = 3 SE +/- 0.09, N = 3 SE +/- 0.11, N = 3 SE +/- 0.12, N = 3 SE +/- 0.03, N = 3 SE +/- 0.10, N = 3 SE +/- 0.22, N = 3 SE +/- 0.07, N = 3 SE +/- 0.36, N = 3 SE +/- 0.52, N = 3 SE +/- 0.57, N = 3 SE +/- 0.42, N = 3 62.18 65.48 66.21 58.70 58.42 64.56 65.51 55.39 67.24 68.85 65.32 67.42 73.65 74.77 72.86 74.22 69.50 67.28 56.84 60.80 63.81 76.44 1. (CC) gcc options: -lm -O3
AOBench Performance / Cost - Size: 2048 x 2048 - Total Time OpenBenchmarking.org Seconds x Dollar, Fewer Is Better AOBench Performance / Cost - Size: 2048 x 2048 - Total Time EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 3 6 9 12 15 1.24 2.62 8.61 4.70 8.76 11.62 0.66 4.43 7.40 0.69 1.96 1.35 1.47 0.75 2.19 2.23 3.48 6.06 8.53 1.22 7.66 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 3 Minutes, 11 Seconds: cost approximately 0.02 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.04 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 3 Minutes, 22 Seconds: cost approximately 0.13 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 3 Minutes: cost approximately 0.08 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 2 Minutes, 59 Seconds: cost approximately 0.15 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 3 Minutes, 18 Seconds: cost approximately 0.18 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.01 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 2 Minutes, 50 Seconds: cost approximately 0.08 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 3 Minutes, 26 Seconds: cost approximately 0.11 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 3 Minutes, 31 Seconds: cost approximately 0.01 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.03 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 3 Minutes, 26 Seconds: cost approximately 0.02 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 3 Minutes, 45 Seconds: cost approximately 0.02 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 3 Minutes, 48 Seconds: cost approximately 0.01 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 3 Minutes, 43 Seconds: cost approximately 0.03 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 3 Minutes, 47 Seconds: cost approximately 0.03 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 3 Minutes, 32 Seconds: cost approximately 0.05 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 3 Minutes, 26 Seconds: cost approximately 0.09 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 54 Seconds: cost approximately 0.15 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 3 Minutes, 6 Seconds: cost approximately 0.02 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 3 Minutes, 16 Seconds: cost approximately 0.12 dollar.
Crafty Elapsed Time OpenBenchmarking.org Nodes Per Second, More Is Better Crafty 25.2 Elapsed Time EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 1.5M 3M 4.5M 6M 7.5M SE +/- 3484.54, N = 3 SE +/- 7362.69, N = 3 SE +/- 2343.50, N = 3 SE +/- 7226.78, N = 3 SE +/- 7074.19, N = 3 SE +/- 14246.76, N = 3 SE +/- 87880.44, N = 3 SE +/- 24158.72, N = 3 SE +/- 24686.39, N = 3 SE +/- 22944.13, N = 3 SE +/- 35943.27, N = 3 SE +/- 30240.43, N = 3 SE +/- 7660.06, N = 3 SE +/- 18368.33, N = 3 SE +/- 33738.56, N = 3 SE +/- 3776.53, N = 3 SE +/- 22783.95, N = 3 SE +/- 65958.25, N = 3 SE +/- 4663.73, N = 3 SE +/- 27207.60, N = 3 SE +/- 108291.70, N = 3 SE +/- 5979.29, N = 3 5824045 6023992 6372596 6968801 6974942 5378062 5691579 6480104 5369651 5106438 5042429 5201506 5040959 4839203 5253687 4932898 5032857 5120858 5985875 6562714 5029618 4324494 1. (CC) gcc options: -lstdc++ -fprofile-use -pthread -lm
Crafty Performance / Cost - Elapsed Time OpenBenchmarking.org Nodes Per Second Per Dollar, More Is Better Crafty 25.2 Performance / Cost - Elapsed Time EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 140M 280M 420M 560M 700M 582404500.00 301199600.00 106209933.33 174220025.00 87186775.00 53780620.00 162002600.00 89494183.33 510643800.00 252121450.00 520150600.00 504095900.00 483920300.00 262684350.00 493289800.00 167761900.00 102417160.00 66509722.22 656271400.00 71851685.71 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 1 Minute, 49 Seconds: cost approximately 0.01 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 43 Seconds: cost approximately 0.02 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 37 Seconds: cost approximately 0.06 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 29 Seconds: cost approximately 0.04 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 29 Seconds: cost approximately 0.08 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 54 Seconds: cost approximately 0.1 dollar. 7. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 36 Seconds: cost approximately 0.04 dollar. 8. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.06 dollar. 9. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 2 Minutes: cost approximately 0.01 dollar. 10. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 2 Minutes, 2 Seconds: cost approximately 0.02 dollar. 11. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 58 Seconds: cost approximately 0.01 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 1 Second: cost approximately 0.01 dollar. 13. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.01 dollar. 14. Google n1-standard-16: $0.533 reported cost per hour, test consumed 1 Minute, 58 Seconds: cost approximately 0.02 dollar. 15. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 2 Minutes, 5 Seconds: cost approximately 0.01 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 2 Minutes, 2 Seconds: cost approximately 0.03 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 1 Minute, 59 Seconds: cost approximately 0.05 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 1 Minute, 43 Seconds: cost approximately 0.09 dollar. 19. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 35 Seconds: cost approximately 0.01 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 2 Seconds: cost approximately 0.07 dollar.
Parboil Performance / Cost - Test: OpenMP CUTCP OpenBenchmarking.org Seconds x Dollar, Fewer Is Better Parboil 2.5 Performance / Cost - Test: OpenMP CUTCP EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 0.2205 0.441 0.6615 0.882 1.1025 0.16 0.06 0.06 0.04 0.03 0.98 0.04 0.05 0.38 0.75 0.20 0.28 0.14 0.14 0.10 0.06 0.07 0.28 0.06 1. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 53 Seconds: cost approximately 0.01 dollar. 2. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 21 Seconds: cost approximately 0.01 dollar. 3. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 22 Seconds: cost approximately 0.01 dollar. 4. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 16 Seconds: cost approximately 0.01 dollar. 5. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 14 Seconds: cost approximately 0.01 dollar. 6. EC2 m5.large: $0.096 reported cost per hour, test consumed 4 Minutes, 58 Seconds: cost approximately 0.01 dollar. 7. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar. 8. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar. 9. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 1 Minute, 58 Seconds: cost approximately 0.01 dollar. 10. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.02 dollar. 11. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 3 Seconds: cost approximately 0.01 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 1 Minute, 27 Seconds: cost approximately 0.01 dollar. 13. Google n1-standard-16: $0.533 reported cost per hour, test consumed 47 Seconds: cost approximately 0.01 dollar. 14. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 47 Seconds: cost approximately 0.01 dollar. 15. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 35 Seconds: cost approximately 0.01 dollar. 16. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 23 Seconds: cost approximately 0.01 dollar. 17. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 20 Seconds: cost approximately 0.02 dollar. 18. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 29 Seconds: cost approximately 0.01 dollar. 19. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 21 Seconds: cost approximately 0.01 dollar.
Cost To Run Tests Cost / Price Per Hour OpenBenchmarking.org Cost / Price Per Hour, Fewer Is Better Cost To Run Tests Cost / Price Per Hour EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 0.6728 1.3456 2.0184 2.6912 3.364 0.89 2.00 1.28 2.43 2.81 0.34 1.35 1.86 0.47 1.20 0.61 0.41 0.32 0.63 0.48 0.96 1.59 2.99 0.49 2.19 1. EC2 m5.4xlarge: $0.768 reported cost per hour, running tests consumed 1 Hour, 9 Minutes, 15 Seconds: cost approximately 0.89 dollar. 2. EC2 m5.12xlarge: $2.304 reported cost per hour, running tests consumed 52 Minutes, 9 Seconds: cost approximately 2 dollar. 3. EC2 c5.9xlarge: $1.53 reported cost per hour, running tests consumed 50 Minutes, 21 Seconds: cost approximately 1.28 dollar. 4. EC2 c5.18xlarge: $3.06 reported cost per hour, running tests consumed 47 Minutes, 35 Seconds: cost approximately 2.43 dollar. 5. EC2 m4.16xlarge: $3.20 reported cost per hour, running tests consumed 52 Minutes, 42 Seconds: cost approximately 2.81 dollar. 6. EC2 m5.large: $0.096 reported cost per hour, running tests consumed 3 Hours, 30 Minutes, 28 Seconds: cost approximately 0.34 dollar. 7. EC2 c4.8xlarge: $1.591 reported cost per hour, running tests consumed 50 Minutes, 46 Seconds: cost approximately 1.35 dollar. 8. EC2 m4.10xlarge: $2.00 reported cost per hour, running tests consumed 55 Minutes, 55 Seconds: cost approximately 1.86 dollar. 9. Microsoft Azure D4s v3: $0.1920 reported cost per hour, running tests consumed 2 Hours, 27 Minutes, 44 Seconds: cost approximately 0.47 dollar. 10. Microsoft Azure E4s v3: $0.495 reported cost per hour, running tests consumed 2 Hours, 25 Minutes, 51 Seconds: cost approximately 1.2 dollar. 11. Microsoft Azure D8s v3: $0.3840 reported cost per hour, running tests consumed 1 Hour, 35 Minutes, 54 Seconds: cost approximately 0.61 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, running tests consumed 1 Hour, 32 Minutes, 18 Seconds: cost approximately 0.41 dollar. 13. Google n1-highcpu-8: $0.199 reported cost per hour, running tests consumed 1 Hour, 35 Minutes, 11 Seconds: cost approximately 0.32 dollar. 14. Google n1-standard-16: $0.533 reported cost per hour, running tests consumed 1 Hour, 11 Minutes, 1 Second: cost approximately 0.63 dollar. 15. Google n1-highcpu-16: $0.399 reported cost per hour, running tests consumed 1 Hour, 12 Minutes, 24 Seconds: cost approximately 0.48 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, running tests consumed 1 Hour, 15 Minutes, 19 Seconds: cost approximately 0.96 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, running tests consumed 1 Hour, 2 Minutes, 12 Seconds: cost approximately 1.59 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, running tests consumed 58 Minutes, 25 Seconds: cost approximately 2.99 dollar. 19. Microsoft Azure F8s v2: $0.3380 reported cost per hour, running tests consumed 1 Hour, 27 Minutes, 16 Seconds: cost approximately 0.49 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, running tests consumed 1 Hour, 1 Minute, 44 Seconds: cost approximately 2.19 dollar.
Timed MAFFT Alignment Performance / Cost - Multiple Sequence Alignment OpenBenchmarking.org Seconds x Dollar, Fewer Is Better Timed MAFFT Alignment 6.864 Performance / Cost - Multiple Sequence Alignment EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure E4s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E32s v3 0.0675 0.135 0.2025 0.27 0.3375 0.03 0.03 0.04 0.27 0.04 0.06 0.12 0.07 0.30 0.07 1. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 14 Seconds: cost approximately 0.01 dollar. 2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 12 Seconds: cost approximately 0.01 dollar. 3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 17 Seconds: cost approximately 0.01 dollar. 4. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 31 Seconds: cost approximately 0.03 dollar. 5. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar. 6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 21 Seconds: cost approximately 0.01 dollar. 7. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 40 Seconds: cost approximately 0.01 dollar. 8. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 24 Seconds: cost approximately 0.01 dollar. 9. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 34 Seconds: cost approximately 0.03 dollar. 10. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 25 Seconds: cost approximately 0.01 dollar.
Phoronix Test Suite v10.8.4