Google Compute Engine, Amazon EC2, Microsoft Azure Public Compute Cloud Benchmarks Various instance type benchmarks of different setups on Microsoft Azure, Amazon Elastic Compute Cloud, and Google Compute Engine. Benchmarks by Michael Larabel.
HTML result view exported from: https://openbenchmarking.org/result/1803147-FO-1802221FO46&grs&sor .
Google Compute Engine, Amazon EC2, Microsoft Azure Public Compute Cloud Benchmarks Processor Motherboard Chipset Memory Disk Graphics Network OS Kernel Compiler File-System System Layer Screen Resolution EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 Orange Flexible Engine s1.medium 2 x Intel Xeon E5-2666 v3 @ 3.50GHz (18 Cores / 36 Threads) Xen HVM domU (4.2.amazon BIOS) Intel 440FX- 82441FX PMC 60416MB 28GB Cirrus Logic GD 5446 Intel 82599 Virtual Function Ubuntu 16.04 4.4.0-1050-aws (x86_64) GCC 5.4.0 20160609 ext4 Xen HVM domU 4.2.amazon Intel Xeon Platinum 8124M @ 3.00GHz (18 Cores / 36 Threads) Amazon EC2 c5.9xlarge (1.0 BIOS) 70656MB 30GB Amazon Elastic Block Store Device 1d0f:ec20 KVM 2 x Intel Xeon Platinum 8124M @ 3.00GHz (36 Cores / 72 Threads) Amazon EC2 c5.18xlarge (1.0 BIOS) 141312MB Intel Xeon Platinum 8175M @ 2.50GHz (8 Cores / 16 Threads) Amazon EC2 m5.4xlarge (1.0 BIOS) 63488MB Intel Xeon Platinum 8175M @ 2.50GHz (24 Cores / 48 Threads) Amazon EC2 m5.12xlarge (1.0 BIOS) 189440MB 2 x Intel Xeon E5-2676 v3 @ 3.00GHz (20 Cores / 40 Threads) Xen HVM domU (4.2.amazon BIOS) 161792MB 28GB Cirrus Logic GD 5446 Intel 82599 Virtual Function Xen HVM domU 4.2.amazon 2 x Intel Xeon E5-2686 v4 @ 3.00GHz (32 Cores / 64 Threads) 258048MB Device 1d0f:ec20 Intel Xeon Platinum 8175M @ 2.50GHz (1 Core / 2 Threads) Amazon EC2 m5.large (1.0 BIOS) 8192MB 30GB Amazon Elastic Block Store KVM Intel Xeon E5-2676 v3 @ 2.39GHz (8 Cores) Xen HVM domU (4.2.amazon BIOS) 32768MB 28GB Cirrus Logic GD 5446 Xen HVM domU 4.2.amazon Intel Xeon @ 2.30GHz (4 Cores / 8 Threads) Google Compute Engine 8192MB 32GB PersistentDisk Red Hat Virtio device 4.13.0-1008-gcp (x86_64) KVM Intel Xeon @ 2.30GHz (8 Cores / 16 Threads) 15360MB Intel Xeon @ 2.30GHz (4 Cores / 8 Threads) 30720MB Intel Xeon @ 2.30GHz (8 Cores / 16 Threads) 60416MB 11GB PersistentDisk Intel Xeon E5-2673 v3 @ 2.39GHz (2 Cores / 4 Threads) Microsoft Virtual Machine v7.0 (090007 BIOS) Intel 440BX/ZX/DX 16384MB 32GB Virtual Disk + 34GB Virtual Disk Microsoft Hyper-V virtual VGA 4.13.0-1009-azure (x86_64) 1152x864 Microsoft Hyper-V Server Intel Xeon E5-2673 v3 @ 2.39GHz (4 Cores / 8 Threads) 32768MB 32GB Virtual Disk + 69GB Virtual Disk Intel Xeon E5-2673 v3 @ 2.39GHz (8 Cores / 16 Threads) 64512MB 32GB Virtual Disk + 137GB Virtual Disk 2 x Intel Xeon E5-2673 v3 @ 2.39GHz (16 Cores / 32 Threads) 129024MB 32GB Virtual Disk + 275GB Virtual Disk 2 x Intel Xeon E5-2673 v4 @ 2.29GHz (32 Cores / 64 Threads) 258048MB 32GB Virtual Disk + 550GB Virtual Disk 4.13.0-1011-azure (x86_64) Intel Xeon E5-2673 v4 @ 2.29GHz (2 Cores / 4 Threads) 32768MB 32GB Virtual Disk + 69GB Virtual Disk 4.13.0-1009-azure (x86_64) 2 x Intel Xeon E5-2673 v4 @ 2.29GHz (16 Cores / 32 Threads) 258048MB 32GB Virtual Disk + 550GB Virtual Disk 4.13.0-1011-azure (x86_64) Intel Xeon Platinum 8168 @ 2.69GHz (4 Cores / 8 Threads) 16384MB 32GB Virtual Disk + 69GB Virtual Disk Intel Xeon E5-2658 v4 @ 2.29GHz (1 Core) Xen HVM domU (4.1.2_115-908.792. BIOS) Intel 440FX- 82441FX PMC 1 x 4088 MB RAM 39GB Cirrus Logic GD 5446 4.4.0-116-generic (x86_64) Xen HVM domU 4.1.2_115-908.792. OpenBenchmarking.org Compiler Details - --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v Processor Details - EC2 c4.8xlarge, EC2 m4.10xlarge, EC2 m4.16xlarge: Scaling Governor: intel_pstate powersave Python Details - Python 2.7.12 + Python 3.5.2 Security Details - EC2 c4.8xlarge: KPTI Protection - EC2 c5.9xlarge: KPTI Protection - EC2 c5.18xlarge: KPTI Protection - EC2 m5.4xlarge: KPTI Protection - EC2 m5.12xlarge: KPTI Protection - EC2 m4.10xlarge: KPTI Protection - EC2 m4.16xlarge: KPTI Protection - EC2 m5.large: KPTI Protection - EC2 t2.2xlarge: KPTI Protection - Google n1-highcpu-8: KPTI Protection - Google n1-highcpu-16: KPTI Protection - Google n1-standard-8: KPTI Protection - Google n1-standard-16: KPTI Protection - Microsoft Azure D4s v3: KPTI Protection - Microsoft Azure D8s v3: KPTI Protection - Microsoft Azure D16s v3: KPTI Protection - Microsoft Azure D32s v3: KPTI Protection - Microsoft Azure D64s v3: KPTI + OSB (observable speculation barrier Intel v6) + Full generic retpoline Protection - Microsoft Azure E4s v3: KPTI Protection - Microsoft Azure E32s v3: KPTI + OSB (observable speculation barrier Intel v6) + Full generic retpoline Protection - Microsoft Azure F8s v2: KPTI + OSB (observable speculation barrier Intel v6) + Full generic retpoline Protection - Orange Flexible Engine s1.medium: KPTI + OSB (observable speculation barrier Intel v6) + Full generic retpoline Protection Kernel Details - EC2 c5.9xlarge, EC2 c5.18xlarge, EC2 m5.4xlarge, EC2 m5.12xlarge, EC2 m5.large: nvme.io_timeout=4294967295
Google Compute Engine, Amazon EC2, Microsoft Azure Public Compute Cloud Benchmarks openssl: RSA 4096-bit Performance john-the-ripper: Blowfish rodinia: OpenMP LavaMD java-jmh: Throughput compress-7zip: Compress Speed Test povray: Trace Time npb: EP.C c-ray: Total Time parboil: OpenMP CUTCP nginx: Static Web Page Serving x264: H.264 Video Encoding nero2d: Total Time ttsiod-renderer: Phong Rendering With Soft-Shadow Mapping scikit-learn: pybench: Total For Average Test Times pybench: Total For Average Test Times crafty: Elapsed Time encode-mp3: WAV To MP3 aobench: 2048 x 2048 - Total Time build-linux-kernel: Time To Compile mafft: Multiple Sequence Alignment EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 Orange Flexible Engine s1.medium 2579.57 25341 52.79 56603426109.55 78087 35.08 673.14 6.09 4.39 23090.77 107.99 36.91 419.30 164.09 1819 1643 6480104 37.62 55.39 43.51 4.42 4671.50 30593 44.56 60940889045.98 91933 32.35 1256.19 11.00 6.17 29999.02 134.10 60.15 460.27 190.08 1607 1459 6968801 35.63 58.70 37.99 2.72 9303.67 60305 22.77 121829911181.01 160822 17.74 2512.81 5.72 3.75 24619.23 176.03 32.19 336.76 190.52 1609 1453 6974942 35.62 58.42 24.48 4.23 1860.93 12094 115.20 24447443003.95 36642 87.10 459.35 29.48 16.11 20160.69 55.46 115.44 184.83 211.86 1792 1637 6023992 43.90 65.48 85.77 4.35 5669.13 37069 39.53 74086333554.07 112699 29.87 1385.49 9.94 5.80 25555.24 129.66 48.78 504.82 204.55 1777 1604 6372596 43.57 66.21 35.61 3.18 2410.57 23632 56.59 52821381652.06 75762 37.44 627.62 6.46 4.63 21579.29 97.43 41.18 394.52 191.67 2225 1987 5369651 45.51 67.24 45.91 5.78 3962.67 39091 34.10 84002323902.87 115598 24.12 1034.94 4.16 3.18 21410.50 115.34 26.13 465.90 182.92 2239 1992 5378062 45.22 64.56 33.90 8.84 242.00 1562 828.97 3178036199.44 5090 617.28 60.99 152.07 98.07 12132.51 11.02 534.08 26.88 214.77 1721 1559 5691579 41.09 65.51 641.51 20.00 174.83 6067 213.70 4217431038.72 23917 563.33 146.20 16.52 11.46 18175.24 38.43 87.04 231.07 179.03 2044 1837 5824045 42.12 62.18 106.83 4.26 540.70 5256 246.30 10642422187.43 14996 152.93 235.75 40.08 27.80 21203.08 25.92 198.33 124.66 272.74 2069 1875 4839203 45.81 74.77 164.16 7.44 1078.87 10501 122.90 21349296898.72 30253 75.87 464.55 20.84 14.16 24005.34 52.41 130.21 234.96 264.88 2063 1876 4932898 45.56 74.22 83.23 4.91 554.97 5311 245.74 10676070774.18 16136 150.53 233.87 39.77 27.54 25255.90 26.93 193.69 129.81 260.15 2035 1846 5040959 44.72 73.65 155.50 7.30 1091.73 10649 123.24 21381785010.72 30229 75.92 477.95 20.76 14.16 26556.48 52.07 126.67 238.88 252.14 2036 1858 5253687 44.85 72.86 84.17 4.96 242.10 2323 550.02 5267511004.58 9144 346.10 64.00 63.05 37.92 14328.83 13.95 391.21 74.64 196.96 2191 1965 5106438 46.62 68.85 381.97 11.89 478.40 4621 279.78 10474890150.44 17015 172.17 125.37 31.97 19.56 15431.68 26.82 177.01 142.43 192.66 2193 1954 5201506 45.77 67.42 192.60 6.61 929.47 8016 144.60 20355987704.49 30273 89.86 243.00 16.49 10.35 13495.31 46.48 100.00 249.33 199.18 2201 2007 5032857 47.04 69.50 119.95 5.88 1889.00 13792 72.41 41237574200.22 57028 45.72 487.26 8.16 5.65 13352.91 81.64 57.39 381.19 199.08 2183 1949 5120858 45.88 67.28 68.61 6.94 5826.23 14237 35.20 79724759013.03 97549 25.87 996.94 5.15 3.25 12687.56 82.04 34.06 141.98 171.10 1986 1783 5985875 41.01 56.84 46.99 10.04 376.40 2419 529.89 5147334632.54 8708 378.52 64.90 63.95 37.25 15480.88 12.08 351.83 75.14 187.80 2171 1959 5042429 46.44 65.32 386.80 11.86 2893.60 13878 69.61 39975500322.53 56544 48.85 495.73 8.46 5.71 12574.34 71.74 52.48 381.87 181.49 2015 1843 5029618 43.77 63.81 64.62 6.80 1017.47 5912 206.12 13410992384.58 21252 163.10 256.23 53.48 28.33 16486.68 31.44 174.93 106.43 193.88 1631 1473 6562714 40.51 60.80 160.25 6.33 104.93 694 1827.69 2276017754.87 3049 915.14 151.05 97.12 8634.63 6.18 29.47 219.06 2644 2359 4415980 53.69 74.41 895.79 27.45 OpenBenchmarking.org
POV-Ray Performance / Cost - Trace Time OpenBenchmarking.org Seconds x Dollar, Fewer Is Better POV-Ray 3.7.0.7 Performance / Cost - Trace Time EC2 c5.18xlarge EC2 c5.9xlarge EC2 c4.8xlarge EC2 m4.16xlarge Microsoft Azure D64s v3 EC2 m5.12xlarge Google n1-highcpu-16 EC2 m4.10xlarge Microsoft Azure D32s v3 Google n1-standard-16 Google n1-standard-8 Google n1-highcpu-8 Microsoft Azure E32s v3 EC2 m5.4xlarge Microsoft Azure D16s v3 Microsoft Azure F8s v2 Microsoft Azure D8s v3 Microsoft Azure D4s v3 EC2 m5.large Microsoft Azure E4s v3 EC2 t2.2xlarge 20 40 60 80 100 1.06 1.62 1.75 1.93 2.07 2.09 2.28 2.62 2.74 3.04 4.52 4.59 4.89 5.23 5.39 8.16 10.33 20.77 30.86 60.56 101.40 1. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.06 dollar. 2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 48 Seconds: cost approximately 0.05 dollar. 3. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 57 Seconds: cost approximately 0.05 dollar. 4. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 25 Seconds: cost approximately 0.08 dollar. 5. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 1 Minute, 31 Seconds: cost approximately 0.08 dollar. 6. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 42 Seconds: cost approximately 0.07 dollar. 7. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 3 Minutes, 59 Seconds: cost approximately 0.03 dollar. 8. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 5 Seconds: cost approximately 0.07 dollar. 9. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 30 Seconds: cost approximately 0.06 dollar. 10. Google n1-standard-16: $0.533 reported cost per hour, test consumed 4 Minutes: cost approximately 0.04 dollar. 11. Google n1-standard-8: $0.268 reported cost per hour, test consumed 7 Minutes, 44 Seconds: cost approximately 0.03 dollar. 12. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 7 Minutes, 51 Seconds: cost approximately 0.03 dollar. 13. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 41 Seconds: cost approximately 0.1 dollar. 14. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 4 Minutes, 34 Seconds: cost approximately 0.06 dollar. 15. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 4 Minutes, 42 Seconds: cost approximately 0.06 dollar. 16. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 8 Minutes, 22 Seconds: cost approximately 0.05 dollar. 17. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 8 Minutes, 50 Seconds: cost approximately 0.06 dollar. 18. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 17 Minutes, 31 Seconds: cost approximately 0.06 dollar. 19. EC2 m5.large: $0.096 reported cost per hour, test consumed 31 Minutes, 4 Seconds: cost approximately 0.05 dollar. 20. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 19 Minutes, 9 Seconds: cost approximately 0.16 dollar. 21. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 28 Minutes, 22 Seconds: cost approximately 0.18 dollar.
Cost To Run Tests Cost / Price Per Hour OpenBenchmarking.org Cost / Price Per Hour, Fewer Is Better Cost To Run Tests Cost / Price Per Hour Google n1-highcpu-8 EC2 m5.large Google n1-standard-8 Microsoft Azure D4s v3 Google n1-highcpu-16 Microsoft Azure F8s v2 Microsoft Azure D8s v3 Google n1-standard-16 EC2 m5.4xlarge Microsoft Azure D16s v3 Microsoft Azure E4s v3 EC2 c5.9xlarge EC2 c4.8xlarge Microsoft Azure D32s v3 EC2 m4.10xlarge EC2 m5.12xlarge Microsoft Azure E32s v3 EC2 c5.18xlarge EC2 m4.16xlarge Microsoft Azure D64s v3 0.6728 1.3456 2.0184 2.6912 3.364 0.32 0.34 0.41 0.47 0.48 0.49 0.61 0.63 0.89 0.96 1.20 1.28 1.35 1.59 1.86 2.00 2.19 2.43 2.81 2.99 1. Google n1-highcpu-8: $0.199 reported cost per hour, running tests consumed 1 Hour, 35 Minutes, 11 Seconds: cost approximately 0.32 dollar. 2. EC2 m5.large: $0.096 reported cost per hour, running tests consumed 3 Hours, 30 Minutes, 28 Seconds: cost approximately 0.34 dollar. 3. Google n1-standard-8: $0.268 reported cost per hour, running tests consumed 1 Hour, 32 Minutes, 18 Seconds: cost approximately 0.41 dollar. 4. Microsoft Azure D4s v3: $0.1920 reported cost per hour, running tests consumed 2 Hours, 27 Minutes, 44 Seconds: cost approximately 0.47 dollar. 5. Google n1-highcpu-16: $0.399 reported cost per hour, running tests consumed 1 Hour, 12 Minutes, 24 Seconds: cost approximately 0.48 dollar. 6. Microsoft Azure F8s v2: $0.3380 reported cost per hour, running tests consumed 1 Hour, 27 Minutes, 16 Seconds: cost approximately 0.49 dollar. 7. Microsoft Azure D8s v3: $0.3840 reported cost per hour, running tests consumed 1 Hour, 35 Minutes, 54 Seconds: cost approximately 0.61 dollar. 8. Google n1-standard-16: $0.533 reported cost per hour, running tests consumed 1 Hour, 11 Minutes, 1 Second: cost approximately 0.63 dollar. 9. EC2 m5.4xlarge: $0.768 reported cost per hour, running tests consumed 1 Hour, 9 Minutes, 15 Seconds: cost approximately 0.89 dollar. 10. Microsoft Azure D16s v3: $0.7680 reported cost per hour, running tests consumed 1 Hour, 15 Minutes, 19 Seconds: cost approximately 0.96 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, running tests consumed 2 Hours, 25 Minutes, 51 Seconds: cost approximately 1.2 dollar. 12. EC2 c5.9xlarge: $1.53 reported cost per hour, running tests consumed 50 Minutes, 21 Seconds: cost approximately 1.28 dollar. 13. EC2 c4.8xlarge: $1.591 reported cost per hour, running tests consumed 50 Minutes, 46 Seconds: cost approximately 1.35 dollar. 14. Microsoft Azure D32s v3: $1.5360 reported cost per hour, running tests consumed 1 Hour, 2 Minutes, 12 Seconds: cost approximately 1.59 dollar. 15. EC2 m4.10xlarge: $2.00 reported cost per hour, running tests consumed 55 Minutes, 55 Seconds: cost approximately 1.86 dollar. 16. EC2 m5.12xlarge: $2.304 reported cost per hour, running tests consumed 52 Minutes, 9 Seconds: cost approximately 2 dollar. 17. Microsoft Azure E32s v3: $2.1280 reported cost per hour, running tests consumed 1 Hour, 1 Minute, 44 Seconds: cost approximately 2.19 dollar. 18. EC2 c5.18xlarge: $3.06 reported cost per hour, running tests consumed 47 Minutes, 35 Seconds: cost approximately 2.43 dollar. 19. EC2 m4.16xlarge: $3.20 reported cost per hour, running tests consumed 52 Minutes, 42 Seconds: cost approximately 2.81 dollar. 20. Microsoft Azure D64s v3: $3.0720 reported cost per hour, running tests consumed 58 Minutes, 25 Seconds: cost approximately 2.99 dollar.
OpenSSL RSA 4096-bit Performance OpenBenchmarking.org Signs Per Second, More Is Better OpenSSL 1.1.0f RSA 4096-bit Performance EC2 c5.18xlarge Microsoft Azure D64s v3 EC2 m5.12xlarge EC2 c5.9xlarge EC2 m4.16xlarge Microsoft Azure E32s v3 EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D32s v3 EC2 m5.4xlarge Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure F8s v2 Microsoft Azure D16s v3 Google n1-standard-8 Google n1-highcpu-8 Microsoft Azure D8s v3 Microsoft Azure E4s v3 Microsoft Azure D4s v3 EC2 m5.large EC2 t2.2xlarge Orange Flexible Engine s1.medium 2K 4K 6K 8K 10K SE +/- 19.65, N = 3 SE +/- 35.20, N = 3 SE +/- 13.34, N = 3 SE +/- 1.27, N = 3 SE +/- 4.00, N = 3 SE +/- 4.11, N = 3 SE +/- 2.55, N = 3 SE +/- 2.05, N = 3 SE +/- 1.96, N = 3 SE +/- 2.33, N = 3 SE +/- 49.53, N = 3 SE +/- 37.17, N = 3 SE +/- 3.69, N = 3 SE +/- 1.62, N = 3 SE +/- 34.32, N = 3 SE +/- 21.05, N = 3 SE +/- 0.31, N = 3 SE +/- 0.35, N = 3 SE +/- 2.80, N = 3 SE +/- 0.95, N = 3 SE +/- 1.37, N = 3 SE +/- 0.03, N = 3 9303.67 5826.23 5669.13 4671.50 3962.67 2893.60 2579.57 2410.57 1889.00 1860.93 1091.73 1078.87 1017.47 929.47 554.97 540.70 478.40 376.40 242.10 242.00 174.83 104.93 1. (CC) gcc options: -O3 -pthread -m64 -lcrypto -ldl
John The Ripper Test: Blowfish OpenBenchmarking.org Real C/S, More Is Better John The Ripper 1.8.0 Test: Blowfish EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D64s v3 Microsoft Azure E32s v3 Microsoft Azure D32s v3 EC2 m5.4xlarge Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 EC2 t2.2xlarge Microsoft Azure F8s v2 Google n1-standard-8 Google n1-highcpu-8 Microsoft Azure D8s v3 Microsoft Azure E4s v3 Microsoft Azure D4s v3 EC2 m5.large Orange Flexible Engine s1.medium 13K 26K 39K 52K 65K SE +/- 33.25, N = 3 SE +/- 193.12, N = 3 SE +/- 41.59, N = 3 SE +/- 26.19, N = 3 SE +/- 40.45, N = 3 SE +/- 16.00, N = 3 SE +/- 166.51, N = 3 SE +/- 629.45, N = 3 SE +/- 504.49, N = 3 SE +/- 21.00, N = 3 SE +/- 25.67, N = 3 SE +/- 21.36, N = 3 SE +/- 45.99, N = 3 SE +/- 29.67, N = 3 SE +/- 6.51, N = 3 SE +/- 8.50, N = 3 SE +/- 22.84, N = 3 SE +/- 2.89, N = 3 SE +/- 30.95, N = 3 SE +/- 23.86, N = 3 60305 39091 37069 30593 25341 23632 14237 13878 13792 12094 10649 10501 8016 6067 5912 5311 5256 4621 2419 2323 1562 694 1. (CC) gcc options: -fopenmp -lcrypt
Rodinia Performance / Cost - Test: OpenMP LavaMD OpenBenchmarking.org Seconds x Dollar, Fewer Is Better Rodinia 2.4 Performance / Cost - Test: OpenMP LavaMD EC2 c5.18xlarge EC2 c5.9xlarge EC2 m5.12xlarge Microsoft Azure D64s v3 EC2 m4.16xlarge EC2 c4.8xlarge Google n1-highcpu-16 EC2 m4.10xlarge Microsoft Azure D32s v3 Google n1-standard-16 EC2 m5.4xlarge Microsoft Azure E32s v3 Google n1-highcpu-8 Microsoft Azure F8s v2 Microsoft Azure D16s v3 Google n1-standard-8 EC2 t2.2xlarge Microsoft Azure D8s v3 Microsoft Azure D4s v3 EC2 m5.large Microsoft Azure E4s v3 30 60 90 120 150 1.37 2.67 3.16 3.17 3.41 3.70 4.92 5.66 6.52 7.39 8.06 9.05 9.85 12.37 13.01 14.74 14.96 25.18 49.50 58.03 116.58 1. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 12 Seconds: cost approximately 0.06 dollar. 2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.06 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 3 Seconds: cost approximately 0.08 dollar. 4. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 1 Minute, 50 Seconds: cost approximately 0.09 dollar. 5. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 47 Seconds: cost approximately 0.1 dollar. 6. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 2 Minutes, 42 Seconds: cost approximately 0.07 dollar. 7. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 6 Minutes, 12 Seconds: cost approximately 0.04 dollar. 8. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 54 Seconds: cost approximately 0.1 dollar. 9. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 3 Minutes, 41 Seconds: cost approximately 0.09 dollar. 10. Google n1-standard-16: $0.533 reported cost per hour, test consumed 6 Minutes, 14 Seconds: cost approximately 0.06 dollar. 11. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 5 Minutes, 50 Seconds: cost approximately 0.07 dollar. 12. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 3 Minutes, 33 Seconds: cost approximately 0.13 dollar. 13. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 12 Minutes, 23 Seconds: cost approximately 0.04 dollar. 14. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 10 Minutes, 22 Seconds: cost approximately 0.06 dollar. 15. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 7 Minutes, 18 Seconds: cost approximately 0.09 dollar. 16. Google n1-standard-8: $0.268 reported cost per hour, test consumed 12 Minutes, 21 Seconds: cost approximately 0.06 dollar. 17. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 10 Minutes, 46 Seconds: cost approximately 0.07 dollar. 18. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 14 Minutes, 4 Seconds: cost approximately 0.09 dollar. 19. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 27 Minutes, 34 Seconds: cost approximately 0.09 dollar. 20. EC2 m5.large: $0.096 reported cost per hour, test consumed 41 Minutes, 30 Seconds: cost approximately 0.07 dollar. 21. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 26 Minutes, 34 Seconds: cost approximately 0.22 dollar.
Rodinia Test: OpenMP LavaMD OpenBenchmarking.org Seconds, Fewer Is Better Rodinia 2.4 Test: OpenMP LavaMD EC2 c5.18xlarge EC2 m4.16xlarge Microsoft Azure D64s v3 EC2 m5.12xlarge EC2 c5.9xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure E32s v3 Microsoft Azure D32s v3 EC2 m5.4xlarge Google n1-highcpu-16 Google n1-standard-16 Microsoft Azure D16s v3 Microsoft Azure F8s v2 EC2 t2.2xlarge Google n1-standard-8 Google n1-highcpu-8 Microsoft Azure D8s v3 Microsoft Azure E4s v3 Microsoft Azure D4s v3 EC2 m5.large Orange Flexible Engine s1.medium 400 800 1200 1600 2000 SE +/- 0.16, N = 3 SE +/- 0.05, N = 3 SE +/- 0.06, N = 3 SE +/- 0.81, N = 3 SE +/- 0.33, N = 3 SE +/- 0.11, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 2.22, N = 3 SE +/- 0.47, N = 3 SE +/- 0.19, N = 3 SE +/- 0.32, N = 3 SE +/- 1.61, N = 3 SE +/- 0.03, N = 3 SE +/- 0.90, N = 3 SE +/- 0.54, N = 3 SE +/- 0.06, N = 3 SE +/- 2.20, N = 3 SE +/- 1.53, N = 3 SE +/- 7.59, N = 3 SE +/- 3.28, N = 3 22.77 34.10 35.20 39.53 44.56 52.79 56.59 69.61 72.41 115.20 122.90 123.24 144.60 206.12 213.70 245.74 246.30 279.78 529.89 550.02 828.97 1827.69 1. (CXX) g++ options: -O2 -lOpenCL
John The Ripper Performance / Cost - Test: Blowfish OpenBenchmarking.org Real C/S Per Dollar, More Is Better John The Ripper 1.8.0 Performance / Cost - Test: Blowfish Google n1-standard-8 Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-16 EC2 c5.18xlarge EC2 c5.9xlarge EC2 t2.2xlarge EC2 m5.4xlarge Microsoft Azure F8s v2 EC2 m5.12xlarge EC2 c4.8xlarge Microsoft Azure D4s v3 Microsoft Azure D8s v3 EC2 m4.16xlarge EC2 m4.10xlarge Microsoft Azure D16s v3 EC2 m5.large Microsoft Azure D32s v3 Microsoft Azure E32s v3 Microsoft Azure E4s v3 Microsoft Azure D64s v3 110K 220K 330K 440K 550K 531100.00 525600.00 525050.00 354966.67 354735.29 339922.22 303350.00 302350.00 295600.00 285146.15 281566.67 232300.00 231050.00 217172.22 214836.36 200400.00 156200.00 153244.44 115650.00 80633.33 79094.44 1. Google n1-standard-8: $0.268 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.01 dollar. 2. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.01 dollar. 3. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.02 dollar. 4. Google n1-standard-16: $0.533 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.03 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 3 Minutes, 22 Seconds: cost approximately 0.17 dollar. 6. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.09 dollar. 7. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 3 Minutes, 19 Seconds: cost approximately 0.02 dollar. 8. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.04 dollar. 9. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.02 dollar. 10. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.13 dollar. 11. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.09 dollar. 12. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.01 dollar. 13. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.02 dollar. 14. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.18 dollar. 15. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 3 Minutes, 22 Seconds: cost approximately 0.11 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.04 dollar. 17. EC2 m5.large: $0.096 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.01 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 3 Minutes, 23 Seconds: cost approximately 0.09 dollar. 19. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 3 Minutes, 23 Seconds: cost approximately 0.12 dollar. 20. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.03 dollar. 21. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 3 Minutes, 27 Seconds: cost approximately 0.18 dollar.
Java JMH Performance / Cost - Throughput OpenBenchmarking.org Ops/s Per Dollar, More Is Better Java JMH Performance / Cost - Throughput Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-16 Google n1-standard-8 EC2 c5.9xlarge EC2 c5.18xlarge Microsoft Azure F8s v2 EC2 m5.large EC2 c4.8xlarge EC2 m5.12xlarge EC2 m5.4xlarge Microsoft Azure D4s v3 Microsoft Azure D8s v3 EC2 m4.10xlarge Microsoft Azure D32s v3 Microsoft Azure D16s v3 EC2 m4.16xlarge Microsoft Azure D64s v3 Microsoft Azure E32s v3 EC2 t2.2xlarge Microsoft Azure E4s v3 110000M 220000M 330000M 440000M 550000M 532121109371.50 426985937974.40 356363083512.00 355869025806.00 338560494699.89 338416419947.25 335274809614.50 317803619944.00 314463478386.39 274393827978.04 271638255599.44 263375550229.00 261872253761.00 229658181095.91 229097634445.67 226177641161.00 221058747112.82 181192634120.52 159902001290.12 105435775968.00 85788910542.33 1. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 6 Minutes, 49 Seconds: cost approximately 0.02 dollar. 2. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 6 Minutes, 49 Seconds: cost approximately 0.05 dollar. 3. Google n1-standard-16: $0.533 reported cost per hour, test consumed 6 Minutes, 48 Seconds: cost approximately 0.06 dollar. 4. Google n1-standard-8: $0.268 reported cost per hour, test consumed 6 Minutes, 48 Seconds: cost approximately 0.03 dollar. 5. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 6 Minutes, 55 Seconds: cost approximately 0.18 dollar. 6. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 7 Minutes, 1 Second: cost approximately 0.36 dollar. 7. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 6 Minutes, 48 Seconds: cost approximately 0.04 dollar. 8. EC2 m5.large: $0.096 reported cost per hour, test consumed 6 Minutes, 47 Seconds: cost approximately 0.01 dollar. 9. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 6 Minutes, 58 Seconds: cost approximately 0.18 dollar. 10. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 6 Minutes, 57 Seconds: cost approximately 0.27 dollar. 11. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 6 Minutes, 53 Seconds: cost approximately 0.09 dollar. 12. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 6 Minutes, 49 Seconds: cost approximately 0.02 dollar. 13. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 6 Minutes, 49 Seconds: cost approximately 0.04 dollar. 14. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 6 Minutes, 59 Seconds: cost approximately 0.23 dollar. 15. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 7 Minutes, 3 Seconds: cost approximately 0.18 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 6 Minutes, 52 Seconds: cost approximately 0.09 dollar. 17. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 7 Minutes, 4 Seconds: cost approximately 0.38 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 8 Minutes, 35 Seconds: cost approximately 0.44 dollar. 19. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 7 Minutes, 4 Seconds: cost approximately 0.25 dollar. 20. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 7 Minutes, 14 Seconds: cost approximately 0.04 dollar. 21. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 6 Minutes, 49 Seconds: cost approximately 0.06 dollar.
Java JMH Throughput OpenBenchmarking.org Ops/s, More Is Better Java JMH Throughput EC2 c5.18xlarge EC2 m4.16xlarge Microsoft Azure D64s v3 EC2 m5.12xlarge EC2 c5.9xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D32s v3 Microsoft Azure E32s v3 EC2 m5.4xlarge Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure F8s v2 Google n1-standard-8 Google n1-highcpu-8 Microsoft Azure D8s v3 Microsoft Azure D4s v3 Microsoft Azure E4s v3 EC2 t2.2xlarge EC2 m5.large Orange Flexible Engine s1.medium 30000M 60000M 90000M 120000M 150000M 121829911181.01 84002323902.87 79724759013.03 74086333554.07 60940889045.98 56603426109.55 52821381652.06 41237574200.22 39975500322.53 24447443003.95 21381785010.72 21349296898.72 20355987704.49 13410992384.58 10676070774.18 10642422187.43 10474890150.44 5267511004.58 5147334632.54 4217431038.72 3178036199.44 2276017754.87
7-Zip Compression Compress Speed Test OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 9.20.1 Compress Speed Test EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.12xlarge Microsoft Azure D64s v3 EC2 c5.9xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D32s v3 Microsoft Azure E32s v3 EC2 m5.4xlarge Microsoft Azure D16s v3 Google n1-highcpu-16 Google n1-standard-16 EC2 t2.2xlarge Microsoft Azure F8s v2 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Microsoft Azure D4s v3 Microsoft Azure E4s v3 EC2 m5.large Orange Flexible Engine s1.medium 30K 60K 90K 120K 150K SE +/- 319.70, N = 3 SE +/- 482.44, N = 3 SE +/- 480.06, N = 3 SE +/- 416.92, N = 3 SE +/- 226.61, N = 3 SE +/- 380.57, N = 3 SE +/- 280.19, N = 3 SE +/- 268.12, N = 3 SE +/- 60.61, N = 3 SE +/- 282.94, N = 3 SE +/- 231.20, N = 3 SE +/- 132.53, N = 3 SE +/- 130.52, N = 3 SE +/- 86.00, N = 3 SE +/- 244.04, N = 3 SE +/- 88.33, N = 3 SE +/- 75.03, N = 3 SE +/- 16.90, N = 3 SE +/- 90.16, N = 3 SE +/- 16.02, N = 3 SE +/- 28.62, N = 3 SE +/- 34.56, N = 3 160822 115598 112699 97549 91933 78087 75762 57028 56544 36642 30273 30253 30229 23917 21252 17015 16136 14996 9144 8708 5090 3049 1. (CXX) g++ options: -pipe -lpthread
POV-Ray Trace Time OpenBenchmarking.org Seconds, Fewer Is Better POV-Ray 3.7.0.7 Trace Time EC2 c5.18xlarge EC2 m4.16xlarge Microsoft Azure D64s v3 EC2 m5.12xlarge EC2 c5.9xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D32s v3 Microsoft Azure E32s v3 Google n1-highcpu-16 Google n1-standard-16 EC2 m5.4xlarge Microsoft Azure D16s v3 Google n1-standard-8 Google n1-highcpu-8 Microsoft Azure F8s v2 Microsoft Azure D8s v3 Microsoft Azure D4s v3 Microsoft Azure E4s v3 EC2 t2.2xlarge EC2 m5.large Orange Flexible Engine s1.medium 200 400 600 800 1000 SE +/- 0.13, N = 3 SE +/- 0.07, N = 3 SE +/- 0.16, N = 3 SE +/- 0.03, N = 3 SE +/- 0.18, N = 3 SE +/- 0.14, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.18, N = 3 SE +/- 0.10, N = 3 SE +/- 0.28, N = 3 SE +/- 0.14, N = 3 SE +/- 0.27, N = 3 SE +/- 0.31, N = 3 SE +/- 0.04, N = 3 SE +/- 0.17, N = 3 SE +/- 0.04, N = 3 SE +/- 0.27, N = 3 SE +/- 0.16, N = 3 SE +/- 29.42, N = 3 SE +/- 40.66, N = 3 SE +/- 1.92, N = 3 17.74 24.12 25.87 29.87 32.35 35.08 37.44 45.72 48.85 75.87 75.92 87.10 89.86 150.53 152.93 163.10 172.17 346.10 378.52 563.33 617.28 915.14 1. (CXX) g++ options: -pipe -O3 -ffast-math -march=native -pthread -lSDL -lSM -lICE -lX11 -ltiff -ljpeg -lpng -lz -lrt -lm -lboost_thread -lboost_system
NGINX Benchmark Performance / Cost - Static Web Page Serving OpenBenchmarking.org Requests Per Second Per Dollar, More Is Better NGINX Benchmark 1.9.9 Performance / Cost - Static Web Page Serving Google n1-standard-8 EC2 m5.large Google n1-highcpu-8 Google n1-highcpu-16 Microsoft Azure D4s v3 Google n1-standard-16 EC2 t2.2xlarge Microsoft Azure F8s v2 Microsoft Azure D8s v3 EC2 c5.9xlarge EC2 m5.4xlarge Microsoft Azure E4s v3 EC2 c4.8xlarge EC2 m5.12xlarge Microsoft Azure D16s v3 EC2 m4.10xlarge EC2 c5.18xlarge EC2 m4.16xlarge Microsoft Azure D32s v3 Microsoft Azure E32s v3 Microsoft Azure D64s v3 300K 600K 900K 1200K 1500K 1262795.00 1213251.00 1060154.00 800178.00 716441.50 663912.00 454381.00 412167.00 385792.00 333322.44 288009.86 258014.67 192423.08 159720.25 134953.10 126937.00 111905.59 79298.15 74182.83 43359.79 30208.48 1. Google n1-standard-8: $0.268 reported cost per hour, test consumed 4 Minutes, 17 Seconds: cost approximately 0.02 dollar. 2. EC2 m5.large: $0.096 reported cost per hour, test consumed 8 Minutes, 35 Seconds: cost approximately 0.01 dollar. 3. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 5 Minutes, 3 Seconds: cost approximately 0.02 dollar. 4. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 4 Minutes, 29 Seconds: cost approximately 0.03 dollar. 5. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 7 Minutes, 18 Seconds: cost approximately 0.02 dollar. 6. Google n1-standard-16: $0.533 reported cost per hour, test consumed 4 Minutes, 5 Seconds: cost approximately 0.04 dollar. 7. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 5 Minutes, 50 Seconds: cost approximately 0.04 dollar. 8. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 6 Minutes, 22 Seconds: cost approximately 0.04 dollar. 9. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 6 Minutes, 47 Seconds: cost approximately 0.04 dollar. 10. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 3 Minutes, 37 Seconds: cost approximately 0.09 dollar. 11. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 5 Minutes, 16 Seconds: cost approximately 0.07 dollar. 12. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 6 Minutes, 47 Seconds: cost approximately 0.06 dollar. 13. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 4 Minutes, 37 Seconds: cost approximately 0.12 dollar. 14. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 4 Minutes, 12 Seconds: cost approximately 0.16 dollar. 15. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 7 Minutes, 44 Seconds: cost approximately 0.1 dollar. 16. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 4 Minutes, 57 Seconds: cost approximately 0.17 dollar. 17. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 4 Minutes, 22 Seconds: cost approximately 0.22 dollar. 18. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 5 Minutes: cost approximately 0.27 dollar. 19. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 7 Minutes, 5 Seconds: cost approximately 0.18 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 8 Minutes, 17 Seconds: cost approximately 0.29 dollar. 21. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 8 Minutes, 12 Seconds: cost approximately 0.42 dollar.
NAS Parallel Benchmarks Test / Class: EP.C OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.3 Test / Class: EP.C EC2 c5.18xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 m4.16xlarge Microsoft Azure D64s v3 EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure E32s v3 Microsoft Azure D32s v3 Google n1-standard-16 Google n1-highcpu-16 EC2 m5.4xlarge Microsoft Azure F8s v2 Microsoft Azure D16s v3 Google n1-highcpu-8 Google n1-standard-8 EC2 t2.2xlarge Microsoft Azure D8s v3 Microsoft Azure E4s v3 Microsoft Azure D4s v3 EC2 m5.large 500 1000 1500 2000 2500 SE +/- 29.39, N = 3 SE +/- 1.50, N = 3 SE +/- 19.93, N = 3 SE +/- 1.06, N = 3 SE +/- 1.86, N = 3 SE +/- 3.43, N = 3 SE +/- 0.96, N = 3 SE +/- 0.98, N = 3 SE +/- 0.74, N = 3 SE +/- 3.92, N = 3 SE +/- 17.11, N = 3 SE +/- 1.09, N = 3 SE +/- 1.49, N = 3 SE +/- 1.01, N = 3 SE +/- 2.09, N = 3 SE +/- 1.37, N = 3 SE +/- 0.08, N = 3 SE +/- 0.54, N = 3 SE +/- 0.06, N = 3 SE +/- 0.23, N = 3 SE +/- 3.02, N = 3 2512.81 1385.49 1256.19 1034.94 996.94 673.14 627.62 495.73 487.26 477.95 464.55 459.35 256.23 243.00 235.75 233.87 146.20 125.37 64.90 64.00 60.99 1. (F9X) gfortran options: -O3 -march=native -pthread -lmpi_usempif08 -lmpi_mpifh -lmpi 2. Open MPI 1.10.2
7-Zip Compression Performance / Cost - Compress Speed Test OpenBenchmarking.org MIPS Per Dollar, More Is Better 7-Zip Compression 9.20.1 Performance / Cost - Compress Speed Test Google n1-highcpu-16 EC2 t2.2xlarge EC2 c5.9xlarge Microsoft Azure F8s v2 EC2 m5.4xlarge Microsoft Azure D8s v3 Google n1-standard-8 EC2 m5.12xlarge EC2 c4.8xlarge Microsoft Azure D16s v3 Google n1-standard-16 Google n1-highcpu-8 EC2 c5.18xlarge EC2 m4.10xlarge Microsoft Azure D32s v3 Microsoft Azure D4s v3 Microsoft Azure E4s v3 EC2 m4.16xlarge Microsoft Azure D64s v3 Microsoft Azure E32s v3 600K 1200K 1800K 2400K 3000K 3025300.00 2391700.00 2298325.00 2125200.00 1832100.00 1701500.00 1613600.00 1609985.71 1561740.00 1513650.00 1511450.00 1499600.00 1462018.18 1082314.29 950466.67 914400.00 870800.00 770653.33 750376.92 706800.00 1. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.01 dollar. 2. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 1 Minute, 14 Seconds: cost approximately 0.01 dollar. 3. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 39 Seconds: cost approximately 0.04 dollar. 4. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 24 Seconds: cost approximately 0.01 dollar. 5. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 38 Seconds: cost approximately 0.02 dollar. 6. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 42 Seconds: cost approximately 0.01 dollar. 7. Google n1-standard-8: $0.268 reported cost per hour, test consumed 1 Minute, 46 Seconds: cost approximately 0.01 dollar. 8. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.07 dollar. 9. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 51 Seconds: cost approximately 0.05 dollar. 10. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.02 dollar. 11. Google n1-standard-16: $0.533 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.02 dollar. 12. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 1 Minute, 52 Seconds: cost approximately 0.01 dollar. 13. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 2 Minutes, 6 Seconds: cost approximately 0.11 dollar. 14. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 14 Seconds: cost approximately 0.07 dollar. 15. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 11 Seconds: cost approximately 0.06 dollar. 16. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 1 Minute, 36 Seconds: cost approximately 0.01 dollar. 17. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 1 Minute, 39 Seconds: cost approximately 0.01 dollar. 18. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 45 Seconds: cost approximately 0.15 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 37 Seconds: cost approximately 0.13 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 12 Seconds: cost approximately 0.08 dollar.
C-Ray Total Time OpenBenchmarking.org Seconds, Fewer Is Better C-Ray 1.1 Total Time EC2 m4.16xlarge Microsoft Azure D64s v3 EC2 c5.18xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D32s v3 Microsoft Azure E32s v3 EC2 m5.12xlarge EC2 c5.9xlarge Microsoft Azure D16s v3 EC2 t2.2xlarge Google n1-standard-16 Google n1-highcpu-16 EC2 m5.4xlarge Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Microsoft Azure F8s v2 Microsoft Azure D4s v3 Microsoft Azure E4s v3 Orange Flexible Engine s1.medium EC2 m5.large 30 60 90 120 150 SE +/- 0.00, N = 3 SE +/- 0.42, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.00, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.23, N = 3 SE +/- 0.14, N = 3 SE +/- 0.11, N = 3 SE +/- 0.05, N = 3 SE +/- 5.71, N = 3 4.16 5.15 5.72 6.09 6.46 8.16 8.46 9.94 11.00 16.49 16.52 20.76 20.84 29.48 31.97 39.77 40.08 53.48 63.05 63.95 151.05 152.07 1. (CC) gcc options: -lm -lpthread -O3
Parboil Performance / Cost - Test: OpenMP CUTCP OpenBenchmarking.org Seconds x Dollar, Fewer Is Better Parboil 2.5 Performance / Cost - Test: OpenMP CUTCP EC2 m4.16xlarge EC2 c4.8xlarge EC2 c5.18xlarge EC2 m4.10xlarge EC2 c5.9xlarge EC2 m5.12xlarge Microsoft Azure D32s v3 Microsoft Azure E32s v3 Microsoft Azure D64s v3 Microsoft Azure D16s v3 Google n1-highcpu-16 Google n1-standard-16 EC2 m5.4xlarge Microsoft Azure D8s v3 Google n1-standard-8 Microsoft Azure F8s v2 Microsoft Azure D4s v3 Microsoft Azure E4s v3 EC2 m5.large 0.2205 0.441 0.6615 0.882 1.1025 0.03 0.04 0.04 0.05 0.06 0.06 0.06 0.06 0.07 0.10 0.14 0.14 0.16 0.20 0.28 0.28 0.38 0.75 0.98 1. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 14 Seconds: cost approximately 0.01 dollar. 2. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar. 3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 16 Seconds: cost approximately 0.01 dollar. 4. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar. 5. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 22 Seconds: cost approximately 0.01 dollar. 6. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 21 Seconds: cost approximately 0.01 dollar. 7. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 23 Seconds: cost approximately 0.01 dollar. 8. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 21 Seconds: cost approximately 0.01 dollar. 9. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 20 Seconds: cost approximately 0.02 dollar. 10. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 35 Seconds: cost approximately 0.01 dollar. 11. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 47 Seconds: cost approximately 0.01 dollar. 12. Google n1-standard-16: $0.533 reported cost per hour, test consumed 47 Seconds: cost approximately 0.01 dollar. 13. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 53 Seconds: cost approximately 0.01 dollar. 14. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 3 Seconds: cost approximately 0.01 dollar. 15. Google n1-standard-8: $0.268 reported cost per hour, test consumed 1 Minute, 27 Seconds: cost approximately 0.01 dollar. 16. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 29 Seconds: cost approximately 0.01 dollar. 17. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 1 Minute, 58 Seconds: cost approximately 0.01 dollar. 18. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.02 dollar. 19. EC2 m5.large: $0.096 reported cost per hour, test consumed 4 Minutes, 58 Seconds: cost approximately 0.01 dollar.
C-Ray Performance / Cost - Total Time OpenBenchmarking.org Seconds x Dollar, Fewer Is Better C-Ray 1.1 Performance / Cost - Total Time EC2 c4.8xlarge EC2 m4.10xlarge EC2 m4.16xlarge Microsoft Azure D32s v3 Microsoft Azure D64s v3 EC2 c5.18xlarge Microsoft Azure D16s v3 EC2 t2.2xlarge Microsoft Azure E32s v3 EC2 m5.12xlarge Google n1-highcpu-16 Google n1-standard-16 EC2 c5.9xlarge Microsoft Azure D8s v3 Google n1-highcpu-8 Google n1-standard-8 EC2 m5.4xlarge Microsoft Azure D4s v3 Microsoft Azure F8s v2 EC2 m5.large Microsoft Azure E4s v3 0.432 0.864 1.296 1.728 2.16 0.06 0.06 0.08 0.08 0.10 0.11 0.16 0.17 0.17 0.20 0.21 0.21 0.22 0.32 0.40 0.40 0.59 0.63 1.07 1.52 1.92 1. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 23 Seconds: cost approximately 0.01 dollar. 2. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 23 Seconds: cost approximately 0.01 dollar. 3. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 17 Seconds: cost approximately 0.02 dollar. 4. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 29 Seconds: cost approximately 0.01 dollar. 5. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 20 Seconds: cost approximately 0.02 dollar. 6. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 21 Seconds: cost approximately 0.02 dollar. 7. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 54 Seconds: cost approximately 0.01 dollar. 8. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 54 Seconds: cost approximately 0.01 dollar. 9. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 30 Seconds: cost approximately 0.02 dollar. 10. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 34 Seconds: cost approximately 0.02 dollar. 11. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 1 Minute, 7 Seconds: cost approximately 0.01 dollar. 12. Google n1-standard-16: $0.533 reported cost per hour, test consumed 1 Minute, 7 Seconds: cost approximately 0.01 dollar. 13. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 38 Seconds: cost approximately 0.02 dollar. 14. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 40 Seconds: cost approximately 0.01 dollar. 15. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 5 Seconds: cost approximately 0.01 dollar. 16. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 3 Seconds: cost approximately 0.01 dollar. 17. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 33 Seconds: cost approximately 0.02 dollar. 18. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 3 Minutes, 14 Seconds: cost approximately 0.01 dollar. 19. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 2 Minutes, 45 Seconds: cost approximately 0.02 dollar. 20. EC2 m5.large: $0.096 reported cost per hour, test consumed 7 Minutes, 40 Seconds: cost approximately 0.01 dollar. 21. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 3 Minutes, 16 Seconds: cost approximately 0.03 dollar.
Timed Linux Kernel Compilation Performance / Cost - Time To Compile OpenBenchmarking.org Seconds x Dollar, Fewer Is Better Timed Linux Kernel Compilation 4.13 Performance / Cost - Time To Compile EC2 c5.18xlarge EC2 c5.9xlarge Google n1-highcpu-16 EC2 m5.12xlarge EC2 c4.8xlarge Google n1-standard-16 EC2 m4.16xlarge EC2 m4.10xlarge EC2 t2.2xlarge Google n1-highcpu-8 EC2 m5.4xlarge Google n1-standard-8 Microsoft Azure D64s v3 Microsoft Azure D32s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 Microsoft Azure D16s v3 Microsoft Azure D8s v3 Microsoft Azure D4s v3 EC2 m5.large Microsoft Azure E4s v3 14 28 42 56 70 1.96 2.28 2.50 2.85 3.05 3.37 3.73 4.13 4.27 4.92 5.15 6.22 6.58 6.86 8.01 8.40 9.60 11.56 22.92 32.08 61.89 1. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 36 Seconds: cost approximately 0.08 dollar. 2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 2 Minutes, 13 Seconds: cost approximately 0.06 dollar. 3. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 4 Minutes, 33 Seconds: cost approximately 0.03 dollar. 4. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 9 Seconds: cost approximately 0.08 dollar. 5. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 2 Minutes, 35 Seconds: cost approximately 0.07 dollar. 6. Google n1-standard-16: $0.533 reported cost per hour, test consumed 4 Minutes, 42 Seconds: cost approximately 0.04 dollar. 7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 8 Seconds: cost approximately 0.11 dollar. 8. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 43 Seconds: cost approximately 0.09 dollar. 9. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 5 Minutes, 41 Seconds: cost approximately 0.04 dollar. 10. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 8 Minutes, 37 Seconds: cost approximately 0.03 dollar. 11. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 4 Minutes, 41 Seconds: cost approximately 0.06 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 8 Minutes, 10 Seconds: cost approximately 0.04 dollar. 13. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 47 Seconds: cost approximately 0.14 dollar. 14. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 3 Minutes, 52 Seconds: cost approximately 0.1 dollar. 15. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 8 Minutes, 24 Seconds: cost approximately 0.05 dollar. 16. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 3 Minutes, 40 Seconds: cost approximately 0.13 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 6 Minutes, 27 Seconds: cost approximately 0.08 dollar. 18. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 10 Minutes, 4 Seconds: cost approximately 0.06 dollar. 19. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 19 Minutes, 32 Seconds: cost approximately 0.06 dollar. 20. EC2 m5.large: $0.096 reported cost per hour, test consumed 32 Minutes, 29 Seconds: cost approximately 0.05 dollar. 21. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 19 Minutes, 46 Seconds: cost approximately 0.16 dollar.
Parboil Test: OpenMP CUTCP OpenBenchmarking.org Seconds, Fewer Is Better Parboil 2.5 Test: OpenMP CUTCP EC2 m4.16xlarge Microsoft Azure D64s v3 EC2 c5.18xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D32s v3 Microsoft Azure E32s v3 EC2 m5.12xlarge EC2 c5.9xlarge Microsoft Azure D16s v3 EC2 t2.2xlarge Google n1-highcpu-16 Google n1-standard-16 EC2 m5.4xlarge Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Microsoft Azure F8s v2 Microsoft Azure E4s v3 Microsoft Azure D4s v3 Orange Flexible Engine s1.medium EC2 m5.large 20 40 60 80 100 SE +/- 0.06, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.09, N = 3 SE +/- 0.11, N = 3 SE +/- 0.09, N = 3 SE +/- 0.16, N = 3 SE +/- 0.05, N = 3 SE +/- 0.46, N = 3 3.18 3.25 3.75 4.39 4.63 5.65 5.71 5.80 6.17 10.35 11.46 14.16 14.16 16.11 19.56 27.54 27.80 28.33 37.25 37.92 97.12 98.07 1. (CXX) g++ options: -lm -lpthread -lgomp -ffast-math -fopenmp
NGINX Benchmark Static Web Page Serving OpenBenchmarking.org Requests Per Second, More Is Better NGINX Benchmark 1.9.9 Static Web Page Serving EC2 c5.9xlarge Google n1-standard-16 EC2 m5.12xlarge Google n1-standard-8 EC2 c5.18xlarge Google n1-highcpu-16 EC2 c4.8xlarge EC2 m4.10xlarge EC2 m4.16xlarge Google n1-highcpu-8 EC2 m5.4xlarge EC2 t2.2xlarge Microsoft Azure F8s v2 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Microsoft Azure D4s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E32s v3 EC2 m5.large Orange Flexible Engine s1.medium 6K 12K 18K 24K 30K SE +/- 54.82, N = 3 SE +/- 73.63, N = 3 SE +/- 146.75, N = 3 SE +/- 98.84, N = 3 SE +/- 78.50, N = 3 SE +/- 91.80, N = 3 SE +/- 451.84, N = 3 SE +/- 101.19, N = 3 SE +/- 279.06, N = 3 SE +/- 341.39, N = 3 SE +/- 92.03, N = 3 SE +/- 798.70, N = 3 SE +/- 150.79, N = 3 SE +/- 142.39, N = 3 SE +/- 25.54, N = 3 SE +/- 1.63, N = 3 SE +/- 117.02, N = 3 SE +/- 619.74, N = 2 SE +/- 226.15, N = 3 SE +/- 297.47, N = 3 SE +/- 188.83, N = 3 SE +/- 41.91, N = 3 29999.02 26556.48 25555.24 25255.90 24619.23 24005.34 23090.77 21579.29 21410.50 21203.08 20160.69 18175.24 16486.68 15480.88 15431.68 14328.83 13495.31 13352.91 12687.56 12574.34 12132.51 8634.63 1. (CC) gcc options: -lpthread -lcrypt -lcrypto -lz -O3 -march=native
x264 Performance / Cost - H.264 Video Encoding OpenBenchmarking.org Frames Per Second Per Dollar, More Is Better x264 2018-02-05 Performance / Cost - H.264 Video Encoding EC2 c5.18xlarge EC2 c5.9xlarge EC2 m5.12xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D32s v3 EC2 m4.16xlarge EC2 m5.4xlarge Google n1-standard-16 Microsoft Azure D16s v3 Microsoft Azure D64s v3 EC2 t2.2xlarge Microsoft Azure E32s v3 Microsoft Azure F8s v2 Google n1-standard-8 Microsoft Azure D8s v3 Microsoft Azure D4s v3 Microsoft Azure E4s v3 4K 8K 12K 16K 20K 17603.00 13410.00 12966.00 10799.00 9743.00 8164.00 5767.00 5546.00 5207.00 4648.00 4102.00 3843.00 3587.00 3144.00 2693.00 2682.00 1395.00 604.00 1. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 15 Seconds: cost approximately 0.01 dollar. 2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar. 4. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 21 Seconds: cost approximately 0.01 dollar. 5. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 23 Seconds: cost approximately 0.01 dollar. 6. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 26 Seconds: cost approximately 0.01 dollar. 7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 20 Seconds: cost approximately 0.02 dollar. 8. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 37 Seconds: cost approximately 0.01 dollar. 9. Google n1-standard-16: $0.533 reported cost per hour, test consumed 39 Seconds: cost approximately 0.01 dollar. 10. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 43 Seconds: cost approximately 0.01 dollar. 11. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 27 Seconds: cost approximately 0.02 dollar. 12. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 51 Seconds: cost approximately 0.01 dollar. 13. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 29 Seconds: cost approximately 0.02 dollar. 14. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 1 Second: cost approximately 0.01 dollar. 15. Google n1-standard-8: $0.268 reported cost per hour, test consumed 1 Minute, 11 Seconds: cost approximately 0.01 dollar. 16. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 11 Seconds: cost approximately 0.01 dollar. 17. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 2 Minutes, 13 Seconds: cost approximately 0.01 dollar. 18. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 2 Minutes, 33 Seconds: cost approximately 0.02 dollar.
Open FMM Nero2D Performance / Cost - Total Time OpenBenchmarking.org Seconds x Dollar, Fewer Is Better Open FMM Nero2D 2.0.2 Performance / Cost - Total Time EC2 m4.16xlarge EC2 c4.8xlarge EC2 t2.2xlarge EC2 m4.10xlarge EC2 c5.18xlarge Microsoft Azure D64s v3 Microsoft Azure D32s v3 EC2 c5.9xlarge EC2 m5.12xlarge Google n1-highcpu-16 Microsoft Azure E32s v3 Google n1-highcpu-8 Microsoft Azure D16s v3 Google n1-standard-16 Google n1-standard-8 EC2 m5.4xlarge Microsoft Azure F8s v2 Microsoft Azure D8s v3 EC2 m5.large Microsoft Azure D4s v3 Microsoft Azure E4s v3 12 24 36 48 60 1.83 1.85 2.61 2.88 2.90 3.07 4.59 4.81 4.88 5.21 5.25 5.95 6.00 7.60 7.75 8.08 8.75 10.62 21.36 23.47 52.77 1. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 23 Seconds: cost approximately 0.07 dollar. 2. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.05 dollar. 3. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 4 Minutes, 26 Seconds: cost approximately 0.03 dollar. 4. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.07 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 40 Seconds: cost approximately 0.09 dollar. 6. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 1 Minute, 46 Seconds: cost approximately 0.09 dollar. 7. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 56 Seconds: cost approximately 0.08 dollar. 8. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 3 Minutes, 5 Seconds: cost approximately 0.08 dollar. 9. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 30 Seconds: cost approximately 0.1 dollar. 10. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 6 Minutes, 35 Seconds: cost approximately 0.04 dollar. 11. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 42 Seconds: cost approximately 0.1 dollar. 12. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 9 Minutes, 59 Seconds: cost approximately 0.03 dollar. 13. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 5 Minutes, 4 Seconds: cost approximately 0.06 dollar. 14. Google n1-standard-16: $0.533 reported cost per hour, test consumed 6 Minutes, 24 Seconds: cost approximately 0.06 dollar. 15. Google n1-standard-8: $0.268 reported cost per hour, test consumed 9 Minutes, 45 Seconds: cost approximately 0.04 dollar. 16. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 5 Minutes, 51 Seconds: cost approximately 0.07 dollar. 17. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 8 Minutes, 49 Seconds: cost approximately 0.05 dollar. 18. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 8 Minutes, 55 Seconds: cost approximately 0.06 dollar. 19. EC2 m5.large: $0.096 reported cost per hour, test consumed 26 Minutes, 47 Seconds: cost approximately 0.04 dollar. 20. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 19 Minutes, 38 Seconds: cost approximately 0.06 dollar. 21. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 17 Minutes, 39 Seconds: cost approximately 0.15 dollar.
x264 H.264 Video Encoding OpenBenchmarking.org Frames Per Second, More Is Better x264 2018-02-05 H.264 Video Encoding EC2 c5.18xlarge EC2 c5.9xlarge EC2 m5.12xlarge EC2 m4.16xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D64s v3 Microsoft Azure D32s v3 Microsoft Azure E32s v3 EC2 m5.4xlarge Google n1-highcpu-16 Google n1-standard-16 Microsoft Azure D16s v3 EC2 t2.2xlarge Microsoft Azure F8s v2 Google n1-standard-8 Microsoft Azure D8s v3 Google n1-highcpu-8 Microsoft Azure D4s v3 Microsoft Azure E4s v3 EC2 m5.large Orange Flexible Engine s1.medium 40 80 120 160 200 SE +/- 1.46, N = 3 SE +/- 0.49, N = 3 SE +/- 0.28, N = 3 SE +/- 1.25, N = 3 SE +/- 0.30, N = 3 SE +/- 0.19, N = 3 SE +/- 0.61, N = 3 SE +/- 0.27, N = 3 SE +/- 0.23, N = 3 SE +/- 0.55, N = 3 SE +/- 0.12, N = 3 SE +/- 0.24, N = 3 SE +/- 0.18, N = 3 SE +/- 0.03, N = 3 SE +/- 0.27, N = 3 SE +/- 0.05, N = 3 SE +/- 0.06, N = 3 SE +/- 0.14, N = 3 SE +/- 0.06, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.11, N = 4 176.03 134.10 129.66 115.34 107.99 97.43 82.04 81.64 71.74 55.46 52.41 52.07 46.48 38.43 31.44 26.93 26.82 25.92 13.95 12.08 11.02 6.18 1. (CC) gcc options: -ldl -m64 -lm -lpthread -O3 -ffast-math -std=gnu99 -fPIC -fomit-frame-pointer -fno-tree-vectorize
NAS Parallel Benchmarks Performance / Cost - Test / Class: EP.C OpenBenchmarking.org Total Mop/s Per Dollar, More Is Better NAS Parallel Benchmarks 3.3 Performance / Cost - Test / Class: EP.C EC2 c5.18xlarge EC2 c5.9xlarge EC2 m5.12xlarge Google n1-standard-16 Google n1-highcpu-16 EC2 m5.4xlarge EC2 m4.16xlarge EC2 c4.8xlarge Microsoft Azure F8s v2 Microsoft Azure D64s v3 Microsoft Azure D32s v3 Google n1-highcpu-8 Google n1-standard-8 EC2 m4.10xlarge Microsoft Azure E32s v3 Microsoft Azure D16s v3 EC2 t2.2xlarge Microsoft Azure D8s v3 EC2 m5.large Microsoft Azure D4s v3 Microsoft Azure E4s v3 50K 100K 150K 200K 250K 251281.00 125619.00 69274.50 47795.00 46455.00 45935.00 34498.00 33657.00 25623.00 24923.50 24363.00 23575.00 23387.00 20920.67 16524.33 12150.00 7310.00 6268.50 6099.00 3200.00 1081.67 1. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 16 Seconds: cost approximately 0.01 dollar. 2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 26 Seconds: cost approximately 0.01 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 24 Seconds: cost approximately 0.02 dollar. 4. Google n1-standard-16: $0.533 reported cost per hour, test consumed 58 Seconds: cost approximately 0.01 dollar. 5. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 1 Minute: cost approximately 0.01 dollar. 6. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute: cost approximately 0.01 dollar. 7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 30 Seconds: cost approximately 0.03 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 43 Seconds: cost approximately 0.02 dollar. 9. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 45 Seconds: cost approximately 0.01 dollar. 10. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 52 Seconds: cost approximately 0.04 dollar. 11. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 58 Seconds: cost approximately 0.02 dollar. 12. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 1 Minute, 54 Seconds: cost approximately 0.01 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.01 dollar. 14. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 47 Seconds: cost approximately 0.03 dollar. 15. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 57 Seconds: cost approximately 0.03 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 1 Minute, 50 Seconds: cost approximately 0.02 dollar. 17. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 3 Minutes, 1 Second: cost approximately 0.02 dollar. 18. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 3 Minutes, 30 Seconds: cost approximately 0.02 dollar. 19. EC2 m5.large: $0.096 reported cost per hour, test consumed 7 Minutes, 9 Seconds: cost approximately 0.01 dollar. 20. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 6 Minutes, 47 Seconds: cost approximately 0.02 dollar. 21. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 6 Minutes, 41 Seconds: cost approximately 0.06 dollar.
Scikit-Learn Performance / Cost - OpenBenchmarking.org Seconds x Dollar, Fewer Is Better Scikit-Learn 0.17.1 Performance / Cost - EC2 m5.large Microsoft Azure D4s v3 Microsoft Azure F8s v2 EC2 t2.2xlarge Microsoft Azure D8s v3 Google n1-highcpu-8 Microsoft Azure E4s v3 Google n1-standard-8 Google n1-highcpu-16 Microsoft Azure D16s v3 Google n1-standard-16 EC2 m5.4xlarge EC2 c4.8xlarge EC2 c5.9xlarge Microsoft Azure D32s v3 Microsoft Azure E32s v3 EC2 m4.10xlarge Microsoft Azure D64s v3 EC2 m5.12xlarge EC2 m4.16xlarge EC2 c5.18xlarge 20 40 60 80 100 4.30 5.91 9.69 10.74 11.56 13.64 15.02 15.61 23.84 25.89 27.74 29.66 36.10 45.62 51.76 58.08 61.33 75.28 79.77 89.63 93.35 1. EC2 m5.large: $0.096 reported cost per hour, test consumed 10 Minutes, 49 Seconds: cost approximately 0.02 dollar. 2. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 9 Minutes, 55 Seconds: cost approximately 0.03 dollar. 3. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 9 Minutes, 45 Seconds: cost approximately 0.05 dollar. 4. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 9 Minutes, 2 Seconds: cost approximately 0.06 dollar. 5. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 9 Minutes, 42 Seconds: cost approximately 0.06 dollar. 6. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 13 Minutes, 43 Seconds: cost approximately 0.05 dollar. 7. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 9 Minutes, 27 Seconds: cost approximately 0.08 dollar. 8. Google n1-standard-8: $0.268 reported cost per hour, test consumed 13 Minutes, 4 Seconds: cost approximately 0.06 dollar. 9. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 13 Minutes, 19 Seconds: cost approximately 0.09 dollar. 10. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 10 Minutes, 2 Seconds: cost approximately 0.13 dollar. 11. Google n1-standard-16: $0.533 reported cost per hour, test consumed 12 Minutes, 40 Seconds: cost approximately 0.11 dollar. 12. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 10 Minutes, 40 Seconds: cost approximately 0.14 dollar. 13. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 8 Minutes, 17 Seconds: cost approximately 0.22 dollar. 14. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 9 Minutes, 35 Seconds: cost approximately 0.24 dollar. 15. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 10 Minutes, 1 Second: cost approximately 0.26 dollar. 16. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 9 Minutes, 8 Seconds: cost approximately 0.32 dollar. 17. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 9 Minutes, 39 Seconds: cost approximately 0.32 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 8 Minutes, 37 Seconds: cost approximately 0.44 dollar. 19. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 10 Minutes, 17 Seconds: cost approximately 0.39 dollar. 20. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 9 Minutes, 13 Seconds: cost approximately 0.49 dollar. 21. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 9 Minutes, 36 Seconds: cost approximately 0.49 dollar.
Open FMM Nero2D Total Time OpenBenchmarking.org Seconds, Fewer Is Better Open FMM Nero2D 2.0.2 Total Time EC2 m4.16xlarge EC2 c5.18xlarge Microsoft Azure D64s v3 EC2 c4.8xlarge EC2 m4.10xlarge EC2 m5.12xlarge Microsoft Azure E32s v3 Microsoft Azure D32s v3 EC2 c5.9xlarge EC2 t2.2xlarge Microsoft Azure D16s v3 EC2 m5.4xlarge Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure F8s v2 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Microsoft Azure E4s v3 Microsoft Azure D4s v3 EC2 m5.large 120 240 360 480 600 SE +/- 0.13, N = 3 SE +/- 4.84, N = 3 SE +/- 0.33, N = 3 SE +/- 0.13, N = 3 SE +/- 0.80, N = 3 SE +/- 7.90, N = 3 SE +/- 0.33, N = 3 SE +/- 0.13, N = 3 SE +/- 0.96, N = 3 SE +/- 0.42, N = 3 SE +/- 0.02, N = 3 SE +/- 5.00, N = 3 SE +/- 1.34, N = 3 SE +/- 6.47, N = 3 SE +/- 1.35, N = 3 SE +/- 0.89, N = 3 SE +/- 0.90, N = 3 SE +/- 0.57, N = 3 SE +/- 0.74, N = 3 SE +/- 0.35, N = 3 SE +/- 8.89, N = 3 26.13 32.19 34.06 36.91 41.18 48.78 52.48 57.39 60.15 87.04 100.00 115.44 126.67 130.21 174.93 177.01 193.69 198.33 351.83 391.21 534.08 1. (CXX) g++ options: -O2 -lfftw3 -llapack -lblas -lgfortran -lquadmath -lm -pthread -lmpi_cxx -lmpi
PyBench Performance / Cost - Total For Average Test Times OpenBenchmarking.org Milliseconds x Dollar, Fewer Is Better PyBench 2018-02-16 Performance / Cost - Total For Average Test Times Microsoft Azure F8s v2 Google n1-standard-8 EC2 t2.2xlarge Google n1-highcpu-8 Microsoft Azure D4s v3 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure E4s v3 Microsoft Azure D8s v3 EC2 m5.4xlarge Microsoft Azure D16s v3 EC2 c5.9xlarge EC2 c4.8xlarge EC2 m5.12xlarge Microsoft Azure D32s v3 EC2 c5.18xlarge Microsoft Azure E32s v3 EC2 m4.10xlarge Microsoft Azure D64s v3 EC2 m4.16xlarge 70 140 210 280 350 16.31 20.35 20.44 20.69 21.91 40.72 41.26 43.42 43.86 53.76 66.03 80.35 109.14 142.16 152.81 160.90 181.35 200.25 238.32 313.46 1. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.01 dollar. 2. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 23 Seconds: cost approximately 0.01 dollar. 3. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 2 Minutes, 24 Seconds: cost approximately 0.01 dollar. 4. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 29 Seconds: cost approximately 0.01 dollar. 5. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 2 Minutes, 38 Seconds: cost approximately 0.01 dollar. 6. Google n1-standard-16: $0.533 reported cost per hour, test consumed 2 Minutes, 22 Seconds: cost approximately 0.02 dollar. 7. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 2 Minutes, 25 Seconds: cost approximately 0.02 dollar. 8. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 2 Minutes, 40 Seconds: cost approximately 0.02 dollar. 9. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 2 Minutes, 37 Seconds: cost approximately 0.02 dollar. 10. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.03 dollar. 11. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 2 Minutes, 37 Seconds: cost approximately 0.03 dollar. 12. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 53 Seconds: cost approximately 0.05 dollar. 13. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.06 dollar. 14. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 5 Seconds: cost approximately 0.08 dollar. 15. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 36 Seconds: cost approximately 0.07 dollar. 16. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 53 Seconds: cost approximately 0.1 dollar. 17. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 28 Seconds: cost approximately 0.09 dollar. 18. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 35 Seconds: cost approximately 0.09 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 21 Seconds: cost approximately 0.12 dollar. 20. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 36 Seconds: cost approximately 0.14 dollar.
TTSIOD 3D Renderer Phong Rendering With Soft-Shadow Mapping OpenBenchmarking.org FPS, More Is Better TTSIOD 3D Renderer 2.3a Phong Rendering With Soft-Shadow Mapping EC2 m5.12xlarge EC2 m4.16xlarge EC2 c5.9xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure E32s v3 Microsoft Azure D32s v3 EC2 c5.18xlarge Microsoft Azure D16s v3 Google n1-standard-16 Google n1-highcpu-16 EC2 t2.2xlarge EC2 m5.4xlarge Microsoft Azure D8s v3 Microsoft Azure D64s v3 Google n1-standard-8 Google n1-highcpu-8 Microsoft Azure F8s v2 Microsoft Azure E4s v3 Microsoft Azure D4s v3 Orange Flexible Engine s1.medium EC2 m5.large 110 220 330 440 550 SE +/- 4.78, N = 3 SE +/- 20.68, N = 3 SE +/- 4.23, N = 3 SE +/- 3.14, N = 3 SE +/- 3.29, N = 3 SE +/- 4.11, N = 3 SE +/- 5.69, N = 3 SE +/- 12.51, N = 3 SE +/- 1.45, N = 3 SE +/- 1.87, N = 3 SE +/- 2.14, N = 3 SE +/- 0.39, N = 3 SE +/- 0.49, N = 3 SE +/- 0.38, N = 3 SE +/- 1.98, N = 3 SE +/- 0.50, N = 3 SE +/- 0.39, N = 3 SE +/- 0.20, N = 3 SE +/- 0.10, N = 3 SE +/- 0.19, N = 3 SE +/- 0.04, N = 3 SE +/- 2.30, N = 3 504.82 465.90 460.27 419.30 394.52 381.87 381.19 336.76 249.33 238.88 234.96 231.07 184.83 142.43 141.98 129.81 124.66 106.43 75.14 74.64 29.47 26.88 1. (CXX) g++ options: -O3 -fomit-frame-pointer -ffast-math -mtune=native -flto -msse -mrecip -mfpmath=sse -msse2 -mssse3 -lSDL -lstdc++
TTSIOD 3D Renderer Performance / Cost - Phong Rendering With Soft-Shadow Mapping OpenBenchmarking.org FPS Per Dollar, More Is Better TTSIOD 3D Renderer 2.3a Performance / Cost - Phong Rendering With Soft-Shadow Mapping Google n1-standard-16 Google n1-highcpu-16 EC2 t2.2xlarge EC2 c5.9xlarge EC2 m5.12xlarge Microsoft Azure D8s v3 EC2 c4.8xlarge EC2 m4.10xlarge Google n1-standard-8 Microsoft Azure D32s v3 Microsoft Azure D16s v3 Google n1-highcpu-8 Microsoft Azure E32s v3 EC2 m4.16xlarge EC2 m5.4xlarge Microsoft Azure D4s v3 EC2 c5.18xlarge Microsoft Azure F8s v2 Microsoft Azure E4s v3 EC2 m5.large Microsoft Azure D64s v3 5K 10K 15K 20K 25K 23888.00 23496.00 23107.00 23013.50 16827.33 14243.00 13976.67 13150.67 12981.00 12706.33 12466.50 12466.00 9546.75 9318.00 9241.50 7464.00 5612.67 5321.50 2504.67 1344.00 1290.73 1. Google n1-standard-16: $0.533 reported cost per hour, test consumed 1 Minute, 24 Seconds: cost approximately 0.01 dollar. 2. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 1 Minute, 25 Seconds: cost approximately 0.01 dollar. 3. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 1 Minute, 26 Seconds: cost approximately 0.01 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 53 Seconds: cost approximately 0.02 dollar. 5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 50 Seconds: cost approximately 0.03 dollar. 6. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 2 Minutes, 6 Seconds: cost approximately 0.01 dollar. 7. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 58 Seconds: cost approximately 0.03 dollar. 8. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 1 Minute: cost approximately 0.03 dollar. 9. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 17 Seconds: cost approximately 0.01 dollar. 10. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 1 Minute, 1 Second: cost approximately 0.03 dollar. 11. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 1 Minute, 21 Seconds: cost approximately 0.02 dollar. 12. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 22 Seconds: cost approximately 0.01 dollar. 13. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 1 Minute: cost approximately 0.04 dollar. 14. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 54 Seconds: cost approximately 0.05 dollar. 15. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 42 Seconds: cost approximately 0.02 dollar. 16. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 3 Minutes, 41 Seconds: cost approximately 0.01 dollar. 17. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 10 Seconds: cost approximately 0.06 dollar. 18. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 2 Minutes, 42 Seconds: cost approximately 0.02 dollar. 19. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 3 Minutes, 40 Seconds: cost approximately 0.03 dollar. 20. EC2 m5.large: $0.096 reported cost per hour, test consumed 9 Minutes, 47 Seconds: cost approximately 0.02 dollar. 21. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 13 Seconds: cost approximately 0.11 dollar.
AOBench Performance / Cost - Size: 2048 x 2048 - Total Time OpenBenchmarking.org Seconds x Dollar, Fewer Is Better AOBench Performance / Cost - Size: 2048 x 2048 - Total Time EC2 m5.large Microsoft Azure D4s v3 Google n1-highcpu-8 Microsoft Azure F8s v2 EC2 t2.2xlarge Microsoft Azure D8s v3 Google n1-standard-8 Microsoft Azure E4s v3 Google n1-standard-16 Google n1-highcpu-16 EC2 m5.4xlarge Microsoft Azure D16s v3 EC2 c4.8xlarge EC2 c5.9xlarge Microsoft Azure D32s v3 EC2 m4.10xlarge Microsoft Azure E32s v3 Microsoft Azure D64s v3 EC2 m5.12xlarge EC2 c5.18xlarge EC2 m4.16xlarge 3 6 9 12 15 0.66 0.69 0.75 1.22 1.24 1.35 1.47 1.96 2.19 2.23 2.62 3.48 4.43 4.70 6.06 7.40 7.66 8.53 8.61 8.76 11.62 1. EC2 m5.large: $0.096 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.01 dollar. 2. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 3 Minutes, 31 Seconds: cost approximately 0.01 dollar. 3. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 3 Minutes, 48 Seconds: cost approximately 0.01 dollar. 4. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 3 Minutes, 6 Seconds: cost approximately 0.02 dollar. 5. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 3 Minutes, 11 Seconds: cost approximately 0.02 dollar. 6. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 3 Minutes, 26 Seconds: cost approximately 0.02 dollar. 7. Google n1-standard-8: $0.268 reported cost per hour, test consumed 3 Minutes, 45 Seconds: cost approximately 0.02 dollar. 8. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.03 dollar. 9. Google n1-standard-16: $0.533 reported cost per hour, test consumed 3 Minutes, 43 Seconds: cost approximately 0.03 dollar. 10. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 3 Minutes, 47 Seconds: cost approximately 0.03 dollar. 11. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.04 dollar. 12. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 3 Minutes, 32 Seconds: cost approximately 0.05 dollar. 13. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 2 Minutes, 50 Seconds: cost approximately 0.08 dollar. 14. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 3 Minutes: cost approximately 0.08 dollar. 15. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 3 Minutes, 26 Seconds: cost approximately 0.09 dollar. 16. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 3 Minutes, 26 Seconds: cost approximately 0.11 dollar. 17. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 3 Minutes, 16 Seconds: cost approximately 0.12 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 54 Seconds: cost approximately 0.15 dollar. 19. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 3 Minutes, 22 Seconds: cost approximately 0.13 dollar. 20. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 2 Minutes, 59 Seconds: cost approximately 0.15 dollar. 21. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 3 Minutes, 18 Seconds: cost approximately 0.18 dollar.
PyBench Performance / Cost - Total For Average Test Times OpenBenchmarking.org Milliseconds x Dollar, Fewer Is Better PyBench 2008-08-14 Performance / Cost - Total For Average Test Times Microsoft Azure F8s v2 EC2 t2.2xlarge Google n1-standard-8 Google n1-highcpu-8 Google n1-highcpu-16 Microsoft Azure D8s v3 Microsoft Azure D4s v3 EC2 m5.4xlarge Google n1-standard-16 Microsoft Azure E4s v3 EC2 c5.9xlarge Microsoft Azure D16s v3 EC2 c4.8xlarge EC2 m5.12xlarge Microsoft Azure D32s v3 EC2 c5.18xlarge Microsoft Azure E32s v3 EC2 m4.10xlarge Microsoft Azure D64s v3 EC2 m4.16xlarge 50 100 150 200 250 14.73 18.37 18.46 18.75 18.76 19.54 19.65 32.74 37.16 39.18 58.36 60.21 82.15 112.28 116.94 130.77 147.44 158.96 196.13 239.04 1. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 44 Seconds: cost approximately 0.01 dollar. 2. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 2 Minutes, 8 Seconds: cost approximately 0.01 dollar. 3. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 8 Seconds: cost approximately 0.01 dollar. 4. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 13 Seconds: cost approximately 0.01 dollar. 5. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 2 Minutes, 11 Seconds: cost approximately 0.01 dollar. 6. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.01 dollar. 7. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 2 Minutes, 20 Seconds: cost approximately 0.01 dollar. 8. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.02 dollar. 9. Google n1-standard-16: $0.533 reported cost per hour, test consumed 2 Minutes, 9 Seconds: cost approximately 0.02 dollar. 10. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 2 Minutes, 22 Seconds: cost approximately 0.02 dollar. 11. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 42 Seconds: cost approximately 0.04 dollar. 12. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 2 Minutes, 25 Seconds: cost approximately 0.03 dollar. 13. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 54 Seconds: cost approximately 0.05 dollar. 14. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 52 Seconds: cost approximately 0.07 dollar. 15. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.06 dollar. 16. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 41 Seconds: cost approximately 0.09 dollar. 17. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 16 Seconds: cost approximately 0.08 dollar. 18. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.08 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 4 Seconds: cost approximately 0.11 dollar. 20. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 17 Seconds: cost approximately 0.12 dollar.
LAME MP3 Encoding Performance / Cost - WAV To MP3 OpenBenchmarking.org Seconds x Dollar, Fewer Is Better LAME MP3 Encoding 3.100 Performance / Cost - WAV To MP3 Microsoft Azure F8s v2 EC2 t2.2xlarge Google n1-standard-8 Google n1-highcpu-8 Microsoft Azure D4s v3 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D8s v3 Microsoft Azure E4s v3 EC2 m5.4xlarge Microsoft Azure D16s v3 EC2 c5.9xlarge EC2 c4.8xlarge Microsoft Azure D32s v3 EC2 c5.18xlarge Microsoft Azure E32s v3 EC2 m4.10xlarge EC2 m5.12xlarge Microsoft Azure D64s v3 EC2 m4.16xlarge 1.2218 2.4436 3.6654 4.8872 6.109 0.41 0.42 0.45 0.46 0.47 0.90 0.91 0.92 0.93 1.32 1.41 1.78 1.88 2.75 3.21 3.50 3.64 3.92 4.51 5.43 1. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 2 Minutes, 6 Seconds: cost approximately 0.01 dollar. 2. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 2 Minutes, 10 Seconds: cost approximately 0.01 dollar. 3. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.01 dollar. 4. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 21 Seconds: cost approximately 0.01 dollar. 5. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 2 Minutes, 24 Seconds: cost approximately 0.01 dollar. 6. Google n1-standard-16: $0.533 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.02 dollar. 7. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 2 Minutes, 21 Seconds: cost approximately 0.02 dollar. 8. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 2 Minutes, 21 Seconds: cost approximately 0.02 dollar. 9. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 2 Minutes, 23 Seconds: cost approximately 0.02 dollar. 10. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 2 Minutes, 16 Seconds: cost approximately 0.03 dollar. 11. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 2 Minutes, 25 Seconds: cost approximately 0.03 dollar. 12. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 51 Seconds: cost approximately 0.05 dollar. 13. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.05 dollar. 14. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 22 Seconds: cost approximately 0.06 dollar. 15. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 51 Seconds: cost approximately 0.09 dollar. 16. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 15 Seconds: cost approximately 0.08 dollar. 17. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 21 Seconds: cost approximately 0.08 dollar. 18. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 14 Seconds: cost approximately 0.09 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.11 dollar. 20. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 19 Seconds: cost approximately 0.12 dollar.
Crafty Performance / Cost - Elapsed Time OpenBenchmarking.org Nodes Per Second Per Dollar, More Is Better Crafty 25.2 Performance / Cost - Elapsed Time Microsoft Azure F8s v2 EC2 t2.2xlarge Microsoft Azure D8s v3 Microsoft Azure D4s v3 Google n1-standard-8 Google n1-highcpu-16 Google n1-highcpu-8 EC2 m5.4xlarge Google n1-standard-16 Microsoft Azure E4s v3 EC2 c5.9xlarge Microsoft Azure D16s v3 EC2 c4.8xlarge EC2 m5.12xlarge Microsoft Azure D32s v3 EC2 m4.10xlarge EC2 c5.18xlarge Microsoft Azure E32s v3 Microsoft Azure D64s v3 EC2 m4.16xlarge 140M 280M 420M 560M 700M 656271400.00 582404500.00 520150600.00 510643800.00 504095900.00 493289800.00 483920300.00 301199600.00 262684350.00 252121450.00 174220025.00 167761900.00 162002600.00 106209933.33 102417160.00 89494183.33 87186775.00 71851685.71 66509722.22 53780620.00 1. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 35 Seconds: cost approximately 0.01 dollar. 2. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 1 Minute, 49 Seconds: cost approximately 0.01 dollar. 3. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 58 Seconds: cost approximately 0.01 dollar. 4. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 2 Minutes: cost approximately 0.01 dollar. 5. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 1 Second: cost approximately 0.01 dollar. 6. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 2 Minutes, 5 Seconds: cost approximately 0.01 dollar. 7. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.01 dollar. 8. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 43 Seconds: cost approximately 0.02 dollar. 9. Google n1-standard-16: $0.533 reported cost per hour, test consumed 1 Minute, 58 Seconds: cost approximately 0.02 dollar. 10. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 2 Minutes, 2 Seconds: cost approximately 0.02 dollar. 11. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 29 Seconds: cost approximately 0.04 dollar. 12. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 2 Minutes, 2 Seconds: cost approximately 0.03 dollar. 13. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 36 Seconds: cost approximately 0.04 dollar. 14. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 37 Seconds: cost approximately 0.06 dollar. 15. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 1 Minute, 59 Seconds: cost approximately 0.05 dollar. 16. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.06 dollar. 17. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 29 Seconds: cost approximately 0.08 dollar. 18. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 2 Seconds: cost approximately 0.07 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 1 Minute, 43 Seconds: cost approximately 0.09 dollar. 20. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 54 Seconds: cost approximately 0.1 dollar.
OpenSSL Performance / Cost - RSA 4096-bit Performance OpenBenchmarking.org Signs Per Second Per Dollar, More Is Better OpenSSL 1.1.0f Performance / Cost - RSA 4096-bit Performance EC2 m5.4xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.12xlarge Microsoft Azure D64s v3 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure F8s v2 Microsoft Azure D16s v3 EC2 c4.8xlarge Microsoft Azure E32s v3 EC2 m4.16xlarge Microsoft Azure D32s v3 EC2 m4.10xlarge Microsoft Azure D8s v3 Microsoft Azure E4s v3 EC2 t2.2xlarge 40K 80K 120K 160K 200K 186093.00 155716.67 155061.17 141728.25 116524.60 109173.00 107887.00 101747.00 92947.00 85985.67 72340.00 66044.50 62966.67 60264.25 47840.00 37640.00 17483.00 1. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.03 dollar. 3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.06 dollar. 4. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.04 dollar. 5. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.05 dollar. 6. Google n1-standard-16: $0.533 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.01 dollar. 7. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 8. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 9. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 10. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.03 dollar. 11. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.04 dollar. 12. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.06 dollar. 13. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.03 dollar. 14. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.04 dollar. 15. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 16. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 17. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.01 dollar.
Timed MAFFT Alignment Performance / Cost - Multiple Sequence Alignment OpenBenchmarking.org Seconds x Dollar, Fewer Is Better Timed MAFFT Alignment 6.864 Performance / Cost - Multiple Sequence Alignment EC2 c5.9xlarge EC2 m5.12xlarge EC2 c4.8xlarge EC2 c5.18xlarge EC2 m4.10xlarge Microsoft Azure D32s v3 Microsoft Azure E32s v3 Microsoft Azure E4s v3 EC2 m4.16xlarge Microsoft Azure D64s v3 0.0675 0.135 0.2025 0.27 0.3375 0.03 0.03 0.04 0.04 0.06 0.07 0.07 0.12 0.27 0.30 1. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 12 Seconds: cost approximately 0.01 dollar. 2. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 14 Seconds: cost approximately 0.01 dollar. 3. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar. 4. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 17 Seconds: cost approximately 0.01 dollar. 5. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 21 Seconds: cost approximately 0.01 dollar. 6. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 24 Seconds: cost approximately 0.01 dollar. 7. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 25 Seconds: cost approximately 0.01 dollar. 8. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 40 Seconds: cost approximately 0.01 dollar. 9. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 31 Seconds: cost approximately 0.03 dollar. 10. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 34 Seconds: cost approximately 0.03 dollar.
Scikit-Learn OpenBenchmarking.org Seconds, Fewer Is Better Scikit-Learn 0.17.1 EC2 c4.8xlarge Microsoft Azure D64s v3 EC2 t2.2xlarge Microsoft Azure E32s v3 EC2 m4.16xlarge Microsoft Azure E4s v3 EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.10xlarge Microsoft Azure D8s v3 Microsoft Azure F8s v2 Microsoft Azure D4s v3 Microsoft Azure D32s v3 Microsoft Azure D16s v3 EC2 m5.12xlarge EC2 m5.4xlarge EC2 m5.large Orange Flexible Engine s1.medium Google n1-standard-16 Google n1-standard-8 Google n1-highcpu-16 Google n1-highcpu-8 60 120 180 240 300 SE +/- 0.56, N = 3 SE +/- 1.42, N = 3 SE +/- 0.08, N = 3 SE +/- 2.86, N = 3 SE +/- 0.14, N = 3 SE +/- 1.78, N = 3 SE +/- 0.05, N = 3 SE +/- 0.17, N = 3 SE +/- 1.48, N = 3 SE +/- 0.52, N = 3 SE +/- 0.09, N = 3 SE +/- 0.35, N = 3 SE +/- 2.98, N = 3 SE +/- 0.92, N = 3 SE +/- 0.02, N = 3 SE +/- 0.07, N = 3 SE +/- 9.88, N = 3 SE +/- 0.25, N = 3 SE +/- 0.47, N = 3 SE +/- 0.62, N = 3 SE +/- 0.83, N = 3 SE +/- 0.80, N = 3 164.09 171.10 179.03 181.49 182.92 187.80 190.08 190.52 191.67 192.66 193.88 196.96 199.08 199.18 204.55 211.86 214.77 219.06 252.14 260.15 264.88 272.74
PyBench Total For Average Test Times OpenBenchmarking.org Milliseconds, Fewer Is Better PyBench 2018-02-16 Total For Average Test Times EC2 c5.9xlarge EC2 c5.18xlarge Microsoft Azure F8s v2 EC2 m5.large EC2 m5.12xlarge EC2 m5.4xlarge EC2 c4.8xlarge Microsoft Azure D64s v3 Microsoft Azure E32s v3 Google n1-standard-8 Google n1-standard-16 EC2 t2.2xlarge Google n1-highcpu-16 Google n1-highcpu-8 Microsoft Azure E4s v3 Microsoft Azure D32s v3 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 EC2 m4.10xlarge EC2 m4.16xlarge Orange Flexible Engine s1.medium 600 1200 1800 2400 3000 SE +/- 3.48, N = 3 SE +/- 3.53, N = 3 SE +/- 7.51, N = 3 SE +/- 14.67, N = 3 SE +/- 4.51, N = 3 SE +/- 3.84, N = 3 SE +/- 8.66, N = 3 SE +/- 1.53, N = 3 SE +/- 4.73, N = 3 SE +/- 4.91, N = 3 SE +/- 0.33, N = 3 SE +/- 2.52, N = 3 SE +/- 1.45, N = 3 SE +/- 11.57, N = 3 SE +/- 6.08, N = 3 SE +/- 0.88, N = 3 SE +/- 12.44, N = 3 SE +/- 5.24, N = 3 SE +/- 4.16, N = 3 SE +/- 2.40, N = 3 SE +/- 3.28, N = 3 1607 1609 1631 1721 1777 1792 1819 1986 2015 2035 2036 2044 2063 2069 2171 2183 2191 2193 2201 2225 2239 2644
PyBench Total For Average Test Times OpenBenchmarking.org Milliseconds, Fewer Is Better PyBench 2008-08-14 Total For Average Test Times EC2 c5.18xlarge EC2 c5.9xlarge Microsoft Azure F8s v2 EC2 m5.large EC2 m5.12xlarge EC2 m5.4xlarge EC2 c4.8xlarge Microsoft Azure D64s v3 EC2 t2.2xlarge Microsoft Azure E32s v3 Google n1-standard-8 Google n1-standard-16 Google n1-highcpu-8 Google n1-highcpu-16 Microsoft Azure D32s v3 Microsoft Azure D8s v3 Microsoft Azure E4s v3 Microsoft Azure D4s v3 EC2 m4.10xlarge EC2 m4.16xlarge Microsoft Azure D16s v3 Orange Flexible Engine s1.medium 500 1000 1500 2000 2500 SE +/- 7.42, N = 3 SE +/- 4.41, N = 3 SE +/- 2.73, N = 3 SE +/- 2.03, N = 3 SE +/- 11.46, N = 3 SE +/- 8.33, N = 3 SE +/- 6.00, N = 3 SE +/- 4.91, N = 3 SE +/- 13.86, N = 3 SE +/- 10.17, N = 3 SE +/- 5.93, N = 3 SE +/- 1.33, N = 3 SE +/- 0.58, N = 3 SE +/- 9.50, N = 3 SE +/- 14.74, N = 3 SE +/- 6.23, N = 3 SE +/- 3.61, N = 3 SE +/- 1.73, N = 3 1453 1459 1473 1559 1604 1637 1643 1783 1837 1843 1846 1858 1875 1876 1949 1954 1959 1965 1987 1992 2007 2359
Crafty Elapsed Time OpenBenchmarking.org Nodes Per Second, More Is Better Crafty 25.2 Elapsed Time EC2 c5.18xlarge EC2 c5.9xlarge Microsoft Azure F8s v2 EC2 c4.8xlarge EC2 m5.12xlarge EC2 m5.4xlarge Microsoft Azure D64s v3 EC2 t2.2xlarge EC2 m5.large EC2 m4.16xlarge EC2 m4.10xlarge Google n1-standard-16 Microsoft Azure D8s v3 Microsoft Azure D32s v3 Microsoft Azure D4s v3 Microsoft Azure E4s v3 Google n1-standard-8 Microsoft Azure D16s v3 Microsoft Azure E32s v3 Google n1-highcpu-16 Google n1-highcpu-8 Orange Flexible Engine s1.medium 1.5M 3M 4.5M 6M 7.5M SE +/- 7074.19, N = 3 SE +/- 7226.78, N = 3 SE +/- 27207.60, N = 3 SE +/- 24158.72, N = 3 SE +/- 2343.50, N = 3 SE +/- 7362.69, N = 3 SE +/- 4663.73, N = 3 SE +/- 3484.54, N = 3 SE +/- 87880.44, N = 3 SE +/- 14246.76, N = 3 SE +/- 24686.39, N = 3 SE +/- 33738.56, N = 3 SE +/- 30240.43, N = 3 SE +/- 65958.25, N = 3 SE +/- 22944.13, N = 3 SE +/- 35943.27, N = 3 SE +/- 7660.06, N = 3 SE +/- 22783.95, N = 3 SE +/- 108291.70, N = 3 SE +/- 3776.53, N = 3 SE +/- 18368.33, N = 3 SE +/- 23171.34, N = 3 6974942 6968801 6562714 6480104 6372596 6023992 5985875 5824045 5691579 5378062 5369651 5253687 5201506 5120858 5106438 5042429 5040959 5032857 5029618 4932898 4839203 4415980 1. (CC) gcc options: -lstdc++ -fprofile-use -pthread -lm
LAME MP3 Encoding WAV To MP3 OpenBenchmarking.org Seconds, Fewer Is Better LAME MP3 Encoding 3.100 WAV To MP3 EC2 c5.18xlarge EC2 c5.9xlarge EC2 c4.8xlarge Microsoft Azure F8s v2 Microsoft Azure D64s v3 EC2 m5.large EC2 t2.2xlarge EC2 m5.12xlarge Microsoft Azure E32s v3 EC2 m5.4xlarge Google n1-standard-8 Google n1-standard-16 EC2 m4.16xlarge EC2 m4.10xlarge Google n1-highcpu-16 Microsoft Azure D8s v3 Google n1-highcpu-8 Microsoft Azure D32s v3 Microsoft Azure E4s v3 Microsoft Azure D4s v3 Microsoft Azure D16s v3 Orange Flexible Engine s1.medium 12 24 36 48 60 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.33, N = 3 SE +/- 0.04, N = 3 SE +/- 1.71, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.32, N = 3 SE +/- 0.03, N = 3 SE +/- 0.11, N = 3 SE +/- 0.00, N = 3 SE +/- 0.17, N = 3 SE +/- 0.08, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.36, N = 3 SE +/- 0.10, N = 3 SE +/- 0.10, N = 3 SE +/- 0.02, N = 3 SE +/- 0.07, N = 3 SE +/- 0.61, N = 3 35.62 35.63 37.62 40.51 41.01 41.09 42.12 43.57 43.77 43.90 44.72 44.85 45.22 45.51 45.56 45.77 45.81 45.88 46.44 46.62 47.04 53.69 1. (CC) gcc options: -lm
AOBench Size: 2048 x 2048 - Total Time OpenBenchmarking.org Seconds, Fewer Is Better AOBench Size: 2048 x 2048 - Total Time EC2 c4.8xlarge Microsoft Azure D64s v3 EC2 c5.18xlarge EC2 c5.9xlarge Microsoft Azure F8s v2 EC2 t2.2xlarge Microsoft Azure E32s v3 EC2 m4.16xlarge Microsoft Azure E4s v3 EC2 m5.4xlarge EC2 m5.large EC2 m5.12xlarge EC2 m4.10xlarge Microsoft Azure D32s v3 Microsoft Azure D8s v3 Microsoft Azure D4s v3 Microsoft Azure D16s v3 Google n1-standard-16 Google n1-standard-8 Google n1-highcpu-16 Orange Flexible Engine s1.medium Google n1-highcpu-8 20 40 60 80 100 SE +/- 0.11, N = 3 SE +/- 0.36, N = 3 SE +/- 0.12, N = 3 SE +/- 0.38, N = 3 SE +/- 0.52, N = 3 SE +/- 0.04, N = 3 SE +/- 0.57, N = 3 SE +/- 1.04, N = 3 SE +/- 0.52, N = 3 SE +/- 0.16, N = 3 SE +/- 0.50, N = 3 SE +/- 1.07, N = 3 SE +/- 0.20, N = 3 SE +/- 0.07, N = 3 SE +/- 0.09, N = 3 SE +/- 0.22, N = 3 SE +/- 0.22, N = 3 SE +/- 0.03, N = 3 SE +/- 0.11, N = 3 SE +/- 0.10, N = 3 SE +/- 0.09, N = 3 SE +/- 0.12, N = 3 55.39 56.84 58.42 58.70 60.80 62.18 63.81 64.56 65.32 65.48 65.51 66.21 67.24 67.28 67.42 68.85 69.50 72.86 73.65 74.22 74.41 74.77 1. (CC) gcc options: -lm -O3
Timed Linux Kernel Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 4.13 Time To Compile EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D64s v3 Microsoft Azure E32s v3 Microsoft Azure D32s v3 Google n1-highcpu-16 Google n1-standard-16 EC2 m5.4xlarge EC2 t2.2xlarge Microsoft Azure D16s v3 Google n1-standard-8 Microsoft Azure F8s v2 Google n1-highcpu-8 Microsoft Azure D8s v3 Microsoft Azure D4s v3 Microsoft Azure E4s v3 EC2 m5.large Orange Flexible Engine s1.medium 200 400 600 800 1000 SE +/- 1.47, N = 3 SE +/- 1.14, N = 3 SE +/- 1.57, N = 3 SE +/- 1.57, N = 3 SE +/- 1.05, N = 3 SE +/- 1.16, N = 3 SE +/- 11.84, N = 3 SE +/- 4.86, N = 3 SE +/- 7.94, N = 3 SE +/- 1.19, N = 3 SE +/- 1.08, N = 3 SE +/- 1.41, N = 3 SE +/- 0.79, N = 3 SE +/- 5.75, N = 3 SE +/- 1.36, N = 3 SE +/- 14.41, N = 3 SE +/- 2.20, N = 3 SE +/- 1.81, N = 3 SE +/- 14.52, N = 3 SE +/- 13.44, N = 3 SE +/- 46.62, N = 3 SE +/- 0.87, N = 3 24.48 33.90 35.61 37.99 43.51 45.91 46.99 64.62 68.61 83.23 84.17 85.77 106.83 119.95 155.50 160.25 164.16 192.60 381.97 386.80 641.51 895.79
Timed MAFFT Alignment Multiple Sequence Alignment OpenBenchmarking.org Seconds, Fewer Is Better Timed MAFFT Alignment 6.864 Multiple Sequence Alignment EC2 c5.9xlarge EC2 m5.12xlarge EC2 c5.18xlarge EC2 t2.2xlarge EC2 m5.4xlarge EC2 c4.8xlarge Google n1-highcpu-16 Google n1-standard-16 EC2 m4.10xlarge Microsoft Azure D16s v3 Microsoft Azure F8s v2 Microsoft Azure D8s v3 Microsoft Azure E32s v3 Microsoft Azure D32s v3 Google n1-standard-8 Google n1-highcpu-8 EC2 m4.16xlarge Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure D4s v3 EC2 m5.large Orange Flexible Engine s1.medium 6 12 18 24 30 SE +/- 0.05, N = 3 SE +/- 0.13, N = 3 SE +/- 0.21, N = 3 SE +/- 0.01, N = 3 SE +/- 0.24, N = 3 SE +/- 0.15, N = 3 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 SE +/- 0.59, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.22, N = 3 SE +/- 0.18, N = 3 SE +/- 0.41, N = 3 SE +/- 0.16, N = 3 SE +/- 0.08, N = 3 SE +/- 0.13, N = 3 SE +/- 0.56, N = 3 SE +/- 0.26, N = 3 SE +/- 0.07, N = 3 SE +/- 0.02, N = 3 2.72 3.18 4.23 4.26 4.35 4.42 4.91 4.96 5.78 5.88 6.33 6.61 6.80 6.94 7.30 7.44 8.84 10.04 11.86 11.89 20.00 27.45 1. (CC) gcc options: -O3 -lm -lpthread
Phoronix Test Suite v10.8.4