Google Compute Engine, Amazon EC2, Microsoft Azure Public Compute Cloud Benchmarks Various instance type benchmarks of different setups on Microsoft Azure, Amazon Elastic Compute Cloud, and Google Compute Engine. Benchmarks by Michael Larabel.
HTML result view exported from: https://openbenchmarking.org/result/1803148-FO-1802221FO10&rdt&grs .
Google Compute Engine, Amazon EC2, Microsoft Azure Public Compute Cloud Benchmarks Processor Motherboard Chipset Memory Disk Graphics Network OS Kernel Compiler File-System System Layer Screen Resolution EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge Intel Xeon E5-2676 v3 @ 2.39GHz (8 Cores) Xen HVM domU (4.2.amazon BIOS) Intel 440FX- 82441FX PMC 32768MB 28GB Cirrus Logic GD 5446 Ubuntu 16.04 4.4.0-1050-aws (x86_64) GCC 5.4.0 20160609 ext4 Xen HVM domU 4.2.amazon Intel Xeon Platinum 8175M @ 2.50GHz (8 Cores / 16 Threads) Amazon EC2 m5.4xlarge (1.0 BIOS) 63488MB 30GB Amazon Elastic Block Store Device 1d0f:ec20 KVM Intel Xeon Platinum 8175M @ 2.50GHz (24 Cores / 48 Threads) Amazon EC2 m5.12xlarge (1.0 BIOS) 189440MB Intel Xeon Platinum 8124M @ 3.00GHz (18 Cores / 36 Threads) Amazon EC2 c5.9xlarge (1.0 BIOS) 70656MB 2 x Intel Xeon Platinum 8124M @ 3.00GHz (36 Cores / 72 Threads) Amazon EC2 c5.18xlarge (1.0 BIOS) 141312MB 2 x Intel Xeon E5-2686 v4 @ 3.00GHz (32 Cores / 64 Threads) Xen HVM domU (4.2.amazon BIOS) 258048MB 28GB Cirrus Logic GD 5446 Xen HVM domU 4.2.amazon Intel Xeon Platinum 8175M @ 2.50GHz (1 Core / 2 Threads) Amazon EC2 m5.large (1.0 BIOS) 8192MB 30GB Amazon Elastic Block Store KVM 2 x Intel Xeon E5-2666 v3 @ 3.50GHz (18 Cores / 36 Threads) Xen HVM domU (4.2.amazon BIOS) 60416MB 28GB Cirrus Logic GD 5446 Intel 82599 Virtual Function Xen HVM domU 4.2.amazon 2 x Intel Xeon E5-2676 v3 @ 3.00GHz (20 Cores / 40 Threads) 161792MB Intel Xeon E5-2673 v3 @ 2.39GHz (2 Cores / 4 Threads) Microsoft Virtual Machine v7.0 (090007 BIOS) Intel 440BX/ZX/DX 16384MB 32GB Virtual Disk + 34GB Virtual Disk Microsoft Hyper-V virtual VGA 4.13.0-1009-azure (x86_64) 1152x864 Microsoft Hyper-V Server Intel Xeon E5-2673 v4 @ 2.29GHz (2 Cores / 4 Threads) 32768MB 32GB Virtual Disk + 69GB Virtual Disk Intel Xeon E5-2673 v3 @ 2.39GHz (4 Cores / 8 Threads) Intel Xeon @ 2.30GHz (4 Cores / 8 Threads) Google Compute Engine Intel 440FX- 82441FX PMC 30720MB 32GB PersistentDisk Red Hat Virtio device 4.13.0-1008-gcp (x86_64) KVM 8192MB Intel Xeon @ 2.30GHz (8 Cores / 16 Threads) 60416MB 11GB PersistentDisk 15360MB 32GB PersistentDisk Intel Xeon E5-2673 v3 @ 2.39GHz (8 Cores / 16 Threads) Microsoft Virtual Machine v7.0 (090007 BIOS) Intel 440BX/ZX/DX 64512MB 32GB Virtual Disk + 137GB Virtual Disk Microsoft Hyper-V virtual VGA 4.13.0-1009-azure (x86_64) 1152x864 Microsoft Hyper-V Server 2 x Intel Xeon E5-2673 v3 @ 2.39GHz (16 Cores / 32 Threads) 129024MB 32GB Virtual Disk + 275GB Virtual Disk 2 x Intel Xeon E5-2673 v4 @ 2.29GHz (32 Cores / 64 Threads) 258048MB 32GB Virtual Disk + 550GB Virtual Disk 4.13.0-1011-azure (x86_64) Intel Xeon Platinum 8168 @ 2.69GHz (4 Cores / 8 Threads) 16384MB 32GB Virtual Disk + 69GB Virtual Disk 2 x Intel Xeon E5-2673 v4 @ 2.29GHz (16 Cores / 32 Threads) 258048MB 32GB Virtual Disk + 550GB Virtual Disk Intel Xeon E5-2658 v4 @ 2.29GHz (4 Cores) Xen HVM domU (4.1.2_115-908.792. BIOS) Intel 440FX- 82441FX PMC 1 x 16376 MB RAM 39GB Cirrus Logic GD 5446 4.4.0-116-generic (x86_64) Xen HVM domU 4.1.2_115-908.792. OpenBenchmarking.org Compiler Details - --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v Python Details - Python 2.7.12 + Python 3.5.2 Security Details - EC2 t2.2xlarge: KPTI Protection - EC2 m5.4xlarge: KPTI Protection - EC2 m5.12xlarge: KPTI Protection - EC2 c5.9xlarge: KPTI Protection - EC2 c5.18xlarge: KPTI Protection - EC2 m4.16xlarge: KPTI Protection - EC2 m5.large: KPTI Protection - EC2 c4.8xlarge: KPTI Protection - EC2 m4.10xlarge: KPTI Protection - Microsoft Azure D4s v3: KPTI Protection - Microsoft Azure E4s v3: KPTI Protection - Microsoft Azure D8s v3: KPTI Protection - Google n1-standard-8: KPTI Protection - Google n1-highcpu-8: KPTI Protection - Google n1-standard-16: KPTI Protection - Google n1-highcpu-16: KPTI Protection - Microsoft Azure D16s v3: KPTI Protection - Microsoft Azure D32s v3: KPTI Protection - Microsoft Azure D64s v3: KPTI + OSB (observable speculation barrier Intel v6) + Full generic retpoline Protection - Microsoft Azure F8s v2: KPTI + OSB (observable speculation barrier Intel v6) + Full generic retpoline Protection - Microsoft Azure E32s v3: KPTI + OSB (observable speculation barrier Intel v6) + Full generic retpoline Protection - COrange DFFlexible Engine s1.xlarge: KPTI + OSB (observable speculation barrier Intel v6) + Full generic retpoline Protection Kernel Details - EC2 m5.4xlarge, EC2 m5.12xlarge, EC2 c5.9xlarge, EC2 c5.18xlarge, EC2 m5.large: nvme.io_timeout=4294967295 Processor Details - EC2 m4.16xlarge, EC2 c4.8xlarge, EC2 m4.10xlarge: Scaling Governor: intel_pstate powersave
Google Compute Engine, Amazon EC2, Microsoft Azure Public Compute Cloud Benchmarks openssl: RSA 4096-bit Performance npb: EP.C john-the-ripper: Blowfish java-jmh: Throughput c-ray: Total Time rodinia: OpenMP LavaMD povray: Trace Time compress-7zip: Compress Speed Test parboil: OpenMP CUTCP nero2d: Total Time nginx: Static Web Page Serving ttsiod-renderer: Phong Rendering With Soft-Shadow Mapping x264: H.264 Video Encoding scikit-learn: pybench: Total For Average Test Times pybench: Total For Average Test Times crafty: Elapsed Time encode-mp3: WAV To MP3 aobench: 2048 x 2048 - Total Time build-linux-kernel: Time To Compile mafft: Multiple Sequence Alignment EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 174.83 146.20 6067 4217431038.72 16.52 213.70 563.33 23917 11.46 87.04 18175.24 231.07 38.43 179.03 2044 1837 5824045 42.12 62.18 106.83 4.26 1860.93 459.35 12094 24447443003.95 29.48 115.20 87.10 36642 16.11 115.44 20160.69 184.83 55.46 211.86 1792 1637 6023992 43.90 65.48 85.77 4.35 5669.13 1385.49 37069 74086333554.07 9.94 39.53 29.87 112699 5.80 48.78 25555.24 504.82 129.66 204.55 1777 1604 6372596 43.57 66.21 35.61 3.18 4671.50 1256.19 30593 60940889045.98 11.00 44.56 32.35 91933 6.17 60.15 29999.02 460.27 134.10 190.08 1607 1459 6968801 35.63 58.70 37.99 2.72 9303.67 2512.81 60305 121829911181.01 5.72 22.77 17.74 160822 3.75 32.19 24619.23 336.76 176.03 190.52 1609 1453 6974942 35.62 58.42 24.48 4.23 3962.67 1034.94 39091 84002323902.87 4.16 34.10 24.12 115598 3.18 26.13 21410.50 465.90 115.34 182.92 2239 1992 5378062 45.22 64.56 33.90 8.84 242.00 60.99 1562 3178036199.44 152.07 828.97 617.28 5090 98.07 534.08 12132.51 26.88 11.02 214.77 1721 1559 5691579 41.09 65.51 641.51 20.00 2579.57 673.14 25341 56603426109.55 6.09 52.79 35.08 78087 4.39 36.91 23090.77 419.30 107.99 164.09 1819 1643 6480104 37.62 55.39 43.51 4.42 2410.57 627.62 23632 52821381652.06 6.46 56.59 37.44 75762 4.63 41.18 21579.29 394.52 97.43 191.67 2225 1987 5369651 45.51 67.24 45.91 5.78 242.10 64.00 2323 5267511004.58 63.05 550.02 346.10 9144 37.92 391.21 14328.83 74.64 13.95 196.96 2191 1965 5106438 46.62 68.85 381.97 11.89 376.40 64.90 2419 5147334632.54 63.95 529.89 378.52 8708 37.25 351.83 15480.88 75.14 12.08 187.80 2171 1959 5042429 46.44 65.32 386.80 11.86 478.40 125.37 4621 10474890150.44 31.97 279.78 172.17 17015 19.56 177.01 15431.68 142.43 26.82 192.66 2193 1954 5201506 45.77 67.42 192.60 6.61 554.97 233.87 5311 10676070774.18 39.77 245.74 150.53 16136 27.54 193.69 25255.90 129.81 26.93 260.15 2035 1846 5040959 44.72 73.65 155.50 7.30 540.70 235.75 5256 10642422187.43 40.08 246.30 152.93 14996 27.80 198.33 21203.08 124.66 25.92 272.74 2069 1875 4839203 45.81 74.77 164.16 7.44 1091.73 477.95 10649 21381785010.72 20.76 123.24 75.92 30229 14.16 126.67 26556.48 238.88 52.07 252.14 2036 1858 5253687 44.85 72.86 84.17 4.96 1078.87 464.55 10501 21349296898.72 20.84 122.90 75.87 30253 14.16 130.21 24005.34 234.96 52.41 264.88 2063 1876 4932898 45.56 74.22 83.23 4.91 929.47 243.00 8016 20355987704.49 16.49 144.60 89.86 30273 10.35 100.00 13495.31 249.33 46.48 199.18 2201 2007 5032857 47.04 69.50 119.95 5.88 1889.00 487.26 13792 41237574200.22 8.16 72.41 45.72 57028 5.65 57.39 13352.91 381.19 81.64 199.08 2183 1949 5120858 45.88 67.28 68.61 6.94 5826.23 996.94 14237 79724759013.03 5.15 35.20 25.87 97549 3.25 34.06 12687.56 141.98 82.04 171.10 1986 1783 5985875 41.01 56.84 46.99 10.04 1017.47 256.23 5912 13410992384.58 53.48 206.12 163.10 21252 28.33 174.93 16486.68 106.43 31.44 193.88 1631 1473 6562714 40.51 60.80 160.25 6.33 2893.60 495.73 13878 39975500322.53 8.46 69.61 48.85 56544 5.71 52.48 12574.34 381.87 71.74 181.49 2015 1843 5029618 43.77 63.81 64.62 6.80 404.93 2658 8842237904.79 38.78 470.58 235.04 10121 26.68 17661.61 98.75 16.46 222.51 2639 2382 4324494 53.83 76.44 245.93 8.85 OpenBenchmarking.org
POV-Ray Performance / Cost - Trace Time OpenBenchmarking.org Seconds x Dollar, Fewer Is Better POV-Ray 3.7.0.7 Performance / Cost - Trace Time EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 20 40 60 80 100 101.40 5.23 2.09 1.62 1.06 1.93 30.86 1.75 2.62 20.77 60.56 10.33 4.52 4.59 3.04 2.28 5.39 2.74 2.07 8.16 4.89 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 28 Minutes, 22 Seconds: cost approximately 0.18 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 4 Minutes, 34 Seconds: cost approximately 0.06 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 42 Seconds: cost approximately 0.07 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 48 Seconds: cost approximately 0.05 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.06 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 25 Seconds: cost approximately 0.08 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 31 Minutes, 4 Seconds: cost approximately 0.05 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 57 Seconds: cost approximately 0.05 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 5 Seconds: cost approximately 0.07 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 17 Minutes, 31 Seconds: cost approximately 0.06 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 19 Minutes, 9 Seconds: cost approximately 0.16 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 8 Minutes, 50 Seconds: cost approximately 0.06 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 7 Minutes, 44 Seconds: cost approximately 0.03 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 7 Minutes, 51 Seconds: cost approximately 0.03 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 4 Minutes: cost approximately 0.04 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 3 Minutes, 59 Seconds: cost approximately 0.03 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 4 Minutes, 42 Seconds: cost approximately 0.06 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 30 Seconds: cost approximately 0.06 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 1 Minute, 31 Seconds: cost approximately 0.08 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 8 Minutes, 22 Seconds: cost approximately 0.05 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 41 Seconds: cost approximately 0.1 dollar.
Cost To Run Tests Cost / Price Per Hour OpenBenchmarking.org Cost / Price Per Hour, Fewer Is Better Cost To Run Tests Cost / Price Per Hour EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 0.6728 1.3456 2.0184 2.6912 3.364 0.89 2.00 1.28 2.43 2.81 0.34 1.35 1.86 0.47 1.20 0.61 0.41 0.32 0.63 0.48 0.96 1.59 2.99 0.49 2.19 1. EC2 m5.4xlarge: $0.768 reported cost per hour, running tests consumed 1 Hour, 9 Minutes, 15 Seconds: cost approximately 0.89 dollar. 2. EC2 m5.12xlarge: $2.304 reported cost per hour, running tests consumed 52 Minutes, 9 Seconds: cost approximately 2 dollar. 3. EC2 c5.9xlarge: $1.53 reported cost per hour, running tests consumed 50 Minutes, 21 Seconds: cost approximately 1.28 dollar. 4. EC2 c5.18xlarge: $3.06 reported cost per hour, running tests consumed 47 Minutes, 35 Seconds: cost approximately 2.43 dollar. 5. EC2 m4.16xlarge: $3.20 reported cost per hour, running tests consumed 52 Minutes, 42 Seconds: cost approximately 2.81 dollar. 6. EC2 m5.large: $0.096 reported cost per hour, running tests consumed 3 Hours, 30 Minutes, 28 Seconds: cost approximately 0.34 dollar. 7. EC2 c4.8xlarge: $1.591 reported cost per hour, running tests consumed 50 Minutes, 46 Seconds: cost approximately 1.35 dollar. 8. EC2 m4.10xlarge: $2.00 reported cost per hour, running tests consumed 55 Minutes, 55 Seconds: cost approximately 1.86 dollar. 9. Microsoft Azure D4s v3: $0.1920 reported cost per hour, running tests consumed 2 Hours, 27 Minutes, 44 Seconds: cost approximately 0.47 dollar. 10. Microsoft Azure E4s v3: $0.495 reported cost per hour, running tests consumed 2 Hours, 25 Minutes, 51 Seconds: cost approximately 1.2 dollar. 11. Microsoft Azure D8s v3: $0.3840 reported cost per hour, running tests consumed 1 Hour, 35 Minutes, 54 Seconds: cost approximately 0.61 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, running tests consumed 1 Hour, 32 Minutes, 18 Seconds: cost approximately 0.41 dollar. 13. Google n1-highcpu-8: $0.199 reported cost per hour, running tests consumed 1 Hour, 35 Minutes, 11 Seconds: cost approximately 0.32 dollar. 14. Google n1-standard-16: $0.533 reported cost per hour, running tests consumed 1 Hour, 11 Minutes, 1 Second: cost approximately 0.63 dollar. 15. Google n1-highcpu-16: $0.399 reported cost per hour, running tests consumed 1 Hour, 12 Minutes, 24 Seconds: cost approximately 0.48 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, running tests consumed 1 Hour, 15 Minutes, 19 Seconds: cost approximately 0.96 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, running tests consumed 1 Hour, 2 Minutes, 12 Seconds: cost approximately 1.59 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, running tests consumed 58 Minutes, 25 Seconds: cost approximately 2.99 dollar. 19. Microsoft Azure F8s v2: $0.3380 reported cost per hour, running tests consumed 1 Hour, 27 Minutes, 16 Seconds: cost approximately 0.49 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, running tests consumed 1 Hour, 1 Minute, 44 Seconds: cost approximately 2.19 dollar.
Rodinia Performance / Cost - Test: OpenMP LavaMD OpenBenchmarking.org Seconds x Dollar, Fewer Is Better Rodinia 2.4 Performance / Cost - Test: OpenMP LavaMD EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 30 60 90 120 150 14.96 8.06 3.16 2.67 1.37 3.41 58.03 3.70 5.66 49.50 116.58 25.18 14.74 9.85 7.39 4.92 13.01 6.52 3.17 12.37 9.05 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 10 Minutes, 46 Seconds: cost approximately 0.07 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 5 Minutes, 50 Seconds: cost approximately 0.07 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 3 Seconds: cost approximately 0.08 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.06 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 12 Seconds: cost approximately 0.06 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 47 Seconds: cost approximately 0.1 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 41 Minutes, 30 Seconds: cost approximately 0.07 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 2 Minutes, 42 Seconds: cost approximately 0.07 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 54 Seconds: cost approximately 0.1 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 27 Minutes, 34 Seconds: cost approximately 0.09 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 26 Minutes, 34 Seconds: cost approximately 0.22 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 14 Minutes, 4 Seconds: cost approximately 0.09 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 12 Minutes, 21 Seconds: cost approximately 0.06 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 12 Minutes, 23 Seconds: cost approximately 0.04 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 6 Minutes, 14 Seconds: cost approximately 0.06 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 6 Minutes, 12 Seconds: cost approximately 0.04 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 7 Minutes, 18 Seconds: cost approximately 0.09 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 3 Minutes, 41 Seconds: cost approximately 0.09 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 1 Minute, 50 Seconds: cost approximately 0.09 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 10 Minutes, 22 Seconds: cost approximately 0.06 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 3 Minutes, 33 Seconds: cost approximately 0.13 dollar.
John The Ripper Performance / Cost - Test: Blowfish OpenBenchmarking.org Real C/S Per Dollar, More Is Better John The Ripper 1.8.0 Performance / Cost - Test: Blowfish EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 110K 220K 330K 440K 550K 303350.00 302350.00 285146.15 339922.22 354735.29 217172.22 156200.00 281566.67 214836.36 232300.00 80633.33 231050.00 531100.00 525600.00 354966.67 525050.00 200400.00 153244.44 79094.44 295600.00 115650.00 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 3 Minutes, 19 Seconds: cost approximately 0.02 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.04 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.13 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.09 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 3 Minutes, 22 Seconds: cost approximately 0.17 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.18 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.01 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.09 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 3 Minutes, 22 Seconds: cost approximately 0.11 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.01 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.03 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.02 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.01 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.01 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.03 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.02 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.04 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 3 Minutes, 23 Seconds: cost approximately 0.09 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 3 Minutes, 27 Seconds: cost approximately 0.18 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.02 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 3 Minutes, 23 Seconds: cost approximately 0.12 dollar.
Java JMH Performance / Cost - Throughput OpenBenchmarking.org Ops/s Per Dollar, More Is Better Java JMH Performance / Cost - Throughput EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 110000M 220000M 330000M 440000M 550000M 105435775968.00 271638255599.44 274393827978.04 338560494699.89 338416419947.25 221058747112.82 317803619944.00 314463478386.39 229658181095.91 263375550229.00 85788910542.33 261872253761.00 355869025806.00 532121109371.50 356363083512.00 426985937974.40 226177641161.00 229097634445.67 181192634120.52 335274809614.50 159902001290.12 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 7 Minutes, 14 Seconds: cost approximately 0.04 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 6 Minutes, 53 Seconds: cost approximately 0.09 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 6 Minutes, 57 Seconds: cost approximately 0.27 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 6 Minutes, 55 Seconds: cost approximately 0.18 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 7 Minutes, 1 Second: cost approximately 0.36 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 7 Minutes, 4 Seconds: cost approximately 0.38 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 6 Minutes, 47 Seconds: cost approximately 0.01 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 6 Minutes, 58 Seconds: cost approximately 0.18 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 6 Minutes, 59 Seconds: cost approximately 0.23 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 6 Minutes, 49 Seconds: cost approximately 0.02 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 6 Minutes, 49 Seconds: cost approximately 0.06 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 6 Minutes, 49 Seconds: cost approximately 0.04 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 6 Minutes, 48 Seconds: cost approximately 0.03 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 6 Minutes, 49 Seconds: cost approximately 0.02 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 6 Minutes, 48 Seconds: cost approximately 0.06 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 6 Minutes, 49 Seconds: cost approximately 0.05 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 6 Minutes, 52 Seconds: cost approximately 0.09 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 7 Minutes, 3 Seconds: cost approximately 0.18 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 8 Minutes, 35 Seconds: cost approximately 0.44 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 6 Minutes, 48 Seconds: cost approximately 0.04 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 7 Minutes, 4 Seconds: cost approximately 0.25 dollar.
OpenSSL RSA 4096-bit Performance OpenBenchmarking.org Signs Per Second, More Is Better OpenSSL 1.1.0f RSA 4096-bit Performance EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 2K 4K 6K 8K 10K SE +/- 1.37, N = 3 SE +/- 2.33, N = 3 SE +/- 13.34, N = 3 SE +/- 1.27, N = 3 SE +/- 19.65, N = 3 SE +/- 4.00, N = 3 SE +/- 0.95, N = 3 SE +/- 2.55, N = 3 SE +/- 2.05, N = 3 SE +/- 2.80, N = 3 SE +/- 0.35, N = 3 SE +/- 0.31, N = 3 SE +/- 34.32, N = 3 SE +/- 21.05, N = 3 SE +/- 49.53, N = 3 SE +/- 37.17, N = 3 SE +/- 1.62, N = 3 SE +/- 1.96, N = 3 SE +/- 35.20, N = 3 SE +/- 3.69, N = 3 SE +/- 4.11, N = 3 SE +/- 1.85, N = 3 174.83 1860.93 5669.13 4671.50 9303.67 3962.67 242.00 2579.57 2410.57 242.10 376.40 478.40 554.97 540.70 1091.73 1078.87 929.47 1889.00 5826.23 1017.47 2893.60 404.93 1. (CC) gcc options: -O3 -pthread -m64 -lssl -lcrypto -ldl
NGINX Benchmark Performance / Cost - Static Web Page Serving OpenBenchmarking.org Requests Per Second Per Dollar, More Is Better NGINX Benchmark 1.9.9 Performance / Cost - Static Web Page Serving EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 300K 600K 900K 1200K 1500K 454381.00 288009.86 159720.25 333322.44 111905.59 79298.15 1213251.00 192423.08 126937.00 716441.50 258014.67 385792.00 1262795.00 1060154.00 663912.00 800178.00 134953.10 74182.83 30208.48 412167.00 43359.79 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 5 Minutes, 50 Seconds: cost approximately 0.04 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 5 Minutes, 16 Seconds: cost approximately 0.07 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 4 Minutes, 12 Seconds: cost approximately 0.16 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 3 Minutes, 37 Seconds: cost approximately 0.09 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 4 Minutes, 22 Seconds: cost approximately 0.22 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 5 Minutes: cost approximately 0.27 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 8 Minutes, 35 Seconds: cost approximately 0.01 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 4 Minutes, 37 Seconds: cost approximately 0.12 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 4 Minutes, 57 Seconds: cost approximately 0.17 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 7 Minutes, 18 Seconds: cost approximately 0.02 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 6 Minutes, 47 Seconds: cost approximately 0.06 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 6 Minutes, 47 Seconds: cost approximately 0.04 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 4 Minutes, 17 Seconds: cost approximately 0.02 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 5 Minutes, 3 Seconds: cost approximately 0.02 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 4 Minutes, 5 Seconds: cost approximately 0.04 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 4 Minutes, 29 Seconds: cost approximately 0.03 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 7 Minutes, 44 Seconds: cost approximately 0.1 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 7 Minutes, 5 Seconds: cost approximately 0.18 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 8 Minutes, 12 Seconds: cost approximately 0.42 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 6 Minutes, 22 Seconds: cost approximately 0.04 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 8 Minutes, 17 Seconds: cost approximately 0.29 dollar.
NAS Parallel Benchmarks Test / Class: EP.C OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.3 Test / Class: EP.C EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 500 1000 1500 2000 2500 SE +/- 0.08, N = 3 SE +/- 1.09, N = 3 SE +/- 1.50, N = 3 SE +/- 19.93, N = 3 SE +/- 29.39, N = 3 SE +/- 1.06, N = 3 SE +/- 3.02, N = 3 SE +/- 3.43, N = 3 SE +/- 0.96, N = 3 SE +/- 0.23, N = 3 SE +/- 0.06, N = 3 SE +/- 0.54, N = 3 SE +/- 1.37, N = 3 SE +/- 2.09, N = 3 SE +/- 3.92, N = 3 SE +/- 17.11, N = 3 SE +/- 1.01, N = 3 SE +/- 0.74, N = 3 SE +/- 1.86, N = 3 SE +/- 1.49, N = 3 SE +/- 0.98, N = 3 146.20 459.35 1385.49 1256.19 2512.81 1034.94 60.99 673.14 627.62 64.00 64.90 125.37 233.87 235.75 477.95 464.55 243.00 487.26 996.94 256.23 495.73 1. (F9X) gfortran options: -O3 -march=native -pthread -lmpi_usempif08 -lmpi_mpifh -lmpi 2. Open MPI 1.10.2
7-Zip Compression Performance / Cost - Compress Speed Test OpenBenchmarking.org MIPS Per Dollar, More Is Better 7-Zip Compression 9.20.1 Performance / Cost - Compress Speed Test EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 600K 1200K 1800K 2400K 3000K 2391700.00 1832100.00 1609985.71 2298325.00 1462018.18 770653.33 1561740.00 1082314.29 914400.00 870800.00 1701500.00 1613600.00 1499600.00 1511450.00 3025300.00 1513650.00 950466.67 750376.92 2125200.00 706800.00 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 1 Minute, 14 Seconds: cost approximately 0.01 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 38 Seconds: cost approximately 0.02 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.07 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 39 Seconds: cost approximately 0.04 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 2 Minutes, 6 Seconds: cost approximately 0.11 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 45 Seconds: cost approximately 0.15 dollar. 7. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 51 Seconds: cost approximately 0.05 dollar. 8. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 14 Seconds: cost approximately 0.07 dollar. 9. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 1 Minute, 36 Seconds: cost approximately 0.01 dollar. 10. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 1 Minute, 39 Seconds: cost approximately 0.01 dollar. 11. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 42 Seconds: cost approximately 0.01 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 1 Minute, 46 Seconds: cost approximately 0.01 dollar. 13. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 1 Minute, 52 Seconds: cost approximately 0.01 dollar. 14. Google n1-standard-16: $0.533 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.02 dollar. 15. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.01 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.02 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 11 Seconds: cost approximately 0.06 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 37 Seconds: cost approximately 0.13 dollar. 19. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 24 Seconds: cost approximately 0.01 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 12 Seconds: cost approximately 0.08 dollar.
John The Ripper Test: Blowfish OpenBenchmarking.org Real C/S, More Is Better John The Ripper 1.8.0 Test: Blowfish EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 13K 26K 39K 52K 65K SE +/- 21.00, N = 3 SE +/- 41.59, N = 3 SE +/- 26.19, N = 3 SE +/- 33.25, N = 3 SE +/- 193.12, N = 3 SE +/- 23.86, N = 3 SE +/- 40.45, N = 3 SE +/- 16.00, N = 3 SE +/- 30.95, N = 3 SE +/- 2.89, N = 3 SE +/- 22.84, N = 3 SE +/- 6.51, N = 3 SE +/- 8.50, N = 3 SE +/- 25.67, N = 3 SE +/- 21.36, N = 3 SE +/- 45.99, N = 3 SE +/- 504.49, N = 3 SE +/- 166.51, N = 3 SE +/- 29.67, N = 3 SE +/- 629.45, N = 3 SE +/- 12.66, N = 3 6067 12094 37069 30593 60305 39091 1562 25341 23632 2323 2419 4621 5311 5256 10649 10501 8016 13792 14237 5912 13878 2658 1. (CC) gcc options: -fopenmp -lcrypt
Java JMH Throughput OpenBenchmarking.org Ops/s, More Is Better Java JMH Throughput EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 30000M 60000M 90000M 120000M 150000M 4217431038.72 24447443003.95 74086333554.07 60940889045.98 121829911181.01 84002323902.87 3178036199.44 56603426109.55 52821381652.06 5267511004.58 5147334632.54 10474890150.44 10676070774.18 10642422187.43 21381785010.72 21349296898.72 20355987704.49 41237574200.22 79724759013.03 13410992384.58 39975500322.53 8842237904.79
C-Ray Total Time OpenBenchmarking.org Seconds, Fewer Is Better C-Ray 1.1 Total Time EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 30 60 90 120 150 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 5.71, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.14, N = 3 SE +/- 0.11, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.42, N = 3 SE +/- 0.23, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 16.52 29.48 9.94 11.00 5.72 4.16 152.07 6.09 6.46 63.05 63.95 31.97 39.77 40.08 20.76 20.84 16.49 8.16 5.15 53.48 8.46 38.78 1. (CC) gcc options: -lm -lpthread -O3
Rodinia Test: OpenMP LavaMD OpenBenchmarking.org Seconds, Fewer Is Better Rodinia 2.4 Test: OpenMP LavaMD EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 200 400 600 800 1000 SE +/- 0.03, N = 3 SE +/- 2.22, N = 3 SE +/- 0.81, N = 3 SE +/- 0.33, N = 3 SE +/- 0.16, N = 3 SE +/- 0.05, N = 3 SE +/- 7.59, N = 3 SE +/- 0.11, N = 3 SE +/- 0.02, N = 3 SE +/- 1.53, N = 3 SE +/- 2.20, N = 3 SE +/- 0.06, N = 3 SE +/- 0.90, N = 3 SE +/- 0.54, N = 3 SE +/- 0.19, N = 3 SE +/- 0.47, N = 3 SE +/- 0.32, N = 3 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 SE +/- 1.61, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 213.70 115.20 39.53 44.56 22.77 34.10 828.97 52.79 56.59 550.02 529.89 279.78 245.74 246.30 123.24 122.90 144.60 72.41 35.20 206.12 69.61 470.58 1. (CXX) g++ options: -O2 -lOpenCL
POV-Ray Trace Time OpenBenchmarking.org Seconds, Fewer Is Better POV-Ray 3.7.0.7 Trace Time EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 130 260 390 520 650 SE +/- 29.42, N = 3 SE +/- 0.14, N = 3 SE +/- 0.03, N = 3 SE +/- 0.18, N = 3 SE +/- 0.13, N = 3 SE +/- 0.07, N = 3 SE +/- 40.66, N = 3 SE +/- 0.14, N = 3 SE +/- 0.02, N = 3 SE +/- 0.27, N = 3 SE +/- 0.16, N = 3 SE +/- 0.04, N = 3 SE +/- 0.31, N = 3 SE +/- 0.04, N = 3 SE +/- 0.28, N = 3 SE +/- 0.10, N = 3 SE +/- 0.27, N = 3 SE +/- 0.04, N = 3 SE +/- 0.16, N = 3 SE +/- 0.17, N = 3 SE +/- 0.18, N = 3 SE +/- 0.18, N = 3 563.33 87.10 29.87 32.35 17.74 24.12 617.28 35.08 37.44 346.10 378.52 172.17 150.53 152.93 75.92 75.87 89.86 45.72 25.87 163.10 48.85 235.04 1. (CXX) g++ options: -pipe -O3 -ffast-math -march=native -pthread -lSDL -lSM -lICE -lX11 -ltiff -ljpeg -lpng -lz -lrt -lm -lboost_thread -lboost_system
Parboil Performance / Cost - Test: OpenMP CUTCP OpenBenchmarking.org Seconds x Dollar, Fewer Is Better Parboil 2.5 Performance / Cost - Test: OpenMP CUTCP EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 0.2205 0.441 0.6615 0.882 1.1025 0.16 0.06 0.06 0.04 0.03 0.98 0.04 0.05 0.38 0.75 0.20 0.28 0.14 0.14 0.10 0.06 0.07 0.28 0.06 1. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 53 Seconds: cost approximately 0.01 dollar. 2. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 21 Seconds: cost approximately 0.01 dollar. 3. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 22 Seconds: cost approximately 0.01 dollar. 4. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 16 Seconds: cost approximately 0.01 dollar. 5. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 14 Seconds: cost approximately 0.01 dollar. 6. EC2 m5.large: $0.096 reported cost per hour, test consumed 4 Minutes, 58 Seconds: cost approximately 0.01 dollar. 7. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar. 8. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar. 9. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 1 Minute, 58 Seconds: cost approximately 0.01 dollar. 10. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.02 dollar. 11. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 3 Seconds: cost approximately 0.01 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 1 Minute, 27 Seconds: cost approximately 0.01 dollar. 13. Google n1-standard-16: $0.533 reported cost per hour, test consumed 47 Seconds: cost approximately 0.01 dollar. 14. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 47 Seconds: cost approximately 0.01 dollar. 15. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 35 Seconds: cost approximately 0.01 dollar. 16. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 23 Seconds: cost approximately 0.01 dollar. 17. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 20 Seconds: cost approximately 0.02 dollar. 18. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 29 Seconds: cost approximately 0.01 dollar. 19. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 21 Seconds: cost approximately 0.01 dollar.
C-Ray Performance / Cost - Total Time OpenBenchmarking.org Seconds x Dollar, Fewer Is Better C-Ray 1.1 Performance / Cost - Total Time EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 0.432 0.864 1.296 1.728 2.16 0.17 0.59 0.20 0.22 0.11 0.08 1.52 0.06 0.06 0.63 1.92 0.32 0.40 0.40 0.21 0.21 0.16 0.08 0.10 1.07 0.17 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 54 Seconds: cost approximately 0.01 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 33 Seconds: cost approximately 0.02 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 34 Seconds: cost approximately 0.02 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 38 Seconds: cost approximately 0.02 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 21 Seconds: cost approximately 0.02 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 17 Seconds: cost approximately 0.02 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 7 Minutes, 40 Seconds: cost approximately 0.01 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 23 Seconds: cost approximately 0.01 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 23 Seconds: cost approximately 0.01 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 3 Minutes, 14 Seconds: cost approximately 0.01 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 3 Minutes, 16 Seconds: cost approximately 0.03 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 40 Seconds: cost approximately 0.01 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 3 Seconds: cost approximately 0.01 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 5 Seconds: cost approximately 0.01 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 1 Minute, 7 Seconds: cost approximately 0.01 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 1 Minute, 7 Seconds: cost approximately 0.01 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 54 Seconds: cost approximately 0.01 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 29 Seconds: cost approximately 0.01 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 20 Seconds: cost approximately 0.02 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 2 Minutes, 45 Seconds: cost approximately 0.02 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 30 Seconds: cost approximately 0.02 dollar.
7-Zip Compression Compress Speed Test OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 9.20.1 Compress Speed Test EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 30K 60K 90K 120K 150K SE +/- 86.00, N = 3 SE +/- 282.94, N = 3 SE +/- 480.06, N = 3 SE +/- 226.61, N = 3 SE +/- 319.70, N = 3 SE +/- 482.44, N = 3 SE +/- 28.62, N = 3 SE +/- 380.57, N = 3 SE +/- 280.19, N = 3 SE +/- 90.16, N = 3 SE +/- 16.02, N = 3 SE +/- 88.33, N = 3 SE +/- 75.03, N = 3 SE +/- 16.90, N = 3 SE +/- 130.52, N = 3 SE +/- 132.53, N = 3 SE +/- 231.20, N = 3 SE +/- 268.12, N = 3 SE +/- 416.92, N = 3 SE +/- 244.04, N = 3 SE +/- 60.61, N = 3 SE +/- 35.51, N = 3 23917 36642 112699 91933 160822 115598 5090 78087 75762 9144 8708 17015 16136 14996 30229 30253 30273 57028 97549 21252 56544 10121 1. (CXX) g++ options: -pipe -lpthread
Timed Linux Kernel Compilation Performance / Cost - Time To Compile OpenBenchmarking.org Seconds x Dollar, Fewer Is Better Timed Linux Kernel Compilation 4.13 Performance / Cost - Time To Compile EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 14 28 42 56 70 4.27 5.15 2.85 2.28 1.96 3.73 32.08 3.05 4.13 22.92 61.89 11.56 6.22 4.92 3.37 2.50 9.60 6.86 6.58 8.01 8.40 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 5 Minutes, 41 Seconds: cost approximately 0.04 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 4 Minutes, 41 Seconds: cost approximately 0.06 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 9 Seconds: cost approximately 0.08 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 2 Minutes, 13 Seconds: cost approximately 0.06 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 36 Seconds: cost approximately 0.08 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 8 Seconds: cost approximately 0.11 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 32 Minutes, 29 Seconds: cost approximately 0.05 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 2 Minutes, 35 Seconds: cost approximately 0.07 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 43 Seconds: cost approximately 0.09 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 19 Minutes, 32 Seconds: cost approximately 0.06 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 19 Minutes, 46 Seconds: cost approximately 0.16 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 10 Minutes, 4 Seconds: cost approximately 0.06 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 8 Minutes, 10 Seconds: cost approximately 0.04 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 8 Minutes, 37 Seconds: cost approximately 0.03 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 4 Minutes, 42 Seconds: cost approximately 0.04 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 4 Minutes, 33 Seconds: cost approximately 0.03 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 6 Minutes, 27 Seconds: cost approximately 0.08 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 3 Minutes, 52 Seconds: cost approximately 0.1 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 47 Seconds: cost approximately 0.14 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 8 Minutes, 24 Seconds: cost approximately 0.05 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 3 Minutes, 40 Seconds: cost approximately 0.13 dollar.
Parboil Test: OpenMP CUTCP OpenBenchmarking.org Seconds, Fewer Is Better Parboil 2.5 Test: OpenMP CUTCP EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 20 40 60 80 100 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.06, N = 3 SE +/- 0.46, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.16, N = 3 SE +/- 0.09, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.09, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.11, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 11.46 16.11 5.80 6.17 3.75 3.18 98.07 4.39 4.63 37.92 37.25 19.56 27.54 27.80 14.16 14.16 10.35 5.65 3.25 28.33 5.71 26.68 1. (CXX) g++ options: -lm -lpthread -lgomp -ffast-math -fopenmp
x264 Performance / Cost - H.264 Video Encoding OpenBenchmarking.org Frames Per Second Per Dollar, More Is Better x264 2018-02-05 Performance / Cost - H.264 Video Encoding EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 4K 8K 12K 16K 20K 3843.00 5546.00 12966.00 13410.00 17603.00 5767.00 10799.00 9743.00 1395.00 604.00 2682.00 2693.00 5207.00 4648.00 8164.00 4102.00 3144.00 3587.00 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 51 Seconds: cost approximately 0.01 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 37 Seconds: cost approximately 0.01 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 15 Seconds: cost approximately 0.01 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 20 Seconds: cost approximately 0.02 dollar. 7. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 21 Seconds: cost approximately 0.01 dollar. 8. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 23 Seconds: cost approximately 0.01 dollar. 9. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 2 Minutes, 13 Seconds: cost approximately 0.01 dollar. 10. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 2 Minutes, 33 Seconds: cost approximately 0.02 dollar. 11. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 11 Seconds: cost approximately 0.01 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 1 Minute, 11 Seconds: cost approximately 0.01 dollar. 13. Google n1-standard-16: $0.533 reported cost per hour, test consumed 39 Seconds: cost approximately 0.01 dollar. 14. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 43 Seconds: cost approximately 0.01 dollar. 15. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 26 Seconds: cost approximately 0.01 dollar. 16. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 27 Seconds: cost approximately 0.02 dollar. 17. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 1 Second: cost approximately 0.01 dollar. 18. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 29 Seconds: cost approximately 0.02 dollar.
Open FMM Nero2D Performance / Cost - Total Time OpenBenchmarking.org Seconds x Dollar, Fewer Is Better Open FMM Nero2D 2.0.2 Performance / Cost - Total Time EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 12 24 36 48 60 2.61 8.08 4.88 4.81 2.90 1.83 21.36 1.85 2.88 23.47 52.77 10.62 7.75 5.95 7.60 5.21 6.00 4.59 3.07 8.75 5.25 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 4 Minutes, 26 Seconds: cost approximately 0.03 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 5 Minutes, 51 Seconds: cost approximately 0.07 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 30 Seconds: cost approximately 0.1 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 3 Minutes, 5 Seconds: cost approximately 0.08 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 40 Seconds: cost approximately 0.09 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 23 Seconds: cost approximately 0.07 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 26 Minutes, 47 Seconds: cost approximately 0.04 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.05 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.07 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 19 Minutes, 38 Seconds: cost approximately 0.06 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 17 Minutes, 39 Seconds: cost approximately 0.15 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 8 Minutes, 55 Seconds: cost approximately 0.06 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 9 Minutes, 45 Seconds: cost approximately 0.04 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 9 Minutes, 59 Seconds: cost approximately 0.03 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 6 Minutes, 24 Seconds: cost approximately 0.06 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 6 Minutes, 35 Seconds: cost approximately 0.04 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 5 Minutes, 4 Seconds: cost approximately 0.06 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 56 Seconds: cost approximately 0.08 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 1 Minute, 46 Seconds: cost approximately 0.09 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 8 Minutes, 49 Seconds: cost approximately 0.05 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 42 Seconds: cost approximately 0.1 dollar.
NAS Parallel Benchmarks Performance / Cost - Test / Class: EP.C OpenBenchmarking.org Total Mop/s Per Dollar, More Is Better NAS Parallel Benchmarks 3.3 Performance / Cost - Test / Class: EP.C EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 50K 100K 150K 200K 250K 7310.00 45935.00 69274.50 125619.00 251281.00 34498.00 6099.00 33657.00 20920.67 3200.00 1081.67 6268.50 23387.00 23575.00 47795.00 46455.00 12150.00 24363.00 24923.50 25623.00 16524.33 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 3 Minutes, 1 Second: cost approximately 0.02 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute: cost approximately 0.01 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 24 Seconds: cost approximately 0.02 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 26 Seconds: cost approximately 0.01 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 16 Seconds: cost approximately 0.01 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 30 Seconds: cost approximately 0.03 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 7 Minutes, 9 Seconds: cost approximately 0.01 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 43 Seconds: cost approximately 0.02 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 47 Seconds: cost approximately 0.03 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 6 Minutes, 47 Seconds: cost approximately 0.02 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 6 Minutes, 41 Seconds: cost approximately 0.06 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 3 Minutes, 30 Seconds: cost approximately 0.02 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.01 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 1 Minute, 54 Seconds: cost approximately 0.01 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 58 Seconds: cost approximately 0.01 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 1 Minute: cost approximately 0.01 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 1 Minute, 50 Seconds: cost approximately 0.02 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 58 Seconds: cost approximately 0.02 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 52 Seconds: cost approximately 0.04 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 45 Seconds: cost approximately 0.01 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 57 Seconds: cost approximately 0.03 dollar.
Scikit-Learn Performance / Cost - OpenBenchmarking.org Seconds x Dollar, Fewer Is Better Scikit-Learn 0.17.1 Performance / Cost - EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 20 40 60 80 100 10.74 29.66 79.77 45.62 93.35 89.63 4.30 36.10 61.33 5.91 15.02 11.56 15.61 13.64 27.74 23.84 25.89 51.76 75.28 9.69 58.08 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 9 Minutes, 2 Seconds: cost approximately 0.06 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 10 Minutes, 40 Seconds: cost approximately 0.14 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 10 Minutes, 17 Seconds: cost approximately 0.39 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 9 Minutes, 35 Seconds: cost approximately 0.24 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 9 Minutes, 36 Seconds: cost approximately 0.49 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 9 Minutes, 13 Seconds: cost approximately 0.49 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 10 Minutes, 49 Seconds: cost approximately 0.02 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 8 Minutes, 17 Seconds: cost approximately 0.22 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 9 Minutes, 39 Seconds: cost approximately 0.32 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 9 Minutes, 55 Seconds: cost approximately 0.03 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 9 Minutes, 27 Seconds: cost approximately 0.08 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 9 Minutes, 42 Seconds: cost approximately 0.06 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 13 Minutes, 4 Seconds: cost approximately 0.06 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 13 Minutes, 43 Seconds: cost approximately 0.05 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 12 Minutes, 40 Seconds: cost approximately 0.11 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 13 Minutes, 19 Seconds: cost approximately 0.09 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 10 Minutes, 2 Seconds: cost approximately 0.13 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 10 Minutes, 1 Second: cost approximately 0.26 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 8 Minutes, 37 Seconds: cost approximately 0.44 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 9 Minutes, 45 Seconds: cost approximately 0.05 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 9 Minutes, 8 Seconds: cost approximately 0.32 dollar.
Open FMM Nero2D Total Time OpenBenchmarking.org Seconds, Fewer Is Better Open FMM Nero2D 2.0.2 Total Time EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 120 240 360 480 600 SE +/- 0.42, N = 3 SE +/- 5.00, N = 3 SE +/- 7.90, N = 3 SE +/- 0.96, N = 3 SE +/- 4.84, N = 3 SE +/- 0.13, N = 3 SE +/- 8.89, N = 3 SE +/- 0.13, N = 3 SE +/- 0.80, N = 3 SE +/- 0.35, N = 3 SE +/- 0.74, N = 3 SE +/- 0.89, N = 3 SE +/- 0.90, N = 3 SE +/- 0.57, N = 3 SE +/- 1.34, N = 3 SE +/- 6.47, N = 3 SE +/- 0.02, N = 3 SE +/- 0.13, N = 3 SE +/- 0.33, N = 3 SE +/- 1.35, N = 3 SE +/- 0.33, N = 3 87.04 115.44 48.78 60.15 32.19 26.13 534.08 36.91 41.18 391.21 351.83 177.01 193.69 198.33 126.67 130.21 100.00 57.39 34.06 174.93 52.48 1. (CXX) g++ options: -O2 -lfftw3 -llapack -lblas -lgfortran -lquadmath -lm -pthread -lmpi_cxx -lmpi
NGINX Benchmark Static Web Page Serving OpenBenchmarking.org Requests Per Second, More Is Better NGINX Benchmark 1.9.9 Static Web Page Serving EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 6K 12K 18K 24K 30K SE +/- 798.70, N = 3 SE +/- 92.03, N = 3 SE +/- 146.75, N = 3 SE +/- 54.82, N = 3 SE +/- 78.50, N = 3 SE +/- 279.06, N = 3 SE +/- 188.83, N = 3 SE +/- 451.84, N = 3 SE +/- 101.19, N = 3 SE +/- 1.63, N = 3 SE +/- 142.39, N = 3 SE +/- 25.54, N = 3 SE +/- 98.84, N = 3 SE +/- 341.39, N = 3 SE +/- 73.63, N = 3 SE +/- 91.80, N = 3 SE +/- 117.02, N = 3 SE +/- 619.74, N = 2 SE +/- 226.15, N = 3 SE +/- 150.79, N = 3 SE +/- 297.47, N = 3 SE +/- 38.17, N = 3 18175.24 20160.69 25555.24 29999.02 24619.23 21410.50 12132.51 23090.77 21579.29 14328.83 15480.88 15431.68 25255.90 21203.08 26556.48 24005.34 13495.31 13352.91 12687.56 16486.68 12574.34 17661.61 1. (CC) gcc options: -lpthread -lcrypt -lcrypto -lz -O3 -march=native
PyBench Performance / Cost - Total For Average Test Times OpenBenchmarking.org Milliseconds x Dollar, Fewer Is Better PyBench 2018-02-16 Performance / Cost - Total For Average Test Times EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 70 140 210 280 350 20.44 53.76 142.16 80.35 160.90 313.46 109.14 200.25 21.91 43.42 43.86 20.35 20.69 40.72 41.26 66.03 152.81 238.32 16.31 181.35 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 2 Minutes, 24 Seconds: cost approximately 0.01 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.03 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 5 Seconds: cost approximately 0.08 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 53 Seconds: cost approximately 0.05 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 53 Seconds: cost approximately 0.1 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 36 Seconds: cost approximately 0.14 dollar. 7. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.06 dollar. 8. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 35 Seconds: cost approximately 0.09 dollar. 9. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 2 Minutes, 38 Seconds: cost approximately 0.01 dollar. 10. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 2 Minutes, 40 Seconds: cost approximately 0.02 dollar. 11. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 2 Minutes, 37 Seconds: cost approximately 0.02 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 23 Seconds: cost approximately 0.01 dollar. 13. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 29 Seconds: cost approximately 0.01 dollar. 14. Google n1-standard-16: $0.533 reported cost per hour, test consumed 2 Minutes, 22 Seconds: cost approximately 0.02 dollar. 15. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 2 Minutes, 25 Seconds: cost approximately 0.02 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 2 Minutes, 37 Seconds: cost approximately 0.03 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 36 Seconds: cost approximately 0.07 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 21 Seconds: cost approximately 0.12 dollar. 19. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.01 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 28 Seconds: cost approximately 0.09 dollar.
TTSIOD 3D Renderer Phong Rendering With Soft-Shadow Mapping OpenBenchmarking.org FPS, More Is Better TTSIOD 3D Renderer 2.3a Phong Rendering With Soft-Shadow Mapping EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 110 220 330 440 550 SE +/- 0.39, N = 3 SE +/- 0.49, N = 3 SE +/- 4.78, N = 3 SE +/- 4.23, N = 3 SE +/- 12.51, N = 3 SE +/- 20.68, N = 3 SE +/- 2.30, N = 3 SE +/- 3.14, N = 3 SE +/- 3.29, N = 3 SE +/- 0.19, N = 3 SE +/- 0.10, N = 3 SE +/- 0.38, N = 3 SE +/- 0.50, N = 3 SE +/- 0.39, N = 3 SE +/- 1.87, N = 3 SE +/- 2.14, N = 3 SE +/- 1.45, N = 3 SE +/- 5.69, N = 3 SE +/- 1.98, N = 3 SE +/- 0.20, N = 3 SE +/- 4.11, N = 3 SE +/- 0.41, N = 3 231.07 184.83 504.82 460.27 336.76 465.90 26.88 419.30 394.52 74.64 75.14 142.43 129.81 124.66 238.88 234.96 249.33 381.19 141.98 106.43 381.87 98.75 1. (CXX) g++ options: -O3 -fomit-frame-pointer -ffast-math -mtune=native -flto -msse -mrecip -mfpmath=sse -msse2 -mssse3 -lSDL -lstdc++
TTSIOD 3D Renderer Performance / Cost - Phong Rendering With Soft-Shadow Mapping OpenBenchmarking.org FPS Per Dollar, More Is Better TTSIOD 3D Renderer 2.3a Performance / Cost - Phong Rendering With Soft-Shadow Mapping EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 5K 10K 15K 20K 25K 23107.00 9241.50 16827.33 23013.50 5612.67 9318.00 1344.00 13976.67 13150.67 7464.00 2504.67 14243.00 12981.00 12466.00 23888.00 23496.00 12466.50 12706.33 1290.73 5321.50 9546.75 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 1 Minute, 26 Seconds: cost approximately 0.01 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 42 Seconds: cost approximately 0.02 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 50 Seconds: cost approximately 0.03 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 53 Seconds: cost approximately 0.02 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 10 Seconds: cost approximately 0.06 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 54 Seconds: cost approximately 0.05 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 9 Minutes, 47 Seconds: cost approximately 0.02 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 58 Seconds: cost approximately 0.03 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 1 Minute: cost approximately 0.03 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 3 Minutes, 41 Seconds: cost approximately 0.01 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 3 Minutes, 40 Seconds: cost approximately 0.03 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 2 Minutes, 6 Seconds: cost approximately 0.01 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 17 Seconds: cost approximately 0.01 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 22 Seconds: cost approximately 0.01 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 1 Minute, 24 Seconds: cost approximately 0.01 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 1 Minute, 25 Seconds: cost approximately 0.01 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 1 Minute, 21 Seconds: cost approximately 0.02 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 1 Minute, 1 Second: cost approximately 0.03 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 13 Seconds: cost approximately 0.11 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 2 Minutes, 42 Seconds: cost approximately 0.02 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 1 Minute: cost approximately 0.04 dollar.
AOBench Performance / Cost - Size: 2048 x 2048 - Total Time OpenBenchmarking.org Seconds x Dollar, Fewer Is Better AOBench Performance / Cost - Size: 2048 x 2048 - Total Time EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 3 6 9 12 15 1.24 2.62 8.61 4.70 8.76 11.62 0.66 4.43 7.40 0.69 1.96 1.35 1.47 0.75 2.19 2.23 3.48 6.06 8.53 1.22 7.66 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 3 Minutes, 11 Seconds: cost approximately 0.02 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.04 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 3 Minutes, 22 Seconds: cost approximately 0.13 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 3 Minutes: cost approximately 0.08 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 2 Minutes, 59 Seconds: cost approximately 0.15 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 3 Minutes, 18 Seconds: cost approximately 0.18 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.01 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 2 Minutes, 50 Seconds: cost approximately 0.08 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 3 Minutes, 26 Seconds: cost approximately 0.11 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 3 Minutes, 31 Seconds: cost approximately 0.01 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.03 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 3 Minutes, 26 Seconds: cost approximately 0.02 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 3 Minutes, 45 Seconds: cost approximately 0.02 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 3 Minutes, 48 Seconds: cost approximately 0.01 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 3 Minutes, 43 Seconds: cost approximately 0.03 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 3 Minutes, 47 Seconds: cost approximately 0.03 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 3 Minutes, 32 Seconds: cost approximately 0.05 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 3 Minutes, 26 Seconds: cost approximately 0.09 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 54 Seconds: cost approximately 0.15 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 3 Minutes, 6 Seconds: cost approximately 0.02 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 3 Minutes, 16 Seconds: cost approximately 0.12 dollar.
PyBench Performance / Cost - Total For Average Test Times OpenBenchmarking.org Milliseconds x Dollar, Fewer Is Better PyBench 2008-08-14 Performance / Cost - Total For Average Test Times EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 50 100 150 200 250 18.37 32.74 112.28 58.36 130.77 239.04 82.15 158.96 19.65 39.18 19.54 18.46 18.75 37.16 18.76 60.21 116.94 196.13 14.73 147.44 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 2 Minutes, 8 Seconds: cost approximately 0.01 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.02 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 52 Seconds: cost approximately 0.07 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 42 Seconds: cost approximately 0.04 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 41 Seconds: cost approximately 0.09 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 17 Seconds: cost approximately 0.12 dollar. 7. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 54 Seconds: cost approximately 0.05 dollar. 8. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.08 dollar. 9. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 2 Minutes, 20 Seconds: cost approximately 0.01 dollar. 10. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 2 Minutes, 22 Seconds: cost approximately 0.02 dollar. 11. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.01 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 8 Seconds: cost approximately 0.01 dollar. 13. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 13 Seconds: cost approximately 0.01 dollar. 14. Google n1-standard-16: $0.533 reported cost per hour, test consumed 2 Minutes, 9 Seconds: cost approximately 0.02 dollar. 15. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 2 Minutes, 11 Seconds: cost approximately 0.01 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 2 Minutes, 25 Seconds: cost approximately 0.03 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.06 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 4 Seconds: cost approximately 0.11 dollar. 19. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 44 Seconds: cost approximately 0.01 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 16 Seconds: cost approximately 0.08 dollar.
x264 H.264 Video Encoding OpenBenchmarking.org Frames Per Second, More Is Better x264 2018-02-05 H.264 Video Encoding EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 40 80 120 160 200 SE +/- 0.03, N = 3 SE +/- 0.55, N = 3 SE +/- 0.28, N = 3 SE +/- 0.49, N = 3 SE +/- 1.46, N = 3 SE +/- 1.25, N = 3 SE +/- 0.02, N = 3 SE +/- 0.30, N = 3 SE +/- 0.19, N = 3 SE +/- 0.06, N = 3 SE +/- 0.01, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.14, N = 3 SE +/- 0.24, N = 3 SE +/- 0.12, N = 3 SE +/- 0.18, N = 3 SE +/- 0.27, N = 3 SE +/- 0.61, N = 3 SE +/- 0.27, N = 3 SE +/- 0.23, N = 3 SE +/- 0.06, N = 3 38.43 55.46 129.66 134.10 176.03 115.34 11.02 107.99 97.43 13.95 12.08 26.82 26.93 25.92 52.07 52.41 46.48 81.64 82.04 31.44 71.74 16.46 1. (CC) gcc options: -ldl -m64 -lm -lpthread -O3 -ffast-math -std=gnu99 -fPIC -fomit-frame-pointer -fno-tree-vectorize
LAME MP3 Encoding Performance / Cost - WAV To MP3 OpenBenchmarking.org Seconds x Dollar, Fewer Is Better LAME MP3 Encoding 3.100 Performance / Cost - WAV To MP3 EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 1.2218 2.4436 3.6654 4.8872 6.109 0.42 1.32 3.92 1.78 3.21 5.43 1.88 3.64 0.47 0.93 0.92 0.45 0.46 0.90 0.91 1.41 2.75 4.51 0.41 3.50 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 2 Minutes, 10 Seconds: cost approximately 0.01 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 2 Minutes, 16 Seconds: cost approximately 0.03 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 14 Seconds: cost approximately 0.09 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 51 Seconds: cost approximately 0.05 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 51 Seconds: cost approximately 0.09 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 19 Seconds: cost approximately 0.12 dollar. 7. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.05 dollar. 8. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 21 Seconds: cost approximately 0.08 dollar. 9. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 2 Minutes, 24 Seconds: cost approximately 0.01 dollar. 10. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 2 Minutes, 23 Seconds: cost approximately 0.02 dollar. 11. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 2 Minutes, 21 Seconds: cost approximately 0.02 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.01 dollar. 13. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 21 Seconds: cost approximately 0.01 dollar. 14. Google n1-standard-16: $0.533 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.02 dollar. 15. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 2 Minutes, 21 Seconds: cost approximately 0.02 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 2 Minutes, 25 Seconds: cost approximately 0.03 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 22 Seconds: cost approximately 0.06 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.11 dollar. 19. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 2 Minutes, 6 Seconds: cost approximately 0.01 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 15 Seconds: cost approximately 0.08 dollar.
Crafty Performance / Cost - Elapsed Time OpenBenchmarking.org Nodes Per Second Per Dollar, More Is Better Crafty 25.2 Performance / Cost - Elapsed Time EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 140M 280M 420M 560M 700M 582404500.00 301199600.00 106209933.33 174220025.00 87186775.00 53780620.00 162002600.00 89494183.33 510643800.00 252121450.00 520150600.00 504095900.00 483920300.00 262684350.00 493289800.00 167761900.00 102417160.00 66509722.22 656271400.00 71851685.71 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 1 Minute, 49 Seconds: cost approximately 0.01 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 43 Seconds: cost approximately 0.02 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 37 Seconds: cost approximately 0.06 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 29 Seconds: cost approximately 0.04 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 29 Seconds: cost approximately 0.08 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 54 Seconds: cost approximately 0.1 dollar. 7. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 36 Seconds: cost approximately 0.04 dollar. 8. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.06 dollar. 9. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 2 Minutes: cost approximately 0.01 dollar. 10. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 2 Minutes, 2 Seconds: cost approximately 0.02 dollar. 11. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 58 Seconds: cost approximately 0.01 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 1 Second: cost approximately 0.01 dollar. 13. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.01 dollar. 14. Google n1-standard-16: $0.533 reported cost per hour, test consumed 1 Minute, 58 Seconds: cost approximately 0.02 dollar. 15. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 2 Minutes, 5 Seconds: cost approximately 0.01 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 2 Minutes, 2 Seconds: cost approximately 0.03 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 1 Minute, 59 Seconds: cost approximately 0.05 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 1 Minute, 43 Seconds: cost approximately 0.09 dollar. 19. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 35 Seconds: cost approximately 0.01 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 2 Seconds: cost approximately 0.07 dollar.
OpenSSL Performance / Cost - RSA 4096-bit Performance OpenBenchmarking.org Signs Per Second Per Dollar, More Is Better OpenSSL 1.1.0f Performance / Cost - RSA 4096-bit Performance EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 40K 80K 120K 160K 200K 17483.00 186093.00 141728.25 155716.67 155061.17 66044.50 85985.67 60264.25 37640.00 47840.00 109173.00 107887.00 92947.00 62966.67 116524.60 101747.00 72340.00 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.01 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.04 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.03 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.06 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.06 dollar. 7. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.03 dollar. 8. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.04 dollar. 9. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 10. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 11. Google n1-standard-16: $0.533 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.01 dollar. 12. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 13. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 14. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.03 dollar. 15. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.05 dollar. 16. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 17. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.04 dollar.
Timed MAFFT Alignment Performance / Cost - Multiple Sequence Alignment OpenBenchmarking.org Seconds x Dollar, Fewer Is Better Timed MAFFT Alignment 6.864 Performance / Cost - Multiple Sequence Alignment EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure E4s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E32s v3 0.0675 0.135 0.2025 0.27 0.3375 0.03 0.03 0.04 0.27 0.04 0.06 0.12 0.07 0.30 0.07 1. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 14 Seconds: cost approximately 0.01 dollar. 2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 12 Seconds: cost approximately 0.01 dollar. 3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 17 Seconds: cost approximately 0.01 dollar. 4. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 31 Seconds: cost approximately 0.03 dollar. 5. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar. 6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 21 Seconds: cost approximately 0.01 dollar. 7. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 40 Seconds: cost approximately 0.01 dollar. 8. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 24 Seconds: cost approximately 0.01 dollar. 9. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 34 Seconds: cost approximately 0.03 dollar. 10. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 25 Seconds: cost approximately 0.01 dollar.
Scikit-Learn OpenBenchmarking.org Seconds, Fewer Is Better Scikit-Learn 0.17.1 EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 60 120 180 240 300 SE +/- 0.08, N = 3 SE +/- 0.07, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.17, N = 3 SE +/- 0.14, N = 3 SE +/- 9.88, N = 3 SE +/- 0.56, N = 3 SE +/- 1.48, N = 3 SE +/- 0.35, N = 3 SE +/- 1.78, N = 3 SE +/- 0.52, N = 3 SE +/- 0.62, N = 3 SE +/- 0.80, N = 3 SE +/- 0.47, N = 3 SE +/- 0.83, N = 3 SE +/- 0.92, N = 3 SE +/- 2.98, N = 3 SE +/- 1.42, N = 3 SE +/- 0.09, N = 3 SE +/- 2.86, N = 3 SE +/- 0.13, N = 3 179.03 211.86 204.55 190.08 190.52 182.92 214.77 164.09 191.67 196.96 187.80 192.66 260.15 272.74 252.14 264.88 199.18 199.08 171.10 193.88 181.49 222.51
PyBench Total For Average Test Times OpenBenchmarking.org Milliseconds, Fewer Is Better PyBench 2018-02-16 Total For Average Test Times EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 600 1200 1800 2400 3000 SE +/- 0.33, N = 3 SE +/- 3.84, N = 3 SE +/- 4.51, N = 3 SE +/- 3.48, N = 3 SE +/- 3.53, N = 3 SE +/- 2.40, N = 3 SE +/- 14.67, N = 3 SE +/- 8.66, N = 3 SE +/- 4.16, N = 3 SE +/- 0.88, N = 3 SE +/- 11.57, N = 3 SE +/- 12.44, N = 3 SE +/- 4.73, N = 3 SE +/- 1.45, N = 3 SE +/- 4.91, N = 3 SE +/- 2.52, N = 3 SE +/- 5.24, N = 3 SE +/- 6.08, N = 3 SE +/- 7.51, N = 3 SE +/- 1.53, N = 3 SE +/- 2.00, N = 3 2044 1792 1777 1607 1609 2239 1721 1819 2225 2191 2171 2193 2035 2069 2036 2063 2201 2183 1986 1631 2015 2639
PyBench Total For Average Test Times OpenBenchmarking.org Milliseconds, Fewer Is Better PyBench 2008-08-14 Total For Average Test Times EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 500 1000 1500 2000 2500 SE +/- 4.91, N = 3 SE +/- 8.33, N = 3 SE +/- 11.46, N = 3 SE +/- 4.41, N = 3 SE +/- 7.42, N = 3 SE +/- 6.23, N = 3 SE +/- 2.03, N = 3 SE +/- 6.00, N = 3 SE +/- 14.74, N = 3 SE +/- 9.50, N = 3 SE +/- 10.17, N = 3 SE +/- 5.93, N = 3 SE +/- 1.33, N = 3 SE +/- 3.61, N = 3 SE +/- 0.58, N = 3 SE +/- 2.73, N = 3 SE +/- 13.86, N = 3 SE +/- 2.03, N = 3 1837 1637 1604 1459 1453 1992 1559 1643 1987 1965 1959 1954 1846 1875 1858 1876 2007 1949 1783 1473 1843 2382
Crafty Elapsed Time OpenBenchmarking.org Nodes Per Second, More Is Better Crafty 25.2 Elapsed Time EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 1.5M 3M 4.5M 6M 7.5M SE +/- 3484.54, N = 3 SE +/- 7362.69, N = 3 SE +/- 2343.50, N = 3 SE +/- 7226.78, N = 3 SE +/- 7074.19, N = 3 SE +/- 14246.76, N = 3 SE +/- 87880.44, N = 3 SE +/- 24158.72, N = 3 SE +/- 24686.39, N = 3 SE +/- 22944.13, N = 3 SE +/- 35943.27, N = 3 SE +/- 30240.43, N = 3 SE +/- 7660.06, N = 3 SE +/- 18368.33, N = 3 SE +/- 33738.56, N = 3 SE +/- 3776.53, N = 3 SE +/- 22783.95, N = 3 SE +/- 65958.25, N = 3 SE +/- 4663.73, N = 3 SE +/- 27207.60, N = 3 SE +/- 108291.70, N = 3 SE +/- 5979.29, N = 3 5824045 6023992 6372596 6968801 6974942 5378062 5691579 6480104 5369651 5106438 5042429 5201506 5040959 4839203 5253687 4932898 5032857 5120858 5985875 6562714 5029618 4324494 1. (CC) gcc options: -lstdc++ -fprofile-use -pthread -lm
LAME MP3 Encoding WAV To MP3 OpenBenchmarking.org Seconds, Fewer Is Better LAME MP3 Encoding 3.100 WAV To MP3 EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 12 24 36 48 60 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.17, N = 3 SE +/- 1.71, N = 3 SE +/- 0.04, N = 3 SE +/- 0.08, N = 3 SE +/- 0.02, N = 3 SE +/- 0.10, N = 3 SE +/- 0.02, N = 3 SE +/- 0.11, N = 3 SE +/- 0.36, N = 3 SE +/- 0.00, N = 3 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 SE +/- 0.33, N = 3 SE +/- 0.32, N = 3 SE +/- 0.02, N = 3 42.12 43.90 43.57 35.63 35.62 45.22 41.09 37.62 45.51 46.62 46.44 45.77 44.72 45.81 44.85 45.56 47.04 45.88 41.01 40.51 43.77 53.83 1. (CC) gcc options: -lm
AOBench Size: 2048 x 2048 - Total Time OpenBenchmarking.org Seconds, Fewer Is Better AOBench Size: 2048 x 2048 - Total Time EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 20 40 60 80 100 SE +/- 0.04, N = 3 SE +/- 0.16, N = 3 SE +/- 1.07, N = 3 SE +/- 0.38, N = 3 SE +/- 0.12, N = 3 SE +/- 1.04, N = 3 SE +/- 0.50, N = 3 SE +/- 0.11, N = 3 SE +/- 0.20, N = 3 SE +/- 0.22, N = 3 SE +/- 0.52, N = 3 SE +/- 0.09, N = 3 SE +/- 0.11, N = 3 SE +/- 0.12, N = 3 SE +/- 0.03, N = 3 SE +/- 0.10, N = 3 SE +/- 0.22, N = 3 SE +/- 0.07, N = 3 SE +/- 0.36, N = 3 SE +/- 0.52, N = 3 SE +/- 0.57, N = 3 SE +/- 0.42, N = 3 62.18 65.48 66.21 58.70 58.42 64.56 65.51 55.39 67.24 68.85 65.32 67.42 73.65 74.77 72.86 74.22 69.50 67.28 56.84 60.80 63.81 76.44 1. (CC) gcc options: -lm -O3
Timed Linux Kernel Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 4.13 Time To Compile EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 140 280 420 560 700 SE +/- 0.79, N = 3 SE +/- 1.41, N = 3 SE +/- 1.57, N = 3 SE +/- 1.57, N = 3 SE +/- 1.47, N = 3 SE +/- 1.14, N = 3 SE +/- 46.62, N = 3 SE +/- 1.05, N = 3 SE +/- 1.16, N = 3 SE +/- 14.52, N = 3 SE +/- 13.44, N = 3 SE +/- 1.81, N = 3 SE +/- 1.36, N = 3 SE +/- 2.20, N = 3 SE +/- 1.08, N = 3 SE +/- 1.19, N = 3 SE +/- 5.75, N = 3 SE +/- 7.94, N = 3 SE +/- 11.84, N = 3 SE +/- 14.41, N = 3 SE +/- 4.86, N = 3 SE +/- 1.42, N = 3 106.83 85.77 35.61 37.99 24.48 33.90 641.51 43.51 45.91 381.97 386.80 192.60 155.50 164.16 84.17 83.23 119.95 68.61 46.99 160.25 64.62 245.93
Timed MAFFT Alignment Multiple Sequence Alignment OpenBenchmarking.org Seconds, Fewer Is Better Timed MAFFT Alignment 6.864 Multiple Sequence Alignment EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 COrange DFFlexible Engine s1.xlarge 5 10 15 20 25 SE +/- 0.01, N = 3 SE +/- 0.24, N = 3 SE +/- 0.13, N = 3 SE +/- 0.05, N = 3 SE +/- 0.21, N = 3 SE +/- 0.08, N = 3 SE +/- 0.07, N = 3 SE +/- 0.15, N = 3 SE +/- 0.59, N = 3 SE +/- 0.26, N = 3 SE +/- 0.56, N = 3 SE +/- 0.02, N = 3 SE +/- 0.41, N = 3 SE +/- 0.16, N = 3 SE +/- 0.04, N = 3 SE +/- 0.10, N = 3 SE +/- 0.02, N = 3 SE +/- 0.18, N = 3 SE +/- 0.13, N = 3 SE +/- 0.05, N = 3 SE +/- 0.22, N = 3 SE +/- 0.00, N = 3 4.26 4.35 3.18 2.72 4.23 8.84 20.00 4.42 5.78 11.89 11.86 6.61 7.30 7.44 4.96 4.91 5.88 6.94 10.04 6.33 6.80 8.85 1. (CC) gcc options: -O3 -lm -lpthread
Phoronix Test Suite v10.8.4