Google Compute Engine, Amazon EC2, Microsoft Azure Public Compute Cloud Benchmarks Various instance type benchmarks of different setups on Microsoft Azure, Amazon Elastic Compute Cloud, and Google Compute Engine. Benchmarks by Michael Larabel.
HTML result view exported from: https://openbenchmarking.org/result/1803147-FO-1802221FO46&rdt&grs .
Google Compute Engine, Amazon EC2, Microsoft Azure Public Compute Cloud Benchmarks Processor Motherboard Chipset Memory Disk Graphics Network OS Kernel Compiler File-System System Layer Screen Resolution EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 Orange Flexible Engine s1.medium Intel Xeon E5-2676 v3 @ 2.39GHz (8 Cores) Xen HVM domU (4.2.amazon BIOS) Intel 440FX- 82441FX PMC 32768MB 28GB Cirrus Logic GD 5446 Ubuntu 16.04 4.4.0-1050-aws (x86_64) GCC 5.4.0 20160609 ext4 Xen HVM domU 4.2.amazon Intel Xeon Platinum 8175M @ 2.50GHz (8 Cores / 16 Threads) Amazon EC2 m5.4xlarge (1.0 BIOS) 63488MB 30GB Amazon Elastic Block Store Device 1d0f:ec20 KVM Intel Xeon Platinum 8175M @ 2.50GHz (24 Cores / 48 Threads) Amazon EC2 m5.12xlarge (1.0 BIOS) 189440MB Intel Xeon Platinum 8124M @ 3.00GHz (18 Cores / 36 Threads) Amazon EC2 c5.9xlarge (1.0 BIOS) 70656MB 2 x Intel Xeon Platinum 8124M @ 3.00GHz (36 Cores / 72 Threads) Amazon EC2 c5.18xlarge (1.0 BIOS) 141312MB 2 x Intel Xeon E5-2686 v4 @ 3.00GHz (32 Cores / 64 Threads) Xen HVM domU (4.2.amazon BIOS) 258048MB 28GB Cirrus Logic GD 5446 Xen HVM domU 4.2.amazon Intel Xeon Platinum 8175M @ 2.50GHz (1 Core / 2 Threads) Amazon EC2 m5.large (1.0 BIOS) 8192MB 30GB Amazon Elastic Block Store KVM 2 x Intel Xeon E5-2666 v3 @ 3.50GHz (18 Cores / 36 Threads) Xen HVM domU (4.2.amazon BIOS) 60416MB 28GB Cirrus Logic GD 5446 Intel 82599 Virtual Function Xen HVM domU 4.2.amazon 2 x Intel Xeon E5-2676 v3 @ 3.00GHz (20 Cores / 40 Threads) 161792MB Intel Xeon E5-2673 v3 @ 2.39GHz (2 Cores / 4 Threads) Microsoft Virtual Machine v7.0 (090007 BIOS) Intel 440BX/ZX/DX 16384MB 32GB Virtual Disk + 34GB Virtual Disk Microsoft Hyper-V virtual VGA 4.13.0-1009-azure (x86_64) 1152x864 Microsoft Hyper-V Server Intel Xeon E5-2673 v4 @ 2.29GHz (2 Cores / 4 Threads) 32768MB 32GB Virtual Disk + 69GB Virtual Disk Intel Xeon E5-2673 v3 @ 2.39GHz (4 Cores / 8 Threads) Intel Xeon @ 2.30GHz (4 Cores / 8 Threads) Google Compute Engine Intel 440FX- 82441FX PMC 30720MB 32GB PersistentDisk Red Hat Virtio device 4.13.0-1008-gcp (x86_64) KVM 8192MB Intel Xeon @ 2.30GHz (8 Cores / 16 Threads) 60416MB 11GB PersistentDisk 15360MB 32GB PersistentDisk Intel Xeon E5-2673 v3 @ 2.39GHz (8 Cores / 16 Threads) Microsoft Virtual Machine v7.0 (090007 BIOS) Intel 440BX/ZX/DX 64512MB 32GB Virtual Disk + 137GB Virtual Disk Microsoft Hyper-V virtual VGA 4.13.0-1009-azure (x86_64) 1152x864 Microsoft Hyper-V Server 2 x Intel Xeon E5-2673 v3 @ 2.39GHz (16 Cores / 32 Threads) 129024MB 32GB Virtual Disk + 275GB Virtual Disk 2 x Intel Xeon E5-2673 v4 @ 2.29GHz (32 Cores / 64 Threads) 258048MB 32GB Virtual Disk + 550GB Virtual Disk 4.13.0-1011-azure (x86_64) Intel Xeon Platinum 8168 @ 2.69GHz (4 Cores / 8 Threads) 16384MB 32GB Virtual Disk + 69GB Virtual Disk 2 x Intel Xeon E5-2673 v4 @ 2.29GHz (16 Cores / 32 Threads) 258048MB 32GB Virtual Disk + 550GB Virtual Disk Intel Xeon E5-2658 v4 @ 2.29GHz (1 Core) Xen HVM domU (4.1.2_115-908.792. BIOS) Intel 440FX- 82441FX PMC 1 x 4088 MB RAM 39GB Cirrus Logic GD 5446 4.4.0-116-generic (x86_64) Xen HVM domU 4.1.2_115-908.792. OpenBenchmarking.org Compiler Details - --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v Python Details - Python 2.7.12 + Python 3.5.2 Security Details - EC2 t2.2xlarge: KPTI Protection - EC2 m5.4xlarge: KPTI Protection - EC2 m5.12xlarge: KPTI Protection - EC2 c5.9xlarge: KPTI Protection - EC2 c5.18xlarge: KPTI Protection - EC2 m4.16xlarge: KPTI Protection - EC2 m5.large: KPTI Protection - EC2 c4.8xlarge: KPTI Protection - EC2 m4.10xlarge: KPTI Protection - Microsoft Azure D4s v3: KPTI Protection - Microsoft Azure E4s v3: KPTI Protection - Microsoft Azure D8s v3: KPTI Protection - Google n1-standard-8: KPTI Protection - Google n1-highcpu-8: KPTI Protection - Google n1-standard-16: KPTI Protection - Google n1-highcpu-16: KPTI Protection - Microsoft Azure D16s v3: KPTI Protection - Microsoft Azure D32s v3: KPTI Protection - Microsoft Azure D64s v3: KPTI + OSB (observable speculation barrier Intel v6) + Full generic retpoline Protection - Microsoft Azure F8s v2: KPTI + OSB (observable speculation barrier Intel v6) + Full generic retpoline Protection - Microsoft Azure E32s v3: KPTI + OSB (observable speculation barrier Intel v6) + Full generic retpoline Protection - Orange Flexible Engine s1.medium: KPTI + OSB (observable speculation barrier Intel v6) + Full generic retpoline Protection Kernel Details - EC2 m5.4xlarge, EC2 m5.12xlarge, EC2 c5.9xlarge, EC2 c5.18xlarge, EC2 m5.large: nvme.io_timeout=4294967295 Processor Details - EC2 m4.16xlarge, EC2 c4.8xlarge, EC2 m4.10xlarge: Scaling Governor: intel_pstate powersave
Google Compute Engine, Amazon EC2, Microsoft Azure Public Compute Cloud Benchmarks openssl: RSA 4096-bit Performance john-the-ripper: Blowfish rodinia: OpenMP LavaMD java-jmh: Throughput compress-7zip: Compress Speed Test povray: Trace Time npb: EP.C c-ray: Total Time parboil: OpenMP CUTCP nginx: Static Web Page Serving x264: H.264 Video Encoding nero2d: Total Time ttsiod-renderer: Phong Rendering With Soft-Shadow Mapping scikit-learn: pybench: Total For Average Test Times pybench: Total For Average Test Times crafty: Elapsed Time encode-mp3: WAV To MP3 aobench: 2048 x 2048 - Total Time build-linux-kernel: Time To Compile mafft: Multiple Sequence Alignment EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 Orange Flexible Engine s1.medium 174.83 6067 213.70 4217431038.72 23917 563.33 146.20 16.52 11.46 18175.24 38.43 87.04 231.07 179.03 2044 1837 5824045 42.12 62.18 106.83 4.26 1860.93 12094 115.20 24447443003.95 36642 87.10 459.35 29.48 16.11 20160.69 55.46 115.44 184.83 211.86 1792 1637 6023992 43.90 65.48 85.77 4.35 5669.13 37069 39.53 74086333554.07 112699 29.87 1385.49 9.94 5.80 25555.24 129.66 48.78 504.82 204.55 1777 1604 6372596 43.57 66.21 35.61 3.18 4671.50 30593 44.56 60940889045.98 91933 32.35 1256.19 11.00 6.17 29999.02 134.10 60.15 460.27 190.08 1607 1459 6968801 35.63 58.70 37.99 2.72 9303.67 60305 22.77 121829911181.01 160822 17.74 2512.81 5.72 3.75 24619.23 176.03 32.19 336.76 190.52 1609 1453 6974942 35.62 58.42 24.48 4.23 3962.67 39091 34.10 84002323902.87 115598 24.12 1034.94 4.16 3.18 21410.50 115.34 26.13 465.90 182.92 2239 1992 5378062 45.22 64.56 33.90 8.84 242.00 1562 828.97 3178036199.44 5090 617.28 60.99 152.07 98.07 12132.51 11.02 534.08 26.88 214.77 1721 1559 5691579 41.09 65.51 641.51 20.00 2579.57 25341 52.79 56603426109.55 78087 35.08 673.14 6.09 4.39 23090.77 107.99 36.91 419.30 164.09 1819 1643 6480104 37.62 55.39 43.51 4.42 2410.57 23632 56.59 52821381652.06 75762 37.44 627.62 6.46 4.63 21579.29 97.43 41.18 394.52 191.67 2225 1987 5369651 45.51 67.24 45.91 5.78 242.10 2323 550.02 5267511004.58 9144 346.10 64.00 63.05 37.92 14328.83 13.95 391.21 74.64 196.96 2191 1965 5106438 46.62 68.85 381.97 11.89 376.40 2419 529.89 5147334632.54 8708 378.52 64.90 63.95 37.25 15480.88 12.08 351.83 75.14 187.80 2171 1959 5042429 46.44 65.32 386.80 11.86 478.40 4621 279.78 10474890150.44 17015 172.17 125.37 31.97 19.56 15431.68 26.82 177.01 142.43 192.66 2193 1954 5201506 45.77 67.42 192.60 6.61 554.97 5311 245.74 10676070774.18 16136 150.53 233.87 39.77 27.54 25255.90 26.93 193.69 129.81 260.15 2035 1846 5040959 44.72 73.65 155.50 7.30 540.70 5256 246.30 10642422187.43 14996 152.93 235.75 40.08 27.80 21203.08 25.92 198.33 124.66 272.74 2069 1875 4839203 45.81 74.77 164.16 7.44 1091.73 10649 123.24 21381785010.72 30229 75.92 477.95 20.76 14.16 26556.48 52.07 126.67 238.88 252.14 2036 1858 5253687 44.85 72.86 84.17 4.96 1078.87 10501 122.90 21349296898.72 30253 75.87 464.55 20.84 14.16 24005.34 52.41 130.21 234.96 264.88 2063 1876 4932898 45.56 74.22 83.23 4.91 929.47 8016 144.60 20355987704.49 30273 89.86 243.00 16.49 10.35 13495.31 46.48 100.00 249.33 199.18 2201 2007 5032857 47.04 69.50 119.95 5.88 1889.00 13792 72.41 41237574200.22 57028 45.72 487.26 8.16 5.65 13352.91 81.64 57.39 381.19 199.08 2183 1949 5120858 45.88 67.28 68.61 6.94 5826.23 14237 35.20 79724759013.03 97549 25.87 996.94 5.15 3.25 12687.56 82.04 34.06 141.98 171.10 1986 1783 5985875 41.01 56.84 46.99 10.04 1017.47 5912 206.12 13410992384.58 21252 163.10 256.23 53.48 28.33 16486.68 31.44 174.93 106.43 193.88 1631 1473 6562714 40.51 60.80 160.25 6.33 2893.60 13878 69.61 39975500322.53 56544 48.85 495.73 8.46 5.71 12574.34 71.74 52.48 381.87 181.49 2015 1843 5029618 43.77 63.81 64.62 6.80 104.93 694 1827.69 2276017754.87 3049 915.14 151.05 97.12 8634.63 6.18 29.47 219.06 2644 2359 4415980 53.69 74.41 895.79 27.45 OpenBenchmarking.org
POV-Ray Performance / Cost - Trace Time OpenBenchmarking.org Seconds x Dollar, Fewer Is Better POV-Ray 3.7.0.7 Performance / Cost - Trace Time EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 20 40 60 80 100 101.40 5.23 2.09 1.62 1.06 1.93 30.86 1.75 2.62 20.77 60.56 10.33 4.52 4.59 3.04 2.28 5.39 2.74 2.07 8.16 4.89 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 28 Minutes, 22 Seconds: cost approximately 0.18 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 4 Minutes, 34 Seconds: cost approximately 0.06 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 42 Seconds: cost approximately 0.07 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 48 Seconds: cost approximately 0.05 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.06 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 25 Seconds: cost approximately 0.08 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 31 Minutes, 4 Seconds: cost approximately 0.05 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 57 Seconds: cost approximately 0.05 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 5 Seconds: cost approximately 0.07 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 17 Minutes, 31 Seconds: cost approximately 0.06 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 19 Minutes, 9 Seconds: cost approximately 0.16 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 8 Minutes, 50 Seconds: cost approximately 0.06 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 7 Minutes, 44 Seconds: cost approximately 0.03 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 7 Minutes, 51 Seconds: cost approximately 0.03 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 4 Minutes: cost approximately 0.04 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 3 Minutes, 59 Seconds: cost approximately 0.03 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 4 Minutes, 42 Seconds: cost approximately 0.06 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 30 Seconds: cost approximately 0.06 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 1 Minute, 31 Seconds: cost approximately 0.08 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 8 Minutes, 22 Seconds: cost approximately 0.05 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 41 Seconds: cost approximately 0.1 dollar.
Cost To Run Tests Cost / Price Per Hour OpenBenchmarking.org Cost / Price Per Hour, Fewer Is Better Cost To Run Tests Cost / Price Per Hour EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 0.6728 1.3456 2.0184 2.6912 3.364 0.89 2.00 1.28 2.43 2.81 0.34 1.35 1.86 0.47 1.20 0.61 0.41 0.32 0.63 0.48 0.96 1.59 2.99 0.49 2.19 1. EC2 m5.4xlarge: $0.768 reported cost per hour, running tests consumed 1 Hour, 9 Minutes, 15 Seconds: cost approximately 0.89 dollar. 2. EC2 m5.12xlarge: $2.304 reported cost per hour, running tests consumed 52 Minutes, 9 Seconds: cost approximately 2 dollar. 3. EC2 c5.9xlarge: $1.53 reported cost per hour, running tests consumed 50 Minutes, 21 Seconds: cost approximately 1.28 dollar. 4. EC2 c5.18xlarge: $3.06 reported cost per hour, running tests consumed 47 Minutes, 35 Seconds: cost approximately 2.43 dollar. 5. EC2 m4.16xlarge: $3.20 reported cost per hour, running tests consumed 52 Minutes, 42 Seconds: cost approximately 2.81 dollar. 6. EC2 m5.large: $0.096 reported cost per hour, running tests consumed 3 Hours, 30 Minutes, 28 Seconds: cost approximately 0.34 dollar. 7. EC2 c4.8xlarge: $1.591 reported cost per hour, running tests consumed 50 Minutes, 46 Seconds: cost approximately 1.35 dollar. 8. EC2 m4.10xlarge: $2.00 reported cost per hour, running tests consumed 55 Minutes, 55 Seconds: cost approximately 1.86 dollar. 9. Microsoft Azure D4s v3: $0.1920 reported cost per hour, running tests consumed 2 Hours, 27 Minutes, 44 Seconds: cost approximately 0.47 dollar. 10. Microsoft Azure E4s v3: $0.495 reported cost per hour, running tests consumed 2 Hours, 25 Minutes, 51 Seconds: cost approximately 1.2 dollar. 11. Microsoft Azure D8s v3: $0.3840 reported cost per hour, running tests consumed 1 Hour, 35 Minutes, 54 Seconds: cost approximately 0.61 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, running tests consumed 1 Hour, 32 Minutes, 18 Seconds: cost approximately 0.41 dollar. 13. Google n1-highcpu-8: $0.199 reported cost per hour, running tests consumed 1 Hour, 35 Minutes, 11 Seconds: cost approximately 0.32 dollar. 14. Google n1-standard-16: $0.533 reported cost per hour, running tests consumed 1 Hour, 11 Minutes, 1 Second: cost approximately 0.63 dollar. 15. Google n1-highcpu-16: $0.399 reported cost per hour, running tests consumed 1 Hour, 12 Minutes, 24 Seconds: cost approximately 0.48 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, running tests consumed 1 Hour, 15 Minutes, 19 Seconds: cost approximately 0.96 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, running tests consumed 1 Hour, 2 Minutes, 12 Seconds: cost approximately 1.59 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, running tests consumed 58 Minutes, 25 Seconds: cost approximately 2.99 dollar. 19. Microsoft Azure F8s v2: $0.3380 reported cost per hour, running tests consumed 1 Hour, 27 Minutes, 16 Seconds: cost approximately 0.49 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, running tests consumed 1 Hour, 1 Minute, 44 Seconds: cost approximately 2.19 dollar.
OpenSSL RSA 4096-bit Performance OpenBenchmarking.org Signs Per Second, More Is Better OpenSSL 1.1.0f RSA 4096-bit Performance EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 Orange Flexible Engine s1.medium 2K 4K 6K 8K 10K SE +/- 1.37, N = 3 SE +/- 2.33, N = 3 SE +/- 13.34, N = 3 SE +/- 1.27, N = 3 SE +/- 19.65, N = 3 SE +/- 4.00, N = 3 SE +/- 0.95, N = 3 SE +/- 2.55, N = 3 SE +/- 2.05, N = 3 SE +/- 2.80, N = 3 SE +/- 0.35, N = 3 SE +/- 0.31, N = 3 SE +/- 34.32, N = 3 SE +/- 21.05, N = 3 SE +/- 49.53, N = 3 SE +/- 37.17, N = 3 SE +/- 1.62, N = 3 SE +/- 1.96, N = 3 SE +/- 35.20, N = 3 SE +/- 3.69, N = 3 SE +/- 4.11, N = 3 SE +/- 0.03, N = 3 174.83 1860.93 5669.13 4671.50 9303.67 3962.67 242.00 2579.57 2410.57 242.10 376.40 478.40 554.97 540.70 1091.73 1078.87 929.47 1889.00 5826.23 1017.47 2893.60 104.93 1. (CC) gcc options: -O3 -pthread -m64 -lcrypto -ldl
John The Ripper Test: Blowfish OpenBenchmarking.org Real C/S, More Is Better John The Ripper 1.8.0 Test: Blowfish EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 Orange Flexible Engine s1.medium 13K 26K 39K 52K 65K SE +/- 21.00, N = 3 SE +/- 41.59, N = 3 SE +/- 26.19, N = 3 SE +/- 33.25, N = 3 SE +/- 193.12, N = 3 SE +/- 23.86, N = 3 SE +/- 40.45, N = 3 SE +/- 16.00, N = 3 SE +/- 30.95, N = 3 SE +/- 2.89, N = 3 SE +/- 22.84, N = 3 SE +/- 6.51, N = 3 SE +/- 8.50, N = 3 SE +/- 25.67, N = 3 SE +/- 21.36, N = 3 SE +/- 45.99, N = 3 SE +/- 504.49, N = 3 SE +/- 166.51, N = 3 SE +/- 29.67, N = 3 SE +/- 629.45, N = 3 6067 12094 37069 30593 60305 39091 1562 25341 23632 2323 2419 4621 5311 5256 10649 10501 8016 13792 14237 5912 13878 694 1. (CC) gcc options: -fopenmp -lcrypt
Rodinia Performance / Cost - Test: OpenMP LavaMD OpenBenchmarking.org Seconds x Dollar, Fewer Is Better Rodinia 2.4 Performance / Cost - Test: OpenMP LavaMD EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 30 60 90 120 150 14.96 8.06 3.16 2.67 1.37 3.41 58.03 3.70 5.66 49.50 116.58 25.18 14.74 9.85 7.39 4.92 13.01 6.52 3.17 12.37 9.05 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 10 Minutes, 46 Seconds: cost approximately 0.07 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 5 Minutes, 50 Seconds: cost approximately 0.07 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 3 Seconds: cost approximately 0.08 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.06 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 12 Seconds: cost approximately 0.06 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 47 Seconds: cost approximately 0.1 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 41 Minutes, 30 Seconds: cost approximately 0.07 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 2 Minutes, 42 Seconds: cost approximately 0.07 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 54 Seconds: cost approximately 0.1 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 27 Minutes, 34 Seconds: cost approximately 0.09 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 26 Minutes, 34 Seconds: cost approximately 0.22 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 14 Minutes, 4 Seconds: cost approximately 0.09 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 12 Minutes, 21 Seconds: cost approximately 0.06 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 12 Minutes, 23 Seconds: cost approximately 0.04 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 6 Minutes, 14 Seconds: cost approximately 0.06 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 6 Minutes, 12 Seconds: cost approximately 0.04 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 7 Minutes, 18 Seconds: cost approximately 0.09 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 3 Minutes, 41 Seconds: cost approximately 0.09 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 1 Minute, 50 Seconds: cost approximately 0.09 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 10 Minutes, 22 Seconds: cost approximately 0.06 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 3 Minutes, 33 Seconds: cost approximately 0.13 dollar.
Rodinia Test: OpenMP LavaMD OpenBenchmarking.org Seconds, Fewer Is Better Rodinia 2.4 Test: OpenMP LavaMD EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 Orange Flexible Engine s1.medium 400 800 1200 1600 2000 SE +/- 0.03, N = 3 SE +/- 2.22, N = 3 SE +/- 0.81, N = 3 SE +/- 0.33, N = 3 SE +/- 0.16, N = 3 SE +/- 0.05, N = 3 SE +/- 7.59, N = 3 SE +/- 0.11, N = 3 SE +/- 0.02, N = 3 SE +/- 1.53, N = 3 SE +/- 2.20, N = 3 SE +/- 0.06, N = 3 SE +/- 0.90, N = 3 SE +/- 0.54, N = 3 SE +/- 0.19, N = 3 SE +/- 0.47, N = 3 SE +/- 0.32, N = 3 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 SE +/- 1.61, N = 3 SE +/- 0.04, N = 3 SE +/- 3.28, N = 3 213.70 115.20 39.53 44.56 22.77 34.10 828.97 52.79 56.59 550.02 529.89 279.78 245.74 246.30 123.24 122.90 144.60 72.41 35.20 206.12 69.61 1827.69 1. (CXX) g++ options: -O2 -lOpenCL
John The Ripper Performance / Cost - Test: Blowfish OpenBenchmarking.org Real C/S Per Dollar, More Is Better John The Ripper 1.8.0 Performance / Cost - Test: Blowfish EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 110K 220K 330K 440K 550K 303350.00 302350.00 285146.15 339922.22 354735.29 217172.22 156200.00 281566.67 214836.36 232300.00 80633.33 231050.00 531100.00 525600.00 354966.67 525050.00 200400.00 153244.44 79094.44 295600.00 115650.00 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 3 Minutes, 19 Seconds: cost approximately 0.02 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.04 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.13 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.09 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 3 Minutes, 22 Seconds: cost approximately 0.17 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.18 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.01 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.09 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 3 Minutes, 22 Seconds: cost approximately 0.11 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.01 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.03 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.02 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.01 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.01 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.03 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.02 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.04 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 3 Minutes, 23 Seconds: cost approximately 0.09 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 3 Minutes, 27 Seconds: cost approximately 0.18 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.02 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 3 Minutes, 23 Seconds: cost approximately 0.12 dollar.
Java JMH Performance / Cost - Throughput OpenBenchmarking.org Ops/s Per Dollar, More Is Better Java JMH Performance / Cost - Throughput EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 110000M 220000M 330000M 440000M 550000M 105435775968.00 271638255599.44 274393827978.04 338560494699.89 338416419947.25 221058747112.82 317803619944.00 314463478386.39 229658181095.91 263375550229.00 85788910542.33 261872253761.00 355869025806.00 532121109371.50 356363083512.00 426985937974.40 226177641161.00 229097634445.67 181192634120.52 335274809614.50 159902001290.12 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 7 Minutes, 14 Seconds: cost approximately 0.04 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 6 Minutes, 53 Seconds: cost approximately 0.09 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 6 Minutes, 57 Seconds: cost approximately 0.27 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 6 Minutes, 55 Seconds: cost approximately 0.18 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 7 Minutes, 1 Second: cost approximately 0.36 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 7 Minutes, 4 Seconds: cost approximately 0.38 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 6 Minutes, 47 Seconds: cost approximately 0.01 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 6 Minutes, 58 Seconds: cost approximately 0.18 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 6 Minutes, 59 Seconds: cost approximately 0.23 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 6 Minutes, 49 Seconds: cost approximately 0.02 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 6 Minutes, 49 Seconds: cost approximately 0.06 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 6 Minutes, 49 Seconds: cost approximately 0.04 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 6 Minutes, 48 Seconds: cost approximately 0.03 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 6 Minutes, 49 Seconds: cost approximately 0.02 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 6 Minutes, 48 Seconds: cost approximately 0.06 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 6 Minutes, 49 Seconds: cost approximately 0.05 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 6 Minutes, 52 Seconds: cost approximately 0.09 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 7 Minutes, 3 Seconds: cost approximately 0.18 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 8 Minutes, 35 Seconds: cost approximately 0.44 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 6 Minutes, 48 Seconds: cost approximately 0.04 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 7 Minutes, 4 Seconds: cost approximately 0.25 dollar.
Java JMH Throughput OpenBenchmarking.org Ops/s, More Is Better Java JMH Throughput EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 Orange Flexible Engine s1.medium 30000M 60000M 90000M 120000M 150000M 4217431038.72 24447443003.95 74086333554.07 60940889045.98 121829911181.01 84002323902.87 3178036199.44 56603426109.55 52821381652.06 5267511004.58 5147334632.54 10474890150.44 10676070774.18 10642422187.43 21381785010.72 21349296898.72 20355987704.49 41237574200.22 79724759013.03 13410992384.58 39975500322.53 2276017754.87
7-Zip Compression Compress Speed Test OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 9.20.1 Compress Speed Test EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 Orange Flexible Engine s1.medium 30K 60K 90K 120K 150K SE +/- 86.00, N = 3 SE +/- 282.94, N = 3 SE +/- 480.06, N = 3 SE +/- 226.61, N = 3 SE +/- 319.70, N = 3 SE +/- 482.44, N = 3 SE +/- 28.62, N = 3 SE +/- 380.57, N = 3 SE +/- 280.19, N = 3 SE +/- 90.16, N = 3 SE +/- 16.02, N = 3 SE +/- 88.33, N = 3 SE +/- 75.03, N = 3 SE +/- 16.90, N = 3 SE +/- 130.52, N = 3 SE +/- 132.53, N = 3 SE +/- 231.20, N = 3 SE +/- 268.12, N = 3 SE +/- 416.92, N = 3 SE +/- 244.04, N = 3 SE +/- 60.61, N = 3 SE +/- 34.56, N = 3 23917 36642 112699 91933 160822 115598 5090 78087 75762 9144 8708 17015 16136 14996 30229 30253 30273 57028 97549 21252 56544 3049 1. (CXX) g++ options: -pipe -lpthread
POV-Ray Trace Time OpenBenchmarking.org Seconds, Fewer Is Better POV-Ray 3.7.0.7 Trace Time EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 Orange Flexible Engine s1.medium 200 400 600 800 1000 SE +/- 29.42, N = 3 SE +/- 0.14, N = 3 SE +/- 0.03, N = 3 SE +/- 0.18, N = 3 SE +/- 0.13, N = 3 SE +/- 0.07, N = 3 SE +/- 40.66, N = 3 SE +/- 0.14, N = 3 SE +/- 0.02, N = 3 SE +/- 0.27, N = 3 SE +/- 0.16, N = 3 SE +/- 0.04, N = 3 SE +/- 0.31, N = 3 SE +/- 0.04, N = 3 SE +/- 0.28, N = 3 SE +/- 0.10, N = 3 SE +/- 0.27, N = 3 SE +/- 0.04, N = 3 SE +/- 0.16, N = 3 SE +/- 0.17, N = 3 SE +/- 0.18, N = 3 SE +/- 1.92, N = 3 563.33 87.10 29.87 32.35 17.74 24.12 617.28 35.08 37.44 346.10 378.52 172.17 150.53 152.93 75.92 75.87 89.86 45.72 25.87 163.10 48.85 915.14 1. (CXX) g++ options: -pipe -O3 -ffast-math -march=native -pthread -lSDL -lSM -lICE -lX11 -ltiff -ljpeg -lpng -lz -lrt -lm -lboost_thread -lboost_system
NGINX Benchmark Performance / Cost - Static Web Page Serving OpenBenchmarking.org Requests Per Second Per Dollar, More Is Better NGINX Benchmark 1.9.9 Performance / Cost - Static Web Page Serving EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 300K 600K 900K 1200K 1500K 454381.00 288009.86 159720.25 333322.44 111905.59 79298.15 1213251.00 192423.08 126937.00 716441.50 258014.67 385792.00 1262795.00 1060154.00 663912.00 800178.00 134953.10 74182.83 30208.48 412167.00 43359.79 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 5 Minutes, 50 Seconds: cost approximately 0.04 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 5 Minutes, 16 Seconds: cost approximately 0.07 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 4 Minutes, 12 Seconds: cost approximately 0.16 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 3 Minutes, 37 Seconds: cost approximately 0.09 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 4 Minutes, 22 Seconds: cost approximately 0.22 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 5 Minutes: cost approximately 0.27 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 8 Minutes, 35 Seconds: cost approximately 0.01 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 4 Minutes, 37 Seconds: cost approximately 0.12 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 4 Minutes, 57 Seconds: cost approximately 0.17 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 7 Minutes, 18 Seconds: cost approximately 0.02 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 6 Minutes, 47 Seconds: cost approximately 0.06 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 6 Minutes, 47 Seconds: cost approximately 0.04 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 4 Minutes, 17 Seconds: cost approximately 0.02 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 5 Minutes, 3 Seconds: cost approximately 0.02 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 4 Minutes, 5 Seconds: cost approximately 0.04 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 4 Minutes, 29 Seconds: cost approximately 0.03 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 7 Minutes, 44 Seconds: cost approximately 0.1 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 7 Minutes, 5 Seconds: cost approximately 0.18 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 8 Minutes, 12 Seconds: cost approximately 0.42 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 6 Minutes, 22 Seconds: cost approximately 0.04 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 8 Minutes, 17 Seconds: cost approximately 0.29 dollar.
NAS Parallel Benchmarks Test / Class: EP.C OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.3 Test / Class: EP.C EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 500 1000 1500 2000 2500 SE +/- 0.08, N = 3 SE +/- 1.09, N = 3 SE +/- 1.50, N = 3 SE +/- 19.93, N = 3 SE +/- 29.39, N = 3 SE +/- 1.06, N = 3 SE +/- 3.02, N = 3 SE +/- 3.43, N = 3 SE +/- 0.96, N = 3 SE +/- 0.23, N = 3 SE +/- 0.06, N = 3 SE +/- 0.54, N = 3 SE +/- 1.37, N = 3 SE +/- 2.09, N = 3 SE +/- 3.92, N = 3 SE +/- 17.11, N = 3 SE +/- 1.01, N = 3 SE +/- 0.74, N = 3 SE +/- 1.86, N = 3 SE +/- 1.49, N = 3 SE +/- 0.98, N = 3 146.20 459.35 1385.49 1256.19 2512.81 1034.94 60.99 673.14 627.62 64.00 64.90 125.37 233.87 235.75 477.95 464.55 243.00 487.26 996.94 256.23 495.73 1. (F9X) gfortran options: -O3 -march=native -pthread -lmpi_usempif08 -lmpi_mpifh -lmpi 2. Open MPI 1.10.2
7-Zip Compression Performance / Cost - Compress Speed Test OpenBenchmarking.org MIPS Per Dollar, More Is Better 7-Zip Compression 9.20.1 Performance / Cost - Compress Speed Test EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 600K 1200K 1800K 2400K 3000K 2391700.00 1832100.00 1609985.71 2298325.00 1462018.18 770653.33 1561740.00 1082314.29 914400.00 870800.00 1701500.00 1613600.00 1499600.00 1511450.00 3025300.00 1513650.00 950466.67 750376.92 2125200.00 706800.00 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 1 Minute, 14 Seconds: cost approximately 0.01 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 38 Seconds: cost approximately 0.02 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.07 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 39 Seconds: cost approximately 0.04 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 2 Minutes, 6 Seconds: cost approximately 0.11 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 45 Seconds: cost approximately 0.15 dollar. 7. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 51 Seconds: cost approximately 0.05 dollar. 8. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 14 Seconds: cost approximately 0.07 dollar. 9. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 1 Minute, 36 Seconds: cost approximately 0.01 dollar. 10. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 1 Minute, 39 Seconds: cost approximately 0.01 dollar. 11. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 42 Seconds: cost approximately 0.01 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 1 Minute, 46 Seconds: cost approximately 0.01 dollar. 13. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 1 Minute, 52 Seconds: cost approximately 0.01 dollar. 14. Google n1-standard-16: $0.533 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.02 dollar. 15. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.01 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.02 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 11 Seconds: cost approximately 0.06 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 37 Seconds: cost approximately 0.13 dollar. 19. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 24 Seconds: cost approximately 0.01 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 12 Seconds: cost approximately 0.08 dollar.
C-Ray Total Time OpenBenchmarking.org Seconds, Fewer Is Better C-Ray 1.1 Total Time EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 Orange Flexible Engine s1.medium 30 60 90 120 150 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 5.71, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.14, N = 3 SE +/- 0.11, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.42, N = 3 SE +/- 0.23, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 16.52 29.48 9.94 11.00 5.72 4.16 152.07 6.09 6.46 63.05 63.95 31.97 39.77 40.08 20.76 20.84 16.49 8.16 5.15 53.48 8.46 151.05 1. (CC) gcc options: -lm -lpthread -O3
Parboil Performance / Cost - Test: OpenMP CUTCP OpenBenchmarking.org Seconds x Dollar, Fewer Is Better Parboil 2.5 Performance / Cost - Test: OpenMP CUTCP EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 0.2205 0.441 0.6615 0.882 1.1025 0.16 0.06 0.06 0.04 0.03 0.98 0.04 0.05 0.38 0.75 0.20 0.28 0.14 0.14 0.10 0.06 0.07 0.28 0.06 1. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 53 Seconds: cost approximately 0.01 dollar. 2. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 21 Seconds: cost approximately 0.01 dollar. 3. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 22 Seconds: cost approximately 0.01 dollar. 4. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 16 Seconds: cost approximately 0.01 dollar. 5. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 14 Seconds: cost approximately 0.01 dollar. 6. EC2 m5.large: $0.096 reported cost per hour, test consumed 4 Minutes, 58 Seconds: cost approximately 0.01 dollar. 7. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar. 8. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar. 9. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 1 Minute, 58 Seconds: cost approximately 0.01 dollar. 10. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.02 dollar. 11. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 3 Seconds: cost approximately 0.01 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 1 Minute, 27 Seconds: cost approximately 0.01 dollar. 13. Google n1-standard-16: $0.533 reported cost per hour, test consumed 47 Seconds: cost approximately 0.01 dollar. 14. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 47 Seconds: cost approximately 0.01 dollar. 15. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 35 Seconds: cost approximately 0.01 dollar. 16. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 23 Seconds: cost approximately 0.01 dollar. 17. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 20 Seconds: cost approximately 0.02 dollar. 18. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 29 Seconds: cost approximately 0.01 dollar. 19. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 21 Seconds: cost approximately 0.01 dollar.
C-Ray Performance / Cost - Total Time OpenBenchmarking.org Seconds x Dollar, Fewer Is Better C-Ray 1.1 Performance / Cost - Total Time EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 0.432 0.864 1.296 1.728 2.16 0.17 0.59 0.20 0.22 0.11 0.08 1.52 0.06 0.06 0.63 1.92 0.32 0.40 0.40 0.21 0.21 0.16 0.08 0.10 1.07 0.17 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 54 Seconds: cost approximately 0.01 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 33 Seconds: cost approximately 0.02 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 34 Seconds: cost approximately 0.02 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 38 Seconds: cost approximately 0.02 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 21 Seconds: cost approximately 0.02 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 17 Seconds: cost approximately 0.02 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 7 Minutes, 40 Seconds: cost approximately 0.01 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 23 Seconds: cost approximately 0.01 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 23 Seconds: cost approximately 0.01 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 3 Minutes, 14 Seconds: cost approximately 0.01 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 3 Minutes, 16 Seconds: cost approximately 0.03 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 40 Seconds: cost approximately 0.01 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 3 Seconds: cost approximately 0.01 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 5 Seconds: cost approximately 0.01 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 1 Minute, 7 Seconds: cost approximately 0.01 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 1 Minute, 7 Seconds: cost approximately 0.01 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 54 Seconds: cost approximately 0.01 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 29 Seconds: cost approximately 0.01 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 20 Seconds: cost approximately 0.02 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 2 Minutes, 45 Seconds: cost approximately 0.02 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 30 Seconds: cost approximately 0.02 dollar.
Timed Linux Kernel Compilation Performance / Cost - Time To Compile OpenBenchmarking.org Seconds x Dollar, Fewer Is Better Timed Linux Kernel Compilation 4.13 Performance / Cost - Time To Compile EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 14 28 42 56 70 4.27 5.15 2.85 2.28 1.96 3.73 32.08 3.05 4.13 22.92 61.89 11.56 6.22 4.92 3.37 2.50 9.60 6.86 6.58 8.01 8.40 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 5 Minutes, 41 Seconds: cost approximately 0.04 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 4 Minutes, 41 Seconds: cost approximately 0.06 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 9 Seconds: cost approximately 0.08 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 2 Minutes, 13 Seconds: cost approximately 0.06 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 36 Seconds: cost approximately 0.08 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 8 Seconds: cost approximately 0.11 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 32 Minutes, 29 Seconds: cost approximately 0.05 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 2 Minutes, 35 Seconds: cost approximately 0.07 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 43 Seconds: cost approximately 0.09 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 19 Minutes, 32 Seconds: cost approximately 0.06 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 19 Minutes, 46 Seconds: cost approximately 0.16 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 10 Minutes, 4 Seconds: cost approximately 0.06 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 8 Minutes, 10 Seconds: cost approximately 0.04 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 8 Minutes, 37 Seconds: cost approximately 0.03 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 4 Minutes, 42 Seconds: cost approximately 0.04 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 4 Minutes, 33 Seconds: cost approximately 0.03 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 6 Minutes, 27 Seconds: cost approximately 0.08 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 3 Minutes, 52 Seconds: cost approximately 0.1 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 47 Seconds: cost approximately 0.14 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 8 Minutes, 24 Seconds: cost approximately 0.05 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 3 Minutes, 40 Seconds: cost approximately 0.13 dollar.
Parboil Test: OpenMP CUTCP OpenBenchmarking.org Seconds, Fewer Is Better Parboil 2.5 Test: OpenMP CUTCP EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 Orange Flexible Engine s1.medium 20 40 60 80 100 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.06, N = 3 SE +/- 0.46, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.16, N = 3 SE +/- 0.09, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.09, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.11, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 11.46 16.11 5.80 6.17 3.75 3.18 98.07 4.39 4.63 37.92 37.25 19.56 27.54 27.80 14.16 14.16 10.35 5.65 3.25 28.33 5.71 97.12 1. (CXX) g++ options: -lm -lpthread -lgomp -ffast-math -fopenmp
NGINX Benchmark Static Web Page Serving OpenBenchmarking.org Requests Per Second, More Is Better NGINX Benchmark 1.9.9 Static Web Page Serving EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 Orange Flexible Engine s1.medium 6K 12K 18K 24K 30K SE +/- 798.70, N = 3 SE +/- 92.03, N = 3 SE +/- 146.75, N = 3 SE +/- 54.82, N = 3 SE +/- 78.50, N = 3 SE +/- 279.06, N = 3 SE +/- 188.83, N = 3 SE +/- 451.84, N = 3 SE +/- 101.19, N = 3 SE +/- 1.63, N = 3 SE +/- 142.39, N = 3 SE +/- 25.54, N = 3 SE +/- 98.84, N = 3 SE +/- 341.39, N = 3 SE +/- 73.63, N = 3 SE +/- 91.80, N = 3 SE +/- 117.02, N = 3 SE +/- 619.74, N = 2 SE +/- 226.15, N = 3 SE +/- 150.79, N = 3 SE +/- 297.47, N = 3 SE +/- 41.91, N = 3 18175.24 20160.69 25555.24 29999.02 24619.23 21410.50 12132.51 23090.77 21579.29 14328.83 15480.88 15431.68 25255.90 21203.08 26556.48 24005.34 13495.31 13352.91 12687.56 16486.68 12574.34 8634.63 1. (CC) gcc options: -lpthread -lcrypt -lcrypto -lz -O3 -march=native
x264 Performance / Cost - H.264 Video Encoding OpenBenchmarking.org Frames Per Second Per Dollar, More Is Better x264 2018-02-05 Performance / Cost - H.264 Video Encoding EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 4K 8K 12K 16K 20K 3843.00 5546.00 12966.00 13410.00 17603.00 5767.00 10799.00 9743.00 1395.00 604.00 2682.00 2693.00 5207.00 4648.00 8164.00 4102.00 3144.00 3587.00 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 51 Seconds: cost approximately 0.01 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 37 Seconds: cost approximately 0.01 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 15 Seconds: cost approximately 0.01 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 20 Seconds: cost approximately 0.02 dollar. 7. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 21 Seconds: cost approximately 0.01 dollar. 8. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 23 Seconds: cost approximately 0.01 dollar. 9. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 2 Minutes, 13 Seconds: cost approximately 0.01 dollar. 10. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 2 Minutes, 33 Seconds: cost approximately 0.02 dollar. 11. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 11 Seconds: cost approximately 0.01 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 1 Minute, 11 Seconds: cost approximately 0.01 dollar. 13. Google n1-standard-16: $0.533 reported cost per hour, test consumed 39 Seconds: cost approximately 0.01 dollar. 14. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 43 Seconds: cost approximately 0.01 dollar. 15. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 26 Seconds: cost approximately 0.01 dollar. 16. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 27 Seconds: cost approximately 0.02 dollar. 17. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 1 Second: cost approximately 0.01 dollar. 18. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 29 Seconds: cost approximately 0.02 dollar.
Open FMM Nero2D Performance / Cost - Total Time OpenBenchmarking.org Seconds x Dollar, Fewer Is Better Open FMM Nero2D 2.0.2 Performance / Cost - Total Time EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 12 24 36 48 60 2.61 8.08 4.88 4.81 2.90 1.83 21.36 1.85 2.88 23.47 52.77 10.62 7.75 5.95 7.60 5.21 6.00 4.59 3.07 8.75 5.25 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 4 Minutes, 26 Seconds: cost approximately 0.03 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 5 Minutes, 51 Seconds: cost approximately 0.07 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 30 Seconds: cost approximately 0.1 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 3 Minutes, 5 Seconds: cost approximately 0.08 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 40 Seconds: cost approximately 0.09 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 23 Seconds: cost approximately 0.07 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 26 Minutes, 47 Seconds: cost approximately 0.04 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.05 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.07 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 19 Minutes, 38 Seconds: cost approximately 0.06 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 17 Minutes, 39 Seconds: cost approximately 0.15 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 8 Minutes, 55 Seconds: cost approximately 0.06 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 9 Minutes, 45 Seconds: cost approximately 0.04 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 9 Minutes, 59 Seconds: cost approximately 0.03 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 6 Minutes, 24 Seconds: cost approximately 0.06 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 6 Minutes, 35 Seconds: cost approximately 0.04 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 5 Minutes, 4 Seconds: cost approximately 0.06 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 56 Seconds: cost approximately 0.08 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 1 Minute, 46 Seconds: cost approximately 0.09 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 8 Minutes, 49 Seconds: cost approximately 0.05 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 42 Seconds: cost approximately 0.1 dollar.
x264 H.264 Video Encoding OpenBenchmarking.org Frames Per Second, More Is Better x264 2018-02-05 H.264 Video Encoding EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 Orange Flexible Engine s1.medium 40 80 120 160 200 SE +/- 0.03, N = 3 SE +/- 0.55, N = 3 SE +/- 0.28, N = 3 SE +/- 0.49, N = 3 SE +/- 1.46, N = 3 SE +/- 1.25, N = 3 SE +/- 0.02, N = 3 SE +/- 0.30, N = 3 SE +/- 0.19, N = 3 SE +/- 0.06, N = 3 SE +/- 0.01, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.14, N = 3 SE +/- 0.24, N = 3 SE +/- 0.12, N = 3 SE +/- 0.18, N = 3 SE +/- 0.27, N = 3 SE +/- 0.61, N = 3 SE +/- 0.27, N = 3 SE +/- 0.23, N = 3 SE +/- 0.11, N = 4 38.43 55.46 129.66 134.10 176.03 115.34 11.02 107.99 97.43 13.95 12.08 26.82 26.93 25.92 52.07 52.41 46.48 81.64 82.04 31.44 71.74 6.18 1. (CC) gcc options: -ldl -m64 -lm -lpthread -O3 -ffast-math -std=gnu99 -fPIC -fomit-frame-pointer -fno-tree-vectorize
NAS Parallel Benchmarks Performance / Cost - Test / Class: EP.C OpenBenchmarking.org Total Mop/s Per Dollar, More Is Better NAS Parallel Benchmarks 3.3 Performance / Cost - Test / Class: EP.C EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 50K 100K 150K 200K 250K 7310.00 45935.00 69274.50 125619.00 251281.00 34498.00 6099.00 33657.00 20920.67 3200.00 1081.67 6268.50 23387.00 23575.00 47795.00 46455.00 12150.00 24363.00 24923.50 25623.00 16524.33 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 3 Minutes, 1 Second: cost approximately 0.02 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute: cost approximately 0.01 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 24 Seconds: cost approximately 0.02 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 26 Seconds: cost approximately 0.01 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 16 Seconds: cost approximately 0.01 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 30 Seconds: cost approximately 0.03 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 7 Minutes, 9 Seconds: cost approximately 0.01 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 43 Seconds: cost approximately 0.02 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 47 Seconds: cost approximately 0.03 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 6 Minutes, 47 Seconds: cost approximately 0.02 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 6 Minutes, 41 Seconds: cost approximately 0.06 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 3 Minutes, 30 Seconds: cost approximately 0.02 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.01 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 1 Minute, 54 Seconds: cost approximately 0.01 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 58 Seconds: cost approximately 0.01 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 1 Minute: cost approximately 0.01 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 1 Minute, 50 Seconds: cost approximately 0.02 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 58 Seconds: cost approximately 0.02 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 52 Seconds: cost approximately 0.04 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 45 Seconds: cost approximately 0.01 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 57 Seconds: cost approximately 0.03 dollar.
Scikit-Learn Performance / Cost - OpenBenchmarking.org Seconds x Dollar, Fewer Is Better Scikit-Learn 0.17.1 Performance / Cost - EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 20 40 60 80 100 10.74 29.66 79.77 45.62 93.35 89.63 4.30 36.10 61.33 5.91 15.02 11.56 15.61 13.64 27.74 23.84 25.89 51.76 75.28 9.69 58.08 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 9 Minutes, 2 Seconds: cost approximately 0.06 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 10 Minutes, 40 Seconds: cost approximately 0.14 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 10 Minutes, 17 Seconds: cost approximately 0.39 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 9 Minutes, 35 Seconds: cost approximately 0.24 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 9 Minutes, 36 Seconds: cost approximately 0.49 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 9 Minutes, 13 Seconds: cost approximately 0.49 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 10 Minutes, 49 Seconds: cost approximately 0.02 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 8 Minutes, 17 Seconds: cost approximately 0.22 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 9 Minutes, 39 Seconds: cost approximately 0.32 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 9 Minutes, 55 Seconds: cost approximately 0.03 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 9 Minutes, 27 Seconds: cost approximately 0.08 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 9 Minutes, 42 Seconds: cost approximately 0.06 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 13 Minutes, 4 Seconds: cost approximately 0.06 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 13 Minutes, 43 Seconds: cost approximately 0.05 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 12 Minutes, 40 Seconds: cost approximately 0.11 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 13 Minutes, 19 Seconds: cost approximately 0.09 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 10 Minutes, 2 Seconds: cost approximately 0.13 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 10 Minutes, 1 Second: cost approximately 0.26 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 8 Minutes, 37 Seconds: cost approximately 0.44 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 9 Minutes, 45 Seconds: cost approximately 0.05 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 9 Minutes, 8 Seconds: cost approximately 0.32 dollar.
Open FMM Nero2D Total Time OpenBenchmarking.org Seconds, Fewer Is Better Open FMM Nero2D 2.0.2 Total Time EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 120 240 360 480 600 SE +/- 0.42, N = 3 SE +/- 5.00, N = 3 SE +/- 7.90, N = 3 SE +/- 0.96, N = 3 SE +/- 4.84, N = 3 SE +/- 0.13, N = 3 SE +/- 8.89, N = 3 SE +/- 0.13, N = 3 SE +/- 0.80, N = 3 SE +/- 0.35, N = 3 SE +/- 0.74, N = 3 SE +/- 0.89, N = 3 SE +/- 0.90, N = 3 SE +/- 0.57, N = 3 SE +/- 1.34, N = 3 SE +/- 6.47, N = 3 SE +/- 0.02, N = 3 SE +/- 0.13, N = 3 SE +/- 0.33, N = 3 SE +/- 1.35, N = 3 SE +/- 0.33, N = 3 87.04 115.44 48.78 60.15 32.19 26.13 534.08 36.91 41.18 391.21 351.83 177.01 193.69 198.33 126.67 130.21 100.00 57.39 34.06 174.93 52.48 1. (CXX) g++ options: -O2 -lfftw3 -llapack -lblas -lgfortran -lquadmath -lm -pthread -lmpi_cxx -lmpi
PyBench Performance / Cost - Total For Average Test Times OpenBenchmarking.org Milliseconds x Dollar, Fewer Is Better PyBench 2018-02-16 Performance / Cost - Total For Average Test Times EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 70 140 210 280 350 20.44 53.76 142.16 80.35 160.90 313.46 109.14 200.25 21.91 43.42 43.86 20.35 20.69 40.72 41.26 66.03 152.81 238.32 16.31 181.35 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 2 Minutes, 24 Seconds: cost approximately 0.01 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.03 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 5 Seconds: cost approximately 0.08 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 53 Seconds: cost approximately 0.05 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 53 Seconds: cost approximately 0.1 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 36 Seconds: cost approximately 0.14 dollar. 7. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.06 dollar. 8. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 35 Seconds: cost approximately 0.09 dollar. 9. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 2 Minutes, 38 Seconds: cost approximately 0.01 dollar. 10. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 2 Minutes, 40 Seconds: cost approximately 0.02 dollar. 11. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 2 Minutes, 37 Seconds: cost approximately 0.02 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 23 Seconds: cost approximately 0.01 dollar. 13. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 29 Seconds: cost approximately 0.01 dollar. 14. Google n1-standard-16: $0.533 reported cost per hour, test consumed 2 Minutes, 22 Seconds: cost approximately 0.02 dollar. 15. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 2 Minutes, 25 Seconds: cost approximately 0.02 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 2 Minutes, 37 Seconds: cost approximately 0.03 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 36 Seconds: cost approximately 0.07 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 21 Seconds: cost approximately 0.12 dollar. 19. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.01 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 28 Seconds: cost approximately 0.09 dollar.
TTSIOD 3D Renderer Phong Rendering With Soft-Shadow Mapping OpenBenchmarking.org FPS, More Is Better TTSIOD 3D Renderer 2.3a Phong Rendering With Soft-Shadow Mapping EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 Orange Flexible Engine s1.medium 110 220 330 440 550 SE +/- 0.39, N = 3 SE +/- 0.49, N = 3 SE +/- 4.78, N = 3 SE +/- 4.23, N = 3 SE +/- 12.51, N = 3 SE +/- 20.68, N = 3 SE +/- 2.30, N = 3 SE +/- 3.14, N = 3 SE +/- 3.29, N = 3 SE +/- 0.19, N = 3 SE +/- 0.10, N = 3 SE +/- 0.38, N = 3 SE +/- 0.50, N = 3 SE +/- 0.39, N = 3 SE +/- 1.87, N = 3 SE +/- 2.14, N = 3 SE +/- 1.45, N = 3 SE +/- 5.69, N = 3 SE +/- 1.98, N = 3 SE +/- 0.20, N = 3 SE +/- 4.11, N = 3 SE +/- 0.04, N = 3 231.07 184.83 504.82 460.27 336.76 465.90 26.88 419.30 394.52 74.64 75.14 142.43 129.81 124.66 238.88 234.96 249.33 381.19 141.98 106.43 381.87 29.47 1. (CXX) g++ options: -O3 -fomit-frame-pointer -ffast-math -mtune=native -flto -msse -mrecip -mfpmath=sse -msse2 -mssse3 -lSDL -lstdc++
TTSIOD 3D Renderer Performance / Cost - Phong Rendering With Soft-Shadow Mapping OpenBenchmarking.org FPS Per Dollar, More Is Better TTSIOD 3D Renderer 2.3a Performance / Cost - Phong Rendering With Soft-Shadow Mapping EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 5K 10K 15K 20K 25K 23107.00 9241.50 16827.33 23013.50 5612.67 9318.00 1344.00 13976.67 13150.67 7464.00 2504.67 14243.00 12981.00 12466.00 23888.00 23496.00 12466.50 12706.33 1290.73 5321.50 9546.75 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 1 Minute, 26 Seconds: cost approximately 0.01 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 42 Seconds: cost approximately 0.02 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 50 Seconds: cost approximately 0.03 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 53 Seconds: cost approximately 0.02 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 10 Seconds: cost approximately 0.06 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 54 Seconds: cost approximately 0.05 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 9 Minutes, 47 Seconds: cost approximately 0.02 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 58 Seconds: cost approximately 0.03 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 1 Minute: cost approximately 0.03 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 3 Minutes, 41 Seconds: cost approximately 0.01 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 3 Minutes, 40 Seconds: cost approximately 0.03 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 2 Minutes, 6 Seconds: cost approximately 0.01 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 17 Seconds: cost approximately 0.01 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 22 Seconds: cost approximately 0.01 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 1 Minute, 24 Seconds: cost approximately 0.01 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 1 Minute, 25 Seconds: cost approximately 0.01 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 1 Minute, 21 Seconds: cost approximately 0.02 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 1 Minute, 1 Second: cost approximately 0.03 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 13 Seconds: cost approximately 0.11 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 2 Minutes, 42 Seconds: cost approximately 0.02 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 1 Minute: cost approximately 0.04 dollar.
AOBench Performance / Cost - Size: 2048 x 2048 - Total Time OpenBenchmarking.org Seconds x Dollar, Fewer Is Better AOBench Performance / Cost - Size: 2048 x 2048 - Total Time EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 3 6 9 12 15 1.24 2.62 8.61 4.70 8.76 11.62 0.66 4.43 7.40 0.69 1.96 1.35 1.47 0.75 2.19 2.23 3.48 6.06 8.53 1.22 7.66 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 3 Minutes, 11 Seconds: cost approximately 0.02 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.04 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 3 Minutes, 22 Seconds: cost approximately 0.13 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 3 Minutes: cost approximately 0.08 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 2 Minutes, 59 Seconds: cost approximately 0.15 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 3 Minutes, 18 Seconds: cost approximately 0.18 dollar. 7. EC2 m5.large: $0.096 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.01 dollar. 8. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 2 Minutes, 50 Seconds: cost approximately 0.08 dollar. 9. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 3 Minutes, 26 Seconds: cost approximately 0.11 dollar. 10. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 3 Minutes, 31 Seconds: cost approximately 0.01 dollar. 11. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.03 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 3 Minutes, 26 Seconds: cost approximately 0.02 dollar. 13. Google n1-standard-8: $0.268 reported cost per hour, test consumed 3 Minutes, 45 Seconds: cost approximately 0.02 dollar. 14. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 3 Minutes, 48 Seconds: cost approximately 0.01 dollar. 15. Google n1-standard-16: $0.533 reported cost per hour, test consumed 3 Minutes, 43 Seconds: cost approximately 0.03 dollar. 16. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 3 Minutes, 47 Seconds: cost approximately 0.03 dollar. 17. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 3 Minutes, 32 Seconds: cost approximately 0.05 dollar. 18. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 3 Minutes, 26 Seconds: cost approximately 0.09 dollar. 19. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 54 Seconds: cost approximately 0.15 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 3 Minutes, 6 Seconds: cost approximately 0.02 dollar. 21. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 3 Minutes, 16 Seconds: cost approximately 0.12 dollar.
PyBench Performance / Cost - Total For Average Test Times OpenBenchmarking.org Milliseconds x Dollar, Fewer Is Better PyBench 2008-08-14 Performance / Cost - Total For Average Test Times EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 50 100 150 200 250 18.37 32.74 112.28 58.36 130.77 239.04 82.15 158.96 19.65 39.18 19.54 18.46 18.75 37.16 18.76 60.21 116.94 196.13 14.73 147.44 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 2 Minutes, 8 Seconds: cost approximately 0.01 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.02 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 52 Seconds: cost approximately 0.07 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 42 Seconds: cost approximately 0.04 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 41 Seconds: cost approximately 0.09 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 17 Seconds: cost approximately 0.12 dollar. 7. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 54 Seconds: cost approximately 0.05 dollar. 8. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.08 dollar. 9. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 2 Minutes, 20 Seconds: cost approximately 0.01 dollar. 10. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 2 Minutes, 22 Seconds: cost approximately 0.02 dollar. 11. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.01 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 8 Seconds: cost approximately 0.01 dollar. 13. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 13 Seconds: cost approximately 0.01 dollar. 14. Google n1-standard-16: $0.533 reported cost per hour, test consumed 2 Minutes, 9 Seconds: cost approximately 0.02 dollar. 15. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 2 Minutes, 11 Seconds: cost approximately 0.01 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 2 Minutes, 25 Seconds: cost approximately 0.03 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.06 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 4 Seconds: cost approximately 0.11 dollar. 19. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 44 Seconds: cost approximately 0.01 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 16 Seconds: cost approximately 0.08 dollar.
LAME MP3 Encoding Performance / Cost - WAV To MP3 OpenBenchmarking.org Seconds x Dollar, Fewer Is Better LAME MP3 Encoding 3.100 Performance / Cost - WAV To MP3 EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 1.2218 2.4436 3.6654 4.8872 6.109 0.42 1.32 3.92 1.78 3.21 5.43 1.88 3.64 0.47 0.93 0.92 0.45 0.46 0.90 0.91 1.41 2.75 4.51 0.41 3.50 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 2 Minutes, 10 Seconds: cost approximately 0.01 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 2 Minutes, 16 Seconds: cost approximately 0.03 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 14 Seconds: cost approximately 0.09 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 51 Seconds: cost approximately 0.05 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 51 Seconds: cost approximately 0.09 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 19 Seconds: cost approximately 0.12 dollar. 7. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.05 dollar. 8. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 21 Seconds: cost approximately 0.08 dollar. 9. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 2 Minutes, 24 Seconds: cost approximately 0.01 dollar. 10. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 2 Minutes, 23 Seconds: cost approximately 0.02 dollar. 11. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 2 Minutes, 21 Seconds: cost approximately 0.02 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.01 dollar. 13. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 21 Seconds: cost approximately 0.01 dollar. 14. Google n1-standard-16: $0.533 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.02 dollar. 15. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 2 Minutes, 21 Seconds: cost approximately 0.02 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 2 Minutes, 25 Seconds: cost approximately 0.03 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 22 Seconds: cost approximately 0.06 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.11 dollar. 19. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 2 Minutes, 6 Seconds: cost approximately 0.01 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 15 Seconds: cost approximately 0.08 dollar.
Crafty Performance / Cost - Elapsed Time OpenBenchmarking.org Nodes Per Second Per Dollar, More Is Better Crafty 25.2 Performance / Cost - Elapsed Time EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 140M 280M 420M 560M 700M 582404500.00 301199600.00 106209933.33 174220025.00 87186775.00 53780620.00 162002600.00 89494183.33 510643800.00 252121450.00 520150600.00 504095900.00 483920300.00 262684350.00 493289800.00 167761900.00 102417160.00 66509722.22 656271400.00 71851685.71 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 1 Minute, 49 Seconds: cost approximately 0.01 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 43 Seconds: cost approximately 0.02 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 37 Seconds: cost approximately 0.06 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 29 Seconds: cost approximately 0.04 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 29 Seconds: cost approximately 0.08 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 54 Seconds: cost approximately 0.1 dollar. 7. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 36 Seconds: cost approximately 0.04 dollar. 8. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.06 dollar. 9. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 2 Minutes: cost approximately 0.01 dollar. 10. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 2 Minutes, 2 Seconds: cost approximately 0.02 dollar. 11. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 58 Seconds: cost approximately 0.01 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 1 Second: cost approximately 0.01 dollar. 13. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.01 dollar. 14. Google n1-standard-16: $0.533 reported cost per hour, test consumed 1 Minute, 58 Seconds: cost approximately 0.02 dollar. 15. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 2 Minutes, 5 Seconds: cost approximately 0.01 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 2 Minutes, 2 Seconds: cost approximately 0.03 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 1 Minute, 59 Seconds: cost approximately 0.05 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 1 Minute, 43 Seconds: cost approximately 0.09 dollar. 19. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 35 Seconds: cost approximately 0.01 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 2 Seconds: cost approximately 0.07 dollar.
OpenSSL Performance / Cost - RSA 4096-bit Performance OpenBenchmarking.org Signs Per Second Per Dollar, More Is Better OpenSSL 1.1.0f Performance / Cost - RSA 4096-bit Performance EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 40K 80K 120K 160K 200K 17483.00 186093.00 141728.25 155716.67 155061.17 66044.50 85985.67 60264.25 37640.00 47840.00 109173.00 107887.00 92947.00 62966.67 116524.60 101747.00 72340.00 1. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.01 dollar. 2. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 3. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.04 dollar. 4. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.03 dollar. 5. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.06 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.06 dollar. 7. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.03 dollar. 8. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.04 dollar. 9. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 10. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 11. Google n1-standard-16: $0.533 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.01 dollar. 12. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 13. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 14. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.03 dollar. 15. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.05 dollar. 16. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 17. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.04 dollar.
Timed MAFFT Alignment Performance / Cost - Multiple Sequence Alignment OpenBenchmarking.org Seconds x Dollar, Fewer Is Better Timed MAFFT Alignment 6.864 Performance / Cost - Multiple Sequence Alignment EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure E4s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E32s v3 0.0675 0.135 0.2025 0.27 0.3375 0.03 0.03 0.04 0.27 0.04 0.06 0.12 0.07 0.30 0.07 1. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 14 Seconds: cost approximately 0.01 dollar. 2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 12 Seconds: cost approximately 0.01 dollar. 3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 17 Seconds: cost approximately 0.01 dollar. 4. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 31 Seconds: cost approximately 0.03 dollar. 5. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar. 6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 21 Seconds: cost approximately 0.01 dollar. 7. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 40 Seconds: cost approximately 0.01 dollar. 8. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 24 Seconds: cost approximately 0.01 dollar. 9. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 34 Seconds: cost approximately 0.03 dollar. 10. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 25 Seconds: cost approximately 0.01 dollar.
Scikit-Learn OpenBenchmarking.org Seconds, Fewer Is Better Scikit-Learn 0.17.1 EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 Orange Flexible Engine s1.medium 60 120 180 240 300 SE +/- 0.08, N = 3 SE +/- 0.07, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.17, N = 3 SE +/- 0.14, N = 3 SE +/- 9.88, N = 3 SE +/- 0.56, N = 3 SE +/- 1.48, N = 3 SE +/- 0.35, N = 3 SE +/- 1.78, N = 3 SE +/- 0.52, N = 3 SE +/- 0.62, N = 3 SE +/- 0.80, N = 3 SE +/- 0.47, N = 3 SE +/- 0.83, N = 3 SE +/- 0.92, N = 3 SE +/- 2.98, N = 3 SE +/- 1.42, N = 3 SE +/- 0.09, N = 3 SE +/- 2.86, N = 3 SE +/- 0.25, N = 3 179.03 211.86 204.55 190.08 190.52 182.92 214.77 164.09 191.67 196.96 187.80 192.66 260.15 272.74 252.14 264.88 199.18 199.08 171.10 193.88 181.49 219.06
PyBench Total For Average Test Times OpenBenchmarking.org Milliseconds, Fewer Is Better PyBench 2018-02-16 Total For Average Test Times EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 Orange Flexible Engine s1.medium 600 1200 1800 2400 3000 SE +/- 0.33, N = 3 SE +/- 3.84, N = 3 SE +/- 4.51, N = 3 SE +/- 3.48, N = 3 SE +/- 3.53, N = 3 SE +/- 2.40, N = 3 SE +/- 14.67, N = 3 SE +/- 8.66, N = 3 SE +/- 4.16, N = 3 SE +/- 0.88, N = 3 SE +/- 11.57, N = 3 SE +/- 12.44, N = 3 SE +/- 4.73, N = 3 SE +/- 1.45, N = 3 SE +/- 4.91, N = 3 SE +/- 2.52, N = 3 SE +/- 5.24, N = 3 SE +/- 6.08, N = 3 SE +/- 7.51, N = 3 SE +/- 1.53, N = 3 SE +/- 3.28, N = 3 2044 1792 1777 1607 1609 2239 1721 1819 2225 2191 2171 2193 2035 2069 2036 2063 2201 2183 1986 1631 2015 2644
PyBench Total For Average Test Times OpenBenchmarking.org Milliseconds, Fewer Is Better PyBench 2008-08-14 Total For Average Test Times EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 Orange Flexible Engine s1.medium 500 1000 1500 2000 2500 SE +/- 4.91, N = 3 SE +/- 8.33, N = 3 SE +/- 11.46, N = 3 SE +/- 4.41, N = 3 SE +/- 7.42, N = 3 SE +/- 6.23, N = 3 SE +/- 2.03, N = 3 SE +/- 6.00, N = 3 SE +/- 14.74, N = 3 SE +/- 9.50, N = 3 SE +/- 10.17, N = 3 SE +/- 5.93, N = 3 SE +/- 1.33, N = 3 SE +/- 3.61, N = 3 SE +/- 0.58, N = 3 SE +/- 2.73, N = 3 SE +/- 13.86, N = 3 SE +/- 1.73, N = 3 1837 1637 1604 1459 1453 1992 1559 1643 1987 1965 1959 1954 1846 1875 1858 1876 2007 1949 1783 1473 1843 2359
Crafty Elapsed Time OpenBenchmarking.org Nodes Per Second, More Is Better Crafty 25.2 Elapsed Time EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 Orange Flexible Engine s1.medium 1.5M 3M 4.5M 6M 7.5M SE +/- 3484.54, N = 3 SE +/- 7362.69, N = 3 SE +/- 2343.50, N = 3 SE +/- 7226.78, N = 3 SE +/- 7074.19, N = 3 SE +/- 14246.76, N = 3 SE +/- 87880.44, N = 3 SE +/- 24158.72, N = 3 SE +/- 24686.39, N = 3 SE +/- 22944.13, N = 3 SE +/- 35943.27, N = 3 SE +/- 30240.43, N = 3 SE +/- 7660.06, N = 3 SE +/- 18368.33, N = 3 SE +/- 33738.56, N = 3 SE +/- 3776.53, N = 3 SE +/- 22783.95, N = 3 SE +/- 65958.25, N = 3 SE +/- 4663.73, N = 3 SE +/- 27207.60, N = 3 SE +/- 108291.70, N = 3 SE +/- 23171.34, N = 3 5824045 6023992 6372596 6968801 6974942 5378062 5691579 6480104 5369651 5106438 5042429 5201506 5040959 4839203 5253687 4932898 5032857 5120858 5985875 6562714 5029618 4415980 1. (CC) gcc options: -lstdc++ -fprofile-use -pthread -lm
LAME MP3 Encoding WAV To MP3 OpenBenchmarking.org Seconds, Fewer Is Better LAME MP3 Encoding 3.100 WAV To MP3 EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 Orange Flexible Engine s1.medium 12 24 36 48 60 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.17, N = 3 SE +/- 1.71, N = 3 SE +/- 0.04, N = 3 SE +/- 0.08, N = 3 SE +/- 0.02, N = 3 SE +/- 0.10, N = 3 SE +/- 0.02, N = 3 SE +/- 0.11, N = 3 SE +/- 0.36, N = 3 SE +/- 0.00, N = 3 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 SE +/- 0.33, N = 3 SE +/- 0.32, N = 3 SE +/- 0.61, N = 3 42.12 43.90 43.57 35.63 35.62 45.22 41.09 37.62 45.51 46.62 46.44 45.77 44.72 45.81 44.85 45.56 47.04 45.88 41.01 40.51 43.77 53.69 1. (CC) gcc options: -lm
AOBench Size: 2048 x 2048 - Total Time OpenBenchmarking.org Seconds, Fewer Is Better AOBench Size: 2048 x 2048 - Total Time EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 Orange Flexible Engine s1.medium 20 40 60 80 100 SE +/- 0.04, N = 3 SE +/- 0.16, N = 3 SE +/- 1.07, N = 3 SE +/- 0.38, N = 3 SE +/- 0.12, N = 3 SE +/- 1.04, N = 3 SE +/- 0.50, N = 3 SE +/- 0.11, N = 3 SE +/- 0.20, N = 3 SE +/- 0.22, N = 3 SE +/- 0.52, N = 3 SE +/- 0.09, N = 3 SE +/- 0.11, N = 3 SE +/- 0.12, N = 3 SE +/- 0.03, N = 3 SE +/- 0.10, N = 3 SE +/- 0.22, N = 3 SE +/- 0.07, N = 3 SE +/- 0.36, N = 3 SE +/- 0.52, N = 3 SE +/- 0.57, N = 3 SE +/- 0.09, N = 3 62.18 65.48 66.21 58.70 58.42 64.56 65.51 55.39 67.24 68.85 65.32 67.42 73.65 74.77 72.86 74.22 69.50 67.28 56.84 60.80 63.81 74.41 1. (CC) gcc options: -lm -O3
Timed Linux Kernel Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 4.13 Time To Compile EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 Orange Flexible Engine s1.medium 200 400 600 800 1000 SE +/- 0.79, N = 3 SE +/- 1.41, N = 3 SE +/- 1.57, N = 3 SE +/- 1.57, N = 3 SE +/- 1.47, N = 3 SE +/- 1.14, N = 3 SE +/- 46.62, N = 3 SE +/- 1.05, N = 3 SE +/- 1.16, N = 3 SE +/- 14.52, N = 3 SE +/- 13.44, N = 3 SE +/- 1.81, N = 3 SE +/- 1.36, N = 3 SE +/- 2.20, N = 3 SE +/- 1.08, N = 3 SE +/- 1.19, N = 3 SE +/- 5.75, N = 3 SE +/- 7.94, N = 3 SE +/- 11.84, N = 3 SE +/- 14.41, N = 3 SE +/- 4.86, N = 3 SE +/- 0.87, N = 3 106.83 85.77 35.61 37.99 24.48 33.90 641.51 43.51 45.91 381.97 386.80 192.60 155.50 164.16 84.17 83.23 119.95 68.61 46.99 160.25 64.62 895.79
Timed MAFFT Alignment Multiple Sequence Alignment OpenBenchmarking.org Seconds, Fewer Is Better Timed MAFFT Alignment 6.864 Multiple Sequence Alignment EC2 t2.2xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m4.16xlarge EC2 m5.large EC2 c4.8xlarge EC2 m4.10xlarge Microsoft Azure D4s v3 Microsoft Azure E4s v3 Microsoft Azure D8s v3 Google n1-standard-8 Google n1-highcpu-8 Google n1-standard-16 Google n1-highcpu-16 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure F8s v2 Microsoft Azure E32s v3 Orange Flexible Engine s1.medium 6 12 18 24 30 SE +/- 0.01, N = 3 SE +/- 0.24, N = 3 SE +/- 0.13, N = 3 SE +/- 0.05, N = 3 SE +/- 0.21, N = 3 SE +/- 0.08, N = 3 SE +/- 0.07, N = 3 SE +/- 0.15, N = 3 SE +/- 0.59, N = 3 SE +/- 0.26, N = 3 SE +/- 0.56, N = 3 SE +/- 0.02, N = 3 SE +/- 0.41, N = 3 SE +/- 0.16, N = 3 SE +/- 0.04, N = 3 SE +/- 0.10, N = 3 SE +/- 0.02, N = 3 SE +/- 0.18, N = 3 SE +/- 0.13, N = 3 SE +/- 0.05, N = 3 SE +/- 0.22, N = 3 SE +/- 0.02, N = 3 4.26 4.35 3.18 2.72 4.23 8.84 20.00 4.42 5.78 11.89 11.86 6.61 7.30 7.44 4.96 4.91 5.88 6.94 10.04 6.33 6.80 27.45 1. (CC) gcc options: -O3 -lm -lpthread
Phoronix Test Suite v10.8.4