Google Compute Engine, Amazon EC2, Microsoft Azure Public Compute Cloud Benchmarks Various instance type benchmarks of different setups on Microsoft Azure, Amazon Elastic Compute Cloud, and Google Compute Engine. Benchmarks by Michael Larabel.
HTML result view exported from: https://openbenchmarking.org/result/1803148-FO-1802221FO54&grt .
Google Compute Engine, Amazon EC2, Microsoft Azure Public Compute Cloud Benchmarks Processor Motherboard Chipset Memory Disk Graphics Network OS Kernel Compiler File-System System Layer Screen Resolution EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 FOrange Flexible Engine s1.large 2 x Intel Xeon E5-2666 v3 @ 3.50GHz (18 Cores / 36 Threads) Xen HVM domU (4.2.amazon BIOS) Intel 440FX- 82441FX PMC 60416MB 28GB Cirrus Logic GD 5446 Intel 82599 Virtual Function Ubuntu 16.04 4.4.0-1050-aws (x86_64) GCC 5.4.0 20160609 ext4 Xen HVM domU 4.2.amazon Intel Xeon Platinum 8124M @ 3.00GHz (18 Cores / 36 Threads) Amazon EC2 c5.9xlarge (1.0 BIOS) 70656MB 30GB Amazon Elastic Block Store Device 1d0f:ec20 KVM 2 x Intel Xeon Platinum 8124M @ 3.00GHz (36 Cores / 72 Threads) Amazon EC2 c5.18xlarge (1.0 BIOS) 141312MB Intel Xeon Platinum 8175M @ 2.50GHz (8 Cores / 16 Threads) Amazon EC2 m5.4xlarge (1.0 BIOS) 63488MB Intel Xeon Platinum 8175M @ 2.50GHz (24 Cores / 48 Threads) Amazon EC2 m5.12xlarge (1.0 BIOS) 189440MB 2 x Intel Xeon E5-2676 v3 @ 3.00GHz (20 Cores / 40 Threads) Xen HVM domU (4.2.amazon BIOS) 161792MB 28GB Cirrus Logic GD 5446 Intel 82599 Virtual Function Xen HVM domU 4.2.amazon 2 x Intel Xeon E5-2686 v4 @ 3.00GHz (32 Cores / 64 Threads) 258048MB Device 1d0f:ec20 Intel Xeon Platinum 8175M @ 2.50GHz (1 Core / 2 Threads) Amazon EC2 m5.large (1.0 BIOS) 8192MB 30GB Amazon Elastic Block Store KVM Intel Xeon E5-2676 v3 @ 2.39GHz (8 Cores) Xen HVM domU (4.2.amazon BIOS) 32768MB 28GB Cirrus Logic GD 5446 Xen HVM domU 4.2.amazon Intel Xeon @ 2.30GHz (4 Cores / 8 Threads) Google Compute Engine 8192MB 32GB PersistentDisk Red Hat Virtio device 4.13.0-1008-gcp (x86_64) KVM Intel Xeon @ 2.30GHz (8 Cores / 16 Threads) 15360MB Intel Xeon @ 2.30GHz (4 Cores / 8 Threads) 30720MB Intel Xeon @ 2.30GHz (8 Cores / 16 Threads) 60416MB 11GB PersistentDisk Intel Xeon E5-2673 v3 @ 2.39GHz (2 Cores / 4 Threads) Microsoft Virtual Machine v7.0 (090007 BIOS) Intel 440BX/ZX/DX 16384MB 32GB Virtual Disk + 34GB Virtual Disk Microsoft Hyper-V virtual VGA 4.13.0-1009-azure (x86_64) 1152x864 Microsoft Hyper-V Server Intel Xeon E5-2673 v3 @ 2.39GHz (4 Cores / 8 Threads) 32768MB 32GB Virtual Disk + 69GB Virtual Disk Intel Xeon E5-2673 v3 @ 2.39GHz (8 Cores / 16 Threads) 64512MB 32GB Virtual Disk + 137GB Virtual Disk 2 x Intel Xeon E5-2673 v3 @ 2.39GHz (16 Cores / 32 Threads) 129024MB 32GB Virtual Disk + 275GB Virtual Disk 2 x Intel Xeon E5-2673 v4 @ 2.29GHz (32 Cores / 64 Threads) 258048MB 32GB Virtual Disk + 550GB Virtual Disk 4.13.0-1011-azure (x86_64) Intel Xeon E5-2673 v4 @ 2.29GHz (2 Cores / 4 Threads) 32768MB 32GB Virtual Disk + 69GB Virtual Disk 4.13.0-1009-azure (x86_64) 2 x Intel Xeon E5-2673 v4 @ 2.29GHz (16 Cores / 32 Threads) 258048MB 32GB Virtual Disk + 550GB Virtual Disk 4.13.0-1011-azure (x86_64) Intel Xeon Platinum 8168 @ 2.69GHz (4 Cores / 8 Threads) 16384MB 32GB Virtual Disk + 69GB Virtual Disk Intel Xeon E5-2658 v4 @ 2.29GHz (2 Cores) Xen HVM domU (4.1.2_115-908.792. BIOS) Intel 440FX- 82441FX PMC 1 x 8184 MB RAM 39GB Cirrus Logic GD 5446 4.4.0-116-generic (x86_64) Xen HVM domU 4.1.2_115-908.792. OpenBenchmarking.org Compiler Details - --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v Processor Details - EC2 c4.8xlarge, EC2 m4.10xlarge, EC2 m4.16xlarge: Scaling Governor: intel_pstate powersave Python Details - Python 2.7.12 + Python 3.5.2 Security Details - EC2 c4.8xlarge: KPTI Protection - EC2 c5.9xlarge: KPTI Protection - EC2 c5.18xlarge: KPTI Protection - EC2 m5.4xlarge: KPTI Protection - EC2 m5.12xlarge: KPTI Protection - EC2 m4.10xlarge: KPTI Protection - EC2 m4.16xlarge: KPTI Protection - EC2 m5.large: KPTI Protection - EC2 t2.2xlarge: KPTI Protection - Google n1-highcpu-8: KPTI Protection - Google n1-highcpu-16: KPTI Protection - Google n1-standard-8: KPTI Protection - Google n1-standard-16: KPTI Protection - Microsoft Azure D4s v3: KPTI Protection - Microsoft Azure D8s v3: KPTI Protection - Microsoft Azure D16s v3: KPTI Protection - Microsoft Azure D32s v3: KPTI Protection - Microsoft Azure D64s v3: KPTI + OSB (observable speculation barrier Intel v6) + Full generic retpoline Protection - Microsoft Azure E4s v3: KPTI Protection - Microsoft Azure E32s v3: KPTI + OSB (observable speculation barrier Intel v6) + Full generic retpoline Protection - Microsoft Azure F8s v2: KPTI + OSB (observable speculation barrier Intel v6) + Full generic retpoline Protection - FOrange Flexible Engine s1.large: KPTI + OSB (observable speculation barrier Intel v6) + Full generic retpoline Protection Kernel Details - EC2 c5.9xlarge, EC2 c5.18xlarge, EC2 m5.4xlarge, EC2 m5.12xlarge, EC2 m5.large: nvme.io_timeout=4294967295
Google Compute Engine, Amazon EC2, Microsoft Azure Public Compute Cloud Benchmarks compress-7zip: Compress Speed Test aobench: 2048 x 2048 - Total Time c-ray: Total Time crafty: Elapsed Time java-jmh: Throughput john-the-ripper: Blowfish encode-mp3: WAV To MP3 npb: EP.C nginx: Static Web Page Serving nero2d: Total Time openssl: RSA 4096-bit Performance parboil: OpenMP CUTCP povray: Trace Time pybench: Total For Average Test Times pybench: Total For Average Test Times rodinia: OpenMP LavaMD scikit-learn: build-linux-kernel: Time To Compile mafft: Multiple Sequence Alignment ttsiod-renderer: Phong Rendering With Soft-Shadow Mapping x264: H.264 Video Encoding EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 FOrange Flexible Engine s1.large 78087 55.39 6.09 6480104 56603426109.55 25341 37.62 673.14 23090.77 36.91 2579.57 4.39 35.08 1643 1819 52.79 164.09 43.51 4.42 419.30 107.99 91933 58.70 11.00 6968801 60940889045.98 30593 35.63 1256.19 29999.02 60.15 4671.50 6.17 32.35 1459 1607 44.56 190.08 37.99 2.72 460.27 134.10 160822 58.42 5.72 6974942 121829911181.01 60305 35.62 2512.81 24619.23 32.19 9303.67 3.75 17.74 1453 1609 22.77 190.52 24.48 4.23 336.76 176.03 36642 65.48 29.48 6023992 24447443003.95 12094 43.90 459.35 20160.69 115.44 1860.93 16.11 87.10 1637 1792 115.20 211.86 85.77 4.35 184.83 55.46 112699 66.21 9.94 6372596 74086333554.07 37069 43.57 1385.49 25555.24 48.78 5669.13 5.80 29.87 1604 1777 39.53 204.55 35.61 3.18 504.82 129.66 75762 67.24 6.46 5369651 52821381652.06 23632 45.51 627.62 21579.29 41.18 2410.57 4.63 37.44 1987 2225 56.59 191.67 45.91 5.78 394.52 97.43 115598 64.56 4.16 5378062 84002323902.87 39091 45.22 1034.94 21410.50 26.13 3962.67 3.18 24.12 1992 2239 34.10 182.92 33.90 8.84 465.90 115.34 5090 65.51 152.07 5691579 3178036199.44 1562 41.09 60.99 12132.51 534.08 242.00 98.07 617.28 1559 1721 828.97 214.77 641.51 20.00 26.88 11.02 23917 62.18 16.52 5824045 4217431038.72 6067 42.12 146.20 18175.24 87.04 174.83 11.46 563.33 1837 2044 213.70 179.03 106.83 4.26 231.07 38.43 14996 74.77 40.08 4839203 10642422187.43 5256 45.81 235.75 21203.08 198.33 540.70 27.80 152.93 1875 2069 246.30 272.74 164.16 7.44 124.66 25.92 30253 74.22 20.84 4932898 21349296898.72 10501 45.56 464.55 24005.34 130.21 1078.87 14.16 75.87 1876 2063 122.90 264.88 83.23 4.91 234.96 52.41 16136 73.65 39.77 5040959 10676070774.18 5311 44.72 233.87 25255.90 193.69 554.97 27.54 150.53 1846 2035 245.74 260.15 155.50 7.30 129.81 26.93 30229 72.86 20.76 5253687 21381785010.72 10649 44.85 477.95 26556.48 126.67 1091.73 14.16 75.92 1858 2036 123.24 252.14 84.17 4.96 238.88 52.07 9144 68.85 63.05 5106438 5267511004.58 2323 46.62 64.00 14328.83 391.21 242.10 37.92 346.10 1965 2191 550.02 196.96 381.97 11.89 74.64 13.95 17015 67.42 31.97 5201506 10474890150.44 4621 45.77 125.37 15431.68 177.01 478.40 19.56 172.17 1954 2193 279.78 192.66 192.60 6.61 142.43 26.82 30273 69.50 16.49 5032857 20355987704.49 8016 47.04 243.00 13495.31 100.00 929.47 10.35 89.86 2007 2201 144.60 199.18 119.95 5.88 249.33 46.48 57028 67.28 8.16 5120858 41237574200.22 13792 45.88 487.26 13352.91 57.39 1889.00 5.65 45.72 1949 2183 72.41 199.08 68.61 6.94 381.19 81.64 97549 56.84 5.15 5985875 79724759013.03 14237 41.01 996.94 12687.56 34.06 5826.23 3.25 25.87 1783 1986 35.20 171.10 46.99 10.04 141.98 82.04 8708 65.32 63.95 5042429 5147334632.54 2419 46.44 64.90 15480.88 351.83 376.40 37.25 378.52 1959 2171 529.89 187.80 386.80 11.86 75.14 12.08 56544 63.81 8.46 5029618 39975500322.53 13878 43.77 495.73 12574.34 52.48 2893.60 5.71 48.85 1843 2015 69.61 181.49 64.62 6.80 381.87 71.74 21252 60.80 53.48 6562714 13410992384.58 5912 40.51 256.23 16486.68 174.93 1017.47 28.33 163.10 1473 1631 206.12 193.88 160.25 6.33 106.43 31.44 5225 75.54 76.64 4390236 4485811577.68 1367 53.70 17902.57 206.57 49.58 466.28 2377 2636 921.50 221.85 471.41 15.94 53.02 11.30 OpenBenchmarking.org
7-Zip Compression Compress Speed Test OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 9.20.1 Compress Speed Test EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 FOrange Flexible Engine s1.large 30K 60K 90K 120K 150K SE +/- 380.57, N = 3 SE +/- 226.61, N = 3 SE +/- 319.70, N = 3 SE +/- 282.94, N = 3 SE +/- 480.06, N = 3 SE +/- 280.19, N = 3 SE +/- 482.44, N = 3 SE +/- 28.62, N = 3 SE +/- 86.00, N = 3 SE +/- 16.90, N = 3 SE +/- 132.53, N = 3 SE +/- 75.03, N = 3 SE +/- 130.52, N = 3 SE +/- 90.16, N = 3 SE +/- 88.33, N = 3 SE +/- 231.20, N = 3 SE +/- 268.12, N = 3 SE +/- 416.92, N = 3 SE +/- 16.02, N = 3 SE +/- 60.61, N = 3 SE +/- 244.04, N = 3 SE +/- 22.50, N = 3 78087 91933 160822 36642 112699 75762 115598 5090 23917 14996 30253 16136 30229 9144 17015 30273 57028 97549 8708 56544 21252 5225 1. (CXX) g++ options: -pipe -lpthread
7-Zip Compression Performance / Cost - Compress Speed Test OpenBenchmarking.org MIPS Per Dollar, More Is Better 7-Zip Compression 9.20.1 Performance / Cost - Compress Speed Test EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 600K 1200K 1800K 2400K 3000K 1561740.00 2298325.00 1462018.18 1832100.00 1609985.71 1082314.29 770653.33 2391700.00 1499600.00 3025300.00 1613600.00 1511450.00 914400.00 1701500.00 1513650.00 950466.67 750376.92 870800.00 706800.00 2125200.00 1. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 51 Seconds: cost approximately 0.05 dollar. 2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 39 Seconds: cost approximately 0.04 dollar. 3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 2 Minutes, 6 Seconds: cost approximately 0.11 dollar. 4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 38 Seconds: cost approximately 0.02 dollar. 5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.07 dollar. 6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 14 Seconds: cost approximately 0.07 dollar. 7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 45 Seconds: cost approximately 0.15 dollar. 8. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 1 Minute, 14 Seconds: cost approximately 0.01 dollar. 9. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 1 Minute, 52 Seconds: cost approximately 0.01 dollar. 10. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.01 dollar. 11. Google n1-standard-8: $0.268 reported cost per hour, test consumed 1 Minute, 46 Seconds: cost approximately 0.01 dollar. 12. Google n1-standard-16: $0.533 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.02 dollar. 13. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 1 Minute, 36 Seconds: cost approximately 0.01 dollar. 14. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 42 Seconds: cost approximately 0.01 dollar. 15. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.02 dollar. 16. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 11 Seconds: cost approximately 0.06 dollar. 17. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 37 Seconds: cost approximately 0.13 dollar. 18. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 1 Minute, 39 Seconds: cost approximately 0.01 dollar. 19. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 12 Seconds: cost approximately 0.08 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 24 Seconds: cost approximately 0.01 dollar.
AOBench Size: 2048 x 2048 - Total Time OpenBenchmarking.org Seconds, Fewer Is Better AOBench Size: 2048 x 2048 - Total Time EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 FOrange Flexible Engine s1.large 20 40 60 80 100 SE +/- 0.11, N = 3 SE +/- 0.38, N = 3 SE +/- 0.12, N = 3 SE +/- 0.16, N = 3 SE +/- 1.07, N = 3 SE +/- 0.20, N = 3 SE +/- 1.04, N = 3 SE +/- 0.50, N = 3 SE +/- 0.04, N = 3 SE +/- 0.12, N = 3 SE +/- 0.10, N = 3 SE +/- 0.11, N = 3 SE +/- 0.03, N = 3 SE +/- 0.22, N = 3 SE +/- 0.09, N = 3 SE +/- 0.22, N = 3 SE +/- 0.07, N = 3 SE +/- 0.36, N = 3 SE +/- 0.52, N = 3 SE +/- 0.57, N = 3 SE +/- 0.52, N = 3 SE +/- 0.07, N = 3 55.39 58.70 58.42 65.48 66.21 67.24 64.56 65.51 62.18 74.77 74.22 73.65 72.86 68.85 67.42 69.50 67.28 56.84 65.32 63.81 60.80 75.54 1. (CC) gcc options: -lm -O3
AOBench Performance / Cost - Size: 2048 x 2048 - Total Time OpenBenchmarking.org Seconds x Dollar, Fewer Is Better AOBench Performance / Cost - Size: 2048 x 2048 - Total Time EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 3 6 9 12 15 4.43 4.70 8.76 2.62 8.61 7.40 11.62 0.66 1.24 0.75 2.23 1.47 2.19 0.69 1.35 3.48 6.06 8.53 1.96 7.66 1.22 1. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 2 Minutes, 50 Seconds: cost approximately 0.08 dollar. 2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 3 Minutes: cost approximately 0.08 dollar. 3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 2 Minutes, 59 Seconds: cost approximately 0.15 dollar. 4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.04 dollar. 5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 3 Minutes, 22 Seconds: cost approximately 0.13 dollar. 6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 3 Minutes, 26 Seconds: cost approximately 0.11 dollar. 7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 3 Minutes, 18 Seconds: cost approximately 0.18 dollar. 8. EC2 m5.large: $0.096 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.01 dollar. 9. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 3 Minutes, 11 Seconds: cost approximately 0.02 dollar. 10. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 3 Minutes, 48 Seconds: cost approximately 0.01 dollar. 11. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 3 Minutes, 47 Seconds: cost approximately 0.03 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 3 Minutes, 45 Seconds: cost approximately 0.02 dollar. 13. Google n1-standard-16: $0.533 reported cost per hour, test consumed 3 Minutes, 43 Seconds: cost approximately 0.03 dollar. 14. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 3 Minutes, 31 Seconds: cost approximately 0.01 dollar. 15. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 3 Minutes, 26 Seconds: cost approximately 0.02 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 3 Minutes, 32 Seconds: cost approximately 0.05 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 3 Minutes, 26 Seconds: cost approximately 0.09 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 54 Seconds: cost approximately 0.15 dollar. 19. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.03 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 3 Minutes, 16 Seconds: cost approximately 0.12 dollar. 21. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 3 Minutes, 6 Seconds: cost approximately 0.02 dollar.
C-Ray Total Time OpenBenchmarking.org Seconds, Fewer Is Better C-Ray 1.1 Total Time EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 FOrange Flexible Engine s1.large 30 60 90 120 150 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 5.71, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.14, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.42, N = 3 SE +/- 0.11, N = 3 SE +/- 0.02, N = 3 SE +/- 0.23, N = 3 SE +/- 0.02, N = 3 6.09 11.00 5.72 29.48 9.94 6.46 4.16 152.07 16.52 40.08 20.84 39.77 20.76 63.05 31.97 16.49 8.16 5.15 63.95 8.46 53.48 76.64 1. (CC) gcc options: -lm -lpthread -O3
C-Ray Performance / Cost - Total Time OpenBenchmarking.org Seconds x Dollar, Fewer Is Better C-Ray 1.1 Performance / Cost - Total Time EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 0.432 0.864 1.296 1.728 2.16 0.06 0.22 0.11 0.59 0.20 0.06 0.08 1.52 0.17 0.40 0.21 0.40 0.21 0.63 0.32 0.16 0.08 0.10 1.92 0.17 1.07 1. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 23 Seconds: cost approximately 0.01 dollar. 2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 38 Seconds: cost approximately 0.02 dollar. 3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 21 Seconds: cost approximately 0.02 dollar. 4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 33 Seconds: cost approximately 0.02 dollar. 5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 34 Seconds: cost approximately 0.02 dollar. 6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 23 Seconds: cost approximately 0.01 dollar. 7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 17 Seconds: cost approximately 0.02 dollar. 8. EC2 m5.large: $0.096 reported cost per hour, test consumed 7 Minutes, 40 Seconds: cost approximately 0.01 dollar. 9. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 54 Seconds: cost approximately 0.01 dollar. 10. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 5 Seconds: cost approximately 0.01 dollar. 11. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 1 Minute, 7 Seconds: cost approximately 0.01 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 3 Seconds: cost approximately 0.01 dollar. 13. Google n1-standard-16: $0.533 reported cost per hour, test consumed 1 Minute, 7 Seconds: cost approximately 0.01 dollar. 14. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 3 Minutes, 14 Seconds: cost approximately 0.01 dollar. 15. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 40 Seconds: cost approximately 0.01 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 54 Seconds: cost approximately 0.01 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 29 Seconds: cost approximately 0.01 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 20 Seconds: cost approximately 0.02 dollar. 19. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 3 Minutes, 16 Seconds: cost approximately 0.03 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 30 Seconds: cost approximately 0.02 dollar. 21. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 2 Minutes, 45 Seconds: cost approximately 0.02 dollar.
Cost To Run Tests Cost / Price Per Hour OpenBenchmarking.org Cost / Price Per Hour, Fewer Is Better Cost To Run Tests Cost / Price Per Hour EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 0.6728 1.3456 2.0184 2.6912 3.364 1.35 1.28 2.43 0.89 2.00 1.86 2.81 0.34 0.32 0.48 0.41 0.63 0.47 0.61 0.96 1.59 2.99 1.20 2.19 0.49 1. EC2 c4.8xlarge: $1.591 reported cost per hour, running tests consumed 50 Minutes, 46 Seconds: cost approximately 1.35 dollar. 2. EC2 c5.9xlarge: $1.53 reported cost per hour, running tests consumed 50 Minutes, 21 Seconds: cost approximately 1.28 dollar. 3. EC2 c5.18xlarge: $3.06 reported cost per hour, running tests consumed 47 Minutes, 35 Seconds: cost approximately 2.43 dollar. 4. EC2 m5.4xlarge: $0.768 reported cost per hour, running tests consumed 1 Hour, 9 Minutes, 15 Seconds: cost approximately 0.89 dollar. 5. EC2 m5.12xlarge: $2.304 reported cost per hour, running tests consumed 52 Minutes, 9 Seconds: cost approximately 2 dollar. 6. EC2 m4.10xlarge: $2.00 reported cost per hour, running tests consumed 55 Minutes, 55 Seconds: cost approximately 1.86 dollar. 7. EC2 m4.16xlarge: $3.20 reported cost per hour, running tests consumed 52 Minutes, 42 Seconds: cost approximately 2.81 dollar. 8. EC2 m5.large: $0.096 reported cost per hour, running tests consumed 3 Hours, 30 Minutes, 28 Seconds: cost approximately 0.34 dollar. 9. Google n1-highcpu-8: $0.199 reported cost per hour, running tests consumed 1 Hour, 35 Minutes, 11 Seconds: cost approximately 0.32 dollar. 10. Google n1-highcpu-16: $0.399 reported cost per hour, running tests consumed 1 Hour, 12 Minutes, 24 Seconds: cost approximately 0.48 dollar. 11. Google n1-standard-8: $0.268 reported cost per hour, running tests consumed 1 Hour, 32 Minutes, 18 Seconds: cost approximately 0.41 dollar. 12. Google n1-standard-16: $0.533 reported cost per hour, running tests consumed 1 Hour, 11 Minutes, 1 Second: cost approximately 0.63 dollar. 13. Microsoft Azure D4s v3: $0.1920 reported cost per hour, running tests consumed 2 Hours, 27 Minutes, 44 Seconds: cost approximately 0.47 dollar. 14. Microsoft Azure D8s v3: $0.3840 reported cost per hour, running tests consumed 1 Hour, 35 Minutes, 54 Seconds: cost approximately 0.61 dollar. 15. Microsoft Azure D16s v3: $0.7680 reported cost per hour, running tests consumed 1 Hour, 15 Minutes, 19 Seconds: cost approximately 0.96 dollar. 16. Microsoft Azure D32s v3: $1.5360 reported cost per hour, running tests consumed 1 Hour, 2 Minutes, 12 Seconds: cost approximately 1.59 dollar. 17. Microsoft Azure D64s v3: $3.0720 reported cost per hour, running tests consumed 58 Minutes, 25 Seconds: cost approximately 2.99 dollar. 18. Microsoft Azure E4s v3: $0.495 reported cost per hour, running tests consumed 2 Hours, 25 Minutes, 51 Seconds: cost approximately 1.2 dollar. 19. Microsoft Azure E32s v3: $2.1280 reported cost per hour, running tests consumed 1 Hour, 1 Minute, 44 Seconds: cost approximately 2.19 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, running tests consumed 1 Hour, 27 Minutes, 16 Seconds: cost approximately 0.49 dollar.
Crafty Elapsed Time OpenBenchmarking.org Nodes Per Second, More Is Better Crafty 25.2 Elapsed Time EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 FOrange Flexible Engine s1.large 1.5M 3M 4.5M 6M 7.5M SE +/- 24158.72, N = 3 SE +/- 7226.78, N = 3 SE +/- 7074.19, N = 3 SE +/- 7362.69, N = 3 SE +/- 2343.50, N = 3 SE +/- 24686.39, N = 3 SE +/- 14246.76, N = 3 SE +/- 87880.44, N = 3 SE +/- 3484.54, N = 3 SE +/- 18368.33, N = 3 SE +/- 3776.53, N = 3 SE +/- 7660.06, N = 3 SE +/- 33738.56, N = 3 SE +/- 22944.13, N = 3 SE +/- 30240.43, N = 3 SE +/- 22783.95, N = 3 SE +/- 65958.25, N = 3 SE +/- 4663.73, N = 3 SE +/- 35943.27, N = 3 SE +/- 108291.70, N = 3 SE +/- 27207.60, N = 3 SE +/- 6305.85, N = 3 6480104 6968801 6974942 6023992 6372596 5369651 5378062 5691579 5824045 4839203 4932898 5040959 5253687 5106438 5201506 5032857 5120858 5985875 5042429 5029618 6562714 4390236 1. (CC) gcc options: -lstdc++ -fprofile-use -pthread -lm
Crafty Performance / Cost - Elapsed Time OpenBenchmarking.org Nodes Per Second Per Dollar, More Is Better Crafty 25.2 Performance / Cost - Elapsed Time EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 140M 280M 420M 560M 700M 162002600.00 174220025.00 87186775.00 301199600.00 106209933.33 89494183.33 53780620.00 582404500.00 483920300.00 493289800.00 504095900.00 262684350.00 510643800.00 520150600.00 167761900.00 102417160.00 66509722.22 252121450.00 71851685.71 656271400.00 1. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 36 Seconds: cost approximately 0.04 dollar. 2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 29 Seconds: cost approximately 0.04 dollar. 3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 29 Seconds: cost approximately 0.08 dollar. 4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 43 Seconds: cost approximately 0.02 dollar. 5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 37 Seconds: cost approximately 0.06 dollar. 6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.06 dollar. 7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 54 Seconds: cost approximately 0.1 dollar. 8. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 1 Minute, 49 Seconds: cost approximately 0.01 dollar. 9. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.01 dollar. 10. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 2 Minutes, 5 Seconds: cost approximately 0.01 dollar. 11. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 1 Second: cost approximately 0.01 dollar. 12. Google n1-standard-16: $0.533 reported cost per hour, test consumed 1 Minute, 58 Seconds: cost approximately 0.02 dollar. 13. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 2 Minutes: cost approximately 0.01 dollar. 14. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 58 Seconds: cost approximately 0.01 dollar. 15. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 2 Minutes, 2 Seconds: cost approximately 0.03 dollar. 16. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 1 Minute, 59 Seconds: cost approximately 0.05 dollar. 17. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 1 Minute, 43 Seconds: cost approximately 0.09 dollar. 18. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 2 Minutes, 2 Seconds: cost approximately 0.02 dollar. 19. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 2 Seconds: cost approximately 0.07 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 35 Seconds: cost approximately 0.01 dollar.
Java JMH Throughput OpenBenchmarking.org Ops/s, More Is Better Java JMH Throughput EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 FOrange Flexible Engine s1.large 30000M 60000M 90000M 120000M 150000M 56603426109.55 60940889045.98 121829911181.01 24447443003.95 74086333554.07 52821381652.06 84002323902.87 3178036199.44 4217431038.72 10642422187.43 21349296898.72 10676070774.18 21381785010.72 5267511004.58 10474890150.44 20355987704.49 41237574200.22 79724759013.03 5147334632.54 39975500322.53 13410992384.58 4485811577.68
Java JMH Performance / Cost - Throughput OpenBenchmarking.org Ops/s Per Dollar, More Is Better Java JMH Performance / Cost - Throughput EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 110000M 220000M 330000M 440000M 550000M 314463478386.39 338560494699.89 338416419947.25 271638255599.44 274393827978.04 229658181095.91 221058747112.82 317803619944.00 105435775968.00 532121109371.50 426985937974.40 355869025806.00 356363083512.00 263375550229.00 261872253761.00 226177641161.00 229097634445.67 181192634120.52 85788910542.33 159902001290.12 335274809614.50 1. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 6 Minutes, 58 Seconds: cost approximately 0.18 dollar. 2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 6 Minutes, 55 Seconds: cost approximately 0.18 dollar. 3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 7 Minutes, 1 Second: cost approximately 0.36 dollar. 4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 6 Minutes, 53 Seconds: cost approximately 0.09 dollar. 5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 6 Minutes, 57 Seconds: cost approximately 0.27 dollar. 6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 6 Minutes, 59 Seconds: cost approximately 0.23 dollar. 7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 7 Minutes, 4 Seconds: cost approximately 0.38 dollar. 8. EC2 m5.large: $0.096 reported cost per hour, test consumed 6 Minutes, 47 Seconds: cost approximately 0.01 dollar. 9. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 7 Minutes, 14 Seconds: cost approximately 0.04 dollar. 10. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 6 Minutes, 49 Seconds: cost approximately 0.02 dollar. 11. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 6 Minutes, 49 Seconds: cost approximately 0.05 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 6 Minutes, 48 Seconds: cost approximately 0.03 dollar. 13. Google n1-standard-16: $0.533 reported cost per hour, test consumed 6 Minutes, 48 Seconds: cost approximately 0.06 dollar. 14. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 6 Minutes, 49 Seconds: cost approximately 0.02 dollar. 15. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 6 Minutes, 49 Seconds: cost approximately 0.04 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 6 Minutes, 52 Seconds: cost approximately 0.09 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 7 Minutes, 3 Seconds: cost approximately 0.18 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 8 Minutes, 35 Seconds: cost approximately 0.44 dollar. 19. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 6 Minutes, 49 Seconds: cost approximately 0.06 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 7 Minutes, 4 Seconds: cost approximately 0.25 dollar. 21. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 6 Minutes, 48 Seconds: cost approximately 0.04 dollar.
John The Ripper Test: Blowfish OpenBenchmarking.org Real C/S, More Is Better John The Ripper 1.8.0 Test: Blowfish EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 FOrange Flexible Engine s1.large 13K 26K 39K 52K 65K SE +/- 40.45, N = 3 SE +/- 26.19, N = 3 SE +/- 33.25, N = 3 SE +/- 21.00, N = 3 SE +/- 41.59, N = 3 SE +/- 16.00, N = 3 SE +/- 193.12, N = 3 SE +/- 23.86, N = 3 SE +/- 8.50, N = 3 SE +/- 21.36, N = 3 SE +/- 6.51, N = 3 SE +/- 25.67, N = 3 SE +/- 30.95, N = 3 SE +/- 22.84, N = 3 SE +/- 45.99, N = 3 SE +/- 504.49, N = 3 SE +/- 166.51, N = 3 SE +/- 2.89, N = 3 SE +/- 629.45, N = 3 SE +/- 29.67, N = 3 25341 30593 60305 12094 37069 23632 39091 1562 6067 5256 10501 5311 10649 2323 4621 8016 13792 14237 2419 13878 5912 1367 1. (CC) gcc options: -fopenmp -lcrypt
John The Ripper Performance / Cost - Test: Blowfish OpenBenchmarking.org Real C/S Per Dollar, More Is Better John The Ripper 1.8.0 Performance / Cost - Test: Blowfish EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 110K 220K 330K 440K 550K 281566.67 339922.22 354735.29 302350.00 285146.15 214836.36 217172.22 156200.00 303350.00 525600.00 525050.00 531100.00 354966.67 232300.00 231050.00 200400.00 153244.44 79094.44 80633.33 115650.00 295600.00 1. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.09 dollar. 2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.09 dollar. 3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 3 Minutes, 22 Seconds: cost approximately 0.17 dollar. 4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.04 dollar. 5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.13 dollar. 6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 3 Minutes, 22 Seconds: cost approximately 0.11 dollar. 7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.18 dollar. 8. EC2 m5.large: $0.096 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.01 dollar. 9. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 3 Minutes, 19 Seconds: cost approximately 0.02 dollar. 10. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.01 dollar. 11. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.02 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.01 dollar. 13. Google n1-standard-16: $0.533 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.03 dollar. 14. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.01 dollar. 15. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.02 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.04 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 3 Minutes, 23 Seconds: cost approximately 0.09 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 3 Minutes, 27 Seconds: cost approximately 0.18 dollar. 19. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.03 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 3 Minutes, 23 Seconds: cost approximately 0.12 dollar. 21. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.02 dollar.
LAME MP3 Encoding WAV To MP3 OpenBenchmarking.org Seconds, Fewer Is Better LAME MP3 Encoding 3.100 WAV To MP3 EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 FOrange Flexible Engine s1.large 12 24 36 48 60 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.08, N = 3 SE +/- 0.17, N = 3 SE +/- 1.71, N = 3 SE +/- 0.03, N = 3 SE +/- 0.36, N = 3 SE +/- 0.05, N = 3 SE +/- 0.11, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.07, N = 3 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 SE +/- 0.10, N = 3 SE +/- 0.32, N = 3 SE +/- 0.33, N = 3 SE +/- 0.03, N = 3 37.62 35.63 35.62 43.90 43.57 45.51 45.22 41.09 42.12 45.81 45.56 44.72 44.85 46.62 45.77 47.04 45.88 41.01 46.44 43.77 40.51 53.70 1. (CC) gcc options: -lm
LAME MP3 Encoding Performance / Cost - WAV To MP3 OpenBenchmarking.org Seconds x Dollar, Fewer Is Better LAME MP3 Encoding 3.100 Performance / Cost - WAV To MP3 EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 1.2218 2.4436 3.6654 4.8872 6.109 1.88 1.78 3.21 1.32 3.92 3.64 5.43 0.42 0.46 0.91 0.45 0.90 0.47 0.92 1.41 2.75 4.51 0.93 3.50 0.41 1. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.05 dollar. 2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 51 Seconds: cost approximately 0.05 dollar. 3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 51 Seconds: cost approximately 0.09 dollar. 4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 2 Minutes, 16 Seconds: cost approximately 0.03 dollar. 5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 14 Seconds: cost approximately 0.09 dollar. 6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 21 Seconds: cost approximately 0.08 dollar. 7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 19 Seconds: cost approximately 0.12 dollar. 8. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 2 Minutes, 10 Seconds: cost approximately 0.01 dollar. 9. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 21 Seconds: cost approximately 0.01 dollar. 10. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 2 Minutes, 21 Seconds: cost approximately 0.02 dollar. 11. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.01 dollar. 12. Google n1-standard-16: $0.533 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.02 dollar. 13. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 2 Minutes, 24 Seconds: cost approximately 0.01 dollar. 14. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 2 Minutes, 21 Seconds: cost approximately 0.02 dollar. 15. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 2 Minutes, 25 Seconds: cost approximately 0.03 dollar. 16. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 22 Seconds: cost approximately 0.06 dollar. 17. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.11 dollar. 18. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 2 Minutes, 23 Seconds: cost approximately 0.02 dollar. 19. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 15 Seconds: cost approximately 0.08 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 2 Minutes, 6 Seconds: cost approximately 0.01 dollar.
NAS Parallel Benchmarks Test / Class: EP.C OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.3 Test / Class: EP.C EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 500 1000 1500 2000 2500 SE +/- 3.43, N = 3 SE +/- 19.93, N = 3 SE +/- 29.39, N = 3 SE +/- 1.09, N = 3 SE +/- 1.50, N = 3 SE +/- 0.96, N = 3 SE +/- 1.06, N = 3 SE +/- 3.02, N = 3 SE +/- 0.08, N = 3 SE +/- 2.09, N = 3 SE +/- 17.11, N = 3 SE +/- 1.37, N = 3 SE +/- 3.92, N = 3 SE +/- 0.23, N = 3 SE +/- 0.54, N = 3 SE +/- 1.01, N = 3 SE +/- 0.74, N = 3 SE +/- 1.86, N = 3 SE +/- 0.06, N = 3 SE +/- 0.98, N = 3 SE +/- 1.49, N = 3 673.14 1256.19 2512.81 459.35 1385.49 627.62 1034.94 60.99 146.20 235.75 464.55 233.87 477.95 64.00 125.37 243.00 487.26 996.94 64.90 495.73 256.23 1. (F9X) gfortran options: -O3 -march=native -pthread -lmpi_usempif08 -lmpi_mpifh -lmpi 2. Open MPI 1.10.2
NAS Parallel Benchmarks Performance / Cost - Test / Class: EP.C OpenBenchmarking.org Total Mop/s Per Dollar, More Is Better NAS Parallel Benchmarks 3.3 Performance / Cost - Test / Class: EP.C EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 50K 100K 150K 200K 250K 33657.00 125619.00 251281.00 45935.00 69274.50 20920.67 34498.00 6099.00 7310.00 23575.00 46455.00 23387.00 47795.00 3200.00 6268.50 12150.00 24363.00 24923.50 1081.67 16524.33 25623.00 1. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 43 Seconds: cost approximately 0.02 dollar. 2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 26 Seconds: cost approximately 0.01 dollar. 3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 16 Seconds: cost approximately 0.01 dollar. 4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute: cost approximately 0.01 dollar. 5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 24 Seconds: cost approximately 0.02 dollar. 6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 47 Seconds: cost approximately 0.03 dollar. 7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 30 Seconds: cost approximately 0.03 dollar. 8. EC2 m5.large: $0.096 reported cost per hour, test consumed 7 Minutes, 9 Seconds: cost approximately 0.01 dollar. 9. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 3 Minutes, 1 Second: cost approximately 0.02 dollar. 10. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 1 Minute, 54 Seconds: cost approximately 0.01 dollar. 11. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 1 Minute: cost approximately 0.01 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.01 dollar. 13. Google n1-standard-16: $0.533 reported cost per hour, test consumed 58 Seconds: cost approximately 0.01 dollar. 14. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 6 Minutes, 47 Seconds: cost approximately 0.02 dollar. 15. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 3 Minutes, 30 Seconds: cost approximately 0.02 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 1 Minute, 50 Seconds: cost approximately 0.02 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 58 Seconds: cost approximately 0.02 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 52 Seconds: cost approximately 0.04 dollar. 19. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 6 Minutes, 41 Seconds: cost approximately 0.06 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 57 Seconds: cost approximately 0.03 dollar. 21. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 45 Seconds: cost approximately 0.01 dollar.
NGINX Benchmark Static Web Page Serving OpenBenchmarking.org Requests Per Second, More Is Better NGINX Benchmark 1.9.9 Static Web Page Serving EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 FOrange Flexible Engine s1.large 6K 12K 18K 24K 30K SE +/- 451.84, N = 3 SE +/- 54.82, N = 3 SE +/- 78.50, N = 3 SE +/- 92.03, N = 3 SE +/- 146.75, N = 3 SE +/- 101.19, N = 3 SE +/- 279.06, N = 3 SE +/- 188.83, N = 3 SE +/- 798.70, N = 3 SE +/- 341.39, N = 3 SE +/- 91.80, N = 3 SE +/- 98.84, N = 3 SE +/- 73.63, N = 3 SE +/- 1.63, N = 3 SE +/- 25.54, N = 3 SE +/- 117.02, N = 3 SE +/- 619.74, N = 2 SE +/- 226.15, N = 3 SE +/- 142.39, N = 3 SE +/- 297.47, N = 3 SE +/- 150.79, N = 3 SE +/- 94.93, N = 3 23090.77 29999.02 24619.23 20160.69 25555.24 21579.29 21410.50 12132.51 18175.24 21203.08 24005.34 25255.90 26556.48 14328.83 15431.68 13495.31 13352.91 12687.56 15480.88 12574.34 16486.68 17902.57 1. (CC) gcc options: -lpthread -lcrypt -lcrypto -lz -O3 -march=native
NGINX Benchmark Performance / Cost - Static Web Page Serving OpenBenchmarking.org Requests Per Second Per Dollar, More Is Better NGINX Benchmark 1.9.9 Performance / Cost - Static Web Page Serving EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 300K 600K 900K 1200K 1500K 192423.08 333322.44 111905.59 288009.86 159720.25 126937.00 79298.15 1213251.00 454381.00 1060154.00 800178.00 1262795.00 663912.00 716441.50 385792.00 134953.10 74182.83 30208.48 258014.67 43359.79 412167.00 1. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 4 Minutes, 37 Seconds: cost approximately 0.12 dollar. 2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 3 Minutes, 37 Seconds: cost approximately 0.09 dollar. 3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 4 Minutes, 22 Seconds: cost approximately 0.22 dollar. 4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 5 Minutes, 16 Seconds: cost approximately 0.07 dollar. 5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 4 Minutes, 12 Seconds: cost approximately 0.16 dollar. 6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 4 Minutes, 57 Seconds: cost approximately 0.17 dollar. 7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 5 Minutes: cost approximately 0.27 dollar. 8. EC2 m5.large: $0.096 reported cost per hour, test consumed 8 Minutes, 35 Seconds: cost approximately 0.01 dollar. 9. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 5 Minutes, 50 Seconds: cost approximately 0.04 dollar. 10. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 5 Minutes, 3 Seconds: cost approximately 0.02 dollar. 11. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 4 Minutes, 29 Seconds: cost approximately 0.03 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 4 Minutes, 17 Seconds: cost approximately 0.02 dollar. 13. Google n1-standard-16: $0.533 reported cost per hour, test consumed 4 Minutes, 5 Seconds: cost approximately 0.04 dollar. 14. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 7 Minutes, 18 Seconds: cost approximately 0.02 dollar. 15. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 6 Minutes, 47 Seconds: cost approximately 0.04 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 7 Minutes, 44 Seconds: cost approximately 0.1 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 7 Minutes, 5 Seconds: cost approximately 0.18 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 8 Minutes, 12 Seconds: cost approximately 0.42 dollar. 19. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 6 Minutes, 47 Seconds: cost approximately 0.06 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 8 Minutes, 17 Seconds: cost approximately 0.29 dollar. 21. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 6 Minutes, 22 Seconds: cost approximately 0.04 dollar.
Open FMM Nero2D Total Time OpenBenchmarking.org Seconds, Fewer Is Better Open FMM Nero2D 2.0.2 Total Time EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 120 240 360 480 600 SE +/- 0.13, N = 3 SE +/- 0.96, N = 3 SE +/- 4.84, N = 3 SE +/- 5.00, N = 3 SE +/- 7.90, N = 3 SE +/- 0.80, N = 3 SE +/- 0.13, N = 3 SE +/- 8.89, N = 3 SE +/- 0.42, N = 3 SE +/- 0.57, N = 3 SE +/- 6.47, N = 3 SE +/- 0.90, N = 3 SE +/- 1.34, N = 3 SE +/- 0.35, N = 3 SE +/- 0.89, N = 3 SE +/- 0.02, N = 3 SE +/- 0.13, N = 3 SE +/- 0.33, N = 3 SE +/- 0.74, N = 3 SE +/- 0.33, N = 3 SE +/- 1.35, N = 3 36.91 60.15 32.19 115.44 48.78 41.18 26.13 534.08 87.04 198.33 130.21 193.69 126.67 391.21 177.01 100.00 57.39 34.06 351.83 52.48 174.93 1. (CXX) g++ options: -O2 -lfftw3 -llapack -lblas -lgfortran -lquadmath -lm -pthread -lmpi_cxx -lmpi
Open FMM Nero2D Performance / Cost - Total Time OpenBenchmarking.org Seconds x Dollar, Fewer Is Better Open FMM Nero2D 2.0.2 Performance / Cost - Total Time EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 12 24 36 48 60 1.85 4.81 2.90 8.08 4.88 2.88 1.83 21.36 2.61 5.95 5.21 7.75 7.60 23.47 10.62 6.00 4.59 3.07 52.77 5.25 8.75 1. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.05 dollar. 2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 3 Minutes, 5 Seconds: cost approximately 0.08 dollar. 3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 40 Seconds: cost approximately 0.09 dollar. 4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 5 Minutes, 51 Seconds: cost approximately 0.07 dollar. 5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 30 Seconds: cost approximately 0.1 dollar. 6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.07 dollar. 7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 23 Seconds: cost approximately 0.07 dollar. 8. EC2 m5.large: $0.096 reported cost per hour, test consumed 26 Minutes, 47 Seconds: cost approximately 0.04 dollar. 9. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 4 Minutes, 26 Seconds: cost approximately 0.03 dollar. 10. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 9 Minutes, 59 Seconds: cost approximately 0.03 dollar. 11. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 6 Minutes, 35 Seconds: cost approximately 0.04 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 9 Minutes, 45 Seconds: cost approximately 0.04 dollar. 13. Google n1-standard-16: $0.533 reported cost per hour, test consumed 6 Minutes, 24 Seconds: cost approximately 0.06 dollar. 14. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 19 Minutes, 38 Seconds: cost approximately 0.06 dollar. 15. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 8 Minutes, 55 Seconds: cost approximately 0.06 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 5 Minutes, 4 Seconds: cost approximately 0.06 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 56 Seconds: cost approximately 0.08 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 1 Minute, 46 Seconds: cost approximately 0.09 dollar. 19. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 17 Minutes, 39 Seconds: cost approximately 0.15 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 42 Seconds: cost approximately 0.1 dollar. 21. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 8 Minutes, 49 Seconds: cost approximately 0.05 dollar.
OpenSSL RSA 4096-bit Performance OpenBenchmarking.org Signs Per Second, More Is Better OpenSSL 1.1.0f RSA 4096-bit Performance EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 FOrange Flexible Engine s1.large 2K 4K 6K 8K 10K SE +/- 2.55, N = 3 SE +/- 1.27, N = 3 SE +/- 19.65, N = 3 SE +/- 2.33, N = 3 SE +/- 13.34, N = 3 SE +/- 2.05, N = 3 SE +/- 4.00, N = 3 SE +/- 0.95, N = 3 SE +/- 1.37, N = 3 SE +/- 21.05, N = 3 SE +/- 37.17, N = 3 SE +/- 34.32, N = 3 SE +/- 49.53, N = 3 SE +/- 2.80, N = 3 SE +/- 0.31, N = 3 SE +/- 1.62, N = 3 SE +/- 1.96, N = 3 SE +/- 35.20, N = 3 SE +/- 0.35, N = 3 SE +/- 4.11, N = 3 SE +/- 3.69, N = 3 SE +/- 0.43, N = 3 2579.57 4671.50 9303.67 1860.93 5669.13 2410.57 3962.67 242.00 174.83 540.70 1078.87 554.97 1091.73 242.10 478.40 929.47 1889.00 5826.23 376.40 2893.60 1017.47 206.57 1. (CC) gcc options: -O3 -pthread -m64 -lssl -lcrypto -ldl
OpenSSL Performance / Cost - RSA 4096-bit Performance OpenBenchmarking.org Signs Per Second Per Dollar, More Is Better OpenSSL 1.1.0f Performance / Cost - RSA 4096-bit Performance EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 t2.2xlarge Google n1-highcpu-16 Google n1-standard-16 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 40K 80K 120K 160K 200K 85985.67 155716.67 155061.17 186093.00 141728.25 60264.25 66044.50 17483.00 107887.00 109173.00 47840.00 92947.00 62966.67 116524.60 37640.00 72340.00 101747.00 1. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.03 dollar. 2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.03 dollar. 3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.06 dollar. 4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.04 dollar. 6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.04 dollar. 7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.06 dollar. 8. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.01 dollar. 9. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 10. Google n1-standard-16: $0.533 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.01 dollar. 11. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 12. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 13. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.03 dollar. 14. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.05 dollar. 15. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar. 16. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.04 dollar. 17. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar.
Parboil Test: OpenMP CUTCP OpenBenchmarking.org Seconds, Fewer Is Better Parboil 2.5 Test: OpenMP CUTCP EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 FOrange Flexible Engine s1.large 20 40 60 80 100 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.06, N = 3 SE +/- 0.46, N = 3 SE +/- 0.00, N = 3 SE +/- 0.09, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.16, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.09, N = 3 SE +/- 0.01, N = 3 SE +/- 0.11, N = 3 SE +/- 0.03, N = 3 4.39 6.17 3.75 16.11 5.80 4.63 3.18 98.07 11.46 27.80 14.16 27.54 14.16 37.92 19.56 10.35 5.65 3.25 37.25 5.71 28.33 49.58 1. (CXX) g++ options: -lm -lpthread -lgomp -ffast-math -fopenmp
Parboil Performance / Cost - Test: OpenMP CUTCP OpenBenchmarking.org Seconds x Dollar, Fewer Is Better Parboil 2.5 Performance / Cost - Test: OpenMP CUTCP EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 0.2205 0.441 0.6615 0.882 1.1025 0.04 0.06 0.04 0.16 0.06 0.05 0.03 0.98 0.14 0.28 0.14 0.38 0.20 0.10 0.06 0.07 0.75 0.06 0.28 1. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar. 2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 22 Seconds: cost approximately 0.01 dollar. 3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 16 Seconds: cost approximately 0.01 dollar. 4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 53 Seconds: cost approximately 0.01 dollar. 5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 21 Seconds: cost approximately 0.01 dollar. 6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar. 7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 14 Seconds: cost approximately 0.01 dollar. 8. EC2 m5.large: $0.096 reported cost per hour, test consumed 4 Minutes, 58 Seconds: cost approximately 0.01 dollar. 9. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 47 Seconds: cost approximately 0.01 dollar. 10. Google n1-standard-8: $0.268 reported cost per hour, test consumed 1 Minute, 27 Seconds: cost approximately 0.01 dollar. 11. Google n1-standard-16: $0.533 reported cost per hour, test consumed 47 Seconds: cost approximately 0.01 dollar. 12. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 1 Minute, 58 Seconds: cost approximately 0.01 dollar. 13. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 3 Seconds: cost approximately 0.01 dollar. 14. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 35 Seconds: cost approximately 0.01 dollar. 15. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 23 Seconds: cost approximately 0.01 dollar. 16. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 20 Seconds: cost approximately 0.02 dollar. 17. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.02 dollar. 18. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 21 Seconds: cost approximately 0.01 dollar. 19. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 29 Seconds: cost approximately 0.01 dollar.
POV-Ray Trace Time OpenBenchmarking.org Seconds, Fewer Is Better POV-Ray 3.7.0.7 Trace Time EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 FOrange Flexible Engine s1.large 130 260 390 520 650 SE +/- 0.14, N = 3 SE +/- 0.18, N = 3 SE +/- 0.13, N = 3 SE +/- 0.14, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.07, N = 3 SE +/- 40.66, N = 3 SE +/- 29.42, N = 3 SE +/- 0.04, N = 3 SE +/- 0.10, N = 3 SE +/- 0.31, N = 3 SE +/- 0.28, N = 3 SE +/- 0.27, N = 3 SE +/- 0.04, N = 3 SE +/- 0.27, N = 3 SE +/- 0.04, N = 3 SE +/- 0.16, N = 3 SE +/- 0.16, N = 3 SE +/- 0.18, N = 3 SE +/- 0.17, N = 3 SE +/- 1.03, N = 3 35.08 32.35 17.74 87.10 29.87 37.44 24.12 617.28 563.33 152.93 75.87 150.53 75.92 346.10 172.17 89.86 45.72 25.87 378.52 48.85 163.10 466.28 1. (CXX) g++ options: -pipe -O3 -ffast-math -march=native -pthread -lSDL -lSM -lICE -lX11 -ltiff -ljpeg -lpng -lz -lrt -lm -lboost_thread -lboost_system
POV-Ray Performance / Cost - Trace Time OpenBenchmarking.org Seconds x Dollar, Fewer Is Better POV-Ray 3.7.0.7 Performance / Cost - Trace Time EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 20 40 60 80 100 1.75 1.62 1.06 5.23 2.09 2.62 1.93 30.86 101.40 4.59 2.28 4.52 3.04 20.77 10.33 5.39 2.74 2.07 60.56 4.89 8.16 1. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 57 Seconds: cost approximately 0.05 dollar. 2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 48 Seconds: cost approximately 0.05 dollar. 3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.06 dollar. 4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 4 Minutes, 34 Seconds: cost approximately 0.06 dollar. 5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 42 Seconds: cost approximately 0.07 dollar. 6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 5 Seconds: cost approximately 0.07 dollar. 7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 25 Seconds: cost approximately 0.08 dollar. 8. EC2 m5.large: $0.096 reported cost per hour, test consumed 31 Minutes, 4 Seconds: cost approximately 0.05 dollar. 9. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 28 Minutes, 22 Seconds: cost approximately 0.18 dollar. 10. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 7 Minutes, 51 Seconds: cost approximately 0.03 dollar. 11. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 3 Minutes, 59 Seconds: cost approximately 0.03 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 7 Minutes, 44 Seconds: cost approximately 0.03 dollar. 13. Google n1-standard-16: $0.533 reported cost per hour, test consumed 4 Minutes: cost approximately 0.04 dollar. 14. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 17 Minutes, 31 Seconds: cost approximately 0.06 dollar. 15. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 8 Minutes, 50 Seconds: cost approximately 0.06 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 4 Minutes, 42 Seconds: cost approximately 0.06 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 30 Seconds: cost approximately 0.06 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 1 Minute, 31 Seconds: cost approximately 0.08 dollar. 19. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 19 Minutes, 9 Seconds: cost approximately 0.16 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 41 Seconds: cost approximately 0.1 dollar. 21. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 8 Minutes, 22 Seconds: cost approximately 0.05 dollar.
PyBench Total For Average Test Times OpenBenchmarking.org Milliseconds, Fewer Is Better PyBench 2008-08-14 Total For Average Test Times EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 FOrange Flexible Engine s1.large 500 1000 1500 2000 2500 SE +/- 6.00, N = 3 SE +/- 4.41, N = 3 SE +/- 7.42, N = 3 SE +/- 8.33, N = 3 SE +/- 11.46, N = 3 SE +/- 6.23, N = 3 SE +/- 2.03, N = 3 SE +/- 4.91, N = 3 SE +/- 5.93, N = 3 SE +/- 1.33, N = 3 SE +/- 10.17, N = 3 SE +/- 9.50, N = 3 SE +/- 3.61, N = 3 SE +/- 0.58, N = 3 SE +/- 14.74, N = 3 SE +/- 13.86, N = 3 SE +/- 2.73, N = 3 SE +/- 2.85, N = 3 1643 1459 1453 1637 1604 1987 1992 1559 1837 1875 1876 1846 1858 1965 1954 2007 1949 1783 1959 1843 1473 2377
PyBench Performance / Cost - Total For Average Test Times OpenBenchmarking.org Milliseconds x Dollar, Fewer Is Better PyBench 2008-08-14 Performance / Cost - Total For Average Test Times EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 50 100 150 200 250 82.15 58.36 130.77 32.74 112.28 158.96 239.04 18.37 18.75 18.76 18.46 37.16 19.65 19.54 60.21 116.94 196.13 39.18 147.44 14.73 1. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 54 Seconds: cost approximately 0.05 dollar. 2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 42 Seconds: cost approximately 0.04 dollar. 3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 41 Seconds: cost approximately 0.09 dollar. 4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.02 dollar. 5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 52 Seconds: cost approximately 0.07 dollar. 6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.08 dollar. 7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 17 Seconds: cost approximately 0.12 dollar. 8. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 2 Minutes, 8 Seconds: cost approximately 0.01 dollar. 9. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 13 Seconds: cost approximately 0.01 dollar. 10. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 2 Minutes, 11 Seconds: cost approximately 0.01 dollar. 11. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 8 Seconds: cost approximately 0.01 dollar. 12. Google n1-standard-16: $0.533 reported cost per hour, test consumed 2 Minutes, 9 Seconds: cost approximately 0.02 dollar. 13. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 2 Minutes, 20 Seconds: cost approximately 0.01 dollar. 14. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.01 dollar. 15. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 2 Minutes, 25 Seconds: cost approximately 0.03 dollar. 16. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.06 dollar. 17. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 4 Seconds: cost approximately 0.11 dollar. 18. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 2 Minutes, 22 Seconds: cost approximately 0.02 dollar. 19. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 16 Seconds: cost approximately 0.08 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 44 Seconds: cost approximately 0.01 dollar.
PyBench Total For Average Test Times OpenBenchmarking.org Milliseconds, Fewer Is Better PyBench 2018-02-16 Total For Average Test Times EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 FOrange Flexible Engine s1.large 600 1200 1800 2400 3000 SE +/- 8.66, N = 3 SE +/- 3.48, N = 3 SE +/- 3.53, N = 3 SE +/- 3.84, N = 3 SE +/- 4.51, N = 3 SE +/- 4.16, N = 3 SE +/- 2.40, N = 3 SE +/- 14.67, N = 3 SE +/- 0.33, N = 3 SE +/- 1.45, N = 3 SE +/- 2.52, N = 3 SE +/- 4.73, N = 3 SE +/- 4.91, N = 3 SE +/- 0.88, N = 3 SE +/- 12.44, N = 3 SE +/- 5.24, N = 3 SE +/- 6.08, N = 3 SE +/- 11.57, N = 3 SE +/- 1.53, N = 3 SE +/- 7.51, N = 3 SE +/- 2.73, N = 3 1819 1607 1609 1792 1777 2225 2239 1721 2044 2069 2063 2035 2036 2191 2193 2201 2183 1986 2171 2015 1631 2636
PyBench Performance / Cost - Total For Average Test Times OpenBenchmarking.org Milliseconds x Dollar, Fewer Is Better PyBench 2018-02-16 Performance / Cost - Total For Average Test Times EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 70 140 210 280 350 109.14 80.35 160.90 53.76 142.16 200.25 313.46 20.44 20.69 41.26 20.35 40.72 21.91 43.86 66.03 152.81 238.32 43.42 181.35 16.31 1. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.06 dollar. 2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 53 Seconds: cost approximately 0.05 dollar. 3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 53 Seconds: cost approximately 0.1 dollar. 4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.03 dollar. 5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 5 Seconds: cost approximately 0.08 dollar. 6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 35 Seconds: cost approximately 0.09 dollar. 7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 36 Seconds: cost approximately 0.14 dollar. 8. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 2 Minutes, 24 Seconds: cost approximately 0.01 dollar. 9. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 29 Seconds: cost approximately 0.01 dollar. 10. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 2 Minutes, 25 Seconds: cost approximately 0.02 dollar. 11. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 23 Seconds: cost approximately 0.01 dollar. 12. Google n1-standard-16: $0.533 reported cost per hour, test consumed 2 Minutes, 22 Seconds: cost approximately 0.02 dollar. 13. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 2 Minutes, 38 Seconds: cost approximately 0.01 dollar. 14. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 2 Minutes, 37 Seconds: cost approximately 0.02 dollar. 15. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 2 Minutes, 37 Seconds: cost approximately 0.03 dollar. 16. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 2 Minutes, 36 Seconds: cost approximately 0.07 dollar. 17. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 21 Seconds: cost approximately 0.12 dollar. 18. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 2 Minutes, 40 Seconds: cost approximately 0.02 dollar. 19. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 2 Minutes, 28 Seconds: cost approximately 0.09 dollar. 20. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.01 dollar.
Rodinia Test: OpenMP LavaMD OpenBenchmarking.org Seconds, Fewer Is Better Rodinia 2.4 Test: OpenMP LavaMD EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 FOrange Flexible Engine s1.large 200 400 600 800 1000 SE +/- 0.11, N = 3 SE +/- 0.33, N = 3 SE +/- 0.16, N = 3 SE +/- 2.22, N = 3 SE +/- 0.81, N = 3 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 7.59, N = 3 SE +/- 0.03, N = 3 SE +/- 0.54, N = 3 SE +/- 0.47, N = 3 SE +/- 0.90, N = 3 SE +/- 0.19, N = 3 SE +/- 1.53, N = 3 SE +/- 0.06, N = 3 SE +/- 0.32, N = 3 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 SE +/- 2.20, N = 3 SE +/- 0.04, N = 3 SE +/- 1.61, N = 3 SE +/- 0.58, N = 3 52.79 44.56 22.77 115.20 39.53 56.59 34.10 828.97 213.70 246.30 122.90 245.74 123.24 550.02 279.78 144.60 72.41 35.20 529.89 69.61 206.12 921.50 1. (CXX) g++ options: -O2 -lOpenCL
Rodinia Performance / Cost - Test: OpenMP LavaMD OpenBenchmarking.org Seconds x Dollar, Fewer Is Better Rodinia 2.4 Performance / Cost - Test: OpenMP LavaMD EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 30 60 90 120 150 3.70 2.67 1.37 8.06 3.16 5.66 3.41 58.03 14.96 9.85 4.92 14.74 7.39 49.50 25.18 13.01 6.52 3.17 116.58 9.05 12.37 1. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 2 Minutes, 42 Seconds: cost approximately 0.07 dollar. 2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.06 dollar. 3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 12 Seconds: cost approximately 0.06 dollar. 4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 5 Minutes, 50 Seconds: cost approximately 0.07 dollar. 5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 3 Seconds: cost approximately 0.08 dollar. 6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 54 Seconds: cost approximately 0.1 dollar. 7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 47 Seconds: cost approximately 0.1 dollar. 8. EC2 m5.large: $0.096 reported cost per hour, test consumed 41 Minutes, 30 Seconds: cost approximately 0.07 dollar. 9. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 10 Minutes, 46 Seconds: cost approximately 0.07 dollar. 10. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 12 Minutes, 23 Seconds: cost approximately 0.04 dollar. 11. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 6 Minutes, 12 Seconds: cost approximately 0.04 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 12 Minutes, 21 Seconds: cost approximately 0.06 dollar. 13. Google n1-standard-16: $0.533 reported cost per hour, test consumed 6 Minutes, 14 Seconds: cost approximately 0.06 dollar. 14. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 27 Minutes, 34 Seconds: cost approximately 0.09 dollar. 15. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 14 Minutes, 4 Seconds: cost approximately 0.09 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 7 Minutes, 18 Seconds: cost approximately 0.09 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 3 Minutes, 41 Seconds: cost approximately 0.09 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 1 Minute, 50 Seconds: cost approximately 0.09 dollar. 19. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 26 Minutes, 34 Seconds: cost approximately 0.22 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 3 Minutes, 33 Seconds: cost approximately 0.13 dollar. 21. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 10 Minutes, 22 Seconds: cost approximately 0.06 dollar.
Scikit-Learn OpenBenchmarking.org Seconds, Fewer Is Better Scikit-Learn 0.17.1 EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 FOrange Flexible Engine s1.large 60 120 180 240 300 SE +/- 0.56, N = 3 SE +/- 0.05, N = 3 SE +/- 0.17, N = 3 SE +/- 0.07, N = 3 SE +/- 0.02, N = 3 SE +/- 1.48, N = 3 SE +/- 0.14, N = 3 SE +/- 9.88, N = 3 SE +/- 0.08, N = 3 SE +/- 0.80, N = 3 SE +/- 0.83, N = 3 SE +/- 0.62, N = 3 SE +/- 0.47, N = 3 SE +/- 0.35, N = 3 SE +/- 0.52, N = 3 SE +/- 0.92, N = 3 SE +/- 2.98, N = 3 SE +/- 1.42, N = 3 SE +/- 1.78, N = 3 SE +/- 2.86, N = 3 SE +/- 0.09, N = 3 SE +/- 0.44, N = 3 164.09 190.08 190.52 211.86 204.55 191.67 182.92 214.77 179.03 272.74 264.88 260.15 252.14 196.96 192.66 199.18 199.08 171.10 187.80 181.49 193.88 221.85
Scikit-Learn Performance / Cost - OpenBenchmarking.org Seconds x Dollar, Fewer Is Better Scikit-Learn 0.17.1 Performance / Cost - EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 20 40 60 80 100 36.10 45.62 93.35 29.66 79.77 61.33 89.63 4.30 10.74 13.64 23.84 15.61 27.74 5.91 11.56 25.89 51.76 75.28 15.02 58.08 9.69 1. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 8 Minutes, 17 Seconds: cost approximately 0.22 dollar. 2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 9 Minutes, 35 Seconds: cost approximately 0.24 dollar. 3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 9 Minutes, 36 Seconds: cost approximately 0.49 dollar. 4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 10 Minutes, 40 Seconds: cost approximately 0.14 dollar. 5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 10 Minutes, 17 Seconds: cost approximately 0.39 dollar. 6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 9 Minutes, 39 Seconds: cost approximately 0.32 dollar. 7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 9 Minutes, 13 Seconds: cost approximately 0.49 dollar. 8. EC2 m5.large: $0.096 reported cost per hour, test consumed 10 Minutes, 49 Seconds: cost approximately 0.02 dollar. 9. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 9 Minutes, 2 Seconds: cost approximately 0.06 dollar. 10. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 13 Minutes, 43 Seconds: cost approximately 0.05 dollar. 11. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 13 Minutes, 19 Seconds: cost approximately 0.09 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 13 Minutes, 4 Seconds: cost approximately 0.06 dollar. 13. Google n1-standard-16: $0.533 reported cost per hour, test consumed 12 Minutes, 40 Seconds: cost approximately 0.11 dollar. 14. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 9 Minutes, 55 Seconds: cost approximately 0.03 dollar. 15. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 9 Minutes, 42 Seconds: cost approximately 0.06 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 10 Minutes, 2 Seconds: cost approximately 0.13 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 10 Minutes, 1 Second: cost approximately 0.26 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 8 Minutes, 37 Seconds: cost approximately 0.44 dollar. 19. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 9 Minutes, 27 Seconds: cost approximately 0.08 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 9 Minutes, 8 Seconds: cost approximately 0.32 dollar. 21. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 9 Minutes, 45 Seconds: cost approximately 0.05 dollar.
Timed Linux Kernel Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 4.13 Time To Compile EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 FOrange Flexible Engine s1.large 140 280 420 560 700 SE +/- 1.05, N = 3 SE +/- 1.57, N = 3 SE +/- 1.47, N = 3 SE +/- 1.41, N = 3 SE +/- 1.57, N = 3 SE +/- 1.16, N = 3 SE +/- 1.14, N = 3 SE +/- 46.62, N = 3 SE +/- 0.79, N = 3 SE +/- 2.20, N = 3 SE +/- 1.19, N = 3 SE +/- 1.36, N = 3 SE +/- 1.08, N = 3 SE +/- 14.52, N = 3 SE +/- 1.81, N = 3 SE +/- 5.75, N = 3 SE +/- 7.94, N = 3 SE +/- 11.84, N = 3 SE +/- 13.44, N = 3 SE +/- 4.86, N = 3 SE +/- 14.41, N = 3 SE +/- 1.17, N = 3 43.51 37.99 24.48 85.77 35.61 45.91 33.90 641.51 106.83 164.16 83.23 155.50 84.17 381.97 192.60 119.95 68.61 46.99 386.80 64.62 160.25 471.41
Timed Linux Kernel Compilation Performance / Cost - Time To Compile OpenBenchmarking.org Seconds x Dollar, Fewer Is Better Timed Linux Kernel Compilation 4.13 Performance / Cost - Time To Compile EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 14 28 42 56 70 3.05 2.28 1.96 5.15 2.85 4.13 3.73 32.08 4.27 4.92 2.50 6.22 3.37 22.92 11.56 9.60 6.86 6.58 61.89 8.40 8.01 1. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 2 Minutes, 35 Seconds: cost approximately 0.07 dollar. 2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 2 Minutes, 13 Seconds: cost approximately 0.06 dollar. 3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 36 Seconds: cost approximately 0.08 dollar. 4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 4 Minutes, 41 Seconds: cost approximately 0.06 dollar. 5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 9 Seconds: cost approximately 0.08 dollar. 6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 43 Seconds: cost approximately 0.09 dollar. 7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 8 Seconds: cost approximately 0.11 dollar. 8. EC2 m5.large: $0.096 reported cost per hour, test consumed 32 Minutes, 29 Seconds: cost approximately 0.05 dollar. 9. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 5 Minutes, 41 Seconds: cost approximately 0.04 dollar. 10. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 8 Minutes, 37 Seconds: cost approximately 0.03 dollar. 11. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 4 Minutes, 33 Seconds: cost approximately 0.03 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 8 Minutes, 10 Seconds: cost approximately 0.04 dollar. 13. Google n1-standard-16: $0.533 reported cost per hour, test consumed 4 Minutes, 42 Seconds: cost approximately 0.04 dollar. 14. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 19 Minutes, 32 Seconds: cost approximately 0.06 dollar. 15. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 10 Minutes, 4 Seconds: cost approximately 0.06 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 6 Minutes, 27 Seconds: cost approximately 0.08 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 3 Minutes, 52 Seconds: cost approximately 0.1 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 47 Seconds: cost approximately 0.14 dollar. 19. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 19 Minutes, 46 Seconds: cost approximately 0.16 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 3 Minutes, 40 Seconds: cost approximately 0.13 dollar. 21. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 8 Minutes, 24 Seconds: cost approximately 0.05 dollar.
Timed MAFFT Alignment Multiple Sequence Alignment OpenBenchmarking.org Seconds, Fewer Is Better Timed MAFFT Alignment 6.864 Multiple Sequence Alignment EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 FOrange Flexible Engine s1.large 5 10 15 20 25 SE +/- 0.15, N = 3 SE +/- 0.05, N = 3 SE +/- 0.21, N = 3 SE +/- 0.24, N = 3 SE +/- 0.13, N = 3 SE +/- 0.59, N = 3 SE +/- 0.08, N = 3 SE +/- 0.07, N = 3 SE +/- 0.01, N = 3 SE +/- 0.16, N = 3 SE +/- 0.10, N = 3 SE +/- 0.41, N = 3 SE +/- 0.04, N = 3 SE +/- 0.26, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.18, N = 3 SE +/- 0.13, N = 3 SE +/- 0.56, N = 3 SE +/- 0.22, N = 3 SE +/- 0.05, N = 3 SE +/- 0.06, N = 3 4.42 2.72 4.23 4.35 3.18 5.78 8.84 20.00 4.26 7.44 4.91 7.30 4.96 11.89 6.61 5.88 6.94 10.04 11.86 6.80 6.33 15.94 1. (CC) gcc options: -O3 -lm -lpthread
Timed MAFFT Alignment Performance / Cost - Multiple Sequence Alignment OpenBenchmarking.org Seconds x Dollar, Fewer Is Better Timed MAFFT Alignment 6.864 Performance / Cost - Multiple Sequence Alignment EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 0.0675 0.135 0.2025 0.27 0.3375 0.04 0.03 0.04 0.03 0.06 0.27 0.07 0.30 0.12 0.07 1. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar. 2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 12 Seconds: cost approximately 0.01 dollar. 3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 17 Seconds: cost approximately 0.01 dollar. 4. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 14 Seconds: cost approximately 0.01 dollar. 5. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 21 Seconds: cost approximately 0.01 dollar. 6. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 31 Seconds: cost approximately 0.03 dollar. 7. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 24 Seconds: cost approximately 0.01 dollar. 8. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 34 Seconds: cost approximately 0.03 dollar. 9. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 40 Seconds: cost approximately 0.01 dollar. 10. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 25 Seconds: cost approximately 0.01 dollar.
TTSIOD 3D Renderer Phong Rendering With Soft-Shadow Mapping OpenBenchmarking.org FPS, More Is Better TTSIOD 3D Renderer 2.3a Phong Rendering With Soft-Shadow Mapping EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 FOrange Flexible Engine s1.large 110 220 330 440 550 SE +/- 3.14, N = 3 SE +/- 4.23, N = 3 SE +/- 12.51, N = 3 SE +/- 0.49, N = 3 SE +/- 4.78, N = 3 SE +/- 3.29, N = 3 SE +/- 20.68, N = 3 SE +/- 2.30, N = 3 SE +/- 0.39, N = 3 SE +/- 0.39, N = 3 SE +/- 2.14, N = 3 SE +/- 0.50, N = 3 SE +/- 1.87, N = 3 SE +/- 0.19, N = 3 SE +/- 0.38, N = 3 SE +/- 1.45, N = 3 SE +/- 5.69, N = 3 SE +/- 1.98, N = 3 SE +/- 0.10, N = 3 SE +/- 4.11, N = 3 SE +/- 0.20, N = 3 SE +/- 0.11, N = 3 419.30 460.27 336.76 184.83 504.82 394.52 465.90 26.88 231.07 124.66 234.96 129.81 238.88 74.64 142.43 249.33 381.19 141.98 75.14 381.87 106.43 53.02 1. (CXX) g++ options: -O3 -fomit-frame-pointer -ffast-math -mtune=native -flto -msse -mrecip -mfpmath=sse -msse2 -mssse3 -lSDL -lstdc++
TTSIOD 3D Renderer Performance / Cost - Phong Rendering With Soft-Shadow Mapping OpenBenchmarking.org FPS Per Dollar, More Is Better TTSIOD 3D Renderer 2.3a Performance / Cost - Phong Rendering With Soft-Shadow Mapping EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 5K 10K 15K 20K 25K 13976.67 23013.50 5612.67 9241.50 16827.33 13150.67 9318.00 1344.00 23107.00 12466.00 23496.00 12981.00 23888.00 7464.00 14243.00 12466.50 12706.33 1290.73 2504.67 9546.75 5321.50 1. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 58 Seconds: cost approximately 0.03 dollar. 2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 53 Seconds: cost approximately 0.02 dollar. 3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 10 Seconds: cost approximately 0.06 dollar. 4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 42 Seconds: cost approximately 0.02 dollar. 5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 50 Seconds: cost approximately 0.03 dollar. 6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 1 Minute: cost approximately 0.03 dollar. 7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 54 Seconds: cost approximately 0.05 dollar. 8. EC2 m5.large: $0.096 reported cost per hour, test consumed 9 Minutes, 47 Seconds: cost approximately 0.02 dollar. 9. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 1 Minute, 26 Seconds: cost approximately 0.01 dollar. 10. Google n1-highcpu-8: $0.199 reported cost per hour, test consumed 2 Minutes, 22 Seconds: cost approximately 0.01 dollar. 11. Google n1-highcpu-16: $0.399 reported cost per hour, test consumed 1 Minute, 25 Seconds: cost approximately 0.01 dollar. 12. Google n1-standard-8: $0.268 reported cost per hour, test consumed 2 Minutes, 17 Seconds: cost approximately 0.01 dollar. 13. Google n1-standard-16: $0.533 reported cost per hour, test consumed 1 Minute, 24 Seconds: cost approximately 0.01 dollar. 14. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 3 Minutes, 41 Seconds: cost approximately 0.01 dollar. 15. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 2 Minutes, 6 Seconds: cost approximately 0.01 dollar. 16. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 1 Minute, 21 Seconds: cost approximately 0.02 dollar. 17. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 1 Minute, 1 Second: cost approximately 0.03 dollar. 18. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 2 Minutes, 13 Seconds: cost approximately 0.11 dollar. 19. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 3 Minutes, 40 Seconds: cost approximately 0.03 dollar. 20. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 1 Minute: cost approximately 0.04 dollar. 21. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 2 Minutes, 42 Seconds: cost approximately 0.02 dollar.
x264 H.264 Video Encoding OpenBenchmarking.org Frames Per Second, More Is Better x264 2018-02-05 H.264 Video Encoding EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 m5.large EC2 t2.2xlarge Google n1-highcpu-8 Google n1-highcpu-16 Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 FOrange Flexible Engine s1.large 40 80 120 160 200 SE +/- 0.30, N = 3 SE +/- 0.49, N = 3 SE +/- 1.46, N = 3 SE +/- 0.55, N = 3 SE +/- 0.28, N = 3 SE +/- 0.19, N = 3 SE +/- 1.25, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.14, N = 3 SE +/- 0.12, N = 3 SE +/- 0.05, N = 3 SE +/- 0.24, N = 3 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 SE +/- 0.18, N = 3 SE +/- 0.27, N = 3 SE +/- 0.61, N = 3 SE +/- 0.01, N = 3 SE +/- 0.23, N = 3 SE +/- 0.27, N = 3 SE +/- 0.02, N = 3 107.99 134.10 176.03 55.46 129.66 97.43 115.34 11.02 38.43 25.92 52.41 26.93 52.07 13.95 26.82 46.48 81.64 82.04 12.08 71.74 31.44 11.30 1. (CC) gcc options: -ldl -m64 -lm -lpthread -O3 -ffast-math -std=gnu99 -fPIC -fomit-frame-pointer -fno-tree-vectorize
x264 Performance / Cost - H.264 Video Encoding OpenBenchmarking.org Frames Per Second Per Dollar, More Is Better x264 2018-02-05 Performance / Cost - H.264 Video Encoding EC2 c4.8xlarge EC2 c5.9xlarge EC2 c5.18xlarge EC2 m5.4xlarge EC2 m5.12xlarge EC2 m4.10xlarge EC2 m4.16xlarge EC2 t2.2xlarge Google n1-standard-8 Google n1-standard-16 Microsoft Azure D4s v3 Microsoft Azure D8s v3 Microsoft Azure D16s v3 Microsoft Azure D32s v3 Microsoft Azure D64s v3 Microsoft Azure E4s v3 Microsoft Azure E32s v3 Microsoft Azure F8s v2 4K 8K 12K 16K 20K 10799.00 13410.00 17603.00 5546.00 12966.00 9743.00 5767.00 3843.00 2693.00 5207.00 1395.00 2682.00 4648.00 8164.00 4102.00 604.00 3587.00 3144.00 1. EC2 c4.8xlarge: $1.591 reported cost per hour, test consumed 21 Seconds: cost approximately 0.01 dollar. 2. EC2 c5.9xlarge: $1.53 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar. 3. EC2 c5.18xlarge: $3.06 reported cost per hour, test consumed 15 Seconds: cost approximately 0.01 dollar. 4. EC2 m5.4xlarge: $0.768 reported cost per hour, test consumed 37 Seconds: cost approximately 0.01 dollar. 5. EC2 m5.12xlarge: $2.304 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar. 6. EC2 m4.10xlarge: $2.00 reported cost per hour, test consumed 23 Seconds: cost approximately 0.01 dollar. 7. EC2 m4.16xlarge: $3.20 reported cost per hour, test consumed 20 Seconds: cost approximately 0.02 dollar. 8. EC2 t2.2xlarge: $0.3712 reported cost per hour, test consumed 51 Seconds: cost approximately 0.01 dollar. 9. Google n1-standard-8: $0.268 reported cost per hour, test consumed 1 Minute, 11 Seconds: cost approximately 0.01 dollar. 10. Google n1-standard-16: $0.533 reported cost per hour, test consumed 39 Seconds: cost approximately 0.01 dollar. 11. Microsoft Azure D4s v3: $0.1920 reported cost per hour, test consumed 2 Minutes, 13 Seconds: cost approximately 0.01 dollar. 12. Microsoft Azure D8s v3: $0.3840 reported cost per hour, test consumed 1 Minute, 11 Seconds: cost approximately 0.01 dollar. 13. Microsoft Azure D16s v3: $0.7680 reported cost per hour, test consumed 43 Seconds: cost approximately 0.01 dollar. 14. Microsoft Azure D32s v3: $1.5360 reported cost per hour, test consumed 26 Seconds: cost approximately 0.01 dollar. 15. Microsoft Azure D64s v3: $3.0720 reported cost per hour, test consumed 27 Seconds: cost approximately 0.02 dollar. 16. Microsoft Azure E4s v3: $0.495 reported cost per hour, test consumed 2 Minutes, 33 Seconds: cost approximately 0.02 dollar. 17. Microsoft Azure E32s v3: $2.1280 reported cost per hour, test consumed 29 Seconds: cost approximately 0.02 dollar. 18. Microsoft Azure F8s v2: $0.3380 reported cost per hour, test consumed 1 Minute, 1 Second: cost approximately 0.01 dollar.
Phoronix Test Suite v10.8.4