Amazon EC2 Cloud Linux Benchmarks

Benchmarks of Amazon EC2 cloud public on-demand instance types. Tests being worked on by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/1802203-FO-CLOUDTYPE77.

Amazon EC2 Cloud Linux BenchmarksProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemSystem Layerc4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge2 x Intel Xeon E5-2666 v3 @ 3.50GHz (18 Cores / 36 Threads)Xen HVM domU (4.2.amazon BIOS)Intel 440FX- 82441FX PMC60416MB28GBCirrus Logic GD 5446Intel 82599 Virtual FunctionUbuntu 16.044.4.0-1050-aws (x86_64)GCC 5.4.0 20160609ext4Xen HVM domU 4.2.amazon2 x Intel Xeon Platinum 8124M @ 3.00GHz (36 Cores / 72 Threads)Amazon EC2 c5.18xlarge (1.0 BIOS)141312MB30GB Amazon Elastic Block StoreDevice 1d0f:ec20KVMIntel Xeon Platinum 8124M @ 3.00GHz (18 Cores / 36 Threads)Amazon EC2 c5.9xlarge (1.0 BIOS)70656MB2 x Intel Xeon E5-2676 v3 @ 3.00GHz (20 Cores / 40 Threads)Xen HVM domU (4.2.amazon BIOS)161792MB28GBCirrus Logic GD 5446Intel 82599 Virtual FunctionXen HVM domU 4.2.amazon2 x Intel Xeon E5-2686 v4 @ 3.00GHz (32 Cores / 64 Threads)258048MBDevice 1d0f:ec20Intel Xeon Platinum 8175M @ 2.50GHz (24 Cores / 48 Threads)Amazon EC2 m5.12xlarge (1.0 BIOS)189440MB30GB Amazon Elastic Block StoreKVMIntel Xeon Platinum 8175M @ 2.50GHz (8 Cores / 16 Threads)Amazon EC2 m5.4xlarge (1.0 BIOS)63488MBIntel Xeon Platinum 8175M @ 2.50GHz (1 Core / 2 Threads)Amazon EC2 m5.large (1.0 BIOS)8192MBIntel Xeon E5-2676 v3 @ 2.39GHz (8 Cores)Xen HVM domU (4.2.amazon BIOS)32768MB28GBCirrus Logic GD 5446Xen HVM domU 4.2.amazonOpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v Processor Details- c4.8xlarge, m4.10xlarge, m4.16xlarge: Scaling Governor: intel_pstate powersavePython Details- Python 2.7.12 + Python 3.5.2Security Details- KPTI ProtectionKernel Details- c5.18xlarge, c5.9xlarge, m5.12xlarge, m5.4xlarge, m5.large: nvme.io_timeout=4294967295

Amazon EC2 Cloud Linux Benchmarksnpb: EP.Cparboil: OpenMP CUTCProdinia: OpenMP LavaMDmafft: Multiple Sequence Alignmentjohn-the-ripper: Blowfishnero2d: Total Timettsiod-renderer: Phong Rendering With Soft-Shadow Mappingx264: H.264 Video Encodingcompress-7zip: Compress Speed Testbuild-linux-kernel: Time To Compilec-ray: Total Timepovray: Trace Timeencode-mp3: WAV To MP3openssl: RSA 4096-bit Performancejava-jmh: Throughputpybench: Total For Average Test Timesnginx: Static Web Page Servingpybench: Total For Average Test Timesscikit-learn: aobench: 2048 x 2048 - Total Timecrafty: Elapsed Timec4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge673.144.3952.794.422534136.91419.30107.997808743.516.0935.0837.622579.5756603426109.55164323090.771819164.0955.3964801042512.813.7522.774.236030532.19336.76176.0316082224.485.7217.7435.629303.67121829911181.01145324619.231609190.5258.4269749421256.196.1744.562.723059360.15460.27134.109193337.9911.0032.3535.634671.5060940889045.98145929999.021607190.0858.706968801627.624.6356.595.782363241.18394.5297.437576245.916.4637.4445.512410.5752821381652.06198721579.292225191.6767.2453696511034.943.1834.108.843909126.13465.90115.3411559833.904.1624.1245.223962.6784002323902.87199221410.502239182.9264.5653780621385.495.8039.533.183706948.78504.82129.6611269935.619.9429.8743.575669.1374086333554.07160425555.241777204.5566.216372596459.3516.11115.204.3512094115.44184.8355.463664285.7729.4887.1043.901860.9324447443003.95163720160.691792211.8665.48602399260.9998.07828.9720.001562534.0826.8811.025090641.51152.07617.2841.09242.003178036199.44155912132.511721214.7765.515691579146.2011.46213.704.26606787.04231.0738.4323917106.8316.52563.3342.12174.834217431038.72183718175.242044179.0362.185824045OpenBenchmarking.org

NAS Parallel Benchmarks

Test / Class: EP.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: EP.Cc4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge5001000150020002500SE +/- 3.43, N = 3SE +/- 29.39, N = 3SE +/- 19.93, N = 3SE +/- 0.96, N = 3SE +/- 1.06, N = 3SE +/- 1.50, N = 3SE +/- 1.09, N = 3SE +/- 3.02, N = 3SE +/- 0.08, N = 3673.142512.811256.19627.621034.941385.49459.3560.99146.201. (F9X) gfortran options: -O3 -march=native -pthread -lmpi_usempif08 -lmpi_mpifh -lmpi2. Open MPI 1.10.2

Parboil

Test: OpenMP CUTCP

OpenBenchmarking.orgSeconds, Fewer Is BetterParboil 2.5Test: OpenMP CUTCPc4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge20406080100SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.46, N = 3SE +/- 0.00, N = 34.393.756.174.633.185.8016.1198.0711.461. (CXX) g++ options: -lm -lpthread -lgomp -ffast-math -fopenmp

Rodinia

Test: OpenMP LavaMD

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 2.4Test: OpenMP LavaMDc4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge2004006008001000SE +/- 0.11, N = 3SE +/- 0.16, N = 3SE +/- 0.33, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.81, N = 3SE +/- 2.22, N = 3SE +/- 7.59, N = 3SE +/- 0.03, N = 352.7922.7744.5656.5934.1039.53115.20828.97213.701. (CXX) g++ options: -O2 -lOpenCL

Timed MAFFT Alignment

Multiple Sequence Alignment

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MAFFT Alignment 6.864Multiple Sequence Alignmentc4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge510152025SE +/- 0.15, N = 3SE +/- 0.21, N = 3SE +/- 0.05, N = 3SE +/- 0.59, N = 3SE +/- 0.08, N = 3SE +/- 0.13, N = 3SE +/- 0.24, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 34.424.232.725.788.843.184.3520.004.261. (CC) gcc options: -O3 -lm -lpthread

John The Ripper

Test: Blowfish

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.8.0Test: Blowfishc4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge13K26K39K52K65KSE +/- 40.45, N = 3SE +/- 33.25, N = 3SE +/- 26.19, N = 3SE +/- 16.00, N = 3SE +/- 193.12, N = 3SE +/- 41.59, N = 3SE +/- 21.00, N = 3SE +/- 23.86, N = 325341603053059323632390913706912094156260671. (CC) gcc options: -fopenmp -lcrypt

Open FMM Nero2D

Total Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpen FMM Nero2D 2.0.2Total Timec4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge120240360480600SE +/- 0.13, N = 3SE +/- 4.84, N = 3SE +/- 0.96, N = 3SE +/- 0.80, N = 3SE +/- 0.13, N = 3SE +/- 7.90, N = 3SE +/- 5.00, N = 3SE +/- 8.89, N = 3SE +/- 0.42, N = 336.9132.1960.1541.1826.1348.78115.44534.0887.041. (CXX) g++ options: -O2 -lfftw3 -llapack -lblas -lgfortran -lquadmath -lm -pthread -lmpi_cxx -lmpi

TTSIOD 3D Renderer

Phong Rendering With Soft-Shadow Mapping

OpenBenchmarking.orgFPS, More Is BetterTTSIOD 3D Renderer 2.3aPhong Rendering With Soft-Shadow Mappingc4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge110220330440550SE +/- 3.14, N = 3SE +/- 12.51, N = 3SE +/- 4.23, N = 3SE +/- 3.29, N = 3SE +/- 20.68, N = 3SE +/- 4.78, N = 3SE +/- 0.49, N = 3SE +/- 2.30, N = 3SE +/- 0.39, N = 3419.30336.76460.27394.52465.90504.82184.8326.88231.071. (CXX) g++ options: -O3 -fomit-frame-pointer -ffast-math -mtune=native -flto -msse -mrecip -mfpmath=sse -msse2 -mssse3 -lSDL -lstdc++

x264

H.264 Video Encoding

OpenBenchmarking.orgFrames Per Second, More Is Betterx264 2018-02-05H.264 Video Encodingc4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge4080120160200SE +/- 0.30, N = 3SE +/- 1.46, N = 3SE +/- 0.49, N = 3SE +/- 0.19, N = 3SE +/- 1.25, N = 3SE +/- 0.28, N = 3SE +/- 0.55, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3107.99176.03134.1097.43115.34129.6655.4611.0238.431. (CC) gcc options: -ldl -m64 -lm -lpthread -O3 -ffast-math -std=gnu99 -fPIC -fomit-frame-pointer -fno-tree-vectorize

7-Zip Compression

Compress Speed Test

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 9.20.1Compress Speed Testc4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge30K60K90K120K150KSE +/- 380.57, N = 3SE +/- 319.70, N = 3SE +/- 226.61, N = 3SE +/- 280.19, N = 3SE +/- 482.44, N = 3SE +/- 480.06, N = 3SE +/- 282.94, N = 3SE +/- 28.62, N = 3SE +/- 86.00, N = 3780871608229193375762115598112699366425090239171. (CXX) g++ options: -pipe -lpthread

Timed Linux Kernel Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 4.13Time To Compilec4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge140280420560700SE +/- 1.05, N = 3SE +/- 1.47, N = 3SE +/- 1.57, N = 3SE +/- 1.16, N = 3SE +/- 1.14, N = 3SE +/- 1.57, N = 3SE +/- 1.41, N = 3SE +/- 46.62, N = 3SE +/- 0.79, N = 343.5124.4837.9945.9133.9035.6185.77641.51106.83

C-Ray

Total Time

OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 1.1Total Timec4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge306090120150SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 5.71, N = 3SE +/- 0.00, N = 36.095.7211.006.464.169.9429.48152.0716.521. (CC) gcc options: -lm -lpthread -O3

POV-Ray

Trace Time

OpenBenchmarking.orgSeconds, Fewer Is BetterPOV-Ray 3.7.0.7Trace Timec4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge130260390520650SE +/- 0.14, N = 3SE +/- 0.13, N = 3SE +/- 0.18, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.14, N = 3SE +/- 40.66, N = 3SE +/- 29.42, N = 335.0817.7432.3537.4424.1229.8787.10617.28563.331. (CXX) g++ options: -pipe -O3 -ffast-math -march=native -pthread -lSDL -lSM -lICE -lX11 -ltiff -ljpeg -lpng -lz -lrt -lm -lboost_thread -lboost_system

LAME MP3 Encoding

WAV To MP3

OpenBenchmarking.orgSeconds, Fewer Is BetterLAME MP3 Encoding 3.100WAV To MP3c4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge1020304050SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 3SE +/- 0.17, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 1.71, N = 3SE +/- 0.03, N = 337.6235.6235.6345.5145.2243.5743.9041.0942.121. (CC) gcc options: -lm

OpenSSL

RSA 4096-bit Performance

OpenBenchmarking.orgSigns Per Second, More Is BetterOpenSSL 1.1.0fRSA 4096-bit Performancec4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge2K4K6K8K10KSE +/- 2.55, N = 3SE +/- 19.65, N = 3SE +/- 1.27, N = 3SE +/- 2.05, N = 3SE +/- 4.00, N = 3SE +/- 13.34, N = 3SE +/- 2.33, N = 3SE +/- 0.95, N = 3SE +/- 1.37, N = 32579.579303.674671.502410.573962.675669.131860.93242.00174.831. (CC) gcc options: -O3 -pthread -m64 -lssl -lcrypto -ldl

Java JMH

Throughput

OpenBenchmarking.orgOps/s, More Is BetterJava JMHThroughputc4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge30000M60000M90000M120000M150000M56603426109.55121829911181.0160940889045.9852821381652.0684002323902.8774086333554.0724447443003.953178036199.444217431038.72

PyBench

Total For Average Test Times

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyBench 2008-08-14Total For Average Test Timesc4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge400800120016002000SE +/- 6.00, N = 3SE +/- 7.42, N = 3SE +/- 4.41, N = 3SE +/- 6.23, N = 3SE +/- 11.46, N = 3SE +/- 8.33, N = 3SE +/- 2.03, N = 3SE +/- 4.91, N = 3164314531459198719921604163715591837

NGINX Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterNGINX Benchmark 1.9.9Static Web Page Servingc4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge6K12K18K24K30KSE +/- 451.84, N = 3SE +/- 78.50, N = 3SE +/- 54.82, N = 3SE +/- 101.19, N = 3SE +/- 279.06, N = 3SE +/- 146.75, N = 3SE +/- 92.03, N = 3SE +/- 188.83, N = 3SE +/- 798.70, N = 323090.7724619.2329999.0221579.2921410.5025555.2420160.6912132.5118175.241. (CC) gcc options: -lpthread -lcrypt -lcrypto -lz -O3 -march=native

NAS Parallel Benchmarks

Performance / Cost - Test / Class: EP.C

OpenBenchmarking.orgTotal Mop/s Per Dollar, More Is BetterNAS Parallel Benchmarks 3.3Performance / Cost - Test / Class: EP.Cc4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge50K100K150K200K250K33657.00251281.00125619.0020920.6734498.0069274.5045935.006099.007310.001. c4.8xlarge: $1.591 reported cost per hour, test consumed 43 Seconds: cost approximately 0.02 dollar.2. c5.18xlarge: $3.06 reported cost per hour, test consumed 16 Seconds: cost approximately 0.01 dollar.3. c5.9xlarge: $1.53 reported cost per hour, test consumed 26 Seconds: cost approximately 0.01 dollar.4. m4.10xlarge: $2.00 reported cost per hour, test consumed 47 Seconds: cost approximately 0.03 dollar.5. m4.16xlarge: $3.20 reported cost per hour, test consumed 30 Seconds: cost approximately 0.03 dollar.6. m5.12xlarge: $2.304 reported cost per hour, test consumed 24 Seconds: cost approximately 0.02 dollar.7. m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute: cost approximately 0.01 dollar.8. m5.large: $0.096 reported cost per hour, test consumed 7 Minutes, 9 Seconds: cost approximately 0.01 dollar.9. t2.2xlarge: $0.3712 reported cost per hour, test consumed 3 Minutes, 1 Second: cost approximately 0.02 dollar.

Rodinia

Performance / Cost - Test: OpenMP LavaMD

OpenBenchmarking.orgSeconds x Dollar, Fewer Is BetterRodinia 2.4Performance / Cost - Test: OpenMP LavaMDc4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge13263952653.701.372.675.663.413.168.0658.0314.961. c4.8xlarge: $1.591 reported cost per hour, test consumed 2 Minutes, 42 Seconds: cost approximately 0.07 dollar.2. c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 12 Seconds: cost approximately 0.06 dollar.3. c5.9xlarge: $1.53 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.06 dollar.4. m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 54 Seconds: cost approximately 0.1 dollar.5. m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 47 Seconds: cost approximately 0.1 dollar.6. m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 3 Seconds: cost approximately 0.08 dollar.7. m5.4xlarge: $0.768 reported cost per hour, test consumed 5 Minutes, 50 Seconds: cost approximately 0.07 dollar.8. m5.large: $0.096 reported cost per hour, test consumed 41 Minutes, 30 Seconds: cost approximately 0.07 dollar.9. t2.2xlarge: $0.3712 reported cost per hour, test consumed 10 Minutes, 46 Seconds: cost approximately 0.07 dollar.

John The Ripper

Performance / Cost - Test: Blowfish

OpenBenchmarking.orgReal C/S Per Dollar, More Is BetterJohn The Ripper 1.8.0Performance / Cost - Test: Blowfishc4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge80K160K240K320K400K281566.67354735.29339922.22214836.36217172.22285146.15302350.00156200.00303350.001. c4.8xlarge: $1.591 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.09 dollar.2. c5.18xlarge: $3.06 reported cost per hour, test consumed 3 Minutes, 22 Seconds: cost approximately 0.17 dollar.3. c5.9xlarge: $1.53 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.09 dollar.4. m4.10xlarge: $2.00 reported cost per hour, test consumed 3 Minutes, 22 Seconds: cost approximately 0.11 dollar.5. m4.16xlarge: $3.20 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.18 dollar.6. m5.12xlarge: $2.304 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.13 dollar.7. m5.4xlarge: $0.768 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.04 dollar.8. m5.large: $0.096 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.01 dollar.9. t2.2xlarge: $0.3712 reported cost per hour, test consumed 3 Minutes, 19 Seconds: cost approximately 0.02 dollar.

Open FMM Nero2D

Performance / Cost - Total Time

OpenBenchmarking.orgSeconds x Dollar, Fewer Is BetterOpen FMM Nero2D 2.0.2Performance / Cost - Total Timec4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge5101520251.852.904.812.881.834.888.0821.362.611. c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.05 dollar.2. c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 40 Seconds: cost approximately 0.09 dollar.3. c5.9xlarge: $1.53 reported cost per hour, test consumed 3 Minutes, 5 Seconds: cost approximately 0.08 dollar.4. m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.07 dollar.5. m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 23 Seconds: cost approximately 0.07 dollar.6. m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 30 Seconds: cost approximately 0.1 dollar.7. m5.4xlarge: $0.768 reported cost per hour, test consumed 5 Minutes, 51 Seconds: cost approximately 0.07 dollar.8. m5.large: $0.096 reported cost per hour, test consumed 26 Minutes, 47 Seconds: cost approximately 0.04 dollar.9. t2.2xlarge: $0.3712 reported cost per hour, test consumed 4 Minutes, 26 Seconds: cost approximately 0.03 dollar.

TTSIOD 3D Renderer

Performance / Cost - Phong Rendering With Soft-Shadow Mapping

OpenBenchmarking.orgFPS Per Dollar, More Is BetterTTSIOD 3D Renderer 2.3aPerformance / Cost - Phong Rendering With Soft-Shadow Mappingc4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge5K10K15K20K25K13976.675612.6723013.5013150.679318.0016827.339241.501344.0023107.001. c4.8xlarge: $1.591 reported cost per hour, test consumed 58 Seconds: cost approximately 0.03 dollar.2. c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 10 Seconds: cost approximately 0.06 dollar.3. c5.9xlarge: $1.53 reported cost per hour, test consumed 53 Seconds: cost approximately 0.02 dollar.4. m4.10xlarge: $2.00 reported cost per hour, test consumed 1 Minute: cost approximately 0.03 dollar.5. m4.16xlarge: $3.20 reported cost per hour, test consumed 54 Seconds: cost approximately 0.05 dollar.6. m5.12xlarge: $2.304 reported cost per hour, test consumed 50 Seconds: cost approximately 0.03 dollar.7. m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 42 Seconds: cost approximately 0.02 dollar.8. m5.large: $0.096 reported cost per hour, test consumed 9 Minutes, 47 Seconds: cost approximately 0.02 dollar.9. t2.2xlarge: $0.3712 reported cost per hour, test consumed 1 Minute, 26 Seconds: cost approximately 0.01 dollar.

x264

Performance / Cost - H.264 Video Encoding

OpenBenchmarking.orgFrames Per Second Per Dollar, More Is Betterx264 2018-02-05Performance / Cost - H.264 Video Encodingc4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlarget2.2xlarge4K8K12K16K20K10799.0017603.0013410.009743.005767.0012966.005546.003843.001. c4.8xlarge: $1.591 reported cost per hour, test consumed 21 Seconds: cost approximately 0.01 dollar.2. c5.18xlarge: $3.06 reported cost per hour, test consumed 15 Seconds: cost approximately 0.01 dollar.3. c5.9xlarge: $1.53 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar.4. m4.10xlarge: $2.00 reported cost per hour, test consumed 23 Seconds: cost approximately 0.01 dollar.5. m4.16xlarge: $3.20 reported cost per hour, test consumed 20 Seconds: cost approximately 0.02 dollar.6. m5.12xlarge: $2.304 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar.7. m5.4xlarge: $0.768 reported cost per hour, test consumed 37 Seconds: cost approximately 0.01 dollar.8. t2.2xlarge: $0.3712 reported cost per hour, test consumed 51 Seconds: cost approximately 0.01 dollar.

7-Zip Compression

Performance / Cost - Compress Speed Test

OpenBenchmarking.orgMIPS Per Dollar, More Is Better7-Zip Compression 9.20.1Performance / Cost - Compress Speed Testc4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlarget2.2xlarge500K1000K1500K2000K2500K1561740.001462018.182298325.001082314.29770653.331609985.711832100.002391700.001. c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 51 Seconds: cost approximately 0.05 dollar.2. c5.18xlarge: $3.06 reported cost per hour, test consumed 2 Minutes, 6 Seconds: cost approximately 0.11 dollar.3. c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 39 Seconds: cost approximately 0.04 dollar.4. m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 14 Seconds: cost approximately 0.07 dollar.5. m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 45 Seconds: cost approximately 0.15 dollar.6. m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.07 dollar.7. m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 38 Seconds: cost approximately 0.02 dollar.8. t2.2xlarge: $0.3712 reported cost per hour, test consumed 1 Minute, 14 Seconds: cost approximately 0.01 dollar.

Timed Linux Kernel Compilation

Performance / Cost - Time To Compile

OpenBenchmarking.orgSeconds x Dollar, Fewer Is BetterTimed Linux Kernel Compilation 4.13Performance / Cost - Time To Compilec4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge7142128353.051.962.284.133.732.855.1532.084.271. c4.8xlarge: $1.591 reported cost per hour, test consumed 2 Minutes, 35 Seconds: cost approximately 0.07 dollar.2. c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 36 Seconds: cost approximately 0.08 dollar.3. c5.9xlarge: $1.53 reported cost per hour, test consumed 2 Minutes, 13 Seconds: cost approximately 0.06 dollar.4. m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 43 Seconds: cost approximately 0.09 dollar.5. m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 8 Seconds: cost approximately 0.11 dollar.6. m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 9 Seconds: cost approximately 0.08 dollar.7. m5.4xlarge: $0.768 reported cost per hour, test consumed 4 Minutes, 41 Seconds: cost approximately 0.06 dollar.8. m5.large: $0.096 reported cost per hour, test consumed 32 Minutes, 29 Seconds: cost approximately 0.05 dollar.9. t2.2xlarge: $0.3712 reported cost per hour, test consumed 5 Minutes, 41 Seconds: cost approximately 0.04 dollar.

C-Ray

Performance / Cost - Total Time

OpenBenchmarking.orgSeconds x Dollar, Fewer Is BetterC-Ray 1.1Performance / Cost - Total Timec4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge0.3420.6841.0261.3681.710.060.110.220.060.080.200.591.520.171. c4.8xlarge: $1.591 reported cost per hour, test consumed 23 Seconds: cost approximately 0.01 dollar.2. c5.18xlarge: $3.06 reported cost per hour, test consumed 21 Seconds: cost approximately 0.02 dollar.3. c5.9xlarge: $1.53 reported cost per hour, test consumed 38 Seconds: cost approximately 0.02 dollar.4. m4.10xlarge: $2.00 reported cost per hour, test consumed 23 Seconds: cost approximately 0.01 dollar.5. m4.16xlarge: $3.20 reported cost per hour, test consumed 17 Seconds: cost approximately 0.02 dollar.6. m5.12xlarge: $2.304 reported cost per hour, test consumed 34 Seconds: cost approximately 0.02 dollar.7. m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 33 Seconds: cost approximately 0.02 dollar.8. m5.large: $0.096 reported cost per hour, test consumed 7 Minutes, 40 Seconds: cost approximately 0.01 dollar.9. t2.2xlarge: $0.3712 reported cost per hour, test consumed 54 Seconds: cost approximately 0.01 dollar.

POV-Ray

Performance / Cost - Trace Time

OpenBenchmarking.orgSeconds x Dollar, Fewer Is BetterPOV-Ray 3.7.0.7Performance / Cost - Trace Timec4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge204060801001.751.061.622.621.932.095.2330.86101.401. c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 57 Seconds: cost approximately 0.05 dollar.2. c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.06 dollar.3. c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 48 Seconds: cost approximately 0.05 dollar.4. m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 5 Seconds: cost approximately 0.07 dollar.5. m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 25 Seconds: cost approximately 0.08 dollar.6. m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 42 Seconds: cost approximately 0.07 dollar.7. m5.4xlarge: $0.768 reported cost per hour, test consumed 4 Minutes, 34 Seconds: cost approximately 0.06 dollar.8. m5.large: $0.096 reported cost per hour, test consumed 31 Minutes, 4 Seconds: cost approximately 0.05 dollar.9. t2.2xlarge: $0.3712 reported cost per hour, test consumed 28 Minutes, 22 Seconds: cost approximately 0.18 dollar.

LAME MP3 Encoding

Performance / Cost - WAV To MP3

OpenBenchmarking.orgSeconds x Dollar, Fewer Is BetterLAME MP3 Encoding 3.100Performance / Cost - WAV To MP3c4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlarget2.2xlarge1.22182.44363.66544.88726.1091.883.211.783.645.433.921.320.421. c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.05 dollar.2. c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 51 Seconds: cost approximately 0.09 dollar.3. c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 51 Seconds: cost approximately 0.05 dollar.4. m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 21 Seconds: cost approximately 0.08 dollar.5. m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 19 Seconds: cost approximately 0.12 dollar.6. m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 14 Seconds: cost approximately 0.09 dollar.7. m5.4xlarge: $0.768 reported cost per hour, test consumed 2 Minutes, 16 Seconds: cost approximately 0.03 dollar.8. t2.2xlarge: $0.3712 reported cost per hour, test consumed 2 Minutes, 10 Seconds: cost approximately 0.01 dollar.

OpenSSL

Performance / Cost - RSA 4096-bit Performance

OpenBenchmarking.orgSigns Per Second Per Dollar, More Is BetterOpenSSL 1.1.0fPerformance / Cost - RSA 4096-bit Performancec4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlarget2.2xlarge40K80K120K160K200K85985.67155061.17155716.6760264.2566044.50141728.25186093.0017483.001. c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.03 dollar.2. c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.06 dollar.3. c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.03 dollar.4. m4.10xlarge: $2.00 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.04 dollar.5. m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.06 dollar.6. m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.04 dollar.7. m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar.8. t2.2xlarge: $0.3712 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.01 dollar.

Java JMH

Performance / Cost - Throughput

OpenBenchmarking.orgOps/s Per Dollar, More Is BetterJava JMHPerformance / Cost - Throughputc4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge70000M140000M210000M280000M350000M314463478386.39338416419947.25338560494699.89229658181095.91221058747112.82274393827978.04271638255599.44317803619944.00105435775968.001. c4.8xlarge: $1.591 reported cost per hour, test consumed 6 Minutes, 58 Seconds: cost approximately 0.18 dollar.2. c5.18xlarge: $3.06 reported cost per hour, test consumed 7 Minutes, 1 Second: cost approximately 0.36 dollar.3. c5.9xlarge: $1.53 reported cost per hour, test consumed 6 Minutes, 55 Seconds: cost approximately 0.18 dollar.4. m4.10xlarge: $2.00 reported cost per hour, test consumed 6 Minutes, 59 Seconds: cost approximately 0.23 dollar.5. m4.16xlarge: $3.20 reported cost per hour, test consumed 7 Minutes, 4 Seconds: cost approximately 0.38 dollar.6. m5.12xlarge: $2.304 reported cost per hour, test consumed 6 Minutes, 57 Seconds: cost approximately 0.27 dollar.7. m5.4xlarge: $0.768 reported cost per hour, test consumed 6 Minutes, 53 Seconds: cost approximately 0.09 dollar.8. m5.large: $0.096 reported cost per hour, test consumed 6 Minutes, 47 Seconds: cost approximately 0.01 dollar.9. t2.2xlarge: $0.3712 reported cost per hour, test consumed 7 Minutes, 14 Seconds: cost approximately 0.04 dollar.

PyBench

Performance / Cost - Total For Average Test Times

OpenBenchmarking.orgMilliseconds x Dollar, Fewer Is BetterPyBench 2008-08-14Performance / Cost - Total For Average Test Timesc4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlarget2.2xlarge5010015020025082.15130.7758.36158.96239.04112.2832.7418.371. c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 54 Seconds: cost approximately 0.05 dollar.2. c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 41 Seconds: cost approximately 0.09 dollar.3. c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 42 Seconds: cost approximately 0.04 dollar.4. m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.08 dollar.5. m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 17 Seconds: cost approximately 0.12 dollar.6. m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 52 Seconds: cost approximately 0.07 dollar.7. m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.02 dollar.8. t2.2xlarge: $0.3712 reported cost per hour, test consumed 2 Minutes, 8 Seconds: cost approximately 0.01 dollar.

NGINX Benchmark

Performance / Cost - Static Web Page Serving

OpenBenchmarking.orgRequests Per Second Per Dollar, More Is BetterNGINX Benchmark 1.9.9Performance / Cost - Static Web Page Servingc4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge300K600K900K1200K1500K192423.08111905.59333322.44126937.0079298.15159720.25288009.861213251.00454381.001. c4.8xlarge: $1.591 reported cost per hour, test consumed 4 Minutes, 37 Seconds: cost approximately 0.12 dollar.2. c5.18xlarge: $3.06 reported cost per hour, test consumed 4 Minutes, 22 Seconds: cost approximately 0.22 dollar.3. c5.9xlarge: $1.53 reported cost per hour, test consumed 3 Minutes, 37 Seconds: cost approximately 0.09 dollar.4. m4.10xlarge: $2.00 reported cost per hour, test consumed 4 Minutes, 57 Seconds: cost approximately 0.17 dollar.5. m4.16xlarge: $3.20 reported cost per hour, test consumed 5 Minutes: cost approximately 0.27 dollar.6. m5.12xlarge: $2.304 reported cost per hour, test consumed 4 Minutes, 12 Seconds: cost approximately 0.16 dollar.7. m5.4xlarge: $0.768 reported cost per hour, test consumed 5 Minutes, 16 Seconds: cost approximately 0.07 dollar.8. m5.large: $0.096 reported cost per hour, test consumed 8 Minutes, 35 Seconds: cost approximately 0.01 dollar.9. t2.2xlarge: $0.3712 reported cost per hour, test consumed 5 Minutes, 50 Seconds: cost approximately 0.04 dollar.

PyBench

Total For Average Test Times

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyBench 2018-02-16Total For Average Test Timesc4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge5001000150020002500SE +/- 8.66, N = 3SE +/- 3.53, N = 3SE +/- 3.48, N = 3SE +/- 4.16, N = 3SE +/- 2.40, N = 3SE +/- 4.51, N = 3SE +/- 3.84, N = 3SE +/- 14.67, N = 3SE +/- 0.33, N = 3181916091607222522391777179217212044

PyBench

Performance / Cost - Total For Average Test Times

OpenBenchmarking.orgMilliseconds x Dollar, Fewer Is BetterPyBench 2018-02-16Performance / Cost - Total For Average Test Timesc4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlarget2.2xlarge70140210280350109.14160.9080.35200.25313.46142.1653.7620.441. c4.8xlarge: $1.591 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.06 dollar.2. c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 53 Seconds: cost approximately 0.1 dollar.3. c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 53 Seconds: cost approximately 0.05 dollar.4. m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 35 Seconds: cost approximately 0.09 dollar.5. m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 36 Seconds: cost approximately 0.14 dollar.6. m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 5 Seconds: cost approximately 0.08 dollar.7. m5.4xlarge: $0.768 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.03 dollar.8. t2.2xlarge: $0.3712 reported cost per hour, test consumed 2 Minutes, 24 Seconds: cost approximately 0.01 dollar.

Scikit-Learn

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 0.17.1c4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge50100150200250SE +/- 0.56, N = 3SE +/- 0.17, N = 3SE +/- 0.05, N = 3SE +/- 1.48, N = 3SE +/- 0.14, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 9.88, N = 3SE +/- 0.08, N = 3164.09190.52190.08191.67182.92204.55211.86214.77179.03

Scikit-Learn

Performance / Cost -

OpenBenchmarking.orgSeconds x Dollar, Fewer Is BetterScikit-Learn 0.17.1Performance / Cost -c4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge2040608010036.1093.3545.6261.3389.6379.7729.664.3010.741. c4.8xlarge: $1.591 reported cost per hour, test consumed 8 Minutes, 17 Seconds: cost approximately 0.22 dollar.2. c5.18xlarge: $3.06 reported cost per hour, test consumed 9 Minutes, 36 Seconds: cost approximately 0.49 dollar.3. c5.9xlarge: $1.53 reported cost per hour, test consumed 9 Minutes, 35 Seconds: cost approximately 0.24 dollar.4. m4.10xlarge: $2.00 reported cost per hour, test consumed 9 Minutes, 39 Seconds: cost approximately 0.32 dollar.5. m4.16xlarge: $3.20 reported cost per hour, test consumed 9 Minutes, 13 Seconds: cost approximately 0.49 dollar.6. m5.12xlarge: $2.304 reported cost per hour, test consumed 10 Minutes, 17 Seconds: cost approximately 0.39 dollar.7. m5.4xlarge: $0.768 reported cost per hour, test consumed 10 Minutes, 40 Seconds: cost approximately 0.14 dollar.8. m5.large: $0.096 reported cost per hour, test consumed 10 Minutes, 49 Seconds: cost approximately 0.02 dollar.9. t2.2xlarge: $0.3712 reported cost per hour, test consumed 9 Minutes, 2 Seconds: cost approximately 0.06 dollar.

AOBench

Size: 2048 x 2048 - Total Time

OpenBenchmarking.orgSeconds, Fewer Is BetterAOBenchSize: 2048 x 2048 - Total Timec4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge1530456075SE +/- 0.11, N = 3SE +/- 0.12, N = 3SE +/- 0.38, N = 3SE +/- 0.20, N = 3SE +/- 1.04, N = 3SE +/- 1.07, N = 3SE +/- 0.16, N = 3SE +/- 0.50, N = 3SE +/- 0.04, N = 355.3958.4258.7067.2464.5666.2165.4865.5162.181. (CC) gcc options: -lm -O3

AOBench

Performance / Cost - Size: 2048 x 2048 - Total Time

OpenBenchmarking.orgSeconds x Dollar, Fewer Is BetterAOBenchPerformance / Cost - Size: 2048 x 2048 - Total Timec4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge36912154.438.764.707.4011.628.612.620.661.241. c4.8xlarge: $1.591 reported cost per hour, test consumed 2 Minutes, 50 Seconds: cost approximately 0.08 dollar.2. c5.18xlarge: $3.06 reported cost per hour, test consumed 2 Minutes, 59 Seconds: cost approximately 0.15 dollar.3. c5.9xlarge: $1.53 reported cost per hour, test consumed 3 Minutes: cost approximately 0.08 dollar.4. m4.10xlarge: $2.00 reported cost per hour, test consumed 3 Minutes, 26 Seconds: cost approximately 0.11 dollar.5. m4.16xlarge: $3.20 reported cost per hour, test consumed 3 Minutes, 18 Seconds: cost approximately 0.18 dollar.6. m5.12xlarge: $2.304 reported cost per hour, test consumed 3 Minutes, 22 Seconds: cost approximately 0.13 dollar.7. m5.4xlarge: $0.768 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.04 dollar.8. m5.large: $0.096 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.01 dollar.9. t2.2xlarge: $0.3712 reported cost per hour, test consumed 3 Minutes, 11 Seconds: cost approximately 0.02 dollar.

Crafty

Elapsed Time

OpenBenchmarking.orgNodes Per Second, More Is BetterCrafty 25.2Elapsed Timec4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge1.5M3M4.5M6M7.5MSE +/- 24158.72, N = 3SE +/- 7074.19, N = 3SE +/- 7226.78, N = 3SE +/- 24686.39, N = 3SE +/- 14246.76, N = 3SE +/- 2343.50, N = 3SE +/- 7362.69, N = 3SE +/- 87880.44, N = 3SE +/- 3484.54, N = 36480104697494269688015369651537806263725966023992569157958240451. (CC) gcc options: -lstdc++ -fprofile-use -pthread -lm

Crafty

Performance / Cost - Elapsed Time

OpenBenchmarking.orgNodes Per Second Per Dollar, More Is BetterCrafty 25.2Performance / Cost - Elapsed Timec4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlarget2.2xlarge120M240M360M480M600M162002600.0087186775.00174220025.0089494183.3353780620.00106209933.33301199600.00582404500.001. c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 36 Seconds: cost approximately 0.04 dollar.2. c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 29 Seconds: cost approximately 0.08 dollar.3. c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 29 Seconds: cost approximately 0.04 dollar.4. m4.10xlarge: $2.00 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.06 dollar.5. m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 54 Seconds: cost approximately 0.1 dollar.6. m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 37 Seconds: cost approximately 0.06 dollar.7. m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 43 Seconds: cost approximately 0.02 dollar.8. t2.2xlarge: $0.3712 reported cost per hour, test consumed 1 Minute, 49 Seconds: cost approximately 0.01 dollar.

Parboil

Performance / Cost - Test: OpenMP CUTCP

OpenBenchmarking.orgSeconds x Dollar, Fewer Is BetterParboil 2.5Performance / Cost - Test: OpenMP CUTCPc4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.large0.22050.4410.66150.8821.10250.040.040.060.050.030.060.160.981. c4.8xlarge: $1.591 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar.2. c5.18xlarge: $3.06 reported cost per hour, test consumed 16 Seconds: cost approximately 0.01 dollar.3. c5.9xlarge: $1.53 reported cost per hour, test consumed 22 Seconds: cost approximately 0.01 dollar.4. m4.10xlarge: $2.00 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar.5. m4.16xlarge: $3.20 reported cost per hour, test consumed 14 Seconds: cost approximately 0.01 dollar.6. m5.12xlarge: $2.304 reported cost per hour, test consumed 21 Seconds: cost approximately 0.01 dollar.7. m5.4xlarge: $0.768 reported cost per hour, test consumed 53 Seconds: cost approximately 0.01 dollar.8. m5.large: $0.096 reported cost per hour, test consumed 4 Minutes, 58 Seconds: cost approximately 0.01 dollar.

Cost To Run Tests

Cost / Price Per Hour

OpenBenchmarking.orgCost / Price Per Hour, Fewer Is BetterCost To Run TestsCost / Price Per Hourc4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.large0.63231.26461.89692.52923.16151.352.431.281.862.812.000.890.341. c4.8xlarge: $1.591 reported cost per hour, running tests consumed 50 Minutes, 46 Seconds: cost approximately 1.35 dollar. 2. c5.18xlarge: $3.06 reported cost per hour, running tests consumed 47 Minutes, 35 Seconds: cost approximately 2.43 dollar. 3. c5.9xlarge: $1.53 reported cost per hour, running tests consumed 50 Minutes, 21 Seconds: cost approximately 1.28 dollar. 4. m4.10xlarge: $2.00 reported cost per hour, running tests consumed 55 Minutes, 55 Seconds: cost approximately 1.86 dollar. 5. m4.16xlarge: $3.20 reported cost per hour, running tests consumed 52 Minutes, 42 Seconds: cost approximately 2.81 dollar. 6. m5.12xlarge: $2.304 reported cost per hour, running tests consumed 52 Minutes, 9 Seconds: cost approximately 2 dollar. 7. m5.4xlarge: $0.768 reported cost per hour, running tests consumed 1 Hour, 9 Minutes, 15 Seconds: cost approximately 0.89 dollar. 8. m5.large: $0.096 reported cost per hour, running tests consumed 3 Hours, 30 Minutes, 28 Seconds: cost approximately 0.34 dollar.

Timed MAFFT Alignment

Performance / Cost - Multiple Sequence Alignment

OpenBenchmarking.orgSeconds x Dollar, Fewer Is BetterTimed MAFFT Alignment 6.864Performance / Cost - Multiple Sequence Alignmentc4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlarge0.06080.12160.18240.24320.3040.040.040.030.060.270.031. c4.8xlarge: $1.591 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar.2. c5.18xlarge: $3.06 reported cost per hour, test consumed 17 Seconds: cost approximately 0.01 dollar.3. c5.9xlarge: $1.53 reported cost per hour, test consumed 12 Seconds: cost approximately 0.01 dollar.4. m4.10xlarge: $2.00 reported cost per hour, test consumed 21 Seconds: cost approximately 0.01 dollar.5. m4.16xlarge: $3.20 reported cost per hour, test consumed 31 Seconds: cost approximately 0.03 dollar.6. m5.12xlarge: $2.304 reported cost per hour, test consumed 14 Seconds: cost approximately 0.01 dollar.

Phoronix Test Suite v10.8.4