Amazon EC2 Cloud Linux Benchmarks

Benchmarks of Amazon EC2 cloud public on-demand instance types. Tests being worked on by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/1802203-FO-CLOUDTYPE77&sor.

Amazon EC2 Cloud Linux BenchmarksProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemSystem Layerc4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge2 x Intel Xeon E5-2666 v3 @ 3.50GHz (18 Cores / 36 Threads)Xen HVM domU (4.2.amazon BIOS)Intel 440FX- 82441FX PMC60416MB28GBCirrus Logic GD 5446Intel 82599 Virtual FunctionUbuntu 16.044.4.0-1050-aws (x86_64)GCC 5.4.0 20160609ext4Xen HVM domU 4.2.amazon2 x Intel Xeon Platinum 8124M @ 3.00GHz (36 Cores / 72 Threads)Amazon EC2 c5.18xlarge (1.0 BIOS)141312MB30GB Amazon Elastic Block StoreDevice 1d0f:ec20KVMIntel Xeon Platinum 8124M @ 3.00GHz (18 Cores / 36 Threads)Amazon EC2 c5.9xlarge (1.0 BIOS)70656MB2 x Intel Xeon E5-2676 v3 @ 3.00GHz (20 Cores / 40 Threads)Xen HVM domU (4.2.amazon BIOS)161792MB28GBCirrus Logic GD 5446Intel 82599 Virtual FunctionXen HVM domU 4.2.amazon2 x Intel Xeon E5-2686 v4 @ 3.00GHz (32 Cores / 64 Threads)258048MBDevice 1d0f:ec20Intel Xeon Platinum 8175M @ 2.50GHz (24 Cores / 48 Threads)Amazon EC2 m5.12xlarge (1.0 BIOS)189440MB30GB Amazon Elastic Block StoreKVMIntel Xeon Platinum 8175M @ 2.50GHz (8 Cores / 16 Threads)Amazon EC2 m5.4xlarge (1.0 BIOS)63488MBIntel Xeon Platinum 8175M @ 2.50GHz (1 Core / 2 Threads)Amazon EC2 m5.large (1.0 BIOS)8192MBIntel Xeon E5-2676 v3 @ 2.39GHz (8 Cores)Xen HVM domU (4.2.amazon BIOS)32768MB28GBCirrus Logic GD 5446Xen HVM domU 4.2.amazonOpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-browser-plugin --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libmpx --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-arch-directory=amd64 --with-default-libstdcxx-abi=new --with-multilib-list=m32,m64,mx32 --with-tune=generic -v Processor Details- c4.8xlarge, m4.10xlarge, m4.16xlarge: Scaling Governor: intel_pstate powersavePython Details- Python 2.7.12 + Python 3.5.2Security Details- KPTI ProtectionKernel Details- c5.18xlarge, c5.9xlarge, m5.12xlarge, m5.4xlarge, m5.large: nvme.io_timeout=4294967295

Amazon EC2 Cloud Linux Benchmarksnpb: EP.Cparboil: OpenMP CUTCProdinia: OpenMP LavaMDmafft: Multiple Sequence Alignmentjohn-the-ripper: Blowfishnero2d: Total Timettsiod-renderer: Phong Rendering With Soft-Shadow Mappingx264: H.264 Video Encodingcompress-7zip: Compress Speed Testbuild-linux-kernel: Time To Compilec-ray: Total Timepovray: Trace Timeencode-mp3: WAV To MP3openssl: RSA 4096-bit Performancejava-jmh: Throughputpybench: Total For Average Test Timesnginx: Static Web Page Servingpybench: Total For Average Test Timesscikit-learn: aobench: 2048 x 2048 - Total Timecrafty: Elapsed Timec4.8xlargec5.18xlargec5.9xlargem4.10xlargem4.16xlargem5.12xlargem5.4xlargem5.larget2.2xlarge673.144.3952.794.422534136.91419.30107.997808743.516.0935.0837.622579.5756603426109.55164323090.771819164.0955.3964801042512.813.7522.774.236030532.19336.76176.0316082224.485.7217.7435.629303.67121829911181.01145324619.231609190.5258.4269749421256.196.1744.562.723059360.15460.27134.109193337.9911.0032.3535.634671.5060940889045.98145929999.021607190.0858.706968801627.624.6356.595.782363241.18394.5297.437576245.916.4637.4445.512410.5752821381652.06198721579.292225191.6767.2453696511034.943.1834.108.843909126.13465.90115.3411559833.904.1624.1245.223962.6784002323902.87199221410.502239182.9264.5653780621385.495.8039.533.183706948.78504.82129.6611269935.619.9429.8743.575669.1374086333554.07160425555.241777204.5566.216372596459.3516.11115.204.3512094115.44184.8355.463664285.7729.4887.1043.901860.9324447443003.95163720160.691792211.8665.48602399260.9998.07828.9720.001562534.0826.8811.025090641.51152.07617.2841.09242.003178036199.44155912132.511721214.7765.515691579146.2011.46213.704.26606787.04231.0738.4323917106.8316.52563.3342.12174.834217431038.72183718175.242044179.0362.185824045OpenBenchmarking.org

NAS Parallel Benchmarks

Test / Class: EP.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.3Test / Class: EP.Cc5.18xlargem5.12xlargec5.9xlargem4.16xlargec4.8xlargem4.10xlargem5.4xlarget2.2xlargem5.large5001000150020002500SE +/- 29.39, N = 3SE +/- 1.50, N = 3SE +/- 19.93, N = 3SE +/- 1.06, N = 3SE +/- 3.43, N = 3SE +/- 0.96, N = 3SE +/- 1.09, N = 3SE +/- 0.08, N = 3SE +/- 3.02, N = 32512.811385.491256.191034.94673.14627.62459.35146.2060.991. (F9X) gfortran options: -O3 -march=native -pthread -lmpi_usempif08 -lmpi_mpifh -lmpi2. Open MPI 1.10.2

Parboil

Test: OpenMP CUTCP

OpenBenchmarking.orgSeconds, Fewer Is BetterParboil 2.5Test: OpenMP CUTCPm4.16xlargec5.18xlargec4.8xlargem4.10xlargem5.12xlargec5.9xlarget2.2xlargem5.4xlargem5.large20406080100SE +/- 0.06, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 0.46, N = 33.183.754.394.635.806.1711.4616.1198.071. (CXX) g++ options: -lm -lpthread -lgomp -ffast-math -fopenmp

Rodinia

Test: OpenMP LavaMD

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 2.4Test: OpenMP LavaMDc5.18xlargem4.16xlargem5.12xlargec5.9xlargec4.8xlargem4.10xlargem5.4xlarget2.2xlargem5.large2004006008001000SE +/- 0.16, N = 3SE +/- 0.05, N = 3SE +/- 0.81, N = 3SE +/- 0.33, N = 3SE +/- 0.11, N = 3SE +/- 0.02, N = 3SE +/- 2.22, N = 3SE +/- 0.03, N = 3SE +/- 7.59, N = 322.7734.1039.5344.5652.7956.59115.20213.70828.971. (CXX) g++ options: -O2 -lOpenCL

Timed MAFFT Alignment

Multiple Sequence Alignment

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MAFFT Alignment 6.864Multiple Sequence Alignmentc5.9xlargem5.12xlargec5.18xlarget2.2xlargem5.4xlargec4.8xlargem4.10xlargem4.16xlargem5.large510152025SE +/- 0.05, N = 3SE +/- 0.13, N = 3SE +/- 0.21, N = 3SE +/- 0.01, N = 3SE +/- 0.24, N = 3SE +/- 0.15, N = 3SE +/- 0.59, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 32.723.184.234.264.354.425.788.8420.001. (CC) gcc options: -O3 -lm -lpthread

John The Ripper

Test: Blowfish

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 1.8.0Test: Blowfishc5.18xlargem4.16xlargem5.12xlargec5.9xlargec4.8xlargem4.10xlargem5.4xlarget2.2xlargem5.large13K26K39K52K65KSE +/- 33.25, N = 3SE +/- 193.12, N = 3SE +/- 41.59, N = 3SE +/- 26.19, N = 3SE +/- 40.45, N = 3SE +/- 16.00, N = 3SE +/- 21.00, N = 3SE +/- 23.86, N = 360305390913706930593253412363212094606715621. (CC) gcc options: -fopenmp -lcrypt

Open FMM Nero2D

Total Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpen FMM Nero2D 2.0.2Total Timem4.16xlargec5.18xlargec4.8xlargem4.10xlargem5.12xlargec5.9xlarget2.2xlargem5.4xlargem5.large120240360480600SE +/- 0.13, N = 3SE +/- 4.84, N = 3SE +/- 0.13, N = 3SE +/- 0.80, N = 3SE +/- 7.90, N = 3SE +/- 0.96, N = 3SE +/- 0.42, N = 3SE +/- 5.00, N = 3SE +/- 8.89, N = 326.1332.1936.9141.1848.7860.1587.04115.44534.081. (CXX) g++ options: -O2 -lfftw3 -llapack -lblas -lgfortran -lquadmath -lm -pthread -lmpi_cxx -lmpi

TTSIOD 3D Renderer

Phong Rendering With Soft-Shadow Mapping

OpenBenchmarking.orgFPS, More Is BetterTTSIOD 3D Renderer 2.3aPhong Rendering With Soft-Shadow Mappingm5.12xlargem4.16xlargec5.9xlargec4.8xlargem4.10xlargec5.18xlarget2.2xlargem5.4xlargem5.large110220330440550SE +/- 4.78, N = 3SE +/- 20.68, N = 3SE +/- 4.23, N = 3SE +/- 3.14, N = 3SE +/- 3.29, N = 3SE +/- 12.51, N = 3SE +/- 0.39, N = 3SE +/- 0.49, N = 3SE +/- 2.30, N = 3504.82465.90460.27419.30394.52336.76231.07184.8326.881. (CXX) g++ options: -O3 -fomit-frame-pointer -ffast-math -mtune=native -flto -msse -mrecip -mfpmath=sse -msse2 -mssse3 -lSDL -lstdc++

x264

H.264 Video Encoding

OpenBenchmarking.orgFrames Per Second, More Is Betterx264 2018-02-05H.264 Video Encodingc5.18xlargec5.9xlargem5.12xlargem4.16xlargec4.8xlargem4.10xlargem5.4xlarget2.2xlargem5.large4080120160200SE +/- 1.46, N = 3SE +/- 0.49, N = 3SE +/- 0.28, N = 3SE +/- 1.25, N = 3SE +/- 0.30, N = 3SE +/- 0.19, N = 3SE +/- 0.55, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3176.03134.10129.66115.34107.9997.4355.4638.4311.021. (CC) gcc options: -ldl -m64 -lm -lpthread -O3 -ffast-math -std=gnu99 -fPIC -fomit-frame-pointer -fno-tree-vectorize

7-Zip Compression

Compress Speed Test

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 9.20.1Compress Speed Testc5.18xlargem4.16xlargem5.12xlargec5.9xlargec4.8xlargem4.10xlargem5.4xlarget2.2xlargem5.large30K60K90K120K150KSE +/- 319.70, N = 3SE +/- 482.44, N = 3SE +/- 480.06, N = 3SE +/- 226.61, N = 3SE +/- 380.57, N = 3SE +/- 280.19, N = 3SE +/- 282.94, N = 3SE +/- 86.00, N = 3SE +/- 28.62, N = 3160822115598112699919337808775762366422391750901. (CXX) g++ options: -pipe -lpthread

Timed Linux Kernel Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 4.13Time To Compilec5.18xlargem4.16xlargem5.12xlargec5.9xlargec4.8xlargem4.10xlargem5.4xlarget2.2xlargem5.large140280420560700SE +/- 1.47, N = 3SE +/- 1.14, N = 3SE +/- 1.57, N = 3SE +/- 1.57, N = 3SE +/- 1.05, N = 3SE +/- 1.16, N = 3SE +/- 1.41, N = 3SE +/- 0.79, N = 3SE +/- 46.62, N = 324.4833.9035.6137.9943.5145.9185.77106.83641.51

C-Ray

Total Time

OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 1.1Total Timem4.16xlargec5.18xlargec4.8xlargem4.10xlargem5.12xlargec5.9xlarget2.2xlargem5.4xlargem5.large306090120150SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 5.71, N = 34.165.726.096.469.9411.0016.5229.48152.071. (CC) gcc options: -lm -lpthread -O3

POV-Ray

Trace Time

OpenBenchmarking.orgSeconds, Fewer Is BetterPOV-Ray 3.7.0.7Trace Timec5.18xlargem4.16xlargem5.12xlargec5.9xlargec4.8xlargem4.10xlargem5.4xlarget2.2xlargem5.large130260390520650SE +/- 0.13, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.18, N = 3SE +/- 0.14, N = 3SE +/- 0.02, N = 3SE +/- 0.14, N = 3SE +/- 29.42, N = 3SE +/- 40.66, N = 317.7424.1229.8732.3535.0837.4487.10563.33617.281. (CXX) g++ options: -pipe -O3 -ffast-math -march=native -pthread -lSDL -lSM -lICE -lX11 -ltiff -ljpeg -lpng -lz -lrt -lm -lboost_thread -lboost_system

LAME MP3 Encoding

WAV To MP3

OpenBenchmarking.orgSeconds, Fewer Is BetterLAME MP3 Encoding 3.100WAV To MP3c5.18xlargec5.9xlargec4.8xlargem5.larget2.2xlargem5.12xlargem5.4xlargem4.16xlargem4.10xlarge1020304050SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 1.71, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.17, N = 3SE +/- 0.08, N = 335.6235.6337.6241.0942.1243.5743.9045.2245.511. (CC) gcc options: -lm

OpenSSL

RSA 4096-bit Performance

OpenBenchmarking.orgSigns Per Second, More Is BetterOpenSSL 1.1.0fRSA 4096-bit Performancec5.18xlargem5.12xlargec5.9xlargem4.16xlargec4.8xlargem4.10xlargem5.4xlargem5.larget2.2xlarge2K4K6K8K10KSE +/- 19.65, N = 3SE +/- 13.34, N = 3SE +/- 1.27, N = 3SE +/- 4.00, N = 3SE +/- 2.55, N = 3SE +/- 2.05, N = 3SE +/- 2.33, N = 3SE +/- 0.95, N = 3SE +/- 1.37, N = 39303.675669.134671.503962.672579.572410.571860.93242.00174.831. (CC) gcc options: -O3 -pthread -m64 -lssl -lcrypto -ldl

Java JMH

Throughput

OpenBenchmarking.orgOps/s, More Is BetterJava JMHThroughputc5.18xlargem4.16xlargem5.12xlargec5.9xlargec4.8xlargem4.10xlargem5.4xlarget2.2xlargem5.large30000M60000M90000M120000M150000M121829911181.0184002323902.8774086333554.0760940889045.9856603426109.5552821381652.0624447443003.954217431038.723178036199.44

PyBench

Total For Average Test Times

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyBench 2008-08-14Total For Average Test Timesc5.18xlargec5.9xlargem5.largem5.12xlargem5.4xlargec4.8xlarget2.2xlargem4.10xlargem4.16xlarge400800120016002000SE +/- 7.42, N = 3SE +/- 4.41, N = 3SE +/- 2.03, N = 3SE +/- 11.46, N = 3SE +/- 8.33, N = 3SE +/- 6.00, N = 3SE +/- 4.91, N = 3SE +/- 6.23, N = 3145314591559160416371643183719871992

NGINX Benchmark

Static Web Page Serving

OpenBenchmarking.orgRequests Per Second, More Is BetterNGINX Benchmark 1.9.9Static Web Page Servingc5.9xlargem5.12xlargec5.18xlargec4.8xlargem4.10xlargem4.16xlargem5.4xlarget2.2xlargem5.large6K12K18K24K30KSE +/- 54.82, N = 3SE +/- 146.75, N = 3SE +/- 78.50, N = 3SE +/- 451.84, N = 3SE +/- 101.19, N = 3SE +/- 279.06, N = 3SE +/- 92.03, N = 3SE +/- 798.70, N = 3SE +/- 188.83, N = 329999.0225555.2424619.2323090.7721579.2921410.5020160.6918175.2412132.511. (CC) gcc options: -lpthread -lcrypt -lcrypto -lz -O3 -march=native

NAS Parallel Benchmarks

Performance / Cost - Test / Class: EP.C

OpenBenchmarking.orgTotal Mop/s Per Dollar, More Is BetterNAS Parallel Benchmarks 3.3Performance / Cost - Test / Class: EP.Cc5.18xlargec5.9xlargem5.12xlargem5.4xlargem4.16xlargec4.8xlargem4.10xlarget2.2xlargem5.large50K100K150K200K250K251281.00125619.0069274.5045935.0034498.0033657.0020920.677310.006099.001. c5.18xlarge: $3.06 reported cost per hour, test consumed 16 Seconds: cost approximately 0.01 dollar.2. c5.9xlarge: $1.53 reported cost per hour, test consumed 26 Seconds: cost approximately 0.01 dollar.3. m5.12xlarge: $2.304 reported cost per hour, test consumed 24 Seconds: cost approximately 0.02 dollar.4. m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute: cost approximately 0.01 dollar.5. m4.16xlarge: $3.20 reported cost per hour, test consumed 30 Seconds: cost approximately 0.03 dollar.6. c4.8xlarge: $1.591 reported cost per hour, test consumed 43 Seconds: cost approximately 0.02 dollar.7. m4.10xlarge: $2.00 reported cost per hour, test consumed 47 Seconds: cost approximately 0.03 dollar.8. t2.2xlarge: $0.3712 reported cost per hour, test consumed 3 Minutes, 1 Second: cost approximately 0.02 dollar.9. m5.large: $0.096 reported cost per hour, test consumed 7 Minutes, 9 Seconds: cost approximately 0.01 dollar.

Rodinia

Performance / Cost - Test: OpenMP LavaMD

OpenBenchmarking.orgSeconds x Dollar, Fewer Is BetterRodinia 2.4Performance / Cost - Test: OpenMP LavaMDc5.18xlargec5.9xlargem5.12xlargem4.16xlargec4.8xlargem4.10xlargem5.4xlarget2.2xlargem5.large13263952651.372.673.163.413.705.668.0614.9658.031. c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 12 Seconds: cost approximately 0.06 dollar.2. c5.9xlarge: $1.53 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.06 dollar.3. m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 3 Seconds: cost approximately 0.08 dollar.4. m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 47 Seconds: cost approximately 0.1 dollar.5. c4.8xlarge: $1.591 reported cost per hour, test consumed 2 Minutes, 42 Seconds: cost approximately 0.07 dollar.6. m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 54 Seconds: cost approximately 0.1 dollar.7. m5.4xlarge: $0.768 reported cost per hour, test consumed 5 Minutes, 50 Seconds: cost approximately 0.07 dollar.8. t2.2xlarge: $0.3712 reported cost per hour, test consumed 10 Minutes, 46 Seconds: cost approximately 0.07 dollar.9. m5.large: $0.096 reported cost per hour, test consumed 41 Minutes, 30 Seconds: cost approximately 0.07 dollar.

John The Ripper

Performance / Cost - Test: Blowfish

OpenBenchmarking.orgReal C/S Per Dollar, More Is BetterJohn The Ripper 1.8.0Performance / Cost - Test: Blowfishc5.18xlargec5.9xlarget2.2xlargem5.4xlargem5.12xlargec4.8xlargem4.16xlargem4.10xlargem5.large80K160K240K320K400K354735.29339922.22303350.00302350.00285146.15281566.67217172.22214836.36156200.001. c5.18xlarge: $3.06 reported cost per hour, test consumed 3 Minutes, 22 Seconds: cost approximately 0.17 dollar.2. c5.9xlarge: $1.53 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.09 dollar.3. t2.2xlarge: $0.3712 reported cost per hour, test consumed 3 Minutes, 19 Seconds: cost approximately 0.02 dollar.4. m5.4xlarge: $0.768 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.04 dollar.5. m5.12xlarge: $2.304 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.13 dollar.6. c4.8xlarge: $1.591 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.09 dollar.7. m4.16xlarge: $3.20 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.18 dollar.8. m4.10xlarge: $2.00 reported cost per hour, test consumed 3 Minutes, 22 Seconds: cost approximately 0.11 dollar.9. m5.large: $0.096 reported cost per hour, test consumed 3 Minutes, 20 Seconds: cost approximately 0.01 dollar.

Open FMM Nero2D

Performance / Cost - Total Time

OpenBenchmarking.orgSeconds x Dollar, Fewer Is BetterOpen FMM Nero2D 2.0.2Performance / Cost - Total Timem4.16xlargec4.8xlarget2.2xlargem4.10xlargec5.18xlargec5.9xlargem5.12xlargem5.4xlargem5.large5101520251.831.852.612.882.904.814.888.0821.361. m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 23 Seconds: cost approximately 0.07 dollar.2. c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.05 dollar.3. t2.2xlarge: $0.3712 reported cost per hour, test consumed 4 Minutes, 26 Seconds: cost approximately 0.03 dollar.4. m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.07 dollar.5. c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 40 Seconds: cost approximately 0.09 dollar.6. c5.9xlarge: $1.53 reported cost per hour, test consumed 3 Minutes, 5 Seconds: cost approximately 0.08 dollar.7. m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 30 Seconds: cost approximately 0.1 dollar.8. m5.4xlarge: $0.768 reported cost per hour, test consumed 5 Minutes, 51 Seconds: cost approximately 0.07 dollar.9. m5.large: $0.096 reported cost per hour, test consumed 26 Minutes, 47 Seconds: cost approximately 0.04 dollar.

TTSIOD 3D Renderer

Performance / Cost - Phong Rendering With Soft-Shadow Mapping

OpenBenchmarking.orgFPS Per Dollar, More Is BetterTTSIOD 3D Renderer 2.3aPerformance / Cost - Phong Rendering With Soft-Shadow Mappingt2.2xlargec5.9xlargem5.12xlargec4.8xlargem4.10xlargem4.16xlargem5.4xlargec5.18xlargem5.large5K10K15K20K25K23107.0023013.5016827.3313976.6713150.679318.009241.505612.671344.001. t2.2xlarge: $0.3712 reported cost per hour, test consumed 1 Minute, 26 Seconds: cost approximately 0.01 dollar.2. c5.9xlarge: $1.53 reported cost per hour, test consumed 53 Seconds: cost approximately 0.02 dollar.3. m5.12xlarge: $2.304 reported cost per hour, test consumed 50 Seconds: cost approximately 0.03 dollar.4. c4.8xlarge: $1.591 reported cost per hour, test consumed 58 Seconds: cost approximately 0.03 dollar.5. m4.10xlarge: $2.00 reported cost per hour, test consumed 1 Minute: cost approximately 0.03 dollar.6. m4.16xlarge: $3.20 reported cost per hour, test consumed 54 Seconds: cost approximately 0.05 dollar.7. m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 42 Seconds: cost approximately 0.02 dollar.8. c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 10 Seconds: cost approximately 0.06 dollar.9. m5.large: $0.096 reported cost per hour, test consumed 9 Minutes, 47 Seconds: cost approximately 0.02 dollar.

x264

Performance / Cost - H.264 Video Encoding

OpenBenchmarking.orgFrames Per Second Per Dollar, More Is Betterx264 2018-02-05Performance / Cost - H.264 Video Encodingc5.18xlargec5.9xlargem5.12xlargec4.8xlargem4.10xlargem4.16xlargem5.4xlarget2.2xlarge4K8K12K16K20K17603.0013410.0012966.0010799.009743.005767.005546.003843.001. c5.18xlarge: $3.06 reported cost per hour, test consumed 15 Seconds: cost approximately 0.01 dollar.2. c5.9xlarge: $1.53 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar.3. m5.12xlarge: $2.304 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar.4. c4.8xlarge: $1.591 reported cost per hour, test consumed 21 Seconds: cost approximately 0.01 dollar.5. m4.10xlarge: $2.00 reported cost per hour, test consumed 23 Seconds: cost approximately 0.01 dollar.6. m4.16xlarge: $3.20 reported cost per hour, test consumed 20 Seconds: cost approximately 0.02 dollar.7. m5.4xlarge: $0.768 reported cost per hour, test consumed 37 Seconds: cost approximately 0.01 dollar.8. t2.2xlarge: $0.3712 reported cost per hour, test consumed 51 Seconds: cost approximately 0.01 dollar.

7-Zip Compression

Performance / Cost - Compress Speed Test

OpenBenchmarking.orgMIPS Per Dollar, More Is Better7-Zip Compression 9.20.1Performance / Cost - Compress Speed Testt2.2xlargec5.9xlargem5.4xlargem5.12xlargec4.8xlargec5.18xlargem4.10xlargem4.16xlarge500K1000K1500K2000K2500K2391700.002298325.001832100.001609985.711561740.001462018.181082314.29770653.331. t2.2xlarge: $0.3712 reported cost per hour, test consumed 1 Minute, 14 Seconds: cost approximately 0.01 dollar.2. c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 39 Seconds: cost approximately 0.04 dollar.3. m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 38 Seconds: cost approximately 0.02 dollar.4. m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.07 dollar.5. c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 51 Seconds: cost approximately 0.05 dollar.6. c5.18xlarge: $3.06 reported cost per hour, test consumed 2 Minutes, 6 Seconds: cost approximately 0.11 dollar.7. m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 14 Seconds: cost approximately 0.07 dollar.8. m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 45 Seconds: cost approximately 0.15 dollar.

Timed Linux Kernel Compilation

Performance / Cost - Time To Compile

OpenBenchmarking.orgSeconds x Dollar, Fewer Is BetterTimed Linux Kernel Compilation 4.13Performance / Cost - Time To Compilec5.18xlargec5.9xlargem5.12xlargec4.8xlargem4.16xlargem4.10xlarget2.2xlargem5.4xlargem5.large7142128351.962.282.853.053.734.134.275.1532.081. c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 36 Seconds: cost approximately 0.08 dollar.2. c5.9xlarge: $1.53 reported cost per hour, test consumed 2 Minutes, 13 Seconds: cost approximately 0.06 dollar.3. m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 9 Seconds: cost approximately 0.08 dollar.4. c4.8xlarge: $1.591 reported cost per hour, test consumed 2 Minutes, 35 Seconds: cost approximately 0.07 dollar.5. m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 8 Seconds: cost approximately 0.11 dollar.6. m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 43 Seconds: cost approximately 0.09 dollar.7. t2.2xlarge: $0.3712 reported cost per hour, test consumed 5 Minutes, 41 Seconds: cost approximately 0.04 dollar.8. m5.4xlarge: $0.768 reported cost per hour, test consumed 4 Minutes, 41 Seconds: cost approximately 0.06 dollar.9. m5.large: $0.096 reported cost per hour, test consumed 32 Minutes, 29 Seconds: cost approximately 0.05 dollar.

C-Ray

Performance / Cost - Total Time

OpenBenchmarking.orgSeconds x Dollar, Fewer Is BetterC-Ray 1.1Performance / Cost - Total Timec4.8xlargem4.10xlargem4.16xlargec5.18xlarget2.2xlargem5.12xlargec5.9xlargem5.4xlargem5.large0.3420.6841.0261.3681.710.060.060.080.110.170.200.220.591.521. c4.8xlarge: $1.591 reported cost per hour, test consumed 23 Seconds: cost approximately 0.01 dollar.2. m4.10xlarge: $2.00 reported cost per hour, test consumed 23 Seconds: cost approximately 0.01 dollar.3. m4.16xlarge: $3.20 reported cost per hour, test consumed 17 Seconds: cost approximately 0.02 dollar.4. c5.18xlarge: $3.06 reported cost per hour, test consumed 21 Seconds: cost approximately 0.02 dollar.5. t2.2xlarge: $0.3712 reported cost per hour, test consumed 54 Seconds: cost approximately 0.01 dollar.6. m5.12xlarge: $2.304 reported cost per hour, test consumed 34 Seconds: cost approximately 0.02 dollar.7. c5.9xlarge: $1.53 reported cost per hour, test consumed 38 Seconds: cost approximately 0.02 dollar.8. m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 33 Seconds: cost approximately 0.02 dollar.9. m5.large: $0.096 reported cost per hour, test consumed 7 Minutes, 40 Seconds: cost approximately 0.01 dollar.

POV-Ray

Performance / Cost - Trace Time

OpenBenchmarking.orgSeconds x Dollar, Fewer Is BetterPOV-Ray 3.7.0.7Performance / Cost - Trace Timec5.18xlargec5.9xlargec4.8xlargem4.16xlargem5.12xlargem4.10xlargem5.4xlargem5.larget2.2xlarge204060801001.061.621.751.932.092.625.2330.86101.401. c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.06 dollar.2. c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 48 Seconds: cost approximately 0.05 dollar.3. c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 57 Seconds: cost approximately 0.05 dollar.4. m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 25 Seconds: cost approximately 0.08 dollar.5. m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 42 Seconds: cost approximately 0.07 dollar.6. m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 5 Seconds: cost approximately 0.07 dollar.7. m5.4xlarge: $0.768 reported cost per hour, test consumed 4 Minutes, 34 Seconds: cost approximately 0.06 dollar.8. m5.large: $0.096 reported cost per hour, test consumed 31 Minutes, 4 Seconds: cost approximately 0.05 dollar.9. t2.2xlarge: $0.3712 reported cost per hour, test consumed 28 Minutes, 22 Seconds: cost approximately 0.18 dollar.

LAME MP3 Encoding

Performance / Cost - WAV To MP3

OpenBenchmarking.orgSeconds x Dollar, Fewer Is BetterLAME MP3 Encoding 3.100Performance / Cost - WAV To MP3t2.2xlargem5.4xlargec5.9xlargec4.8xlargec5.18xlargem4.10xlargem5.12xlargem4.16xlarge1.22182.44363.66544.88726.1090.421.321.781.883.213.643.925.431. t2.2xlarge: $0.3712 reported cost per hour, test consumed 2 Minutes, 10 Seconds: cost approximately 0.01 dollar.2. m5.4xlarge: $0.768 reported cost per hour, test consumed 2 Minutes, 16 Seconds: cost approximately 0.03 dollar.3. c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 51 Seconds: cost approximately 0.05 dollar.4. c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 56 Seconds: cost approximately 0.05 dollar.5. c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 51 Seconds: cost approximately 0.09 dollar.6. m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 21 Seconds: cost approximately 0.08 dollar.7. m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 14 Seconds: cost approximately 0.09 dollar.8. m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 19 Seconds: cost approximately 0.12 dollar.

OpenSSL

Performance / Cost - RSA 4096-bit Performance

OpenBenchmarking.orgSigns Per Second Per Dollar, More Is BetterOpenSSL 1.1.0fPerformance / Cost - RSA 4096-bit Performancem5.4xlargec5.9xlargec5.18xlargem5.12xlargec4.8xlargem4.16xlargem4.10xlarget2.2xlarge40K80K120K160K200K186093.00155716.67155061.17141728.2585985.6766044.5060264.2517483.001. m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.01 dollar.2. c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.03 dollar.3. c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.06 dollar.4. m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.04 dollar.5. c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.03 dollar.6. m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 4 Seconds: cost approximately 0.06 dollar.7. m4.10xlarge: $2.00 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.04 dollar.8. t2.2xlarge: $0.3712 reported cost per hour, test consumed 1 Minute, 5 Seconds: cost approximately 0.01 dollar.

Java JMH

Performance / Cost - Throughput

OpenBenchmarking.orgOps/s Per Dollar, More Is BetterJava JMHPerformance / Cost - Throughputc5.9xlargec5.18xlargem5.largec4.8xlargem5.12xlargem5.4xlargem4.10xlargem4.16xlarget2.2xlarge70000M140000M210000M280000M350000M338560494699.89338416419947.25317803619944.00314463478386.39274393827978.04271638255599.44229658181095.91221058747112.82105435775968.001. c5.9xlarge: $1.53 reported cost per hour, test consumed 6 Minutes, 55 Seconds: cost approximately 0.18 dollar.2. c5.18xlarge: $3.06 reported cost per hour, test consumed 7 Minutes, 1 Second: cost approximately 0.36 dollar.3. m5.large: $0.096 reported cost per hour, test consumed 6 Minutes, 47 Seconds: cost approximately 0.01 dollar.4. c4.8xlarge: $1.591 reported cost per hour, test consumed 6 Minutes, 58 Seconds: cost approximately 0.18 dollar.5. m5.12xlarge: $2.304 reported cost per hour, test consumed 6 Minutes, 57 Seconds: cost approximately 0.27 dollar.6. m5.4xlarge: $0.768 reported cost per hour, test consumed 6 Minutes, 53 Seconds: cost approximately 0.09 dollar.7. m4.10xlarge: $2.00 reported cost per hour, test consumed 6 Minutes, 59 Seconds: cost approximately 0.23 dollar.8. m4.16xlarge: $3.20 reported cost per hour, test consumed 7 Minutes, 4 Seconds: cost approximately 0.38 dollar.9. t2.2xlarge: $0.3712 reported cost per hour, test consumed 7 Minutes, 14 Seconds: cost approximately 0.04 dollar.

PyBench

Performance / Cost - Total For Average Test Times

OpenBenchmarking.orgMilliseconds x Dollar, Fewer Is BetterPyBench 2008-08-14Performance / Cost - Total For Average Test Timest2.2xlargem5.4xlargec5.9xlargec4.8xlargem5.12xlargec5.18xlargem4.10xlargem4.16xlarge5010015020025018.3732.7458.3682.15112.28130.77158.96239.041. t2.2xlarge: $0.3712 reported cost per hour, test consumed 2 Minutes, 8 Seconds: cost approximately 0.01 dollar.2. m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.02 dollar.3. c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 42 Seconds: cost approximately 0.04 dollar.4. c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 54 Seconds: cost approximately 0.05 dollar.5. m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 52 Seconds: cost approximately 0.07 dollar.6. c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 41 Seconds: cost approximately 0.09 dollar.7. m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 18 Seconds: cost approximately 0.08 dollar.8. m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 17 Seconds: cost approximately 0.12 dollar.

NGINX Benchmark

Performance / Cost - Static Web Page Serving

OpenBenchmarking.orgRequests Per Second Per Dollar, More Is BetterNGINX Benchmark 1.9.9Performance / Cost - Static Web Page Servingm5.larget2.2xlargec5.9xlargem5.4xlargec4.8xlargem5.12xlargem4.10xlargec5.18xlargem4.16xlarge300K600K900K1200K1500K1213251.00454381.00333322.44288009.86192423.08159720.25126937.00111905.5979298.151. m5.large: $0.096 reported cost per hour, test consumed 8 Minutes, 35 Seconds: cost approximately 0.01 dollar.2. t2.2xlarge: $0.3712 reported cost per hour, test consumed 5 Minutes, 50 Seconds: cost approximately 0.04 dollar.3. c5.9xlarge: $1.53 reported cost per hour, test consumed 3 Minutes, 37 Seconds: cost approximately 0.09 dollar.4. m5.4xlarge: $0.768 reported cost per hour, test consumed 5 Minutes, 16 Seconds: cost approximately 0.07 dollar.5. c4.8xlarge: $1.591 reported cost per hour, test consumed 4 Minutes, 37 Seconds: cost approximately 0.12 dollar.6. m5.12xlarge: $2.304 reported cost per hour, test consumed 4 Minutes, 12 Seconds: cost approximately 0.16 dollar.7. m4.10xlarge: $2.00 reported cost per hour, test consumed 4 Minutes, 57 Seconds: cost approximately 0.17 dollar.8. c5.18xlarge: $3.06 reported cost per hour, test consumed 4 Minutes, 22 Seconds: cost approximately 0.22 dollar.9. m4.16xlarge: $3.20 reported cost per hour, test consumed 5 Minutes: cost approximately 0.27 dollar.

PyBench

Total For Average Test Times

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyBench 2018-02-16Total For Average Test Timesc5.9xlargec5.18xlargem5.largem5.12xlargem5.4xlargec4.8xlarget2.2xlargem4.10xlargem4.16xlarge5001000150020002500SE +/- 3.48, N = 3SE +/- 3.53, N = 3SE +/- 14.67, N = 3SE +/- 4.51, N = 3SE +/- 3.84, N = 3SE +/- 8.66, N = 3SE +/- 0.33, N = 3SE +/- 4.16, N = 3SE +/- 2.40, N = 3160716091721177717921819204422252239

PyBench

Performance / Cost - Total For Average Test Times

OpenBenchmarking.orgMilliseconds x Dollar, Fewer Is BetterPyBench 2018-02-16Performance / Cost - Total For Average Test Timest2.2xlargem5.4xlargec5.9xlargec4.8xlargem5.12xlargec5.18xlargem4.10xlargem4.16xlarge7014021028035020.4453.7680.35109.14142.16160.90200.25313.461. t2.2xlarge: $0.3712 reported cost per hour, test consumed 2 Minutes, 24 Seconds: cost approximately 0.01 dollar.2. m5.4xlarge: $0.768 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.03 dollar.3. c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 53 Seconds: cost approximately 0.05 dollar.4. c4.8xlarge: $1.591 reported cost per hour, test consumed 2 Minutes, 7 Seconds: cost approximately 0.06 dollar.5. m5.12xlarge: $2.304 reported cost per hour, test consumed 2 Minutes, 5 Seconds: cost approximately 0.08 dollar.6. c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 53 Seconds: cost approximately 0.1 dollar.7. m4.10xlarge: $2.00 reported cost per hour, test consumed 2 Minutes, 35 Seconds: cost approximately 0.09 dollar.8. m4.16xlarge: $3.20 reported cost per hour, test consumed 2 Minutes, 36 Seconds: cost approximately 0.14 dollar.

Scikit-Learn

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 0.17.1c4.8xlarget2.2xlargem4.16xlargec5.9xlargec5.18xlargem4.10xlargem5.12xlargem5.4xlargem5.large50100150200250SE +/- 0.56, N = 3SE +/- 0.08, N = 3SE +/- 0.14, N = 3SE +/- 0.05, N = 3SE +/- 0.17, N = 3SE +/- 1.48, N = 3SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 9.88, N = 3164.09179.03182.92190.08190.52191.67204.55211.86214.77

Scikit-Learn

Performance / Cost -

OpenBenchmarking.orgSeconds x Dollar, Fewer Is BetterScikit-Learn 0.17.1Performance / Cost -m5.larget2.2xlargem5.4xlargec4.8xlargec5.9xlargem4.10xlargem5.12xlargem4.16xlargec5.18xlarge204060801004.3010.7429.6636.1045.6261.3379.7789.6393.351. m5.large: $0.096 reported cost per hour, test consumed 10 Minutes, 49 Seconds: cost approximately 0.02 dollar.2. t2.2xlarge: $0.3712 reported cost per hour, test consumed 9 Minutes, 2 Seconds: cost approximately 0.06 dollar.3. m5.4xlarge: $0.768 reported cost per hour, test consumed 10 Minutes, 40 Seconds: cost approximately 0.14 dollar.4. c4.8xlarge: $1.591 reported cost per hour, test consumed 8 Minutes, 17 Seconds: cost approximately 0.22 dollar.5. c5.9xlarge: $1.53 reported cost per hour, test consumed 9 Minutes, 35 Seconds: cost approximately 0.24 dollar.6. m4.10xlarge: $2.00 reported cost per hour, test consumed 9 Minutes, 39 Seconds: cost approximately 0.32 dollar.7. m5.12xlarge: $2.304 reported cost per hour, test consumed 10 Minutes, 17 Seconds: cost approximately 0.39 dollar.8. m4.16xlarge: $3.20 reported cost per hour, test consumed 9 Minutes, 13 Seconds: cost approximately 0.49 dollar.9. c5.18xlarge: $3.06 reported cost per hour, test consumed 9 Minutes, 36 Seconds: cost approximately 0.49 dollar.

AOBench

Size: 2048 x 2048 - Total Time

OpenBenchmarking.orgSeconds, Fewer Is BetterAOBenchSize: 2048 x 2048 - Total Timec4.8xlargec5.18xlargec5.9xlarget2.2xlargem4.16xlargem5.4xlargem5.largem5.12xlargem4.10xlarge1530456075SE +/- 0.11, N = 3SE +/- 0.12, N = 3SE +/- 0.38, N = 3SE +/- 0.04, N = 3SE +/- 1.04, N = 3SE +/- 0.16, N = 3SE +/- 0.50, N = 3SE +/- 1.07, N = 3SE +/- 0.20, N = 355.3958.4258.7062.1864.5665.4865.5166.2167.241. (CC) gcc options: -lm -O3

AOBench

Performance / Cost - Size: 2048 x 2048 - Total Time

OpenBenchmarking.orgSeconds x Dollar, Fewer Is BetterAOBenchPerformance / Cost - Size: 2048 x 2048 - Total Timem5.larget2.2xlargem5.4xlargec4.8xlargec5.9xlargem4.10xlargem5.12xlargec5.18xlargem4.16xlarge36912150.661.242.624.434.707.408.618.7611.621. m5.large: $0.096 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.01 dollar.2. t2.2xlarge: $0.3712 reported cost per hour, test consumed 3 Minutes, 11 Seconds: cost approximately 0.02 dollar.3. m5.4xlarge: $0.768 reported cost per hour, test consumed 3 Minutes, 21 Seconds: cost approximately 0.04 dollar.4. c4.8xlarge: $1.591 reported cost per hour, test consumed 2 Minutes, 50 Seconds: cost approximately 0.08 dollar.5. c5.9xlarge: $1.53 reported cost per hour, test consumed 3 Minutes: cost approximately 0.08 dollar.6. m4.10xlarge: $2.00 reported cost per hour, test consumed 3 Minutes, 26 Seconds: cost approximately 0.11 dollar.7. m5.12xlarge: $2.304 reported cost per hour, test consumed 3 Minutes, 22 Seconds: cost approximately 0.13 dollar.8. c5.18xlarge: $3.06 reported cost per hour, test consumed 2 Minutes, 59 Seconds: cost approximately 0.15 dollar.9. m4.16xlarge: $3.20 reported cost per hour, test consumed 3 Minutes, 18 Seconds: cost approximately 0.18 dollar.

Crafty

Elapsed Time

OpenBenchmarking.orgNodes Per Second, More Is BetterCrafty 25.2Elapsed Timec5.18xlargec5.9xlargec4.8xlargem5.12xlargem5.4xlarget2.2xlargem5.largem4.16xlargem4.10xlarge1.5M3M4.5M6M7.5MSE +/- 7074.19, N = 3SE +/- 7226.78, N = 3SE +/- 24158.72, N = 3SE +/- 2343.50, N = 3SE +/- 7362.69, N = 3SE +/- 3484.54, N = 3SE +/- 87880.44, N = 3SE +/- 14246.76, N = 3SE +/- 24686.39, N = 36974942696880164801046372596602399258240455691579537806253696511. (CC) gcc options: -lstdc++ -fprofile-use -pthread -lm

Crafty

Performance / Cost - Elapsed Time

OpenBenchmarking.orgNodes Per Second Per Dollar, More Is BetterCrafty 25.2Performance / Cost - Elapsed Timet2.2xlargem5.4xlargec5.9xlargec4.8xlargem5.12xlargem4.10xlargec5.18xlargem4.16xlarge120M240M360M480M600M582404500.00301199600.00174220025.00162002600.00106209933.3389494183.3387186775.0053780620.001. t2.2xlarge: $0.3712 reported cost per hour, test consumed 1 Minute, 49 Seconds: cost approximately 0.01 dollar.2. m5.4xlarge: $0.768 reported cost per hour, test consumed 1 Minute, 43 Seconds: cost approximately 0.02 dollar.3. c5.9xlarge: $1.53 reported cost per hour, test consumed 1 Minute, 29 Seconds: cost approximately 0.04 dollar.4. c4.8xlarge: $1.591 reported cost per hour, test consumed 1 Minute, 36 Seconds: cost approximately 0.04 dollar.5. m5.12xlarge: $2.304 reported cost per hour, test consumed 1 Minute, 37 Seconds: cost approximately 0.06 dollar.6. m4.10xlarge: $2.00 reported cost per hour, test consumed 1 Minute, 55 Seconds: cost approximately 0.06 dollar.7. c5.18xlarge: $3.06 reported cost per hour, test consumed 1 Minute, 29 Seconds: cost approximately 0.08 dollar.8. m4.16xlarge: $3.20 reported cost per hour, test consumed 1 Minute, 54 Seconds: cost approximately 0.1 dollar.

Parboil

Performance / Cost - Test: OpenMP CUTCP

OpenBenchmarking.orgSeconds x Dollar, Fewer Is BetterParboil 2.5Performance / Cost - Test: OpenMP CUTCPm4.16xlargec4.8xlargec5.18xlargem4.10xlargec5.9xlargem5.12xlargem5.4xlargem5.large0.22050.4410.66150.8821.10250.030.040.040.050.060.060.160.981. m4.16xlarge: $3.20 reported cost per hour, test consumed 14 Seconds: cost approximately 0.01 dollar.2. c4.8xlarge: $1.591 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar.3. c5.18xlarge: $3.06 reported cost per hour, test consumed 16 Seconds: cost approximately 0.01 dollar.4. m4.10xlarge: $2.00 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar.5. c5.9xlarge: $1.53 reported cost per hour, test consumed 22 Seconds: cost approximately 0.01 dollar.6. m5.12xlarge: $2.304 reported cost per hour, test consumed 21 Seconds: cost approximately 0.01 dollar.7. m5.4xlarge: $0.768 reported cost per hour, test consumed 53 Seconds: cost approximately 0.01 dollar.8. m5.large: $0.096 reported cost per hour, test consumed 4 Minutes, 58 Seconds: cost approximately 0.01 dollar.

Cost To Run Tests

Cost / Price Per Hour

OpenBenchmarking.orgCost / Price Per Hour, Fewer Is BetterCost To Run TestsCost / Price Per Hourm5.largem5.4xlargec5.9xlargec4.8xlargem4.10xlargem5.12xlargec5.18xlargem4.16xlarge0.63231.26461.89692.52923.16150.340.891.281.351.862.002.432.811. m5.large: $0.096 reported cost per hour, running tests consumed 3 Hours, 30 Minutes, 28 Seconds: cost approximately 0.34 dollar. 2. m5.4xlarge: $0.768 reported cost per hour, running tests consumed 1 Hour, 9 Minutes, 15 Seconds: cost approximately 0.89 dollar. 3. c5.9xlarge: $1.53 reported cost per hour, running tests consumed 50 Minutes, 21 Seconds: cost approximately 1.28 dollar. 4. c4.8xlarge: $1.591 reported cost per hour, running tests consumed 50 Minutes, 46 Seconds: cost approximately 1.35 dollar. 5. m4.10xlarge: $2.00 reported cost per hour, running tests consumed 55 Minutes, 55 Seconds: cost approximately 1.86 dollar. 6. m5.12xlarge: $2.304 reported cost per hour, running tests consumed 52 Minutes, 9 Seconds: cost approximately 2 dollar. 7. c5.18xlarge: $3.06 reported cost per hour, running tests consumed 47 Minutes, 35 Seconds: cost approximately 2.43 dollar. 8. m4.16xlarge: $3.20 reported cost per hour, running tests consumed 52 Minutes, 42 Seconds: cost approximately 2.81 dollar.

Timed MAFFT Alignment

Performance / Cost - Multiple Sequence Alignment

OpenBenchmarking.orgSeconds x Dollar, Fewer Is BetterTimed MAFFT Alignment 6.864Performance / Cost - Multiple Sequence Alignmentc5.9xlargem5.12xlargec4.8xlargec5.18xlargem4.10xlargem4.16xlarge0.06080.12160.18240.24320.3040.030.030.040.040.060.271. c5.9xlarge: $1.53 reported cost per hour, test consumed 12 Seconds: cost approximately 0.01 dollar.2. m5.12xlarge: $2.304 reported cost per hour, test consumed 14 Seconds: cost approximately 0.01 dollar.3. c4.8xlarge: $1.591 reported cost per hour, test consumed 18 Seconds: cost approximately 0.01 dollar.4. c5.18xlarge: $3.06 reported cost per hour, test consumed 17 Seconds: cost approximately 0.01 dollar.5. m4.10xlarge: $2.00 reported cost per hour, test consumed 21 Seconds: cost approximately 0.01 dollar.6. m4.16xlarge: $3.20 reported cost per hour, test consumed 31 Seconds: cost approximately 0.03 dollar.

Phoronix Test Suite v10.8.4