Amazon EC2 Graviton3 Benchmark Comparison

Amazon AWS Graviton3 benchmarks by Michael Larabel.

HTML result view exported from: https://openbenchmarking.org/result/2205260-PTS-GRAVITON42&grs&sor.

Amazon EC2 Graviton3 Benchmark ComparisonProcessorMotherboardChipsetMemoryDiskNetworkOSKernelCompilerFile-SystemSystem Layera1.4xlarge Gravitonc6g.4xlarge Graviton2c7g.4xlarge Graviton3c6a.4xlarge EPYCc6i.4xlarge XeonARMv8 Cortex-A72 (16 Cores)Amazon EC2 a1.4xlarge (1.0 BIOS)Amazon Device 020032GB193GB Amazon Elastic Block StoreAmazon ElasticUbuntu 22.045.15.0-1004-aws (aarch64)GCC 11.2.0ext4amazonARMv8 Neoverse-N1 (16 Cores)Amazon EC2 c6g.4xlarge (1.0 BIOS)ARMv8 Neoverse-V1 (16 Cores)Amazon EC2 c7g.4xlarge (1.0 BIOS)AMD EPYC 7R13 (8 Cores / 16 Threads)Amazon EC2 c6a.4xlarge (1.0 BIOS)Intel 440FX 82441FX PMC5.15.0-1004-aws (x86_64)Intel Xeon Platinum 8375C (8 Cores / 16 Threads)Amazon EC2 c6i.4xlarge (1.0 BIOS)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- a1.4xlarge Graviton: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - c6g.4xlarge Graviton2: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - c7g.4xlarge Graviton3: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto -v - c6a.4xlarge EPYC: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-gBFGDP/gcc-11-11.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-gBFGDP/gcc-11-11.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - c6i.4xlarge Xeon: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-gBFGDP/gcc-11-11.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-gBFGDP/gcc-11-11.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Java Details- OpenJDK Runtime Environment (build 11.0.15+10-Ubuntu-0ubuntu0.22.04.1)Python Details- Python 3.10.4Security Details- a1.4xlarge Graviton: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Not affected + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of Branch predictor hardening BHB + srbds: Not affected + tsx_async_abort: Not affected - c6g.4xlarge Graviton2: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 BHB + srbds: Not affected + tsx_async_abort: Not affected - c7g.4xlarge Graviton3: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 BHB + srbds: Not affected + tsx_async_abort: Not affected - c6a.4xlarge EPYC: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected - c6i.4xlarge Xeon: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected Processor Details- c6a.4xlarge EPYC: CPU Microcode: 0xa001144- c6i.4xlarge Xeon: CPU Microcode: 0xd000331

Amazon EC2 Graviton3 Benchmark Comparisonstress-ng: Memory Copyingnpb: MG.Cnpb: CG.Cnpb: SP.Ccompress-zstd: 3 - Compression Speednpb: FT.Chpcg: amg: incompact3d: input.i3d 129 Cells Per Directionmt-dgemm: Sustained Floating-Point Rateincompact3d: input.i3d 193 Cells Per Directionstress-ng: CPU Stresssimdjson: DistinctUserIDmrbayes: Primate Phylogeny Analysisnpb: IS.Dtensorflow-lite: Mobilenet Floatgpaw: Carbon Nanotubeavifenc: 2simdjson: PartialTweetslulesh: apache: 100astcenc: Thoroughgromacs: MPI CPU - water_GMX50_baretensorflow-lite: Inception V4apache: 500apache: 200simdjson: Kostyanpb: BT.Copenssl: RSA4096tensorflow-lite: Inception ResNet V2apache: 1000tensorflow-lite: SqueezeNetastcenc: Exhaustiverodinia: OpenMP CFD Solveropenssl: RSA4096avifenc: 0build-nodejs: Time To Compilelammps: Rhodopsin Proteinpybench: Total For Average Test Timesphpbench: PHP Benchmark Suitebuild-imagemagick: Time To Compiletensorflow-lite: NASNet Mobilebuild-apache: Time To Compiledacapobench: Jythonbuild-llvm: Ninjanpb: EP.Dngspice: C2670dacapobench: Tradesoapsimdjson: LargeRandsecuremark: SecureMark-TLSdacapobench: Tradebeansliquid-dsp: 16 - 256 - 57build2: Time To Compilebuild-php: Time To Compilecompress-7zip: Compression Ratingngspice: C7552webp: Quality 100, Lossless, Highest Compressionbuild-gem5: Time To Compilewebp: Quality 100, Losslessavifenc: 6, Losslessnginx: 1000nginx: 500nginx: 200compress-zstd: 19 - Decompression Speednginx: 100tscp: AI Chess Performancecompress-zstd: 19, Long Mode - Decompression Speedstockfish: Total Timerodinia: OpenMP LavaMDpovray: Trace Timecompress-zstd: 19, Long Mode - Compression Speedcompress-zstd: 19 - Compression Speeddacapobench: H2stress-ng: Cryptoasmfish: 1024 Hash Memory, 26 Depthsynthmark: VoiceMark_100openssl: SHA256stress-ng: Vector Mathnpb: LU.Clczero: Eigenlczero: BLAScoremark: CoreMark Size 666 - Iterations Per Secondn-queens: Elapsed Timecompress-7zip: Decompression Ratingm-queens: Time To Solvestress-ng: IO_uringonnx: super-resolution-10 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Standardonnx: fcn-resnet101-11 - CPU - Standardonnx: bertsquad-12 - CPU - Standardonnx: GPT-2 - CPU - Standardtensorflow-lite: Mobilenet Quantc-ray: Total Time - 4K, 16 Rays Per Pixelrodinia: OpenMP Streamclustera1.4xlarge Gravitonc6g.4xlarge Graviton2c7g.4xlarge Graviton3c6a.4xlarge EPYCc6i.4xlarge Xeon798.243266.361213.151293.80633.92927.163.7783418671693353.77062740.891391182.5839392366.000.8644.788197.579990.15769.346449.0220.782328.272418636.4333.51980.31618891020133.4920887.580.633148.18588.317116919278.6812014.7277.766941.45045328.6768.3021765.9103.245345224125993.63230986.774.742129971784.600339.20473.901111820.3743569045165513333353.912196.02932498480.793124.7081155.61561.80133.991138205.11139414.84141436.201121.7143155.485385001213.910980430360.30493.8011616.9674011985.3815331550331.070678568951727341.472558.12128135203869.40201732.28540891110.368918172.377571651011523125724.66104.76147.4302903.006720.683520.862356.162888.36244.4819.721893265290011.57335474.78512341.02408353404.941.53384.753372.762500.87215.528238.2051.516016.162746995.3516.52220.78146793.950077.8150059.971.196449.11660.645955.746629.453969.35159.203917.03553951.5406.937628.4017.935174144985540.33314985.434.2015626682.981558.88263.72445060.491203014344262890000142.27788.89771285255.20566.147488.80531.08216.518308213.13310596.58308938.672051.6307349.368723132196.321679245215.66651.04731.034.6396417924.1826540482470.3891072318408337753.895133.89834864315464.33980023.1365944575.224770521.8120723342832269481980.2462.32315.4846693.3213481.616571.954467.194639.111791.7726.305812588073338.016714255.85386429.12585705029.712.69251.3971041.902156.60155.180141.6982.6210940.93967231.8813.92481.12841855.173546.3273676.951.9410339.532546.440051.372719.333257.94139.379710.478178460.4256.841497.57911.291118566648427.90411591.926.9403940544.929934.72198.22435240.71837083203383606667115.02069.48397824191.28648.208391.17122.76911.908346814.75346613.34352380.983050.3345710.8713700943240.627608891143.33437.86339.541.2295123181.8132134123675.6351372204597355258.177730.4111891103405413.86055421.5367305466.822843015.7828176093840779901502.9538.51713.2963551.8016826.436169.228094.792784.018299.965.0604226767070028.27976612.432432110.77002713304.504.30120.636541.352159.72302.95693.9463.645452.105177567.697.98181.00444920.681995.6483070.002.8013134.462088.941366.671537.113103.1272.390821.789136784.2195.532664.3475.067196148074132.6269266.8623.5324616760.344466.21245.88640520.952132883167509746667150.99467.08462562180.35648.677515.20126.70816.394388657.76389030.11390932.792907.5388010.7614426312826.023857623224.33149.43525.930.0301913556.0626187688663.0731169140335353787.6125140.5510011091345133.44054116.3785731872.330768723.46369611926548856173847.9669.34918.3833150.4926298.819522.829563.223440.620423.578.6603166136476717.86827722.23054569.216997812527.164.30134.924861.571965.07202.10697.7353.718112.371586545.577.26251.45241185.791746.5794458.222.4613888.402161.341179.779830.962983.9369.638720.446140964.4204.994604.6206.22099782818629.73710900.622.5274013685.7041103.22147.89338150.862305492928373100000136.80164.33766631161.08141.805469.94021.12217.529347345.49351672.92356829.932582.0356302.8412725962666.122081961281.38952.78433.838.1292110210.3423746200565.690709699393740140.3038136.7714661397285378.84166118.8394565391.2311037943.373450137413977379443967.3992.54523.512OpenBenchmarking.org

Stress-NG

Test: Memory Copying

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: Memory Copyingc7g.4xlarge Graviton3c6a.4xlarge EPYCc6i.4xlarge Xeonc6g.4xlarge Graviton2a1.4xlarge Graviton14002800420056007000SE +/- 3.52, N = 3SE +/- 11.57, N = 3SE +/- 0.94, N = 3SE +/- 3.75, N = 3SE +/- 0.91, N = 36693.323551.803150.492903.00798.241. (CC) gcc options: -O2 -std=gnu99 -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

NAS Parallel Benchmarks

Test / Class: MG.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: MG.Cc6i.4xlarge Xeonc6a.4xlarge EPYCc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton6K12K18K24K30KSE +/- 184.24, N = 3SE +/- 30.62, N = 3SE +/- 4.69, N = 3SE +/- 1.39, N = 3SE +/- 1.64, N = 326298.8116826.4313481.616720.683266.361. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

NAS Parallel Benchmarks

Test / Class: CG.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: CG.Cc6i.4xlarge Xeonc7g.4xlarge Graviton3c6a.4xlarge EPYCc6g.4xlarge Graviton2a1.4xlarge Graviton2K4K6K8K10KSE +/- 66.44, N = 3SE +/- 17.12, N = 3SE +/- 81.25, N = 3SE +/- 9.95, N = 3SE +/- 11.79, N = 69522.826571.956169.223520.861213.151. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

NAS Parallel Benchmarks

Test / Class: SP.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: SP.Cc6i.4xlarge Xeonc6a.4xlarge EPYCc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton2K4K6K8K10KSE +/- 73.65, N = 3SE +/- 24.63, N = 3SE +/- 9.61, N = 3SE +/- 0.57, N = 3SE +/- 2.51, N = 39563.228094.794467.192356.161293.801. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

Zstd Compression

Compression Level: 3 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.0Compression Level: 3 - Compression Speedc7g.4xlarge Graviton3c6i.4xlarge Xeonc6g.4xlarge Graviton2c6a.4xlarge EPYCa1.4xlarge Graviton10002000300040005000SE +/- 9.57, N = 3SE +/- 29.53, N = 3SE +/- 6.37, N = 3SE +/- 2.65, N = 3SE +/- 4.47, N = 34639.13440.62888.32784.0633.9-llzma-llzma-llzma-llzma1. (CC) gcc options: -O3 -pthread -lz

NAS Parallel Benchmarks

Test / Class: FT.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: FT.Cc6i.4xlarge Xeonc6a.4xlarge EPYCc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton4K8K12K16K20KSE +/- 40.24, N = 3SE +/- 45.90, N = 3SE +/- 1.17, N = 3SE +/- 1.10, N = 3SE +/- 1.73, N = 320423.5718299.9611791.776244.482927.161. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

High Performance Conjugate Gradient

OpenBenchmarking.orgGFLOP/s, More Is BetterHigh Performance Conjugate Gradient 3.1c7g.4xlarge Graviton3c6g.4xlarge Graviton2c6i.4xlarge Xeonc6a.4xlarge EPYCa1.4xlarge Graviton612182430SE +/- 0.03738, N = 3SE +/- 0.01639, N = 3SE +/- 0.04033, N = 3SE +/- 0.00225, N = 3SE +/- 0.00065, N = 326.3058019.721808.660315.060423.778341. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi

Algebraic Multi-Grid Benchmark

OpenBenchmarking.orgFigure Of Merit, More Is BetterAlgebraic Multi-Grid Benchmark 1.2c7g.4xlarge Graviton3c6g.4xlarge Graviton2c6i.4xlarge Xeonc6a.4xlarge EPYCa1.4xlarge Graviton300M600M900M1200M1500MSE +/- 952437.28, N = 3SE +/- 3420043.89, N = 3SE +/- 5114517.12, N = 3SE +/- 103921.81, N = 3SE +/- 176548.39, N = 312588073339326529006613647672676707001867169331. (CC) gcc options: -lparcsr_ls -lparcsr_mv -lseq_mv -lIJ_mv -lkrylov -lHYPRE_utilities -lm -fopenmp -lmpi

Xcompact3d Incompact3d

Input: input.i3d 129 Cells Per Direction

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: input.i3d 129 Cells Per Directionc7g.4xlarge Graviton3c6g.4xlarge Graviton2c6i.4xlarge Xeonc6a.4xlarge EPYCa1.4xlarge Graviton1224364860SE +/- 0.01401446, N = 3SE +/- 0.01351889, N = 3SE +/- 0.09619197, N = 3SE +/- 0.03718674, N = 3SE +/- 0.02862870, N = 38.0167142511.5733547017.8682772028.2797661053.770627401. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

ACES DGEMM

Sustained Floating-Point Rate

OpenBenchmarking.orgGFLOP/s, More Is BetterACES DGEMM 1.0Sustained Floating-Point Ratec7g.4xlarge Graviton3c6g.4xlarge Graviton2c6a.4xlarge EPYCc6i.4xlarge Xeona1.4xlarge Graviton1.31712.63423.95135.26846.5855SE +/- 0.016350, N = 3SE +/- 0.007139, N = 3SE +/- 0.023324, N = 6SE +/- 0.003819, N = 3SE +/- 0.002370, N = 35.8538644.7851232.4324322.2305450.8913911. (CC) gcc options: -O3 -march=native -fopenmp

Xcompact3d Incompact3d

Input: input.i3d 193 Cells Per Direction

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: input.i3d 193 Cells Per Directionc7g.4xlarge Graviton3c6g.4xlarge Graviton2c6i.4xlarge Xeonc6a.4xlarge EPYCa1.4xlarge Graviton4080120160200SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.14, N = 3SE +/- 0.12, N = 3SE +/- 0.15, N = 329.1341.0269.22110.77182.581. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

Stress-NG

Test: CPU Stress

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: CPU Stressc6a.4xlarge EPYCc6i.4xlarge Xeonc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton3K6K9K12K15KSE +/- 37.60, N = 3SE +/- 155.66, N = 3SE +/- 0.41, N = 3SE +/- 0.54, N = 3SE +/- 0.16, N = 313304.5012527.165029.713404.942366.001. (CC) gcc options: -O2 -std=gnu99 -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

simdjson

Throughput Test: DistinctUserID

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 1.0Throughput Test: DistinctUserIDc6i.4xlarge Xeonc6a.4xlarge EPYCc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton0.96751.9352.90253.874.8375SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 34.304.302.691.530.801. (CXX) g++ options: -O3

Timed MrBayes Analysis

Primate Phylogeny Analysis

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed MrBayes Analysis 3.2.7Primate Phylogeny Analysisc6a.4xlarge EPYCc6i.4xlarge Xeonc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton140280420560700SE +/- 0.35, N = 3SE +/- 1.43, N = 3SE +/- 0.24, N = 3SE +/- 0.11, N = 3SE +/- 0.49, N = 3120.64134.92251.40384.75644.79-mmmx -msse -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -msse4a -msha -maes -mavx -mfma -mavx2 -mrdrnd -mbmi -mbmi2 -madx -mabm-mmmx -msse -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -msha -maes -mavx -mfma -mavx2 -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mrdrnd -mbmi -mbmi2 -madx -mabm1. (CC) gcc options: -O3 -std=c99 -pedantic -lm

NAS Parallel Benchmarks

Test / Class: IS.D

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: IS.Dc7g.4xlarge Graviton3c6i.4xlarge Xeonc6a.4xlarge EPYCc6g.4xlarge Graviton2a1.4xlarge Graviton2004006008001000SE +/- 2.29, N = 3SE +/- 2.14, N = 3SE +/- 0.47, N = 3SE +/- 0.20, N = 3SE +/- 0.31, N = 31041.90861.57541.35372.76197.571. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

TensorFlow Lite

Model: Mobilenet Float

OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2022-05-18Model: Mobilenet Floatc6i.4xlarge Xeonc7g.4xlarge Graviton3c6a.4xlarge EPYCc6g.4xlarge Graviton2a1.4xlarge Graviton2K4K6K8K10KSE +/- 1.81, N = 3SE +/- 19.61, N = 3SE +/- 1.03, N = 3SE +/- 28.63, N = 3SE +/- 113.94, N = 31965.072156.602159.722500.879990.15

GPAW

Input: Carbon Nanotube

OpenBenchmarking.orgSeconds, Fewer Is BetterGPAW 22.1Input: Carbon Nanotubec7g.4xlarge Graviton3c6i.4xlarge Xeonc6g.4xlarge Graviton2c6a.4xlarge EPYCa1.4xlarge Graviton170340510680850SE +/- 0.08, N = 3SE +/- 0.24, N = 3SE +/- 0.13, N = 3SE +/- 0.17, N = 3SE +/- 5.37, N = 3155.18202.11215.53302.96769.351. (CC) gcc options: -shared -fwrapv -O2 -lxc -lblas -lmpi

libavif avifenc

Encoder Speed: 2

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.10Encoder Speed: 2c6a.4xlarge EPYCc6i.4xlarge Xeonc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton100200300400500SE +/- 0.44, N = 3SE +/- 0.26, N = 3SE +/- 0.11, N = 3SE +/- 0.12, N = 3SE +/- 0.29, N = 393.9597.74141.70238.21449.021. (CXX) g++ options: -O3 -fPIC -lm

simdjson

Throughput Test: PartialTweets

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 1.0Throughput Test: PartialTweetsc6i.4xlarge Xeonc6a.4xlarge EPYCc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton0.83481.66962.50443.33924.174SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 33.713.642.621.510.781. (CXX) g++ options: -O3

LULESH

OpenBenchmarking.orgz/s, More Is BetterLULESH 2.0.3c7g.4xlarge Graviton3c6i.4xlarge Xeonc6g.4xlarge Graviton2c6a.4xlarge EPYCa1.4xlarge Graviton2K4K6K8K10KSE +/- 76.73, N = 3SE +/- 14.20, N = 3SE +/- 4.88, N = 3SE +/- 5.52, N = 3SE +/- 6.27, N = 310940.948112.376016.165452.112328.271. (CXX) g++ options: -O3 -fopenmp -lm -lmpi_cxx -lmpi

Apache HTTP Server

Concurrent Requests: 100

OpenBenchmarking.orgRequests Per Second, More Is BetterApache HTTP Server 2.4.48Concurrent Requests: 100c6i.4xlarge Xeonc6a.4xlarge EPYCc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton20K40K60K80K100KSE +/- 389.13, N = 3SE +/- 211.56, N = 3SE +/- 38.09, N = 3SE +/- 93.03, N = 3SE +/- 28.97, N = 386545.5777567.6967231.8846995.3518636.431. (CC) gcc options: -shared -fPIC -O2

ASTC Encoder

Preset: Thorough

OpenBenchmarking.orgSeconds, Fewer Is BetterASTC Encoder 3.2Preset: Thoroughc6i.4xlarge Xeonc6a.4xlarge EPYCc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton816243240SE +/- 0.0001, N = 3SE +/- 0.0154, N = 3SE +/- 0.0011, N = 3SE +/- 0.0064, N = 3SE +/- 0.0061, N = 37.26257.981813.924816.522233.51981. (CXX) g++ options: -O3 -flto -pthread

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2022.1Implementation: MPI CPU - Input: water_GMX50_barec6i.4xlarge Xeonc7g.4xlarge Graviton3c6a.4xlarge EPYCc6g.4xlarge Graviton2a1.4xlarge Graviton0.32670.65340.98011.30681.6335SE +/- 0.001, N = 3SE +/- 0.002, N = 3SE +/- 0.002, N = 3SE +/- 0.001, N = 3SE +/- 0.000, N = 31.4521.1281.0040.7810.3161. (CXX) g++ options: -O3

TensorFlow Lite

Model: Inception V4

OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2022-05-18Model: Inception V4c6i.4xlarge Xeonc7g.4xlarge Graviton3c6a.4xlarge EPYCc6g.4xlarge Graviton2a1.4xlarge Graviton40K80K120K160K200KSE +/- 75.14, N = 3SE +/- 210.27, N = 3SE +/- 53.95, N = 3SE +/- 197.89, N = 3SE +/- 1746.17, N = 341185.741855.144920.646793.9188910.0

Apache HTTP Server

Concurrent Requests: 500

OpenBenchmarking.orgRequests Per Second, More Is BetterApache HTTP Server 2.4.48Concurrent Requests: 500c6i.4xlarge Xeonc6a.4xlarge EPYCc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton20K40K60K80K100KSE +/- 833.50, N = 7SE +/- 636.46, N = 13SE +/- 89.82, N = 3SE +/- 578.32, N = 3SE +/- 93.64, N = 391746.5781995.6473546.3250077.8120133.491. (CC) gcc options: -shared -fPIC -O2

Apache HTTP Server

Concurrent Requests: 200

OpenBenchmarking.orgRequests Per Second, More Is BetterApache HTTP Server 2.4.48Concurrent Requests: 200c6i.4xlarge Xeonc6a.4xlarge EPYCc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton20K40K60K80K100KSE +/- 615.05, N = 3SE +/- 644.29, N = 3SE +/- 649.31, N = 3SE +/- 112.65, N = 3SE +/- 59.55, N = 394458.2283070.0073676.9550059.9720887.581. (CC) gcc options: -shared -fPIC -O2

simdjson

Throughput Test: Kostya

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 1.0Throughput Test: Kostyac6a.4xlarge EPYCc6i.4xlarge Xeonc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton0.631.261.892.523.15SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 32.802.461.941.190.631. (CXX) g++ options: -O3

NAS Parallel Benchmarks

Test / Class: BT.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: BT.Cc6i.4xlarge Xeonc6a.4xlarge EPYCc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton3K6K9K12K15KSE +/- 22.04, N = 3SE +/- 98.45, N = 3SE +/- 7.36, N = 3SE +/- 3.20, N = 3SE +/- 3.44, N = 313888.4013134.4610339.536449.113148.181. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

OpenSSL

Algorithm: RSA4096

OpenBenchmarking.orgsign/s, More Is BetterOpenSSL 3.0Algorithm: RSA4096c7g.4xlarge Graviton3c6i.4xlarge Xeonc6a.4xlarge EPYCc6g.4xlarge Graviton2a1.4xlarge Graviton5001000150020002500SE +/- 0.23, N = 3SE +/- 4.47, N = 3SE +/- 1.40, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 32546.42161.32088.9660.6588.3-m64-m641. (CC) gcc options: -pthread -O3 -lssl -lcrypto -ldl

TensorFlow Lite

Model: Inception ResNet V2

OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2022-05-18Model: Inception ResNet V2c7g.4xlarge Graviton3c6i.4xlarge Xeonc6a.4xlarge EPYCc6g.4xlarge Graviton2a1.4xlarge Graviton40K80K120K160K200KSE +/- 305.31, N = 3SE +/- 110.01, N = 3SE +/- 27.66, N = 3SE +/- 336.95, N = 3SE +/- 825.35, N = 340051.341179.741366.645955.7171169.0

Apache HTTP Server

Concurrent Requests: 1000

OpenBenchmarking.orgRequests Per Second, More Is BetterApache HTTP Server 2.4.48Concurrent Requests: 1000c6i.4xlarge Xeonc7g.4xlarge Graviton3c6a.4xlarge EPYCc6g.4xlarge Graviton2a1.4xlarge Graviton20K40K60K80K100KSE +/- 335.63, N = 3SE +/- 83.83, N = 3SE +/- 397.88, N = 3SE +/- 276.10, N = 3SE +/- 98.61, N = 379830.9672719.3371537.1146629.4519278.681. (CC) gcc options: -shared -fPIC -O2

TensorFlow Lite

Model: SqueezeNet

OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2022-05-18Model: SqueezeNetc6i.4xlarge Xeonc6a.4xlarge EPYCc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton3K6K9K12K15KSE +/- 3.54, N = 3SE +/- 1.37, N = 3SE +/- 22.07, N = 3SE +/- 37.23, N = 3SE +/- 46.48, N = 32983.933103.123257.943969.3512014.70

ASTC Encoder

Preset: Exhaustive

OpenBenchmarking.orgSeconds, Fewer Is BetterASTC Encoder 3.2Preset: Exhaustivec6i.4xlarge Xeonc6a.4xlarge EPYCc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton60120180240300SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.07, N = 369.6472.39139.38159.20277.771. (CXX) g++ options: -O3 -flto -pthread

Rodinia

Test: OpenMP CFD Solver

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP CFD Solverc7g.4xlarge Graviton3c6g.4xlarge Graviton2c6i.4xlarge Xeonc6a.4xlarge EPYCa1.4xlarge Graviton918273645SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 310.4817.0420.4521.7941.451. (CXX) g++ options: -O2 -lOpenCL

OpenSSL

Algorithm: RSA4096

OpenBenchmarking.orgverify/s, More Is BetterOpenSSL 3.0Algorithm: RSA4096c7g.4xlarge Graviton3c6i.4xlarge Xeonc6a.4xlarge EPYCc6g.4xlarge Graviton2a1.4xlarge Graviton40K80K120K160K200KSE +/- 82.61, N = 3SE +/- 47.94, N = 3SE +/- 74.60, N = 3SE +/- 3.30, N = 3SE +/- 63.75, N = 3178460.4140964.4136784.253951.545328.6-m64-m641. (CC) gcc options: -pthread -O3 -lssl -lcrypto -ldl

libavif avifenc

Encoder Speed: 0

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.10Encoder Speed: 0c6a.4xlarge EPYCc6i.4xlarge Xeonc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton170340510680850SE +/- 0.62, N = 3SE +/- 0.33, N = 3SE +/- 0.18, N = 3SE +/- 0.13, N = 3SE +/- 0.58, N = 3195.53204.99256.84406.94768.301. (CXX) g++ options: -O3 -fPIC -lm

Timed Node.js Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 17.3Time To Compilec7g.4xlarge Graviton3c6i.4xlarge Xeonc6g.4xlarge Graviton2c6a.4xlarge EPYCa1.4xlarge Graviton400800120016002000SE +/- 2.06, N = 3SE +/- 0.42, N = 3SE +/- 0.37, N = 3SE +/- 0.26, N = 3SE +/- 1.80, N = 3497.58604.62628.40664.351765.91

LAMMPS Molecular Dynamics Simulator

Model: Rhodopsin Protein

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 29Oct2020Model: Rhodopsin Proteinc7g.4xlarge Graviton3c6g.4xlarge Graviton2c6i.4xlarge Xeonc6a.4xlarge EPYCa1.4xlarge Graviton3691215SE +/- 0.060, N = 3SE +/- 0.014, N = 3SE +/- 0.009, N = 3SE +/- 0.039, N = 12SE +/- 0.040, N = 311.2917.9356.2205.0673.2451. (CXX) g++ options: -O3 -lm

PyBench

Total For Average Test Times

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyBench 2018-02-16Total For Average Test Timesc6i.4xlarge Xeonc7g.4xlarge Graviton3c6g.4xlarge Graviton2c6a.4xlarge EPYCa1.4xlarge Graviton7001400210028003500SE +/- 3.84, N = 3SE +/- 0.33, N = 3SE +/- 1.67, N = 3SE +/- 1.53, N = 3SE +/- 18.15, N = 39971185174119613452

PHPBench

PHP Benchmark Suite

OpenBenchmarking.orgScore, More Is BetterPHPBench 0.8.1PHP Benchmark Suitec6i.4xlarge Xeonc7g.4xlarge Graviton3c6a.4xlarge EPYCc6g.4xlarge Graviton2a1.4xlarge Graviton200K400K600K800K1000KSE +/- 983.65, N = 3SE +/- 525.83, N = 3SE +/- 2681.41, N = 3SE +/- 743.13, N = 3SE +/- 816.27, N = 3828186666484480741449855241259

Timed ImageMagick Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed ImageMagick Compilation 6.9.0Time To Compilec7g.4xlarge Graviton3c6i.4xlarge Xeonc6a.4xlarge EPYCc6g.4xlarge Graviton2a1.4xlarge Graviton20406080100SE +/- 0.13, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.22, N = 3SE +/- 0.27, N = 327.9029.7432.6340.3393.63

TensorFlow Lite

Model: NASNet Mobile

OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2022-05-18Model: NASNet Mobilec6a.4xlarge EPYCc6i.4xlarge Xeonc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton7K14K21K28K35KSE +/- 23.44, N = 3SE +/- 166.62, N = 14SE +/- 121.56, N = 15SE +/- 203.15, N = 15SE +/- 49.84, N = 39266.8610900.6011591.9014985.4030986.70

Timed Apache Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Apache Compilation 2.4.41Time To Compilec6i.4xlarge Xeonc6a.4xlarge EPYCc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton20406080100SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 322.5323.5326.9434.2074.74

DaCapo Benchmark

Java Test: Jython

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: Jythonc7g.4xlarge Graviton3c6i.4xlarge Xeonc6a.4xlarge EPYCc6g.4xlarge Graviton2a1.4xlarge Graviton3K6K9K12K15KSE +/- 6.99, N = 4SE +/- 24.07, N = 4SE +/- 23.33, N = 4SE +/- 23.29, N = 4SE +/- 48.38, N = 4394040134616562612997

Timed LLVM Compilation

Build System: Ninja

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 13.0Build System: Ninjac7g.4xlarge Graviton3c6g.4xlarge Graviton2c6i.4xlarge Xeonc6a.4xlarge EPYCa1.4xlarge Graviton400800120016002000SE +/- 5.19, N = 3SE +/- 0.49, N = 3SE +/- 0.12, N = 3SE +/- 0.05, N = 3SE +/- 0.34, N = 3544.93682.98685.70760.341784.60

NAS Parallel Benchmarks

Test / Class: EP.D

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: EP.Dc6i.4xlarge Xeonc7g.4xlarge Graviton3c6g.4xlarge Graviton2c6a.4xlarge EPYCa1.4xlarge Graviton2004006008001000SE +/- 19.93, N = 9SE +/- 0.39, N = 3SE +/- 0.23, N = 3SE +/- 0.06, N = 3SE +/- 0.24, N = 31103.22934.72558.88466.21339.201. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

Ngspice

Circuit: C2670

OpenBenchmarking.orgSeconds, Fewer Is BetterNgspice 34Circuit: C2670c6i.4xlarge Xeonc7g.4xlarge Graviton3c6a.4xlarge EPYCc6g.4xlarge Graviton2a1.4xlarge Graviton100200300400500SE +/- 1.80, N = 4SE +/- 0.86, N = 3SE +/- 1.17, N = 3SE +/- 0.91, N = 3SE +/- 3.48, N = 3147.89198.22245.89263.72473.901. (CC) gcc options: -O0 -fopenmp -lm -lstdc++ -lfftw3 -lXaw -lXmu -lXt -lXext -lX11 -lXft -lfontconfig -lXrender -lfreetype -lSM -lICE

DaCapo Benchmark

Java Test: Tradesoap

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: Tradesoapc7g.4xlarge Graviton3c6i.4xlarge Xeonc6a.4xlarge EPYCc6g.4xlarge Graviton2a1.4xlarge Graviton2K4K6K8K10KSE +/- 14.95, N = 4SE +/- 24.39, N = 4SE +/- 16.15, N = 4SE +/- 27.95, N = 4SE +/- 71.92, N = 4352438154052450611182

simdjson

Throughput Test: LargeRandom

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 1.0Throughput Test: LargeRandomc6a.4xlarge EPYCc6i.4xlarge Xeonc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton0.21380.42760.64140.85521.069SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.950.860.700.490.301. (CXX) g++ options: -O3

SecureMark

Benchmark: SecureMark-TLS

OpenBenchmarking.orgmarks, More Is BetterSecureMark 1.0.4Benchmark: SecureMark-TLSc6i.4xlarge Xeonc6a.4xlarge EPYCc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton50K100K150K200K250KSE +/- 864.34, N = 3SE +/- 3310.19, N = 9SE +/- 773.26, N = 3SE +/- 23.07, N = 3SE +/- 59.40, N = 3230549213288183708120301743561. (CC) gcc options: -pedantic -O3

DaCapo Benchmark

Java Test: Tradebeans

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: Tradebeansc6i.4xlarge Xeonc6a.4xlarge EPYCc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton2K4K6K8K10KSE +/- 19.24, N = 20SE +/- 23.53, N = 11SE +/- 26.73, N = 4SE +/- 40.13, N = 4SE +/- 44.35, N = 429283167320343449045

Liquid-DSP

Threads: 16 - Buffer Length: 256 - Filter Length: 57

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 2021.01.31Threads: 16 - Buffer Length: 256 - Filter Length: 57c6a.4xlarge EPYCc7g.4xlarge Graviton3c6i.4xlarge Xeonc6g.4xlarge Graviton2a1.4xlarge Graviton110M220M330M440M550MSE +/- 489364.67, N = 3SE +/- 400097.21, N = 3SE +/- 41633.32, N = 3SE +/- 35118.85, N = 3SE +/- 8819.17, N = 35097466673836066673731000002628900001655133331. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

Build2

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterBuild2 0.13Time To Compilec7g.4xlarge Graviton3c6i.4xlarge Xeonc6g.4xlarge Graviton2c6a.4xlarge EPYCa1.4xlarge Graviton80160240320400SE +/- 0.64, N = 3SE +/- 0.69, N = 3SE +/- 0.70, N = 3SE +/- 0.87, N = 3SE +/- 1.89, N = 3115.02136.80142.28150.99353.91

Timed PHP Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed PHP Compilation 7.4.2Time To Compilec6i.4xlarge Xeonc6a.4xlarge EPYCc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton4080120160200SE +/- 0.09, N = 3SE +/- 0.05, N = 3SE +/- 0.11, N = 3SE +/- 0.31, N = 3SE +/- 0.08, N = 364.3467.0869.4888.90196.03

7-Zip Compression

Test: Compression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 21.06Test: Compression Ratingc7g.4xlarge Graviton3c6g.4xlarge Graviton2c6i.4xlarge Xeonc6a.4xlarge EPYCa1.4xlarge Graviton20K40K60K80K100KSE +/- 159.36, N = 3SE +/- 44.77, N = 3SE +/- 174.34, N = 3SE +/- 16.02, N = 3SE +/- 91.00, N = 397824712856663162562324981. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

Ngspice

Circuit: C7552

OpenBenchmarking.orgSeconds, Fewer Is BetterNgspice 34Circuit: C7552c6i.4xlarge Xeonc6a.4xlarge EPYCc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton100200300400500SE +/- 0.33, N = 3SE +/- 0.66, N = 3SE +/- 1.94, N = 3SE +/- 2.40, N = 7SE +/- 1.19, N = 3161.08180.36191.29255.21480.791. (CC) gcc options: -O0 -fopenmp -lm -lstdc++ -lfftw3 -lXaw -lXmu -lXt -lXext -lX11 -lXft -lfontconfig -lXrender -lfreetype -lSM -lICE

WebP Image Encode

Encode Settings: Quality 100, Lossless, Highest Compression

OpenBenchmarking.orgEncode Time - Seconds, Fewer Is BetterWebP Image Encode 1.1Encode Settings: Quality 100, Lossless, Highest Compressionc6i.4xlarge Xeonc7g.4xlarge Graviton3c6a.4xlarge EPYCc6g.4xlarge Graviton2a1.4xlarge Graviton306090120150SE +/- 0.34, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.09, N = 341.8148.2148.6866.15124.71-ltiff-ltiff-ltiff-ltiff1. (CC) gcc options: -fvisibility=hidden -O2 -lm -ljpeg -lpng16

Timed Gem5 Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 21.2Time To Compilec7g.4xlarge Graviton3c6i.4xlarge Xeonc6g.4xlarge Graviton2c6a.4xlarge EPYCa1.4xlarge Graviton2004006008001000SE +/- 1.33, N = 3SE +/- 0.59, N = 3SE +/- 0.53, N = 3SE +/- 0.79, N = 3SE +/- 0.78, N = 3391.17469.94488.81515.201155.62

WebP Image Encode

Encode Settings: Quality 100, Lossless

OpenBenchmarking.orgEncode Time - Seconds, Fewer Is BetterWebP Image Encode 1.1Encode Settings: Quality 100, Losslessc6i.4xlarge Xeonc7g.4xlarge Graviton3c6a.4xlarge EPYCc6g.4xlarge Graviton2a1.4xlarge Graviton1428425670SE +/- 0.03, N = 3SE +/- 0.09, N = 3SE +/- 0.17, N = 15SE +/- 0.02, N = 3SE +/- 0.06, N = 321.1222.7726.7131.0861.80-ltiff-ltiff-ltiff-ltiff1. (CC) gcc options: -fvisibility=hidden -O2 -lm -ljpeg -lpng16

libavif avifenc

Encoder Speed: 6, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.10Encoder Speed: 6, Losslessc7g.4xlarge Graviton3c6a.4xlarge EPYCc6g.4xlarge Graviton2c6i.4xlarge Xeona1.4xlarge Graviton816243240SE +/- 0.01, N = 3SE +/- 0.12, N = 3SE +/- 0.17, N = 3SE +/- 0.03, N = 3SE +/- 0.31, N = 311.9116.3916.5217.5333.991. (CXX) g++ options: -O3 -fPIC -lm

nginx

Concurrent Requests: 1000

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.21.1Concurrent Requests: 1000c6a.4xlarge EPYCc6i.4xlarge Xeonc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton80K160K240K320K400KSE +/- 781.49, N = 3SE +/- 2637.25, N = 3SE +/- 1410.11, N = 3SE +/- 1677.89, N = 3SE +/- 66.96, N = 3388657.76347345.49346814.75308213.13138205.111. (CC) gcc options: -lcrypt -lz -O3 -march=native

nginx

Concurrent Requests: 500

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.21.1Concurrent Requests: 500c6a.4xlarge EPYCc6i.4xlarge Xeonc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton80K160K240K320K400KSE +/- 771.95, N = 3SE +/- 1620.39, N = 3SE +/- 1017.52, N = 3SE +/- 3783.68, N = 3SE +/- 141.15, N = 3389030.11351672.92346613.34310596.58139414.841. (CC) gcc options: -lcrypt -lz -O3 -march=native

nginx

Concurrent Requests: 200

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.21.1Concurrent Requests: 200c6a.4xlarge EPYCc6i.4xlarge Xeonc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton80K160K240K320K400KSE +/- 1242.81, N = 3SE +/- 1582.66, N = 3SE +/- 3986.77, N = 3SE +/- 1347.28, N = 3SE +/- 133.96, N = 3390932.79356829.93352380.98308938.67141436.201. (CC) gcc options: -lcrypt -lz -O3 -march=native

Zstd Compression

Compression Level: 19 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.0Compression Level: 19 - Decompression Speedc7g.4xlarge Graviton3c6a.4xlarge EPYCc6i.4xlarge Xeonc6g.4xlarge Graviton2a1.4xlarge Graviton7001400210028003500SE +/- 7.75, N = 3SE +/- 3.25, N = 3SE +/- 24.18, N = 3SE +/- 12.10, N = 3SE +/- 4.74, N = 33050.32907.52582.02051.61121.7-llzma-llzma-llzma-llzma1. (CC) gcc options: -O3 -pthread -lz

nginx

Concurrent Requests: 100

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.21.1Concurrent Requests: 100c6a.4xlarge EPYCc6i.4xlarge Xeonc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton80K160K240K320K400KSE +/- 436.72, N = 3SE +/- 1727.81, N = 3SE +/- 2009.97, N = 3SE +/- 3992.58, N = 3SE +/- 22.67, N = 3388010.76356302.84345710.87307349.36143155.481. (CC) gcc options: -lcrypt -lz -O3 -march=native

TSCP

AI Chess Performance

OpenBenchmarking.orgNodes Per Second, More Is BetterTSCP 1.81AI Chess Performancec6a.4xlarge EPYCc7g.4xlarge Graviton3c6i.4xlarge Xeonc6g.4xlarge Graviton2a1.4xlarge Graviton300K600K900K1200K1500KSE +/- 4180.17, N = 5SE +/- 0.00, N = 5SE +/- 1099.67, N = 5SE +/- 338.27, N = 5SE +/- 196.86, N = 51442631137009412725968723135385001. (CC) gcc options: -O3 -march=native

Zstd Compression

Compression Level: 19, Long Mode - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.0Compression Level: 19, Long Mode - Decompression Speedc7g.4xlarge Graviton3c6a.4xlarge EPYCc6i.4xlarge Xeonc6g.4xlarge Graviton2a1.4xlarge Graviton7001400210028003500SE +/- 6.93, N = 3SE +/- 6.53, N = 3SE +/- 7.82, N = 3SE +/- 2.93, N = 3SE +/- 15.28, N = 33240.62826.02666.12196.31213.9-llzma-llzma-llzma-llzma1. (CC) gcc options: -O3 -pthread -lz

Stockfish

Total Time

OpenBenchmarking.orgNodes Per Second, More Is BetterStockfish 13Total Timec7g.4xlarge Graviton3c6a.4xlarge EPYCc6i.4xlarge Xeonc6g.4xlarge Graviton2a1.4xlarge Graviton6M12M18M24M30MSE +/- 153578.64, N = 3SE +/- 149731.77, N = 3SE +/- 242448.39, N = 3SE +/- 292329.99, N = 3SE +/- 123749.22, N = 32760889123857623220819612167924510980430-m64 -msse -msse3 -mpopcnt -mavx2 -msse4.1 -mssse3 -msse2 -mbmi2-m64 -msse -msse3 -mpopcnt -mavx2 -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi21. (CXX) g++ options: -lgcov -lpthread -fno-exceptions -std=c++17 -fprofile-use -fno-peel-loops -fno-tracer -pedantic -O3 -flto -flto=jobserver

Rodinia

Test: OpenMP LavaMD

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP LavaMDc7g.4xlarge Graviton3c6g.4xlarge Graviton2c6a.4xlarge EPYCc6i.4xlarge Xeona1.4xlarge Graviton80160240320400SE +/- 0.15, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.14, N = 3SE +/- 0.07, N = 3143.33215.67224.33281.39360.301. (CXX) g++ options: -O2 -lOpenCL

POV-Ray

Trace Time

OpenBenchmarking.orgSeconds, Fewer Is BetterPOV-Ray 3.7.0.7Trace Timec7g.4xlarge Graviton3c6a.4xlarge EPYCc6g.4xlarge Graviton2c6i.4xlarge Xeona1.4xlarge Graviton20406080100SE +/- 0.01, N = 3SE +/- 0.18, N = 3SE +/- 0.00, N = 3SE +/- 0.12, N = 3SE +/- 0.94, N = 1537.8649.4451.0552.7893.80-march=native-march=native1. (CXX) g++ options: -pipe -O3 -ffast-math -R/usr/lib -lXpm -lSM -lICE -lX11 -ltiff -ljpeg -lpng -lz -lrt -lm -lboost_thread -lboost_system

Zstd Compression

Compression Level: 19, Long Mode - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.0Compression Level: 19, Long Mode - Compression Speedc7g.4xlarge Graviton3c6i.4xlarge Xeonc6g.4xlarge Graviton2c6a.4xlarge EPYCa1.4xlarge Graviton918273645SE +/- 0.23, N = 3SE +/- 0.10, N = 3SE +/- 0.03, N = 3SE +/- 0.27, N = 3SE +/- 0.00, N = 339.533.831.025.916.0-llzma-llzma-llzma-llzma1. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 19 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.0Compression Level: 19 - Compression Speedc7g.4xlarge Graviton3c6i.4xlarge Xeonc6g.4xlarge Graviton2c6a.4xlarge EPYCa1.4xlarge Graviton918273645SE +/- 0.00, N = 3SE +/- 0.40, N = 3SE +/- 0.06, N = 3SE +/- 0.21, N = 3SE +/- 0.03, N = 341.238.134.630.016.9-llzma-llzma-llzma-llzma1. (CC) gcc options: -O3 -pthread -lz

DaCapo Benchmark

Java Test: H2

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: H2c6i.4xlarge Xeonc7g.4xlarge Graviton3c6a.4xlarge EPYCc6g.4xlarge Graviton2a1.4xlarge Graviton14002800420056007000SE +/- 32.93, N = 4SE +/- 32.57, N = 5SE +/- 27.42, N = 4SE +/- 45.89, N = 4SE +/- 63.66, N = 429212951301939646740

Stress-NG

Test: Crypto

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: Cryptoc7g.4xlarge Graviton3c6g.4xlarge Graviton2c6a.4xlarge EPYCa1.4xlarge Gravitonc6i.4xlarge Xeon5K10K15K20K25KSE +/- 32.01, N = 3SE +/- 92.83, N = 3SE +/- 3.93, N = 3SE +/- 6.29, N = 3SE +/- 5.89, N = 323181.8117924.1813556.0611985.3810210.341. (CC) gcc options: -O2 -std=gnu99 -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

asmFish

1024 Hash Memory, 26 Depth

OpenBenchmarking.orgNodes/second, More Is BetterasmFish 2018-07-231024 Hash Memory, 26 Depthc7g.4xlarge Graviton3c6g.4xlarge Graviton2c6a.4xlarge EPYCc6i.4xlarge Xeona1.4xlarge Graviton7M14M21M28M35MSE +/- 104795.40, N = 3SE +/- 359309.26, N = 3SE +/- 303648.79, N = 3SE +/- 325631.00, N = 3SE +/- 106812.26, N = 33213412326540482261876882374620015331550

Google SynthMark

Test: VoiceMark_100

OpenBenchmarking.orgVoices, More Is BetterGoogle SynthMark 20201109Test: VoiceMark_100c7g.4xlarge Graviton3c6a.4xlarge EPYCc6i.4xlarge Xeonc6g.4xlarge Graviton2a1.4xlarge Graviton150300450600750SE +/- 0.32, N = 3SE +/- 7.09, N = 3SE +/- 2.00, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3675.64663.07565.69470.39331.071. (CXX) g++ options: -lm -lpthread -std=c++11 -Ofast

OpenSSL

Algorithm: SHA256

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSL 3.0Algorithm: SHA256c7g.4xlarge Graviton3c6a.4xlarge EPYCc6g.4xlarge Graviton2c6i.4xlarge Xeona1.4xlarge Graviton3000M6000M9000M12000M15000MSE +/- 7739237.92, N = 3SE +/- 8616254.20, N = 3SE +/- 47755430.47, N = 3SE +/- 606684.16, N = 3SE +/- 12563225.46, N = 313722045973116914033531072318408370969939376785689517-m64-m641. (CC) gcc options: -pthread -O3 -lssl -lcrypto -ldl

Stress-NG

Test: Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: Vector Mathc7g.4xlarge Graviton3c6a.4xlarge EPYCc6i.4xlarge Xeonc6g.4xlarge Graviton2a1.4xlarge Graviton12K24K36K48K60KSE +/- 17.05, N = 3SE +/- 2.46, N = 3SE +/- 28.50, N = 3SE +/- 15.72, N = 3SE +/- 0.49, N = 355258.1753787.6140140.3037753.8927341.471. (CC) gcc options: -O2 -std=gnu99 -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

NAS Parallel Benchmarks

Test / Class: LU.C

OpenBenchmarking.orgTotal Mop/s, More Is BetterNAS Parallel Benchmarks 3.4Test / Class: LU.Cc6i.4xlarge Xeonc6a.4xlarge EPYCc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton8K16K24K32K40KSE +/- 160.86, N = 3SE +/- 18.06, N = 3SE +/- 1.96, N = 3SE +/- 0.90, N = 3SE +/- 0.15, N = 338136.7725140.557730.415133.892558.121. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.2

LeelaChessZero

Backend: Eigen

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.28Backend: Eigenc6i.4xlarge Xeonc7g.4xlarge Graviton3c6a.4xlarge EPYCc6g.4xlarge Graviton2a1.4xlarge Graviton30060090012001500SE +/- 13.37, N = 3SE +/- 9.70, N = 3SE +/- 11.74, N = 9SE +/- 12.00, N = 3SE +/- 0.67, N = 31466118910018341281. (CXX) g++ options: -flto -pthread

LeelaChessZero

Backend: BLAS

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.28Backend: BLASc6i.4xlarge Xeonc7g.4xlarge Graviton3c6a.4xlarge EPYCc6g.4xlarge Graviton2a1.4xlarge Graviton30060090012001500SE +/- 12.41, N = 9SE +/- 6.44, N = 3SE +/- 12.82, N = 9SE +/- 10.22, N = 4SE +/- 0.88, N = 31397110310918641351. (CXX) g++ options: -flto -pthread

Coremark

CoreMark Size 666 - Iterations Per Second

OpenBenchmarking.orgIterations/Sec, More Is BetterCoremark 1.0CoreMark Size 666 - Iterations Per Secondc7g.4xlarge Graviton3c6a.4xlarge EPYCc6g.4xlarge Graviton2c6i.4xlarge Xeona1.4xlarge Graviton90K180K270K360K450KSE +/- 3211.91, N = 3SE +/- 2163.00, N = 3SE +/- 49.84, N = 3SE +/- 80.93, N = 3SE +/- 116.54, N = 3405413.86345133.44315464.34285378.84203869.401. (CC) gcc options: -O2 -lrt" -lrt

N-Queens

Elapsed Time

OpenBenchmarking.orgSeconds, Fewer Is BetterN-Queens 1.0Elapsed Timec6a.4xlarge EPYCc6i.4xlarge Xeonc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton714212835SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 316.3818.8421.5423.1432.291. (CC) gcc options: -static -fopenmp -O3 -march=native

7-Zip Compression

Test: Decompression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 21.06Test: Decompression Ratingc7g.4xlarge Graviton3c6g.4xlarge Graviton2c6a.4xlarge EPYCc6i.4xlarge Xeona1.4xlarge Graviton16K32K48K64K80KSE +/- 12.88, N = 3SE +/- 239.68, N = 3SE +/- 142.56, N = 3SE +/- 35.00, N = 3SE +/- 31.21, N = 373054594455731845653408911. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

m-queens

Time To Solve

OpenBenchmarking.orgSeconds, Fewer Is Betterm-queens 1.2Time To Solvec7g.4xlarge Graviton3c6a.4xlarge EPYCc6g.4xlarge Graviton2c6i.4xlarge Xeona1.4xlarge Graviton20406080100SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.00, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 366.8272.3375.2291.23110.371. (CXX) g++ options: -fopenmp -O2 -march=native

Stress-NG

Test: IO_uring

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: IO_uringc6i.4xlarge Xeona1.4xlarge Gravitonc7g.4xlarge Graviton3c6g.4xlarge Graviton2c6a.4xlarge EPYC200K400K600K800K1000KSE +/- 405.56, N = 3SE +/- 3840.04, N = 3SE +/- 614.16, N = 3SE +/- 2395.13, N = 3SE +/- 713.03, N = 31037943.37918172.37843015.78770521.81768723.461. (CC) gcc options: -O2 -std=gnu99 -lm -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: super-resolution-10 - Device: CPU - Executor: Standardc6a.4xlarge EPYCc6i.4xlarge Xeonc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton8001600240032004000SE +/- 234.97, N = 12SE +/- 1.61, N = 3SE +/- 1.86, N = 3SE +/- 1.74, N = 3SE +/- 0.50, N = 336963450281720727571. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: ArcFace ResNet-100 - Device: CPU - Executor: Standardc6i.4xlarge Xeonc6a.4xlarge EPYCc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton30060090012001500SE +/- 91.51, N = 12SE +/- 82.60, N = 12SE +/- 0.00, N = 3SE +/- 0.17, N = 3SE +/- 0.50, N = 3137411926093341651. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: fcn-resnet101-11 - Device: CPU - Executor: Standardc6i.4xlarge Xeonc6a.4xlarge EPYCc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton306090120150SE +/- 0.60, N = 3SE +/- 5.55, N = 12SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3139653828101. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: bertsquad-12 - Device: CPU - Executor: Standardc6i.4xlarge Xeonc6a.4xlarge EPYCc7g.4xlarge Graviton3c6g.4xlarge Graviton2a1.4xlarge Graviton170340510680850SE +/- 50.92, N = 12SE +/- 0.58, N = 3SE +/- 0.17, N = 3SE +/- 0.17, N = 3SE +/- 0.88, N = 37734884073221151. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: GPT-2 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: GPT-2 - Device: CPU - Executor: Standardc7g.4xlarge Graviton3c6i.4xlarge Xeonc6g.4xlarge Graviton2c6a.4xlarge EPYCa1.4xlarge Graviton2K4K6K8K10KSE +/- 2.40, N = 3SE +/- 322.41, N = 12SE +/- 3.50, N = 3SE +/- 75.29, N = 12SE +/- 2.20, N = 3799079446948561723121. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt

TensorFlow Lite

Model: Mobilenet Quant

OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2022-05-18Model: Mobilenet Quantc7g.4xlarge Graviton3c6g.4xlarge Graviton2c6a.4xlarge EPYCc6i.4xlarge Xeona1.4xlarge Graviton12002400360048006000SE +/- 17.76, N = 3SE +/- 14.44, N = 3SE +/- 53.31, N = 15SE +/- 80.05, N = 12SE +/- 20.90, N = 31502.951980.243847.963967.395724.66

C-Ray

Total Time - 4K, 16 Rays Per Pixel

OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 1.1Total Time - 4K, 16 Rays Per Pixelc7g.4xlarge Graviton3c6g.4xlarge Graviton2c6a.4xlarge EPYCc6i.4xlarge Xeona1.4xlarge Graviton20406080100SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.77, N = 5SE +/- 0.04, N = 3SE +/- 2.00, N = 1538.5262.3269.3592.55104.761. (CC) gcc options: -lm -lpthread -O3

Rodinia

Test: OpenMP Streamcluster

OpenBenchmarking.orgSeconds, Fewer Is BetterRodinia 3.1Test: OpenMP Streamclusterc7g.4xlarge Graviton3c6g.4xlarge Graviton2c6a.4xlarge EPYCc6i.4xlarge Xeona1.4xlarge Graviton1122334455SE +/- 0.33, N = 12SE +/- 0.26, N = 15SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 313.3015.4818.3823.5147.431. (CXX) g++ options: -O2 -lOpenCL

Phoronix Test Suite v10.8.5