Amazon EC2 Graviton3 Benchmark Comparison Amazon AWS Graviton3 benchmarks by Michael Larabel. c7g.4xlarge Graviton3: Processor: ARMv8 Neoverse-V1 (16 Cores), Motherboard: Amazon EC2 c7g.4xlarge (1.0 BIOS), Chipset: Amazon Device 0200, Memory: 32GB, Disk: 193GB Amazon Elastic Block Store, Network: Amazon Elastic OS: Ubuntu 22.04, Kernel: 5.15.0-1004-aws (aarch64), Compiler: GCC 11.2.0, File-System: ext4, System Layer: amazon a1.4xlarge Graviton: Processor: ARMv8 Cortex-A72 (16 Cores), Motherboard: Amazon EC2 a1.4xlarge (1.0 BIOS), Chipset: Amazon Device 0200, Memory: 32GB, Disk: 193GB Amazon Elastic Block Store, Network: Amazon Elastic OS: Ubuntu 22.04, Kernel: 5.15.0-1004-aws (aarch64), Compiler: GCC 11.2.0, File-System: ext4, System Layer: amazon c6g.4xlarge Graviton2: Processor: ARMv8 Neoverse-N1 (16 Cores), Motherboard: Amazon EC2 c6g.4xlarge (1.0 BIOS), Chipset: Amazon Device 0200, Memory: 32GB, Disk: 193GB Amazon Elastic Block Store, Network: Amazon Elastic OS: Ubuntu 22.04, Kernel: 5.15.0-1004-aws (aarch64), Compiler: GCC 11.2.0, File-System: ext4, System Layer: amazon c6a.4xlarge EPYC: Processor: AMD EPYC 7R13 (8 Cores / 16 Threads), Motherboard: Amazon EC2 c6a.4xlarge (1.0 BIOS), Chipset: Intel 440FX 82441FX PMC, Memory: 32GB, Disk: 193GB Amazon Elastic Block Store, Network: Amazon Elastic OS: Ubuntu 22.04, Kernel: 5.15.0-1004-aws (x86_64), Compiler: GCC 11.2.0, File-System: ext4, System Layer: amazon c6i.4xlarge Xeon: Processor: Intel Xeon Platinum 8375C (8 Cores / 16 Threads), Motherboard: Amazon EC2 c6i.4xlarge (1.0 BIOS), Chipset: Intel 440FX 82441FX PMC, Memory: 32GB, Disk: 193GB Amazon Elastic Block Store, Network: Amazon Elastic OS: Ubuntu 22.04, Kernel: 5.15.0-1004-aws (x86_64), Compiler: GCC 11.2.0, File-System: ext4, System Layer: amazon Stress-NG 0.14 Test: Memory Copying Bogo Ops/s > Higher Is Better c7g.4xlarge Graviton3 . 6693.32 |============================================== a1.4xlarge Graviton ... 798.24 |===== c6g.4xlarge Graviton2 . 2903.00 |==================== c6a.4xlarge EPYC ...... 3551.80 |======================== c6i.4xlarge Xeon ...... 3150.49 |====================== NAS Parallel Benchmarks 3.4 Test / Class: MG.C Total Mop/s > Higher Is Better c7g.4xlarge Graviton3 . 13481.61 |======================= a1.4xlarge Graviton ... 3266.36 |====== c6g.4xlarge Graviton2 . 6720.68 |=========== c6a.4xlarge EPYC ...... 16826.43 |============================= c6i.4xlarge Xeon ...... 26298.81 |============================================= NAS Parallel Benchmarks 3.4 Test / Class: CG.C Total Mop/s > Higher Is Better c7g.4xlarge Graviton3 . 6571.95 |================================ a1.4xlarge Graviton ... 1213.15 |====== c6g.4xlarge Graviton2 . 3520.86 |================= c6a.4xlarge EPYC ...... 6169.22 |============================== c6i.4xlarge Xeon ...... 9522.82 |============================================== NAS Parallel Benchmarks 3.4 Test / Class: SP.C Total Mop/s > Higher Is Better c7g.4xlarge Graviton3 . 4467.19 |===================== a1.4xlarge Graviton ... 1293.80 |====== c6g.4xlarge Graviton2 . 2356.16 |=========== c6a.4xlarge EPYC ...... 8094.79 |======================================= c6i.4xlarge Xeon ...... 9563.22 |============================================== Zstd Compression 1.5.0 Compression Level: 3 - Compression Speed MB/s > Higher Is Better c6g.4xlarge Graviton2 . 2888.3 |============================= c6a.4xlarge EPYC ...... 2784.0 |============================ c7g.4xlarge Graviton3 . 4639.1 |=============================================== a1.4xlarge Graviton ... 633.9 |====== c6g.4xlarge Graviton2 . 2878.8 |============================= c6a.4xlarge EPYC ...... 2768.7 |============================ c6i.4xlarge Xeon ...... 3440.6 |=================================== NAS Parallel Benchmarks 3.4 Test / Class: FT.C Total Mop/s > Higher Is Better c7g.4xlarge Graviton3 . 11791.77 |========================== a1.4xlarge Graviton ... 2927.16 |====== c6g.4xlarge Graviton2 . 6244.48 |============== c6a.4xlarge EPYC ...... 18299.96 |======================================== c6i.4xlarge Xeon ...... 20423.57 |============================================= High Performance Conjugate Gradient 3.1 GFLOP/s > Higher Is Better c7g.4xlarge Graviton3 . 26.30580 |============================================= a1.4xlarge Graviton ... 3.77834 |====== c6g.4xlarge Graviton2 . 19.72180 |================================== c6a.4xlarge EPYC ...... 5.06042 |========= c6i.4xlarge Xeon ...... 8.66031 |=============== Algebraic Multi-Grid Benchmark 1.2 Figure Of Merit > Higher Is Better c7g.4xlarge Graviton3 . 1258807333 |=========================================== a1.4xlarge Graviton ... 186716933 |====== c6g.4xlarge Graviton2 . 932652900 |================================ c6a.4xlarge EPYC ...... 267670700 |========= c6i.4xlarge Xeon ...... 661364767 |======================= Xcompact3d Incompact3d 2021-03-11 Input: input.i3d 129 Cells Per Direction Seconds < Lower Is Better c7g.4xlarge Graviton3 . 8.01671425 |====== a1.4xlarge Graviton ... 53.77062740 |========================================== c6g.4xlarge Graviton2 . 11.57335470 |========= c6a.4xlarge EPYC ...... 28.27976610 |====================== c6i.4xlarge Xeon ...... 17.86827720 |============== ACES DGEMM 1.0 Sustained Floating-Point Rate GFLOP/s > Higher Is Better c7g.4xlarge Graviton3 . 5.853864 |============================================= a1.4xlarge Graviton ... 0.891391 |======= c6g.4xlarge Graviton2 . 4.785123 |===================================== c6a.4xlarge EPYC ...... 2.432432 |=================== c6i.4xlarge Xeon ...... 2.230545 |================= Xcompact3d Incompact3d 2021-03-11 Input: input.i3d 193 Cells Per Direction Seconds < Lower Is Better c7g.4xlarge Graviton3 . 29.13 |======= a1.4xlarge Graviton ... 182.58 |=============================================== c6g.4xlarge Graviton2 . 41.02 |=========== c6a.4xlarge EPYC ...... 110.77 |============================= c6i.4xlarge Xeon ...... 69.22 |================== Stress-NG 0.14 Test: CPU Stress Bogo Ops/s > Higher Is Better c7g.4xlarge Graviton3 . 5029.71 |================= a1.4xlarge Graviton ... 2366.00 |======== c6g.4xlarge Graviton2 . 3404.94 |============ c6a.4xlarge EPYC ...... 13304.50 |============================================= c6i.4xlarge Xeon ...... 12527.16 |========================================== simdjson 1.0 Throughput Test: DistinctUserID GB/s > Higher Is Better c7g.4xlarge Graviton3 . 2.69 |=============================== a1.4xlarge Graviton ... 0.80 |========= c6g.4xlarge Graviton2 . 1.53 |================= c6a.4xlarge EPYC ...... 4.30 |================================================= c6i.4xlarge Xeon ...... 4.30 |================================================= Timed MrBayes Analysis 3.2.7 Primate Phylogeny Analysis Seconds < Lower Is Better c7g.4xlarge Graviton3 . 251.40 |================== a1.4xlarge Graviton ... 644.79 |=============================================== c6g.4xlarge Graviton2 . 384.75 |============================ c6a.4xlarge EPYC ...... 120.64 |========= c6i.4xlarge Xeon ...... 134.92 |========== NAS Parallel Benchmarks 3.4 Test / Class: IS.D Total Mop/s > Higher Is Better c7g.4xlarge Graviton3 . 1041.90 |============================================== a1.4xlarge Graviton ... 197.57 |========= c6g.4xlarge Graviton2 . 372.76 |================ c6a.4xlarge EPYC ...... 541.35 |======================== c6i.4xlarge Xeon ...... 861.57 |====================================== TensorFlow Lite 2022-05-18 Model: Mobilenet Float Microseconds < Lower Is Better c7g.4xlarge Graviton3 . 2156.60 |========== a1.4xlarge Graviton ... 9990.15 |============================================== c6g.4xlarge Graviton2 . 2500.87 |============ c6a.4xlarge EPYC ...... 2159.72 |========== c6i.4xlarge Xeon ...... 1965.07 |========= GPAW 22.1 Input: Carbon Nanotube Seconds < Lower Is Better c7g.4xlarge Graviton3 . 155.18 |========= a1.4xlarge Graviton ... 769.35 |=============================================== c6g.4xlarge Graviton2 . 215.53 |============= c6a.4xlarge EPYC ...... 302.96 |=================== c6i.4xlarge Xeon ...... 202.11 |============ libavif avifenc 0.10 Encoder Speed: 2 Seconds < Lower Is Better c7g.4xlarge Graviton3 . 141.70 |=============== a1.4xlarge Graviton ... 449.02 |=============================================== c6g.4xlarge Graviton2 . 238.21 |========================= c6a.4xlarge EPYC ...... 93.95 |========== c6i.4xlarge Xeon ...... 97.74 |========== simdjson 1.0 Throughput Test: PartialTweets GB/s > Higher Is Better c7g.4xlarge Graviton3 . 2.62 |=================================== a1.4xlarge Graviton ... 0.78 |========== c6g.4xlarge Graviton2 . 1.51 |==================== c6a.4xlarge EPYC ...... 3.64 |================================================ c6i.4xlarge Xeon ...... 3.71 |================================================= LULESH 2.0.3 z/s > Higher Is Better c7g.4xlarge Graviton3 . 10940.94 |============================================= a1.4xlarge Graviton ... 2328.27 |========== c6g.4xlarge Graviton2 . 6016.16 |========================= c6a.4xlarge EPYC ...... 5452.11 |====================== c6i.4xlarge Xeon ...... 8112.37 |================================= Apache HTTP Server 2.4.48 Concurrent Requests: 100 Requests Per Second > Higher Is Better c7g.4xlarge Graviton3 . 67231.88 |=================================== a1.4xlarge Graviton ... 18636.43 |========== c6g.4xlarge Graviton2 . 46995.35 |======================== c6a.4xlarge EPYC ...... 77567.69 |======================================== c6i.4xlarge Xeon ...... 86545.57 |============================================= ASTC Encoder 3.2 Preset: Thorough Seconds < Lower Is Better c7g.4xlarge Graviton3 . 13.9248 |=================== a1.4xlarge Graviton ... 33.5198 |============================================== c6g.4xlarge Graviton2 . 16.5222 |======================= c6a.4xlarge EPYC ...... 7.9818 |=========== c6i.4xlarge Xeon ...... 7.2625 |========== GROMACS 2022.1 Implementation: MPI CPU - Input: water_GMX50_bare Ns Per Day > Higher Is Better c7g.4xlarge Graviton3 . 1.128 |===================================== a1.4xlarge Graviton ... 0.316 |========== c6g.4xlarge Graviton2 . 0.781 |========================== c6a.4xlarge EPYC ...... 1.004 |================================= c6i.4xlarge Xeon ...... 1.452 |================================================ TensorFlow Lite 2022-05-18 Model: Inception V4 Microseconds < Lower Is Better c7g.4xlarge Graviton3 . 41855.1 |========== a1.4xlarge Graviton ... 188910.0 |============================================= c6g.4xlarge Graviton2 . 46793.9 |=========== c6a.4xlarge EPYC ...... 44920.6 |=========== c6i.4xlarge Xeon ...... 41185.7 |========== Apache HTTP Server 2.4.48 Concurrent Requests: 500 Requests Per Second > Higher Is Better c7g.4xlarge Graviton3 . 73546.32 |==================================== a1.4xlarge Graviton ... 20133.49 |========== c6g.4xlarge Graviton2 . 50077.81 |========================= c6a.4xlarge EPYC ...... 81995.64 |======================================== c6i.4xlarge Xeon ...... 91746.57 |============================================= Apache HTTP Server 2.4.48 Concurrent Requests: 200 Requests Per Second > Higher Is Better c7g.4xlarge Graviton3 . 73676.95 |=================================== a1.4xlarge Graviton ... 20887.58 |========== c6g.4xlarge Graviton2 . 50059.97 |======================== c6a.4xlarge EPYC ...... 83070.00 |======================================== c6i.4xlarge Xeon ...... 94458.22 |============================================= simdjson 1.0 Throughput Test: Kostya GB/s > Higher Is Better c7g.4xlarge Graviton3 . 1.94 |================================== a1.4xlarge Graviton ... 0.63 |=========== c6g.4xlarge Graviton2 . 1.19 |===================== c6a.4xlarge EPYC ...... 2.80 |================================================= c6i.4xlarge Xeon ...... 2.46 |=========================================== NAS Parallel Benchmarks 3.4 Test / Class: BT.C Total Mop/s > Higher Is Better c7g.4xlarge Graviton3 . 10339.53 |================================== a1.4xlarge Graviton ... 3148.18 |========== c6g.4xlarge Graviton2 . 6449.11 |===================== c6a.4xlarge EPYC ...... 13134.46 |=========================================== c6i.4xlarge Xeon ...... 13888.40 |============================================= OpenSSL 3.0 Algorithm: RSA4096 sign/s > Higher Is Better c7g.4xlarge Graviton3 . 2546.4 |=============================================== a1.4xlarge Graviton ... 588.3 |=========== c6g.4xlarge Graviton2 . 660.6 |============ c6a.4xlarge EPYC ...... 2088.9 |======================================= c6i.4xlarge Xeon ...... 2161.3 |======================================== TensorFlow Lite 2022-05-18 Model: Inception ResNet V2 Microseconds < Lower Is Better c7g.4xlarge Graviton3 . 40051.3 |=========== a1.4xlarge Graviton ... 171169.0 |============================================= c6g.4xlarge Graviton2 . 45955.7 |============ c6a.4xlarge EPYC ...... 41366.6 |=========== c6i.4xlarge Xeon ...... 41179.7 |=========== Apache HTTP Server 2.4.48 Concurrent Requests: 1000 Requests Per Second > Higher Is Better c7g.4xlarge Graviton3 . 72719.33 |========================================= a1.4xlarge Graviton ... 19278.68 |=========== c6g.4xlarge Graviton2 . 46629.45 |========================== c6a.4xlarge EPYC ...... 71537.11 |======================================== c6i.4xlarge Xeon ...... 79830.96 |============================================= TensorFlow Lite 2022-05-18 Model: SqueezeNet Microseconds < Lower Is Better c7g.4xlarge Graviton3 . 3257.94 |============ a1.4xlarge Graviton ... 12014.70 |============================================= c6g.4xlarge Graviton2 . 3969.35 |=============== c6a.4xlarge EPYC ...... 3103.12 |============ c6i.4xlarge Xeon ...... 2983.93 |=========== ASTC Encoder 3.2 Preset: Exhaustive Seconds < Lower Is Better c7g.4xlarge Graviton3 . 139.38 |======================== a1.4xlarge Graviton ... 277.77 |=============================================== c6g.4xlarge Graviton2 . 159.20 |=========================== c6a.4xlarge EPYC ...... 72.39 |============ c6i.4xlarge Xeon ...... 69.64 |============ Rodinia 3.1 Test: OpenMP CFD Solver Seconds < Lower Is Better c7g.4xlarge Graviton3 . 10.48 |============ a1.4xlarge Graviton ... 41.45 |================================================ c6g.4xlarge Graviton2 . 17.04 |==================== c6a.4xlarge EPYC ...... 21.79 |========================= c6i.4xlarge Xeon ...... 20.45 |======================== OpenSSL 3.0 Algorithm: RSA4096 verify/s > Higher Is Better c7g.4xlarge Graviton3 . 178460.4 |============================================= a1.4xlarge Graviton ... 45328.6 |=========== c6g.4xlarge Graviton2 . 53951.5 |============== c6a.4xlarge EPYC ...... 136784.2 |================================== c6i.4xlarge Xeon ...... 140964.4 |==================================== libavif avifenc 0.10 Encoder Speed: 0 Seconds < Lower Is Better c7g.4xlarge Graviton3 . 256.84 |================ a1.4xlarge Graviton ... 768.30 |=============================================== c6g.4xlarge Graviton2 . 406.94 |========================= c6a.4xlarge EPYC ...... 195.53 |============ c6i.4xlarge Xeon ...... 204.99 |============= Timed Node.js Compilation 17.3 Time To Compile Seconds < Lower Is Better c7g.4xlarge Graviton3 . 497.58 |============= a1.4xlarge Graviton ... 1765.91 |============================================== c6g.4xlarge Graviton2 . 628.40 |================ c6a.4xlarge EPYC ...... 664.35 |================= c6i.4xlarge Xeon ...... 604.62 |================ LAMMPS Molecular Dynamics Simulator 29Oct2020 Model: Rhodopsin Protein ns/day > Higher Is Better c7g.4xlarge Graviton3 . 11.291 |=============================================== a1.4xlarge Graviton ... 3.245 |============== c6g.4xlarge Graviton2 . 7.935 |================================= c6a.4xlarge EPYC ...... 5.067 |===================== c6i.4xlarge Xeon ...... 6.220 |========================== PyBench 2018-02-16 Total For Average Test Times Milliseconds < Lower Is Better c7g.4xlarge Graviton3 . 1185 |================= a1.4xlarge Graviton ... 3452 |================================================= c6g.4xlarge Graviton2 . 1741 |========================= c6a.4xlarge EPYC ...... 1961 |============================ c6i.4xlarge Xeon ...... 997 |============== PHPBench 0.8.1 PHP Benchmark Suite Score > Higher Is Better c7g.4xlarge Graviton3 . 666484 |====================================== a1.4xlarge Graviton ... 241259 |============== c6g.4xlarge Graviton2 . 449855 |========================== c6a.4xlarge EPYC ...... 480741 |=========================== c6i.4xlarge Xeon ...... 828186 |=============================================== Timed ImageMagick Compilation 6.9.0 Time To Compile Seconds < Lower Is Better c7g.4xlarge Graviton3 . 27.90 |============== a1.4xlarge Graviton ... 93.63 |================================================ c6g.4xlarge Graviton2 . 40.33 |===================== c6a.4xlarge EPYC ...... 32.63 |================= c6i.4xlarge Xeon ...... 29.74 |=============== TensorFlow Lite 2022-05-18 Model: NASNet Mobile Microseconds < Lower Is Better c7g.4xlarge Graviton3 . 11591.90 |================= a1.4xlarge Graviton ... 30986.70 |============================================= c6g.4xlarge Graviton2 . 14985.40 |====================== c6a.4xlarge EPYC ...... 9266.86 |============= c6i.4xlarge Xeon ...... 10900.60 |================ Timed Apache Compilation 2.4.41 Time To Compile Seconds < Lower Is Better c7g.4xlarge Graviton3 . 26.94 |================= a1.4xlarge Graviton ... 74.74 |================================================ c6g.4xlarge Graviton2 . 34.20 |====================== c6a.4xlarge EPYC ...... 23.53 |=============== c6i.4xlarge Xeon ...... 22.53 |============== DaCapo Benchmark 9.12-MR1 Java Test: Jython msec < Lower Is Better c7g.4xlarge Graviton3 . 3940 |=============== a1.4xlarge Graviton ... 12997 |================================================ c6g.4xlarge Graviton2 . 5626 |===================== c6a.4xlarge EPYC ...... 4616 |================= c6i.4xlarge Xeon ...... 4013 |=============== Timed LLVM Compilation 13.0 Build System: Ninja Seconds < Lower Is Better c7g.4xlarge Graviton3 . 544.93 |============== a1.4xlarge Graviton ... 1784.60 |============================================== c6g.4xlarge Graviton2 . 682.98 |================== c6a.4xlarge EPYC ...... 760.34 |==================== c6i.4xlarge Xeon ...... 685.70 |================== NAS Parallel Benchmarks 3.4 Test / Class: EP.D Total Mop/s > Higher Is Better c7g.4xlarge Graviton3 . 934.72 |======================================= a1.4xlarge Graviton ... 339.20 |============== c6g.4xlarge Graviton2 . 558.88 |======================= c6a.4xlarge EPYC ...... 466.21 |=================== c6i.4xlarge Xeon ...... 1103.22 |============================================== Ngspice 34 Circuit: C2670 Seconds < Lower Is Better c7g.4xlarge Graviton3 . 198.22 |==================== a1.4xlarge Graviton ... 473.90 |=============================================== c6g.4xlarge Graviton2 . 263.72 |========================== c6a.4xlarge EPYC ...... 245.89 |======================== c6i.4xlarge Xeon ...... 147.89 |=============== DaCapo Benchmark 9.12-MR1 Java Test: Tradesoap msec < Lower Is Better c7g.4xlarge Graviton3 . 3524 |=============== a1.4xlarge Graviton ... 11182 |================================================ c6g.4xlarge Graviton2 . 4506 |=================== c6a.4xlarge EPYC ...... 4052 |================= c6i.4xlarge Xeon ...... 3815 |================ simdjson 1.0 Throughput Test: LargeRandom GB/s > Higher Is Better c7g.4xlarge Graviton3 . 0.70 |==================================== a1.4xlarge Graviton ... 0.30 |=============== c6g.4xlarge Graviton2 . 0.49 |========================= c6a.4xlarge EPYC ...... 0.95 |================================================= c6i.4xlarge Xeon ...... 0.86 |============================================ SecureMark 1.0.4 Benchmark: SecureMark-TLS marks > Higher Is Better c7g.4xlarge Graviton3 . 183708 |===================================== a1.4xlarge Graviton ... 74356 |=============== c6g.4xlarge Graviton2 . 120301 |========================= c6a.4xlarge EPYC ...... 213288 |=========================================== c6i.4xlarge Xeon ...... 230549 |=============================================== DaCapo Benchmark 9.12-MR1 Java Test: Tradebeans msec < Lower Is Better c7g.4xlarge Graviton3 . 3203 |================= a1.4xlarge Graviton ... 9045 |================================================= c6g.4xlarge Graviton2 . 4344 |======================== c6a.4xlarge EPYC ...... 3167 |================= c6i.4xlarge Xeon ...... 2928 |================ Liquid-DSP 2021.01.31 Threads: 16 - Buffer Length: 256 - Filter Length: 57 samples/s > Higher Is Better c7g.4xlarge Graviton3 . 383606667 |================================= a1.4xlarge Graviton ... 165513333 |============== c6g.4xlarge Graviton2 . 262890000 |======================= c6a.4xlarge EPYC ...... 509746667 |============================================ c6i.4xlarge Xeon ...... 373100000 |================================ Build2 0.13 Time To Compile Seconds < Lower Is Better c7g.4xlarge Graviton3 . 115.02 |=============== a1.4xlarge Graviton ... 353.91 |=============================================== c6g.4xlarge Graviton2 . 142.28 |=================== c6a.4xlarge EPYC ...... 150.99 |==================== c6i.4xlarge Xeon ...... 136.80 |================== Timed PHP Compilation 7.4.2 Time To Compile Seconds < Lower Is Better c7g.4xlarge Graviton3 . 69.48 |================= a1.4xlarge Graviton ... 196.03 |=============================================== c6g.4xlarge Graviton2 . 88.90 |===================== c6a.4xlarge EPYC ...... 67.08 |================ c6i.4xlarge Xeon ...... 64.34 |=============== 7-Zip Compression 21.06 Test: Compression Rating MIPS > Higher Is Better c7g.4xlarge Graviton3 . 97824 |================================================ a1.4xlarge Graviton ... 32498 |================ c6g.4xlarge Graviton2 . 71285 |=================================== c6a.4xlarge EPYC ...... 62562 |=============================== c6i.4xlarge Xeon ...... 66631 |================================= Ngspice 34 Circuit: C7552 Seconds < Lower Is Better c7g.4xlarge Graviton3 . 191.29 |=================== a1.4xlarge Graviton ... 480.79 |=============================================== c6g.4xlarge Graviton2 . 255.21 |========================= c6a.4xlarge EPYC ...... 180.36 |================== c6i.4xlarge Xeon ...... 161.08 |================ WebP Image Encode 1.1 Encode Settings: Quality 100, Lossless, Highest Compression Encode Time - Seconds < Lower Is Better c7g.4xlarge Graviton3 . 48.21 |================== a1.4xlarge Graviton ... 124.71 |=============================================== c6g.4xlarge Graviton2 . 66.15 |========================= c6a.4xlarge EPYC ...... 48.68 |================== c6i.4xlarge Xeon ...... 41.81 |================ Timed Gem5 Compilation 21.2 Time To Compile Seconds < Lower Is Better c7g.4xlarge Graviton3 . 391.17 |================ a1.4xlarge Graviton ... 1155.62 |============================================== c6g.4xlarge Graviton2 . 488.81 |=================== c6a.4xlarge EPYC ...... 515.20 |===================== c6i.4xlarge Xeon ...... 469.94 |=================== WebP Image Encode 1.1 Encode Settings: Quality 100, Lossless Encode Time - Seconds < Lower Is Better c7g.4xlarge Graviton3 . 22.77 |================== a1.4xlarge Graviton ... 61.80 |================================================ c6g.4xlarge Graviton2 . 31.08 |======================== c6a.4xlarge EPYC ...... 26.71 |===================== c6i.4xlarge Xeon ...... 21.12 |================ libavif avifenc 0.10 Encoder Speed: 6, Lossless Seconds < Lower Is Better c7g.4xlarge Graviton3 . 11.91 |================= a1.4xlarge Graviton ... 33.99 |================================================ c6g.4xlarge Graviton2 . 16.52 |======================= c6a.4xlarge EPYC ...... 16.39 |======================= c6i.4xlarge Xeon ...... 17.53 |========================= nginx 1.21.1 Concurrent Requests: 1000 Requests Per Second > Higher Is Better c7g.4xlarge Graviton3 . 346814.75 |======================================= a1.4xlarge Graviton ... 138205.11 |================ c6g.4xlarge Graviton2 . 308213.13 |=================================== c6a.4xlarge EPYC ...... 388657.76 |============================================ c6i.4xlarge Xeon ...... 347345.49 |======================================= nginx 1.21.1 Concurrent Requests: 500 Requests Per Second > Higher Is Better c7g.4xlarge Graviton3 . 346613.34 |======================================= a1.4xlarge Graviton ... 139414.84 |================ c6g.4xlarge Graviton2 . 310596.58 |=================================== c6a.4xlarge EPYC ...... 389030.11 |============================================ c6i.4xlarge Xeon ...... 351672.92 |======================================== nginx 1.21.1 Concurrent Requests: 200 Requests Per Second > Higher Is Better c7g.4xlarge Graviton3 . 352380.98 |======================================== a1.4xlarge Graviton ... 141436.20 |================ c6g.4xlarge Graviton2 . 308938.67 |=================================== c6a.4xlarge EPYC ...... 390932.79 |============================================ c6i.4xlarge Xeon ...... 356829.93 |======================================== Zstd Compression 1.5.0 Compression Level: 19 - Decompression Speed MB/s > Higher Is Better c7g.4xlarge Graviton3 . 3050.3 |=============================================== a1.4xlarge Graviton ... 1121.7 |================= c6g.4xlarge Graviton2 . 2051.6 |================================ c6a.4xlarge EPYC ...... 2907.5 |============================================= c6i.4xlarge Xeon ...... 2582.0 |======================================== nginx 1.21.1 Concurrent Requests: 100 Requests Per Second > Higher Is Better c7g.4xlarge Graviton3 . 345710.87 |======================================= a1.4xlarge Graviton ... 143155.48 |================ c6g.4xlarge Graviton2 . 307349.36 |=================================== c6a.4xlarge EPYC ...... 388010.76 |============================================ c6i.4xlarge Xeon ...... 356302.84 |======================================== TSCP 1.81 AI Chess Performance Nodes Per Second > Higher Is Better c7g.4xlarge Graviton3 . 1370094 |============================================ a1.4xlarge Graviton ... 538500 |================= c6g.4xlarge Graviton2 . 872313 |============================ c6a.4xlarge EPYC ...... 1442631 |============================================== c6i.4xlarge Xeon ...... 1272596 |========================================= Zstd Compression 1.5.0 Compression Level: 19, Long Mode - Decompression Speed MB/s > Higher Is Better c7g.4xlarge Graviton3 . 3240.6 |=============================================== a1.4xlarge Graviton ... 1213.9 |================== c6g.4xlarge Graviton2 . 2196.3 |================================ c6a.4xlarge EPYC ...... 2826.0 |========================================= c6i.4xlarge Xeon ...... 2666.1 |======================================= Stockfish 13 Total Time Nodes Per Second > Higher Is Better c7g.4xlarge Graviton3 . 27608891 |============================================= a1.4xlarge Graviton ... 10980430 |================== c6g.4xlarge Graviton2 . 21679245 |=================================== c6a.4xlarge EPYC ...... 23857623 |======================================= c6i.4xlarge Xeon ...... 22081961 |==================================== Rodinia 3.1 Test: OpenMP LavaMD Seconds < Lower Is Better c7g.4xlarge Graviton3 . 143.33 |=================== a1.4xlarge Graviton ... 360.30 |=============================================== c6g.4xlarge Graviton2 . 215.67 |============================ c6a.4xlarge EPYC ...... 224.33 |============================= c6i.4xlarge Xeon ...... 281.39 |===================================== POV-Ray 3.7.0.7 Trace Time Seconds < Lower Is Better c7g.4xlarge Graviton3 . 37.86 |=================== a1.4xlarge Graviton ... 93.80 |================================================ c6g.4xlarge Graviton2 . 51.05 |========================== c6a.4xlarge EPYC ...... 49.44 |========================= c6i.4xlarge Xeon ...... 52.78 |=========================== Zstd Compression 1.5.0 Compression Level: 19, Long Mode - Compression Speed MB/s > Higher Is Better c7g.4xlarge Graviton3 . 39.5 |================================================= a1.4xlarge Graviton ... 16.0 |==================== c6g.4xlarge Graviton2 . 31.0 |====================================== c6a.4xlarge EPYC ...... 25.9 |================================ c6i.4xlarge Xeon ...... 33.8 |========================================== Zstd Compression 1.5.0 Compression Level: 19 - Compression Speed MB/s > Higher Is Better c7g.4xlarge Graviton3 . 41.2 |================================================= a1.4xlarge Graviton ... 16.9 |==================== c6g.4xlarge Graviton2 . 34.6 |========================================= c6a.4xlarge EPYC ...... 30.0 |==================================== c6i.4xlarge Xeon ...... 38.1 |============================================= DaCapo Benchmark 9.12-MR1 Java Test: H2 msec < Lower Is Better c7g.4xlarge Graviton3 . 2951 |===================== a1.4xlarge Graviton ... 6740 |================================================= c6g.4xlarge Graviton2 . 3964 |============================= c6a.4xlarge EPYC ...... 3019 |====================== c6i.4xlarge Xeon ...... 2921 |===================== Stress-NG 0.14 Test: Crypto Bogo Ops/s > Higher Is Better c7g.4xlarge Graviton3 . 23181.81 |============================================= a1.4xlarge Graviton ... 11985.38 |======================= c6g.4xlarge Graviton2 . 17924.18 |=================================== c6a.4xlarge EPYC ...... 13556.06 |========================== c6i.4xlarge Xeon ...... 10210.34 |==================== asmFish 2018-07-23 1024 Hash Memory, 26 Depth Nodes/second > Higher Is Better c7g.4xlarge Graviton3 . 32134123 |============================================= a1.4xlarge Graviton ... 15331550 |===================== c6g.4xlarge Graviton2 . 26540482 |===================================== c6a.4xlarge EPYC ...... 26187688 |===================================== c6i.4xlarge Xeon ...... 23746200 |================================= Google SynthMark 20201109 Test: VoiceMark_100 Voices > Higher Is Better c7g.4xlarge Graviton3 . 675.64 |=============================================== a1.4xlarge Graviton ... 331.07 |======================= c6g.4xlarge Graviton2 . 470.39 |================================= c6a.4xlarge EPYC ...... 663.07 |============================================== c6i.4xlarge Xeon ...... 565.69 |======================================= OpenSSL 3.0 Algorithm: SHA256 byte/s > Higher Is Better c7g.4xlarge Graviton3 . 13722045973 |========================================== a1.4xlarge Graviton ... 6785689517 |===================== c6g.4xlarge Graviton2 . 10723184083 |================================= c6a.4xlarge EPYC ...... 11691403353 |==================================== c6i.4xlarge Xeon ...... 7096993937 |====================== Stress-NG 0.14 Test: Vector Math Bogo Ops/s > Higher Is Better c7g.4xlarge Graviton3 . 55258.17 |============================================= a1.4xlarge Graviton ... 27341.47 |====================== c6g.4xlarge Graviton2 . 37753.89 |=============================== c6a.4xlarge EPYC ...... 53787.61 |============================================ c6i.4xlarge Xeon ...... 40140.30 |================================= NAS Parallel Benchmarks 3.4 Test / Class: LU.C Total Mop/s > Higher Is Better c7g.4xlarge Graviton3 . 7730.41 |========= a1.4xlarge Graviton ... 2558.12 |=== c6g.4xlarge Graviton2 . 5133.89 |====== c6a.4xlarge EPYC ...... 25140.55 |============================== c6i.4xlarge Xeon ...... 38136.77 |============================================= LeelaChessZero 0.28 Backend: Eigen Nodes Per Second > Higher Is Better c7g.4xlarge Graviton3 . 1189 |======================================== a1.4xlarge Graviton ... 128 |==== c6g.4xlarge Graviton2 . 834 |============================ c6a.4xlarge EPYC ...... 1001 |================================= c6i.4xlarge Xeon ...... 1466 |================================================= LeelaChessZero 0.28 Backend: BLAS Nodes Per Second > Higher Is Better c7g.4xlarge Graviton3 . 1103 |======================================= a1.4xlarge Graviton ... 135 |===== c6g.4xlarge Graviton2 . 864 |============================== c6a.4xlarge EPYC ...... 1091 |====================================== c6i.4xlarge Xeon ...... 1397 |================================================= Coremark 1.0 CoreMark Size 666 - Iterations Per Second Iterations/Sec > Higher Is Better c7g.4xlarge Graviton3 . 405413.86 |============================================ a1.4xlarge Graviton ... 203869.40 |====================== c6g.4xlarge Graviton2 . 315464.34 |================================== c6a.4xlarge EPYC ...... 345133.44 |===================================== c6i.4xlarge Xeon ...... 285378.84 |=============================== N-Queens 1.0 Elapsed Time Seconds < Lower Is Better c7g.4xlarge Graviton3 . 21.54 |================================ a1.4xlarge Graviton ... 32.29 |================================================ c6g.4xlarge Graviton2 . 23.14 |================================== c6a.4xlarge EPYC ...... 16.38 |======================== c6i.4xlarge Xeon ...... 18.84 |============================ 7-Zip Compression 21.06 Test: Decompression Rating MIPS > Higher Is Better c7g.4xlarge Graviton3 . 73054 |================================================ a1.4xlarge Graviton ... 40891 |=========================== c6g.4xlarge Graviton2 . 59445 |======================================= c6a.4xlarge EPYC ...... 57318 |====================================== c6i.4xlarge Xeon ...... 45653 |============================== m-queens 1.2 Time To Solve Seconds < Lower Is Better c7g.4xlarge Graviton3 . 66.82 |============================ a1.4xlarge Graviton ... 110.37 |=============================================== c6g.4xlarge Graviton2 . 75.22 |================================ c6a.4xlarge EPYC ...... 72.33 |=============================== c6i.4xlarge Xeon ...... 91.23 |======================================= Stress-NG 0.14 Test: IO_uring Bogo Ops/s > Higher Is Better c7g.4xlarge Graviton3 . 843015.78 |=================================== a1.4xlarge Graviton ... 918172.37 |====================================== c6g.4xlarge Graviton2 . 770521.81 |================================ c6a.4xlarge EPYC ...... 768723.46 |================================ c6i.4xlarge Xeon ...... 1037943.37 |=========================================== ONNX Runtime 1.11 Model: super-resolution-10 - Device: CPU - Executor: Standard Inferences Per Minute > Higher Is Better c7g.4xlarge Graviton3 . 2817 |===================================== a1.4xlarge Graviton ... 757 |========== c6g.4xlarge Graviton2 . 2072 |=========================== c6a.4xlarge EPYC ...... 3696 |================================================= c6i.4xlarge Xeon ...... 3450 |============================================== ONNX Runtime 1.11 Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard Inferences Per Minute > Higher Is Better c7g.4xlarge Graviton3 . 609 |====================== a1.4xlarge Graviton ... 165 |====== c6g.4xlarge Graviton2 . 334 |============ c6a.4xlarge EPYC ...... 1192 |=========================================== c6i.4xlarge Xeon ...... 1374 |================================================= ONNX Runtime 1.11 Model: fcn-resnet101-11 - Device: CPU - Executor: Standard Inferences Per Minute > Higher Is Better c7g.4xlarge Graviton3 . 38 |============== a1.4xlarge Graviton ... 10 |==== c6g.4xlarge Graviton2 . 28 |========== c6a.4xlarge EPYC ...... 65 |======================= c6i.4xlarge Xeon ...... 139 |================================================== ONNX Runtime 1.11 Model: bertsquad-12 - Device: CPU - Executor: Standard Inferences Per Minute > Higher Is Better c7g.4xlarge Graviton3 . 407 |========================== a1.4xlarge Graviton ... 115 |======= c6g.4xlarge Graviton2 . 322 |===================== c6a.4xlarge EPYC ...... 488 |================================ c6i.4xlarge Xeon ...... 773 |================================================== ONNX Runtime 1.11 Model: GPT-2 - Device: CPU - Executor: Standard Inferences Per Minute > Higher Is Better c7g.4xlarge Graviton3 . 7990 |================================================= a1.4xlarge Graviton ... 2312 |============== c6g.4xlarge Graviton2 . 6948 |=========================================== c6a.4xlarge EPYC ...... 5617 |================================== c6i.4xlarge Xeon ...... 7944 |================================================= TensorFlow Lite 2022-05-18 Model: Mobilenet Quant Microseconds < Lower Is Better c7g.4xlarge Graviton3 . 1502.95 |============ a1.4xlarge Graviton ... 5724.66 |============================================== c6g.4xlarge Graviton2 . 1980.24 |================ c6a.4xlarge EPYC ...... 3847.96 |=============================== c6i.4xlarge Xeon ...... 3967.39 |================================ C-Ray 1.1 Total Time - 4K, 16 Rays Per Pixel Seconds < Lower Is Better c7g.4xlarge Graviton3 . 38.52 |================= a1.4xlarge Graviton ... 104.76 |=============================================== c6g.4xlarge Graviton2 . 62.32 |============================ c6a.4xlarge EPYC ...... 69.35 |=============================== c6i.4xlarge Xeon ...... 92.55 |========================================== Rodinia 3.1 Test: OpenMP Streamcluster Seconds < Lower Is Better c7g.4xlarge Graviton3 . 13.30 |============= a1.4xlarge Graviton ... 47.43 |================================================ c6g.4xlarge Graviton2 . 15.48 |================ c6a.4xlarge EPYC ...... 18.38 |=================== c6i.4xlarge Xeon ...... 23.51 |======================== Geometric Mean Of All Test Results Result Composite - Amazon EC2 Graviton3 Benchmark Comparison Geometric Mean > Higher Is Better c7g.4xlarge Graviton3 . 170.78 |=============================================== a1.4xlarge Graviton ... 53.56 |=============== c6g.4xlarge Graviton2 . 119.30 |================================= c6a.4xlarge EPYC ...... 152.48 |========================================== c6i.4xlarge Xeon ...... 168.19 |============================================== Number Of First Place Finishes Wins - 94 Tests Wins c7g.4xlarge Graviton3 . 43 |=================================================== c6a.4xlarge EPYC ...... 16 |=================== c6i.4xlarge Xeon ...... 35 |========================================== Number Of Last Place Finishes Losses - 94 Tests Losses a1.4xlarge Graviton . 92 |===================================================== c6a.4xlarge EPYC .... 1 |= c6i.4xlarge Xeon .... 1 |= Stress-NG 0.14 Performance / Cost - Test: Memory Copying Bogo Ops/s Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 1338664.00 |=========================================== a1.4xlarge Graviton ... 266080.00 |========= c6g.4xlarge Graviton2 . 580600.00 |=================== c6a.4xlarge EPYC ...... 710360.00 |======================= c6i.4xlarge Xeon ...... 525081.67 |================= NAS Parallel Benchmarks 3.4 Performance / Cost - Test / Class: MG.C Total Mop/s Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 6740805.00 |=========== a1.4xlarge Graviton ... 544393.33 |= c6g.4xlarge Graviton2 . 1680170.00 |=== c6a.4xlarge EPYC ...... 8413215.00 |============= c6i.4xlarge Xeon ...... 26298810.00 |========================================== NAS Parallel Benchmarks 3.4 Performance / Cost - Test / Class: CG.C Total Mop/s Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 1642987.50 |====================== a1.4xlarge Graviton ... 86653.57 |= c6g.4xlarge Graviton2 . 586810.00 |======== c6a.4xlarge EPYC ...... 1542305.00 |===================== c6i.4xlarge Xeon ...... 3174273.33 |=========================================== NAS Parallel Benchmarks 3.4 Performance / Cost - Test / Class: SP.C Total Mop/s Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 84286.60 |=========== a1.4xlarge Graviton ... 10107.81 |= c6g.4xlarge Graviton2 . 25065.53 |=== c6a.4xlarge EPYC ...... 261122.26 |=================================== c6i.4xlarge Xeon ...... 329766.21 |============================================ Zstd Compression 1.5.0 Performance / Cost - Compression Level: 3 - Compression Speed MB/s Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 773183.33 |============================================ a1.4xlarge Graviton ... 126780.00 |======= c6g.4xlarge Graviton2 . 481383.33 |=========================== c6a.4xlarge EPYC ...... 397714.29 |======================= c6i.4xlarge Xeon ...... 491514.29 |============================ NAS Parallel Benchmarks 3.4 Performance / Cost - Test / Class: FT.C Total Mop/s Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 1965295.00 |================= a1.4xlarge Graviton ... 182947.50 |== c6g.4xlarge Graviton2 . 624448.00 |===== c6a.4xlarge EPYC ...... 4574990.00 |======================================= c6i.4xlarge Xeon ...... 5105892.50 |=========================================== High Performance Conjugate Gradient 3.1 Performance / Cost GFLOP/s Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 1753.72 |============================================== a1.4xlarge Graviton ... 107.95 |=== c6g.4xlarge Graviton2 . 1160.11 |============================== c6a.4xlarge EPYC ...... 202.42 |===== c6i.4xlarge Xeon ...... 360.85 |========= Algebraic Multi-Grid Benchmark 1.2 Performance / Cost Figure Of Merit Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 1258807333000.00 |===================================== a1.4xlarge Graviton ... 37343386600.00 |= c6g.4xlarge Graviton2 . 466326450000.00 |============== c6a.4xlarge EPYC ...... 89223566666.67 |=== c6i.4xlarge Xeon ...... 330682383500.00 |========== Xcompact3d Incompact3d 2021-03-11 Performance / Cost - Input: input.i3d 129 Cells Per Direction Seconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 0.008 |= a1.4xlarge Graviton ... 0.323 |================================================ c6g.4xlarge Graviton2 . 0.023 |=== c6a.4xlarge EPYC ...... 0.141 |===================== c6i.4xlarge Xeon ...... 0.054 |======== ACES DGEMM 1.0 Performance / Cost - Sustained Floating-Point Rate GFLOP/s Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 975.64 |=============================================== a1.4xlarge Graviton ... 30.74 |= c6g.4xlarge Graviton2 . 683.59 |================================= c6a.4xlarge EPYC ...... 152.03 |======= c6i.4xlarge Xeon ...... 111.53 |===== Xcompact3d Incompact3d 2021-03-11 Performance / Cost - Input: input.i3d 193 Cells Per Direction Seconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 0.146 |== a1.4xlarge Graviton ... 3.834 |================================================ c6g.4xlarge Graviton2 . 0.246 |=== c6a.4xlarge EPYC ...... 2.105 |========================== c6i.4xlarge Xeon ...... 0.900 |=========== Stress-NG 0.14 Performance / Cost - Test: CPU Stress Bogo Ops/s Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 1005942.00 |================ a1.4xlarge Graviton ... 788666.67 |============= c6g.4xlarge Graviton2 . 680988.00 |=========== c6a.4xlarge EPYC ...... 2660900.00 |=========================================== c6i.4xlarge Xeon ...... 2087860.00 |================================== simdjson 1.0 Performance / Cost - Throughput Test: DistinctUserID GB/s Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 224.17 |================================ a1.4xlarge Graviton ... 133.33 |=================== c6g.4xlarge Graviton2 . 191.25 |=========================== c6a.4xlarge EPYC ...... 286.67 |========================================= c6i.4xlarge Xeon ...... 330.77 |=============================================== Timed MrBayes Analysis 3.2.7 Performance / Cost - Primate Phylogeny Analysis Seconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 10.056 |========== a1.4xlarge Graviton ... 47.070 |=============================================== c6g.4xlarge Graviton2 . 22.316 |====================== c6a.4xlarge EPYC ...... 2.533 |=== c6i.4xlarge Xeon ...... 3.508 |==== NAS Parallel Benchmarks 3.4 Performance / Cost - Test / Class: IS.D Total Mop/s Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 115766.67 |============================================ a1.4xlarge Graviton ... 8980.46 |=== c6g.4xlarge Graviton2 . 23297.50 |========= c6a.4xlarge EPYC ...... 41642.31 |================ c6i.4xlarge Xeon ...... 78324.55 |============================== TensorFlow Lite 2022-05-18 Performance / Cost - Model: Mobilenet Float Microseconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 21.57 |=============== a1.4xlarge Graviton ... 69.93 |================================================ c6g.4xlarge Graviton2 . 22.51 |=============== c6a.4xlarge EPYC ...... 21.60 |=============== c6i.4xlarge Xeon ...... 23.58 |================ GPAW 22.1 Performance / Cost - Input: Carbon Nanotube Seconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 3.880 |=== a1.4xlarge Graviton ... 66.933 |=============================================== c6g.4xlarge Graviton2 . 7.112 |===== c6a.4xlarge EPYC ...... 15.754 |=========== c6i.4xlarge Xeon ...... 7.680 |===== libavif avifenc 0.10 Performance / Cost - Encoder Speed: 2 Seconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 3.259 |======= a1.4xlarge Graviton ... 22.900 |=============================================== c6g.4xlarge Graviton2 . 8.575 |================== c6a.4xlarge EPYC ...... 1.503 |=== c6i.4xlarge Xeon ...... 1.857 |==== simdjson 1.0 Performance / Cost - Throughput Test: PartialTweets GB/s Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 218.33 |==================================== a1.4xlarge Graviton ... 130.00 |===================== c6g.4xlarge Graviton2 . 188.75 |=============================== c6a.4xlarge EPYC ...... 242.67 |======================================== c6i.4xlarge Xeon ...... 285.39 |=============================================== LULESH 2.0.3 Performance / Cost z/s Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 10940939.00 |========================================== a1.4xlarge Graviton ... 776090.80 |=== c6g.4xlarge Graviton2 . 6016162.70 |======================= c6a.4xlarge EPYC ...... 2726052.55 |========== c6i.4xlarge Xeon ...... 8112371.50 |=============================== Apache HTTP Server 2.4.48 Performance / Cost - Concurrent Requests: 100 Requests Per Second Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 4482125.33 |===================================== a1.4xlarge Graviton ... 1863643.00 |=============== c6g.4xlarge Graviton2 . 3356810.71 |============================ c6a.4xlarge EPYC ...... 5171179.33 |=========================================== c6i.4xlarge Xeon ...... 5090915.88 |========================================== ASTC Encoder 3.2 Performance / Cost - Preset: Thorough Seconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 0.042 |============ a1.4xlarge Graviton ... 0.168 |================================================ c6g.4xlarge Graviton2 . 0.050 |============== c6a.4xlarge EPYC ...... 0.016 |===== c6i.4xlarge Xeon ...... 0.015 |==== GROMACS 2022.1 Performance / Cost - Implementation: MPI CPU - Input: water_GMX50_bare Ns Per Day Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 45.120 |=================================== a1.4xlarge Graviton ... 5.016 |==== c6g.4xlarge Graviton2 . 22.971 |================== c6a.4xlarge EPYC ...... 33.467 |========================== c6i.4xlarge Xeon ...... 60.500 |=============================================== TensorFlow Lite 2022-05-18 Performance / Cost - Model: Inception V4 Microseconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 418.55 |=============== a1.4xlarge Graviton ... 1322.37 |============================================== c6g.4xlarge Graviton2 . 421.15 |=============== c6a.4xlarge EPYC ...... 449.21 |================ c6i.4xlarge Xeon ...... 494.23 |================= Apache HTTP Server 2.4.48 Performance / Cost - Concurrent Requests: 500 Requests Per Second Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 4903088.00 |======================================= a1.4xlarge Graviton ... 2013349.00 |================ c6g.4xlarge Graviton2 . 3576986.43 |============================ c6a.4xlarge EPYC ...... 5466376.00 |=========================================== c6i.4xlarge Xeon ...... 5396857.06 |========================================== Apache HTTP Server 2.4.48 Performance / Cost - Concurrent Requests: 200 Requests Per Second Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 4911796.67 |====================================== a1.4xlarge Graviton ... 2088758.00 |================ c6g.4xlarge Graviton2 . 3575712.14 |============================ c6a.4xlarge EPYC ...... 5538000.00 |=========================================== c6i.4xlarge Xeon ...... 5556365.88 |=========================================== simdjson 1.0 Performance / Cost - Throughput Test: Kostya GB/s Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 215.56 |==================================== a1.4xlarge Graviton ... 63.00 |=========== c6g.4xlarge Graviton2 . 119.00 |==================== c6a.4xlarge EPYC ...... 280.00 |=============================================== c6i.4xlarge Xeon ...... 223.64 |====================================== NAS Parallel Benchmarks 3.4 Performance / Cost - Test / Class: BT.C Total Mop/s Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 229767.33 |============================ a1.4xlarge Graviton ... 30270.96 |==== c6g.4xlarge Graviton2 . 94839.85 |============ c6a.4xlarge EPYC ...... 354985.41 |============================================ c6i.4xlarge Xeon ...... 356112.82 |============================================ OpenSSL 3.0 Performance / Cost - Algorithm: RSA4096 sign/s Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 254640.00 |============================================ a1.4xlarge Graviton ... 84042.86 |=============== c6g.4xlarge Graviton2 . 73400.00 |============= c6a.4xlarge EPYC ...... 208890.00 |==================================== c6i.4xlarge Xeon ...... 196481.82 |================================== TensorFlow Lite 2022-05-18 Performance / Cost - Model: Inception ResNet V2 Microseconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 400.51 |=============== a1.4xlarge Graviton ... 1198.18 |============================================== c6g.4xlarge Graviton2 . 413.60 |================ c6a.4xlarge EPYC ...... 413.67 |================ c6i.4xlarge Xeon ...... 494.16 |=================== Apache HTTP Server 2.4.48 Performance / Cost - Concurrent Requests: 1000 Requests Per Second Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 4847955.33 |=========================================== a1.4xlarge Graviton ... 1927868.00 |================= c6g.4xlarge Graviton2 . 3330675.00 |============================== c6a.4xlarge EPYC ...... 4769140.67 |========================================== c6i.4xlarge Xeon ...... 4695938.82 |========================================== TensorFlow Lite 2022-05-18 Performance / Cost - Model: SqueezeNet Microseconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 32.58 |=================== a1.4xlarge Graviton ... 84.10 |================================================ c6g.4xlarge Graviton2 . 35.72 |==================== c6a.4xlarge EPYC ...... 31.03 |================== c6i.4xlarge Xeon ...... 35.81 |==================== ASTC Encoder 3.2 Performance / Cost - Preset: Exhaustive Seconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 3.206 |================= a1.4xlarge Graviton ... 9.166 |================================================ c6g.4xlarge Graviton2 . 3.980 |===================== c6a.4xlarge EPYC ...... 0.941 |===== c6i.4xlarge Xeon ...... 0.975 |===== Rodinia 3.1 Performance / Cost - Test: OpenMP CFD Solver Seconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 0.021 |===== a1.4xlarge Graviton ... 0.207 |================================================ c6g.4xlarge Graviton2 . 0.051 |============ c6a.4xlarge EPYC ...... 0.087 |==================== c6i.4xlarge Xeon ...... 0.082 |=================== OpenSSL 3.0 Performance / Cost - Algorithm: RSA4096 verify/s Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 17846040.00 |========================================== a1.4xlarge Graviton ... 6475514.29 |=============== c6g.4xlarge Graviton2 . 5994611.11 |============== c6a.4xlarge EPYC ...... 13678420.00 |================================ c6i.4xlarge Xeon ...... 12814945.46 |============================== libavif avifenc 0.10 Performance / Cost - Encoder Speed: 0 Seconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 10.530 |======= a1.4xlarge Graviton ... 66.842 |=============================================== c6g.4xlarge Graviton2 . 25.230 |================== c6a.4xlarge EPYC ...... 6.453 |===== c6i.4xlarge Xeon ...... 7.995 |====== Timed Node.js Compilation 17.3 Performance / Cost - Time To Compile Seconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 39.81 |===== a1.4xlarge Graviton ... 353.18 |=============================================== c6g.4xlarge Graviton2 . 59.70 |======== c6a.4xlarge EPYC ...... 75.07 |========== c6i.4xlarge Xeon ...... 68.93 |========= LAMMPS Molecular Dynamics Simulator 29Oct2020 Performance / Cost - Model: Rhodopsin Protein ns/day Per Dollar > Higher Is Better a1.4xlarge Graviton . 3245.00 |========================= c6a.4xlarge EPYC .... 5067.00 |======================================= c6i.4xlarge Xeon .... 6220.00 |================================================ PyBench 2018-02-16 Performance / Cost - Total For Average Test Times Milliseconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 4.740 |======= a1.4xlarge Graviton ... 31.068 |=============================================== c6g.4xlarge Graviton2 . 10.446 |================ c6a.4xlarge EPYC ...... 15.688 |======================== c6i.4xlarge Xeon ...... 3.988 |====== PHPBench 0.8.1 Performance / Cost - PHP Benchmark Suite Score Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 133296800.00 |================================= a1.4xlarge Graviton ... 26806555.56 |======= c6g.4xlarge Graviton2 . 64265000.00 |================ c6a.4xlarge EPYC ...... 68677285.71 |================= c6i.4xlarge Xeon ...... 165637200.00 |========================================= Timed ImageMagick Compilation 6.9.0 Performance / Cost - Time To Compile Seconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 0.140 |======= a1.4xlarge Graviton ... 1.030 |================================================ c6g.4xlarge Graviton2 . 0.242 |=========== c6a.4xlarge EPYC ...... 0.196 |========= c6i.4xlarge Xeon ...... 0.178 |======== TensorFlow Lite 2022-05-18 Performance / Cost - Model: NASNet Mobile Microseconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 115.92 |========================= a1.4xlarge Graviton ... 216.91 |=============================================== c6g.4xlarge Graviton2 . 134.87 |============================= c6a.4xlarge EPYC ...... 92.67 |==================== c6i.4xlarge Xeon ...... 130.81 |============================ Timed Apache Compilation 2.4.41 Performance / Cost - Time To Compile Seconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 0.108 |======== a1.4xlarge Graviton ... 0.673 |================================================ c6g.4xlarge Graviton2 . 0.171 |============ c6a.4xlarge EPYC ...... 0.094 |======= c6i.4xlarge Xeon ...... 0.090 |====== DaCapo Benchmark 9.12-MR1 Performance / Cost - Java Test: Jython msec x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 3.940 |======= a1.4xlarge Graviton ... 25.994 |=============================================== c6g.4xlarge Graviton2 . 5.626 |========== c6a.4xlarge EPYC ...... 4.616 |======== c6i.4xlarge Xeon ...... 4.013 |======= Timed LLVM Compilation 13.0 Performance / Cost - Build System: Ninja Seconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 47.95 |====== a1.4xlarge Graviton ... 360.49 |=============================================== c6g.4xlarge Graviton2 . 70.35 |========= c6a.4xlarge EPYC ...... 98.08 |============= c6i.4xlarge Xeon ...... 89.14 |============ NAS Parallel Benchmarks 3.4 Performance / Cost - Test / Class: EP.D Total Mop/s Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 38946.67 |====================================== a1.4xlarge Graviton ... 7373.91 |======= c6g.4xlarge Graviton2 . 15104.87 |=============== c6a.4xlarge EPYC ...... 9324.20 |========= c6i.4xlarge Xeon ...... 45967.50 |============================================= Ngspice 34 Performance / Cost - Circuit: C2670 Seconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 6.343 |============ a1.4xlarge Graviton ... 25.591 |=============================================== c6g.4xlarge Graviton2 . 10.549 |=================== c6a.4xlarge EPYC ...... 10.327 |=================== c6i.4xlarge Xeon ...... 4.141 |======== DaCapo Benchmark 9.12-MR1 Performance / Cost - Java Test: Tradesoap msec x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 7.048 |========== a1.4xlarge Graviton ... 33.546 |=============================================== c6g.4xlarge Graviton2 . 9.012 |============= c6a.4xlarge EPYC ...... 8.104 |=========== c6i.4xlarge Xeon ...... 7.630 |=========== simdjson 1.0 Performance / Cost - Throughput Test: LargeRandom GB/s Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 77.78 |=================================== a1.4xlarge Graviton ... 37.50 |================= c6g.4xlarge Graviton2 . 54.44 |======================== c6a.4xlarge EPYC ...... 105.56 |=============================================== c6i.4xlarge Xeon ...... 86.00 |====================================== SecureMark 1.0.4 Performance / Cost - Benchmark: SecureMark-TLS marks Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 4082400.00 |======================================== a1.4xlarge Graviton ... 2323625.00 |======================= c6g.4xlarge Graviton2 . 2864309.52 |============================ c6a.4xlarge EPYC ...... 4352816.33 |=========================================== c6i.4xlarge Xeon ...... 4349981.13 |=========================================== DaCapo Benchmark 9.12-MR1 Performance / Cost - Java Test: Tradebeans msec x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 3.203 |====== a1.4xlarge Graviton ... 27.135 |=============================================== c6g.4xlarge Graviton2 . 8.688 |=============== c6a.4xlarge EPYC ...... 6.334 |=========== c6i.4xlarge Xeon ...... 5.856 |========== Liquid-DSP 2021.01.31 Performance / Cost - Threads: 16 - Buffer Length: 256 - Filter Length: 57 samples/s Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 127868889000.00 |============================= a1.4xlarge Graviton ... 82756666500.00 |=================== c6g.4xlarge Graviton2 . 87630000000.00 |==================== c6a.4xlarge EPYC ...... 169915555666.67 |====================================== c6i.4xlarge Xeon ...... 93275000000.00 |===================== Build2 0.13 Performance / Cost - Time To Compile Seconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 2.185 |======= a1.4xlarge Graviton ... 14.156 |=============================================== c6g.4xlarge Graviton2 . 2.988 |========== c6a.4xlarge EPYC ...... 3.926 |============= c6i.4xlarge Xeon ...... 3.557 |============ Timed PHP Compilation 7.4.2 Performance / Cost - Time To Compile Seconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 0.764 |========= a1.4xlarge Graviton ... 4.313 |================================================ c6g.4xlarge Graviton2 . 1.156 |============= c6a.4xlarge EPYC ...... 0.738 |======== c6i.4xlarge Xeon ...... 0.772 |========= 7-Zip Compression 21.06 Performance / Cost - Test: Compression Rating MIPS Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 24456000.00 |========================================== a1.4xlarge Graviton ... 6499600.00 |=========== c6g.4xlarge Graviton2 . 17821250.00 |=============================== c6a.4xlarge EPYC ...... 12512400.00 |===================== c6i.4xlarge Xeon ...... 11105166.67 |=================== Ngspice 34 Performance / Cost - Circuit: C7552 Seconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 6.121 |=========== a1.4xlarge Graviton ... 26.924 |=============================================== c6g.4xlarge Graviton2 . 10.208 |================== c6a.4xlarge EPYC ...... 5.771 |========== c6i.4xlarge Xeon ...... 4.994 |========= WebP Image Encode 1.1 Performance / Cost - Encode Settings: Quality 100, Lossless, Highest Compression Encode Time - Seconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 0.386 |=========== a1.4xlarge Graviton ... 1.746 |================================================ c6g.4xlarge Graviton2 . 0.661 |================== c6a.4xlarge EPYC ...... 0.389 |=========== c6i.4xlarge Xeon ...... 0.334 |========= Timed Gem5 Compilation 21.2 Performance / Cost - Time To Compile Seconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 24.64 |======== a1.4xlarge Graviton ... 151.39 |=============================================== c6g.4xlarge Graviton2 . 36.17 |=========== c6a.4xlarge EPYC ...... 45.34 |============== c6i.4xlarge Xeon ...... 41.83 |============= WebP Image Encode 1.1 Performance / Cost - Encode Settings: Quality 100, Lossless Encode Time - Seconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 0.091 |========== a1.4xlarge Graviton ... 0.433 |================================================ c6g.4xlarge Graviton2 . 0.155 |================= c6a.4xlarge EPYC ...... 0.134 |=============== c6i.4xlarge Xeon ...... 0.084 |========= libavif avifenc 0.10 Performance / Cost - Encoder Speed: 6, Lossless Seconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 0.024 |======== a1.4xlarge Graviton ... 0.136 |================================================ c6g.4xlarge Graviton2 . 0.050 |================== c6a.4xlarge EPYC ...... 0.049 |================= c6i.4xlarge Xeon ...... 0.053 |=================== nginx 1.21.1 Performance / Cost - Concurrent Requests: 1000 Requests Per Second Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 23120983.33 |===================================== a1.4xlarge Graviton ... 13820511.00 |====================== c6g.4xlarge Graviton2 . 22015223.57 |==================================== c6a.4xlarge EPYC ...... 25910517.33 |========================================== c6i.4xlarge Xeon ...... 20432087.65 |================================= nginx 1.21.1 Performance / Cost - Concurrent Requests: 500 Requests Per Second Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 23107556.00 |===================================== a1.4xlarge Graviton ... 13941484.00 |======================= c6g.4xlarge Graviton2 . 22185470.00 |==================================== c6a.4xlarge EPYC ...... 25935340.67 |========================================== c6i.4xlarge Xeon ...... 20686642.35 |================================== nginx 1.21.1 Performance / Cost - Concurrent Requests: 200 Requests Per Second Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 23492065.33 |====================================== a1.4xlarge Graviton ... 14143620.00 |======================= c6g.4xlarge Graviton2 . 22067047.86 |==================================== c6a.4xlarge EPYC ...... 26062186.00 |========================================== c6i.4xlarge Xeon ...... 20989995.88 |================================== Zstd Compression 1.5.0 Performance / Cost - Compression Level: 19 - Decompression Speed MB/s Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 435757.14 |============================================ a1.4xlarge Graviton ... 112170.00 |=========== c6g.4xlarge Graviton2 . 256450.00 |========================== c6a.4xlarge EPYC ...... 290750.00 |============================= c6i.4xlarge Xeon ...... 286888.89 |============================= nginx 1.21.1 Performance / Cost - Concurrent Requests: 100 Requests Per Second Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 23047391.33 |===================================== a1.4xlarge Graviton ... 14315548.00 |======================= c6g.4xlarge Graviton2 . 21953525.71 |==================================== c6a.4xlarge EPYC ...... 25867384.00 |========================================== c6i.4xlarge Xeon ...... 20958990.59 |================================== Zstd Compression 1.5.0 Performance / Cost - Compression Level: 19, Long Mode - Decompression Speed MB/s Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 405075.00 |============================================ a1.4xlarge Graviton ... 121390.00 |============= c6g.4xlarge Graviton2 . 274537.50 |============================== c6a.4xlarge EPYC ...... 256909.09 |============================ c6i.4xlarge Xeon ...... 266610.00 |============================= Stockfish 13 Performance / Cost - Total Time Nodes Per Second Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 5521778200.00 |======================================== a1.4xlarge Graviton ... 1220047777.78 |========= c6g.4xlarge Graviton2 . 3613207500.00 |========================== c6a.4xlarge EPYC ...... 3976270500.00 |============================= c6i.4xlarge Xeon ...... 2760245125.00 |==================== Rodinia 3.1 Performance / Cost - Test: OpenMP LavaMD Seconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 3.297 |========== a1.4xlarge Graviton ... 14.772 |=============================================== c6g.4xlarge Graviton2 . 7.117 |====================== c6a.4xlarge EPYC ...... 8.525 |=========================== c6i.4xlarge Xeon ...... 14.914 |=============================================== POV-Ray 3.7.0.7 Performance / Cost - Trace Time Seconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 0.227 |=========== a1.4xlarge Graviton ... 1.032 |================================================ c6g.4xlarge Graviton2 . 0.408 |=================== c6a.4xlarge EPYC ...... 0.445 |===================== c6i.4xlarge Xeon ...... 0.528 |========================= Zstd Compression 1.5.0 Performance / Cost - Compression Level: 19, Long Mode - Compression Speed MB/s Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 4937.50 |============================================== a1.4xlarge Graviton ... 1600.00 |=============== c6g.4xlarge Graviton2 . 3875.00 |==================================== c6a.4xlarge EPYC ...... 2354.55 |====================== c6i.4xlarge Xeon ...... 3380.00 |=============================== Zstd Compression 1.5.0 Performance / Cost - Compression Level: 19 - Compression Speed MB/s Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 5885.71 |============================================== a1.4xlarge Graviton ... 1690.00 |============= c6g.4xlarge Graviton2 . 4325.00 |================================== c6a.4xlarge EPYC ...... 3000.00 |======================= c6i.4xlarge Xeon ...... 4233.33 |================================= DaCapo Benchmark 9.12-MR1 Performance / Cost - Java Test: H2 msec x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 2.951 |========== a1.4xlarge Graviton ... 13.480 |=============================================== c6g.4xlarge Graviton2 . 7.928 |============================ c6a.4xlarge EPYC ...... 3.019 |=========== c6i.4xlarge Xeon ...... 2.921 |========== Stress-NG 0.14 Performance / Cost - Test: Crypto Bogo Ops/s Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 4636362.00 |=========================================== a1.4xlarge Graviton ... 3995126.67 |===================================== c6g.4xlarge Graviton2 . 3584836.00 |================================= c6a.4xlarge EPYC ...... 2711212.00 |========================= c6i.4xlarge Xeon ...... 1701723.33 |================ asmFish 2018-07-23 Performance / Cost - 1024 Hash Memory, 26 Depth Nodes/second Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 1338921791.67 |======================================== a1.4xlarge Graviton ... 438044285.71 |============= c6g.4xlarge Graviton2 . 1061619280.00 |================================ c6a.4xlarge EPYC ...... 818365250.00 |======================== c6i.4xlarge Xeon ...... 698417647.06 |===================== Google SynthMark 20201109 Performance / Cost - Test: VoiceMark_100 Voices Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 135127.00 |============================================ a1.4xlarge Graviton ... 110356.67 |==================================== c6g.4xlarge Graviton2 . 94077.80 |=============================== c6a.4xlarge EPYC ...... 132614.60 |=========================================== c6i.4xlarge Xeon ...... 94281.67 |=============================== OpenSSL 3.0 Performance / Cost - Algorithm: SHA256 byte/s Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 473173999068.97 |====================================== a1.4xlarge Graviton ... 339284475850.00 |=========================== c6g.4xlarge Graviton2 . 397154966037.04 |================================ c6a.4xlarge EPYC ...... 377142043645.16 |============================== c6i.4xlarge Xeon ...... 208735115794.12 |================= Stress-NG 0.14 Performance / Cost - Test: Vector Math Bogo Ops/s Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 11051634.00 |========================================== a1.4xlarge Graviton ... 9113823.33 |=================================== c6g.4xlarge Graviton2 . 7550778.00 |============================= c6a.4xlarge EPYC ...... 10757522.00 |========================================= c6i.4xlarge Xeon ...... 6690050.00 |========================= NAS Parallel Benchmarks 3.4 Performance / Cost - Test / Class: LU.C Total Mop/s Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 179776.98 |== a1.4xlarge Graviton ... 28111.21 | c6g.4xlarge Graviton2 . 84162.13 |= c6a.4xlarge EPYC ...... 1795753.57 |==================== c6i.4xlarge Xeon ...... 3813677.00 |=========================================== LeelaChessZero 0.28 Performance / Cost - Backend: Eigen Nodes Per Second Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 20500.00 |=========================================== a1.4xlarge Graviton ... 2976.74 |====== c6g.4xlarge Graviton2 . 14892.86 |=============================== c6a.4xlarge EPYC ...... 16145.16 |================================== c6i.4xlarge Xeon ...... 21558.82 |============================================= LeelaChessZero 0.28 Performance / Cost - Backend: BLAS Nodes Per Second Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 19017.24 |========================================== a1.4xlarge Graviton ... 3214.29 |======= c6g.4xlarge Graviton2 . 15709.09 |================================== c6a.4xlarge EPYC ...... 17596.77 |======================================= c6i.4xlarge Xeon ...... 20544.12 |============================================= Coremark 1.0 Performance / Cost - CoreMark Size 666 - Iterations Per Second Iterations/Sec Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 135137953.52 |========================================= a1.4xlarge Graviton ... 67956467.34 |===================== c6g.4xlarge Graviton2 . 105154779.93 |================================ c6a.4xlarge EPYC ...... 86283360.14 |========================== c6i.4xlarge Xeon ...... 57075768.33 |================= N-Queens 1.0 Performance / Cost - Elapsed Time Seconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 0.086 |================================ a1.4xlarge Graviton ... 0.129 |================================================ c6g.4xlarge Graviton2 . 0.069 |========================== c6a.4xlarge EPYC ...... 0.049 |================== c6i.4xlarge Xeon ...... 0.075 |============================ 7-Zip Compression 21.06 Performance / Cost - Test: Decompression Rating MIPS Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 18263500.00 |========================================== a1.4xlarge Graviton ... 8178200.00 |=================== c6g.4xlarge Graviton2 . 14861250.00 |================================== c6a.4xlarge EPYC ...... 11463600.00 |========================== c6i.4xlarge Xeon ...... 7608833.33 |================= m-queens 1.2 Performance / Cost - Time To Solve Seconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 0.735 |======================= a1.4xlarge Graviton ... 1.324 |========================================= c6g.4xlarge Graviton2 . 0.827 |========================== c6a.4xlarge EPYC ...... 0.868 |=========================== c6i.4xlarge Xeon ...... 1.551 |================================================ Stress-NG 0.14 Performance / Cost - Test: IO_uring Bogo Ops/s Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 168603156.00 |======================= a1.4xlarge Graviton ... 306057456.67 |========================================= c6g.4xlarge Graviton2 . 154104362.00 |===================== c6a.4xlarge EPYC ...... 153744692.00 |===================== c6i.4xlarge Xeon ...... 172990561.67 |======================= ONNX Runtime 1.11 Performance / Cost - Model: super-resolution-10 - Device: CPU - Executor: Standard Inferences Per Minute Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 148263.16 |=================================== a1.4xlarge Graviton ... 54071.43 |============= c6g.4xlarge Graviton2 . 115111.11 |=========================== c6a.4xlarge EPYC ...... 184800.00 |============================================ c6i.4xlarge Xeon ...... 150000.00 |==================================== ONNX Runtime 1.11 Performance / Cost - Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard Inferences Per Minute Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 32052.63 |======================== a1.4xlarge Graviton ... 11785.71 |========= c6g.4xlarge Graviton2 . 18555.56 |============== c6a.4xlarge EPYC ...... 56761.91 |=========================================== c6i.4xlarge Xeon ...... 59739.13 |============================================= ONNX Runtime 1.11 Performance / Cost - Model: fcn-resnet101-11 - Device: CPU - Executor: Standard Inferences Per Minute Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 1900.00 |============== a1.4xlarge Graviton ... 666.67 |===== c6g.4xlarge Graviton2 . 1473.68 |=========== c6a.4xlarge EPYC ...... 3095.24 |======================== c6i.4xlarge Xeon ...... 6043.48 |============================================== ONNX Runtime 1.11 Performance / Cost - Model: bertsquad-12 - Device: CPU - Executor: Standard Inferences Per Minute Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 21421.05 |============================= a1.4xlarge Graviton ... 8214.29 |=========== c6g.4xlarge Graviton2 . 17888.89 |======================== c6a.4xlarge EPYC ...... 23238.10 |=============================== c6i.4xlarge Xeon ...... 33608.70 |============================================= ONNX Runtime 1.11 Performance / Cost - Model: GPT-2 - Device: CPU - Executor: Standard Inferences Per Minute Per Dollar > Higher Is Better c7g.4xlarge Graviton3 . 399500.00 |============================================ a1.4xlarge Graviton ... 165142.86 |================== c6g.4xlarge Graviton2 . 386000.00 |=========================================== c6a.4xlarge EPYC ...... 267476.19 |============================= c6i.4xlarge Xeon ...... 345391.30 |====================================== TensorFlow Lite 2022-05-18 Performance / Cost - Model: Mobilenet Quant Microseconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 15.03 |=============== a1.4xlarge Graviton ... 40.07 |======================================== c6g.4xlarge Graviton2 . 17.82 |================== c6a.4xlarge EPYC ...... 38.48 |======================================= c6i.4xlarge Xeon ...... 47.61 |================================================ C-Ray 1.1 Performance / Cost - Total Time - 4K, 16 Rays Per Pixel Seconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 0.231 |======= a1.4xlarge Graviton ... 1.257 |==================================== c6g.4xlarge Graviton2 . 0.623 |================== c6a.4xlarge EPYC ...... 0.832 |======================== c6i.4xlarge Xeon ...... 1.666 |================================================ Rodinia 3.1 Performance / Cost - Test: OpenMP Streamcluster Seconds x Dollar < Lower Is Better c7g.4xlarge Graviton3 . 0.027 |===== a1.4xlarge Graviton ... 0.237 |================================================ c6g.4xlarge Graviton2 . 0.031 |====== c6a.4xlarge EPYC ...... 0.055 |=========== c6i.4xlarge Xeon ...... 0.118 |========================