Amazon EC2 Graviton3 Benchmark Comparison Amazon AWS Graviton3 benchmarks by Michael Larabel. a1.4xlarge Graviton: Processor: ARMv8 Cortex-A72 (16 Cores), Motherboard: Amazon EC2 a1.4xlarge (1.0 BIOS), Chipset: Amazon Device 0200, Memory: 32GB, Disk: 193GB Amazon Elastic Block Store, Network: Amazon Elastic OS: Ubuntu 22.04, Kernel: 5.15.0-1004-aws (aarch64), Compiler: GCC 11.2.0, File-System: ext4, System Layer: amazon c6g.4xlarge Graviton2: Processor: ARMv8 Neoverse-N1 (16 Cores), Motherboard: Amazon EC2 c6g.4xlarge (1.0 BIOS), Chipset: Amazon Device 0200, Memory: 32GB, Disk: 193GB Amazon Elastic Block Store, Network: Amazon Elastic OS: Ubuntu 22.04, Kernel: 5.15.0-1004-aws (aarch64), Compiler: GCC 11.2.0, File-System: ext4, System Layer: amazon c7g.4xlarge Graviton3: Processor: ARMv8 Neoverse-V1 (16 Cores), Motherboard: Amazon EC2 c7g.4xlarge (1.0 BIOS), Chipset: Amazon Device 0200, Memory: 32GB, Disk: 193GB Amazon Elastic Block Store, Network: Amazon Elastic OS: Ubuntu 22.04, Kernel: 5.15.0-1004-aws (aarch64), Compiler: GCC 11.2.0, File-System: ext4, System Layer: amazon c6a.4xlarge EPYC: Processor: AMD EPYC 7R13 (8 Cores / 16 Threads), Motherboard: Amazon EC2 c6a.4xlarge (1.0 BIOS), Chipset: Intel 440FX 82441FX PMC, Memory: 32GB, Disk: 193GB Amazon Elastic Block Store, Network: Amazon Elastic OS: Ubuntu 22.04, Kernel: 5.15.0-1004-aws (x86_64), Compiler: GCC 11.2.0, File-System: ext4, System Layer: amazon c6i.4xlarge Xeon: Processor: Intel Xeon Platinum 8375C (8 Cores / 16 Threads), Motherboard: Amazon EC2 c6i.4xlarge (1.0 BIOS), Chipset: Intel 440FX 82441FX PMC, Memory: 32GB, Disk: 193GB Amazon Elastic Block Store, Network: Amazon Elastic OS: Ubuntu 22.04, Kernel: 5.15.0-1004-aws (x86_64), Compiler: GCC 11.2.0, File-System: ext4, System Layer: amazon High Performance Conjugate Gradient 3.1 GFLOP/s > Higher Is Better a1.4xlarge Graviton ... 3.77834 |====== c6g.4xlarge Graviton2 . 19.72180 |================================== c7g.4xlarge Graviton3 . 26.30580 |============================================= c6a.4xlarge EPYC ...... 5.06042 |========= c6i.4xlarge Xeon ...... 8.66031 |=============== NAS Parallel Benchmarks 3.4 Test / Class: BT.C Total Mop/s > Higher Is Better a1.4xlarge Graviton ... 3148.18 |========== c6g.4xlarge Graviton2 . 6449.11 |===================== c7g.4xlarge Graviton3 . 10339.53 |================================== c6a.4xlarge EPYC ...... 13134.46 |=========================================== c6i.4xlarge Xeon ...... 13888.40 |============================================= NAS Parallel Benchmarks 3.4 Test / Class: CG.C Total Mop/s > Higher Is Better a1.4xlarge Graviton ... 1213.15 |====== c6g.4xlarge Graviton2 . 3520.86 |================= c7g.4xlarge Graviton3 . 6571.95 |================================ c6a.4xlarge EPYC ...... 6169.22 |============================== c6i.4xlarge Xeon ...... 9522.82 |============================================== NAS Parallel Benchmarks 3.4 Test / Class: EP.D Total Mop/s > Higher Is Better a1.4xlarge Graviton ... 339.20 |============== c6g.4xlarge Graviton2 . 558.88 |======================= c7g.4xlarge Graviton3 . 934.72 |======================================= c6a.4xlarge EPYC ...... 466.21 |=================== c6i.4xlarge Xeon ...... 1103.22 |============================================== NAS Parallel Benchmarks 3.4 Test / Class: FT.C Total Mop/s > Higher Is Better a1.4xlarge Graviton ... 2927.16 |====== c6g.4xlarge Graviton2 . 6244.48 |============== c7g.4xlarge Graviton3 . 11791.77 |========================== c6a.4xlarge EPYC ...... 18299.96 |======================================== c6i.4xlarge Xeon ...... 20423.57 |============================================= NAS Parallel Benchmarks 3.4 Test / Class: IS.D Total Mop/s > Higher Is Better a1.4xlarge Graviton ... 197.57 |========= c6g.4xlarge Graviton2 . 372.76 |================ c7g.4xlarge Graviton3 . 1041.90 |============================================== c6a.4xlarge EPYC ...... 541.35 |======================== c6i.4xlarge Xeon ...... 861.57 |====================================== NAS Parallel Benchmarks 3.4 Test / Class: LU.C Total Mop/s > Higher Is Better a1.4xlarge Graviton ... 2558.12 |=== c6g.4xlarge Graviton2 . 5133.89 |====== c7g.4xlarge Graviton3 . 7730.41 |========= c6a.4xlarge EPYC ...... 25140.55 |============================== c6i.4xlarge Xeon ...... 38136.77 |============================================= NAS Parallel Benchmarks 3.4 Test / Class: MG.C Total Mop/s > Higher Is Better a1.4xlarge Graviton ... 3266.36 |====== c6g.4xlarge Graviton2 . 6720.68 |=========== c7g.4xlarge Graviton3 . 13481.61 |======================= c6a.4xlarge EPYC ...... 16826.43 |============================= c6i.4xlarge Xeon ...... 26298.81 |============================================= NAS Parallel Benchmarks 3.4 Test / Class: SP.C Total Mop/s > Higher Is Better a1.4xlarge Graviton ... 1293.80 |====== c6g.4xlarge Graviton2 . 2356.16 |=========== c7g.4xlarge Graviton3 . 4467.19 |===================== c6a.4xlarge EPYC ...... 8094.79 |======================================= c6i.4xlarge Xeon ...... 9563.22 |============================================== LeelaChessZero 0.28 Backend: BLAS Nodes Per Second > Higher Is Better a1.4xlarge Graviton ... 135 |===== c6g.4xlarge Graviton2 . 864 |============================== c7g.4xlarge Graviton3 . 1103 |======================================= c6a.4xlarge EPYC ...... 1091 |====================================== c6i.4xlarge Xeon ...... 1397 |================================================= LeelaChessZero 0.28 Backend: Eigen Nodes Per Second > Higher Is Better a1.4xlarge Graviton ... 128 |==== c6g.4xlarge Graviton2 . 834 |============================ c7g.4xlarge Graviton3 . 1189 |======================================== c6a.4xlarge EPYC ...... 1001 |================================= c6i.4xlarge Xeon ...... 1466 |================================================= Rodinia 3.1 Test: OpenMP LavaMD Seconds < Lower Is Better a1.4xlarge Graviton ... 360.30 |=============================================== c6g.4xlarge Graviton2 . 215.67 |============================ c7g.4xlarge Graviton3 . 143.33 |=================== c6a.4xlarge EPYC ...... 224.33 |============================= c6i.4xlarge Xeon ...... 281.39 |===================================== Rodinia 3.1 Test: OpenMP CFD Solver Seconds < Lower Is Better a1.4xlarge Graviton ... 41.45 |================================================ c6g.4xlarge Graviton2 . 17.04 |==================== c7g.4xlarge Graviton3 . 10.48 |============ c6a.4xlarge EPYC ...... 21.79 |========================= c6i.4xlarge Xeon ...... 20.45 |======================== Rodinia 3.1 Test: OpenMP Streamcluster Seconds < Lower Is Better a1.4xlarge Graviton ... 47.43 |================================================ c6g.4xlarge Graviton2 . 15.48 |================ c7g.4xlarge Graviton3 . 13.30 |============= c6a.4xlarge EPYC ...... 18.38 |=================== c6i.4xlarge Xeon ...... 23.51 |======================== Algebraic Multi-Grid Benchmark 1.2 Figure Of Merit > Higher Is Better a1.4xlarge Graviton ... 186716933 |====== c6g.4xlarge Graviton2 . 932652900 |================================ c7g.4xlarge Graviton3 . 1258807333 |=========================================== c6a.4xlarge EPYC ...... 267670700 |========= c6i.4xlarge Xeon ...... 661364767 |======================= Timed MrBayes Analysis 3.2.7 Primate Phylogeny Analysis Seconds < Lower Is Better a1.4xlarge Graviton ... 644.79 |=============================================== c6g.4xlarge Graviton2 . 384.75 |============================ c7g.4xlarge Graviton3 . 251.40 |================== c6a.4xlarge EPYC ...... 120.64 |========= c6i.4xlarge Xeon ...... 134.92 |========== Xcompact3d Incompact3d 2021-03-11 Input: input.i3d 129 Cells Per Direction Seconds < Lower Is Better a1.4xlarge Graviton ... 53.77062740 |========================================== c6g.4xlarge Graviton2 . 11.57335470 |========= c7g.4xlarge Graviton3 . 8.01671425 |====== c6a.4xlarge EPYC ...... 28.27976610 |====================== c6i.4xlarge Xeon ...... 17.86827720 |============== Xcompact3d Incompact3d 2021-03-11 Input: input.i3d 193 Cells Per Direction Seconds < Lower Is Better a1.4xlarge Graviton ... 182.58 |=============================================== c6g.4xlarge Graviton2 . 41.02 |=========== c7g.4xlarge Graviton3 . 29.13 |======= c6a.4xlarge EPYC ...... 110.77 |============================= c6i.4xlarge Xeon ...... 69.22 |================== LAMMPS Molecular Dynamics Simulator 29Oct2020 Model: Rhodopsin Protein ns/day > Higher Is Better a1.4xlarge Graviton ... 3.245 |============== c6g.4xlarge Graviton2 . 7.935 |================================= c7g.4xlarge Graviton3 . 11.291 |=============================================== c6a.4xlarge EPYC ...... 5.067 |===================== c6i.4xlarge Xeon ...... 6.220 |========================== LULESH 2.0.3 z/s > Higher Is Better a1.4xlarge Graviton ... 2328.27 |========== c6g.4xlarge Graviton2 . 6016.16 |========================= c7g.4xlarge Graviton3 . 10940.94 |============================================= c6a.4xlarge EPYC ...... 5452.11 |====================== c6i.4xlarge Xeon ...... 8112.37 |================================= WebP Image Encode 1.1 Encode Settings: Quality 100, Lossless Encode Time - Seconds < Lower Is Better a1.4xlarge Graviton ... 61.80 |================================================ c6g.4xlarge Graviton2 . 31.08 |======================== c7g.4xlarge Graviton3 . 22.77 |================== c6a.4xlarge EPYC ...... 26.71 |===================== c6i.4xlarge Xeon ...... 21.12 |================ WebP Image Encode 1.1 Encode Settings: Quality 100, Lossless, Highest Compression Encode Time - Seconds < Lower Is Better a1.4xlarge Graviton ... 124.71 |=============================================== c6g.4xlarge Graviton2 . 66.15 |========================= c7g.4xlarge Graviton3 . 48.21 |================== c6a.4xlarge EPYC ...... 48.68 |================== c6i.4xlarge Xeon ...... 41.81 |================ simdjson 1.0 Throughput Test: Kostya GB/s > Higher Is Better a1.4xlarge Graviton ... 0.63 |=========== c6g.4xlarge Graviton2 . 1.19 |===================== c7g.4xlarge Graviton3 . 1.94 |================================== c6a.4xlarge EPYC ...... 2.80 |================================================= c6i.4xlarge Xeon ...... 2.46 |=========================================== simdjson 1.0 Throughput Test: LargeRandom GB/s > Higher Is Better a1.4xlarge Graviton ... 0.30 |=============== c6g.4xlarge Graviton2 . 0.49 |========================= c7g.4xlarge Graviton3 . 0.70 |==================================== c6a.4xlarge EPYC ...... 0.95 |================================================= c6i.4xlarge Xeon ...... 0.86 |============================================ simdjson 1.0 Throughput Test: PartialTweets GB/s > Higher Is Better a1.4xlarge Graviton ... 0.78 |========== c6g.4xlarge Graviton2 . 1.51 |==================== c7g.4xlarge Graviton3 . 2.62 |=================================== c6a.4xlarge EPYC ...... 3.64 |================================================ c6i.4xlarge Xeon ...... 3.71 |================================================= simdjson 1.0 Throughput Test: DistinctUserID GB/s > Higher Is Better a1.4xlarge Graviton ... 0.80 |========= c6g.4xlarge Graviton2 . 1.53 |================= c7g.4xlarge Graviton3 . 2.69 |=============================== c6a.4xlarge EPYC ...... 4.30 |================================================= c6i.4xlarge Xeon ...... 4.30 |================================================= DaCapo Benchmark 9.12-MR1 Java Test: H2 msec < Lower Is Better a1.4xlarge Graviton ... 6740 |================================================= c6g.4xlarge Graviton2 . 3964 |============================= c7g.4xlarge Graviton3 . 2951 |===================== c6a.4xlarge EPYC ...... 3019 |====================== c6i.4xlarge Xeon ...... 2921 |===================== DaCapo Benchmark 9.12-MR1 Java Test: Jython msec < Lower Is Better a1.4xlarge Graviton ... 12997 |================================================ c6g.4xlarge Graviton2 . 5626 |===================== c7g.4xlarge Graviton3 . 3940 |=============== c6a.4xlarge EPYC ...... 4616 |================= c6i.4xlarge Xeon ...... 4013 |=============== DaCapo Benchmark 9.12-MR1 Java Test: Tradesoap msec < Lower Is Better a1.4xlarge Graviton ... 11182 |================================================ c6g.4xlarge Graviton2 . 4506 |=================== c7g.4xlarge Graviton3 . 3524 |=============== c6a.4xlarge EPYC ...... 4052 |================= c6i.4xlarge Xeon ...... 3815 |================ DaCapo Benchmark 9.12-MR1 Java Test: Tradebeans msec < Lower Is Better a1.4xlarge Graviton ... 9045 |================================================= c6g.4xlarge Graviton2 . 4344 |======================== c7g.4xlarge Graviton3 . 3203 |================= c6a.4xlarge EPYC ...... 3167 |================= c6i.4xlarge Xeon ...... 2928 |================ Zstd Compression 1.5.0 Compression Level: 3 - Compression Speed MB/s > Higher Is Better c6g.4xlarge Graviton2 . 2878.8 |============================= c6a.4xlarge EPYC ...... 2768.7 |============================ a1.4xlarge Graviton ... 633.9 |====== c6g.4xlarge Graviton2 . 2888.3 |============================= c7g.4xlarge Graviton3 . 4639.1 |=============================================== c6a.4xlarge EPYC ...... 2784.0 |============================ c6i.4xlarge Xeon ...... 3440.6 |=================================== Zstd Compression 1.5.0 Compression Level: 19 - Compression Speed MB/s > Higher Is Better a1.4xlarge Graviton ... 16.9 |==================== c6g.4xlarge Graviton2 . 34.6 |========================================= c7g.4xlarge Graviton3 . 41.2 |================================================= c6a.4xlarge EPYC ...... 30.0 |==================================== c6i.4xlarge Xeon ...... 38.1 |============================================= Zstd Compression 1.5.0 Compression Level: 19 - Decompression Speed MB/s > Higher Is Better a1.4xlarge Graviton ... 1121.7 |================= c6g.4xlarge Graviton2 . 2051.6 |================================ c7g.4xlarge Graviton3 . 3050.3 |=============================================== c6a.4xlarge EPYC ...... 2907.5 |============================================= c6i.4xlarge Xeon ...... 2582.0 |======================================== Zstd Compression 1.5.0 Compression Level: 19, Long Mode - Compression Speed MB/s > Higher Is Better a1.4xlarge Graviton ... 16.0 |==================== c6g.4xlarge Graviton2 . 31.0 |====================================== c7g.4xlarge Graviton3 . 39.5 |================================================= c6a.4xlarge EPYC ...... 25.9 |================================ c6i.4xlarge Xeon ...... 33.8 |========================================== Zstd Compression 1.5.0 Compression Level: 19, Long Mode - Decompression Speed MB/s > Higher Is Better a1.4xlarge Graviton ... 1213.9 |================== c6g.4xlarge Graviton2 . 2196.3 |================================ c7g.4xlarge Graviton3 . 3240.6 |=============================================== c6a.4xlarge EPYC ...... 2826.0 |========================================= c6i.4xlarge Xeon ...... 2666.1 |======================================= TSCP 1.81 AI Chess Performance Nodes Per Second > Higher Is Better a1.4xlarge Graviton ... 538500 |================= c6g.4xlarge Graviton2 . 872313 |============================ c7g.4xlarge Graviton3 . 1370094 |============================================ c6a.4xlarge EPYC ...... 1442631 |============================================== c6i.4xlarge Xeon ...... 1272596 |========================================= ACES DGEMM 1.0 Sustained Floating-Point Rate GFLOP/s > Higher Is Better a1.4xlarge Graviton ... 0.891391 |======= c6g.4xlarge Graviton2 . 4.785123 |===================================== c7g.4xlarge Graviton3 . 5.853864 |============================================= c6a.4xlarge EPYC ...... 2.432432 |=================== c6i.4xlarge Xeon ...... 2.230545 |================= Coremark 1.0 CoreMark Size 666 - Iterations Per Second Iterations/Sec > Higher Is Better a1.4xlarge Graviton ... 203869.40 |====================== c6g.4xlarge Graviton2 . 315464.34 |================================== c7g.4xlarge Graviton3 . 405413.86 |============================================ c6a.4xlarge EPYC ...... 345133.44 |===================================== c6i.4xlarge Xeon ...... 285378.84 |=============================== 7-Zip Compression 21.06 Test: Compression Rating MIPS > Higher Is Better a1.4xlarge Graviton ... 32498 |================ c6g.4xlarge Graviton2 . 71285 |=================================== c7g.4xlarge Graviton3 . 97824 |================================================ c6a.4xlarge EPYC ...... 62562 |=============================== c6i.4xlarge Xeon ...... 66631 |================================= 7-Zip Compression 21.06 Test: Decompression Rating MIPS > Higher Is Better a1.4xlarge Graviton ... 40891 |=========================== c6g.4xlarge Graviton2 . 59445 |======================================= c7g.4xlarge Graviton3 . 73054 |================================================ c6a.4xlarge EPYC ...... 57318 |====================================== c6i.4xlarge Xeon ...... 45653 |============================== Stockfish 13 Total Time Nodes Per Second > Higher Is Better a1.4xlarge Graviton ... 10980430 |================== c6g.4xlarge Graviton2 . 21679245 |=================================== c7g.4xlarge Graviton3 . 27608891 |============================================= c6a.4xlarge EPYC ...... 23857623 |======================================= c6i.4xlarge Xeon ...... 22081961 |==================================== asmFish 2018-07-23 1024 Hash Memory, 26 Depth Nodes/second > Higher Is Better a1.4xlarge Graviton ... 15331550 |===================== c6g.4xlarge Graviton2 . 26540482 |===================================== c7g.4xlarge Graviton3 . 32134123 |============================================= c6a.4xlarge EPYC ...... 26187688 |===================================== c6i.4xlarge Xeon ...... 23746200 |================================= libavif avifenc 0.10 Encoder Speed: 0 Seconds < Lower Is Better a1.4xlarge Graviton ... 768.30 |=============================================== c6g.4xlarge Graviton2 . 406.94 |========================= c7g.4xlarge Graviton3 . 256.84 |================ c6a.4xlarge EPYC ...... 195.53 |============ c6i.4xlarge Xeon ...... 204.99 |============= libavif avifenc 0.10 Encoder Speed: 2 Seconds < Lower Is Better a1.4xlarge Graviton ... 449.02 |=============================================== c6g.4xlarge Graviton2 . 238.21 |========================= c7g.4xlarge Graviton3 . 141.70 |=============== c6a.4xlarge EPYC ...... 93.95 |========== c6i.4xlarge Xeon ...... 97.74 |========== libavif avifenc 0.10 Encoder Speed: 6, Lossless Seconds < Lower Is Better a1.4xlarge Graviton ... 33.99 |================================================ c6g.4xlarge Graviton2 . 16.52 |======================= c7g.4xlarge Graviton3 . 11.91 |================= c6a.4xlarge EPYC ...... 16.39 |======================= c6i.4xlarge Xeon ...... 17.53 |========================= Timed Apache Compilation 2.4.41 Time To Compile Seconds < Lower Is Better a1.4xlarge Graviton ... 74.74 |================================================ c6g.4xlarge Graviton2 . 34.20 |====================== c7g.4xlarge Graviton3 . 26.94 |================= c6a.4xlarge EPYC ...... 23.53 |=============== c6i.4xlarge Xeon ...... 22.53 |============== Timed Gem5 Compilation 21.2 Time To Compile Seconds < Lower Is Better a1.4xlarge Graviton ... 1155.62 |============================================== c6g.4xlarge Graviton2 . 488.81 |=================== c7g.4xlarge Graviton3 . 391.17 |================ c6a.4xlarge EPYC ...... 515.20 |===================== c6i.4xlarge Xeon ...... 469.94 |=================== Timed ImageMagick Compilation 6.9.0 Time To Compile Seconds < Lower Is Better a1.4xlarge Graviton ... 93.63 |================================================ c6g.4xlarge Graviton2 . 40.33 |===================== c7g.4xlarge Graviton3 . 27.90 |============== c6a.4xlarge EPYC ...... 32.63 |================= c6i.4xlarge Xeon ...... 29.74 |=============== Timed LLVM Compilation 13.0 Build System: Ninja Seconds < Lower Is Better a1.4xlarge Graviton ... 1784.60 |============================================== c6g.4xlarge Graviton2 . 682.98 |================== c7g.4xlarge Graviton3 . 544.93 |============== c6a.4xlarge EPYC ...... 760.34 |==================== c6i.4xlarge Xeon ...... 685.70 |================== Timed Node.js Compilation 17.3 Time To Compile Seconds < Lower Is Better a1.4xlarge Graviton ... 1765.91 |============================================== c6g.4xlarge Graviton2 . 628.40 |================ c7g.4xlarge Graviton3 . 497.58 |============= c6a.4xlarge EPYC ...... 664.35 |================= c6i.4xlarge Xeon ...... 604.62 |================ Timed PHP Compilation 7.4.2 Time To Compile Seconds < Lower Is Better a1.4xlarge Graviton ... 196.03 |=============================================== c6g.4xlarge Graviton2 . 88.90 |===================== c7g.4xlarge Graviton3 . 69.48 |================= c6a.4xlarge EPYC ...... 67.08 |================ c6i.4xlarge Xeon ...... 64.34 |=============== Build2 0.13 Time To Compile Seconds < Lower Is Better a1.4xlarge Graviton ... 353.91 |=============================================== c6g.4xlarge Graviton2 . 142.28 |=================== c7g.4xlarge Graviton3 . 115.02 |=============== c6a.4xlarge EPYC ...... 150.99 |==================== c6i.4xlarge Xeon ...... 136.80 |================== C-Ray 1.1 Total Time - 4K, 16 Rays Per Pixel Seconds < Lower Is Better a1.4xlarge Graviton ... 104.76 |=============================================== c6g.4xlarge Graviton2 . 62.32 |============================ c7g.4xlarge Graviton3 . 38.52 |================= c6a.4xlarge EPYC ...... 69.35 |=============================== c6i.4xlarge Xeon ...... 92.55 |========================================== POV-Ray 3.7.0.7 Trace Time Seconds < Lower Is Better a1.4xlarge Graviton ... 93.80 |================================================ c6g.4xlarge Graviton2 . 51.05 |========================== c7g.4xlarge Graviton3 . 37.86 |=================== c6a.4xlarge EPYC ...... 49.44 |========================= c6i.4xlarge Xeon ...... 52.78 |=========================== m-queens 1.2 Time To Solve Seconds < Lower Is Better a1.4xlarge Graviton ... 110.37 |=============================================== c6g.4xlarge Graviton2 . 75.22 |================================ c7g.4xlarge Graviton3 . 66.82 |============================ c6a.4xlarge EPYC ...... 72.33 |=============================== c6i.4xlarge Xeon ...... 91.23 |======================================= N-Queens 1.0 Elapsed Time Seconds < Lower Is Better a1.4xlarge Graviton ... 32.29 |================================================ c6g.4xlarge Graviton2 . 23.14 |================================== c7g.4xlarge Graviton3 . 21.54 |================================ c6a.4xlarge EPYC ...... 16.38 |======================== c6i.4xlarge Xeon ...... 18.84 |============================ Ngspice 34 Circuit: C2670 Seconds < Lower Is Better a1.4xlarge Graviton ... 473.90 |=============================================== c6g.4xlarge Graviton2 . 263.72 |========================== c7g.4xlarge Graviton3 . 198.22 |==================== c6a.4xlarge EPYC ...... 245.89 |======================== c6i.4xlarge Xeon ...... 147.89 |=============== Ngspice 34 Circuit: C7552 Seconds < Lower Is Better a1.4xlarge Graviton ... 480.79 |=============================================== c6g.4xlarge Graviton2 . 255.21 |========================= c7g.4xlarge Graviton3 . 191.29 |=================== c6a.4xlarge EPYC ...... 180.36 |================== c6i.4xlarge Xeon ...... 161.08 |================ Google SynthMark 20201109 Test: VoiceMark_100 Voices > Higher Is Better a1.4xlarge Graviton ... 331.07 |======================= c6g.4xlarge Graviton2 . 470.39 |================================= c7g.4xlarge Graviton3 . 675.64 |=============================================== c6a.4xlarge EPYC ...... 663.07 |============================================== c6i.4xlarge Xeon ...... 565.69 |======================================= SecureMark 1.0.4 Benchmark: SecureMark-TLS marks > Higher Is Better a1.4xlarge Graviton ... 74356 |=============== c6g.4xlarge Graviton2 . 120301 |========================= c7g.4xlarge Graviton3 . 183708 |===================================== c6a.4xlarge EPYC ...... 213288 |=========================================== c6i.4xlarge Xeon ...... 230549 |=============================================== OpenSSL 3.0 Algorithm: SHA256 byte/s > Higher Is Better a1.4xlarge Graviton ... 6785689517 |===================== c6g.4xlarge Graviton2 . 10723184083 |================================= c7g.4xlarge Graviton3 . 13722045973 |========================================== c6a.4xlarge EPYC ...... 11691403353 |==================================== c6i.4xlarge Xeon ...... 7096993937 |====================== OpenSSL 3.0 Algorithm: RSA4096 sign/s > Higher Is Better a1.4xlarge Graviton ... 588.3 |=========== c6g.4xlarge Graviton2 . 660.6 |============ c7g.4xlarge Graviton3 . 2546.4 |=============================================== c6a.4xlarge EPYC ...... 2088.9 |======================================= c6i.4xlarge Xeon ...... 2161.3 |======================================== OpenSSL 3.0 Algorithm: RSA4096 verify/s > Higher Is Better a1.4xlarge Graviton ... 45328.6 |=========== c6g.4xlarge Graviton2 . 53951.5 |============== c7g.4xlarge Graviton3 . 178460.4 |============================================= c6a.4xlarge EPYC ...... 136784.2 |================================== c6i.4xlarge Xeon ...... 140964.4 |==================================== Liquid-DSP 2021.01.31 Threads: 16 - Buffer Length: 256 - Filter Length: 57 samples/s > Higher Is Better a1.4xlarge Graviton ... 165513333 |============== c6g.4xlarge Graviton2 . 262890000 |======================= c7g.4xlarge Graviton3 . 383606667 |================================= c6a.4xlarge EPYC ...... 509746667 |============================================ c6i.4xlarge Xeon ...... 373100000 |================================ GROMACS 2022.1 Implementation: MPI CPU - Input: water_GMX50_bare Ns Per Day > Higher Is Better a1.4xlarge Graviton ... 0.316 |========== c6g.4xlarge Graviton2 . 0.781 |========================== c7g.4xlarge Graviton3 . 1.128 |===================================== c6a.4xlarge EPYC ...... 1.004 |================================= c6i.4xlarge Xeon ...... 1.452 |================================================ TensorFlow Lite 2022-05-18 Model: SqueezeNet Microseconds < Lower Is Better a1.4xlarge Graviton ... 12014.70 |============================================= c6g.4xlarge Graviton2 . 3969.35 |=============== c7g.4xlarge Graviton3 . 3257.94 |============ c6a.4xlarge EPYC ...... 3103.12 |============ c6i.4xlarge Xeon ...... 2983.93 |=========== TensorFlow Lite 2022-05-18 Model: Inception V4 Microseconds < Lower Is Better a1.4xlarge Graviton ... 188910.0 |============================================= c6g.4xlarge Graviton2 . 46793.9 |=========== c7g.4xlarge Graviton3 . 41855.1 |========== c6a.4xlarge EPYC ...... 44920.6 |=========== c6i.4xlarge Xeon ...... 41185.7 |========== TensorFlow Lite 2022-05-18 Model: NASNet Mobile Microseconds < Lower Is Better a1.4xlarge Graviton ... 30986.70 |============================================= c6g.4xlarge Graviton2 . 14985.40 |====================== c7g.4xlarge Graviton3 . 11591.90 |================= c6a.4xlarge EPYC ...... 9266.86 |============= c6i.4xlarge Xeon ...... 10900.60 |================ TensorFlow Lite 2022-05-18 Model: Mobilenet Float Microseconds < Lower Is Better a1.4xlarge Graviton ... 9990.15 |============================================== c6g.4xlarge Graviton2 . 2500.87 |============ c7g.4xlarge Graviton3 . 2156.60 |========== c6a.4xlarge EPYC ...... 2159.72 |========== c6i.4xlarge Xeon ...... 1965.07 |========= TensorFlow Lite 2022-05-18 Model: Mobilenet Quant Microseconds < Lower Is Better a1.4xlarge Graviton ... 5724.66 |============================================== c6g.4xlarge Graviton2 . 1980.24 |================ c7g.4xlarge Graviton3 . 1502.95 |============ c6a.4xlarge EPYC ...... 3847.96 |=============================== c6i.4xlarge Xeon ...... 3967.39 |================================ TensorFlow Lite 2022-05-18 Model: Inception ResNet V2 Microseconds < Lower Is Better a1.4xlarge Graviton ... 171169.0 |============================================= c6g.4xlarge Graviton2 . 45955.7 |============ c7g.4xlarge Graviton3 . 40051.3 |=========== c6a.4xlarge EPYC ...... 41366.6 |=========== c6i.4xlarge Xeon ...... 41179.7 |=========== ASTC Encoder 3.2 Preset: Thorough Seconds < Lower Is Better a1.4xlarge Graviton ... 33.5198 |============================================== c6g.4xlarge Graviton2 . 16.5222 |======================= c7g.4xlarge Graviton3 . 13.9248 |=================== c6a.4xlarge EPYC ...... 7.9818 |=========== c6i.4xlarge Xeon ...... 7.2625 |========== ASTC Encoder 3.2 Preset: Exhaustive Seconds < Lower Is Better a1.4xlarge Graviton ... 277.77 |=============================================== c6g.4xlarge Graviton2 . 159.20 |=========================== c7g.4xlarge Graviton3 . 139.38 |======================== c6a.4xlarge EPYC ...... 72.39 |============ c6i.4xlarge Xeon ...... 69.64 |============ Stress-NG 0.14 Test: Crypto Bogo Ops/s > Higher Is Better a1.4xlarge Graviton ... 11985.38 |======================= c6g.4xlarge Graviton2 . 17924.18 |=================================== c7g.4xlarge Graviton3 . 23181.81 |============================================= c6a.4xlarge EPYC ...... 13556.06 |========================== c6i.4xlarge Xeon ...... 10210.34 |==================== Stress-NG 0.14 Test: IO_uring Bogo Ops/s > Higher Is Better a1.4xlarge Graviton ... 918172.37 |====================================== c6g.4xlarge Graviton2 . 770521.81 |================================ c7g.4xlarge Graviton3 . 843015.78 |=================================== c6a.4xlarge EPYC ...... 768723.46 |================================ c6i.4xlarge Xeon ...... 1037943.37 |=========================================== Stress-NG 0.14 Test: CPU Stress Bogo Ops/s > Higher Is Better a1.4xlarge Graviton ... 2366.00 |======== c6g.4xlarge Graviton2 . 3404.94 |============ c7g.4xlarge Graviton3 . 5029.71 |================= c6a.4xlarge EPYC ...... 13304.50 |============================================= c6i.4xlarge Xeon ...... 12527.16 |========================================== Stress-NG 0.14 Test: Vector Math Bogo Ops/s > Higher Is Better a1.4xlarge Graviton ... 27341.47 |====================== c6g.4xlarge Graviton2 . 37753.89 |=============================== c7g.4xlarge Graviton3 . 55258.17 |============================================= c6a.4xlarge EPYC ...... 53787.61 |============================================ c6i.4xlarge Xeon ...... 40140.30 |================================= Stress-NG 0.14 Test: Memory Copying Bogo Ops/s > Higher Is Better a1.4xlarge Graviton ... 798.24 |===== c6g.4xlarge Graviton2 . 2903.00 |==================== c7g.4xlarge Graviton3 . 6693.32 |============================================== c6a.4xlarge EPYC ...... 3551.80 |======================== c6i.4xlarge Xeon ...... 3150.49 |====================== GPAW 22.1 Input: Carbon Nanotube Seconds < Lower Is Better a1.4xlarge Graviton ... 769.35 |=============================================== c6g.4xlarge Graviton2 . 215.53 |============= c7g.4xlarge Graviton3 . 155.18 |========= c6a.4xlarge EPYC ...... 302.96 |=================== c6i.4xlarge Xeon ...... 202.11 |============ PyBench 2018-02-16 Total For Average Test Times Milliseconds < Lower Is Better a1.4xlarge Graviton ... 3452 |================================================= c6g.4xlarge Graviton2 . 1741 |========================= c7g.4xlarge Graviton3 . 1185 |================= c6a.4xlarge EPYC ...... 1961 |============================ c6i.4xlarge Xeon ...... 997 |============== nginx 1.21.1 Concurrent Requests: 100 Requests Per Second > Higher Is Better a1.4xlarge Graviton ... 143155.48 |================ c6g.4xlarge Graviton2 . 307349.36 |=================================== c7g.4xlarge Graviton3 . 345710.87 |======================================= c6a.4xlarge EPYC ...... 388010.76 |============================================ c6i.4xlarge Xeon ...... 356302.84 |======================================== nginx 1.21.1 Concurrent Requests: 200 Requests Per Second > Higher Is Better a1.4xlarge Graviton ... 141436.20 |================ c6g.4xlarge Graviton2 . 308938.67 |=================================== c7g.4xlarge Graviton3 . 352380.98 |======================================== c6a.4xlarge EPYC ...... 390932.79 |============================================ c6i.4xlarge Xeon ...... 356829.93 |======================================== nginx 1.21.1 Concurrent Requests: 500 Requests Per Second > Higher Is Better a1.4xlarge Graviton ... 139414.84 |================ c6g.4xlarge Graviton2 . 310596.58 |=================================== c7g.4xlarge Graviton3 . 346613.34 |======================================= c6a.4xlarge EPYC ...... 389030.11 |============================================ c6i.4xlarge Xeon ...... 351672.92 |======================================== nginx 1.21.1 Concurrent Requests: 1000 Requests Per Second > Higher Is Better a1.4xlarge Graviton ... 138205.11 |================ c6g.4xlarge Graviton2 . 308213.13 |=================================== c7g.4xlarge Graviton3 . 346814.75 |======================================= c6a.4xlarge EPYC ...... 388657.76 |============================================ c6i.4xlarge Xeon ...... 347345.49 |======================================= ONNX Runtime 1.11 Model: GPT-2 - Device: CPU - Executor: Standard Inferences Per Minute > Higher Is Better a1.4xlarge Graviton ... 2312 |============== c6g.4xlarge Graviton2 . 6948 |=========================================== c7g.4xlarge Graviton3 . 7990 |================================================= c6a.4xlarge EPYC ...... 5617 |================================== c6i.4xlarge Xeon ...... 7944 |================================================= ONNX Runtime 1.11 Model: bertsquad-12 - Device: CPU - Executor: Standard Inferences Per Minute > Higher Is Better a1.4xlarge Graviton ... 115 |======= c6g.4xlarge Graviton2 . 322 |===================== c7g.4xlarge Graviton3 . 407 |========================== c6a.4xlarge EPYC ...... 488 |================================ c6i.4xlarge Xeon ...... 773 |================================================== ONNX Runtime 1.11 Model: fcn-resnet101-11 - Device: CPU - Executor: Standard Inferences Per Minute > Higher Is Better a1.4xlarge Graviton ... 10 |==== c6g.4xlarge Graviton2 . 28 |========== c7g.4xlarge Graviton3 . 38 |============== c6a.4xlarge EPYC ...... 65 |======================= c6i.4xlarge Xeon ...... 139 |================================================== ONNX Runtime 1.11 Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard Inferences Per Minute > Higher Is Better a1.4xlarge Graviton ... 165 |====== c6g.4xlarge Graviton2 . 334 |============ c7g.4xlarge Graviton3 . 609 |====================== c6a.4xlarge EPYC ...... 1192 |=========================================== c6i.4xlarge Xeon ...... 1374 |================================================= ONNX Runtime 1.11 Model: super-resolution-10 - Device: CPU - Executor: Standard Inferences Per Minute > Higher Is Better a1.4xlarge Graviton ... 757 |========== c6g.4xlarge Graviton2 . 2072 |=========================== c7g.4xlarge Graviton3 . 2817 |===================================== c6a.4xlarge EPYC ...... 3696 |================================================= c6i.4xlarge Xeon ...... 3450 |============================================== Apache HTTP Server 2.4.48 Concurrent Requests: 100 Requests Per Second > Higher Is Better a1.4xlarge Graviton ... 18636.43 |========== c6g.4xlarge Graviton2 . 46995.35 |======================== c7g.4xlarge Graviton3 . 67231.88 |=================================== c6a.4xlarge EPYC ...... 77567.69 |======================================== c6i.4xlarge Xeon ...... 86545.57 |============================================= Apache HTTP Server 2.4.48 Concurrent Requests: 200 Requests Per Second > Higher Is Better a1.4xlarge Graviton ... 20887.58 |========== c6g.4xlarge Graviton2 . 50059.97 |======================== c7g.4xlarge Graviton3 . 73676.95 |=================================== c6a.4xlarge EPYC ...... 83070.00 |======================================== c6i.4xlarge Xeon ...... 94458.22 |============================================= Apache HTTP Server 2.4.48 Concurrent Requests: 500 Requests Per Second > Higher Is Better a1.4xlarge Graviton ... 20133.49 |========== c6g.4xlarge Graviton2 . 50077.81 |========================= c7g.4xlarge Graviton3 . 73546.32 |==================================== c6a.4xlarge EPYC ...... 81995.64 |======================================== c6i.4xlarge Xeon ...... 91746.57 |============================================= Apache HTTP Server 2.4.48 Concurrent Requests: 1000 Requests Per Second > Higher Is Better a1.4xlarge Graviton ... 19278.68 |=========== c6g.4xlarge Graviton2 . 46629.45 |========================== c7g.4xlarge Graviton3 . 72719.33 |========================================= c6a.4xlarge EPYC ...... 71537.11 |======================================== c6i.4xlarge Xeon ...... 79830.96 |============================================= PHPBench 0.8.1 PHP Benchmark Suite Score > Higher Is Better a1.4xlarge Graviton ... 241259 |============== c6g.4xlarge Graviton2 . 449855 |========================== c7g.4xlarge Graviton3 . 666484 |====================================== c6a.4xlarge EPYC ...... 480741 |=========================== c6i.4xlarge Xeon ...... 828186 |=============================================== Geometric Mean Of All Test Results Result Composite - Amazon EC2 Graviton3 Benchmark Comparison Geometric Mean > Higher Is Better a1.4xlarge Graviton ... 53.56 |=============== c6g.4xlarge Graviton2 . 119.30 |================================= c7g.4xlarge Graviton3 . 170.78 |=============================================== c6a.4xlarge EPYC ...... 152.48 |========================================== c6i.4xlarge Xeon ...... 168.19 |============================================== Number Of First Place Finishes Wins - 94 Tests Wins c7g.4xlarge Graviton3 . 43 |=================================================== c6i.4xlarge Xeon ...... 35 |========================================== c6a.4xlarge EPYC ...... 16 |=================== Number Of Last Place Finishes Losses - 94 Tests Losses a1.4xlarge Graviton . 92 |===================================================== c6i.4xlarge Xeon .... 1 |= c6a.4xlarge EPYC .... 1 |= High Performance Conjugate Gradient 3.1 Performance / Cost GFLOP/s Per Dollar > Higher Is Better a1.4xlarge Graviton ... 107.95 |=== c6g.4xlarge Graviton2 . 1160.11 |============================== c7g.4xlarge Graviton3 . 1753.72 |============================================== c6a.4xlarge EPYC ...... 202.42 |===== c6i.4xlarge Xeon ...... 360.85 |========= NAS Parallel Benchmarks 3.4 Performance / Cost - Test / Class: BT.C Total Mop/s Per Dollar > Higher Is Better a1.4xlarge Graviton ... 30270.96 |==== c6g.4xlarge Graviton2 . 94839.85 |============ c7g.4xlarge Graviton3 . 229767.33 |============================ c6a.4xlarge EPYC ...... 354985.41 |============================================ c6i.4xlarge Xeon ...... 356112.82 |============================================ NAS Parallel Benchmarks 3.4 Performance / Cost - Test / Class: CG.C Total Mop/s Per Dollar > Higher Is Better a1.4xlarge Graviton ... 86653.57 |= c6g.4xlarge Graviton2 . 586810.00 |======== c7g.4xlarge Graviton3 . 1642987.50 |====================== c6a.4xlarge EPYC ...... 1542305.00 |===================== c6i.4xlarge Xeon ...... 3174273.33 |=========================================== NAS Parallel Benchmarks 3.4 Performance / Cost - Test / Class: EP.D Total Mop/s Per Dollar > Higher Is Better a1.4xlarge Graviton ... 7373.91 |======= c6g.4xlarge Graviton2 . 15104.87 |=============== c7g.4xlarge Graviton3 . 38946.67 |====================================== c6a.4xlarge EPYC ...... 9324.20 |========= c6i.4xlarge Xeon ...... 45967.50 |============================================= NAS Parallel Benchmarks 3.4 Performance / Cost - Test / Class: FT.C Total Mop/s Per Dollar > Higher Is Better a1.4xlarge Graviton ... 182947.50 |== c6g.4xlarge Graviton2 . 624448.00 |===== c7g.4xlarge Graviton3 . 1965295.00 |================= c6a.4xlarge EPYC ...... 4574990.00 |======================================= c6i.4xlarge Xeon ...... 5105892.50 |=========================================== NAS Parallel Benchmarks 3.4 Performance / Cost - Test / Class: IS.D Total Mop/s Per Dollar > Higher Is Better a1.4xlarge Graviton ... 8980.46 |=== c6g.4xlarge Graviton2 . 23297.50 |========= c7g.4xlarge Graviton3 . 115766.67 |============================================ c6a.4xlarge EPYC ...... 41642.31 |================ c6i.4xlarge Xeon ...... 78324.55 |============================== NAS Parallel Benchmarks 3.4 Performance / Cost - Test / Class: LU.C Total Mop/s Per Dollar > Higher Is Better a1.4xlarge Graviton ... 28111.21 | c6g.4xlarge Graviton2 . 84162.13 |= c7g.4xlarge Graviton3 . 179776.98 |== c6a.4xlarge EPYC ...... 1795753.57 |==================== c6i.4xlarge Xeon ...... 3813677.00 |=========================================== NAS Parallel Benchmarks 3.4 Performance / Cost - Test / Class: MG.C Total Mop/s Per Dollar > Higher Is Better a1.4xlarge Graviton ... 544393.33 |= c6g.4xlarge Graviton2 . 1680170.00 |=== c7g.4xlarge Graviton3 . 6740805.00 |=========== c6a.4xlarge EPYC ...... 8413215.00 |============= c6i.4xlarge Xeon ...... 26298810.00 |========================================== NAS Parallel Benchmarks 3.4 Performance / Cost - Test / Class: SP.C Total Mop/s Per Dollar > Higher Is Better a1.4xlarge Graviton ... 10107.81 |= c6g.4xlarge Graviton2 . 25065.53 |=== c7g.4xlarge Graviton3 . 84286.60 |=========== c6a.4xlarge EPYC ...... 261122.26 |=================================== c6i.4xlarge Xeon ...... 329766.21 |============================================ LeelaChessZero 0.28 Performance / Cost - Backend: BLAS Nodes Per Second Per Dollar > Higher Is Better a1.4xlarge Graviton ... 3214.29 |======= c6g.4xlarge Graviton2 . 15709.09 |================================== c7g.4xlarge Graviton3 . 19017.24 |========================================== c6a.4xlarge EPYC ...... 17596.77 |======================================= c6i.4xlarge Xeon ...... 20544.12 |============================================= LeelaChessZero 0.28 Performance / Cost - Backend: Eigen Nodes Per Second Per Dollar > Higher Is Better a1.4xlarge Graviton ... 2976.74 |====== c6g.4xlarge Graviton2 . 14892.86 |=============================== c7g.4xlarge Graviton3 . 20500.00 |=========================================== c6a.4xlarge EPYC ...... 16145.16 |================================== c6i.4xlarge Xeon ...... 21558.82 |============================================= Rodinia 3.1 Performance / Cost - Test: OpenMP LavaMD Seconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 14.772 |=============================================== c6g.4xlarge Graviton2 . 7.117 |====================== c7g.4xlarge Graviton3 . 3.297 |========== c6a.4xlarge EPYC ...... 8.525 |=========================== c6i.4xlarge Xeon ...... 14.914 |=============================================== Rodinia 3.1 Performance / Cost - Test: OpenMP CFD Solver Seconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 0.207 |================================================ c6g.4xlarge Graviton2 . 0.051 |============ c7g.4xlarge Graviton3 . 0.021 |===== c6a.4xlarge EPYC ...... 0.087 |==================== c6i.4xlarge Xeon ...... 0.082 |=================== Rodinia 3.1 Performance / Cost - Test: OpenMP Streamcluster Seconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 0.237 |================================================ c6g.4xlarge Graviton2 . 0.031 |====== c7g.4xlarge Graviton3 . 0.027 |===== c6a.4xlarge EPYC ...... 0.055 |=========== c6i.4xlarge Xeon ...... 0.118 |======================== Algebraic Multi-Grid Benchmark 1.2 Performance / Cost Figure Of Merit Per Dollar > Higher Is Better a1.4xlarge Graviton ... 37343386600.00 |= c6g.4xlarge Graviton2 . 466326450000.00 |============== c7g.4xlarge Graviton3 . 1258807333000.00 |===================================== c6a.4xlarge EPYC ...... 89223566666.67 |=== c6i.4xlarge Xeon ...... 330682383500.00 |========== Timed MrBayes Analysis 3.2.7 Performance / Cost - Primate Phylogeny Analysis Seconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 47.070 |=============================================== c6g.4xlarge Graviton2 . 22.316 |====================== c7g.4xlarge Graviton3 . 10.056 |========== c6a.4xlarge EPYC ...... 2.533 |=== c6i.4xlarge Xeon ...... 3.508 |==== Xcompact3d Incompact3d 2021-03-11 Performance / Cost - Input: input.i3d 129 Cells Per Direction Seconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 0.323 |================================================ c6g.4xlarge Graviton2 . 0.023 |=== c7g.4xlarge Graviton3 . 0.008 |= c6a.4xlarge EPYC ...... 0.141 |===================== c6i.4xlarge Xeon ...... 0.054 |======== Xcompact3d Incompact3d 2021-03-11 Performance / Cost - Input: input.i3d 193 Cells Per Direction Seconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 3.834 |================================================ c6g.4xlarge Graviton2 . 0.246 |=== c7g.4xlarge Graviton3 . 0.146 |== c6a.4xlarge EPYC ...... 2.105 |========================== c6i.4xlarge Xeon ...... 0.900 |=========== LAMMPS Molecular Dynamics Simulator 29Oct2020 Performance / Cost - Model: Rhodopsin Protein ns/day Per Dollar > Higher Is Better a1.4xlarge Graviton . 3245.00 |========================= c6a.4xlarge EPYC .... 5067.00 |======================================= c6i.4xlarge Xeon .... 6220.00 |================================================ LULESH 2.0.3 Performance / Cost z/s Per Dollar > Higher Is Better a1.4xlarge Graviton ... 776090.80 |=== c6g.4xlarge Graviton2 . 6016162.70 |======================= c7g.4xlarge Graviton3 . 10940939.00 |========================================== c6a.4xlarge EPYC ...... 2726052.55 |========== c6i.4xlarge Xeon ...... 8112371.50 |=============================== WebP Image Encode 1.1 Performance / Cost - Encode Settings: Quality 100, Lossless Encode Time - Seconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 0.433 |================================================ c6g.4xlarge Graviton2 . 0.155 |================= c7g.4xlarge Graviton3 . 0.091 |========== c6a.4xlarge EPYC ...... 0.134 |=============== c6i.4xlarge Xeon ...... 0.084 |========= WebP Image Encode 1.1 Performance / Cost - Encode Settings: Quality 100, Lossless, Highest Compression Encode Time - Seconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 1.746 |================================================ c6g.4xlarge Graviton2 . 0.661 |================== c7g.4xlarge Graviton3 . 0.386 |=========== c6a.4xlarge EPYC ...... 0.389 |=========== c6i.4xlarge Xeon ...... 0.334 |========= simdjson 1.0 Performance / Cost - Throughput Test: Kostya GB/s Per Dollar > Higher Is Better a1.4xlarge Graviton ... 63.00 |=========== c6g.4xlarge Graviton2 . 119.00 |==================== c7g.4xlarge Graviton3 . 215.56 |==================================== c6a.4xlarge EPYC ...... 280.00 |=============================================== c6i.4xlarge Xeon ...... 223.64 |====================================== simdjson 1.0 Performance / Cost - Throughput Test: LargeRandom GB/s Per Dollar > Higher Is Better a1.4xlarge Graviton ... 37.50 |================= c6g.4xlarge Graviton2 . 54.44 |======================== c7g.4xlarge Graviton3 . 77.78 |=================================== c6a.4xlarge EPYC ...... 105.56 |=============================================== c6i.4xlarge Xeon ...... 86.00 |====================================== simdjson 1.0 Performance / Cost - Throughput Test: PartialTweets GB/s Per Dollar > Higher Is Better a1.4xlarge Graviton ... 130.00 |===================== c6g.4xlarge Graviton2 . 188.75 |=============================== c7g.4xlarge Graviton3 . 218.33 |==================================== c6a.4xlarge EPYC ...... 242.67 |======================================== c6i.4xlarge Xeon ...... 285.39 |=============================================== simdjson 1.0 Performance / Cost - Throughput Test: DistinctUserID GB/s Per Dollar > Higher Is Better a1.4xlarge Graviton ... 133.33 |=================== c6g.4xlarge Graviton2 . 191.25 |=========================== c7g.4xlarge Graviton3 . 224.17 |================================ c6a.4xlarge EPYC ...... 286.67 |========================================= c6i.4xlarge Xeon ...... 330.77 |=============================================== DaCapo Benchmark 9.12-MR1 Performance / Cost - Java Test: H2 msec x Dollar < Lower Is Better a1.4xlarge Graviton ... 13.480 |=============================================== c6g.4xlarge Graviton2 . 7.928 |============================ c7g.4xlarge Graviton3 . 2.951 |========== c6a.4xlarge EPYC ...... 3.019 |=========== c6i.4xlarge Xeon ...... 2.921 |========== DaCapo Benchmark 9.12-MR1 Performance / Cost - Java Test: Jython msec x Dollar < Lower Is Better a1.4xlarge Graviton ... 25.994 |=============================================== c6g.4xlarge Graviton2 . 5.626 |========== c7g.4xlarge Graviton3 . 3.940 |======= c6a.4xlarge EPYC ...... 4.616 |======== c6i.4xlarge Xeon ...... 4.013 |======= DaCapo Benchmark 9.12-MR1 Performance / Cost - Java Test: Tradesoap msec x Dollar < Lower Is Better a1.4xlarge Graviton ... 33.546 |=============================================== c6g.4xlarge Graviton2 . 9.012 |============= c7g.4xlarge Graviton3 . 7.048 |========== c6a.4xlarge EPYC ...... 8.104 |=========== c6i.4xlarge Xeon ...... 7.630 |=========== DaCapo Benchmark 9.12-MR1 Performance / Cost - Java Test: Tradebeans msec x Dollar < Lower Is Better a1.4xlarge Graviton ... 27.135 |=============================================== c6g.4xlarge Graviton2 . 8.688 |=============== c7g.4xlarge Graviton3 . 3.203 |====== c6a.4xlarge EPYC ...... 6.334 |=========== c6i.4xlarge Xeon ...... 5.856 |========== Zstd Compression 1.5.0 Performance / Cost - Compression Level: 3 - Compression Speed MB/s Per Dollar > Higher Is Better a1.4xlarge Graviton ... 126780.00 |======= c6g.4xlarge Graviton2 . 481383.33 |=========================== c7g.4xlarge Graviton3 . 773183.33 |============================================ c6a.4xlarge EPYC ...... 397714.29 |======================= c6i.4xlarge Xeon ...... 491514.29 |============================ Zstd Compression 1.5.0 Performance / Cost - Compression Level: 19 - Compression Speed MB/s Per Dollar > Higher Is Better a1.4xlarge Graviton ... 1690.00 |============= c6g.4xlarge Graviton2 . 4325.00 |================================== c7g.4xlarge Graviton3 . 5885.71 |============================================== c6a.4xlarge EPYC ...... 3000.00 |======================= c6i.4xlarge Xeon ...... 4233.33 |================================= Zstd Compression 1.5.0 Performance / Cost - Compression Level: 19 - Decompression Speed MB/s Per Dollar > Higher Is Better a1.4xlarge Graviton ... 112170.00 |=========== c6g.4xlarge Graviton2 . 256450.00 |========================== c7g.4xlarge Graviton3 . 435757.14 |============================================ c6a.4xlarge EPYC ...... 290750.00 |============================= c6i.4xlarge Xeon ...... 286888.89 |============================= Zstd Compression 1.5.0 Performance / Cost - Compression Level: 19, Long Mode - Compression Speed MB/s Per Dollar > Higher Is Better a1.4xlarge Graviton ... 1600.00 |=============== c6g.4xlarge Graviton2 . 3875.00 |==================================== c7g.4xlarge Graviton3 . 4937.50 |============================================== c6a.4xlarge EPYC ...... 2354.55 |====================== c6i.4xlarge Xeon ...... 3380.00 |=============================== Zstd Compression 1.5.0 Performance / Cost - Compression Level: 19, Long Mode - Decompression Speed MB/s Per Dollar > Higher Is Better a1.4xlarge Graviton ... 121390.00 |============= c6g.4xlarge Graviton2 . 274537.50 |============================== c7g.4xlarge Graviton3 . 405075.00 |============================================ c6a.4xlarge EPYC ...... 256909.09 |============================ c6i.4xlarge Xeon ...... 266610.00 |============================= ACES DGEMM 1.0 Performance / Cost - Sustained Floating-Point Rate GFLOP/s Per Dollar > Higher Is Better a1.4xlarge Graviton ... 30.74 |= c6g.4xlarge Graviton2 . 683.59 |================================= c7g.4xlarge Graviton3 . 975.64 |=============================================== c6a.4xlarge EPYC ...... 152.03 |======= c6i.4xlarge Xeon ...... 111.53 |===== Coremark 1.0 Performance / Cost - CoreMark Size 666 - Iterations Per Second Iterations/Sec Per Dollar > Higher Is Better a1.4xlarge Graviton ... 67956467.34 |===================== c6g.4xlarge Graviton2 . 105154779.93 |================================ c7g.4xlarge Graviton3 . 135137953.52 |========================================= c6a.4xlarge EPYC ...... 86283360.14 |========================== c6i.4xlarge Xeon ...... 57075768.33 |================= 7-Zip Compression 21.06 Performance / Cost - Test: Compression Rating MIPS Per Dollar > Higher Is Better a1.4xlarge Graviton ... 6499600.00 |=========== c6g.4xlarge Graviton2 . 17821250.00 |=============================== c7g.4xlarge Graviton3 . 24456000.00 |========================================== c6a.4xlarge EPYC ...... 12512400.00 |===================== c6i.4xlarge Xeon ...... 11105166.67 |=================== 7-Zip Compression 21.06 Performance / Cost - Test: Decompression Rating MIPS Per Dollar > Higher Is Better a1.4xlarge Graviton ... 8178200.00 |=================== c6g.4xlarge Graviton2 . 14861250.00 |================================== c7g.4xlarge Graviton3 . 18263500.00 |========================================== c6a.4xlarge EPYC ...... 11463600.00 |========================== c6i.4xlarge Xeon ...... 7608833.33 |================= Stockfish 13 Performance / Cost - Total Time Nodes Per Second Per Dollar > Higher Is Better a1.4xlarge Graviton ... 1220047777.78 |========= c6g.4xlarge Graviton2 . 3613207500.00 |========================== c7g.4xlarge Graviton3 . 5521778200.00 |======================================== c6a.4xlarge EPYC ...... 3976270500.00 |============================= c6i.4xlarge Xeon ...... 2760245125.00 |==================== asmFish 2018-07-23 Performance / Cost - 1024 Hash Memory, 26 Depth Nodes/second Per Dollar > Higher Is Better a1.4xlarge Graviton ... 438044285.71 |============= c6g.4xlarge Graviton2 . 1061619280.00 |================================ c7g.4xlarge Graviton3 . 1338921791.67 |======================================== c6a.4xlarge EPYC ...... 818365250.00 |======================== c6i.4xlarge Xeon ...... 698417647.06 |===================== libavif avifenc 0.10 Performance / Cost - Encoder Speed: 0 Seconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 66.842 |=============================================== c6g.4xlarge Graviton2 . 25.230 |================== c7g.4xlarge Graviton3 . 10.530 |======= c6a.4xlarge EPYC ...... 6.453 |===== c6i.4xlarge Xeon ...... 7.995 |====== libavif avifenc 0.10 Performance / Cost - Encoder Speed: 2 Seconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 22.900 |=============================================== c6g.4xlarge Graviton2 . 8.575 |================== c7g.4xlarge Graviton3 . 3.259 |======= c6a.4xlarge EPYC ...... 1.503 |=== c6i.4xlarge Xeon ...... 1.857 |==== libavif avifenc 0.10 Performance / Cost - Encoder Speed: 6, Lossless Seconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 0.136 |================================================ c6g.4xlarge Graviton2 . 0.050 |================== c7g.4xlarge Graviton3 . 0.024 |======== c6a.4xlarge EPYC ...... 0.049 |================= c6i.4xlarge Xeon ...... 0.053 |=================== Timed Apache Compilation 2.4.41 Performance / Cost - Time To Compile Seconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 0.673 |================================================ c6g.4xlarge Graviton2 . 0.171 |============ c7g.4xlarge Graviton3 . 0.108 |======== c6a.4xlarge EPYC ...... 0.094 |======= c6i.4xlarge Xeon ...... 0.090 |====== Timed Gem5 Compilation 21.2 Performance / Cost - Time To Compile Seconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 151.39 |=============================================== c6g.4xlarge Graviton2 . 36.17 |=========== c7g.4xlarge Graviton3 . 24.64 |======== c6a.4xlarge EPYC ...... 45.34 |============== c6i.4xlarge Xeon ...... 41.83 |============= Timed ImageMagick Compilation 6.9.0 Performance / Cost - Time To Compile Seconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 1.030 |================================================ c6g.4xlarge Graviton2 . 0.242 |=========== c7g.4xlarge Graviton3 . 0.140 |======= c6a.4xlarge EPYC ...... 0.196 |========= c6i.4xlarge Xeon ...... 0.178 |======== Timed LLVM Compilation 13.0 Performance / Cost - Build System: Ninja Seconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 360.49 |=============================================== c6g.4xlarge Graviton2 . 70.35 |========= c7g.4xlarge Graviton3 . 47.95 |====== c6a.4xlarge EPYC ...... 98.08 |============= c6i.4xlarge Xeon ...... 89.14 |============ Timed Node.js Compilation 17.3 Performance / Cost - Time To Compile Seconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 353.18 |=============================================== c6g.4xlarge Graviton2 . 59.70 |======== c7g.4xlarge Graviton3 . 39.81 |===== c6a.4xlarge EPYC ...... 75.07 |========== c6i.4xlarge Xeon ...... 68.93 |========= Timed PHP Compilation 7.4.2 Performance / Cost - Time To Compile Seconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 4.313 |================================================ c6g.4xlarge Graviton2 . 1.156 |============= c7g.4xlarge Graviton3 . 0.764 |========= c6a.4xlarge EPYC ...... 0.738 |======== c6i.4xlarge Xeon ...... 0.772 |========= Build2 0.13 Performance / Cost - Time To Compile Seconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 14.156 |=============================================== c6g.4xlarge Graviton2 . 2.988 |========== c7g.4xlarge Graviton3 . 2.185 |======= c6a.4xlarge EPYC ...... 3.926 |============= c6i.4xlarge Xeon ...... 3.557 |============ C-Ray 1.1 Performance / Cost - Total Time - 4K, 16 Rays Per Pixel Seconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 1.257 |==================================== c6g.4xlarge Graviton2 . 0.623 |================== c7g.4xlarge Graviton3 . 0.231 |======= c6a.4xlarge EPYC ...... 0.832 |======================== c6i.4xlarge Xeon ...... 1.666 |================================================ POV-Ray 3.7.0.7 Performance / Cost - Trace Time Seconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 1.032 |================================================ c6g.4xlarge Graviton2 . 0.408 |=================== c7g.4xlarge Graviton3 . 0.227 |=========== c6a.4xlarge EPYC ...... 0.445 |===================== c6i.4xlarge Xeon ...... 0.528 |========================= m-queens 1.2 Performance / Cost - Time To Solve Seconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 1.324 |========================================= c6g.4xlarge Graviton2 . 0.827 |========================== c7g.4xlarge Graviton3 . 0.735 |======================= c6a.4xlarge EPYC ...... 0.868 |=========================== c6i.4xlarge Xeon ...... 1.551 |================================================ N-Queens 1.0 Performance / Cost - Elapsed Time Seconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 0.129 |================================================ c6g.4xlarge Graviton2 . 0.069 |========================== c7g.4xlarge Graviton3 . 0.086 |================================ c6a.4xlarge EPYC ...... 0.049 |================== c6i.4xlarge Xeon ...... 0.075 |============================ Ngspice 34 Performance / Cost - Circuit: C2670 Seconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 25.591 |=============================================== c6g.4xlarge Graviton2 . 10.549 |=================== c7g.4xlarge Graviton3 . 6.343 |============ c6a.4xlarge EPYC ...... 10.327 |=================== c6i.4xlarge Xeon ...... 4.141 |======== Ngspice 34 Performance / Cost - Circuit: C7552 Seconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 26.924 |=============================================== c6g.4xlarge Graviton2 . 10.208 |================== c7g.4xlarge Graviton3 . 6.121 |=========== c6a.4xlarge EPYC ...... 5.771 |========== c6i.4xlarge Xeon ...... 4.994 |========= Google SynthMark 20201109 Performance / Cost - Test: VoiceMark_100 Voices Per Dollar > Higher Is Better a1.4xlarge Graviton ... 110356.67 |==================================== c6g.4xlarge Graviton2 . 94077.80 |=============================== c7g.4xlarge Graviton3 . 135127.00 |============================================ c6a.4xlarge EPYC ...... 132614.60 |=========================================== c6i.4xlarge Xeon ...... 94281.67 |=============================== SecureMark 1.0.4 Performance / Cost - Benchmark: SecureMark-TLS marks Per Dollar > Higher Is Better a1.4xlarge Graviton ... 2323625.00 |======================= c6g.4xlarge Graviton2 . 2864309.52 |============================ c7g.4xlarge Graviton3 . 4082400.00 |======================================== c6a.4xlarge EPYC ...... 4352816.33 |=========================================== c6i.4xlarge Xeon ...... 4349981.13 |=========================================== OpenSSL 3.0 Performance / Cost - Algorithm: SHA256 byte/s Per Dollar > Higher Is Better a1.4xlarge Graviton ... 339284475850.00 |=========================== c6g.4xlarge Graviton2 . 397154966037.04 |================================ c7g.4xlarge Graviton3 . 473173999068.97 |====================================== c6a.4xlarge EPYC ...... 377142043645.16 |============================== c6i.4xlarge Xeon ...... 208735115794.12 |================= OpenSSL 3.0 Performance / Cost - Algorithm: RSA4096 sign/s Per Dollar > Higher Is Better a1.4xlarge Graviton ... 84042.86 |=============== c6g.4xlarge Graviton2 . 73400.00 |============= c7g.4xlarge Graviton3 . 254640.00 |============================================ c6a.4xlarge EPYC ...... 208890.00 |==================================== c6i.4xlarge Xeon ...... 196481.82 |================================== OpenSSL 3.0 Performance / Cost - Algorithm: RSA4096 verify/s Per Dollar > Higher Is Better a1.4xlarge Graviton ... 6475514.29 |=============== c6g.4xlarge Graviton2 . 5994611.11 |============== c7g.4xlarge Graviton3 . 17846040.00 |========================================== c6a.4xlarge EPYC ...... 13678420.00 |================================ c6i.4xlarge Xeon ...... 12814945.46 |============================== Liquid-DSP 2021.01.31 Performance / Cost - Threads: 16 - Buffer Length: 256 - Filter Length: 57 samples/s Per Dollar > Higher Is Better a1.4xlarge Graviton ... 82756666500.00 |=================== c6g.4xlarge Graviton2 . 87630000000.00 |==================== c7g.4xlarge Graviton3 . 127868889000.00 |============================= c6a.4xlarge EPYC ...... 169915555666.67 |====================================== c6i.4xlarge Xeon ...... 93275000000.00 |===================== GROMACS 2022.1 Performance / Cost - Implementation: MPI CPU - Input: water_GMX50_bare Ns Per Day Per Dollar > Higher Is Better a1.4xlarge Graviton ... 5.016 |==== c6g.4xlarge Graviton2 . 22.971 |================== c7g.4xlarge Graviton3 . 45.120 |=================================== c6a.4xlarge EPYC ...... 33.467 |========================== c6i.4xlarge Xeon ...... 60.500 |=============================================== TensorFlow Lite 2022-05-18 Performance / Cost - Model: SqueezeNet Microseconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 84.10 |================================================ c6g.4xlarge Graviton2 . 35.72 |==================== c7g.4xlarge Graviton3 . 32.58 |=================== c6a.4xlarge EPYC ...... 31.03 |================== c6i.4xlarge Xeon ...... 35.81 |==================== TensorFlow Lite 2022-05-18 Performance / Cost - Model: Inception V4 Microseconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 1322.37 |============================================== c6g.4xlarge Graviton2 . 421.15 |=============== c7g.4xlarge Graviton3 . 418.55 |=============== c6a.4xlarge EPYC ...... 449.21 |================ c6i.4xlarge Xeon ...... 494.23 |================= TensorFlow Lite 2022-05-18 Performance / Cost - Model: NASNet Mobile Microseconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 216.91 |=============================================== c6g.4xlarge Graviton2 . 134.87 |============================= c7g.4xlarge Graviton3 . 115.92 |========================= c6a.4xlarge EPYC ...... 92.67 |==================== c6i.4xlarge Xeon ...... 130.81 |============================ TensorFlow Lite 2022-05-18 Performance / Cost - Model: Mobilenet Float Microseconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 69.93 |================================================ c6g.4xlarge Graviton2 . 22.51 |=============== c7g.4xlarge Graviton3 . 21.57 |=============== c6a.4xlarge EPYC ...... 21.60 |=============== c6i.4xlarge Xeon ...... 23.58 |================ TensorFlow Lite 2022-05-18 Performance / Cost - Model: Mobilenet Quant Microseconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 40.07 |======================================== c6g.4xlarge Graviton2 . 17.82 |================== c7g.4xlarge Graviton3 . 15.03 |=============== c6a.4xlarge EPYC ...... 38.48 |======================================= c6i.4xlarge Xeon ...... 47.61 |================================================ TensorFlow Lite 2022-05-18 Performance / Cost - Model: Inception ResNet V2 Microseconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 1198.18 |============================================== c6g.4xlarge Graviton2 . 413.60 |================ c7g.4xlarge Graviton3 . 400.51 |=============== c6a.4xlarge EPYC ...... 413.67 |================ c6i.4xlarge Xeon ...... 494.16 |=================== ASTC Encoder 3.2 Performance / Cost - Preset: Thorough Seconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 0.168 |================================================ c6g.4xlarge Graviton2 . 0.050 |============== c7g.4xlarge Graviton3 . 0.042 |============ c6a.4xlarge EPYC ...... 0.016 |===== c6i.4xlarge Xeon ...... 0.015 |==== ASTC Encoder 3.2 Performance / Cost - Preset: Exhaustive Seconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 9.166 |================================================ c6g.4xlarge Graviton2 . 3.980 |===================== c7g.4xlarge Graviton3 . 3.206 |================= c6a.4xlarge EPYC ...... 0.941 |===== c6i.4xlarge Xeon ...... 0.975 |===== Stress-NG 0.14 Performance / Cost - Test: Crypto Bogo Ops/s Per Dollar > Higher Is Better a1.4xlarge Graviton ... 3995126.67 |===================================== c6g.4xlarge Graviton2 . 3584836.00 |================================= c7g.4xlarge Graviton3 . 4636362.00 |=========================================== c6a.4xlarge EPYC ...... 2711212.00 |========================= c6i.4xlarge Xeon ...... 1701723.33 |================ Stress-NG 0.14 Performance / Cost - Test: IO_uring Bogo Ops/s Per Dollar > Higher Is Better a1.4xlarge Graviton ... 306057456.67 |========================================= c6g.4xlarge Graviton2 . 154104362.00 |===================== c7g.4xlarge Graviton3 . 168603156.00 |======================= c6a.4xlarge EPYC ...... 153744692.00 |===================== c6i.4xlarge Xeon ...... 172990561.67 |======================= Stress-NG 0.14 Performance / Cost - Test: CPU Stress Bogo Ops/s Per Dollar > Higher Is Better a1.4xlarge Graviton ... 788666.67 |============= c6g.4xlarge Graviton2 . 680988.00 |=========== c7g.4xlarge Graviton3 . 1005942.00 |================ c6a.4xlarge EPYC ...... 2660900.00 |=========================================== c6i.4xlarge Xeon ...... 2087860.00 |================================== Stress-NG 0.14 Performance / Cost - Test: Vector Math Bogo Ops/s Per Dollar > Higher Is Better a1.4xlarge Graviton ... 9113823.33 |=================================== c6g.4xlarge Graviton2 . 7550778.00 |============================= c7g.4xlarge Graviton3 . 11051634.00 |========================================== c6a.4xlarge EPYC ...... 10757522.00 |========================================= c6i.4xlarge Xeon ...... 6690050.00 |========================= Stress-NG 0.14 Performance / Cost - Test: Memory Copying Bogo Ops/s Per Dollar > Higher Is Better a1.4xlarge Graviton ... 266080.00 |========= c6g.4xlarge Graviton2 . 580600.00 |=================== c7g.4xlarge Graviton3 . 1338664.00 |=========================================== c6a.4xlarge EPYC ...... 710360.00 |======================= c6i.4xlarge Xeon ...... 525081.67 |================= GPAW 22.1 Performance / Cost - Input: Carbon Nanotube Seconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 66.933 |=============================================== c6g.4xlarge Graviton2 . 7.112 |===== c7g.4xlarge Graviton3 . 3.880 |=== c6a.4xlarge EPYC ...... 15.754 |=========== c6i.4xlarge Xeon ...... 7.680 |===== PyBench 2018-02-16 Performance / Cost - Total For Average Test Times Milliseconds x Dollar < Lower Is Better a1.4xlarge Graviton ... 31.068 |=============================================== c6g.4xlarge Graviton2 . 10.446 |================ c7g.4xlarge Graviton3 . 4.740 |======= c6a.4xlarge EPYC ...... 15.688 |======================== c6i.4xlarge Xeon ...... 3.988 |====== nginx 1.21.1 Performance / Cost - Concurrent Requests: 100 Requests Per Second Per Dollar > Higher Is Better a1.4xlarge Graviton ... 14315548.00 |======================= c6g.4xlarge Graviton2 . 21953525.71 |==================================== c7g.4xlarge Graviton3 . 23047391.33 |===================================== c6a.4xlarge EPYC ...... 25867384.00 |========================================== c6i.4xlarge Xeon ...... 20958990.59 |================================== nginx 1.21.1 Performance / Cost - Concurrent Requests: 200 Requests Per Second Per Dollar > Higher Is Better a1.4xlarge Graviton ... 14143620.00 |======================= c6g.4xlarge Graviton2 . 22067047.86 |==================================== c7g.4xlarge Graviton3 . 23492065.33 |====================================== c6a.4xlarge EPYC ...... 26062186.00 |========================================== c6i.4xlarge Xeon ...... 20989995.88 |================================== nginx 1.21.1 Performance / Cost - Concurrent Requests: 500 Requests Per Second Per Dollar > Higher Is Better a1.4xlarge Graviton ... 13941484.00 |======================= c6g.4xlarge Graviton2 . 22185470.00 |==================================== c7g.4xlarge Graviton3 . 23107556.00 |===================================== c6a.4xlarge EPYC ...... 25935340.67 |========================================== c6i.4xlarge Xeon ...... 20686642.35 |================================== nginx 1.21.1 Performance / Cost - Concurrent Requests: 1000 Requests Per Second Per Dollar > Higher Is Better a1.4xlarge Graviton ... 13820511.00 |====================== c6g.4xlarge Graviton2 . 22015223.57 |==================================== c7g.4xlarge Graviton3 . 23120983.33 |===================================== c6a.4xlarge EPYC ...... 25910517.33 |========================================== c6i.4xlarge Xeon ...... 20432087.65 |================================= ONNX Runtime 1.11 Performance / Cost - Model: GPT-2 - Device: CPU - Executor: Standard Inferences Per Minute Per Dollar > Higher Is Better a1.4xlarge Graviton ... 165142.86 |================== c6g.4xlarge Graviton2 . 386000.00 |=========================================== c7g.4xlarge Graviton3 . 399500.00 |============================================ c6a.4xlarge EPYC ...... 267476.19 |============================= c6i.4xlarge Xeon ...... 345391.30 |====================================== ONNX Runtime 1.11 Performance / Cost - Model: bertsquad-12 - Device: CPU - Executor: Standard Inferences Per Minute Per Dollar > Higher Is Better a1.4xlarge Graviton ... 8214.29 |=========== c6g.4xlarge Graviton2 . 17888.89 |======================== c7g.4xlarge Graviton3 . 21421.05 |============================= c6a.4xlarge EPYC ...... 23238.10 |=============================== c6i.4xlarge Xeon ...... 33608.70 |============================================= ONNX Runtime 1.11 Performance / Cost - Model: fcn-resnet101-11 - Device: CPU - Executor: Standard Inferences Per Minute Per Dollar > Higher Is Better a1.4xlarge Graviton ... 666.67 |===== c6g.4xlarge Graviton2 . 1473.68 |=========== c7g.4xlarge Graviton3 . 1900.00 |============== c6a.4xlarge EPYC ...... 3095.24 |======================== c6i.4xlarge Xeon ...... 6043.48 |============================================== ONNX Runtime 1.11 Performance / Cost - Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard Inferences Per Minute Per Dollar > Higher Is Better a1.4xlarge Graviton ... 11785.71 |========= c6g.4xlarge Graviton2 . 18555.56 |============== c7g.4xlarge Graviton3 . 32052.63 |======================== c6a.4xlarge EPYC ...... 56761.91 |=========================================== c6i.4xlarge Xeon ...... 59739.13 |============================================= ONNX Runtime 1.11 Performance / Cost - Model: super-resolution-10 - Device: CPU - Executor: Standard Inferences Per Minute Per Dollar > Higher Is Better a1.4xlarge Graviton ... 54071.43 |============= c6g.4xlarge Graviton2 . 115111.11 |=========================== c7g.4xlarge Graviton3 . 148263.16 |=================================== c6a.4xlarge EPYC ...... 184800.00 |============================================ c6i.4xlarge Xeon ...... 150000.00 |==================================== Apache HTTP Server 2.4.48 Performance / Cost - Concurrent Requests: 100 Requests Per Second Per Dollar > Higher Is Better a1.4xlarge Graviton ... 1863643.00 |=============== c6g.4xlarge Graviton2 . 3356810.71 |============================ c7g.4xlarge Graviton3 . 4482125.33 |===================================== c6a.4xlarge EPYC ...... 5171179.33 |=========================================== c6i.4xlarge Xeon ...... 5090915.88 |========================================== Apache HTTP Server 2.4.48 Performance / Cost - Concurrent Requests: 200 Requests Per Second Per Dollar > Higher Is Better a1.4xlarge Graviton ... 2088758.00 |================ c6g.4xlarge Graviton2 . 3575712.14 |============================ c7g.4xlarge Graviton3 . 4911796.67 |====================================== c6a.4xlarge EPYC ...... 5538000.00 |=========================================== c6i.4xlarge Xeon ...... 5556365.88 |=========================================== Apache HTTP Server 2.4.48 Performance / Cost - Concurrent Requests: 500 Requests Per Second Per Dollar > Higher Is Better a1.4xlarge Graviton ... 2013349.00 |================ c6g.4xlarge Graviton2 . 3576986.43 |============================ c7g.4xlarge Graviton3 . 4903088.00 |======================================= c6a.4xlarge EPYC ...... 5466376.00 |=========================================== c6i.4xlarge Xeon ...... 5396857.06 |========================================== Apache HTTP Server 2.4.48 Performance / Cost - Concurrent Requests: 1000 Requests Per Second Per Dollar > Higher Is Better a1.4xlarge Graviton ... 1927868.00 |================= c6g.4xlarge Graviton2 . 3330675.00 |============================== c7g.4xlarge Graviton3 . 4847955.33 |=========================================== c6a.4xlarge EPYC ...... 4769140.67 |========================================== c6i.4xlarge Xeon ...... 4695938.82 |========================================== PHPBench 0.8.1 Performance / Cost - PHP Benchmark Suite Score Per Dollar > Higher Is Better a1.4xlarge Graviton ... 26806555.56 |======= c6g.4xlarge Graviton2 . 64265000.00 |================ c7g.4xlarge Graviton3 . 133296800.00 |================================= c6a.4xlarge EPYC ...... 68677285.71 |================= c6i.4xlarge Xeon ...... 165637200.00 |=========================================