Amazon EC2 Graviton3 Benchmark Comparison Amazon AWS Graviton3 benchmarks by Michael Larabel. ,,"a1.4xlarge Graviton","c6g.4xlarge Graviton2","c7g.4xlarge Graviton3","c6a.4xlarge EPYC","c6i.4xlarge Xeon" Processor,,ARMv8 Cortex-A72 (16 Cores),ARMv8 Neoverse-N1 (16 Cores),ARMv8 Neoverse-V1 (16 Cores),AMD EPYC 7R13 (8 Cores / 16 Threads),Intel Xeon Platinum 8375C (8 Cores / 16 Threads) Motherboard,,Amazon EC2 a1.4xlarge (1.0 BIOS),Amazon EC2 c6g.4xlarge (1.0 BIOS),Amazon EC2 c7g.4xlarge (1.0 BIOS),Amazon EC2 c6a.4xlarge (1.0 BIOS),Amazon EC2 c6i.4xlarge (1.0 BIOS) Chipset,,Amazon Device 0200,Amazon Device 0200,Amazon Device 0200,Intel 440FX 82441FX PMC,Intel 440FX 82441FX PMC Memory,,32GB,32GB,32GB,32GB,32GB Disk,,193GB Amazon Elastic Block Store,193GB Amazon Elastic Block Store,193GB Amazon Elastic Block Store,193GB Amazon Elastic Block Store,193GB Amazon Elastic Block Store Network,,Amazon Elastic,Amazon Elastic,Amazon Elastic,Amazon Elastic,Amazon Elastic OS,,Ubuntu 22.04,Ubuntu 22.04,Ubuntu 22.04,Ubuntu 22.04,Ubuntu 22.04 Kernel,,5.15.0-1004-aws (aarch64),5.15.0-1004-aws (aarch64),5.15.0-1004-aws (aarch64),5.15.0-1004-aws (x86_64),5.15.0-1004-aws (x86_64) Compiler,,GCC 11.2.0,GCC 11.2.0,GCC 11.2.0,GCC 11.2.0,GCC 11.2.0 File-System,,ext4,ext4,ext4,ext4,ext4 System Layer,,amazon,amazon,amazon,amazon,amazon ,,"a1.4xlarge Graviton","c6g.4xlarge Graviton2","c7g.4xlarge Graviton3","c6a.4xlarge EPYC","c6i.4xlarge Xeon" "High Performance Conjugate Gradient - (GFLOP/s)",HIB,3.77834,19.7218,26.3058,5.06042,8.66031 "NAS Parallel Benchmarks - Test / Class: BT.C (Mop/s)",HIB,3148.18,6449.11,10339.53,13134.46,13888.40 "NAS Parallel Benchmarks - Test / Class: CG.C (Mop/s)",HIB,1213.15,3520.86,6571.95,6169.22,9522.82 "NAS Parallel Benchmarks - Test / Class: EP.D (Mop/s)",HIB,339.20,558.88,934.72,466.21,1103.22 "NAS Parallel Benchmarks - Test / Class: FT.C (Mop/s)",HIB,2927.16,6244.48,11791.77,18299.96,20423.57 "NAS Parallel Benchmarks - Test / Class: IS.D (Mop/s)",HIB,197.57,372.76,1041.90,541.35,861.57 "NAS Parallel Benchmarks - Test / Class: LU.C (Mop/s)",HIB,2558.12,5133.89,7730.41,25140.55,38136.77 "NAS Parallel Benchmarks - Test / Class: MG.C (Mop/s)",HIB,3266.36,6720.68,13481.61,16826.43,26298.81 "NAS Parallel Benchmarks - Test / Class: SP.C (Mop/s)",HIB,1293.80,2356.16,4467.19,8094.79,9563.22 "LeelaChessZero - Backend: BLAS (Nodes/s)",HIB,135,864,1103,1091,1397 "LeelaChessZero - Backend: Eigen (Nodes/s)",HIB,128,834,1189,1001,1466 "Rodinia - Test: OpenMP LavaMD (sec)",LIB,360.304,215.666,143.334,224.331,281.389 "Rodinia - Test: OpenMP CFD Solver (sec)",LIB,41.450,17.035,10.478,21.789,20.446 "Rodinia - Test: OpenMP Streamcluster (sec)",LIB,47.430,15.484,13.296,18.383,23.512 "Algebraic Multi-Grid Benchmark - (Figure Of Merit)",HIB,186716933,932652900,1258807333,267670700,661364767 "Timed MrBayes Analysis - Primate Phylogeny Analysis (sec)",LIB,644.788,384.753,251.397,120.636,134.924 "Xcompact3d Incompact3d - Input: input.i3d 129 Cells Per Direction (sec)",LIB,53.7706274,11.5733547,8.01671425,28.2797661,17.8682772 "Xcompact3d Incompact3d - Input: input.i3d 193 Cells Per Direction (sec)",LIB,182.583939,41.0240835,29.1258570,110.770027,69.2169978 "LAMMPS Molecular Dynamics Simulator - Model: Rhodopsin Protein (ns/day)",HIB,3.245,7.935,11.291,5.067,6.220 "LULESH - (z/s)",HIB,2328.2724,6016.1627,10940.939,5452.1051,8112.3715 "WebP Image Encode - Encode Settings: Quality 100, Lossless (Encode Time - sec)",LIB,61.801,31.082,22.769,26.708,21.122 "WebP Image Encode - Encode Settings: Quality 100, Lossless, Highest Compression (Encode Time - sec)",LIB,124.708,66.147,48.208,48.677,41.805 "simdjson - Throughput Test: Kostya (GB/s)",HIB,0.63,1.19,1.94,2.80,2.46 "simdjson - Throughput Test: LargeRandom (GB/s)",HIB,0.3,0.49,0.7,0.95,0.86 "simdjson - Throughput Test: PartialTweets (GB/s)",HIB,0.78,1.51,2.62,3.64,3.71 "simdjson - Throughput Test: DistinctUserID (GB/s)",HIB,0.8,1.53,2.69,4.30,4.30 "DaCapo Benchmark - Java Test: H2 (msec)",LIB,6740,3964,2951,3019,2921 "DaCapo Benchmark - Java Test: Jython (msec)",LIB,12997,5626,3940,4616,4013 "DaCapo Benchmark - Java Test: Tradesoap (msec)",LIB,11182,4506,3524,4052,3815 "DaCapo Benchmark - Java Test: Tradebeans (msec)",LIB,9045,4344,3203,3167,2928 "Zstd Compression - Compression Level: 3 - Compression Speed (MB/s)",HIB,633.9,2878.8,4639.1,2768.7,3440.6 "Zstd Compression - Compression Level: 19 - Compression Speed (MB/s)",HIB,16.9,34.6,41.2,30.0,38.1 "Zstd Compression - Compression Level: 19 - Decompression Speed (MB/s)",HIB,1121.7,2051.6,3050.3,2907.5,2582.0 "Zstd Compression - Compression Level: 19, Long Mode - Compression Speed (MB/s)",HIB,16,31.0,39.5,25.9,33.8 "Zstd Compression - Compression Level: 19, Long Mode - Decompression Speed (MB/s)",HIB,1213.9,2196.3,3240.6,2826.0,2666.1 "TSCP - AI Chess Performance (Nodes/s)",HIB,538500,872313,1370094,1442631,1272596 "ACES DGEMM - Sustained Floating-Point Rate (GFLOP/s)",HIB,0.891391,4.785123,5.853864,2.432432,2.230545 "Coremark - CoreMark Size 666 - Iterations Per Second (Iterations/Sec)",HIB,203869.402017,315464.339800,405413.860554,345133.440541,285378.841661 "7-Zip Compression - Test: Compression Rating (MIPS)",HIB,32498,71285,97824,62562,66631 "7-Zip Compression - Test: Decompression Rating (MIPS)",HIB,40891,59445,73054,57318,45653 "Stockfish - Total Time (Nodes/s)",HIB,10980430,21679245,27608891,23857623,22081961 "asmFish - 1024 Hash Memory, 26 Depth (Nodes/s)",HIB,15331550,26540482,32134123,26187688,23746200 "libavif avifenc - Encoder Speed: 0 (sec)",LIB,768.302,406.937,256.841,195.532,204.994 "libavif avifenc - Encoder Speed: 2 (sec)",LIB,449.022,238.205,141.698,93.946,97.735 "libavif avifenc - Encoder Speed: 6, Lossless (sec)",LIB,33.991,16.518,11.908,16.394,17.529 "Timed Apache Compilation - Time To Compile (sec)",LIB,74.742,34.201,26.940,23.532,22.527 "Timed Gem5 Compilation - Time To Compile (sec)",LIB,1155.615,488.805,391.171,515.201,469.940 "Timed ImageMagick Compilation - Time To Compile (sec)",LIB,93.632,40.333,27.904,32.626,29.737 "Timed LLVM Compilation - Build System: Ninja (sec)",LIB,1784.600,682.981,544.929,760.344,685.704 "Timed Node.js Compilation - Time To Compile (sec)",LIB,1765.910,628.401,497.579,664.347,604.620 "Timed PHP Compilation - Time To Compile (sec)",LIB,196.029,88.897,69.483,67.084,64.337 "Build2 - Time To Compile (sec)",LIB,353.912,142.277,115.020,150.994,136.801 "C-Ray - Total Time - 4K, 16 Rays Per Pixel (sec)",LIB,104.761,62.323,38.517,69.349,92.545 "POV-Ray - Trace Time (sec)",LIB,93.801,51.047,37.863,49.435,52.784 "m-queens - Time To Solve (sec)",LIB,110.368,75.224,66.822,72.330,91.231 "N-Queens - Elapsed Time (sec)",LIB,32.285,23.136,21.536,16.378,18.839 "Ngspice - Circuit: C2670 (sec)",LIB,473.901,263.724,198.224,245.886,147.893 "Ngspice - Circuit: C7552 (sec)",LIB,480.793,255.205,191.286,180.356,161.081 "Google SynthMark - Test: VoiceMark_100 (Voices)",HIB,331.070,470.389,675.635,663.073,565.690 "SecureMark - Benchmark: SecureMark-TLS (marks)",HIB,74356,120301,183708,213288,230549 "OpenSSL - Algorithm: SHA256 (byte/s)",HIB,6785689517,10723184083,13722045973,11691403353,7096993937 "OpenSSL - Algorithm: RSA4096 (sign/s)",HIB,588.3,660.6,2546.4,2088.9,2161.3 "OpenSSL - Algorithm: RSA4096 (verify/s)",HIB,45328.6,53951.5,178460.4,136784.2,140964.4 "Liquid-DSP - Threads: 16 - Buffer Length: 256 - Filter Length: 57 (samples/s)",HIB,165513333,262890000,383606667,509746667,373100000 "GROMACS - Implementation: MPI CPU - Input: water_GMX50_bare (Ns/Day)",HIB,0.316,0.781,1.128,1.004,1.452 "TensorFlow Lite - Model: SqueezeNet (us)",LIB,12014.7,3969.35,3257.94,3103.12,2983.93 "TensorFlow Lite - Model: Inception V4 (us)",LIB,188910,46793.9,41855.1,44920.6,41185.7 "TensorFlow Lite - Model: NASNet Mobile (us)",LIB,30986.7,14985.4,11591.9,9266.86,10900.6 "TensorFlow Lite - Model: Mobilenet Float (us)",LIB,9990.15,2500.87,2156.60,2159.72,1965.07 "TensorFlow Lite - Model: Mobilenet Quant (us)",LIB,5724.66,1980.24,1502.95,3847.96,3967.39 "TensorFlow Lite - Model: Inception ResNet V2 (us)",LIB,171169,45955.7,40051.3,41366.6,41179.7 "ASTC Encoder - Preset: Thorough (sec)",LIB,33.5198,16.5222,13.9248,7.9818,7.2625 "ASTC Encoder - Preset: Exhaustive (sec)",LIB,277.7669,159.2039,139.3797,72.3908,69.6387 "Stress-NG - Test: Crypto (Bogo Ops/s)",HIB,11985.38,17924.18,23181.81,13556.06,10210.34 "Stress-NG - Test: IO_uring (Bogo Ops/s)",HIB,918172.37,770521.81,843015.78,768723.46,1037943.37 "Stress-NG - Test: CPU Stress (Bogo Ops/s)",HIB,2366.00,3404.94,5029.71,13304.50,12527.16 "Stress-NG - Test: Vector Math (Bogo Ops/s)",HIB,27341.47,37753.89,55258.17,53787.61,40140.30 "Stress-NG - Test: Memory Copying (Bogo Ops/s)",HIB,798.24,2903.00,6693.32,3551.80,3150.49 "GPAW - Input: Carbon Nanotube (sec)",LIB,769.346,215.528,155.180,302.956,202.106 "PyBench - Total For Average Test Times (Milliseconds)",LIB,3452,1741,1185,1961,997 "nginx - Concurrent Requests: 100 (Reqs/sec)",HIB,143155.48,307349.36,345710.87,388010.76,356302.84 "nginx - Concurrent Requests: 200 (Reqs/sec)",HIB,141436.20,308938.67,352380.98,390932.79,356829.93 "nginx - Concurrent Requests: 500 (Reqs/sec)",HIB,139414.84,310596.58,346613.34,389030.11,351672.92 "nginx - Concurrent Requests: 1000 (Reqs/sec)",HIB,138205.11,308213.13,346814.75,388657.76,347345.49 "ONNX Runtime - Model: GPT-2 - Device: CPU - Executor: Standard (Inferences/min)",HIB,2312,6948,7990,5617,7944 "ONNX Runtime - Model: bertsquad-12 - Device: CPU - Executor: Standard (Inferences/min)",HIB,115,322,407,488,773 "ONNX Runtime - Model: fcn-resnet101-11 - Device: CPU - Executor: Standard (Inferences/min)",HIB,10,28,38,65,139 "ONNX Runtime - Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard (Inferences/min)",HIB,165,334,609,1192,1374 "ONNX Runtime - Model: super-resolution-10 - Device: CPU - Executor: Standard (Inferences/min)",HIB,757,2072,2817,3696,3450 "Apache HTTP Server - Concurrent Requests: 100 (Reqs/sec)",HIB,18636.43,46995.35,67231.88,77567.69,86545.57 "Apache HTTP Server - Concurrent Requests: 200 (Reqs/sec)",HIB,20887.58,50059.97,73676.95,83070.00,94458.22 "Apache HTTP Server - Concurrent Requests: 500 (Reqs/sec)",HIB,20133.49,50077.81,73546.32,81995.64,91746.57 "Apache HTTP Server - Concurrent Requests: 1000 (Reqs/sec)",HIB,19278.68,46629.45,72719.33,71537.11,79830.96 "PHPBench - PHP Benchmark Suite (Score)",HIB,241259,449855,666484,480741,828186