Gigabyte G242-P36 Ampere Altra Max Server

Benchmarks by Michael Larabel.

HTML result view exported from: https://openbenchmarking.org/result/2401172-NE-GIGABYTEG53&grr.

PyTorch

Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_l

PyTorch

Device: CPU - Batch Size: 16 - Model: ResNet-152

PyTorch

Device: CPU - Batch Size: 16 - Model: ResNet-50

PyTorch

Device: CPU - Batch Size: 1 - Model: ResNet-152

Speedb

Test: Sequential Fill

PyTorch

Device: CPU - Batch Size: 1 - Model: ResNet-50

Xmrig

Variant: Wownero - Hash Count: 1M

Stress-NG

Test: Atomic

Neural Magic DeepSparse

Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream

Timed LLVM Compilation

Build System: Unix Makefiles

Llama.cpp

Model: llama-2-70b-chat.Q5_0.gguf

LeelaChessZero

Backend: BLAS

LeelaChessZero

Backend: Eigen

Stockfish

Total Time

Quicksilver

Input: CTS2

Timed Linux Kernel Compilation

Build: allmodconfig

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

Speedb

Test: Read While Writing

RocksDB

Test: Random Read

Timed LLVM Compilation

Build System: Ninja

Xmrig

Variant: Monero - Hash Count: 1M

Speedb

Test: Random Read

Llama.cpp

Model: llama-2-13b.Q4_0.gguf

Quicksilver

Input: CORAL2 P2

RocksDB

Test: Read While Writing

OpenSSL

Algorithm: ChaCha20-Poly1305

OpenSSL

Algorithm: ChaCha20

OpenSSL

Algorithm: AES-128-GCM

OpenSSL

Algorithm: SHA256

OpenSSL

Algorithm: AES-256-GCM

OpenSSL

Algorithm: SHA512

Stress-NG

Test: Futex

Stress-NG

Test: Context Switching

RocksDB

Test: Read Random Write Random

CacheBench

Test: Read

CacheBench

Test: Read / Modify / Write

CacheBench

Test: Write

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream

Stress-NG

Test: MEMFD

Timed Linux Kernel Compilation

Build: defconfig

Algebraic Multi-Grid Benchmark

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream

Speedb

Test: Random Fill

Speedb

Test: Random Fill Sync

Speedb

Test: Update Random

Speedb

Test: Read Random Write Random

RocksDB

Test: Update Random

OpenSSL

Algorithm: RSA4096

OpenSSL

Algorithm: RSA4096

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream

Quicksilver

Input: CORAL2 P1

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

Llama.cpp

Model: llama-2-7b.Q4_0.gguf

7-Zip Compression

Test: Decompression Rating

7-Zip Compression

Test: Compression Rating

Stress-NG

Test: IO_uring

Stress-NG

Test: MMAP

Stress-NG

Test: Cloning

Stress-NG

Test: Malloc

Stress-NG

Test: CPU Cache

Stress-NG

Test: Pthread

Stress-NG

Test: Zlib

Stress-NG

Test: Wide Vector Math

Stress-NG

Test: Function Call

Stress-NG

Test: SENDFILE

Stress-NG

Test: CPU Stress

Stress-NG

Test: AVL Tree

Stress-NG

Test: Matrix 3D Math

Stress-NG

Test: Fused Multiply-Add

Stress-NG

Test: Vector Math

Stress-NG

Test: Vector Shuffle

Stress-NG

Test: System V Message Passing

Stress-NG

Test: Forking

Stress-NG

Test: Memory Copying

Stress-NG

Test: Crypto

Stress-NG

Test: Hash

Stress-NG

Test: Matrix Math

Stress-NG

Test: AVX-512 VNNI

Stress-NG

Test: Vector Floating Point

Stress-NG

Test: Semaphores

Stress-NG

Test: Glibc Qsort Data Sorting

Stress-NG

Test: Mixed Scheduler

Stress-NG

Test: Pipe

Stress-NG

Test: Floating Point

Stress-NG

Test: Poll

Stress-NG

Test: NUMA

Stress-NG

Test: Socket Activity

Stress-NG

Test: Glibc C String Functions

Stress-NG

Test: Mutex

miniFE

Problem Size: Small

ACES DGEMM

Sustained Floating-Point Rate

System Power Consumption Monitor

Phoronix Test Suite System Monitoring

CPU Temperature Monitor

Phoronix Test Suite System Monitoring

CPU Power Consumption Monitor

Phoronix Test Suite System Monitoring

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Phoronix Test Suite System Monitoring

GROMACS

System Power Consumption Monitor

GROMACS

CPU Temperature Monitor

GROMACS

CPU Power Consumption Monitor

GROMACS

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Algebraic Multi-Grid Benchmark

System Power Consumption Monitor

Algebraic Multi-Grid Benchmark

CPU Temperature Monitor

Algebraic Multi-Grid Benchmark

CPU Power Consumption Monitor

Algebraic Multi-Grid Benchmark

CPU Peak Freq (Highest CPU Core Frequency) Monitor

ACES DGEMM

System Power Consumption Monitor

ACES DGEMM

CPU Temperature Monitor

ACES DGEMM

CPU Power Consumption Monitor

ACES DGEMM

CPU Peak Freq (Highest CPU Core Frequency) Monitor

miniFE

System Power Consumption Monitor

miniFE

CPU Temperature Monitor

miniFE

CPU Power Consumption Monitor

miniFE

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenSSL

System Power Consumption Monitor

OpenSSL

CPU Temperature Monitor

OpenSSL

CPU Power Consumption Monitor

OpenSSL

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenSSL

System Power Consumption Monitor

OpenSSL

CPU Temperature Monitor

OpenSSL

CPU Power Consumption Monitor

OpenSSL

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenSSL

System Power Consumption Monitor

OpenSSL

CPU Temperature Monitor

OpenSSL

CPU Power Consumption Monitor

OpenSSL

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenSSL

System Power Consumption Monitor

OpenSSL

CPU Temperature Monitor

OpenSSL

CPU Power Consumption Monitor