Gigabyte G242-P36 Ampere Altra Max Server

Benchmarks by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2401176-NE-GIGABYTEG67&grs&rdt.

Llama.cpp

Model: llama-2-7b.Q4_0.gguf

Stress-NG

Test: Cloning

RocksDB

Test: Random Read

RocksDB

Test: Read Random Write Random

Stress-NG

Test: Context Switching

LeelaChessZero

Backend: BLAS

Stress-NG

Test: IO_uring

Quicksilver

Input: CORAL2 P2

Stress-NG

Test: Forking

Speedb

Test: Read Random Write Random

RocksDB

Test: Update Random

Speedb

Test: Sequential Fill

Stress-NG

Test: Pipe

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream

Speedb

Test: Update Random

ACES DGEMM

Sustained Floating-Point Rate

Speedb

Test: Random Read

Speedb

Test: Random Fill

Neural Magic DeepSparse

Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream

Llama.cpp

Model: llama-2-70b-chat.Q5_0.gguf

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

LeelaChessZero

Backend: Eigen

Quicksilver

Input: CORAL2 P1

Timed Linux Kernel Compilation

Build: defconfig

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

Stress-NG

Test: Socket Activity

Speedb

Test: Random Fill Sync

Quicksilver

Input: CTS2

Llama.cpp

Model: llama-2-13b.Q4_0.gguf

Stress-NG

Test: MMAP

RocksDB

Test: Read While Writing

Stress-NG

Test: Mixed Scheduler

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream

OpenSSL

Algorithm: SHA256

Stress-NG

Test: MEMFD

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

Timed LLVM Compilation

Build System: Ninja

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

Timed LLVM Compilation

Build System: Unix Makefiles

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

Stress-NG

Test: Semaphores

Stress-NG

Test: Poll

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

Stress-NG

Test: NUMA

7-Zip Compression

Test: Decompression Rating

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

miniFE

Problem Size: Small

Stress-NG

Test: CPU Stress

Timed Linux Kernel Compilation

Build: allmodconfig

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream

7-Zip Compression

Test: Compression Rating

Stress-NG

Test: Pthread

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream

Stress-NG

Test: System V Message Passing

Stress-NG

Test: Wide Vector Math

Stress-NG

Test: Matrix 3D Math

Stress-NG

Test: Malloc

Stress-NG

Test: CPU Cache

Stress-NG

Test: AVL Tree

Algebraic Multi-Grid Benchmark

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream

Stress-NG

Test: Mutex

Stress-NG

Test: Fused Multiply-Add

Stress-NG

Test: Vector Shuffle

Stress-NG

Test: Zlib

Stress-NG

Test: Glibc C String Functions

Stress-NG

Test: Crypto

Stress-NG

Test: Hash

Stress-NG

Test: Matrix Math

Stress-NG

Test: Glibc Qsort Data Sorting

OpenSSL

Algorithm: SHA512

Stress-NG

Test: Vector Floating Point

Neural Magic DeepSparse

Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream

OpenSSL

Algorithm: RSA4096

OpenSSL

Algorithm: RSA4096

Stress-NG

Test: AVX-512 VNNI

OpenSSL

Algorithm: AES-128-GCM

Stress-NG

Test: Vector Math

OpenSSL

Algorithm: ChaCha20

CacheBench

Test: Write

OpenSSL

Algorithm: ChaCha20-Poly1305

Stress-NG

Test: Floating Point

Stress-NG

Test: Memory Copying

CacheBench

Test: Read / Modify / Write

Stress-NG

Test: SENDFILE

Stress-NG

Test: Function Call

OpenSSL

Algorithm: AES-256-GCM

CacheBench

Test: Read

Xmrig

Variant: Wownero - Hash Count: 1M

Xmrig

Variant: Monero - Hash Count: 1M

PyTorch

Device: CPU - Batch Size: 16 - Model: ResNet-152

PyTorch

Device: CPU - Batch Size: 16 - Model: ResNet-50

PyTorch

Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_l

PyTorch

Device: CPU - Batch Size: 1 - Model: ResNet-152

PyTorch

Device: CPU - Batch Size: 1 - Model: ResNet-50

Stockfish

Total Time

Stress-NG

Test: Futex

Stress-NG

Test: Atomic

Speedb

Test: Read While Writing

Phoronix Test Suite v10.8.5