AMD EPYC Turin AVX-512 Comparison

AMD EPYC 9755 AVX-512 comparison by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2410104-NE-TURINAVX566&grr&rdt.

OpenVKL

Benchmark: vklBenchmarkCPU ISPC

Xmrig

Variant: GhostRider - Hash Count: 1M

TensorFlow

Device: CPU - Batch Size: 512 - Model: ResNet-50

ONNX Runtime

Model: ResNet101_DUC_HDC-12 - Device: CPU - Executor: Standard

ONNX Runtime

Model: ResNet101_DUC_HDC-12 - Device: CPU - Executor: Standard

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Standard

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Standard

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Standard

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Standard

simdjson

Throughput Test: PartialTweets

SVT-AV1

Encoder Mode: Preset 3 - Input: Bosphorus 4K

TensorFlow

Device: CPU - Batch Size: 256 - Model: ResNet-50

Numpy Benchmark

Mobile Neural Network

Model: resnet-v2-50

Mobile Neural Network

Model: mobilenetV3

simdjson

Throughput Test: Kostya

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Execution Time

simdjson

Throughput Test: DistinctUserID

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

oneDNN

Harness: Recurrent Neural Network Training - Engine: CPU

simdjson

Throughput Test: LargeRandom

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Standard

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Standard

simdjson

Throughput Test: TopTweet

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

libxsmm

M N K: 128

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

Y-Cruncher

Pi Digits To Calculate: 10B

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

OpenVINO

Model: Noise Suppression Poconet-Like FP16 - Device: CPU

OpenVINO

Model: Noise Suppression Poconet-Like FP16 - Device: CPU

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenVINO

Model: Person Re-Identification Retail FP16 - Device: CPU

OpenVINO

Model: Person Re-Identification Retail FP16 - Device: CPU

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

ONNX Runtime

Model: GPT-2 - Device: CPU - Executor: Standard

ONNX Runtime

Model: GPT-2 - Device: CPU - Executor: Standard

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

PyTorch

Device: CPU - Batch Size: 512 - Model: ResNet-50

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

PyTorch

Device: CPU - Batch Size: 256 - Model: ResNet-50

SVT-AV1

Encoder Mode: Preset 5 - Input: Bosphorus 4K

Y-Cruncher

Pi Digits To Calculate: 5B

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

NAMD

Input: STMV with 1,066,628 Atoms

PyTorch

Device: CPU - Batch Size: 1 - Model: ResNet-50

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

miniBUDE

Implementation: OpenMP - Input Deck: BM2

miniBUDE

Implementation: OpenMP - Input Deck: BM2

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon Obj

Y-Cruncher

Pi Digits To Calculate: 1B

SMHasher

Hash: FarmHash32 x86_64 AVX

SMHasher

Hash: FarmHash32 x86_64 AVX

NAMD

Input: ATPase with 327,506 Atoms

OpenFOAM

Input: drivaerFastback, Small Mesh Size - Execution Time

oneDNN

Harness: IP Shapes 3D - Engine: CPU

oneDNN

Harness: Convolution Batch Shapes Auto - Engine: CPU

Embree

Binary: Pathtracer ISPC - Model: Crown

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

oneDNN

Harness: Deconvolution Batch shapes_3d - Engine: CPU

miniBUDE

Implementation: OpenMP - Input Deck: BM1

miniBUDE

Implementation: OpenMP - Input Deck: BM1

CPU Temperature Monitor

Phoronix Test Suite System Monitoring

CPU Power Consumption Monitor

Phoronix Test Suite System Monitoring

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Phoronix Test Suite System Monitoring

SVT-AV1

CPU Temperature Monitor

SVT-AV1

CPU Power Consumption Monitor