Sapphire Rapids AVX-512 Benchmarks

Ice Lake, Sapphire Rapids, Genoa AVX-512 benchmarks by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2301176-NE-SAPPHIRER14&sro&grs.

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

Cpuminer-Opt

Algorithm: LBC, LBRY Credits

Cpuminer-Opt

Algorithm: Quad SHA-256, Pyrite

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

Cpuminer-Opt

Algorithm: Triple SHA-256, Onecoin

Cpuminer-Opt

Algorithm: Skeincoin

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

miniBUDE

Implementation: OpenMP - Input Deck: BM2

miniBUDE

Implementation: OpenMP - Input Deck: BM2

Cpuminer-Opt

Algorithm: scrypt

Cpuminer-Opt

Algorithm: x25x

miniBUDE

Implementation: OpenMP - Input Deck: BM1

miniBUDE

Implementation: OpenMP - Input Deck: BM1

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

Mobile Neural Network

Model: squeezenetv1.1

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Execution Time

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

Mobile Neural Network

Model: resnet-v2-50

Embree

Binary: Pathtracer ISPC - Model: Crown

Cpuminer-Opt

Algorithm: Deepcoin

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenFOAM

Input: drivaerFastback, Large Mesh Size - Execution Time

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

LeelaChessZero

Backend: Eigen

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

Mobile Neural Network

Model: SqueezeNetV1.0

Mobile Neural Network

Model: mobilenetV3

LeelaChessZero

Backend: BLAS

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

Intel Open Image Denoise

Run: RT.hdr_alb_nrm.3840x2160

Intel Open Image Denoise

Run: RTLightmap.hdr.4096x4096

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenVKL

Benchmark: vklBenchmark ISPC

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

SMHasher

Hash: FarmHash32 x86_64 AVX

OpenFOAM

Input: drivaerFastback, Large Mesh Size - Mesh Time

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Mesh Time

CPU Power Consumption Monitor

Phoronix Test Suite System Monitoring