X3D Zen 4

Benchmarks for a future article..

HTML result view exported from: https://openbenchmarking.org/result/2303056-NE-X3DUPPER661&grs.

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Standard

ASKAP

Test: tConvolve OpenMP - Degridding

CloverLeaf

Lagrangian-Eulerian Hydrodynamics

oneDNN

Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

Pennant

Test: leblancbig

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU

OpenVINO

Model: Face Detection FP16 - Device: CPU

KTX-Software toktx

Settings: UASTC 4 + Zstd Compression 19

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Parallel

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

oneDNN

Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU

oneDNN

Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU

Xmrig

Variant: Wownero - Hash Count: 1M

ACES DGEMM

Sustained Floating-Point Rate

OpenVINO

Model: Person Detection FP16 - Device: CPU

Pennant

Test: sedovbig

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenFOAM

Input: drivaerFastback, Small Mesh Size - Execution Time

Embree

Binary: Pathtracer ISPC - Model: Crown

ASKAP

Test: tConvolve OpenMP - Gridding

Embree

Binary: Pathtracer - Model: Crown

OpenVINO

Model: Person Detection FP32 - Device: CPU

TensorFlow

Device: CPU - Batch Size: 256 - Model: AlexNet

Embree

Binary: Pathtracer - Model: Asian Dragon

KTX-Software toktx

Settings: UASTC 3

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel

Embree

Binary: Pathtracer - Model: Asian Dragon Obj

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon Obj

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

TensorFlow

Device: CPU - Batch Size: 64 - Model: AlexNet

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Parallel

Zstd Compression

Compression Level: 8 - Compression Speed

ONNX Runtime

Model: yolov4 - Device: CPU - Executor: Parallel

ASKAP

Test: Hogbom Clean OpenMP

Zstd Compression

Compression Level: 8, Long Mode - Compression Speed

srsRAN

Test: 4G PHY_DL_Test 100 PRB SISO 256-QAM

ONNX Runtime

Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel

NCNN

Target: CPU - Model: vision_transformer

Zstd Compression

Compression Level: 19, Long Mode - Compression Speed

Zstd Compression

Compression Level: 12 - Compression Speed

KTX-Software toktx

Settings: UASTC 3 + Zstd Compression 19

NCNN

Target: CPU - Model: regnety_400m

GPAW

Input: Carbon Nanotube

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

TensorFlow

Device: CPU - Batch Size: 32 - Model: AlexNet

Xmrig

Variant: Monero - Hash Count: 1M

TensorFlow

Device: CPU - Batch Size: 256 - Model: GoogLeNet

TensorFlow

Device: CPU - Batch Size: 32 - Model: GoogLeNet

NCNN

Target: CPU - Model: blazeface

ONNX Runtime

Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel

TensorFlow

Device: CPU - Batch Size: 16 - Model: GoogLeNet

TensorFlow

Device: CPU - Batch Size: 64 - Model: GoogLeNet

Xcompact3d Incompact3d

Input: input.i3d 129 Cells Per Direction

NCNN

Target: CPU - Model: alexnet

ClickHouse

100M Rows Hits Dataset, Third Run

Xcompact3d Incompact3d

Input: input.i3d 193 Cells Per Direction

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Execution Time

ONNX Runtime

Model: GPT-2 - Device: CPU - Executor: Standard

TensorFlow

Device: CPU - Batch Size: 256 - Model: ResNet-50

ClickHouse

100M Rows Hits Dataset, Second Run

OpenFOAM

Input: drivaerFastback, Small Mesh Size - Mesh Time

ASKAP

Test: tConvolve MT - Gridding

srsRAN

Test: 4G PHY_DL_Test 100 PRB SISO 256-QAM

TensorFlow

Device: CPU - Batch Size: 64 - Model: ResNet-50

Zstd Compression

Compression Level: 3 - Compression Speed

TensorFlow

Device: CPU - Batch Size: 32 - Model: ResNet-50

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Standard

ONNX Runtime

Model: GPT-2 - Device: CPU - Executor: Parallel

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Mesh Time

ClickHouse

100M Rows Hits Dataset, First Run / Cold Cache

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

NCNN

Target: CPU - Model: shufflenet-v2

ASKAP

Test: tConvolve MPI - Gridding

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

TensorFlow

Device: CPU - Batch Size: 16 - Model: AlexNet

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

ASKAP

Test: tConvolve MPI - Degridding

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

ASKAP

Test: tConvolve MT - Degridding

OpenVINO

Model: Person Detection FP16 - Device: CPU

Zstd Compression

Compression Level: 19 - Compression Speed

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenVINO

Model: Face Detection FP16 - Device: CPU

NCNN

Target: CPU-v2-v2 - Model: mobilenet-v2

NCNN

Target: CPU - Model: mnasnet

NCNN

Target: CPU - Model: mobilenet

ONNX Runtime

Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel

Zstd Compression

Compression Level: 3, Long Mode - Compression Speed

NCNN

Target: CPU - Model: efficientnet-b0

NCNN

Target: CPU - Model: vgg16

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

LULESH

NCNN

Target: CPU-v3-v3 - Model: mobilenet-v3

NCNN

Target: CPU - Model: resnet50

NCNN

Target: CPU - Model: squeezenet_ssd

srsRAN

Test: OFDM_Test

srsRAN

Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAM

KTX-Software toktx

Settings: Zstd Compression 19

NCNN

Target: CPU - Model: yolov4-tiny

Zstd Compression

Compression Level: 19 - Decompression Speed

srsRAN

Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAM

LeelaChessZero

Backend: BLAS

srsRAN

Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAM

srsRAN

Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAM

Zstd Compression

Compression Level: 8, Long Mode - Decompression Speed