TR Comparison

AMD Ryzen Threadripper 7980X 64-Cores testing with a ASUS Pro WS TRX50-SAGE WIFI (0607 BIOS) and NAVI31 20GB on Pop 22.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2401134-NE-TRCOMPARI89
Jump To Table - Results

Statistics

Remove Outliers Before Calculating Averages

Graph Settings

Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs
Condense Test Profiles With Multiple Version Results Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
TR 7980X DIY Build
January 12
  9 Hours, 33 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


TR ComparisonOpenBenchmarking.orgPhoronix Test SuiteAMD Ryzen Threadripper 7980X 64-Cores @ 8.21GHz (64 Cores / 128 Threads)ASUS Pro WS TRX50-SAGE WIFI (0607 BIOS)AMD Device 14a44 x 32 GB DRAM-4800MT/s F5-6400R3239G32GQ1000GB Western Digital WDS100T1X0E-00AFY0NAVI31 20GB (2025/1249MHz)Realtek ALC1220DELL U2723QEAquantia Device 04c0 + Intel Device 125b + MEDIATEK Device 0616Pop 22.046.6.6-76060606-generic (x86_64)GNOME Shell 42.5X Server 1.21.1.44.6 Mesa 23.3.2-1pop0~1704238321~22.04~36f1d0e (LLVM 15.0.7 DRM 3.54)1.3.267GCC 11.4.0ext43840x2160ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen ResolutionTR Comparison BenchmarksSystem Logs- Transparent Huge Pages: madvise- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xa108105- Python 3.10.12- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

TR Comparisonpytorch: CPU - 1 - ResNet-152pytorch: CPU - 1 - Efficientnet_v2_lpytorch: CPU - 64 - ResNet-50pytorch: CPU - 64 - ResNet-152pytorch: CPU - 1 - ResNet-50pytorch: CPU - 64 - Efficientnet_v2_lopenvino: Face Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Crownsvt-av1: Preset 13 - Bosphorus 4Ksvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 4 - Bosphorus 4Ktensorflow: CPU - 1 - ResNet-50tensorflow: CPU - 16 - ResNet-50tensorflow: CPU - 256 - ResNet-50ospray: gravity_spheres_volume/dim_512/ao/real_timeospray: gravity_spheres_volume/dim_512/pathtracer/real_timeospray: particle_volume/scivis/real_timeospray: particle_volume/pathtracer/real_timeospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: particle_volume/ao/real_timedeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamindigobench: CPU - Supercarindigobench: CPU - Bedroomquantlib: Multi-Threadedcompress-7zip: Compression Ratingcompress-7zip: Decompression Ratinglczero: BLASlczero: Eigennumpy: llama-cpp: llama-2-7b.Q4_0.ggufllama-cpp: llama-2-13b.Q4_0.ggufllama-cpp: llama-2-70b-chat.Q5_0.ggufv-ray: CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamwhisper-cpp: ggml-base.en - 2016 State of the Unionwhisper-cpp: ggml-small.en - 2016 State of the Unionwhisper-cpp: ggml-medium.en - 2016 State of the Unionbuild-linux-kernel: defconfigbuild-linux-kernel: allmodconfigbuild-godot: Time To Compilebuild-ffmpeg: Time To Compilebuild-llvm: Ninjabuild-nodejs: Time To Compilebuild-gem5: Time To Compileblender: BMW27 - CPU-Onlyblender: Classroom - CPU-Onlyblender: Fishy Cat - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlyblender: Barbershop - CPU-Onlyopenfoam: drivaerFastback, Small Mesh Size - Mesh Timeopenfoam: drivaerFastback, Small Mesh Size - Execution Timeopenfoam: drivaerFastback, Medium Mesh Size - Mesh Timeopenfoam: drivaerFastback, Medium Mesh Size - Execution Timeopenradioss: Bird Strike on Windshieldopenradioss: Rubber O-Ring Seal Installationopenradioss: Cell Phone Drop Testopenradioss: Bumper Beamopenradioss: INIVOL and Fluid Structure Interaction Drop Containeropenradioss: Chrysler Neon 1MTR 7980X DIY Build22.0812.8748.3919.0559.798.2378.74112465.33220.467702.024727.164215.15429.1113253.181711.041601.38103.913893.4593194.101198.74090.4509.2467.6259.41105.8523.425726.506222.5832239.31922.644622.5275905.4136190.4801280.000122.2065130.5869133.539422.200441.9230280.02742372.168227.6721405.484934.44615.704245683.2443349529231557533753.6830.7818.433.0488574405.370.40145.958.096.677.4874.424.6037.3119.928.814041.962928.5428359.858861.212359.8761359.8583190.646828.54023.3518288.575819.7033191.99942445.32330925.9806523.413216.69079.84411.671122.225113.780178.79418.4747.1523.8057.94166.8819.55385636.85956104.60125617.2658105.4253.1823.4175.61115.12292.06OpenBenchmarking.org

CPU Temperature Monitor

OpenBenchmarking.orgCelsiusCPU Temperature MonitorPhoronix Test Suite System MonitoringTR 7980X DIY Build20406080100Min: 36.88 / Avg: 64.84 / Max: 94.75

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertzCPU Peak Freq (Highest CPU Core Frequency) MonitorPhoronix Test Suite System MonitoringTR 7980X DIY Build10002000300040005000Min: 545 / Avg: 4217.07 / Max: 5617

CPU Power Consumption Monitor

OpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringTR 7980X DIY Build70140210280350Min: 39.88 / Avg: 305.94 / Max: 372.82

PyTorch

OpenBenchmarking.orgbatches/sec Per Watt, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: ResNet-50TR 7980X DIY Build0.05220.10440.15660.20880.2610.232

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: ResNet-152TR 7980X DIY Build510152025SE +/- 0.12, N = 322.08MIN: 21.34 / MAX: 22.48

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_lTR 7980X DIY Build3691215SE +/- 0.04, N = 312.87MIN: 12.56 / MAX: 13.11

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: ResNet-50TR 7980X DIY Build1122334455SE +/- 0.35, N = 348.39MIN: 44.46 / MAX: 50.22

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: ResNet-152TR 7980X DIY Build510152025SE +/- 0.15, N = 319.05MIN: 18.34 / MAX: 19.48

OpenBenchmarking.orgbatches/sec Per Watt, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_lTR 7980X DIY Build0.00590.01180.01770.02360.02950.026

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: ResNet-50TR 7980X DIY Build1326395265SE +/- 0.17, N = 359.79MIN: 54.43 / MAX: 61.61

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_lTR 7980X DIY Build246810SE +/- 0.02, N = 38.23MIN: 6.24 / MAX: 8.41

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUTR 7980X DIY Build20406080100SE +/- 0.45, N = 378.741. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUTR 7980X DIY Build20K40K60K80K100KSE +/- 340.10, N = 3112465.331. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUTR 7980X DIY Build50100150200250SE +/- 5.43, N = 15220.461. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUTR 7980X DIY Build17003400510068008500SE +/- 11.71, N = 37702.021. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUTR 7980X DIY Build10002000300040005000SE +/- 5.51, N = 34727.161. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUTR 7980X DIY Build9001800270036004500SE +/- 6.56, N = 34215.151. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUTR 7980X DIY Build90180270360450SE +/- 0.87, N = 3429.111. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUTR 7980X DIY Build3K6K9K12K15KSE +/- 23.14, N = 313253.181. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUTR 7980X DIY Build400800120016002000SE +/- 4.52, N = 31711.041. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUTR 7980X DIY Build30060090012001500SE +/- 1.27, N = 31601.381. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

Embree

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownTR 7980X DIY Build0.08150.1630.24450.3260.40750.362

SVT-AV1

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 8 - Input: Bosphorus 4KTR 7980X DIY Build0.10170.20340.30510.40680.50850.452

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 4 - Input: Bosphorus 4KTR 7980X DIY Build0.00970.01940.02910.03880.04850.043

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonTR 7980X DIY Build20406080100SE +/- 0.08, N = 6103.91MIN: 102.79 / MAX: 105.67

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownTR 7980X DIY Build20406080100SE +/- 0.17, N = 693.46MIN: 91.73 / MAX: 95.85

SVT-AV1

This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 13 - Input: Bosphorus 4KTR 7980X DIY Build4080120160200SE +/- 1.79, N = 15194.101. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 12 - Input: Bosphorus 4KTR 7980X DIY Build4080120160200SE +/- 1.52, N = 15198.741. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 8 - Input: Bosphorus 4KTR 7980X DIY Build20406080100SE +/- 0.28, N = 590.451. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 4 - Input: Bosphorus 4KTR 7980X DIY Build3691215SE +/- 0.001, N = 39.2461. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 1 - Model: ResNet-50TR 7980X DIY Build246810SE +/- 0.02, N = 37.62

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: ResNet-50TR 7980X DIY Build1326395265SE +/- 0.19, N = 359.41

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 256 - Model: ResNet-50TR 7980X DIY Build20406080100SE +/- 1.06, N = 3105.85

OSPRay

Intel OSPRay is a portable ray-tracing engine for high-performance, high-fidelity scientific visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/ao/real_timeTR 7980X DIY Build612182430SE +/- 0.00, N = 323.43

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeTR 7980X DIY Build612182430SE +/- 0.03, N = 326.51

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/scivis/real_timeTR 7980X DIY Build510152025SE +/- 0.01, N = 322.58

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/pathtracer/real_timeTR 7980X DIY Build50100150200250SE +/- 0.48, N = 3239.32

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeTR 7980X DIY Build510152025SE +/- 0.03, N = 322.64

OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.12Benchmark: particle_volume/ao/real_timeTR 7980X DIY Build0.01510.03020.04530.06040.07550.067

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/ao/real_timeTR 7980X DIY Build510152025SE +/- 0.03, N = 322.53

Neural Magic DeepSparse

This is a benchmark of Neural Magic's DeepSparse using its built-in deepsparse.benchmark utility and various models from their SparseZoo (https://sparsezoo.neuralmagic.com/). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY Build2004006008001000SE +/- 1.13, N = 3905.41

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamTR 7980X DIY Build4080120160200SE +/- 0.04, N = 3190.48

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamTR 7980X DIY Build60120180240300SE +/- 0.18, N = 3280.00

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamTR 7980X DIY Build510152025SE +/- 0.03, N = 322.21

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamTR 7980X DIY Build306090120150SE +/- 0.20, N = 3130.59

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY Build306090120150SE +/- 0.12, N = 3133.54

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamTR 7980X DIY Build510152025SE +/- 0.03, N = 322.20

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamTR 7980X DIY Build1020304050SE +/- 0.02, N = 341.92

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-StreamTR 7980X DIY Build60120180240300SE +/- 0.06, N = 3280.03

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY Build5001000150020002500SE +/- 9.01, N = 32372.17

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-StreamTR 7980X DIY Build714212835SE +/- 0.04, N = 327.67

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY Build90180270360450SE +/- 0.14, N = 3405.48

IndigoBench

This is a test of Indigo Renderer's IndigoBench benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: CPU - Scene: SupercarTR 7980X DIY Build816243240SE +/- 0.02, N = 334.45

OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: CPU - Scene: BedroomTR 7980X DIY Build48121620SE +/- 0.03, N = 315.70

OpenVINO

MinAvgMaxTR 7980X DIY Build54536295194OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54538275018OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54541185219OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54535914456OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000

MinAvgMaxTR 7980X DIY Build54535375065OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build143236104876OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000

MinAvgMaxTR 7980X DIY Build54536374645OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000

MinAvgMaxTR 7980X DIY Build54535545044OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54535104194OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

MinAvgMaxTR 7980X DIY Build146736514945OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

Whisper.cpp

OpenBenchmarking.orgMegahertz, More Is BetterWhisper.cpp 1.4CPU Peak Freq (Highest CPU Core Frequency) MonitorTR 7980X DIY Build9001800270036004500Min: 545 / Avg: 4549.3 / Max: 4992

OpenBenchmarking.orgMegahertz, More Is BetterWhisper.cpp 1.4CPU Peak Freq (Highest CPU Core Frequency) MonitorTR 7980X DIY Build9001800270036004500Min: 545 / Avg: 4516.14 / Max: 5155

OpenBenchmarking.orgMegahertz, More Is BetterWhisper.cpp 1.4CPU Peak Freq (Highest CPU Core Frequency) MonitorTR 7980X DIY Build9001800270036004500Min: 545 / Avg: 4441.33 / Max: 5192

Llama.cpp

MinAvgMaxTR 7980X DIY Build54540144903OpenBenchmarking.orgMegahertz, More Is BetterLlama.cpp b1808CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54542995277OpenBenchmarking.orgMegahertz, More Is BetterLlama.cpp b1808CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

OpenBenchmarking.orgMegahertz, More Is BetterLlama.cpp b1808CPU Peak Freq (Highest CPU Core Frequency) MonitorTR 7980X DIY Build9001800270036004500Min: 545 / Avg: 4525.77 / Max: 5304

LeelaChessZero

MinAvgMaxTR 7980X DIY Build54543395391OpenBenchmarking.orgMegahertz, More Is BetterLeelaChessZero 0.30CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxTR 7980X DIY Build54543455371OpenBenchmarking.orgMegahertz, More Is BetterLeelaChessZero 0.30CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

Neural Magic DeepSparse

MinAvgMaxTR 7980X DIY Build54545235508OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxTR 7980X DIY Build54544645502OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxTR 7980X DIY Build54544345076OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54544425297OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54543665169OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54544174861OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000

MinAvgMaxTR 7980X DIY Build54544895591OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxTR 7980X DIY Build54544905296OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54543674822OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000

MinAvgMaxTR 7980X DIY Build54547335608OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxTR 7980X DIY Build54545375585OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

Numpy Benchmark

MinAvgMaxTR 7980X DIY Build54550315416OpenBenchmarking.orgMegahertz, More Is BetterNumpy BenchmarkCPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

Timed Linux Kernel Compilation

MinAvgMaxTR 7980X DIY Build54542825617OpenBenchmarking.orgMegahertz, More Is BetterTimed Linux Kernel Compilation 6.1CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxTR 7980X DIY Build149140945317OpenBenchmarking.orgMegahertz, More Is BetterTimed Linux Kernel Compilation 6.1CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

Timed Godot Game Engine Compilation

MinAvgMaxTR 7980X DIY Build54543575292OpenBenchmarking.orgMegahertz, More Is BetterTimed Godot Game Engine Compilation 4.0CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

Timed FFmpeg Compilation

MinAvgMaxTR 7980X DIY Build54539445336OpenBenchmarking.orgMegahertz, More Is BetterTimed FFmpeg Compilation 6.1CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

Timed LLVM Compilation

MinAvgMaxTR 7980X DIY Build54541875412OpenBenchmarking.orgMegahertz, More Is BetterTimed LLVM Compilation 16.0CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

Timed Node.js Compilation

MinAvgMaxTR 7980X DIY Build54542945442OpenBenchmarking.orgMegahertz, More Is BetterTimed Node.js Compilation 19.8.1CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

Timed Gem5 Compilation

MinAvgMaxTR 7980X DIY Build54547445577OpenBenchmarking.orgMegahertz, More Is BetterTimed Gem5 Compilation 23.0.1CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

Blender

MinAvgMaxTR 7980X DIY Build54533264194OpenBenchmarking.orgMegahertz, More Is BetterBlender 4.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

MinAvgMaxTR 7980X DIY Build54535375167OpenBenchmarking.orgMegahertz, More Is BetterBlender 4.0CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54532875137OpenBenchmarking.orgMegahertz, More Is BetterBlender 4.0CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54534954924OpenBenchmarking.orgMegahertz, More Is BetterBlender 4.0CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54536675267OpenBenchmarking.orgMegahertz, More Is BetterBlender 4.0CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

Chaos Group V-RAY

MinAvgMaxTR 7980X DIY Build54538195301OpenBenchmarking.orgMegahertz, More Is BetterChaos Group V-RAY 5.02CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

7-Zip Compression

MinAvgMaxTR 7980X DIY Build54538105277OpenBenchmarking.orgMegahertz, More Is Better7-Zip Compression 22.01CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

OpenFOAM

MinAvgMaxTR 7980X DIY Build54539115461OpenBenchmarking.orgMegahertz, More Is BetterOpenFOAM 10CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxTR 7980X DIY Build147044925340OpenBenchmarking.orgMegahertz, More Is BetterOpenFOAM 10CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

OpenRadioss

MinAvgMaxTR 7980X DIY Build54540035238OpenBenchmarking.orgMegahertz, More Is BetterOpenRadioss 2023.09.15CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54540115192OpenBenchmarking.orgMegahertz, More Is BetterOpenRadioss 2023.09.15CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54537775269OpenBenchmarking.orgMegahertz, More Is BetterOpenRadioss 2023.09.15CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54538205053OpenBenchmarking.orgMegahertz, More Is BetterOpenRadioss 2023.09.15CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54539445125OpenBenchmarking.orgMegahertz, More Is BetterOpenRadioss 2023.09.15CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54545585559OpenBenchmarking.orgMegahertz, More Is BetterOpenRadioss 2023.09.15CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

QuantLib

MinAvgMaxTR 7980X DIY Build54535214982OpenBenchmarking.orgMegahertz, More Is BetterQuantLib 1.32CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Multi-ThreadedTR 7980X DIY Build50K100K150K200K250KSE +/- 97.04, N = 3245683.21. (CXX) g++ options: -O3 -march=native -fPIE -pie

7-Zip Compression

This is a test of 7-Zip compression/decompression with its integrated benchmark feature. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression RatingTR 7980X DIY Build90K180K270K360K450KSE +/- 469.56, N = 34433491. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression RatingTR 7980X DIY Build110K220K330K440K550KSE +/- 1196.73, N = 35292311. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

LeelaChessZero

OpenBenchmarking.orgNodes Per Second Per Watt, More Is BetterLeelaChessZero 0.30Backend: EigenTR 7980X DIY Build0.39380.78761.18141.57521.9691.75

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.30Backend: BLASTR 7980X DIY Build120240360480600SE +/- 2.19, N = 35571. (CXX) g++ options: -flto -pthread

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.30Backend: EigenTR 7980X DIY Build120240360480600SE +/- 5.78, N = 35331. (CXX) g++ options: -flto -pthread

Meta Performance Per Watts

OpenBenchmarking.orgPerformance Per Watts, More Is BetterMeta Performance Per WattsPerformance Per WattsTR 7980X DIY Build2040608010099.29

Numpy Benchmark

OpenBenchmarking.orgScore Per Watt, More Is BetterNumpy BenchmarkTR 7980X DIY Build1.18462.36923.55384.73845.9235.265

OpenBenchmarking.orgScore, More Is BetterNumpy BenchmarkTR 7980X DIY Build160320480640800SE +/- 1.70, N = 3753.68

Llama.cpp

OpenBenchmarking.orgTokens Per Second Per Watt, More Is BetterLlama.cpp b1808Model: llama-2-7b.Q4_0.ggufTR 7980X DIY Build0.02390.04780.07170.09560.11950.106

OpenBenchmarking.orgTokens Per Second Per Watt, More Is BetterLlama.cpp b1808Model: llama-2-13b.Q4_0.ggufTR 7980X DIY Build0.01370.02740.04110.05480.06850.061

OpenBenchmarking.orgTokens Per Second Per Watt, More Is BetterLlama.cpp b1808Model: llama-2-70b-chat.Q5_0.ggufTR 7980X DIY Build0.0020.0040.0060.0080.010.009

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-7b.Q4_0.ggufTR 7980X DIY Build714212835SE +/- 0.02, N = 330.781. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-13b.Q4_0.ggufTR 7980X DIY Build510152025SE +/- 0.05, N = 318.431. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-70b-chat.Q5_0.ggufTR 7980X DIY Build0.6841.3682.0522.7363.42SE +/- 0.03, N = 123.041. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas

Chaos Group V-RAY

OpenBenchmarking.orgvsamples Per Watt, More Is BetterChaos Group V-RAY 5.02Mode: CPUTR 7980X DIY Build60120180240300289.23

OpenBenchmarking.orgvsamples, More Is BetterChaos Group V-RAY 5.02Mode: CPUTR 7980X DIY Build20K40K60K80K100KSE +/- 667.39, N = 388574

OpenVINO

MinAvgMaxTR 7980X DIY Build37.363.476.5OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build47.466.870.5OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build48.366.081.5OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build48.367.371.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build49.166.769.6OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build48.667.071.9OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build49.165.569.6OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build49.167.171.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build48.368.171.9OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build49.167.573.8OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

Whisper.cpp

OpenBenchmarking.orgCelsius, Fewer Is BetterWhisper.cpp 1.4CPU Temperature MonitorTR 7980X DIY Build1530456075Min: 49.13 / Avg: 69.31 / Max: 76

OpenBenchmarking.orgCelsius, Fewer Is BetterWhisper.cpp 1.4CPU Temperature MonitorTR 7980X DIY Build1428425670Min: 48.25 / Avg: 68.54 / Max: 75.13

OpenBenchmarking.orgCelsius, Fewer Is BetterWhisper.cpp 1.4CPU Temperature MonitorTR 7980X DIY Build1530456075Min: 49.13 / Avg: 69.3 / Max: 75.5

Neural Magic DeepSparse

MinAvgMaxTR 7980X DIY Build46.050.552.4OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor1530456075

MinAvgMaxTR 7980X DIY Build42.849.051.0OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor1530456075

MinAvgMaxTR 7980X DIY Build41.949.051.0OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor1530456075

MinAvgMaxTR 7980X DIY Build43.649.051.4OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor1530456075

MinAvgMaxTR 7980X DIY Build41.948.550.0OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor1428425670

MinAvgMaxTR 7980X DIY Build41.448.250.0OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor1428425670

MinAvgMaxTR 7980X DIY Build41.948.451.0OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor1530456075

MinAvgMaxTR 7980X DIY Build41.548.750.5OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor1428425670

MinAvgMaxTR 7980X DIY Build42.349.451.9OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor1530456075

MinAvgMaxTR 7980X DIY Build42.847.249.6OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor1428425670

MinAvgMaxTR 7980X DIY Build41.447.950.0OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor1428425670

Timed Linux Kernel Compilation

MinAvgMaxTR 7980X DIY Build38.355.084.6OpenBenchmarking.orgCelsius, Fewer Is BetterTimed Linux Kernel Compilation 6.1CPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build43.667.383.8OpenBenchmarking.orgCelsius, Fewer Is BetterTimed Linux Kernel Compilation 6.1CPU Temperature Monitor20406080100

Timed Godot Game Engine Compilation

MinAvgMaxTR 7980X DIY Build43.360.385.1OpenBenchmarking.orgCelsius, Fewer Is BetterTimed Godot Game Engine Compilation 4.0CPU Temperature Monitor20406080100

Timed FFmpeg Compilation

MinAvgMaxTR 7980X DIY Build43.655.679.6OpenBenchmarking.orgCelsius, Fewer Is BetterTimed FFmpeg Compilation 6.1CPU Temperature Monitor20406080100

Timed LLVM Compilation

MinAvgMaxTR 7980X DIY Build43.667.189.3OpenBenchmarking.orgCelsius, Fewer Is BetterTimed LLVM Compilation 16.0CPU Temperature Monitor20406080100

Timed Node.js Compilation

MinAvgMaxTR 7980X DIY Build46.964.988.3OpenBenchmarking.orgCelsius, Fewer Is BetterTimed Node.js Compilation 19.8.1CPU Temperature Monitor20406080100

Timed Gem5 Compilation

MinAvgMaxTR 7980X DIY Build41.954.682.9OpenBenchmarking.orgCelsius, Fewer Is BetterTimed Gem5 Compilation 23.0.1CPU Temperature Monitor20406080100

Blender

MinAvgMaxTR 7980X DIY Build40.059.567.4OpenBenchmarking.orgCelsius, Fewer Is BetterBlender 4.0CPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build47.467.372.0OpenBenchmarking.orgCelsius, Fewer Is BetterBlender 4.0CPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build48.364.482.9OpenBenchmarking.orgCelsius, Fewer Is BetterBlender 4.0CPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build48.668.071.5OpenBenchmarking.orgCelsius, Fewer Is BetterBlender 4.0CPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build49.669.187.0OpenBenchmarking.orgCelsius, Fewer Is BetterBlender 4.0CPU Temperature Monitor20406080100

OpenFOAM

MinAvgMaxTR 7980X DIY Build49.166.571.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenFOAM 10CPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build49.668.781.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenFOAM 10CPU Temperature Monitor20406080100

OpenRadioss

MinAvgMaxTR 7980X DIY Build48.370.382.9OpenBenchmarking.orgCelsius, Fewer Is BetterOpenRadioss 2023.09.15CPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build48.666.972.4OpenBenchmarking.orgCelsius, Fewer Is BetterOpenRadioss 2023.09.15CPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build49.164.186.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenRadioss 2023.09.15CPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build47.869.874.3OpenBenchmarking.orgCelsius, Fewer Is BetterOpenRadioss 2023.09.15CPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build50.069.488.3OpenBenchmarking.orgCelsius, Fewer Is BetterOpenRadioss 2023.09.15CPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build49.167.192.4OpenBenchmarking.orgCelsius, Fewer Is BetterOpenRadioss 2023.09.15CPU Temperature Monitor20406080100

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUTR 7980X DIY Build90180270360450SE +/- 2.22, N = 3405.37MIN: 344.27 / MAX: 423.971. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUTR 7980X DIY Build0.090.180.270.360.45SE +/- 0.00, N = 30.40MIN: 0.18 / MAX: 27.231. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUTR 7980X DIY Build306090120150SE +/- 3.04, N = 15145.95MIN: 40.15 / MAX: 306.091. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUTR 7980X DIY Build246810SE +/- 0.02, N = 38.09MIN: 3.7 / MAX: 19.861. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUTR 7980X DIY Build246810SE +/- 0.01, N = 36.67MIN: 3.42 / MAX: 321. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUTR 7980X DIY Build246810SE +/- 0.01, N = 37.48MIN: 4.13 / MAX: 17.571. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUTR 7980X DIY Build20406080100SE +/- 0.15, N = 374.42MIN: 39.51 / MAX: 109.011. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUTR 7980X DIY Build1.0352.073.1054.145.175SE +/- 0.01, N = 34.60MIN: 2.13 / MAX: 19.821. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUTR 7980X DIY Build918273645SE +/- 0.10, N = 337.31MIN: 21.65 / MAX: 56.71. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUTR 7980X DIY Build510152025SE +/- 0.02, N = 319.92MIN: 12.32 / MAX: 32.171. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

Neural Magic DeepSparse

This is a benchmark of Neural Magic's DeepSparse using its built-in deepsparse.benchmark utility and various models from their SparseZoo (https://sparsezoo.neuralmagic.com/). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY Build246810SE +/- 0.0108, N = 38.8140

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamTR 7980X DIY Build1020304050SE +/- 0.01, N = 341.96

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamTR 7980X DIY Build714212835SE +/- 0.02, N = 328.54

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamTR 7980X DIY Build80160240320400SE +/- 0.44, N = 3359.86

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamTR 7980X DIY Build1428425670SE +/- 0.10, N = 361.21

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY Build1326395265SE +/- 0.05, N = 359.88

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamTR 7980X DIY Build80160240320400SE +/- 0.17, N = 3359.86

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamTR 7980X DIY Build4080120160200SE +/- 0.02, N = 3190.65

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-StreamTR 7980X DIY Build714212835SE +/- 0.01, N = 328.54

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY Build0.75421.50842.26263.01683.771SE +/- 0.0127, N = 33.3518

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-StreamTR 7980X DIY Build60120180240300SE +/- 0.18, N = 3288.58

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY Build510152025SE +/- 0.01, N = 319.70

Whisper.cpp

Whisper.cpp is a port of OpenAI's Whisper model in C/C++. Whisper.cpp is developed by Georgi Gerganov for transcribing WAV audio files to text / speech recognition. Whisper.cpp supports ARM NEON, x86 AVX, and other advanced CPU features. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.4Model: ggml-base.en - Input: 2016 State of the UnionTR 7980X DIY Build4080120160200SE +/- 4.70, N = 12192.001. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread

OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.4Model: ggml-small.en - Input: 2016 State of the UnionTR 7980X DIY Build100200300400500SE +/- 15.22, N = 9445.321. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread

OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.4Model: ggml-medium.en - Input: 2016 State of the UnionTR 7980X DIY Build2004006008001000SE +/- 4.81, N = 3925.981. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread

Timed Linux Kernel Compilation

This test times how long it takes to build the Linux kernel in a default configuration (defconfig) for the architecture being tested or alternatively an allmodconfig for building all possible kernel modules for the build. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigTR 7980X DIY Build612182430SE +/- 0.23, N = 623.41

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfigTR 7980X DIY Build50100150200250SE +/- 0.36, N = 3216.69

Timed Mesa Compilation

This test profile times how long it takes to compile Mesa with Meson/Ninja. For minimizing build dependencies and avoid versioning conflicts, test this is just the core Mesa build without LLVM or the extra Gallium3D/Mesa drivers enabled. Learn more via the OpenBenchmarking.org test page.

Time To Compile

TR 7980X DIY Build: The test quit with a non-zero exit status. E: ninja: error: loading 'build.ninja': No such file or directory

Timed Godot Game Engine Compilation

This test times how long it takes to compile the Godot Game Engine. Godot is a popular, open-source, cross-platform 2D/3D game engine and is built using the SCons build system and targeting the X11 platform. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 4.0Time To CompileTR 7980X DIY Build20406080100SE +/- 0.14, N = 379.84

Timed FFmpeg Compilation

This test times how long it takes to build the FFmpeg multimedia library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 6.1Time To CompileTR 7980X DIY Build3691215SE +/- 0.03, N = 411.67

Timed LLVM Compilation

This test times how long it takes to compile/build the LLVM compiler stack. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: NinjaTR 7980X DIY Build306090120150SE +/- 0.22, N = 3122.23

Timed Node.js Compilation

This test profile times how long it takes to build/compile Node.js itself from source. Node.js is a JavaScript run-time built from the Chrome V8 JavaScript engine while itself is written in C/C++. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 19.8.1Time To CompileTR 7980X DIY Build306090120150SE +/- 0.78, N = 3113.78

Timed Gem5 Compilation

This test times how long it takes to compile Gem5. Gem5 is a simulator for computer system architecture research. Gem5 is widely used for computer architecture research within the industry, academia, and more. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 23.0.1Time To CompileTR 7980X DIY Build4080120160200SE +/- 2.15, N = 3178.79

Blender

Blender is an open-source 3D creation and modeling software project. This test is of Blender's Cycles performance with various sample files. GPU computing via NVIDIA OptiX and NVIDIA CUDA is currently supported as well as HIP for AMD Radeon GPUs and Intel oneAPI for Intel Graphics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: BMW27 - Compute: CPU-OnlyTR 7980X DIY Build510152025SE +/- 0.03, N = 318.47

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Classroom - Compute: CPU-OnlyTR 7980X DIY Build1122334455SE +/- 0.15, N = 347.15

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Fishy Cat - Compute: CPU-OnlyTR 7980X DIY Build612182430SE +/- 0.09, N = 323.80

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Pabellon Barcelona - Compute: CPU-OnlyTR 7980X DIY Build1326395265SE +/- 0.15, N = 357.94

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Barbershop - Compute: CPU-OnlyTR 7980X DIY Build4080120160200SE +/- 0.09, N = 3166.88

OpenFOAM

OpenFOAM is the leading free, open-source software for computational fluid dynamics (CFD). This test profile currently uses the drivaerFastback test case for analyzing automotive aerodynamics or alternatively the older motorBike input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Mesh TimeTR 7980X DIY Build51015202519.551. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Execution TimeTR 7980X DIY Build81624324036.861. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Mesh TimeTR 7980X DIY Build20406080100104.601. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Execution TimeTR 7980X DIY Build130260390520650617.271. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

OpenRadioss

OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/ and https://github.com/OpenRadioss/ModelExchange/tree/main/Examples. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bird Strike on WindshieldTR 7980X DIY Build20406080100SE +/- 0.68, N = 3105.42

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Rubber O-Ring Seal InstallationTR 7980X DIY Build1224364860SE +/- 0.34, N = 353.18

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Cell Phone Drop TestTR 7980X DIY Build612182430SE +/- 0.10, N = 323.41

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bumper BeamTR 7980X DIY Build20406080100SE +/- 0.65, N = 375.61

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: INIVOL and Fluid Structure Interaction Drop ContainerTR 7980X DIY Build306090120150SE +/- 0.12, N = 3115.12

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Chrysler Neon 1MTR 7980X DIY Build60120180240300SE +/- 3.99, N = 3292.06

215 Results Shown

CPU Temperature Monitor:
  Phoronix Test Suite System Monitoring:
    Celsius
    Megahertz
    Watts
  CPU - 1 - ResNet-50:
    batches/sec Per Watt
PyTorch:
  CPU - 1 - ResNet-152
  CPU - 1 - Efficientnet_v2_l
  CPU - 64 - ResNet-50
  CPU - 64 - ResNet-152
PyTorch
PyTorch:
  CPU - 1 - ResNet-50
  CPU - 64 - Efficientnet_v2_l
OpenVINO:
  Face Detection FP16-INT8 - CPU
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU
  Person Detection FP16 - CPU
  Weld Porosity Detection FP16-INT8 - CPU
  Vehicle Detection FP16-INT8 - CPU
  Person Vehicle Bike Detection FP16 - CPU
  Machine Translation EN To DE FP16 - CPU
  Face Detection Retail FP16-INT8 - CPU
  Handwritten English Recognition FP16-INT8 - CPU
  Road Segmentation ADAS FP16-INT8 - CPU
Embree:
  Pathtracer ISPC - Crown
  Preset 8 - Bosphorus 4K
  Preset 4 - Bosphorus 4K
Embree:
  Pathtracer ISPC - Asian Dragon
  Pathtracer ISPC - Crown
SVT-AV1:
  Preset 13 - Bosphorus 4K
  Preset 12 - Bosphorus 4K
  Preset 8 - Bosphorus 4K
  Preset 4 - Bosphorus 4K
TensorFlow:
  CPU - 1 - ResNet-50
  CPU - 16 - ResNet-50
  CPU - 256 - ResNet-50
OSPRay:
  gravity_spheres_volume/dim_512/ao/real_time
  gravity_spheres_volume/dim_512/pathtracer/real_time
  particle_volume/scivis/real_time
  particle_volume/pathtracer/real_time
  gravity_spheres_volume/dim_512/scivis/real_time
OSPRay
OSPRay
Neural Magic DeepSparse:
  NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Stream
  NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream
  CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream
  NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream
  CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream
  CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Stream
  NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream
  CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream
  ResNet-50, Baseline - Asynchronous Multi-Stream
  ResNet-50, Sparse INT8 - Asynchronous Multi-Stream
  BERT-Large, NLP Question Answering - Asynchronous Multi-Stream
  BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Stream
IndigoBench:
  CPU - Supercar
  CPU - Bedroom
OpenVINO:
  CPU Peak Freq (Highest CPU Core Frequency) Monitor:
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
QuantLib
7-Zip Compression:
  Compression Rating
  Decompression Rating
LeelaChessZero
LeelaChessZero:
  BLAS
  Eigen
Meta Performance Per Watts:
  Performance Per Watts
 
Numpy Benchmark
Llama.cpp:
  llama-2-7b.Q4_0.gguf
  llama-2-13b.Q4_0.gguf
  llama-2-70b-chat.Q5_0.gguf
Llama.cpp:
  llama-2-7b.Q4_0.gguf
  llama-2-13b.Q4_0.gguf
  llama-2-70b-chat.Q5_0.gguf
Chaos Group V-RAY
Chaos Group V-RAY
OpenVINO:
  CPU Temp Monitor:
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
OpenVINO:
  Face Detection FP16-INT8 - CPU
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU
  Person Detection FP16 - CPU
  Weld Porosity Detection FP16-INT8 - CPU
  Vehicle Detection FP16-INT8 - CPU
  Person Vehicle Bike Detection FP16 - CPU
  Machine Translation EN To DE FP16 - CPU
  Face Detection Retail FP16-INT8 - CPU
  Handwritten English Recognition FP16-INT8 - CPU
  Road Segmentation ADAS FP16-INT8 - CPU
Neural Magic DeepSparse:
  NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Stream
  NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream
  CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream
  NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream
  CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream
  CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Stream
  NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream
  CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream
  ResNet-50, Baseline - Asynchronous Multi-Stream
  ResNet-50, Sparse INT8 - Asynchronous Multi-Stream
  BERT-Large, NLP Question Answering - Asynchronous Multi-Stream
  BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Stream
Whisper.cpp:
  ggml-base.en - 2016 State of the Union
  ggml-small.en - 2016 State of the Union
  ggml-medium.en - 2016 State of the Union
Timed Linux Kernel Compilation:
  defconfig
  allmodconfig
Timed Godot Game Engine Compilation
Timed FFmpeg Compilation
Timed LLVM Compilation
Timed Node.js Compilation
Timed Gem5 Compilation
Blender:
  BMW27 - CPU-Only
  Classroom - CPU-Only
  Fishy Cat - CPU-Only
  Pabellon Barcelona - CPU-Only
  Barbershop - CPU-Only
OpenFOAM:
  drivaerFastback, Small Mesh Size - Mesh Time
  drivaerFastback, Small Mesh Size - Execution Time
  drivaerFastback, Medium Mesh Size - Mesh Time
  drivaerFastback, Medium Mesh Size - Execution Time
OpenRadioss:
  Bird Strike on Windshield
  Rubber O-Ring Seal Installation
  Cell Phone Drop Test
  Bumper Beam
  INIVOL and Fluid Structure Interaction Drop Container
  Chrysler Neon 1M