AMD Ryzen 7 5800X3D 8-Core testing with a ASUS ROG CROSSHAIR VIII HERO (4201 BIOS) and AMD Radeon RX 6700 XT 12GB on Ubuntu 22.04 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2302220-NE-5800X3D2009
5800X3D 2023
AMD Ryzen 7 5800X3D 8-Core testing with a ASUS ROG CROSSHAIR VIII HERO (4201 BIOS) and AMD Radeon RX 6700 XT 12GB on Ubuntu 22.04 via the Phoronix Test Suite.
a:
Processor: AMD Ryzen 7 5800X3D 8-Core @ 3.40GHz (8 Cores / 16 Threads), Motherboard: ASUS ROG CROSSHAIR VIII HERO (4201 BIOS), Chipset: AMD Starship/Matisse, Memory: 32GB, Disk: 1000GB Sabrent Rocket 4.0 1TB, Graphics: AMD Radeon RX 6700 XT 12GB (2855/1000MHz), Audio: AMD Navi 21 HDMI Audio, Monitor: ASUS MG28U, Network: Realtek RTL8125 2.5GbE + Intel I211
OS: Ubuntu 22.04, Kernel: 5.17.0-1019-oem (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server 1.21.1.3 + Wayland, OpenGL: 4.6 Mesa 22.2.0-devel (git-44289c46d9) (LLVM 13.0.1 DRM 3.44), Vulkan: 1.3.219, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 3840x2160
b:
Processor: AMD Ryzen 7 5800X3D 8-Core @ 3.40GHz (8 Cores / 16 Threads), Motherboard: ASUS ROG CROSSHAIR VIII HERO (4201 BIOS), Chipset: AMD Starship/Matisse, Memory: 32GB, Disk: 1000GB Sabrent Rocket 4.0 1TB, Graphics: AMD Radeon RX 6700 XT 12GB (2855/1000MHz), Audio: AMD Navi 21 HDMI Audio, Monitor: ASUS MG28U, Network: Realtek RTL8125 2.5GbE + Intel I211
OS: Ubuntu 22.04, Kernel: 5.17.0-1019-oem (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server 1.21.1.3 + Wayland, OpenGL: 4.6 Mesa 22.2.0-devel (git-44289c46d9) (LLVM 13.0.1 DRM 3.44), Vulkan: 1.3.219, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 3840x2160
Timed Linux Kernel Compilation 6.1
Build: allmodconfig
Seconds < Lower Is Better
a . 1151.48 |==================================================================
b . 1148.85 |==================================================================
nekRS 22.0
Input: TurboPipe Periodic
FLOP/s > Higher Is Better
a . 34139600000 |============================================================
b . 35064100000 |==============================================================
BRL-CAD 7.34
VGR Performance Metric
VGR Performance Metric > Higher Is Better
a . 163581 |===================================================================
b . 163651 |===================================================================
OpenVKL 1.3.1
Benchmark: vklBenchmark Scalar
Items / Sec > Higher Is Better
a . 84 |======================================================================
b . 85 |=======================================================================
OpenVKL 1.3.1
Benchmark: vklBenchmark ISPC
Items / Sec > Higher Is Better
a . 142 |======================================================================
b . 143 |======================================================================
Blender 3.4
Blend File: Classroom - Compute: CPU-Only
Seconds < Lower Is Better
a . 370.53 |===================================================================
b . 370.08 |===================================================================
ClickHouse 22.12.3.5
100M Rows Hits Dataset, Third Run
Queries Per Minute, Geo Mean > Higher Is Better
a . 190.07 |===================================================================
b . 182.33 |================================================================
ClickHouse 22.12.3.5
100M Rows Hits Dataset, Second Run
Queries Per Minute, Geo Mean > Higher Is Better
a . 188.88 |===================================================================
b . 188.30 |===================================================================
ClickHouse 22.12.3.5
100M Rows Hits Dataset, First Run / Cold Cache
Queries Per Minute, Geo Mean > Higher Is Better
a . 171.34 |===================================================================
b . 165.35 |=================================================================
VVenC 1.7
Video Input: Bosphorus 4K - Video Preset: Fast
Frames Per Second > Higher Is Better
a . 3.491 |====================================================================
b . 3.497 |====================================================================
Numenta Anomaly Benchmark 1.1
Detector: KNN CAD
Seconds < Lower Is Better
a . 159.16 |=================================================================
b . 165.04 |===================================================================
GROMACS 2023
Implementation: MPI CPU - Input: water_GMX50_bare
Ns Per Day > Higher Is Better
a . 1.230 |====================================================================
b . 1.233 |====================================================================
Blender 3.4
Blend File: BMW27 - Compute: CPU-Only
Seconds < Lower Is Better
a . 135.64 |===================================================================
b . 135.31 |===================================================================
CockroachDB 22.2
Workload: KV, 50% Reads - Concurrency: 128
ops/s > Higher Is Better
a . 49976.6 |==================================================================
b . 50302.3 |==================================================================
CockroachDB 22.2
Workload: KV, 60% Reads - Concurrency: 128
ops/s > Higher Is Better
a . 51998.8 |==================================================================
b . 52219.8 |==================================================================
CockroachDB 22.2
Workload: KV, 95% Reads - Concurrency: 128
ops/s > Higher Is Better
a . 60896.8 |==================================================================
b . 60892.3 |==================================================================
CockroachDB 22.2
Workload: KV, 10% Reads - Concurrency: 128
ops/s > Higher Is Better
a . 42029.2 |=================================================================
b . 42435.0 |==================================================================
uvg266 0.4.1
Video Input: Bosphorus 4K - Video Preset: Slow
Frames Per Second > Higher Is Better
a . 5.67 |=====================================================================
b . 5.70 |=====================================================================
AOM AV1 3.6
Encoder Mode: Speed 4 Two-Pass - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
a . 7.69 |=====================================================================
b . 7.66 |=====================================================================
Stargate Digital Audio Workstation 22.11.5
Sample Rate: 192000 - Buffer Size: 512
Render Ratio > Higher Is Better
a . 1.666360 |=================================================================
b . 1.653657 |=================================================================
CockroachDB 22.2
Workload: MoVR - Concurrency: 128
ops/s > Higher Is Better
a . 644.1 |====================================================================
b . 645.4 |====================================================================
uvg266 0.4.1
Video Input: Bosphorus 4K - Video Preset: Medium
Frames Per Second > Higher Is Better
a . 6.39 |=====================================================================
b . 6.40 |=====================================================================
Stargate Digital Audio Workstation 22.11.5
Sample Rate: 192000 - Buffer Size: 1024
Render Ratio > Higher Is Better
a . 1.767146 |=================================================================
b . 1.760010 |=================================================================
AOM AV1 3.6
Encoder Mode: Speed 0 Two-Pass - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
a . 0.22 |=====================================================================
b . 0.22 |=====================================================================
nginx 1.23.2
Connections: 500
Requests Per Second > Higher Is Better
a . 78331.87 |=================================================================
b . 77953.04 |=================================================================
nginx 1.23.2
Connections: 200
Requests Per Second > Higher Is Better
a . 79162.32 |================================================================
b . 79947.38 |=================================================================
nginx 1.23.2
Connections: 1000
Requests Per Second > Higher Is Better
a . 74754.89 |=================================================================
b . 73712.99 |================================================================
nginx 1.23.2
Connections: 100
Requests Per Second > Higher Is Better
a . 78677.98 |=================================================================
b . 77977.48 |================================================================
nginx 1.23.2
Connections: 20
Requests Per Second > Higher Is Better
a . 66267.23 |=================================================================
b . 66228.29 |=================================================================
Numenta Anomaly Benchmark 1.1
Detector: Earthgecko Skyline
Seconds < Lower Is Better
a . 89.98 |====================================================================
b . 88.12 |===================================================================
Timed Linux Kernel Compilation 6.1
Build: defconfig
Seconds < Lower Is Better
a . 87.47 |====================================================================
b . 86.96 |====================================================================
oneDNN 3.0
Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU
ms < Lower Is Better
a . 2704.46 |==================================================================
b . 2707.84 |==================================================================
oneDNN 3.0
Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU
ms < Lower Is Better
a . 2696.70 |==================================================================
b . 2698.59 |==================================================================
oneDNN 3.0
Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU
ms < Lower Is Better
a . 2702.47 |==================================================================
b . 2703.36 |==================================================================
oneDNN 3.0
Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU
ms < Lower Is Better
a . 1382.62 |==================================================================
b . 1383.07 |==================================================================
oneDNN 3.0
Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU
ms < Lower Is Better
a . 1385.03 |==================================================================
b . 1383.90 |==================================================================
oneDNN 3.0
Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU
ms < Lower Is Better
a . 1379.73 |==================================================================
b . 1381.80 |==================================================================
VVenC 1.7
Video Input: Bosphorus 4K - Video Preset: Faster
Frames Per Second > Higher Is Better
a . 7.622 |====================================================================
b . 7.665 |====================================================================
VP9 libvpx Encoding 1.13
Speed: Speed 0 - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
a . 8.74 |=====================================================================
b . 8.78 |=====================================================================
Zstd Compression 1.5.4
Compression Level: 19, Long Mode - Decompression Speed
MB/s > Higher Is Better
a . 1531.0 |===================================================================
b . 1518.4 |==================================================================
Zstd Compression 1.5.4
Compression Level: 19, Long Mode - Compression Speed
MB/s > Higher Is Better
a . 10.7 |=====================================================================
b . 10.7 |=====================================================================
Stargate Digital Audio Workstation 22.11.5
Sample Rate: 96000 - Buffer Size: 512
Render Ratio > Higher Is Better
a . 2.459627 |=================================================================
b . 2.455281 |=================================================================
Zstd Compression 1.5.4
Compression Level: 19 - Decompression Speed
MB/s > Higher Is Better
a . 1612.5 |===================================================================
b . 1611.9 |===================================================================
Zstd Compression 1.5.4
Compression Level: 19 - Compression Speed
MB/s > Higher Is Better
a . 18.9 |====================================================================
b . 19.1 |=====================================================================
VVenC 1.7
Video Input: Bosphorus 1080p - Video Preset: Fast
Frames Per Second > Higher Is Better
a . 9.304 |====================================================================
b . 9.347 |====================================================================
Kvazaar 2.2
Video Input: Bosphorus 4K - Video Preset: Slow
Frames Per Second > Higher Is Better
a . 9.34 |=====================================================================
b . 9.33 |=====================================================================
Stargate Digital Audio Workstation 22.11.5
Sample Rate: 96000 - Buffer Size: 1024
Render Ratio > Higher Is Better
a . 2.570685 |=================================================================
b . 2.568560 |=================================================================
Kvazaar 2.2
Video Input: Bosphorus 4K - Video Preset: Medium
Frames Per Second > Higher Is Better
a . 9.56 |=====================================================================
b . 9.61 |=====================================================================
Zstd Compression 1.5.4
Compression Level: 3 - Decompression Speed
MB/s > Higher Is Better
a . 1607.6 |==================================================================
b . 1633.5 |===================================================================
Zstd Compression 1.5.4
Compression Level: 3 - Compression Speed
MB/s > Higher Is Better
a . 2158.4 |===================================================================
b . 2169.8 |===================================================================
Zstd Compression 1.5.4
Compression Level: 12 - Decompression Speed
MB/s > Higher Is Better
a . 1824.7 |===================================================================
b . 1809.3 |==================================================================
Zstd Compression 1.5.4
Compression Level: 12 - Compression Speed
MB/s > Higher Is Better
a . 155.8 |====================================================================
b . 156.1 |====================================================================
Zstd Compression 1.5.4
Compression Level: 8, Long Mode - Decompression Speed
MB/s > Higher Is Better
a . 1723.7 |================================================================
b . 1792.7 |===================================================================
Zstd Compression 1.5.4
Compression Level: 8, Long Mode - Compression Speed
MB/s > Higher Is Better
a . 612.5 |====================================================================
b . 611.0 |====================================================================
Zstd Compression 1.5.4
Compression Level: 3, Long Mode - Decompression Speed
MB/s > Higher Is Better
a . 1655.7 |==================================================================
b . 1682.1 |===================================================================
Zstd Compression 1.5.4
Compression Level: 3, Long Mode - Compression Speed
MB/s > Higher Is Better
a . 1157.5 |===================================================================
b . 1156.1 |===================================================================
Zstd Compression 1.5.4
Compression Level: 8 - Decompression Speed
MB/s > Higher Is Better
a . 1719.5 |================================================================
b . 1800.4 |===================================================================
Zstd Compression 1.5.4
Compression Level: 8 - Compression Speed
MB/s > Higher Is Better
a . 591.7 |====================================================================
b . 595.4 |====================================================================
RocksDB 7.9.2
Test: Random Fill Sync
Op/s > Higher Is Better
a . 8967 |=====================================================================
b . 8971 |=====================================================================
RocksDB 7.9.2
Test: Update Random
Op/s > Higher Is Better
a . 577378 |==================================================================
b . 586602 |===================================================================
RocksDB 7.9.2
Test: Random Fill
Op/s > Higher Is Better
a . 1070894 |==================================================================
b . 1075102 |==================================================================
RocksDB 7.9.2
Test: Random Read
Op/s > Higher Is Better
a . 53281981 |================================================================
b . 53718767 |=================================================================
RocksDB 7.9.2
Test: Read Random Write Random
Op/s > Higher Is Better
a . 1960434 |==================================================================
b . 1970290 |==================================================================
RocksDB 7.9.2
Test: Read While Writing
Op/s > Higher Is Better
a . 2342780 |==================================================================
b . 2329290 |==================================================================
SVT-AV1 1.4
Encoder Mode: Preset 4 - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
a . 2.918 |====================================================================
b . 2.899 |====================================================================
AOM AV1 3.6
Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
a . 14.30 |===================================================================
b . 14.44 |====================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
a . 478.90 |===================================================================
b . 479.88 |===================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
a . 8.3435 |===================================================================
b . 8.3352 |===================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
a . 116.79 |===================================================================
b . 116.74 |===================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
a . 34.24 |====================================================================
b . 34.26 |====================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
a . 36.48 |====================================================================
b . 36.38 |====================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
a . 109.61 |===================================================================
b . 109.90 |===================================================================
Stargate Digital Audio Workstation 22.11.5
Sample Rate: 480000 - Buffer Size: 512
Render Ratio > Higher Is Better
a . 3.278197 |=================================================================
b . 3.275538 |=================================================================
Stargate Digital Audio Workstation 22.11.5
Sample Rate: 44100 - Buffer Size: 512
Render Ratio > Higher Is Better
a . 3.363174 |=================================================================
b . 3.354047 |=================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
a . 484.86 |===================================================================
b . 477.44 |==================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
a . 8.2496 |==================================================================
b . 8.3776 |===================================================================
Stargate Digital Audio Workstation 22.11.5
Sample Rate: 480000 - Buffer Size: 1024
Render Ratio > Higher Is Better
a . 3.391201 |=================================================================
b . 3.389115 |=================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
a . 113.89 |===================================================================
b . 113.54 |===================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
a . 35.12 |====================================================================
b . 35.22 |====================================================================
Embree 4.0
Binary: Pathtracer ISPC - Model: Crown
Frames Per Second > Higher Is Better
a . 13.75 |====================================================================
b . 13.83 |====================================================================
Stargate Digital Audio Workstation 22.11.5
Sample Rate: 44100 - Buffer Size: 1024
Render Ratio > Higher Is Better
a . 3.461056 |=================================================================
b . 3.462191 |=================================================================
Neural Magic DeepSparse 1.3.2
Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
a . 358.04 |===================================================================
b . 357.92 |===================================================================
Neural Magic DeepSparse 1.3.2
Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
a . 11.17 |====================================================================
b . 11.18 |====================================================================
miniBUDE 20210901
Implementation: OpenMP - Input Deck: BM1
Billion Interactions/s > Higher Is Better
a . 17.73 |====================================================================
b . 17.55 |===================================================================
miniBUDE 20210901
Implementation: OpenMP - Input Deck: BM1
GFInst/s > Higher Is Better
a . 443.21 |===================================================================
b . 438.79 |==================================================================
Embree 4.0
Binary: Pathtracer - Model: Crown
Frames Per Second > Higher Is Better
a . 14.57 |====================================================================
b . 14.54 |====================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream
ms/batch < Lower Is Better
a . 33.36 |====================================================================
b . 33.42 |====================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream
items/sec > Higher Is Better
a . 29.97 |====================================================================
b . 29.92 |====================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream
ms/batch < Lower Is Better
a . 13.10 |====================================================================
b . 13.14 |====================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream
items/sec > Higher Is Better
a . 76.32 |====================================================================
b . 76.05 |====================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream
ms/batch < Lower Is Better
a . 123.81 |===================================================================
b . 124.08 |===================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream
items/sec > Higher Is Better
a . 8.0763 |===================================================================
b . 8.0589 |===================================================================
Neural Magic DeepSparse 1.3.2
Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream
ms/batch < Lower Is Better
a . 94.48 |====================================================================
b . 94.68 |====================================================================
Neural Magic DeepSparse 1.3.2
Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream
items/sec > Higher Is Better
a . 10.58 |====================================================================
b . 10.56 |====================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream
ms/batch < Lower Is Better
a . 124.03 |===================================================================
b . 123.86 |===================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream
items/sec > Higher Is Better
a . 8.0625 |===================================================================
b . 8.0735 |===================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream
ms/batch < Lower Is Better
a . 33.12 |====================================================================
b . 33.25 |====================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream
items/sec > Higher Is Better
a . 30.19 |====================================================================
b . 30.07 |====================================================================
AOM AV1 3.6
Encoder Mode: Speed 4 Two-Pass - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
a . 17.44 |====================================================================
b . 17.43 |====================================================================
Embree 4.0
Binary: Pathtracer ISPC - Model: Asian Dragon
Frames Per Second > Higher Is Better
a . 16.07 |====================================================================
b . 16.07 |====================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
a . 55.82 |====================================================================
b . 55.43 |====================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
a . 71.64 |====================================================================
b . 72.14 |====================================================================
Embree 4.0
Binary: Pathtracer - Model: Asian Dragon
Frames Per Second > Higher Is Better
a . 16.42 |====================================================================
b . 16.53 |====================================================================
Neural Magic DeepSparse 1.3.2
Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
a . 92.55 |====================================================================
b . 92.22 |====================================================================
Neural Magic DeepSparse 1.3.2
Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
a . 43.20 |====================================================================
b . 43.35 |====================================================================
VP9 libvpx Encoding 1.13
Speed: Speed 0 - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
a . 16.73 |===================================================================
b . 16.86 |====================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream
ms/batch < Lower Is Better
a . 16.46 |===================================================================
b . 16.62 |====================================================================
Neural Magic DeepSparse 1.3.2
Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream
items/sec > Higher Is Better
a . 60.73 |====================================================================
b . 60.15 |===================================================================
Neural Magic DeepSparse 1.3.2
Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream
ms/batch < Lower Is Better
a . 41.58 |===================================================================
b . 41.94 |====================================================================
Neural Magic DeepSparse 1.3.2
Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream
items/sec > Higher Is Better
a . 96.18 |====================================================================
b . 95.34 |===================================================================
Numenta Anomaly Benchmark 1.1
Detector: Contextual Anomaly Detector OSE
Seconds < Lower Is Better
a . 37.08 |====================================================================
b . 37.18 |====================================================================
Neural Magic DeepSparse 1.3.2
Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream
ms/batch < Lower Is Better
a . 24.70 |====================================================================
b . 24.41 |===================================================================
Neural Magic DeepSparse 1.3.2
Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream
items/sec > Higher Is Better
a . 40.48 |===================================================================
b . 40.96 |====================================================================
Neural Magic DeepSparse 1.3.2
Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream
ms/batch < Lower Is Better
a . 11.68 |====================================================================
b . 11.69 |====================================================================
Neural Magic DeepSparse 1.3.2
Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream
items/sec > Higher Is Better
a . 85.60 |====================================================================
b . 85.48 |====================================================================
VP9 libvpx Encoding 1.13
Speed: Speed 5 - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
a . 21.50 |====================================================================
b . 21.41 |====================================================================
AOM AV1 3.6
Encoder Mode: Speed 0 Two-Pass - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
a . 0.63 |=====================================================================
b . 0.63 |=====================================================================
uvg266 0.4.1
Video Input: Bosphorus 4K - Video Preset: Very Fast
Frames Per Second > Higher Is Better
a . 19.57 |====================================================================
b . 19.66 |====================================================================
Stress-NG 0.14.06
Test: Context Switching
Bogo Ops/s > Higher Is Better
a . 1950833.18 |===============================================================
b . 1955532.58 |===============================================================
Stress-NG 0.14.06
Test: Atomic
Bogo Ops/s > Higher Is Better
a . 207367.46 |===============================================================
b . 210418.41 |================================================================
Stress-NG 0.14.06
Test: Memory Copying
Bogo Ops/s > Higher Is Better
a . 2880.68 |==================================================================
b . 2876.31 |==================================================================
Stress-NG 0.14.06
Test: Glibc C String Functions
Bogo Ops/s > Higher Is Better
a . 1504135.83 |===============================================================
b . 1486398.55 |==============================================================
Stress-NG 0.14.06
Test: Semaphores
Bogo Ops/s > Higher Is Better
a . 1730582.08 |===============================================================
b . 1729303.19 |===============================================================
Stress-NG 0.14.06
Test: NUMA
Bogo Ops/s > Higher Is Better
a . 203.71 |==================================================================
b . 208.16 |===================================================================
Stress-NG 0.14.06
Test: CPU Cache
Bogo Ops/s > Higher Is Better
a . 21.79 |==================================================================
b . 22.46 |====================================================================
Stress-NG 0.14.06
Test: Malloc
Bogo Ops/s > Higher Is Better
a . 10203045.86 |==============================================================
b . 10248227.68 |==============================================================
Stress-NG 0.14.06
Test: MMAP
Bogo Ops/s > Higher Is Better
a . 229.43 |===================================================================
b . 228.30 |===================================================================
Stress-NG 0.14.06
Test: Futex
Bogo Ops/s > Higher Is Better
a . 2578944.04 |==========================================================
b . 2788905.26 |===============================================================
Stress-NG 0.14.06
Test: System V Message Passing
Bogo Ops/s > Higher Is Better
a . 15725638.80 |==============================================================
b . 15720009.94 |==============================================================
Stress-NG 0.14.06
Test: Glibc Qsort Data Sorting
Bogo Ops/s > Higher Is Better
a . 128.97 |===================================================================
b . 128.50 |===================================================================
Stress-NG 0.14.06
Test: Socket Activity
Bogo Ops/s > Higher Is Better
a . 16993.52 |=================================================================
b . 15181.86 |==========================================================
Stress-NG 0.14.06
Test: Vector Math
Bogo Ops/s > Higher Is Better
a . 68928.43 |=================================================================
b . 68956.87 |=================================================================
Stress-NG 0.14.06
Test: Matrix Math
Bogo Ops/s > Higher Is Better
a . 41982.12 |=================================================================
b . 42253.01 |=================================================================
Stress-NG 0.14.06
Test: CPU Stress
Bogo Ops/s > Higher Is Better
a . 22855.73 |=================================================================
b . 22479.17 |================================================================
Stress-NG 0.14.06
Test: SENDFILE
Bogo Ops/s > Higher Is Better
a . 214925.92 |================================================================
b . 214987.40 |================================================================
Stress-NG 0.14.06
Test: IO_uring
Bogo Ops/s > Higher Is Better
a . 14637.88 |=================================================================
b . 14624.24 |=================================================================
Stress-NG 0.14.06
Test: Forking
Bogo Ops/s > Higher Is Better
a . 76412.68 |=================================================================
b . 76680.66 |=================================================================
Stress-NG 0.14.06
Test: Crypto
Bogo Ops/s > Higher Is Better
a . 16257.67 |=================================================================
b . 16284.13 |=================================================================
Stress-NG 0.14.06
Test: Mutex
Bogo Ops/s > Higher Is Better
a . 6528137.56 |===============================================================
b . 6514970.59 |===============================================================
Stress-NG 0.14.06
Test: MEMFD
Bogo Ops/s > Higher Is Better
a . 845.84 |===================================================================
b . 847.49 |===================================================================
uvg266 0.4.1
Video Input: Bosphorus 4K - Video Preset: Super Fast
Frames Per Second > Higher Is Better
a . 20.13 |====================================================================
b . 20.07 |====================================================================
VVenC 1.7
Video Input: Bosphorus 1080p - Video Preset: Faster
Frames Per Second > Higher Is Better
a . 23.19 |====================================================================
b . 23.17 |====================================================================
Numenta Anomaly Benchmark 1.1
Detector: Bayesian Changepoint
Seconds < Lower Is Better
a . 26.38 |====================================================================
b . 25.22 |=================================================================
uvg266 0.4.1
Video Input: Bosphorus 4K - Video Preset: Ultra Fast
Frames Per Second > Higher Is Better
a . 23.95 |====================================================================
b . 23.78 |====================================================================
Kvazaar 2.2
Video Input: Bosphorus 4K - Video Preset: Very Fast
Frames Per Second > Higher Is Better
a . 23.83 |====================================================================
b . 23.92 |====================================================================
oneDNN 3.0
Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU
ms < Lower Is Better
a . 7.69019 |==================================================================
b . 6.67421 |=========================================================
oneDNN 3.0
Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU
ms < Lower Is Better
a . 1.79573 |==================================================================
b . 1.79316 |==================================================================
Kvazaar 2.2
Video Input: Bosphorus 4K - Video Preset: Super Fast
Frames Per Second > Higher Is Better
a . 29.63 |====================================================================
b . 29.60 |====================================================================
uvg266 0.4.1
Video Input: Bosphorus 1080p - Video Preset: Slow
Frames Per Second > Higher Is Better
a . 30.31 |====================================================================
b . 30.47 |====================================================================
SVT-AV1 1.4
Encoder Mode: Preset 4 - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
a . 9.092 |===================================================================
b . 9.255 |====================================================================
SVT-AV1 1.4
Encoder Mode: Preset 8 - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
a . 35.45 |===================================================================
b . 35.77 |====================================================================
uvg266 0.4.1
Video Input: Bosphorus 1080p - Video Preset: Medium
Frames Per Second > Higher Is Better
a . 34.19 |====================================================================
b . 34.17 |====================================================================
AOM AV1 3.6
Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
a . 43.91 |====================================================================
b . 43.74 |====================================================================
VP9 libvpx Encoding 1.13
Speed: Speed 5 - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
a . 37.14 |===================================================================
b . 37.43 |====================================================================
Numenta Anomaly Benchmark 1.1
Detector: Relative Entropy
Seconds < Lower Is Better
a . 16.84 |====================================================================
b . 15.37 |==============================================================
Kvazaar 2.2
Video Input: Bosphorus 4K - Video Preset: Ultra Fast
Frames Per Second > Higher Is Better
a . 39.12 |====================================================================
b . 39.11 |====================================================================
oneDNN 3.0
Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU
ms < Lower Is Better
a . 2.93610 |==================================================================
b . 2.93136 |==================================================================
oneDNN 3.0
Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU
ms < Lower Is Better
a . 1.25312 |==================================================================
b . 1.25100 |==================================================================
dav1d 1.1
Video Input: Summer Nature 4K
FPS > Higher Is Better
a . 248.99 |==================================================================
b . 254.01 |===================================================================
dav1d 1.1
Video Input: Chimera 1080p 10-bit
FPS > Higher Is Better
a . 689.80 |===================================================================
b . 691.15 |===================================================================
Kvazaar 2.2
Video Input: Bosphorus 1080p - Video Preset: Slow
Frames Per Second > Higher Is Better
a . 48.18 |====================================================================
b . 48.17 |====================================================================
oneDNN 3.0
Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU
ms < Lower Is Better
a . 1.06155 |=================================================================
b . 1.07118 |==================================================================
oneDNN 3.0
Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU
ms < Lower Is Better
a . 0.830567 |=================================================================
b . 0.829345 |=================================================================
Kvazaar 2.2
Video Input: Bosphorus 1080p - Video Preset: Medium
Frames Per Second > Higher Is Better
a . 49.85 |====================================================================
b . 49.88 |====================================================================
dav1d 1.1
Video Input: Chimera 1080p
FPS > Higher Is Better
a . 762.90 |===================================================================
b . 762.84 |===================================================================
RocksDB 7.9.2
Test: Sequential Fill
Op/s > Higher Is Better
a . 1399982 |==================================================================
b . 1378572 |=================================================================
Numenta Anomaly Benchmark 1.1
Detector: Windowed Gaussian
Seconds < Lower Is Better
a . 10.42 |====================================================================
b . 10.19 |==================================================================
oneDNN 3.0
Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU
ms < Lower Is Better
a . 7.78709 |==================================================================
b . 7.80630 |==================================================================
oneDNN 3.0
Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU
ms < Lower Is Better
a . 0.605848 |=================================================================
b . 0.604134 |=================================================================
AOM AV1 3.6
Encoder Mode: Speed 8 Realtime - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
a . 69.83 |================================================================
b . 74.48 |====================================================================
AOM AV1 3.6
Encoder Mode: Speed 10 Realtime - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
a . 80.59 |==================================================================
b . 82.50 |====================================================================
AOM AV1 3.6
Encoder Mode: Speed 6 Realtime - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
a . 85.38 |=============================================================
b . 94.64 |====================================================================
AOM AV1 3.6
Encoder Mode: Speed 9 Realtime - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
a . 80.62 |=====================================================
b . 101.82 |===================================================================
SVT-AV1 1.4
Encoder Mode: Preset 12 - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
a . 100.95 |===================================================================
b . 98.93 |==================================================================
uvg266 0.4.1
Video Input: Bosphorus 1080p - Video Preset: Very Fast
Frames Per Second > Higher Is Better
a . 87.77 |====================================================================
b . 87.53 |====================================================================
uvg266 0.4.1
Video Input: Bosphorus 1080p - Video Preset: Super Fast
Frames Per Second > Higher Is Better
a . 91.68 |====================================================================
b . 91.60 |====================================================================
SVT-AV1 1.4
Encoder Mode: Preset 8 - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
a . 101.76 |===================================================================
b . 101.64 |===================================================================
oneDNN 3.0
Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU
ms < Lower Is Better
a . 13.48 |====================================================================
b . 13.51 |====================================================================
oneDNN 3.0
Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU
ms < Lower Is Better
a . 11.72 |====================================================================
b . 11.72 |====================================================================
Kvazaar 2.2
Video Input: Bosphorus 1080p - Video Preset: Very Fast
Frames Per Second > Higher Is Better
a . 98.70 |====================================================================
b . 99.06 |====================================================================
SVT-AV1 1.4
Encoder Mode: Preset 13 - Input: Bosphorus 4K
Frames Per Second > Higher Is Better
a . 117.08 |==================================================================
b . 119.40 |===================================================================
uvg266 0.4.1
Video Input: Bosphorus 1080p - Video Preset: Ultra Fast
Frames Per Second > Higher Is Better
a . 108.76 |===================================================================
b . 108.53 |===================================================================
Kvazaar 2.2
Video Input: Bosphorus 1080p - Video Preset: Super Fast
Frames Per Second > Higher Is Better
a . 128.86 |===================================================================
b . 128.43 |===================================================================
dav1d 1.1
Video Input: Summer Nature 1080p
FPS > Higher Is Better
a . 1035.33 |==================================================================
b . 1039.43 |==================================================================
AOM AV1 3.6
Encoder Mode: Speed 8 Realtime - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
a . 166.87 |=============================================================
b . 182.46 |===================================================================
Kvazaar 2.2
Video Input: Bosphorus 1080p - Video Preset: Ultra Fast
Frames Per Second > Higher Is Better
a . 171.94 |===================================================================
b . 171.87 |===================================================================
oneDNN 3.0
Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU
ms < Lower Is Better
a . 5.57159 |==================================================================
b . 5.58635 |==================================================================
oneDNN 3.0
Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU
ms < Lower Is Better
a . 2.54853 |=================================================================
b . 2.58212 |==================================================================
AOM AV1 3.6
Encoder Mode: Speed 10 Realtime - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
a . 203.50 |=============================================================
b . 223.37 |===================================================================
AOM AV1 3.6
Encoder Mode: Speed 6 Realtime - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
a . 245.35 |===================================================================
b . 192.58 |=====================================================
AOM AV1 3.6
Encoder Mode: Speed 9 Realtime - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
a . 277.56 |===================================================================
b . 220.55 |=====================================================
SVT-AV1 1.4
Encoder Mode: Preset 12 - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
a . 464.88 |===================================================================
b . 464.03 |===================================================================
SVT-AV1 1.4
Encoder Mode: Preset 13 - Input: Bosphorus 1080p
Frames Per Second > Higher Is Better
a . 520.94 |==================================================================
b . 531.55 |===================================================================
nginx 1.23.2
Connections: 1
Requests Per Second > Higher Is Better
oneDNN 3.0
Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU
ms < Lower Is Better
oneDNN 3.0
Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU
ms < Lower Is Better
oneDNN 3.0
Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU
ms < Lower Is Better
oneDNN 3.0
Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU
ms < Lower Is Better
Stress-NG 0.14.06
Test: x86_64 RdRand
oneDNN 3.0
Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU
ms < Lower Is Better
oneDNN 3.0
Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU
ms < Lower Is Better