deepsparse 7950x

AMD Ryzen 9 7950X 16-Core testing with a ASUS ROG CROSSHAIR X670E HERO (0805 BIOS) and AMD Radeon RX 6800/6800 XT / 6900 on Ubuntu 22.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2301241-NE-DEEPSPARS52

Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result

Hide
Result

Result
Identifier

View Logs

Performance Per
Dollar

Date
Run

Test
Duration

January 24 2023

25 Minutes

January 24 2023

25 Minutes

January 24 2023

25 Minutes

January 24 2023

26 Minutes

Invert Hiding All Results Option

25 Minutes

Only show results where is faster than

Only show results matching title/arguments (delimit multiple options with a comma):

Do not show results matching title/arguments (delimit multiple options with a comma):

deepsparse 7950x AMD Ryzen 9 7950X 16-Core testing with a ASUS ROG CROSSHAIR X670E HERO (0805 BIOS) and AMD Radeon RX 6800/6800 XT / 6900 on Ubuntu 22.10 via the Phoronix Test Suite. ,,"a","bb","c","d" Processor,,AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads),AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads),AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads),AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads) Motherboard,,ASUS ROG CROSSHAIR X670E HERO (0805 BIOS),ASUS ROG CROSSHAIR X670E HERO (0805 BIOS),ASUS ROG CROSSHAIR X670E HERO (0805 BIOS),ASUS ROG CROSSHAIR X670E HERO (0805 BIOS) Chipset,,AMD Device 14d8,AMD Device 14d8,AMD Device 14d8,AMD Device 14d8 Memory,,32GB,32GB,32GB,32GB Disk,,2048GB SOLIDIGM SSDPFKKW020X7 + 257GB Flash Drive,2048GB SOLIDIGM SSDPFKKW020X7 + 257GB Flash Drive,2048GB SOLIDIGM SSDPFKKW020X7 + 257GB Flash Drive,2048GB SOLIDIGM SSDPFKKW020X7 + 257GB Flash Drive Graphics,,AMD Radeon RX 6800/6800 XT / 6900,AMD Radeon RX 6800/6800 XT / 6900 (2575/1000MHz),AMD Radeon RX 6800/6800 XT / 6900 (2575/1000MHz),AMD Radeon RX 6800/6800 XT / 6900 (2575/1000MHz) Audio,,AMD Navi 21/23,AMD Navi 21/23,AMD Navi 21/23,AMD Navi 21/23 Monitor,,ASUS MG28U,ASUS MG28U,ASUS MG28U,ASUS MG28U Network,,Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411,Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411,Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411,Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411 OS,,Ubuntu 22.10,Ubuntu 22.10,Ubuntu 22.10,Ubuntu 22.10 Kernel,,5.19.0-29-generic (x86_64),5.19.0-29-generic (x86_64),5.19.0-29-generic (x86_64),5.19.0-29-generic (x86_64) Desktop,,GNOME Shell 43.1,GNOME Shell 43.1,GNOME Shell 43.1,GNOME Shell 43.1 Display Server,,X Server + Wayland,X Server + Wayland,X Server + Wayland,X Server + Wayland Vulkan,,1.3.224,1.3.224,1.3.224,1.3.224 Compiler,,GCC 12.2.0,GCC 12.2.0,GCC 12.2.0,GCC 12.2.0 File-System,,ext4,ext4,ext4,ext4 Screen Resolution,,3840x2160,3840x2160,3840x2160,3840x2160 OpenGL,,,4.6 Mesa 22.2.1 (LLVM 15.0.2 DRM 3.47),4.6 Mesa 22.2.1 (LLVM 15.0.2 DRM 3.47),4.6 Mesa 22.2.1 (LLVM 15.0.2 DRM 3.47) ,,"a","bb","c","d" "Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,12.7031,12.6369,12.5918,12.6421 "Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream (items/sec)",HIB,11.7605,11.7185,11.694,11.7194 "Neural Magic DeepSparse - Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,447.3079,445.8868,446.6482,446.7292 "Neural Magic DeepSparse - Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream (items/sec)",HIB,163.7662,163.2539,162.7819,164.2746 "Neural Magic DeepSparse - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,101.2583,101.5713,100.7526,100.9291 "Neural Magic DeepSparse - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream (items/sec)",HIB,64.8383,64.1578,64.3933,64.4436 "Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,116.6551,117.6106,115.9903,116.0617 "Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream (items/sec)",HIB,88.7219,88.7951,89.0528,88.9476 "Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,298.2713,298.3351,298.6177,297.798 "Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream (items/sec)",HIB,204.3664,204.0369,204.6633,204.44 "Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,184.8994,184.4151,182.9559,182.0317 "Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream (items/sec)",HIB,116.7361,117.5369,116.6075,117.534 "Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,39.7599,39.6409,39.8652,39.8529 "Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream (items/sec)",HIB,33.9089,33.8938,33.8956,33.8714 "Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,96.0573,95.567,96.2813,95.6055 "Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream (items/sec)",HIB,61.7312,61.1354,61.896,61.9274 "Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,12.5896,12.6314,12.6256,12.593 "Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream (items/sec)",HIB,11.7161,11.7116,11.7392,11.7336 "Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,627.4365,630.5156,632.9304,630.3581 "Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream (ms/batch)",LIB,85.0258,85.3311,85.5102,85.3242 "Neural Magic DeepSparse - Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,17.8715,17.9286,17.8979,17.8947 "Neural Magic DeepSparse - Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream (ms/batch)",LIB,6.1019,6.1208,6.1393,6.0829 "Neural Magic DeepSparse - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,78.9798,78.736,79.376,79.2372 "Neural Magic DeepSparse - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,15.4177,15.5803,15.5237,15.512 "Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,68.5103,67.951,68.9309,68.8771 "Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream (ms/batch)",LIB,11.2523,11.2464,11.2104,11.2263 "Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,26.8102,26.8037,26.7761,26.8519 "Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream (ms/batch)",LIB,4.888,4.896,4.8812,4.8865 "Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,43.2539,43.3682,43.7142,43.9364 "Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream (ms/batch)",LIB,8.5625,8.5043,8.5719,8.5044 "Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,201.0063,201.3574,200.4828,200.5266 "Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream (ms/batch)",LIB,29.4789,29.4922,29.4905,29.5119 "Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,83.27,83.6973,83.0764,83.6639 "Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,16.1956,16.3534,16.1524,16.1441 "Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,633.1822,630.7995,631.3046,632.1566 "Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,85.3482,85.3815,85.1808,85.2218