AMD Ryzen 9 7950X 16-Core testing with a ASUS ROG CROSSHAIR X670E HERO (0805 BIOS) and AMD Radeon RX 6800/6800 XT / 6900 on Ubuntu 22.10 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2301241-NE-DEEPSPARS52
deepsparse 7950x
AMD Ryzen 9 7950X 16-Core testing with a ASUS ROG CROSSHAIR X670E HERO (0805 BIOS) and AMD Radeon RX 6800/6800 XT / 6900 on Ubuntu 22.10 via the Phoronix Test Suite.
,,"a","bb","c","d"
Processor,,AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads),AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads),AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads),AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads)
Motherboard,,ASUS ROG CROSSHAIR X670E HERO (0805 BIOS),ASUS ROG CROSSHAIR X670E HERO (0805 BIOS),ASUS ROG CROSSHAIR X670E HERO (0805 BIOS),ASUS ROG CROSSHAIR X670E HERO (0805 BIOS)
Chipset,,AMD Device 14d8,AMD Device 14d8,AMD Device 14d8,AMD Device 14d8
Memory,,32GB,32GB,32GB,32GB
Disk,,2048GB SOLIDIGM SSDPFKKW020X7 + 257GB Flash Drive,2048GB SOLIDIGM SSDPFKKW020X7 + 257GB Flash Drive,2048GB SOLIDIGM SSDPFKKW020X7 + 257GB Flash Drive,2048GB SOLIDIGM SSDPFKKW020X7 + 257GB Flash Drive
Graphics,,AMD Radeon RX 6800/6800 XT / 6900,AMD Radeon RX 6800/6800 XT / 6900 (2575/1000MHz),AMD Radeon RX 6800/6800 XT / 6900 (2575/1000MHz),AMD Radeon RX 6800/6800 XT / 6900 (2575/1000MHz)
Audio,,AMD Navi 21/23,AMD Navi 21/23,AMD Navi 21/23,AMD Navi 21/23
Monitor,,ASUS MG28U,ASUS MG28U,ASUS MG28U,ASUS MG28U
Network,,Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411,Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411,Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411,Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411
OS,,Ubuntu 22.10,Ubuntu 22.10,Ubuntu 22.10,Ubuntu 22.10
Kernel,,5.19.0-29-generic (x86_64),5.19.0-29-generic (x86_64),5.19.0-29-generic (x86_64),5.19.0-29-generic (x86_64)
Desktop,,GNOME Shell 43.1,GNOME Shell 43.1,GNOME Shell 43.1,GNOME Shell 43.1
Display Server,,X Server + Wayland,X Server + Wayland,X Server + Wayland,X Server + Wayland
Vulkan,,1.3.224,1.3.224,1.3.224,1.3.224
Compiler,,GCC 12.2.0,GCC 12.2.0,GCC 12.2.0,GCC 12.2.0
File-System,,ext4,ext4,ext4,ext4
Screen Resolution,,3840x2160,3840x2160,3840x2160,3840x2160
OpenGL,,,4.6 Mesa 22.2.1 (LLVM 15.0.2 DRM 3.47),4.6 Mesa 22.2.1 (LLVM 15.0.2 DRM 3.47),4.6 Mesa 22.2.1 (LLVM 15.0.2 DRM 3.47)
,,"a","bb","c","d"
"Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,633.1822,630.7995,631.3046,632.1566
"Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,12.5896,12.6314,12.6256,12.593
"Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,201.0063,201.3574,200.4828,200.5266
"Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,39.7599,39.6409,39.8652,39.8529
"Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,83.27,83.6973,83.0764,83.6639
"Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,96.0573,95.567,96.2813,95.6055
"Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,627.4365,630.5156,632.9304,630.3581
"Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,12.7031,12.6369,12.5918,12.6421
"Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream (ms/batch)",LIB,29.4789,29.4922,29.4905,29.5119
"Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream (items/sec)",HIB,33.9089,33.8938,33.8956,33.8714
"Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,16.1956,16.3534,16.1524,16.1441
"Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream (items/sec)",HIB,61.7312,61.1354,61.896,61.9274
"Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream (ms/batch)",LIB,8.5625,8.5043,8.5719,8.5044
"Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream (items/sec)",HIB,116.7361,117.5369,116.6075,117.534
"Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream (ms/batch)",LIB,85.0258,85.3311,85.5102,85.3242
"Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream (items/sec)",HIB,11.7605,11.7185,11.694,11.7194
"Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,85.3482,85.3815,85.1808,85.2218
"Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream (items/sec)",HIB,11.7161,11.7116,11.7392,11.7336
"Neural Magic DeepSparse - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,78.9798,78.736,79.376,79.2372
"Neural Magic DeepSparse - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,101.2583,101.5713,100.7526,100.9291
"Neural Magic DeepSparse - Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,17.8715,17.9286,17.8979,17.8947
"Neural Magic DeepSparse - Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,447.3079,445.8868,446.6482,446.7292
"Neural Magic DeepSparse - Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream (ms/batch)",LIB,6.1019,6.1208,6.1393,6.0829
"Neural Magic DeepSparse - Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream (items/sec)",HIB,163.7662,163.2539,162.7819,164.2746
"Neural Magic DeepSparse - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,15.4177,15.5803,15.5237,15.512
"Neural Magic DeepSparse - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream (items/sec)",HIB,64.8383,64.1578,64.3933,64.4436
"Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,43.2539,43.3682,43.7142,43.9364
"Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,184.8994,184.4151,182.9559,182.0317
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,68.5103,67.951,68.9309,68.8771
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,116.6551,117.6106,115.9903,116.0617
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream (ms/batch)",LIB,11.2523,11.2464,11.2104,11.2263
"Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream (items/sec)",HIB,88.7219,88.7951,89.0528,88.9476
"Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,26.8102,26.8037,26.7761,26.8519
"Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,298.2713,298.3351,298.6177,297.798
"Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream (ms/batch)",LIB,4.888,4.896,4.8812,4.8865
"Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream (items/sec)",HIB,204.3664,204.0369,204.6633,204.44