deepsparse 7950x AMD Ryzen 9 7950X 16-Core testing with a ASUS ROG CROSSHAIR X670E HERO (0805 BIOS) and AMD Radeon RX 6800/6800 XT / 6900 on Ubuntu 22.10 via the Phoronix Test Suite. ,,"a","bb","c","d" Processor,,AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads),AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads),AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads),AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads) Motherboard,,ASUS ROG CROSSHAIR X670E HERO (0805 BIOS),ASUS ROG CROSSHAIR X670E HERO (0805 BIOS),ASUS ROG CROSSHAIR X670E HERO (0805 BIOS),ASUS ROG CROSSHAIR X670E HERO (0805 BIOS) Chipset,,AMD Device 14d8,AMD Device 14d8,AMD Device 14d8,AMD Device 14d8 Memory,,32GB,32GB,32GB,32GB Disk,,2048GB SOLIDIGM SSDPFKKW020X7 + 257GB Flash Drive,2048GB SOLIDIGM SSDPFKKW020X7 + 257GB Flash Drive,2048GB SOLIDIGM SSDPFKKW020X7 + 257GB Flash Drive,2048GB SOLIDIGM SSDPFKKW020X7 + 257GB Flash Drive Graphics,,AMD Radeon RX 6800/6800 XT / 6900,AMD Radeon RX 6800/6800 XT / 6900 (2575/1000MHz),AMD Radeon RX 6800/6800 XT / 6900 (2575/1000MHz),AMD Radeon RX 6800/6800 XT / 6900 (2575/1000MHz) Audio,,AMD Navi 21/23,AMD Navi 21/23,AMD Navi 21/23,AMD Navi 21/23 Monitor,,ASUS MG28U,ASUS MG28U,ASUS MG28U,ASUS MG28U Network,,Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411,Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411,Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411,Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411 OS,,Ubuntu 22.10,Ubuntu 22.10,Ubuntu 22.10,Ubuntu 22.10 Kernel,,5.19.0-29-generic (x86_64),5.19.0-29-generic (x86_64),5.19.0-29-generic (x86_64),5.19.0-29-generic (x86_64) Desktop,,GNOME Shell 43.1,GNOME Shell 43.1,GNOME Shell 43.1,GNOME Shell 43.1 Display Server,,X Server + Wayland,X Server + Wayland,X Server + Wayland,X Server + Wayland Vulkan,,1.3.224,1.3.224,1.3.224,1.3.224 Compiler,,GCC 12.2.0,GCC 12.2.0,GCC 12.2.0,GCC 12.2.0 File-System,,ext4,ext4,ext4,ext4 Screen Resolution,,3840x2160,3840x2160,3840x2160,3840x2160 OpenGL,,,4.6 Mesa 22.2.1 (LLVM 15.0.2 DRM 3.47),4.6 Mesa 22.2.1 (LLVM 15.0.2 DRM 3.47),4.6 Mesa 22.2.1 (LLVM 15.0.2 DRM 3.47) ,,"a","bb","c","d" "Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,12.7031,12.6369,12.5918,12.6421 "Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,627.4365,630.5156,632.9304,630.3581 "Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream (items/sec)",HIB,11.7605,11.7185,11.694,11.7194 "Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream (ms/batch)",LIB,85.0258,85.3311,85.5102,85.3242 "Neural Magic DeepSparse - Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,447.3079,445.8868,446.6482,446.7292 "Neural Magic DeepSparse - Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,17.8715,17.9286,17.8979,17.8947 "Neural Magic DeepSparse - Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream (items/sec)",HIB,163.7662,163.2539,162.7819,164.2746 "Neural Magic DeepSparse - Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream (ms/batch)",LIB,6.1019,6.1208,6.1393,6.0829 "Neural Magic DeepSparse - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,101.2583,101.5713,100.7526,100.9291 "Neural Magic DeepSparse - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,78.9798,78.736,79.376,79.2372 "Neural Magic DeepSparse - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream (items/sec)",HIB,64.8383,64.1578,64.3933,64.4436 "Neural Magic DeepSparse - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,15.4177,15.5803,15.5237,15.512 "Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,116.6551,117.6106,115.9903,116.0617 "Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,68.5103,67.951,68.9309,68.8771 "Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream (items/sec)",HIB,88.7219,88.7951,89.0528,88.9476 "Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream (ms/batch)",LIB,11.2523,11.2464,11.2104,11.2263 "Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,298.2713,298.3351,298.6177,297.798 "Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,26.8102,26.8037,26.7761,26.8519 "Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream (items/sec)",HIB,204.3664,204.0369,204.6633,204.44 "Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream (ms/batch)",LIB,4.888,4.896,4.8812,4.8865 "Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,184.8994,184.4151,182.9559,182.0317 "Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,43.2539,43.3682,43.7142,43.9364 "Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream (items/sec)",HIB,116.7361,117.5369,116.6075,117.534 "Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream (ms/batch)",LIB,8.5625,8.5043,8.5719,8.5044 "Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,39.7599,39.6409,39.8652,39.8529 "Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,201.0063,201.3574,200.4828,200.5266 "Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream (items/sec)",HIB,33.9089,33.8938,33.8956,33.8714 "Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream (ms/batch)",LIB,29.4789,29.4922,29.4905,29.5119 "Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,96.0573,95.567,96.2813,95.6055 "Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,83.27,83.6973,83.0764,83.6639 "Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream (items/sec)",HIB,61.7312,61.1354,61.896,61.9274 "Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,16.1956,16.3534,16.1524,16.1441 "Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,12.5896,12.6314,12.6256,12.593 "Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,633.1822,630.7995,631.3046,632.1566 "Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream (items/sec)",HIB,11.7161,11.7116,11.7392,11.7336 "Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,85.3482,85.3815,85.1808,85.2218