deepsparse new AMD Ryzen 9 5900HX testing with a ASUS G513QY v1.0 (G513QY.318 BIOS) and ASUS AMD Cezanne 512MB on Ubuntu 22.10 via the Phoronix Test Suite. ,,"a","b","c" Processor,,AMD Ryzen 9 5900HX @ 4.89GHz (8 Cores / 16 Threads),AMD Ryzen 9 5900HX @ 4.89GHz (8 Cores / 16 Threads),AMD Ryzen 9 5900HX @ 4.89GHz (8 Cores / 16 Threads) Motherboard,,ASUS G513QY v1.0 (G513QY.318 BIOS),ASUS G513QY v1.0 (G513QY.318 BIOS),ASUS G513QY v1.0 (G513QY.318 BIOS) Chipset,,AMD Renoir/Cezanne,AMD Renoir/Cezanne,AMD Renoir/Cezanne Memory,,16GB,16GB,16GB Disk,,512GB SAMSUNG MZVLQ512HBLU-00B00,512GB SAMSUNG MZVLQ512HBLU-00B00,512GB SAMSUNG MZVLQ512HBLU-00B00 Graphics,,ASUS AMD Cezanne 512MB (2500/1000MHz),ASUS AMD Cezanne 512MB (2500/1000MHz),ASUS AMD Cezanne 512MB (2500/1000MHz) Audio,,AMD Navi 21/23,AMD Navi 21/23,AMD Navi 21/23 Monitor,,LQ156M1JW25,LQ156M1JW25,LQ156M1JW25 Network,,Realtek RTL8111/8168/8411 + MEDIATEK MT7921 802.11ax PCI,Realtek RTL8111/8168/8411 + MEDIATEK MT7921 802.11ax PCI,Realtek RTL8111/8168/8411 + MEDIATEK MT7921 802.11ax PCI OS,,Ubuntu 22.10,Ubuntu 22.10,Ubuntu 22.10 Kernel,,5.19.0-28-generic (x86_64),5.19.0-28-generic (x86_64),5.19.0-28-generic (x86_64) Desktop,,GNOME Shell 43.0,GNOME Shell 43.0,GNOME Shell 43.0 Display Server,,X Server 1.21.1.4 + Wayland,X Server 1.21.1.4 + Wayland,X Server 1.21.1.4 + Wayland OpenGL,,4.6 Mesa 22.2.1 (LLVM 15.0.2 DRM 3.47),4.6 Mesa 22.2.1 (LLVM 15.0.2 DRM 3.47),4.6 Mesa 22.2.1 (LLVM 15.0.2 DRM 3.47) Vulkan,,1.3.224,1.3.224,1.3.224 Compiler,,GCC 12.2.0,GCC 12.2.0,GCC 12.2.0 File-System,,ext4,ext4,ext4 Screen Resolution,,1920x1080,1920x1080,1920x1080 ,,"a","b","c" "Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,8.5515,7.9379,8.4650 "Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,467.7261,502.3104,472.5227 "Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,26.8409,28.2256,28.1413 "Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,148.9317,141.6979,142.0899 "Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream (ms/batch)",LIB,13.9424,14.389,14.1479 "Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream (items/sec)",HIB,71.668,69.4477,70.6570 "Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream (items/sec)",HIB,5.8462,5.975,5.8801 "Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,171.042,167.3562,170.1116 "Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream (ms/batch)",LIB,121.9787,119.5417,121.8985 "Neural Magic DeepSparse - Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream (items/sec)",HIB,8.1972,8.3643,8.2039 "Neural Magic DeepSparse - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,207.5649,204.2325,207.0196 "Neural Magic DeepSparse - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,19.2686,19.5795,19.3064 "Neural Magic DeepSparse - Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream (items/sec)",HIB,57.3632,57.659,57.9803 "Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,125.384,126.7324,126.3038 "Neural Magic DeepSparse - Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream (ms/batch)",LIB,17.4245,17.3351,17.2396 "Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,72.0407,72.8102,72.6940 "Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,31.8864,31.5504,31.6469 "Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,55.5122,54.9277,55.0102 "Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,649.3885,651.2184,645.6068 "Neural Magic DeepSparse - Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,6.1594,6.142,6.1952 "Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream (items/sec)",HIB,47.0176,47.4231,47.3174 "Neural Magic DeepSparse - Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream (ms/batch)",LIB,21.2615,21.0804,21.1276 "Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,41.8069,41.579,41.8992 "Neural Magic DeepSparse - Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream (items/sec)",HIB,23.916,24.0462,23.8628 "Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,76.0952,76.0289,75.5245 "Neural Magic DeepSparse - Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,52.5513,52.5794,52.9213 "Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream (ms/batch)",LIB,170.1219,169.251,169.9081 "Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream (items/sec)",HIB,5.8779,5.9081,5.8876 "Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream (ms/batch)",LIB,34.6433,34.5469,34.4683 "Neural Magic DeepSparse - Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream (items/sec)",HIB,28.8554,28.9365,29.0018 "Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,6.1849,6.1688,6.1581 "Neural Magic DeepSparse - Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,646.7167,648.4005,649.4201 "Neural Magic DeepSparse - Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream (items/sec)",HIB,71.1662,71.0519,71.3201 "Neural Magic DeepSparse - Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream (ms/batch)",LIB,56.1912,56.2815,56.0700 "Neural Magic DeepSparse - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream (ms/batch)",LIB,53.8018,53.8347,53.9980 "Neural Magic DeepSparse - Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream (items/sec)",HIB,18.5832,18.5719,18.5157