dgg Tests for a future article. AMD Ryzen 7 3800XT 8-Core testing with a MSI X370 XPOWER GAMING TITANIUM (MS-7A31) v1.0 (1.MS BIOS) and Sapphire AMD Radeon HD 4650 on Debian 12 via the Phoronix Test Suite. a: Processor: AMD Ryzen 7 3800XT 8-Core @ 3.90GHz (8 Cores / 16 Threads), Motherboard: MSI X370 XPOWER GAMING TITANIUM (MS-7A31) v1.0 (1.MS BIOS), Chipset: AMD Starship/Matisse, Memory: 2 x 8GB DDR4-3200MT/s CL16-18-18 D4-3200, Disk: 128GB INTEL SSDPEKKW128G7, Graphics: Sapphire AMD Radeon HD 4650, Audio: AMD RV710/730, Network: Intel I211 OS: Debian 12, Kernel: 6.1.0-18-amd64 (x86_64), Display Server: X Server 1.20.11, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1024x768 AMD Ryzen 7 3800XT 8-Core: Processor: AMD Ryzen 7 3800XT 8-Core @ 3.90GHz (8 Cores / 16 Threads), Motherboard: MSI X370 XPOWER GAMING TITANIUM (MS-7A31) v1.0 (1.MS BIOS), Chipset: AMD Starship/Matisse, Memory: 2 x 8GB DDR4-3200MT/s CL16-18-18 D4-3200, Disk: 128GB INTEL SSDPEKKW128G7, Graphics: Sapphire AMD Radeon HD 4650, Audio: AMD RV710/730, Network: Intel I211 OS: Debian 12, Kernel: 6.1.0-18-amd64 (x86_64), Display Server: X Server 1.20.11, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1024x768 SVT-AV1 2.0 Encoder Mode: Preset 4 - Input: Bosphorus 4K Frames Per Second > Higher Is Better a ......................... 3.497 |=========================================== AMD Ryzen 7 3800XT 8-Core . 3.560 |============================================ SVT-AV1 2.0 Encoder Mode: Preset 8 - Input: Bosphorus 4K Frames Per Second > Higher Is Better a ......................... 29.07 |============================================ AMD Ryzen 7 3800XT 8-Core . 28.99 |============================================ SVT-AV1 2.0 Encoder Mode: Preset 12 - Input: Bosphorus 4K Frames Per Second > Higher Is Better a ......................... 76.75 |============================================ AMD Ryzen 7 3800XT 8-Core . 76.75 |============================================ SVT-AV1 2.0 Encoder Mode: Preset 13 - Input: Bosphorus 4K Frames Per Second > Higher Is Better a ......................... 76.92 |============================================ AMD Ryzen 7 3800XT 8-Core . 76.76 |============================================ SVT-AV1 2.0 Encoder Mode: Preset 4 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better a ......................... 11.23 |============================================ AMD Ryzen 7 3800XT 8-Core . 11.16 |============================================ SVT-AV1 2.0 Encoder Mode: Preset 8 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better a ......................... 87.57 |============================================ AMD Ryzen 7 3800XT 8-Core . 87.22 |============================================ SVT-AV1 2.0 Encoder Mode: Preset 12 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better a ......................... 332.74 |=========================================== AMD Ryzen 7 3800XT 8-Core . 335.20 |=========================================== SVT-AV1 2.0 Encoder Mode: Preset 13 - Input: Bosphorus 1080p Frames Per Second > Higher Is Better a ......................... 393.13 |=========================================== AMD Ryzen 7 3800XT 8-Core . 393.53 |=========================================== Stockfish 16.1 Chess Benchmark Nodes Per Second > Higher Is Better a ......................... 14229414 |===================================== AMD Ryzen 7 3800XT 8-Core . 15599239 |========================================= Timed Linux Kernel Compilation 6.8 Build: defconfig Seconds < Lower Is Better Timed Linux Kernel Compilation 6.8 Build: allmodconfig Seconds < Lower Is Better Primesieve 12.1 Length: 1e12 Seconds < Lower Is Better a ......................... 19.93 |============================================ AMD Ryzen 7 3800XT 8-Core . 20.01 |============================================ Primesieve 12.1 Length: 1e13 Seconds < Lower Is Better a ......................... 249.60 |=========================================== AMD Ryzen 7 3800XT 8-Core . 251.01 |=========================================== Neural Magic DeepSparse 1.7 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a ......................... 7.5633 |=========================================== AMD Ryzen 7 3800XT 8-Core . 7.5518 |=========================================== Neural Magic DeepSparse 1.7 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a ......................... 528.85 |=========================================== AMD Ryzen 7 3800XT 8-Core . 529.66 |=========================================== Neural Magic DeepSparse 1.7 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a ......................... 6.9688 |=========================================== AMD Ryzen 7 3800XT 8-Core . 6.9917 |=========================================== Neural Magic DeepSparse 1.7 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a ......................... 143.49 |=========================================== AMD Ryzen 7 3800XT 8-Core . 143.02 |=========================================== Neural Magic DeepSparse 1.7 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a ......................... 178.92 |=========================================== AMD Ryzen 7 3800XT 8-Core . 179.18 |=========================================== Neural Magic DeepSparse 1.7 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a ......................... 22.34 |============================================ AMD Ryzen 7 3800XT 8-Core . 22.31 |============================================ Neural Magic DeepSparse 1.7 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a ......................... 117.55 |=========================================== AMD Ryzen 7 3800XT 8-Core . 118.11 |=========================================== Neural Magic DeepSparse 1.7 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a ......................... 8.4992 |=========================================== AMD Ryzen 7 3800XT 8-Core . 8.4587 |=========================================== Neural Magic DeepSparse 1.7 Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a ......................... 88.95 |============================================ AMD Ryzen 7 3800XT 8-Core . 89.43 |============================================ Neural Magic DeepSparse 1.7 Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a ......................... 44.96 |============================================ AMD Ryzen 7 3800XT 8-Core . 44.72 |============================================ Neural Magic DeepSparse 1.7 Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a ......................... 71.37 |============================================ AMD Ryzen 7 3800XT 8-Core . 71.44 |============================================ Neural Magic DeepSparse 1.7 Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a ......................... 14.00 |============================================ AMD Ryzen 7 3800XT 8-Core . 13.99 |============================================ Neural Magic DeepSparse 1.7 Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a ......................... 497.20 |=========================================== AMD Ryzen 7 3800XT 8-Core . 494.73 |=========================================== Neural Magic DeepSparse 1.7 Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a ......................... 8.0290 |=========================================== AMD Ryzen 7 3800XT 8-Core . 8.0691 |=========================================== Neural Magic DeepSparse 1.7 Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a ......................... 346.76 |=========================================== AMD Ryzen 7 3800XT 8-Core . 345.70 |=========================================== Neural Magic DeepSparse 1.7 Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a ......................... 2.8747 |=========================================== AMD Ryzen 7 3800XT 8-Core . 2.8825 |=========================================== Neural Magic DeepSparse 1.7 Model: Llama2 Chat 7b Quantized - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a ......................... 0.2488 |=========================================== AMD Ryzen 7 3800XT 8-Core . 0.2098 |==================================== Neural Magic DeepSparse 1.7 Model: Llama2 Chat 7b Quantized - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a ......................... 15733.32 |================================== AMD Ryzen 7 3800XT 8-Core . 18763.13 |========================================= Neural Magic DeepSparse 1.7 Model: Llama2 Chat 7b Quantized - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a ......................... 2.4239 |=========================================== AMD Ryzen 7 3800XT 8-Core . 2.4327 |=========================================== Neural Magic DeepSparse 1.7 Model: Llama2 Chat 7b Quantized - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a ......................... 412.35 |=========================================== AMD Ryzen 7 3800XT 8-Core . 410.87 |=========================================== Neural Magic DeepSparse 1.7 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a ......................... 88.86 |============================================ AMD Ryzen 7 3800XT 8-Core . 88.90 |============================================ Neural Magic DeepSparse 1.7 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a ......................... 45.00 |============================================ AMD Ryzen 7 3800XT 8-Core . 44.98 |============================================ Neural Magic DeepSparse 1.7 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a ......................... 71.32 |============================================ AMD Ryzen 7 3800XT 8-Core . 71.23 |============================================ Neural Magic DeepSparse 1.7 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a ......................... 14.01 |============================================ AMD Ryzen 7 3800XT 8-Core . 14.03 |============================================ Neural Magic DeepSparse 1.7 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a ......................... 41.42 |============================================ AMD Ryzen 7 3800XT 8-Core . 41.48 |============================================ Neural Magic DeepSparse 1.7 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a ......................... 96.56 |============================================ AMD Ryzen 7 3800XT 8-Core . 96.42 |============================================ Neural Magic DeepSparse 1.7 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a ......................... 36.31 |============================================ AMD Ryzen 7 3800XT 8-Core . 36.16 |============================================ Neural Magic DeepSparse 1.7 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a ......................... 27.53 |============================================ AMD Ryzen 7 3800XT 8-Core . 27.65 |============================================ Neural Magic DeepSparse 1.7 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a ......................... 65.59 |============================================ AMD Ryzen 7 3800XT 8-Core . 65.59 |============================================ Neural Magic DeepSparse 1.7 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a ......................... 60.95 |============================================ AMD Ryzen 7 3800XT 8-Core . 60.94 |============================================ Neural Magic DeepSparse 1.7 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a ......................... 50.41 |============================================ AMD Ryzen 7 3800XT 8-Core . 50.33 |============================================ Neural Magic DeepSparse 1.7 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a ......................... 19.83 |============================================ AMD Ryzen 7 3800XT 8-Core . 19.86 |============================================ Neural Magic DeepSparse 1.7 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a ......................... 9.2291 |=========================================== AMD Ryzen 7 3800XT 8-Core . 9.0767 |========================================== Neural Magic DeepSparse 1.7 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a ......................... 430.69 |========================================== AMD Ryzen 7 3800XT 8-Core . 440.66 |=========================================== Neural Magic DeepSparse 1.7 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a ......................... 8.5233 |=========================================== AMD Ryzen 7 3800XT 8-Core . 8.5260 |=========================================== Neural Magic DeepSparse 1.7 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a ......................... 117.31 |=========================================== AMD Ryzen 7 3800XT 8-Core . 117.27 |=========================================== Neural Magic DeepSparse 1.7 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a ......................... 91.60 |============================================ AMD Ryzen 7 3800XT 8-Core . 91.37 |============================================ Neural Magic DeepSparse 1.7 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a ......................... 43.65 |============================================ AMD Ryzen 7 3800XT 8-Core . 43.76 |============================================ Neural Magic DeepSparse 1.7 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a ......................... 47.91 |============================================ AMD Ryzen 7 3800XT 8-Core . 47.89 |============================================ Neural Magic DeepSparse 1.7 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a ......................... 20.86 |============================================ AMD Ryzen 7 3800XT 8-Core . 20.87 |============================================ Neural Magic DeepSparse 1.7 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a ......................... 7.5861 |=========================================== AMD Ryzen 7 3800XT 8-Core . 7.5437 |=========================================== Neural Magic DeepSparse 1.7 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a ......................... 527.06 |=========================================== AMD Ryzen 7 3800XT 8-Core . 526.21 |=========================================== Neural Magic DeepSparse 1.7 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a ......................... 6.9873 |=========================================== AMD Ryzen 7 3800XT 8-Core . 6.9704 |=========================================== Neural Magic DeepSparse 1.7 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a ......................... 143.11 |=========================================== AMD Ryzen 7 3800XT 8-Core . 143.46 |===========================================