ssa AMD Ryzen 7 PRO 6850U testing with a LENOVO 21CM0001US (R22ET51W 1.21 BIOS) and AMD Radeon 680M 1GB on Ubuntu 22.10 via the Phoronix Test Suite. A: Processor: AMD Ryzen 7 PRO 6850U @ 2.70GHz (8 Cores / 16 Threads), Motherboard: LENOVO 21CM0001US (R22ET51W 1.21 BIOS), Chipset: AMD Device 14b5, Memory: 16GB, Disk: 512GB Micron MTFDKBA512TFK, Graphics: AMD Radeon 680M 1GB (2200/400MHz), Audio: AMD Rembrandt Radeon HD Audio, Network: Qualcomm QCNFA765 OS: Ubuntu 22.10, Kernel: 6.0.0-060000rc2daily20220824-generic (x86_64), Desktop: GNOME Shell 42.4, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.1.3 (LLVM 14.0.6 DRM 3.48), Vulkan: 1.3.211, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1920x1200 B: Processor: AMD Ryzen 7 PRO 6850U @ 2.70GHz (8 Cores / 16 Threads), Motherboard: LENOVO 21CM0001US (R22ET51W 1.21 BIOS), Chipset: AMD Device 14b5, Memory: 16GB, Disk: 512GB Micron MTFDKBA512TFK, Graphics: AMD Radeon 680M 1GB (2200/400MHz), Audio: AMD Rembrandt Radeon HD Audio, Network: Qualcomm QCNFA765 OS: Ubuntu 22.10, Kernel: 6.0.0-060000rc2daily20220824-generic (x86_64), Desktop: GNOME Shell 42.4, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.1.3 (LLVM 14.0.6 DRM 3.48), Vulkan: 1.3.211, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1920x1200 C: Processor: AMD Ryzen 7 PRO 6850U @ 2.70GHz (8 Cores / 16 Threads), Motherboard: LENOVO 21CM0001US (R22ET51W 1.21 BIOS), Chipset: AMD Device 14b5, Memory: 16GB, Disk: 512GB Micron MTFDKBA512TFK, Graphics: AMD Radeon 680M 1GB (2200/400MHz), Audio: AMD Rembrandt Radeon HD Audio, Network: Qualcomm QCNFA765 OS: Ubuntu 22.10, Kernel: 6.0.0-060000rc2daily20220824-generic (x86_64), Desktop: GNOME Shell 42.4, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.1.3 (LLVM 14.0.6 DRM 3.48), Vulkan: 1.3.211, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1920x1200 D: Processor: AMD Ryzen 7 PRO 6850U @ 2.70GHz (8 Cores / 16 Threads), Motherboard: LENOVO 21CM0001US (R22ET51W 1.21 BIOS), Chipset: AMD Device 14b5, Memory: 16GB, Disk: 512GB Micron MTFDKBA512TFK, Graphics: AMD Radeon 680M 1GB (2200/400MHz), Audio: AMD Rembrandt Radeon HD Audio, Network: Qualcomm QCNFA765 OS: Ubuntu 22.10, Kernel: 6.0.0-060000rc2daily20220824-generic (x86_64), Desktop: GNOME Shell 42.4, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.1.3 (LLVM 14.0.6 DRM 3.48), Vulkan: 1.3.211, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1920x1200 OpenRadioss 2022.10.13 Model: Bumper Beam Seconds < Lower Is Better A . 245.34 |================================================================= B . 248.82 |================================================================== C . 252.17 |=================================================================== D . 248.50 |================================================================== OpenRadioss 2022.10.13 Model: Cell Phone Drop Test Seconds < Lower Is Better A . 187.99 |=================================================================== B . 183.36 |================================================================= C . 184.71 |================================================================== D . 183.80 |================================================================== OpenRadioss 2022.10.13 Model: Bird Strike on Windshield Seconds < Lower Is Better A . 463.03 |================================================================== B . 462.03 |================================================================== C . 470.03 |=================================================================== D . 468.03 |=================================================================== OpenRadioss 2022.10.13 Model: Rubber O-Ring Seal Installation Seconds < Lower Is Better A . 320.24 |================================================================ B . 320.34 |================================================================ C . 334.03 |=================================================================== D . 326.46 |================================================================= OpenRadioss 2022.10.13 Model: INIVOL and Fluid Structure Interaction Drop Container Seconds < Lower Is Better A . 952.66 |================================================================ B . 970.46 |================================================================= C . 994.75 |=================================================================== D . 996.65 |=================================================================== JPEG XL libjxl 0.7 Input: PNG - Quality: 80 MP/s > Higher Is Better A . 8.68 |===================================================================== B . 8.71 |===================================================================== C . 8.59 |==================================================================== D . 8.60 |==================================================================== JPEG XL libjxl 0.7 Input: PNG - Quality: 90 MP/s > Higher Is Better A . 8.53 |===================================================================== B . 8.58 |===================================================================== C . 8.51 |==================================================================== D . 8.54 |===================================================================== JPEG XL libjxl 0.7 Input: JPEG - Quality: 80 MP/s > Higher Is Better A . 8.26 |===================================================================== B . 8.32 |===================================================================== C . 8.30 |===================================================================== D . 8.26 |===================================================================== JPEG XL libjxl 0.7 Input: JPEG - Quality: 90 MP/s > Higher Is Better A . 8.09 |==================================================================== B . 8.17 |===================================================================== C . 8.12 |===================================================================== D . 8.14 |===================================================================== JPEG XL libjxl 0.7 Input: PNG - Quality: 100 MP/s > Higher Is Better A . 0.67 |==================================================================== B . 0.68 |===================================================================== C . 0.67 |==================================================================== D . 0.68 |===================================================================== JPEG XL libjxl 0.7 Input: JPEG - Quality: 100 MP/s > Higher Is Better A . 0.66 |===================================================================== B . 0.64 |=================================================================== C . 0.64 |=================================================================== D . 0.64 |=================================================================== JPEG XL Decoding libjxl 0.7 CPU Threads: 1 MP/s > Higher Is Better A . 45.39 |==================================================================== B . 45.05 |=================================================================== C . 45.27 |==================================================================== D . 44.60 |=================================================================== JPEG XL Decoding libjxl 0.7 CPU Threads: All MP/s > Higher Is Better A . 190.85 |================================================================== B . 192.29 |=================================================================== C . 190.78 |================================================================== D . 188.77 |================================================================== libavif avifenc 0.11 Encoder Speed: 0 Seconds < Lower Is Better A . 214.91 |=================================================================== B . 214.51 |=================================================================== C . 214.98 |=================================================================== D . 215.22 |=================================================================== libavif avifenc 0.11 Encoder Speed: 2 Seconds < Lower Is Better A . 97.55 |==================================================================== B . 97.58 |==================================================================== C . 97.74 |==================================================================== D . 97.77 |==================================================================== libavif avifenc 0.11 Encoder Speed: 6 Seconds < Lower Is Better A . 9.656 |==================================================================== B . 9.666 |==================================================================== C . 9.702 |==================================================================== D . 9.673 |==================================================================== libavif avifenc 0.11 Encoder Speed: 6, Lossless Seconds < Lower Is Better A . 14.35 |==================================================================== B . 14.39 |==================================================================== C . 14.45 |==================================================================== D . 14.45 |==================================================================== libavif avifenc 0.11 Encoder Speed: 10, Lossless Seconds < Lower Is Better A . 6.466 |=================================================================== B . 6.454 |=================================================================== C . 6.542 |==================================================================== D . 6.490 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 4.6528 |=================================================================== B . 4.6587 |=================================================================== C . 4.6435 |=================================================================== D . 4.6580 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 859.68 |=================================================================== B . 858.57 |=================================================================== C . 861.39 |=================================================================== D . 858.71 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 4.5777 |=================================================================== B . 4.5617 |=================================================================== C . 4.5637 |=================================================================== D . 4.5476 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 218.43 |=================================================================== B . 219.20 |=================================================================== C . 219.10 |=================================================================== D . 219.88 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 18.72 |=================================================================== B . 18.49 |=================================================================== C . 18.55 |=================================================================== D . 18.89 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 213.57 |================================================================== B . 215.90 |=================================================================== C . 215.01 |=================================================================== D . 211.75 |================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 16.94 |==================================================================== B . 16.94 |==================================================================== C . 16.91 |==================================================================== D . 16.92 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 59.01 |==================================================================== B . 59.02 |==================================================================== C . 59.10 |==================================================================== D . 59.07 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 26.74 |==================================================================== B . 26.78 |==================================================================== C . 26.60 |==================================================================== D . 26.66 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 149.53 |=================================================================== B . 149.35 |=================================================================== C . 150.37 |=================================================================== D . 150.01 |=================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 26.23 |==================================================================== B . 26.15 |==================================================================== C . 26.11 |==================================================================== D . 26.14 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 38.10 |==================================================================== B . 38.21 |==================================================================== C . 38.27 |==================================================================== D . 38.24 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 56.70 |==================================================================== B . 56.81 |==================================================================== C . 57.11 |==================================================================== D . 56.84 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 70.52 |==================================================================== B . 70.36 |==================================================================== C . 70.02 |==================================================================== D . 70.35 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 51.88 |==================================================================== B . 51.51 |==================================================================== C . 51.63 |==================================================================== D . 51.38 |=================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 19.26 |=================================================================== B . 19.40 |==================================================================== C . 19.35 |==================================================================== D . 19.44 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 41.88 |==================================================================== B . 42.14 |==================================================================== C . 42.09 |==================================================================== D . 42.03 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 95.48 |==================================================================== B . 94.91 |==================================================================== C . 95.02 |==================================================================== D . 95.15 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 38.14 |==================================================================== B . 38.26 |==================================================================== C . 38.22 |==================================================================== D . 38.25 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 26.20 |==================================================================== B . 26.12 |==================================================================== C . 26.15 |==================================================================== D . 26.13 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 19.83 |==================================================================== B . 19.80 |==================================================================== C . 19.79 |==================================================================== D . 19.84 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 201.70 |=================================================================== B . 201.99 |=================================================================== C . 202.07 |=================================================================== D . 201.62 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 18.37 |==================================================================== B . 18.36 |==================================================================== C . 18.37 |==================================================================== D . 18.32 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 54.43 |==================================================================== B . 54.44 |==================================================================== C . 54.41 |==================================================================== D . 54.58 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 4.6380 |=================================================================== B . 4.6277 |=================================================================== C . 4.6400 |=================================================================== D . 4.6606 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 862.40 |=================================================================== B . 864.05 |=================================================================== C . 862.04 |=================================================================== D . 858.23 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 4.5614 |=================================================================== B . 4.5483 |=================================================================== C . 4.5782 |=================================================================== D . 4.5487 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 219.22 |=================================================================== B . 219.85 |=================================================================== C . 218.41 |=================================================================== D . 219.83 |===================================================================