ddds AMD Ryzen 7 PRO 5850U testing with a HP 8A78 (F.04 BIOS) and AMD Cezanne 512MB on Pop 22.04 via the Phoronix Test Suite. a: Processor: AMD Ryzen 7 PRO 5850U @ 4.51GHz (8 Cores / 16 Threads), Motherboard: HP 8A78 (F.04 BIOS), Chipset: AMD Renoir/Cezanne, Memory: 16GB, Disk: 1024GB SK hynix PC711 HFS001TDE9X073N, Graphics: AMD Cezanne 512MB (2000/400MHz), Audio: AMD Renoir Radeon HD Audio, Network: Realtek RTL8822CE 802.11ac PCIe OS: Pop 22.04, Kernel: 5.19.0-76051900-generic (x86_64), Desktop: GNOME Shell 42.3.1, Display Server: X Server 1.21.1.3, OpenGL: 4.6 Mesa 22.0.5 (LLVM 13.0.1 DRM 3.47), Vulkan: 1.3.204, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 1920x1080 B: Processor: AMD Ryzen 7 PRO 5850U @ 4.51GHz (8 Cores / 16 Threads), Motherboard: HP 8A78 (F.04 BIOS), Chipset: AMD Renoir/Cezanne, Memory: 16GB, Disk: 1024GB SK hynix PC711 HFS001TDE9X073N, Graphics: AMD Cezanne 512MB (2000/400MHz), Audio: AMD Renoir Radeon HD Audio, Network: Realtek RTL8822CE 802.11ac PCIe OS: Pop 22.04, Kernel: 5.19.0-76051900-generic (x86_64), Desktop: GNOME Shell 42.3.1, Display Server: X Server 1.21.1.3, OpenGL: 4.6 Mesa 22.0.5 (LLVM 13.0.1 DRM 3.47), Vulkan: 1.3.204, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 1920x1080 C: Processor: AMD Ryzen 7 PRO 5850U @ 4.51GHz (8 Cores / 16 Threads), Motherboard: HP 8A78 (F.04 BIOS), Chipset: AMD Renoir/Cezanne, Memory: 16GB, Disk: 1024GB SK hynix PC711 HFS001TDE9X073N, Graphics: AMD Cezanne 512MB (2000/400MHz), Audio: AMD Renoir Radeon HD Audio, Network: Realtek RTL8822CE 802.11ac PCIe OS: Pop 22.04, Kernel: 5.19.0-76051900-generic (x86_64), Desktop: GNOME Shell 42.3.1, Display Server: X Server 1.21.1.3, OpenGL: 4.6 Mesa 22.0.5 (LLVM 13.0.1 DRM 3.47), Vulkan: 1.3.204, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 1920x1080 OpenRadioss 2022.10.13 Model: INIVOL and Fluid Structure Interaction Drop Container Seconds < Lower Is Better a . 1009.55 |================================================================== B . 1010.85 |================================================================== C . 1011.17 |================================================================== OpenRadioss 2022.10.13 Model: Bird Strike on Windshield Seconds < Lower Is Better a . 453.96 |================================================================== B . 457.75 |=================================================================== C . 460.64 |=================================================================== OpenRadioss 2022.10.13 Model: Rubber O-Ring Seal Installation Seconds < Lower Is Better a . 311.06 |================================================================== B . 313.51 |=================================================================== C . 308.85 |================================================================== OpenRadioss 2022.10.13 Model: Bumper Beam Seconds < Lower Is Better a . 231.72 |=================================================================== B . 229.73 |================================================================== C . 228.65 |================================================================== OpenRadioss 2022.10.13 Model: Cell Phone Drop Test Seconds < Lower Is Better a . 181.70 |================================================================ B . 182.58 |================================================================ C . 189.88 |=================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 1 - Mode: Read Only - Average Latency ms < Lower Is Better a . 0.034 |================================================================== B . 0.035 |==================================================================== C . 0.035 |==================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 1 - Mode: Read Only TPS > Higher Is Better a . 29488 |==================================================================== B . 28609 |================================================================== C . 28704 |================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 100 - Mode: Read Write - Average Latency ms < Lower Is Better a . 4.481 |==================================================================== B . 4.438 |=================================================================== C . 4.441 |=================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 100 - Mode: Read Write TPS > Higher Is Better a . 22314 |=================================================================== B . 22532 |==================================================================== C . 22515 |==================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 1 - Mode: Read Write - Average Latency ms < Lower Is Better a . 0.496 |==================================================================== B . 0.495 |==================================================================== C . 0.496 |==================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 1 - Mode: Read Write TPS > Higher Is Better a . 2015 |===================================================================== B . 2019 |===================================================================== C . 2017 |===================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 50 - Mode: Read Only - Average Latency ms < Lower Is Better a . 0.236 |==================================================================== B . 0.237 |==================================================================== C . 0.235 |=================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 50 - Mode: Read Only TPS > Higher Is Better a . 212136 |=================================================================== B . 211278 |=================================================================== C . 212526 |=================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 100 - Mode: Read Only - Average Latency ms < Lower Is Better a . 0.485 |=================================================================== B . 0.488 |==================================================================== C . 0.489 |==================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 100 - Mode: Read Only TPS > Higher Is Better a . 206141 |=================================================================== B . 204738 |=================================================================== C . 204309 |================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 50 - Mode: Read Write - Average Latency ms < Lower Is Better a . 2.186 |=================================================================== B . 2.188 |=================================================================== C . 2.207 |==================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 50 - Mode: Read Write TPS > Higher Is Better a . 22877 |==================================================================== B . 22849 |==================================================================== C . 22652 |=================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 100 - Mode: Read Write - Average Latency ms < Lower Is Better a . 43.34 |=================================================================== B . 43.57 |==================================================================== C . 43.70 |==================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 100 - Mode: Read Write TPS > Higher Is Better a . 2307 |===================================================================== B . 2295 |===================================================================== C . 2288 |==================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 50 - Mode: Read Write - Average Latency ms < Lower Is Better a . 19.49 |==================================================================== B . 19.46 |==================================================================== C . 19.48 |==================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 50 - Mode: Read Write TPS > Higher Is Better a . 2566 |===================================================================== B . 2569 |===================================================================== C . 2566 |===================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 100 - Mode: Read Only - Average Latency ms < Lower Is Better a . 0.463 |=================================================================== B . 0.451 |================================================================== C . 0.468 |==================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 100 - Mode: Read Only TPS > Higher Is Better a . 215829 |================================================================= B . 221814 |=================================================================== C . 213858 |================================================================= PostgreSQL 15 Scaling Factor: 1 - Clients: 1 - Mode: Read Only - Average Latency ms < Lower Is Better a . 0.030 |================================================================ B . 0.031 |================================================================== C . 0.032 |==================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 1 - Mode: Read Only TPS > Higher Is Better a . 33107 |==================================================================== B . 31946 |================================================================== C . 31482 |================================================================= PostgreSQL 15 Scaling Factor: 1 - Clients: 50 - Mode: Read Only - Average Latency ms < Lower Is Better a . 0.223 |=================================================================== B . 0.225 |==================================================================== C . 0.224 |==================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 50 - Mode: Read Only TPS > Higher Is Better a . 223719 |=================================================================== B . 222551 |=================================================================== C . 222985 |=================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 1 - Mode: Read Write - Average Latency ms < Lower Is Better a . 0.464 |==================================================================== B . 0.464 |==================================================================== C . 0.463 |==================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 1 - Mode: Read Write TPS > Higher Is Better a . 2155 |===================================================================== B . 2157 |===================================================================== C . 2158 |===================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 216.61 |================================================================== B . 216.65 |================================================================== C . 218.83 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 18.46 |==================================================================== B . 18.46 |==================================================================== C . 18.23 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 891.33 |=================================================================== B . 893.58 |=================================================================== C . 893.53 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 4.4873 |=================================================================== B . 4.4762 |=================================================================== C . 4.4764 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 890.03 |================================================================== B . 898.12 |=================================================================== C . 892.08 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 4.4823 |=================================================================== B . 4.4536 |=================================================================== C . 4.4837 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 228.62 |=================================================================== B . 228.67 |=================================================================== C . 229.36 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 4.3739 |=================================================================== B . 4.3729 |=================================================================== C . 4.3598 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 205.22 |=================================================================== B . 205.96 |=================================================================== C . 204.99 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 19.49 |==================================================================== B . 19.42 |==================================================================== C . 19.51 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 61.14 |==================================================================== B . 61.52 |==================================================================== C . 61.38 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 16.35 |==================================================================== B . 16.25 |==================================================================== C . 16.29 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 57.14 |=================================================================== B . 57.57 |==================================================================== C . 57.58 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 17.50 |==================================================================== B . 17.37 |=================================================================== C . 17.36 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 228.48 |=================================================================== B . 228.73 |=================================================================== C . 230.06 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 4.3765 |=================================================================== B . 4.3718 |=================================================================== C . 4.3466 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 104.84 |=================================================================== B . 100.55 |================================================================ C . 100.22 |================================================================ Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 38.15 |================================================================= B . 39.77 |==================================================================== C . 39.90 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 28.17 |==================================================================== B . 28.24 |==================================================================== C . 28.21 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 35.49 |==================================================================== B . 35.40 |==================================================================== C . 35.44 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 152.65 |=================================================================== B . 152.41 |=================================================================== C . 152.31 |=================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 26.20 |==================================================================== B . 26.24 |==================================================================== C . 26.26 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 38.02 |==================================================================== B . 38.13 |==================================================================== C . 38.04 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 26.29 |==================================================================== B . 26.21 |==================================================================== C . 26.28 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 67.87 |==================================================================== B . 67.97 |==================================================================== C . 67.76 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 58.92 |==================================================================== B . 58.83 |==================================================================== C . 59.01 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 18.76 |==================================================================== B . 18.84 |==================================================================== C . 18.75 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 53.27 |==================================================================== B . 53.05 |==================================================================== C . 53.30 |====================================================================