dds AMD Ryzen 9 5900HX testing with a ASUS G513QY v1.0 (G513QY.318 BIOS) and ASUS AMD Cezanne 512MB on Ubuntu 22.10 via the Phoronix Test Suite. A: Processor: AMD Ryzen 9 5900HX @ 4.89GHz (8 Cores / 16 Threads), Motherboard: ASUS G513QY v1.0 (G513QY.318 BIOS), Chipset: AMD Renoir/Cezanne, Memory: 16GB, Disk: 512GB SAMSUNG MZVLQ512HBLU-00B00, Graphics: ASUS AMD Cezanne 512MB (2500/1000MHz), Audio: AMD Navi 21/23, Monitor: LQ156M1JW25, Network: Realtek RTL8111/8168/8411 + MEDIATEK MT7921 802.11ax PCI OS: Ubuntu 22.10, Kernel: 5.19.0-18-generic (x86_64), Desktop: GNOME Shell 43.0, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.2.0 (LLVM 15.0.1 DRM 3.47), Vulkan: 1.3.224, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1920x1080 B: Processor: AMD Ryzen 9 5900HX @ 4.89GHz (8 Cores / 16 Threads), Motherboard: ASUS G513QY v1.0 (G513QY.318 BIOS), Chipset: AMD Renoir/Cezanne, Memory: 16GB, Disk: 512GB SAMSUNG MZVLQ512HBLU-00B00, Graphics: ASUS AMD Cezanne 512MB (2500/1000MHz), Audio: AMD Navi 21/23, Monitor: LQ156M1JW25, Network: Realtek RTL8111/8168/8411 + MEDIATEK MT7921 802.11ax PCI OS: Ubuntu 22.10, Kernel: 5.19.0-18-generic (x86_64), Desktop: GNOME Shell 43.0, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.2.0 (LLVM 15.0.1 DRM 3.47), Vulkan: 1.3.224, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1920x1080 C: Processor: AMD Ryzen 9 5900HX @ 4.89GHz (8 Cores / 16 Threads), Motherboard: ASUS G513QY v1.0 (G513QY.318 BIOS), Chipset: AMD Renoir/Cezanne, Memory: 16GB, Disk: 512GB SAMSUNG MZVLQ512HBLU-00B00, Graphics: ASUS AMD Cezanne 512MB (2500/1000MHz), Audio: AMD Navi 21/23, Monitor: LQ156M1JW25, Network: Realtek RTL8111/8168/8411 + MEDIATEK MT7921 802.11ax PCI OS: Ubuntu 22.10, Kernel: 5.19.0-18-generic (x86_64), Desktop: GNOME Shell 43.0, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.2.0 (LLVM 15.0.1 DRM 3.47), Vulkan: 1.3.224, Compiler: GCC 12.2.0, File-System: ext4, Screen Resolution: 1920x1080 OpenRadioss 2022.10.13 Model: Bumper Beam Seconds < Lower Is Better A . 196.62 |=================================================================== B . 195.96 |=================================================================== C . 195.94 |=================================================================== OpenRadioss 2022.10.13 Model: Cell Phone Drop Test Seconds < Lower Is Better A . 172.93 |=================================================================== B . 172.03 |================================================================== C . 173.51 |=================================================================== OpenRadioss 2022.10.13 Model: Bird Strike on Windshield Seconds < Lower Is Better A . 392.32 |=================================================================== B . 391.47 |=================================================================== C . 392.64 |=================================================================== OpenRadioss 2022.10.13 Model: Rubber O-Ring Seal Installation Seconds < Lower Is Better A . 300.93 |=================================================================== B . 296.47 |================================================================== C . 299.04 |=================================================================== OpenRadioss 2022.10.13 Model: INIVOL and Fluid Structure Interaction Drop Container Seconds < Lower Is Better A . 1030.06 |================================================================= B . 1024.02 |================================================================= C . 1039.72 |================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 1 - Mode: Read Only TPS > Higher Is Better A . 35354 |==================================================================== B . 34350 |================================================================== C . 34632 |=================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 1 - Mode: Read Only - Average Latency ms < Lower Is Better A . 0.028 |================================================================== B . 0.029 |==================================================================== C . 0.029 |==================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 1 - Mode: Read Write TPS > Higher Is Better A . 1562 |===================================================================== B . 1561 |===================================================================== C . 1560 |===================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 1 - Mode: Read Write - Average Latency ms < Lower Is Better A . 0.640 |==================================================================== B . 0.640 |==================================================================== C . 0.641 |==================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 50 - Mode: Read Only TPS > Higher Is Better A . 320104 |================================================================== B . 320218 |================================================================== C . 323261 |=================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 50 - Mode: Read Only - Average Latency ms < Lower Is Better A . 0.156 |==================================================================== B . 0.156 |==================================================================== C . 0.155 |==================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 100 - Mode: Read Only TPS > Higher Is Better A . 317345 |=================================================================== B . 317603 |=================================================================== C . 319323 |=================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 100 - Mode: Read Only - Average Latency ms < Lower Is Better A . 0.315 |==================================================================== B . 0.315 |==================================================================== C . 0.313 |==================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 250 - Mode: Read Only TPS > Higher Is Better A . 314152 |=================================================================== B . 314051 |=================================================================== C . 314334 |=================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 250 - Mode: Read Only - Average Latency ms < Lower Is Better A . 0.796 |==================================================================== B . 0.796 |==================================================================== C . 0.795 |==================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 50 - Mode: Read Write TPS > Higher Is Better A . 1259 |===================================================================== B . 1258 |===================================================================== C . 1265 |===================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 50 - Mode: Read Write - Average Latency ms < Lower Is Better A . 39.71 |==================================================================== B . 39.75 |==================================================================== C . 39.53 |==================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 1 - Mode: Read Only TPS > Higher Is Better A . 31636 |=================================================================== B . 31880 |==================================================================== C . 31400 |=================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 1 - Mode: Read Only - Average Latency ms < Lower Is Better A . 0.032 |==================================================================== B . 0.031 |================================================================== C . 0.032 |==================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 100 - Mode: Read Write TPS > Higher Is Better A . 1165 |===================================================================== B . 1169 |===================================================================== C . 1168 |===================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 100 - Mode: Read Write - Average Latency ms < Lower Is Better A . 85.84 |==================================================================== B . 85.53 |==================================================================== C . 85.65 |==================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 250 - Mode: Read Write TPS > Higher Is Better A . 837 |===================================================================== B . 824 |==================================================================== C . 852 |====================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 250 - Mode: Read Write - Average Latency ms < Lower Is Better A . 298.57 |================================================================== B . 303.93 |=================================================================== C . 293.44 |================================================================= PostgreSQL 15 Scaling Factor: 100 - Clients: 1 - Mode: Read Write TPS > Higher Is Better A . 1450 |===================================================================== B . 1450 |===================================================================== C . 1427 |==================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 1 - Mode: Read Write - Average Latency ms < Lower Is Better A . 0.690 |=================================================================== B . 0.690 |=================================================================== C . 0.701 |==================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 50 - Mode: Read Only TPS > Higher Is Better A . 307397 |=================================================================== B . 306035 |================================================================== C . 308711 |=================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 50 - Mode: Read Only - Average Latency ms < Lower Is Better A . 0.163 |==================================================================== B . 0.163 |==================================================================== C . 0.162 |==================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 100 - Mode: Read Only TPS > Higher Is Better A . 301030 |================================================================= B . 305927 |================================================================== C . 308899 |=================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 100 - Mode: Read Only - Average Latency ms < Lower Is Better A . 0.332 |==================================================================== B . 0.327 |=================================================================== C . 0.324 |================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 250 - Mode: Read Only TPS > Higher Is Better A . 304319 |=================================================================== B . 299853 |================================================================== C . 301981 |================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 250 - Mode: Read Only - Average Latency ms < Lower Is Better A . 0.822 |=================================================================== B . 0.834 |==================================================================== C . 0.828 |==================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 50 - Mode: Read Write TPS > Higher Is Better A . 24845 |==================================================================== B . 24729 |==================================================================== C . 24617 |=================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 50 - Mode: Read Write - Average Latency ms < Lower Is Better A . 2.012 |=================================================================== B . 2.022 |==================================================================== C . 2.031 |==================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 100 - Mode: Read Write TPS > Higher Is Better A . 26278 |==================================================================== B . 10878 |============================ C . 24281 |=============================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 100 - Mode: Read Write - Average Latency ms < Lower Is Better A . 3.805 |========================= B . 10.305 |=================================================================== C . 4.119 |=========================== PostgreSQL 15 Scaling Factor: 100 - Clients: 250 - Mode: Read Write TPS > Higher Is Better A . 20378 |==================================================================== B . 10293 |================================== C . 11604 |======================================= PostgreSQL 15 Scaling Factor: 100 - Clients: 250 - Mode: Read Write - Average Latency ms < Lower Is Better A . 12.27 |================================== B . 24.48 |==================================================================== C . 21.55 |============================================================ Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 6.1434 |=================================================================== B . 6.1268 |=================================================================== C . 6.1276 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 651.09 |=================================================================== B . 652.86 |=================================================================== C . 652.76 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 5.8989 |=================================================================== B . 5.8602 |=================================================================== C . 5.8708 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 169.52 |=================================================================== B . 170.64 |=================================================================== C . 170.33 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 19.47 |==================================================================== B . 19.45 |==================================================================== C . 19.21 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 205.11 |================================================================== B . 205.62 |================================================================== C . 207.90 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 18.55 |==================================================================== B . 18.58 |==================================================================== C . 18.58 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 53.90 |==================================================================== B . 53.80 |==================================================================== C . 53.80 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 29.98 |==================================================================== B . 30.14 |==================================================================== C . 29.89 |=================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 133.42 |=================================================================== B . 132.74 |================================================================== C . 133.79 |=================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 30.76 |==================================================================== B . 30.36 |=================================================================== C . 30.73 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 32.50 |=================================================================== B . 32.92 |==================================================================== C . 32.53 |=================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 73.99 |==================================================================== B . 73.97 |==================================================================== C . 73.43 |=================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 54.05 |=================================================================== B . 54.06 |==================================================================== C . 54.46 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 67.60 |================================================================== B . 69.80 |==================================================================== C . 70.09 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 14.78 |==================================================================== B . 14.32 |================================================================== C . 14.26 |================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 55.15 |==================================================================== B . 55.20 |==================================================================== C . 55.47 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 72.51 |==================================================================== B . 72.46 |==================================================================== C . 72.10 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 47.28 |==================================================================== B . 46.73 |=================================================================== C . 46.94 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 21.15 |=================================================================== B . 21.39 |==================================================================== C . 21.30 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 28.18 |==================================================================== B . 28.14 |==================================================================== C . 28.14 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 141.85 |=================================================================== B . 142.13 |=================================================================== C . 142.15 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 23.88 |==================================================================== B . 23.88 |==================================================================== C . 23.95 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 41.88 |==================================================================== B . 41.87 |==================================================================== C . 41.75 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 6.1060 |================================================================== B . 6.1642 |=================================================================== C . 6.1695 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 655.07 |=================================================================== B . 643.71 |================================================================== C . 648.34 |================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 5.8303 |=================================================================== B . 5.8567 |=================================================================== C . 5.8353 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 171.51 |=================================================================== B . 170.75 |=================================================================== C . 171.36 |===================================================================