new tt AMD Ryzen 7 PRO 6850U testing with a LENOVO 21CM0001US (R22ET51W 1.21 BIOS) and AMD Radeon 680M 1GB on Ubuntu 22.10 via the Phoronix Test Suite. A: Processor: AMD Ryzen 7 PRO 6850U @ 2.70GHz (8 Cores / 16 Threads), Motherboard: LENOVO 21CM0001US (R22ET51W 1.21 BIOS), Chipset: AMD Device 14b5, Memory: 16GB, Disk: 512GB Micron MTFDKBA512TFK, Graphics: AMD Radeon 680M 1GB (2200/400MHz), Audio: AMD Rembrandt Radeon HD Audio, Network: Qualcomm QCNFA765 OS: Ubuntu 22.10, Kernel: 6.0.0-060000rc2daily20220824-generic (x86_64), Desktop: GNOME Shell 42.4, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.1.3 (LLVM 14.0.6 DRM 3.48), Vulkan: 1.3.211, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1920x1200 B: Processor: AMD Ryzen 7 PRO 6850U @ 2.70GHz (8 Cores / 16 Threads), Motherboard: LENOVO 21CM0001US (R22ET51W 1.21 BIOS), Chipset: AMD Device 14b5, Memory: 16GB, Disk: 512GB Micron MTFDKBA512TFK, Graphics: AMD Radeon 680M 1GB (2200/400MHz), Audio: AMD Rembrandt Radeon HD Audio, Network: Qualcomm QCNFA765 OS: Ubuntu 22.10, Kernel: 6.0.0-060000rc2daily20220824-generic (x86_64), Desktop: GNOME Shell 42.4, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.1.3 (LLVM 14.0.6 DRM 3.48), Vulkan: 1.3.211, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1920x1200 C: Processor: AMD Ryzen 7 PRO 6850U @ 2.70GHz (8 Cores / 16 Threads), Motherboard: LENOVO 21CM0001US (R22ET51W 1.21 BIOS), Chipset: AMD Device 14b5, Memory: 16GB, Disk: 512GB Micron MTFDKBA512TFK, Graphics: AMD Radeon 680M 1GB (2200/400MHz), Audio: AMD Rembrandt Radeon HD Audio, Network: Qualcomm QCNFA765 OS: Ubuntu 22.10, Kernel: 6.0.0-060000rc2daily20220824-generic (x86_64), Desktop: GNOME Shell 42.4, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.1.3 (LLVM 14.0.6 DRM 3.48), Vulkan: 1.3.211, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1920x1200 OpenRadioss 2022.10.13 Model: Bumper Beam Seconds < Lower Is Better A . 252.18 |=================================================================== B . 251.00 |=================================================================== C . 252.15 |=================================================================== OpenRadioss 2022.10.13 Model: Cell Phone Drop Test Seconds < Lower Is Better A . 182.55 |================================================================= B . 188.41 |=================================================================== C . 186.29 |================================================================== OpenRadioss 2022.10.13 Model: Bird Strike on Windshield Seconds < Lower Is Better A . 464.20 |================================================================== B . 469.01 |=================================================================== C . 471.51 |=================================================================== OpenRadioss 2022.10.13 Model: Rubber O-Ring Seal Installation Seconds < Lower Is Better A . 316.13 |================================================================== B . 322.15 |=================================================================== C . 318.95 |================================================================== OpenRadioss 2022.10.13 Model: INIVOL and Fluid Structure Interaction Drop Container Seconds < Lower Is Better A . 1034.94 |================================================================== B . 1009.58 |================================================================ C . 996.10 |================================================================ QuadRay 2022.05.25 Scene: 1 - Resolution: 4K FPS > Higher Is Better A . 4.66 |===================================================================== B . 4.65 |===================================================================== C . 4.65 |===================================================================== QuadRay 2022.05.25 Scene: 2 - Resolution: 4K FPS > Higher Is Better A . 1.35 |===================================================================== B . 1.35 |===================================================================== C . 1.35 |===================================================================== QuadRay 2022.05.25 Scene: 3 - Resolution: 4K FPS > Higher Is Better A . 1.21 |===================================================================== B . 1.21 |===================================================================== C . 1.21 |===================================================================== QuadRay 2022.05.25 Scene: 5 - Resolution: 4K FPS > Higher Is Better A . 0.34 |===================================================================== B . 0.34 |===================================================================== C . 0.34 |===================================================================== QuadRay 2022.05.25 Scene: 1 - Resolution: 1080p FPS > Higher Is Better A . 19.52 |==================================================================== B . 19.50 |==================================================================== C . 19.47 |==================================================================== QuadRay 2022.05.25 Scene: 2 - Resolution: 1080p FPS > Higher Is Better A . 5.54 |===================================================================== B . 5.55 |===================================================================== C . 5.54 |===================================================================== QuadRay 2022.05.25 Scene: 3 - Resolution: 1080p FPS > Higher Is Better A . 4.83 |===================================================================== B . 4.82 |===================================================================== C . 4.80 |===================================================================== QuadRay 2022.05.25 Scene: 5 - Resolution: 1080p FPS > Higher Is Better A . 1.36 |===================================================================== B . 1.36 |===================================================================== C . 1.36 |===================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 1 - Mode: Read Only TPS > Higher Is Better A . 20915 |==================================================================== B . 20473 |=================================================================== C . 20271 |================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 1 - Mode: Read Only - Average Latency ms < Lower Is Better A . 0.048 |=================================================================== B . 0.049 |==================================================================== C . 0.049 |==================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 1 - Mode: Read Write TPS > Higher Is Better A . 891 |===================================================================== B . 887 |==================================================================== C . 908 |====================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 1 - Mode: Read Write - Average Latency ms < Lower Is Better A . 1.122 |==================================================================== B . 1.127 |==================================================================== C . 1.101 |================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 50 - Mode: Read Only TPS > Higher Is Better A . 198361 |================================================================== B . 199962 |=================================================================== C . 200265 |=================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 50 - Mode: Read Only - Average Latency ms < Lower Is Better A . 0.252 |==================================================================== B . 0.250 |=================================================================== C . 0.250 |=================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 100 - Mode: Read Only TPS > Higher Is Better A . 199762 |=================================================================== B . 198715 |=================================================================== C . 198264 |================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 100 - Mode: Read Only - Average Latency ms < Lower Is Better A . 0.501 |==================================================================== B . 0.503 |==================================================================== C . 0.504 |==================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 50 - Mode: Read Write TPS > Higher Is Better A . 915 |====================================================================== B . 920 |====================================================================== C . 912 |===================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 50 - Mode: Read Write - Average Latency ms < Lower Is Better A . 54.65 |==================================================================== B . 54.36 |=================================================================== C . 54.80 |==================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 1 - Mode: Read Only TPS > Higher Is Better A . 19147 |==================================================================== B . 18946 |=================================================================== C . 18950 |=================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 1 - Mode: Read Only - Average Latency ms < Lower Is Better A . 0.052 |=================================================================== B . 0.053 |==================================================================== C . 0.053 |==================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 100 - Mode: Read Write TPS > Higher Is Better A . 834 |====================================================================== B . 828 |===================================================================== C . 835 |====================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 100 - Mode: Read Write - Average Latency ms < Lower Is Better A . 119.90 |================================================================== B . 120.81 |=================================================================== C . 119.72 |================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 1 - Mode: Read Write TPS > Higher Is Better A . 699 |===================================================================== B . 706 |===================================================================== C . 713 |====================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 1 - Mode: Read Write - Average Latency ms < Lower Is Better A . 1.430 |==================================================================== B . 1.417 |=================================================================== C . 1.403 |=================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 50 - Mode: Read Only TPS > Higher Is Better A . 191376 |=================================================================== B . 190549 |=================================================================== C . 190860 |=================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 50 - Mode: Read Only - Average Latency ms < Lower Is Better A . 0.261 |==================================================================== B . 0.262 |==================================================================== C . 0.262 |==================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 100 - Mode: Read Only TPS > Higher Is Better A . 190000 |=================================================================== B . 188694 |================================================================== C . 190663 |=================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 100 - Mode: Read Only - Average Latency ms < Lower Is Better A . 0.526 |=================================================================== B . 0.530 |==================================================================== C . 0.524 |=================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 50 - Mode: Read Write TPS > Higher Is Better A . 14244 |================================================================ B . 14576 |================================================================== C . 15081 |==================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 50 - Mode: Read Write - Average Latency ms < Lower Is Better A . 3.510 |==================================================================== B . 3.430 |================================================================== C . 3.315 |================================================================ PostgreSQL 15 Scaling Factor: 100 - Clients: 100 - Mode: Read Write TPS > Higher Is Better A . 18588 |=================================================================== B . 17800 |================================================================ C . 18857 |==================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 100 - Mode: Read Write - Average Latency ms < Lower Is Better A . 5.380 |================================================================= B . 5.618 |==================================================================== C . 5.303 |================================================================ Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 4.5978 |=================================================================== B . 4.4512 |================================================================= C . 4.6039 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 869.96 |================================================================= B . 896.32 |=================================================================== C . 867.37 |================================================================= Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 4.4498 |================================================================== B . 4.4606 |================================================================== C . 4.5417 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 224.71 |=================================================================== B . 224.17 |=================================================================== C . 220.16 |================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 18.36 |=================================================================== B . 16.49 |============================================================= C . 18.50 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 217.41 |============================================================ B . 242.49 |=================================================================== C . 215.92 |============================================================ Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 16.85 |==================================================================== B . 16.85 |==================================================================== C . 16.88 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 59.31 |==================================================================== B . 59.34 |==================================================================== C . 59.22 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 26.42 |=================================================================== B . 26.98 |==================================================================== C . 26.61 |=================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 151.39 |=================================================================== B . 148.18 |================================================================== C . 150.29 |=================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 26.11 |==================================================================== B . 25.73 |=================================================================== C . 25.92 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 38.27 |=================================================================== B . 38.85 |==================================================================== C . 38.55 |=================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 57.04 |==================================================================== B . 56.52 |=================================================================== C . 56.50 |=================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 70.08 |=================================================================== B . 70.72 |==================================================================== C . 70.77 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 51.57 |==================================================================== B . 51.22 |=================================================================== C . 51.66 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 19.37 |==================================================================== B . 19.51 |==================================================================== C . 19.34 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 42.30 |==================================================================== B . 41.51 |=================================================================== C . 41.68 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 94.54 |=================================================================== B . 96.20 |==================================================================== C . 95.95 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 38.09 |==================================================================== B . 38.08 |==================================================================== C . 38.17 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 26.24 |==================================================================== B . 26.25 |==================================================================== C . 26.19 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 19.75 |==================================================================== B . 19.79 |==================================================================== C . 19.72 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 202.54 |=================================================================== B . 202.08 |=================================================================== C . 202.77 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 18.29 |==================================================================== B . 18.35 |==================================================================== C . 18.37 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 54.67 |==================================================================== B . 54.49 |==================================================================== C . 54.43 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 4.6177 |=================================================================== B . 4.4955 |================================================================= C . 4.6096 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 862.77 |================================================================= B . 889.68 |=================================================================== C . 867.72 |================================================================= Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 4.5190 |================================================================== B . 4.4731 |================================================================== C . 4.5679 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 221.27 |================================================================== B . 223.54 |=================================================================== C . 218.90 |==================================================================