ddds AMD Ryzen 7 4800U testing with a ASRock 4X4-4000 (P1.30Q BIOS) and AMD Renoir 512MB on Ubuntu 22.04 via the Phoronix Test Suite. A: Processor: AMD Ryzen 7 4800U @ 1.80GHz (8 Cores / 16 Threads), Motherboard: ASRock 4X4-4000 (P1.30Q BIOS), Chipset: AMD Renoir/Cezanne, Memory: 16GB, Disk: 512GB TS512GMTS952T-I, Graphics: AMD Renoir 512MB (1750/400MHz), Audio: AMD Renoir Radeon HD Audio, Monitor: DELL P2415Q, Network: Realtek RTL8125 2.5GbE + Realtek RTL8111/8168/8411 + Intel 8265 / 8275 OS: Ubuntu 22.04, Kernel: 5.19.0-rc6-phx-retbleed (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1 (LLVM 13.0.1 DRM 3.47), Vulkan: 1.3.204, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 3840x2160 B: Processor: AMD Ryzen 7 4800U @ 1.80GHz (8 Cores / 16 Threads), Motherboard: ASRock 4X4-4000 (P1.30Q BIOS), Chipset: AMD Renoir/Cezanne, Memory: 16GB, Disk: 512GB TS512GMTS952T-I, Graphics: AMD Renoir 512MB (1750/400MHz), Audio: AMD Renoir Radeon HD Audio, Monitor: DELL P2415Q, Network: Realtek RTL8125 2.5GbE + Realtek RTL8111/8168/8411 + Intel 8265 / 8275 OS: Ubuntu 22.04, Kernel: 5.19.0-rc6-phx-retbleed (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1 (LLVM 13.0.1 DRM 3.47), Vulkan: 1.3.204, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 3840x2160 C: Processor: AMD Ryzen 7 4800U @ 1.80GHz (8 Cores / 16 Threads), Motherboard: ASRock 4X4-4000 (P1.30Q BIOS), Chipset: AMD Renoir/Cezanne, Memory: 16GB, Disk: 512GB TS512GMTS952T-I, Graphics: AMD Renoir 512MB (1750/400MHz), Audio: AMD Renoir Radeon HD Audio, Monitor: DELL P2415Q, Network: Realtek RTL8125 2.5GbE + Realtek RTL8111/8168/8411 + Intel 8265 / 8275 OS: Ubuntu 22.04, Kernel: 5.19.0-rc6-phx-retbleed (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1 (LLVM 13.0.1 DRM 3.47), Vulkan: 1.3.204, Compiler: GCC 11.2.0, File-System: ext4, Screen Resolution: 3840x2160 OpenRadioss 2022.10.13 Model: Bumper Beam Seconds < Lower Is Better A . 434.63 |=================================================================== B . 435.29 |=================================================================== C . 434.05 |=================================================================== OpenRadioss 2022.10.13 Model: Cell Phone Drop Test Seconds < Lower Is Better A . 288.26 |=================================================================== B . 290.20 |=================================================================== C . 287.42 |================================================================== OpenRadioss 2022.10.13 Model: Bird Strike on Windshield Seconds < Lower Is Better A . 621.00 |=================================================================== B . 597.32 |================================================================ C . 601.98 |================================================================= OpenRadioss 2022.10.13 Model: Rubber O-Ring Seal Installation Seconds < Lower Is Better A . 568.28 |=================================================================== B . 567.63 |=================================================================== C . 568.16 |=================================================================== OpenRadioss 2022.10.13 Model: INIVOL and Fluid Structure Interaction Drop Container Seconds < Lower Is Better A . 1820.44 |================================================================== B . 1831.09 |================================================================== C . 1827.95 |================================================================== JPEG XL libjxl 0.7 Input: PNG - Quality: 80 MP/s > Higher Is Better A . 6.27 |==================================================================== B . 6.30 |===================================================================== C . 6.32 |===================================================================== JPEG XL libjxl 0.7 Input: PNG - Quality: 90 MP/s > Higher Is Better A . 6.23 |===================================================================== B . 6.27 |===================================================================== C . 6.26 |===================================================================== JPEG XL libjxl 0.7 Input: JPEG - Quality: 80 MP/s > Higher Is Better A . 6.07 |==================================================================== B . 6.12 |===================================================================== C . 6.09 |===================================================================== JPEG XL libjxl 0.7 Input: JPEG - Quality: 90 MP/s > Higher Is Better A . 6.01 |===================================================================== B . 6.03 |===================================================================== C . 6.02 |===================================================================== JPEG XL libjxl 0.7 Input: PNG - Quality: 100 MP/s > Higher Is Better A . 0.5 |====================================================================== B . 0.5 |====================================================================== C . 0.5 |====================================================================== JPEG XL libjxl 0.7 Input: JPEG - Quality: 100 MP/s > Higher Is Better A . 0.50 |==================================================================== B . 0.50 |==================================================================== C . 0.51 |===================================================================== JPEG XL Decoding libjxl 0.7 CPU Threads: 1 MP/s > Higher Is Better A . 34.01 |=================================================================== B . 34.37 |==================================================================== C . 34.20 |==================================================================== JPEG XL Decoding libjxl 0.7 CPU Threads: All MP/s > Higher Is Better A . 84.13 |=================================================================== B . 85.32 |==================================================================== C . 84.90 |==================================================================== libavif avifenc 0.11 Encoder Speed: 0 Seconds < Lower Is Better A . 218.53 |================================================================= B . 219.50 |================================================================== C . 223.55 |=================================================================== libavif avifenc 0.11 Encoder Speed: 2 Seconds < Lower Is Better A . 103.68 |================================================================ B . 105.99 |================================================================== C . 107.75 |=================================================================== libavif avifenc 0.11 Encoder Speed: 6 Seconds < Lower Is Better A . 11.30 |=================================================================== B . 11.37 |==================================================================== C . 11.45 |==================================================================== libavif avifenc 0.11 Encoder Speed: 6, Lossless Seconds < Lower Is Better A . 17.33 |=================================================================== B . 17.40 |==================================================================== C . 17.51 |==================================================================== libavif avifenc 0.11 Encoder Speed: 10, Lossless Seconds < Lower Is Better A . 8.417 |==================================================================== B . 8.315 |=================================================================== C . 8.350 |=================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 1 - Mode: Read Only TPS > Higher Is Better A . 19464 |==================================================================== B . 19449 |==================================================================== C . 19284 |=================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 1 - Mode: Read Only - Average Latency ms < Lower Is Better A . 0.051 |=================================================================== B . 0.051 |=================================================================== C . 0.052 |==================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 1 - Mode: Read Write TPS > Higher Is Better A . 531 |================================================================= B . 571 |====================================================================== C . 553 |==================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 1 - Mode: Read Write - Average Latency ms < Lower Is Better A . 1.882 |==================================================================== B . 1.752 |=============================================================== C . 1.809 |================================================================= PostgreSQL 15 Scaling Factor: 1 - Clients: 50 - Mode: Read Only TPS > Higher Is Better A . 169570 |=================================================================== B . 158317 |=============================================================== C . 161775 |================================================================ PostgreSQL 15 Scaling Factor: 1 - Clients: 50 - Mode: Read Only - Average Latency ms < Lower Is Better A . 0.295 |=============================================================== B . 0.316 |==================================================================== C . 0.309 |================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 100 - Mode: Read Only TPS > Higher Is Better A . 146390 |=================================================================== B . 139290 |================================================================ C . 143727 |================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 100 - Mode: Read Only - Average Latency ms < Lower Is Better A . 0.683 |================================================================= B . 0.718 |==================================================================== C . 0.696 |================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 250 - Mode: Read Only TPS > Higher Is Better A . 107550 |=================================================================== B . 105957 |================================================================== C . 107072 |=================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 250 - Mode: Read Only - Average Latency ms < Lower Is Better A . 2.324 |=================================================================== B . 2.359 |==================================================================== C . 2.335 |=================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 50 - Mode: Read Write TPS > Higher Is Better A . 562 |====================================================================== B . 561 |====================================================================== C . 561 |====================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 50 - Mode: Read Write - Average Latency ms < Lower Is Better A . 89.05 |==================================================================== B . 89.11 |==================================================================== C . 89.09 |==================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 500 - Mode: Read Only TPS > Higher Is Better A . 89903 |=================================================================== B . 91413 |==================================================================== C . 89999 |=================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 500 - Mode: Read Only - Average Latency ms < Lower Is Better A . 5.562 |==================================================================== B . 5.470 |=================================================================== C . 5.556 |==================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 1 - Mode: Read Only TPS > Higher Is Better A . 18257 |==================================================================== B . 18183 |=================================================================== C . 18381 |==================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 1 - Mode: Read Only - Average Latency ms < Lower Is Better A . 0.055 |==================================================================== B . 0.055 |==================================================================== C . 0.054 |=================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 100 - Mode: Read Write TPS > Higher Is Better A . 544 |====================================================================== B . 545 |====================================================================== C . 545 |====================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 100 - Mode: Read Write - Average Latency ms < Lower Is Better A . 183.77 |=================================================================== B . 183.52 |=================================================================== C . 183.43 |=================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 250 - Mode: Read Write TPS > Higher Is Better A . 437 |=================================================================== B . 458 |====================================================================== C . 458 |====================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 250 - Mode: Read Write - Average Latency ms < Lower Is Better A . 571.87 |=================================================================== B . 545.82 |================================================================ C . 545.51 |================================================================ PostgreSQL 15 Scaling Factor: 1 - Clients: 500 - Mode: Read Write TPS > Higher Is Better A . 329 |==================================================================== B . 337 |====================================================================== C . 336 |====================================================================== PostgreSQL 15 Scaling Factor: 1 - Clients: 500 - Mode: Read Write - Average Latency ms < Lower Is Better A . 1521.91 |================================================================== B . 1483.97 |================================================================ C . 1489.57 |================================================================= PostgreSQL 15 Scaling Factor: 100 - Clients: 1 - Mode: Read Write TPS > Higher Is Better A . 526 |====================================================================== B . 404 |====================================================== C . 406 |====================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 1 - Mode: Read Write - Average Latency ms < Lower Is Better A . 1.901 |==================================================== B . 2.472 |==================================================================== C . 2.461 |==================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 50 - Mode: Read Only TPS > Higher Is Better A . 159460 |================================================================== B . 162655 |=================================================================== C . 160806 |================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 50 - Mode: Read Only - Average Latency ms < Lower Is Better A . 0.314 |==================================================================== B . 0.307 |================================================================== C . 0.311 |=================================================================== PostgreSQL 15 Scaling Factor: 1000 - Clients: 1 - Mode: Read Only TPS > Higher Is Better A . 6099 |===================================================================== B . 5270 |============================================================ C . 5798 |================================================================== PostgreSQL 15 Scaling Factor: 1000 - Clients: 1 - Mode: Read Only - Average Latency ms < Lower Is Better A . 0.164 |=========================================================== B . 0.190 |==================================================================== C . 0.172 |============================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 100 - Mode: Read Only TPS > Higher Is Better A . 141934 |=================================================================== B . 141525 |=================================================================== C . 140123 |================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 100 - Mode: Read Only - Average Latency ms < Lower Is Better A . 0.705 |=================================================================== B . 0.707 |=================================================================== C . 0.714 |==================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 250 - Mode: Read Only TPS > Higher Is Better A . 101537 |=================================================================== B . 95333 |=============================================================== C . 101962 |=================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 250 - Mode: Read Only - Average Latency ms < Lower Is Better A . 2.462 |================================================================ B . 2.622 |==================================================================== C . 2.452 |================================================================ PostgreSQL 15 Scaling Factor: 100 - Clients: 50 - Mode: Read Write TPS > Higher Is Better A . 2703 |================================= B . 5727 |===================================================================== C . 5636 |==================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 50 - Mode: Read Write - Average Latency ms < Lower Is Better A . 18.500 |=================================================================== B . 8.731 |================================ C . 8.872 |================================ PostgreSQL 15 Scaling Factor: 100 - Clients: 500 - Mode: Read Only TPS > Higher Is Better A . 82432 |==================================================================== B . 80990 |=================================================================== C . 81122 |=================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 500 - Mode: Read Only - Average Latency ms < Lower Is Better A . 6.066 |=================================================================== B . 6.174 |==================================================================== C . 6.164 |==================================================================== PostgreSQL 15 Scaling Factor: 1000 - Clients: 1 - Mode: Read Write TPS > Higher Is Better A . 86 |============== B . 392 |================================================================ C . 429 |====================================================================== PostgreSQL 15 Scaling Factor: 1000 - Clients: 1 - Mode: Read Write - Average Latency ms < Lower Is Better A . 11.675 |=================================================================== B . 2.551 |=============== C . 2.331 |============= PostgreSQL 15 Scaling Factor: 1000 - Clients: 50 - Mode: Read Only TPS > Higher Is Better A . 50078 |==================================================================== B . 48014 |================================================================= C . 47739 |================================================================= PostgreSQL 15 Scaling Factor: 1000 - Clients: 50 - Mode: Read Only - Average Latency ms < Lower Is Better A . 0.998 |================================================================= B . 1.041 |==================================================================== C . 1.047 |==================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 100 - Mode: Read Write TPS > Higher Is Better A . 3416 |====================================== B . 6241 |===================================================================== C . 5715 |=============================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 100 - Mode: Read Write - Average Latency ms < Lower Is Better A . 29.28 |==================================================================== B . 16.02 |===================================== C . 17.50 |========================================= PostgreSQL 15 Scaling Factor: 100 - Clients: 250 - Mode: Read Write TPS > Higher Is Better A . 3929 |==================================== B . 6088 |======================================================== C . 7516 |===================================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 250 - Mode: Read Write - Average Latency ms < Lower Is Better A . 63.63 |==================================================================== B . 41.06 |============================================ C . 33.26 |==================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 500 - Mode: Read Write TPS > Higher Is Better A . 4158 |============================================ B . 6535 |===================================================================== C . 5867 |============================================================== PostgreSQL 15 Scaling Factor: 100 - Clients: 500 - Mode: Read Write - Average Latency ms < Lower Is Better A . 120.25 |=================================================================== B . 76.51 |=========================================== C . 85.22 |=============================================== PostgreSQL 15 Scaling Factor: 1000 - Clients: 100 - Mode: Read Only TPS > Higher Is Better A . 48016 |==================================================================== B . 45926 |================================================================= C . 44468 |=============================================================== PostgreSQL 15 Scaling Factor: 1000 - Clients: 100 - Mode: Read Only - Average Latency ms < Lower Is Better A . 2.083 |=============================================================== B . 2.177 |================================================================== C . 2.249 |==================================================================== PostgreSQL 15 Scaling Factor: 1000 - Clients: 250 - Mode: Read Only TPS > Higher Is Better A . 39379 |==================================================================== B . 39520 |==================================================================== C . 39305 |==================================================================== PostgreSQL 15 Scaling Factor: 1000 - Clients: 250 - Mode: Read Only - Average Latency ms < Lower Is Better A . 6.349 |==================================================================== B . 6.326 |==================================================================== C . 6.361 |==================================================================== PostgreSQL 15 Scaling Factor: 1000 - Clients: 50 - Mode: Read Write TPS > Higher Is Better A . 2238 |==================================================================== B . 2266 |===================================================================== C . 2190 |=================================================================== PostgreSQL 15 Scaling Factor: 1000 - Clients: 50 - Mode: Read Write - Average Latency ms < Lower Is Better A . 22.34 |=================================================================== B . 22.07 |================================================================== C . 22.83 |==================================================================== PostgreSQL 15 Scaling Factor: 1000 - Clients: 500 - Mode: Read Only TPS > Higher Is Better A . 34141 |==================================================================== B . 34294 |==================================================================== C . 33862 |=================================================================== PostgreSQL 15 Scaling Factor: 1000 - Clients: 500 - Mode: Read Only - Average Latency ms < Lower Is Better A . 14.65 |=================================================================== B . 14.58 |=================================================================== C . 14.77 |==================================================================== PostgreSQL 15 Scaling Factor: 1000 - Clients: 100 - Mode: Read Write TPS > Higher Is Better A . 2782 |===================================================================== B . 2642 |================================================================== C . 2428 |============================================================ PostgreSQL 15 Scaling Factor: 1000 - Clients: 100 - Mode: Read Write - Average Latency ms < Lower Is Better A . 35.94 |=========================================================== B . 37.85 |============================================================== C . 41.19 |==================================================================== PostgreSQL 15 Scaling Factor: 1000 - Clients: 250 - Mode: Read Write TPS > Higher Is Better A . 2809 |===================================================================== B . 2555 |=============================================================== C . 2540 |============================================================== PostgreSQL 15 Scaling Factor: 1000 - Clients: 250 - Mode: Read Write - Average Latency ms < Lower Is Better A . 89.01 |============================================================= B . 97.85 |==================================================================== C . 98.42 |==================================================================== PostgreSQL 15 Scaling Factor: 1000 - Clients: 500 - Mode: Read Write TPS > Higher Is Better A . 3040 |===================================================================== B . 2712 |============================================================== C . 2552 |========================================================== PostgreSQL 15 Scaling Factor: 1000 - Clients: 500 - Mode: Read Write - Average Latency ms < Lower Is Better A . 164.47 |======================================================== B . 184.39 |=============================================================== C . 195.91 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 4.0890 |================================================================== B . 4.1714 |=================================================================== C . 4.1666 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 971.39 |=================================================================== B . 958.16 |================================================================== C . 954.35 |================================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 4.2974 |=================================================================== B . 4.2380 |================================================================== C . 4.3254 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 232.69 |================================================================== B . 235.95 |=================================================================== C . 231.18 |================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 9.5047 |================================================================== B . 9.5860 |=================================================================== C . 9.5308 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 420.41 |=================================================================== B . 416.03 |================================================================== C . 419.19 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 10.0367 |================================================================== B . 9.6605 |================================================================ C . 9.5742 |=============================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 99.62 |================================================================ B . 103.50 |================================================================== C . 104.43 |=================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 22.47 |=================================================================== B . 21.55 |================================================================ C . 22.72 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 177.63 |================================================================ B . 185.54 |=================================================================== C . 175.92 |================================================================ Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 21.72 |==================================================================== B . 21.74 |==================================================================== C . 21.40 |=================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 46.02 |=================================================================== B . 45.99 |=================================================================== C . 46.71 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 52.18 |=================================================================== B . 52.51 |==================================================================== C . 52.82 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 76.59 |==================================================================== B . 76.14 |==================================================================== C . 75.70 |=================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 45.93 |==================================================================== B . 45.11 |=================================================================== C . 45.53 |=================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 21.76 |=================================================================== B . 22.16 |==================================================================== C . 21.95 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 37.56 |=================================================================== B . 36.98 |================================================================== C . 38.06 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 106.46 |================================================================== B . 108.13 |=================================================================== C . 104.86 |================================================================= Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 31.57 |==================================================================== B . 31.71 |==================================================================== C . 31.77 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 31.67 |==================================================================== B . 31.53 |==================================================================== C . 31.46 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 18.79 |==================================================================== B . 18.64 |=================================================================== C . 18.78 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 212.90 |================================================================== B . 214.53 |=================================================================== C . 212.99 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 15.92 |==================================================================== B . 15.84 |=================================================================== C . 15.97 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 62.82 |==================================================================== B . 63.14 |==================================================================== C . 62.60 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 4.1337 |=================================================================== B . 4.0389 |================================================================= C . 4.0614 |================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 961.75 |================================================================= B . 983.50 |=================================================================== C . 984.21 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 4.1226 |=================================================================== B . 4.0762 |================================================================== C . 4.1523 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 242.55 |================================================================== B . 245.32 |=================================================================== C . 240.82 |==================================================================