ds key Intel Core i7-1185G7 testing with a Dell 0DXP1F (3.7.0 BIOS) and Intel Xe TGL GT2 15GB on Ubuntu 22.04 via the Phoronix Test Suite. a: Processor: Intel Core i7-1185G7 @ 4.80GHz (4 Cores / 8 Threads), Motherboard: Dell 0DXP1F (3.7.0 BIOS), Chipset: Intel Tiger Lake-LP, Memory: 16GB, Disk: Micron 2300 NVMe 512GB, Graphics: Intel Xe TGL GT2 15GB (1350MHz), Audio: Realtek ALC289, Network: Intel Wi-Fi 6 AX201 OS: Ubuntu 22.04, Kernel: 5.18.8-051808-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1, OpenCL: OpenCL 3.0, Vulkan: 1.3.204, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1920x1200 b: Processor: Intel Core i7-1185G7 @ 4.80GHz (4 Cores / 8 Threads), Motherboard: Dell 0DXP1F (3.7.0 BIOS), Chipset: Intel Tiger Lake-LP, Memory: 16GB, Disk: Micron 2300 NVMe 512GB, Graphics: Intel Xe TGL GT2 15GB (1350MHz), Audio: Realtek ALC289, Network: Intel Wi-Fi 6 AX201 OS: Ubuntu 22.04, Kernel: 5.18.8-051808-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1, OpenCL: OpenCL 3.0, Vulkan: 1.3.204, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1920x1200 c: Processor: Intel Core i7-1185G7 @ 4.80GHz (4 Cores / 8 Threads), Motherboard: Dell 0DXP1F (3.7.0 BIOS), Chipset: Intel Tiger Lake-LP, Memory: 16GB, Disk: Micron 2300 NVMe 512GB, Graphics: Intel Xe TGL GT2 15GB (1350MHz), Audio: Realtek ALC289, Network: Intel Wi-Fi 6 AX201 OS: Ubuntu 22.04, Kernel: 5.18.8-051808-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1, OpenCL: OpenCL 3.0, Vulkan: 1.3.204, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1920x1200 KeyDB 6.3.2 Test: GET - Parallel Connections: 50 Requests Per Second > Higher Is Better a . 1177884.00 |=============================================================== b . 1135615.12 |============================================================= c . 1108278.75 |=========================================================== KeyDB 6.3.2 Test: SET - Parallel Connections: 50 Requests Per Second > Higher Is Better a . 1016156.88 |============================================================== b . 1026609.75 |=============================================================== c . 970270.88 |============================================================ KeyDB 6.3.2 Test: GET - Parallel Connections: 100 Requests Per Second > Higher Is Better a . 1149108.25 |=============================================================== b . 1102925.00 |============================================================ c . 1092729.00 |============================================================ KeyDB 6.3.2 Test: GET - Parallel Connections: 500 Requests Per Second > Higher Is Better a . 1142517.62 |=============================================================== b . 1044517.31 |========================================================== c . 1108672.00 |============================================================= KeyDB 6.3.2 Test: GET - Parallel Connections: 900 Requests Per Second > Higher Is Better a . 1098732.12 |=============================================================== b . 1022515.81 |=========================================================== c . 1015166.62 |========================================================== KeyDB 6.3.2 Test: LPOP - Parallel Connections: 50 Requests Per Second > Higher Is Better a . 1237409.38 |=============================================================== b . 847141.75 |=========================================== c . 860363.06 |============================================ KeyDB 6.3.2 Test: SADD - Parallel Connections: 50 Requests Per Second > Higher Is Better a . 1069335.75 |=============================================================== b . 1064237.38 |=============================================================== c . 1049934.88 |============================================================== KeyDB 6.3.2 Test: SET - Parallel Connections: 100 Requests Per Second > Higher Is Better a . 974544.88 |=============================================================== b . 923907.00 |============================================================ c . 993601.25 |================================================================ KeyDB 6.3.2 Test: SET - Parallel Connections: 500 Requests Per Second > Higher Is Better a . 947957.19 |================================================================ b . 952000.12 |================================================================ c . 949884.12 |================================================================ KeyDB 6.3.2 Test: SET - Parallel Connections: 900 Requests Per Second > Higher Is Better a . 887232.75 |================================================================ b . 877762.75 |=============================================================== c . 876869.94 |=============================================================== KeyDB 6.3.2 Test: HMSET - Parallel Connections: 50 Requests Per Second > Higher Is Better a . 555129.94 |================================================================ b . 516972.19 |============================================================ c . 429704.62 |================================================== KeyDB 6.3.2 Test: LPOP - Parallel Connections: 100 Requests Per Second > Higher Is Better a . 1164496.88 |=============================================================== b . 844894.31 |============================================== c . 855593.00 |============================================== KeyDB 6.3.2 Test: LPOP - Parallel Connections: 500 Requests Per Second > Higher Is Better a . 1187253.75 |=============================================================== b . 869338.44 |============================================== c . 865950.81 |============================================== KeyDB 6.3.2 Test: LPOP - Parallel Connections: 900 Requests Per Second > Higher Is Better a . 1093756.88 |=============================================================== b . 859047.50 |================================================= c . 855915.25 |================================================= KeyDB 6.3.2 Test: LPUSH - Parallel Connections: 50 Requests Per Second > Higher Is Better a . 873560.81 |================================================================ b . 878487.56 |================================================================ c . 873133.69 |================================================================ KeyDB 6.3.2 Test: SADD - Parallel Connections: 100 Requests Per Second > Higher Is Better a . 1056635.62 |============================================================== b . 1069152.88 |============================================================== c . 1078702.12 |=============================================================== KeyDB 6.3.2 Test: SADD - Parallel Connections: 500 Requests Per Second > Higher Is Better a . 1049119.75 |=============================================================== b . 979431.94 |=========================================================== c . 1019513.50 |============================================================= KeyDB 6.3.2 Test: SADD - Parallel Connections: 900 Requests Per Second > Higher Is Better a . 971534.06 |=============================================================== b . 982241.12 |================================================================ c . 987869.00 |================================================================ KeyDB 6.3.2 Test: HMSET - Parallel Connections: 100 Requests Per Second > Higher Is Better a . 351400.00 |================================================================ b . 340381.50 |============================================================== c . 333220.06 |============================================================= KeyDB 6.3.2 Test: HMSET - Parallel Connections: 500 Requests Per Second > Higher Is Better a . 339833.22 |================================================================ b . 331138.97 |============================================================== c . 333226.69 |=============================================================== KeyDB 6.3.2 Test: HMSET - Parallel Connections: 900 Requests Per Second > Higher Is Better a . 334560.06 |================================================================ b . 316315.53 |============================================================= c . 324928.50 |============================================================== KeyDB 6.3.2 Test: LPUSH - Parallel Connections: 100 Requests Per Second > Higher Is Better a . 835324.19 |=============================================================== b . 846181.19 |================================================================ c . 809887.12 |============================================================= KeyDB 6.3.2 Test: LPUSH - Parallel Connections: 500 Requests Per Second > Higher Is Better a . 789390.56 |=============================================================== b . 800192.06 |================================================================ c . 785015.62 |=============================================================== KeyDB 6.3.2 Test: LPUSH - Parallel Connections: 900 Requests Per Second > Higher Is Better a . 745145.38 |================================================================ b . 727590.19 |============================================================== c . 725636.75 |============================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 3.6432 |=================================================================== b . 3.4334 |=============================================================== c . 3.5142 |================================================================= Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 548.92 |=============================================================== b . 582.48 |=================================================================== c . 569.09 |================================================================= Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 3.2019 |=================================================================== b . 3.1968 |=================================================================== c . 3.1813 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 312.30 |=================================================================== b . 312.81 |=================================================================== c . 314.33 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 64.25 |==================================================================== b . 63.95 |==================================================================== c . 63.71 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 31.09 |=================================================================== b . 31.23 |==================================================================== c . 31.36 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 57.40 |==================================================================== b . 57.68 |==================================================================== c . 57.56 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 17.41 |==================================================================== b . 17.33 |==================================================================== c . 17.36 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 16.35 |==================================================================== b . 16.34 |==================================================================== c . 16.23 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 122.24 |================================================================== b . 122.31 |================================================================== c . 123.23 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 16.77 |==================================================================== b . 16.69 |==================================================================== c . 16.72 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 59.64 |==================================================================== b . 59.89 |==================================================================== c . 59.78 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 20.95 |==================================================================== b . 20.99 |==================================================================== c . 20.95 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 95.41 |==================================================================== b . 95.27 |==================================================================== c . 95.41 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 18.29 |==================================================================== b . 18.30 |==================================================================== c . 18.23 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 54.66 |==================================================================== b . 54.62 |==================================================================== c . 54.84 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 53.23 |==================================================================== b . 53.31 |==================================================================== c . 53.42 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 37.53 |==================================================================== b . 37.48 |==================================================================== c . 37.40 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 51.52 |==================================================================== b . 51.51 |==================================================================== c . 51.50 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 19.40 |==================================================================== b . 19.40 |==================================================================== c . 19.41 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 29.65 |==================================================================== b . 27.59 |=============================================================== c . 29.37 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 67.44 |=============================================================== b . 72.47 |==================================================================== c . 68.07 |================================================================ Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 26.72 |==================================================================== b . 26.86 |==================================================================== c . 26.62 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 37.42 |==================================================================== b . 37.23 |=================================================================== c . 37.56 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 6.8672 |=================================================================== b . 6.8531 |=================================================================== c . 6.8583 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 291.20 |=================================================================== b . 291.80 |=================================================================== c . 291.58 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 6.8260 |=================================================================== b . 6.8287 |=================================================================== c . 6.8067 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 146.48 |=================================================================== b . 146.42 |=================================================================== c . 146.89 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 13.96 |==================================================================== b . 14.01 |==================================================================== c . 13.96 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 143.20 |=================================================================== b . 142.68 |=================================================================== c . 143.20 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 13.20 |=================================================================== b . 13.32 |==================================================================== c . 13.30 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 75.74 |==================================================================== b . 75.05 |=================================================================== c . 75.18 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 3.2707 |=================================================================== b . 3.1604 |================================================================= c . 3.2108 |================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 611.45 |================================================================= b . 632.79 |=================================================================== c . 622.86 |================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 3.2194 |=================================================================== b . 3.2087 |=================================================================== c . 3.2088 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 310.60 |=================================================================== b . 311.64 |=================================================================== c . 311.63 |===================================================================