icelake deep Intel Core i7-1065G7 testing with a Dell 06CDVY (1.0.9 BIOS) and Intel Iris Plus ICL GT2 16GB on Ubuntu 22.04 via the Phoronix Test Suite. a: Processor: Intel Core i7-1065G7 @ 3.90GHz (4 Cores / 8 Threads), Motherboard: Dell 06CDVY (1.0.9 BIOS), Chipset: Intel Ice Lake-LP DRAM, Memory: 16GB, Disk: Toshiba KBG40ZPZ512G NVMe 512GB, Graphics: Intel Iris Plus ICL GT2 16GB (1100MHz), Audio: Realtek ALC289, Network: Intel Ice Lake-LP PCH CNVi WiFi OS: Ubuntu 22.04, Kernel: 5.18.8-051808-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1, OpenCL: OpenCL 3.0, Vulkan: 1.3.204, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1920x1200 b: Processor: Intel Core i7-1065G7 @ 3.90GHz (4 Cores / 8 Threads), Motherboard: Dell 06CDVY (1.0.9 BIOS), Chipset: Intel Ice Lake-LP DRAM, Memory: 16GB, Disk: Toshiba KBG40ZPZ512G NVMe 512GB, Graphics: Intel Iris Plus ICL GT2 16GB (1100MHz), Audio: Realtek ALC289, Network: Intel Ice Lake-LP PCH CNVi WiFi OS: Ubuntu 22.04, Kernel: 5.18.8-051808-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1, OpenCL: OpenCL 3.0, Vulkan: 1.3.204, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1920x1200 c: Processor: Intel Core i7-1065G7 @ 3.90GHz (4 Cores / 8 Threads), Motherboard: Dell 06CDVY (1.0.9 BIOS), Chipset: Intel Ice Lake-LP DRAM, Memory: 16GB, Disk: Toshiba KBG40ZPZ512G NVMe 512GB, Graphics: Intel Iris Plus ICL GT2 16GB (1100MHz), Audio: Realtek ALC289, Network: Intel Ice Lake-LP PCH CNVi WiFi OS: Ubuntu 22.04, Kernel: 5.18.8-051808-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1, OpenCL: OpenCL 3.0, Vulkan: 1.3.204, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1920x1200 KeyDB 6.3.2 Test: GET - Parallel Connections: 50 Requests Per Second > Higher Is Better a . 965959.56 |================================================================ b . 919540.25 |============================================================= c . 908611.81 |============================================================ KeyDB 6.3.2 Test: SET - Parallel Connections: 50 Requests Per Second > Higher Is Better a . 791389.69 |=============================================================== b . 800922.62 |================================================================ c . 783883.38 |=============================================================== KeyDB 6.3.2 Test: GET - Parallel Connections: 100 Requests Per Second > Higher Is Better a . 909570.50 |================================================================ b . 768804.94 |====================================================== c . 856061.75 |============================================================ KeyDB 6.3.2 Test: GET - Parallel Connections: 500 Requests Per Second > Higher Is Better a . 889078.56 |================================================================ b . 742060.00 |===================================================== c . 752604.06 |====================================================== KeyDB 6.3.2 Test: GET - Parallel Connections: 900 Requests Per Second > Higher Is Better a . 865980.81 |================================================================ b . 700074.25 |==================================================== c . 711207.19 |===================================================== KeyDB 6.3.2 Test: LPOP - Parallel Connections: 50 Requests Per Second > Higher Is Better a . 991178.50 |================================================================ b . 649747.25 |========================================== c . 618965.12 |======================================== KeyDB 6.3.2 Test: SADD - Parallel Connections: 50 Requests Per Second > Higher Is Better a . 878271.56 |================================================================ b . 768793.12 |======================================================== c . 750593.00 |======================================================= KeyDB 6.3.2 Test: SET - Parallel Connections: 100 Requests Per Second > Higher Is Better a . 815381.38 |================================================================ b . 696563.19 |======================================================= c . 677947.75 |===================================================== KeyDB 6.3.2 Test: SET - Parallel Connections: 500 Requests Per Second > Higher Is Better a . 396372.41 |====================================== b . 641659.12 |============================================================== c . 663182.75 |================================================================ KeyDB 6.3.2 Test: SET - Parallel Connections: 900 Requests Per Second > Higher Is Better a . 703037.06 |================================================================ b . 614001.69 |======================================================== c . 609369.62 |======================================================= KeyDB 6.3.2 Test: HMSET - Parallel Connections: 50 Requests Per Second > Higher Is Better a . 306581.06 |=========================================================== b . 333883.12 |================================================================ c . 300563.84 |========================================================== KeyDB 6.3.2 Test: LPOP - Parallel Connections: 100 Requests Per Second > Higher Is Better a . 910150.00 |================================================================ b . 604353.75 |========================================== c . 616424.00 |=========================================== KeyDB 6.3.2 Test: LPOP - Parallel Connections: 500 Requests Per Second > Higher Is Better a . 906109.00 |================================================================ b . 604763.12 |=========================================== c . 596153.62 |========================================== KeyDB 6.3.2 Test: LPOP - Parallel Connections: 900 Requests Per Second > Higher Is Better a . 809375.81 |================================================================ b . 682435.50 |====================================================== c . 642269.00 |=================================================== KeyDB 6.3.2 Test: LPUSH - Parallel Connections: 50 Requests Per Second > Higher Is Better a . 643467.50 |================================================================ b . 618727.69 |============================================================= c . 644712.06 |================================================================ KeyDB 6.3.2 Test: SADD - Parallel Connections: 100 Requests Per Second > Higher Is Better a . 814690.50 |================================================================ b . 758575.69 |============================================================ c . 759612.94 |============================================================ KeyDB 6.3.2 Test: SADD - Parallel Connections: 500 Requests Per Second > Higher Is Better a . 739677.81 |================================================================ b . 716722.56 |============================================================== c . 735434.75 |================================================================ KeyDB 6.3.2 Test: SADD - Parallel Connections: 900 Requests Per Second > Higher Is Better a . 743582.94 |================================================================ b . 696805.88 |============================================================ c . 679338.62 |========================================================== KeyDB 6.3.2 Test: HMSET - Parallel Connections: 100 Requests Per Second > Higher Is Better a . 245915.34 |============================================================== b . 252201.72 |================================================================ c . 248416.36 |=============================================================== KeyDB 6.3.2 Test: HMSET - Parallel Connections: 500 Requests Per Second > Higher Is Better a . 241319.73 |================================================================ b . 238656.66 |=============================================================== c . 235957.02 |=============================================================== KeyDB 6.3.2 Test: HMSET - Parallel Connections: 900 Requests Per Second > Higher Is Better a . 235377.19 |================================================================ b . 234181.08 |================================================================ c . 233903.91 |================================================================ KeyDB 6.3.2 Test: LPUSH - Parallel Connections: 100 Requests Per Second > Higher Is Better a . 605935.75 |================================================================ b . 596281.62 |=============================================================== c . 603624.19 |================================================================ KeyDB 6.3.2 Test: LPUSH - Parallel Connections: 500 Requests Per Second > Higher Is Better a . 558752.88 |================================================================ b . 553452.44 |=============================================================== c . 560846.19 |================================================================ KeyDB 6.3.2 Test: LPUSH - Parallel Connections: 900 Requests Per Second > Higher Is Better a . 547585.19 |================================================================ b . 535200.12 |=============================================================== c . 537871.56 |=============================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 1.9804 |================================================================== b . 1.9855 |=================================================================== c . 1.9956 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 1007.55 |================================================================== b . 1005.89 |================================================================== c . 1001.29 |================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 1.9891 |=================================================================== b . 1.9858 |=================================================================== c . 1.9861 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 502.74 |=================================================================== b . 503.58 |=================================================================== c . 503.50 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 43.72 |==================================================================== b . 42.47 |================================================================== c . 43.49 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 45.71 |================================================================== b . 47.04 |==================================================================== c . 45.96 |================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 41.62 |==================================================================== b . 41.41 |==================================================================== c . 41.39 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 24.02 |==================================================================== b . 24.14 |==================================================================== c . 24.15 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 10.75 |==================================================================== b . 10.74 |==================================================================== c . 10.74 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 185.64 |=================================================================== b . 186.08 |=================================================================== c . 186.12 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 10.73 |=================================================================== b . 10.75 |==================================================================== c . 10.82 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 93.17 |==================================================================== b . 93.01 |==================================================================== c . 92.37 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 13.68 |==================================================================== b . 13.64 |==================================================================== c . 13.57 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 146.14 |================================================================== b . 146.64 |=================================================================== c . 147.40 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 12.35 |==================================================================== b . 12.34 |==================================================================== c . 12.31 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 80.93 |==================================================================== b . 81.04 |==================================================================== c . 81.19 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 34.34 |==================================================================== b . 34.35 |==================================================================== c . 34.48 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 58.21 |==================================================================== b . 58.15 |==================================================================== c . 57.94 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 33.65 |==================================================================== b . 33.64 |==================================================================== c . 33.63 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 29.70 |==================================================================== b . 29.71 |==================================================================== c . 29.72 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 18.65 |=================================================================== b . 18.77 |==================================================================== c . 18.81 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 107.18 |=================================================================== b . 106.46 |=================================================================== c . 106.25 |================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 17.11 |==================================================================== b . 17.06 |==================================================================== c . 17.10 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 58.42 |==================================================================== b . 58.61 |==================================================================== c . 58.48 |==================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 4.3781 |=================================================================== b . 4.3125 |================================================================== c . 4.3910 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 456.75 |================================================================== b . 463.53 |=================================================================== c . 455.39 |================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 4.4416 |=================================================================== b . 4.4172 |=================================================================== c . 4.4042 |================================================================== Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 225.12 |================================================================== b . 226.37 |=================================================================== c . 227.03 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 8.6291 |=================================================================== b . 8.6367 |=================================================================== c . 8.6032 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 231.34 |=================================================================== b . 231.21 |=================================================================== c . 232.10 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 7.9995 |=================================================================== b . 8.0057 |=================================================================== c . 8.0153 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 125.00 |=================================================================== b . 124.90 |=================================================================== c . 124.75 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 1.9802 |=================================================================== b . 1.9823 |=================================================================== c . 1.9885 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 1007.90 |================================================================== b . 1007.67 |================================================================== c . 1004.99 |================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 1.9825 |=================================================================== b . 1.9836 |=================================================================== c . 1.9828 |=================================================================== Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 504.41 |=================================================================== b . 504.12 |=================================================================== c . 504.34 |===================================================================