ddsa Intel Core i7-1065G7 testing with a Dell 06CDVY (1.0.9 BIOS) and Intel Iris Plus ICL GT2 16GB on Ubuntu 22.04 via the Phoronix Test Suite. a: Processor: Intel Core i7-1065G7 @ 3.90GHz (4 Cores / 8 Threads), Motherboard: Dell 06CDVY (1.0.9 BIOS), Chipset: Intel Ice Lake-LP DRAM, Memory: 16GB, Disk: Toshiba KBG40ZPZ512G NVMe 512GB, Graphics: Intel Iris Plus ICL GT2 16GB (1100MHz), Audio: Realtek ALC289, Network: Intel Ice Lake-LP PCH CNVi WiFi OS: Ubuntu 22.04, Kernel: 5.19.0-41-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1, OpenCL: OpenCL 3.0, Vulkan: 1.3.204, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1920x1200 b: Processor: Intel Core i7-1065G7 @ 3.90GHz (4 Cores / 8 Threads), Motherboard: Dell 06CDVY (1.0.9 BIOS), Chipset: Intel Ice Lake-LP DRAM, Memory: 16GB, Disk: Toshiba KBG40ZPZ512G NVMe 512GB, Graphics: Intel Iris Plus ICL GT2 16GB (1100MHz), Audio: Realtek ALC289, Network: Intel Ice Lake-LP PCH CNVi WiFi OS: Ubuntu 22.04, Kernel: 5.19.0-41-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1, OpenCL: OpenCL 3.0, Vulkan: 1.3.204, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1920x1200 c: Processor: Intel Core i7-1065G7 @ 3.90GHz (4 Cores / 8 Threads), Motherboard: Dell 06CDVY (1.0.9 BIOS), Chipset: Intel Ice Lake-LP DRAM, Memory: 16GB, Disk: Toshiba KBG40ZPZ512G NVMe 512GB, Graphics: Intel Iris Plus ICL GT2 16GB (1100MHz), Audio: Realtek ALC289, Network: Intel Ice Lake-LP PCH CNVi WiFi OS: Ubuntu 22.04, Kernel: 5.19.0-41-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 22.0.1, OpenCL: OpenCL 3.0, Vulkan: 1.3.204, Compiler: GCC 11.3.0, File-System: ext4, Screen Resolution: 1920x1200 LevelDB 1.23 Benchmark: Hot Read Microseconds Per Op < Lower Is Better a . 3.567 |================================================================== b . 3.651 |==================================================================== c . 3.645 |==================================================================== LevelDB 1.23 Benchmark: Fill Sync MB/s > Higher Is Better a . 0.1 |=================================== b . 0.1 |=================================== c . 0.2 |====================================================================== LevelDB 1.23 Benchmark: Fill Sync Microseconds Per Op < Lower Is Better a . 8397.30 |================================================================== b . 7210.97 |========================================================= c . 4275.17 |================================== LevelDB 1.23 Benchmark: Overwrite MB/s > Higher Is Better a . 38.4 |=========================================================== b . 44.7 |===================================================================== c . 44.8 |===================================================================== LevelDB 1.23 Benchmark: Overwrite Microseconds Per Op < Lower Is Better a . 23.01 |==================================================================== b . 19.74 |========================================================== c . 19.76 |========================================================== LevelDB 1.23 Benchmark: Random Fill MB/s > Higher Is Better a . 35.4 |======================================================= b . 44.4 |===================================================================== c . 44.4 |===================================================================== LevelDB 1.23 Benchmark: Random Fill Microseconds Per Op < Lower Is Better a . 24.98 |==================================================================== b . 19.89 |====================================================== c . 19.92 |====================================================== LevelDB 1.23 Benchmark: Random Read Microseconds Per Op < Lower Is Better a . 3.381 |============================================================== b . 3.704 |==================================================================== c . 3.648 |=================================================================== LevelDB 1.23 Benchmark: Seek Random Microseconds Per Op < Lower Is Better a . 4.568 |================================================================= b . 4.795 |==================================================================== c . 4.623 |================================================================== LevelDB 1.23 Benchmark: Random Delete Microseconds Per Op < Lower Is Better a . 26.17 |==================================================================== b . 18.11 |=============================================== c . 18.34 |================================================ LevelDB 1.23 Benchmark: Sequential Fill MB/s > Higher Is Better a . 27.6 |======================================= b . 48.6 |===================================================================== c . 44.8 |================================================================ LevelDB 1.23 Benchmark: Sequential Fill Microseconds Per Op < Lower Is Better a . 32.10 |==================================================================== b . 18.21 |======================================= c . 19.73 |========================================== dav1d 1.2.1 Video Input: Chimera 1080p FPS > Higher Is Better a . 181.36 |======================================= b . 309.17 |=================================================================== c . 310.19 |=================================================================== dav1d 1.2.1 Video Input: Summer Nature 4K FPS > Higher Is Better a . 52.31 |========================================== b . 85.27 |==================================================================== c . 84.67 |==================================================================== dav1d 1.2.1 Video Input: Summer Nature 1080p FPS > Higher Is Better a . 216.34 |======================================= b . 371.35 |=================================================================== c . 371.23 |=================================================================== dav1d 1.2.1 Video Input: Chimera 1080p 10-bit FPS > Higher Is Better a . 199.67 |========================================================= b . 236.09 |=================================================================== c . 213.86 |============================================================= Intel Open Image Denoise 2.0 Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only Images / Sec > Higher Is Better a . 0.10 |===================================================================== b . 0.10 |===================================================================== c . 0.10 |===================================================================== Intel Open Image Denoise 2.0 Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only Images / Sec > Higher Is Better a . 0.11 |===================================================================== b . 0.10 |=============================================================== c . 0.10 |=============================================================== Intel Open Image Denoise 2.0 Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only Images / Sec > Higher Is Better a . 0.05 |===================================================================== b . 0.05 |===================================================================== c . 0.05 |===================================================================== Neural Magic DeepSparse 1.5 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 2.1776 |================================================================== b . 2.2206 |=================================================================== c . 2.1914 |================================================================== Neural Magic DeepSparse 1.5 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 916.84 |=================================================================== b . 898.58 |================================================================== c . 911.93 |=================================================================== Neural Magic DeepSparse 1.5 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 2.2565 |=============================================================== b . 2.3908 |=================================================================== c . 2.3124 |================================================================= Neural Magic DeepSparse 1.5 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 443.16 |=================================================================== b . 418.26 |=============================================================== c . 432.45 |================================================================= Neural Magic DeepSparse 1.5 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 43.80 |================================================================ b . 46.74 |==================================================================== c . 42.43 |============================================================== Neural Magic DeepSparse 1.5 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 45.61 |================================================================== b . 42.76 |============================================================== c . 47.10 |==================================================================== Neural Magic DeepSparse 1.5 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 42.67 |==================================================================== b . 41.50 |================================================================== c . 41.91 |=================================================================== Neural Magic DeepSparse 1.5 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 23.43 |================================================================== b . 24.09 |==================================================================== c . 23.85 |=================================================================== Neural Magic DeepSparse 1.5 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 10.75 |============================================================== b . 11.75 |==================================================================== c . 10.78 |============================================================== Neural Magic DeepSparse 1.5 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 185.60 |=================================================================== b . 169.86 |============================================================= c . 185.39 |=================================================================== Neural Magic DeepSparse 1.5 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 10.81 |==================================================================== b . 10.84 |==================================================================== c . 10.83 |==================================================================== Neural Magic DeepSparse 1.5 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 92.52 |==================================================================== b . 92.26 |==================================================================== c . 92.30 |==================================================================== Neural Magic DeepSparse 1.5 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 15.26 |==================================================================== b . 13.72 |============================================================= c . 13.68 |============================================================= Neural Magic DeepSparse 1.5 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 130.95 |============================================================ b . 145.77 |=================================================================== c . 146.06 |=================================================================== Neural Magic DeepSparse 1.5 Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 12.48 |============================================================= b . 13.45 |================================================================= c . 13.97 |==================================================================== Neural Magic DeepSparse 1.5 Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 80.10 |==================================================================== b . 74.35 |=============================================================== c . 71.58 |============================================================= Neural Magic DeepSparse 1.5 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 38.58 |==================================================================== b . 34.93 |============================================================== c . 34.25 |============================================================ Neural Magic DeepSparse 1.5 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 51.81 |============================================================ b . 57.22 |=================================================================== c . 58.35 |==================================================================== Neural Magic DeepSparse 1.5 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 33.82 |=================================================================== b . 34.34 |==================================================================== c . 33.54 |================================================================== Neural Magic DeepSparse 1.5 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 29.56 |=================================================================== b . 29.11 |================================================================== c . 29.80 |==================================================================== Neural Magic DeepSparse 1.5 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 21.83 |=================================================================== b . 22.19 |==================================================================== c . 20.33 |============================================================== Neural Magic DeepSparse 1.5 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 91.54 |=============================================================== b . 90.03 |============================================================== c . 98.33 |==================================================================== Neural Magic DeepSparse 1.5 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 18.99 |=================================================================== b . 19.03 |=================================================================== c . 19.36 |==================================================================== Neural Magic DeepSparse 1.5 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 52.66 |==================================================================== b . 52.54 |==================================================================== c . 51.65 |=================================================================== Neural Magic DeepSparse 1.5 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 4.8773 |=================================================================== b . 4.3990 |============================================================ c . 4.4129 |============================================================= Neural Magic DeepSparse 1.5 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 410.01 |============================================================ b . 454.58 |=================================================================== c . 453.14 |=================================================================== Neural Magic DeepSparse 1.5 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 4.4560 |=================================================================== b . 4.4322 |=================================================================== c . 4.4223 |================================================================== Neural Magic DeepSparse 1.5 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 224.39 |================================================================== b . 225.60 |=================================================================== c . 226.10 |=================================================================== Neural Magic DeepSparse 1.5 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 9.9347 |=================================================================== b . 9.7376 |================================================================== c . 9.5038 |================================================================ Neural Magic DeepSparse 1.5 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 201.04 |================================================================ b . 205.22 |================================================================= c . 210.21 |=================================================================== Neural Magic DeepSparse 1.5 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 9.3858 |=================================================================== b . 8.8754 |=============================================================== c . 8.8455 |=============================================================== Neural Magic DeepSparse 1.5 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 106.54 |=============================================================== b . 112.66 |=================================================================== c . 113.04 |=================================================================== Neural Magic DeepSparse 1.5 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better a . 2.1780 |=================================================================== b . 2.1728 |=================================================================== c . 2.1694 |=================================================================== Neural Magic DeepSparse 1.5 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better a . 916.62 |=================================================================== b . 918.47 |=================================================================== c . 919.72 |=================================================================== Neural Magic DeepSparse 1.5 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better a . 2.1694 |=================================================================== b . 2.1708 |=================================================================== c . 2.1657 |=================================================================== Neural Magic DeepSparse 1.5 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better a . 460.95 |=================================================================== b . 460.65 |=================================================================== c . 461.74 |===================================================================