icelake nn Intel Core i7-1065G7 testing with a Dell 06CDVY (1.0.9 BIOS) and Intel Iris Plus ICL GT2 3GB on Ubuntu 21.04 via the Phoronix Test Suite. 1: Processor: Intel Core i7-1065G7 @ 3.90GHz (4 Cores / 8 Threads), Motherboard: Dell 06CDVY (1.0.9 BIOS), Chipset: Intel Ice Lake-LP DRAM, Memory: 16GB, Disk: Toshiba KBG40ZPZ512G NVMe 512GB, Graphics: Intel Iris Plus ICL GT2 3GB (1100MHz), Audio: Realtek ALC289, Network: Intel Killer Wi-Fi 6 AX1650i 160MHz OS: Ubuntu 21.04, Kernel: 5.11.0-17-generic (x86_64), Desktop: GNOME Shell 3.38.4, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 21.0.1, Vulkan: 1.2.145, Compiler: GCC 10.3.0, File-System: ext4, Screen Resolution: 1920x1200 2: Processor: Intel Core i7-1065G7 @ 3.90GHz (4 Cores / 8 Threads), Motherboard: Dell 06CDVY (1.0.9 BIOS), Chipset: Intel Ice Lake-LP DRAM, Memory: 16GB, Disk: Toshiba KBG40ZPZ512G NVMe 512GB, Graphics: Intel Iris Plus ICL GT2 3GB (1100MHz), Audio: Realtek ALC289, Network: Intel Killer Wi-Fi 6 AX1650i 160MHz OS: Ubuntu 21.04, Kernel: 5.11.0-17-generic (x86_64), Desktop: GNOME Shell 3.38.4, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 21.0.1, Vulkan: 1.2.145, Compiler: GCC 10.3.0, File-System: ext4, Screen Resolution: 1920x1200 3: Processor: Intel Core i7-1065G7 @ 3.90GHz (4 Cores / 8 Threads), Motherboard: Dell 06CDVY (1.0.9 BIOS), Chipset: Intel Ice Lake-LP DRAM, Memory: 16GB, Disk: Toshiba KBG40ZPZ512G NVMe 512GB, Graphics: Intel Iris Plus ICL GT2 3GB (1100MHz), Audio: Realtek ALC289, Network: Intel Killer Wi-Fi 6 AX1650i 160MHz OS: Ubuntu 21.04, Kernel: 5.11.0-17-generic (x86_64), Desktop: GNOME Shell 3.38.4, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 21.0.1, Vulkan: 1.2.145, Compiler: GCC 10.3.0, File-System: ext4, Screen Resolution: 1920x1200 4: Processor: Intel Core i7-1065G7 @ 3.90GHz (4 Cores / 8 Threads), Motherboard: Dell 06CDVY (1.0.9 BIOS), Chipset: Intel Ice Lake-LP DRAM, Memory: 16GB, Disk: Toshiba KBG40ZPZ512G NVMe 512GB, Graphics: Intel Iris Plus ICL GT2 3GB (1100MHz), Audio: Realtek ALC289, Network: Intel Killer Wi-Fi 6 AX1650i 160MHz OS: Ubuntu 21.04, Kernel: 5.11.0-17-generic (x86_64), Desktop: GNOME Shell 3.38.4, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 21.0.1, Vulkan: 1.2.145, Compiler: GCC 10.3.0, File-System: ext4, Screen Resolution: 1920x1200 Mobile Neural Network 1.2 Model: mobilenetV3 ms < Lower Is Better 1 . 3.157 |==================================================================== 2 . 3.133 |=================================================================== 3 . 3.119 |=================================================================== 4 . 3.152 |==================================================================== Mobile Neural Network 1.2 Model: squeezenetv1.1 ms < Lower Is Better 1 . 6.056 |================================================================= 2 . 6.383 |==================================================================== 3 . 5.971 |================================================================ 4 . 6.330 |=================================================================== Mobile Neural Network 1.2 Model: resnet-v2-50 ms < Lower Is Better 1 . 46.48 |============================================================= 2 . 51.51 |==================================================================== 3 . 46.70 |============================================================== 4 . 50.86 |=================================================================== Mobile Neural Network 1.2 Model: SqueezeNetV1.0 ms < Lower Is Better 1 . 9.963 |=================================================================== 2 . 9.972 |=================================================================== 3 . 9.969 |=================================================================== 4 . 10.018 |=================================================================== Mobile Neural Network 1.2 Model: MobileNetV2_224 ms < Lower Is Better 1 . 6.059 |=================================================================== 2 . 6.093 |=================================================================== 3 . 6.054 |=================================================================== 4 . 6.152 |==================================================================== Mobile Neural Network 1.2 Model: mobilenet-v1-1.0 ms < Lower Is Better 1 . 5.548 |=============================================================== 2 . 5.924 |=================================================================== 3 . 5.532 |============================================================== 4 . 6.029 |==================================================================== Mobile Neural Network 1.2 Model: inception-v3 ms < Lower Is Better 1 . 64.97 |=============================================================== 2 . 69.71 |==================================================================== 3 . 66.19 |================================================================ 4 . 70.10 |==================================================================== NCNN 20210525 Target: CPU - Model: mobilenet ms < Lower Is Better 1 . 29.32 |================================================================= 2 . 30.50 |==================================================================== 3 . 29.77 |================================================================== 4 . 29.40 |================================================================== NCNN 20210525 Target: CPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better 1 . 6.09 |============================================================== 2 . 6.83 |===================================================================== 3 . 6.32 |================================================================ 4 . 6.20 |=============================================================== NCNN 20210525 Target: CPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better 1 . 6.34 |================================================================ 2 . 6.84 |===================================================================== 3 . 6.31 |================================================================ 4 . 6.49 |================================================================= NCNN 20210525 Target: CPU - Model: shufflenet-v2 ms < Lower Is Better 1 . 6.21 |================================================================ 2 . 6.68 |===================================================================== 3 . 6.06 |=============================================================== 4 . 6.10 |=============================================================== NCNN 20210525 Target: CPU - Model: mnasnet ms < Lower Is Better 1 . 7.57 |===================================================================== 2 . 7.50 |==================================================================== 3 . 7.00 |================================================================ 4 . 6.81 |============================================================== NCNN 20210525 Target: CPU - Model: efficientnet-b0 ms < Lower Is Better 1 . 12.06 |==================================================================== 2 . 11.74 |================================================================== 3 . 10.87 |============================================================= 4 . 10.85 |============================================================= NCNN 20210525 Target: CPU - Model: blazeface ms < Lower Is Better 1 . 2.72 |==================================================================== 2 . 2.78 |===================================================================== 3 . 2.50 |============================================================== 4 . 2.52 |=============================================================== NCNN 20210525 Target: CPU - Model: googlenet ms < Lower Is Better 1 . 26.41 |=================================================================== 2 . 26.85 |==================================================================== 3 . 24.30 |============================================================== 4 . 24.28 |============================================================= NCNN 20210525 Target: CPU - Model: vgg16 ms < Lower Is Better 1 . 124.96 |=================================================================== 2 . 80.00 |=========================================== 3 . 78.28 |========================================== 4 . 77.26 |========================================= NCNN 20210525 Target: CPU - Model: resnet18 ms < Lower Is Better 1 . 24.47 |================================================================== 2 . 25.10 |==================================================================== 3 . 25.28 |==================================================================== 4 . 24.93 |=================================================================== NCNN 20210525 Target: CPU - Model: alexnet ms < Lower Is Better 1 . 39.27 |==================================================================== 2 . 22.14 |====================================== 3 . 21.81 |====================================== 4 . 22.17 |====================================== NCNN 20210525 Target: CPU - Model: resnet50 ms < Lower Is Better 1 . 106.47 |=================================================================== 2 . 49.74 |=============================== 3 . 48.22 |============================== 4 . 47.94 |============================== NCNN 20210525 Target: CPU - Model: yolov4-tiny ms < Lower Is Better 1 . 42.43 |================================================================= 2 . 44.55 |==================================================================== 3 . 43.91 |=================================================================== 4 . 42.87 |================================================================= NCNN 20210525 Target: CPU - Model: squeezenet_ssd ms < Lower Is Better 1 . 87.99 |==================================================================== 2 . 40.07 |=============================== 3 . 39.42 |============================== 4 . 38.70 |============================== NCNN 20210525 Target: CPU - Model: regnety_400m ms < Lower Is Better 1 . 14.95 |================================================================== 2 . 15.33 |==================================================================== 3 . 14.36 |================================================================ 4 . 14.11 |=============================================================== TNN 0.3 Target: CPU - Model: DenseNet ms < Lower Is Better 1 . 5483.67 |================================================================== 2 . 5345.17 |================================================================ 3 . 5321.94 |================================================================ 4 . 5293.76 |================================================================ TNN 0.3 Target: CPU - Model: MobileNet v2 ms < Lower Is Better 1 . 373.71 |=================================================================== 2 . 364.75 |================================================================= 3 . 364.37 |================================================================= 4 . 365.41 |================================================================== TNN 0.3 Target: CPU - Model: SqueezeNet v2 ms < Lower Is Better 1 . 69.49 |==================================================================== 2 . 69.42 |==================================================================== 3 . 69.81 |==================================================================== 4 . 69.77 |==================================================================== TNN 0.3 Target: CPU - Model: SqueezeNet v1.1 ms < Lower Is Better 1 . 334.36 |=================================================================== 2 . 336.38 |=================================================================== 3 . 334.07 |================================================================== 4 . 336.86 |===================================================================