NCNN Devel Laptop Intel Core i7-9750H testing with a Notebook P95_96_97Ex Rx (1.07.13MIN29 BIOS) and Intel UHD 630 3GB on Ubuntu 20.04 via the Phoronix Test Suite. 1: Processor: Intel Core i7-9750H @ 4.50GHz (6 Cores / 12 Threads), Motherboard: Notebook P95_96_97Ex Rx (1.07.13MIN29 BIOS), Chipset: Intel Cannon Lake PCH, Memory: 32GB, Disk: 1000GB Samsung SSD 970 EVO Plus 1TB, Graphics: Intel UHD 630 3GB (1150MHz), Audio: Realtek ALC1220, Network: Realtek RTL8111/8168/8411 + Intel-AC 9560 OS: Ubuntu 20.04, Kernel: 5.7.0-999-generic (x86_64) 20200530, Desktop: GNOME Shell 3.36.4, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, OpenGL: 4.6 Mesa 20.0.4, Vulkan: 1.2.131, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 2: Processor: Intel Core i7-9750H @ 4.50GHz (6 Cores / 12 Threads), Motherboard: Notebook P95_96_97Ex Rx (1.07.13MIN29 BIOS), Chipset: Intel Cannon Lake PCH, Memory: 32GB, Disk: 1000GB Samsung SSD 970 EVO Plus 1TB, Graphics: Intel UHD 630 3GB (1150MHz), Audio: Realtek ALC1220, Network: Realtek RTL8111/8168/8411 + Intel-AC 9560 OS: Ubuntu 20.04, Kernel: 5.7.0-999-generic (x86_64) 20200530, Desktop: GNOME Shell 3.36.4, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, OpenGL: 4.6 Mesa 20.0.4, Vulkan: 1.2.131, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 3: Processor: Intel Core i7-9750H @ 4.50GHz (6 Cores / 12 Threads), Motherboard: Notebook P95_96_97Ex Rx (1.07.13MIN29 BIOS), Chipset: Intel Cannon Lake PCH, Memory: 32GB, Disk: 1000GB Samsung SSD 970 EVO Plus 1TB, Graphics: Intel UHD 630 3GB (1150MHz), Audio: Realtek ALC1220, Network: Realtek RTL8111/8168/8411 + Intel-AC 9560 OS: Ubuntu 20.04, Kernel: 5.7.0-999-generic (x86_64) 20200530, Desktop: GNOME Shell 3.36.4, Display Server: X Server 1.20.8, Display Driver: modesetting 1.20.8, OpenGL: 4.6 Mesa 20.0.4, Vulkan: 1.2.131, Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080 PostgreSQL pgbench 13.0 Scaling Factor: 1 - Clients: 1 - Mode: Read Only TPS > Higher Is Better 1 . 27704 |=================================================================== 2 . 27895 |==================================================================== 3 . 28100 |==================================================================== PostgreSQL pgbench 13.0 Scaling Factor: 1 - Clients: 1 - Mode: Read Only - Average Latency ms < Lower Is Better 1 . 0.036 |==================================================================== 2 . 0.036 |==================================================================== 3 . 0.036 |==================================================================== PostgreSQL pgbench 13.0 Scaling Factor: 1 - Clients: 1 - Mode: Read Write TPS > Higher Is Better 1 . 304 |====================================================================== 2 . 300 |===================================================================== 3 . 302 |====================================================================== PostgreSQL pgbench 13.0 Scaling Factor: 1 - Clients: 1 - Mode: Read Write - Average Latency ms < Lower Is Better 1 . 3.295 |=================================================================== 2 . 3.332 |==================================================================== 3 . 3.315 |==================================================================== PostgreSQL pgbench 13.0 Scaling Factor: 100 - Clients: 1 - Mode: Read Only TPS > Higher Is Better 1 . 24577 |==================================================================== 2 . 24530 |==================================================================== 3 . 24462 |==================================================================== PostgreSQL pgbench 13.0 Scaling Factor: 100 - Clients: 1 - Mode: Read Only - Average Latency ms < Lower Is Better 1 . 0.041 |==================================================================== 2 . 0.041 |==================================================================== 3 . 0.041 |==================================================================== PostgreSQL pgbench 13.0 Scaling Factor: 100 - Clients: 1 - Mode: Read Write TPS > Higher Is Better 1 . 281 |===================================================================== 2 . 269 |================================================================== 3 . 284 |====================================================================== PostgreSQL pgbench 13.0 Scaling Factor: 100 - Clients: 1 - Mode: Read Write - Average Latency ms < Lower Is Better 1 . 3.557 |================================================================= 2 . 3.720 |==================================================================== 3 . 3.524 |================================================================ PostgreSQL pgbench 13.0 Scaling Factor: 1000 - Clients: 1 - Mode: Read Only TPS > Higher Is Better 1 . 23648 |==================================================================== 2 . 23471 |=================================================================== 3 . 23770 |==================================================================== PostgreSQL pgbench 13.0 Scaling Factor: 1000 - Clients: 1 - Mode: Read Only - Average Latency ms < Lower Is Better 1 . 0.042 |================================================================== 2 . 0.043 |==================================================================== 3 . 0.042 |================================================================== PostgreSQL pgbench 13.0 Scaling Factor: 1000 - Clients: 1 - Mode: Read Write TPS > Higher Is Better 1 . 271 |===================================================================== 2 . 274 |===================================================================== 3 . 276 |====================================================================== PostgreSQL pgbench 13.0 Scaling Factor: 1000 - Clients: 1 - Mode: Read Write - Average Latency ms < Lower Is Better 1 . 3.688 |==================================================================== 2 . 3.651 |=================================================================== 3 . 3.622 |=================================================================== NCNN 20200916 Target: CPU - Model: squeezenet ms < Lower Is Better 1 . 38.10 |=================================================================== 2 . 38.08 |=================================================================== 3 . 38.63 |==================================================================== NCNN 20200916 Target: CPU - Model: mobilenet ms < Lower Is Better 1 . 23.30 |==================================================================== 2 . 23.36 |==================================================================== 3 . 23.43 |==================================================================== NCNN 20200916 Target: CPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better 1 . 6.29 |===================================================================== 2 . 6.33 |===================================================================== 3 . 6.33 |===================================================================== NCNN 20200916 Target: CPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better 1 . 5.23 |===================================================================== 2 . 5.25 |===================================================================== 3 . 5.24 |===================================================================== NCNN 20200916 Target: CPU - Model: shufflenet-v2 ms < Lower Is Better 1 . 4.04 |==================================================================== 2 . 4.09 |===================================================================== 3 . 4.10 |===================================================================== NCNN 20200916 Target: CPU - Model: mnasnet ms < Lower Is Better 1 . 21.65 |==================================================================== 2 . 5.22 |================ 3 . 5.26 |================= NCNN 20200916 Target: CPU - Model: efficientnet-b0 ms < Lower Is Better 1 . 8.38 |===================================================================== 2 . 8.33 |===================================================================== 3 . 8.35 |===================================================================== NCNN 20200916 Target: CPU - Model: blazeface ms < Lower Is Better 1 . 1.74 |===================================================================== 2 . 1.74 |===================================================================== 3 . 1.75 |===================================================================== NCNN 20200916 Target: CPU - Model: googlenet ms < Lower Is Better 1 . 101.28 |=================================================================== 2 . 51.83 |================================== 3 . 51.72 |================================== NCNN 20200916 Target: CPU - Model: vgg16 ms < Lower Is Better 1 . 169.55 |=================================================================== 2 . 169.81 |=================================================================== 3 . 170.66 |=================================================================== NCNN 20200916 Target: CPU - Model: resnet18 ms < Lower Is Better 1 . 29.83 |==================================================================== 2 . 29.88 |==================================================================== 3 . 29.84 |==================================================================== NCNN 20200916 Target: CPU - Model: alexnet ms < Lower Is Better 1 . 17.33 |=================================================================== 2 . 17.36 |==================================================================== 3 . 17.46 |==================================================================== NCNN 20200916 Target: CPU - Model: resnet50 ms < Lower Is Better 1 . 101.29 |================================================================== 2 . 101.69 |================================================================== 3 . 102.69 |=================================================================== NCNN 20200916 Target: CPU - Model: yolov4-tiny ms < Lower Is Better 1 . 33.91 |=================================================================== 2 . 34.00 |==================================================================== 3 . 34.22 |==================================================================== NCNN 20200916 Target: Vulkan GPU - Model: squeezenet ms < Lower Is Better 1 . 38.26 |=================================================================== 2 . 38.36 |=================================================================== 3 . 38.81 |==================================================================== NCNN 20200916 Target: Vulkan GPU - Model: mobilenet ms < Lower Is Better 1 . 42.77 |==================================================================== 2 . 42.86 |==================================================================== 3 . 42.69 |==================================================================== NCNN 20200916 Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better 1 . 13.94 |==================================================================== 2 . 13.96 |==================================================================== 3 . 13.93 |==================================================================== NCNN 20200916 Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better 1 . 15.41 |==================================================================== 2 . 15.44 |==================================================================== 3 . 15.42 |==================================================================== NCNN 20200916 Target: Vulkan GPU - Model: shufflenet-v2 ms < Lower Is Better 1 . 10.90 |=================================================================== 2 . 11.00 |==================================================================== 3 . 10.96 |==================================================================== NCNN 20200916 Target: Vulkan GPU - Model: mnasnet ms < Lower Is Better 1 . 14.43 |==================================================================== 2 . 14.45 |==================================================================== 3 . 14.43 |==================================================================== NCNN 20200916 Target: Vulkan GPU - Model: efficientnet-b0 ms < Lower Is Better 1 . 29.26 |==================================================================== 2 . 29.28 |==================================================================== 3 . 29.26 |==================================================================== NCNN 20200916 Target: Vulkan GPU - Model: blazeface ms < Lower Is Better 1 . 5.92 |===================================================================== 2 . 5.96 |===================================================================== 3 . 5.93 |===================================================================== NCNN 20200916 Target: Vulkan GPU - Model: googlenet ms < Lower Is Better 1 . 50.70 |================================================================== 2 . 50.00 |================================================================= 3 . 52.18 |==================================================================== NCNN 20200916 Target: Vulkan GPU - Model: vgg16 ms < Lower Is Better 1 . 169.27 |=================================================================== 2 . 167.48 |================================================================== 3 . 169.57 |=================================================================== NCNN 20200916 Target: Vulkan GPU - Model: resnet18 ms < Lower Is Better 1 . 29.46 |================================================================ 2 . 28.49 |============================================================== 3 . 31.27 |==================================================================== NCNN 20200916 Target: Vulkan GPU - Model: alexnet ms < Lower Is Better 1 . 57.68 |==================================================================== 2 . 57.92 |==================================================================== 3 . 57.69 |==================================================================== NCNN 20200916 Target: Vulkan GPU - Model: resnet50 ms < Lower Is Better 1 . 103.05 |=================================================================== 2 . 103.44 |=================================================================== 3 . 103.69 |=================================================================== NCNN 20200916 Target: Vulkan GPU - Model: yolov4-tiny ms < Lower Is Better 1 . 83.31 |==================================================================== 2 . 83.27 |==================================================================== 3 . 83.41 |====================================================================