tigerlake ncnn

Intel Core i7-1165G7 testing with a Dell 0GG9PT (1.0.3 BIOS) and Intel UHD 3GB on Ubuntu 20.10 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2012186-HA-TIGERLAKE59.

tigerlake ncnnProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLVulkanCompilerFile-SystemScreen Resolution1234Intel Core i7-1165G7 @ 4.70GHz (4 Cores / 8 Threads)Dell 0GG9PT (1.0.3 BIOS)Intel Tiger Lake-LP16GBKioxia KBG40ZNS256G NVMe 256GBIntel UHD 3GB (1300MHz)Realtek ALC289Intel Wi-Fi 6 AX201Ubuntu 20.105.10.0-051000rc7daily20201213-generic (x86_64) 20201212GNOME Shell 3.38.1X Server 1.20.9modesetting 1.20.94.6 Mesa 20.2.11.2.145GCC 10.2.0ext41920x1200OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-JvwpWM/gcc-10-10.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-JvwpWM/gcc-10-10.2.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate powersave - CPU Microcode: 0x60 - Thermald 2.3Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

tigerlake ncnnncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: CPU - squeezenet_ssdncnn: CPU - regnety_400mncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - googlenetncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - yolov4-tinyncnn: Vulkan GPU - squeezenet_ssdncnn: Vulkan GPU - regnety_400m123430.406.826.659.157.0310.342.4322.3568.3221.0318.0049.0239.3032.8916.7330.236.586.399.017.7311.352.6423.5068.5421.0118.0048.9539.2233.0117.6630.086.596.408.876.8310.072.5823.8268.7321.1918.1749.2839.1632.9716.4630.286.796.438.836.8010.112.3822.3668.9521.2118.2049.3739.3133.1216.3730.026.646.408.866.8510.042.3821.2468.3521.1718.0449.0339.0832.7416.4130.036.666.418.876.8110.102.3722.1268.7421.2818.1249.3839.0733.0016.4930.826.706.448.896.8010.032.3822.0369.0221.2718.1549.3539.6233.1616.4930.156.596.428.836.7910.032.3722.0468.6021.2718.1149.2739.1233.0116.38OpenBenchmarking.org

NCNN

Target: CPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mobilenet1234714212835SE +/- 0.36, N = 4SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.35, N = 330.4030.0830.0230.82MIN: 28.11 / MAX: 91.92MIN: 29.58 / MAX: 43.23MIN: 29.67 / MAX: 42.99MIN: 29.68 / MAX: 43.381. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v2-v2 - Model: mobilenet-v21234246810SE +/- 0.46, N = 4SE +/- 0.57, N = 3SE +/- 0.60, N = 3SE +/- 0.60, N = 36.826.596.646.70MIN: 5.35 / MAX: 15.23MIN: 5.36 / MAX: 12.76MIN: 5.35 / MAX: 12.93MIN: 5.35 / MAX: 20.611. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU-v3-v3 - Model: mobilenet-v31234246810SE +/- 0.67, N = 4SE +/- 0.91, N = 3SE +/- 0.90, N = 3SE +/- 0.91, N = 36.656.406.406.44MIN: 4.55 / MAX: 14.51MIN: 4.54 / MAX: 12.09MIN: 4.54 / MAX: 11.23MIN: 4.58 / MAX: 13.321. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: shufflenet-v212343691215SE +/- 0.91, N = 4SE +/- 1.20, N = 3SE +/- 1.23, N = 3SE +/- 1.22, N = 39.158.878.868.89MIN: 6.37 / MAX: 21.38MIN: 6.4 / MAX: 14.97MIN: 6.34 / MAX: 17.92MIN: 6.37 / MAX: 25.431. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: mnasnet1234246810SE +/- 0.60, N = 4SE +/- 0.85, N = 3SE +/- 0.85, N = 3SE +/- 0.83, N = 37.036.836.856.80MIN: 5.07 / MAX: 14.06MIN: 5.08 / MAX: 19.65MIN: 5.07 / MAX: 20.78MIN: 5.09 / MAX: 8.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: efficientnet-b012343691215SE +/- 0.94, N = 4SE +/- 1.25, N = 3SE +/- 1.28, N = 3SE +/- 1.27, N = 310.3410.0710.0410.03MIN: 7.42 / MAX: 17.72MIN: 7.45 / MAX: 17.13MIN: 7.42 / MAX: 13.73MIN: 7.44 / MAX: 13.211. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: blazeface12340.58051.1611.74152.3222.9025SE +/- 0.19, N = 4SE +/- 0.05, N = 3SE +/- 0.27, N = 3SE +/- 0.25, N = 32.432.582.382.38MIN: 1.83 / MAX: 4.69MIN: 1.98 / MAX: 8.09MIN: 1.83 / MAX: 2.8MIN: 1.84 / MAX: 6.081. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: googlenet1234612182430SE +/- 1.00, N = 4SE +/- 0.33, N = 3SE +/- 2.23, N = 3SE +/- 1.46, N = 322.3523.8221.2422.03MIN: 14.76 / MAX: 38.22MIN: 21.27 / MAX: 38.57MIN: 14.74 / MAX: 36.92MIN: 14.73 / MAX: 37.591. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: vgg1612341530456075SE +/- 0.24, N = 4SE +/- 0.23, N = 3SE +/- 0.32, N = 3SE +/- 0.20, N = 368.3268.7368.3569.02MIN: 63.68 / MAX: 90.5MIN: 64.27 / MAX: 82.9MIN: 63.74 / MAX: 81.55MIN: 63.92 / MAX: 85.791. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet181234510152025SE +/- 0.10, N = 4SE +/- 0.15, N = 3SE +/- 0.14, N = 3SE +/- 0.19, N = 321.0321.1921.1721.27MIN: 18.4 / MAX: 27.66MIN: 18.46 / MAX: 28.37MIN: 18.38 / MAX: 35.72MIN: 18.41 / MAX: 35.461. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: alexnet123448121620SE +/- 0.05, N = 4SE +/- 0.12, N = 3SE +/- 0.06, N = 3SE +/- 0.10, N = 318.0018.1718.0418.15MIN: 16.03 / MAX: 30.98MIN: 16.03 / MAX: 32.33MIN: 15.98 / MAX: 30.89MIN: 16.07 / MAX: 29.671. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: resnet5012341122334455SE +/- 0.12, N = 4SE +/- 0.06, N = 3SE +/- 0.20, N = 3SE +/- 0.16, N = 349.0249.2849.0349.35MIN: 45.35 / MAX: 62.18MIN: 46.34 / MAX: 65.16MIN: 45.37 / MAX: 62.61MIN: 46.76 / MAX: 59.051. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: yolov4-tiny1234918273645SE +/- 0.32, N = 4SE +/- 0.03, N = 3SE +/- 0.05, N = 3SE +/- 0.21, N = 339.3039.1639.0839.62MIN: 37.57 / MAX: 50.85MIN: 37.71 / MAX: 50.95MIN: 37.75 / MAX: 50.24MIN: 37.77 / MAX: 50.91. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: squeezenet_ssd1234816243240SE +/- 0.15, N = 4SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 332.8932.9732.7433.16MIN: 32.16 / MAX: 46.07MIN: 32.08 / MAX: 45.76MIN: 32.1 / MAX: 39.45MIN: 32.16 / MAX: 45.381. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: CPU - Model: regnety_400m123448121620SE +/- 0.92, N = 4SE +/- 1.23, N = 3SE +/- 1.28, N = 3SE +/- 1.26, N = 316.7316.4616.4116.49MIN: 13.74 / MAX: 26.09MIN: 13.73 / MAX: 23.5MIN: 13.7 / MAX: 19.59MIN: 13.73 / MAX: 23.931. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mobilenet1234714212835SE +/- 0.22, N = 3SE +/- 0.19, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 330.2330.2830.0330.15MIN: 28.87 / MAX: 39.97MIN: 29.65 / MAX: 43.55MIN: 29.63 / MAX: 43.15MIN: 29.62 / MAX: 42.811. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v2-v2 - Model: mobilenet-v21234246810SE +/- 0.52, N = 3SE +/- 0.65, N = 3SE +/- 0.57, N = 3SE +/- 0.55, N = 36.586.796.666.59MIN: 5.36 / MAX: 14.93MIN: 5.37 / MAX: 12.66MIN: 5.37 / MAX: 12.77MIN: 5.36 / MAX: 12.561. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU-v3-v3 - Model: mobilenet-v31234246810SE +/- 0.90, N = 3SE +/- 0.87, N = 3SE +/- 0.89, N = 3SE +/- 0.89, N = 36.396.436.416.42MIN: 4.54 / MAX: 11.19MIN: 4.57 / MAX: 11.03MIN: 4.55 / MAX: 11.21MIN: 4.57 / MAX: 11.261. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: shufflenet-v212343691215SE +/- 1.03, N = 3SE +/- 1.17, N = 3SE +/- 1.19, N = 3SE +/- 1.21, N = 39.018.838.878.83MIN: 6.36 / MAX: 16.12MIN: 6.38 / MAX: 13.74MIN: 6.38 / MAX: 16.18MIN: 6.35 / MAX: 13.661. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: mnasnet1234246810SE +/- 0.08, N = 3SE +/- 0.81, N = 3SE +/- 0.83, N = 3SE +/- 0.82, N = 37.736.806.816.79MIN: 7.34 / MAX: 20.41MIN: 5.09 / MAX: 9.99MIN: 5.07 / MAX: 10.05MIN: 5.07 / MAX: 9.791. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: efficientnet-b012343691215SE +/- 0.05, N = 3SE +/- 1.29, N = 3SE +/- 1.30, N = 3SE +/- 1.26, N = 311.3510.1110.1010.03MIN: 10.87 / MAX: 17.57MIN: 7.45 / MAX: 13.74MIN: 7.46 / MAX: 17.57MIN: 7.45 / MAX: 25.21. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: blazeface12340.5941.1881.7822.3762.97SE +/- 0.02, N = 3SE +/- 0.26, N = 3SE +/- 0.25, N = 3SE +/- 0.27, N = 32.642.382.372.37MIN: 2.48 / MAX: 8.71MIN: 1.84 / MAX: 4.81MIN: 1.84 / MAX: 2.77MIN: 1.82 / MAX: 4.61. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: googlenet1234612182430SE +/- 0.14, N = 3SE +/- 1.32, N = 3SE +/- 1.28, N = 3SE +/- 1.40, N = 323.5022.3622.1222.04MIN: 21.26 / MAX: 36.15MIN: 14.76 / MAX: 37.73MIN: 14.75 / MAX: 28.73MIN: 14.77 / MAX: 31.91. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: vgg1612341530456075SE +/- 0.19, N = 3SE +/- 0.37, N = 3SE +/- 0.39, N = 3SE +/- 0.40, N = 368.5468.9568.7468.60MIN: 63.96 / MAX: 82.97MIN: 63.87 / MAX: 84.6MIN: 63.96 / MAX: 82.53MIN: 63.79 / MAX: 85.041. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet181234510152025SE +/- 0.04, N = 3SE +/- 0.23, N = 3SE +/- 0.26, N = 3SE +/- 0.23, N = 321.0121.2121.2821.27MIN: 18.41 / MAX: 33.62MIN: 18.37 / MAX: 28.23MIN: 18.42 / MAX: 33.68MIN: 18.36 / MAX: 35.331. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: alexnet123448121620SE +/- 0.07, N = 3SE +/- 0.13, N = 3SE +/- 0.11, N = 3SE +/- 0.13, N = 318.0018.2018.1218.11MIN: 16.01 / MAX: 23.62MIN: 16.01 / MAX: 24.53MIN: 16.02 / MAX: 30.54MIN: 16.02 / MAX: 23.551. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: resnet5012341122334455SE +/- 0.01, N = 3SE +/- 0.18, N = 3SE +/- 0.11, N = 3SE +/- 0.15, N = 348.9549.3749.3849.27MIN: 46.42 / MAX: 58.97MIN: 45.9 / MAX: 63.19MIN: 46.54 / MAX: 63.38MIN: 46.92 / MAX: 63.071. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: yolov4-tiny1234918273645SE +/- 0.20, N = 3SE +/- 0.20, N = 3SE +/- 0.02, N = 3SE +/- 0.08, N = 339.2239.3139.0739.12MIN: 37.72 / MAX: 51.81MIN: 37.8 / MAX: 51.31MIN: 37.69 / MAX: 52.09MIN: 37.73 / MAX: 50.751. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: squeezenet_ssd1234816243240SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.11, N = 3SE +/- 0.06, N = 333.0133.1233.0033.01MIN: 32.18 / MAX: 45.46MIN: 32.15 / MAX: 45.6MIN: 32.16 / MAX: 45.66MIN: 32.05 / MAX: 46.041. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20201218Target: Vulkan GPU - Model: regnety_400m123448121620SE +/- 0.10, N = 3SE +/- 1.26, N = 3SE +/- 1.31, N = 3SE +/- 1.28, N = 317.6616.3716.4916.38MIN: 17.3 / MAX: 23.73MIN: 13.72 / MAX: 20.92MIN: 13.75 / MAX: 29.67MIN: 13.71 / MAX: 23.771. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Phoronix Test Suite v10.8.4