NCNN Laptop

Intel Core i7-8565U testing with a Dell 0KTW76 (1.0.0 BIOS) and Intel UHD 620 3GB on Ubuntu 20.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2009248-PTS-NCNNLAPT77.

NCNN LaptopProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLOpenCLVulkanCompilerFile-SystemScreen ResolutionIntel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW7623Intel Core i7-8565U @ 4.60GHz (4 Cores / 8 Threads)Dell 0KTW76 (1.0.0 BIOS)Intel Cannon Point-LP16GBPC401 NVMe SK hynix 256GBIntel UHD 620 3GB (1150MHz)Realtek ALC3271Qualcomm Atheros QCA6174 802.11acUbuntu 20.045.4.0-47-generic (x86_64)GNOME Shell 3.36.4X Server 1.20.8modesetting 1.20.84.6 Mesa 20.0.4OpenCL 2.11.2.131GCC 9.3.0ext41920x1080OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate powersave - CPU Microcode: 0xd6Security Details- itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Mitigation of Microcode + tsx_async_abort: Not affected

NCNN Laptopncnn: CPU - squeezenetncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: Vulkan GPU - squeezenetncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - googlenetncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - yolov4-tinyIntel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW762363.7741.8310.939.166.819.7715.102.8587.18318.7154.9829.77181.2454.7948.32110.2140.3944.1327.2241.8779.417.2964.71310.2940.04107.31169.25153.3159.9639.6410.368.716.429.2614.402.7182.77300.2151.9929.75171.6552.3444.75109.6640.3744.1127.2541.8780.527.3257.64290.7037.44110.40158.89152.5260.3539.8910.458.696.489.2414.452.8682.87300.9051.9829.96172.0252.5344.70109.9439.7344.1027.2340.9880.607.2657.32293.3936.91111.14158.85152.39OpenBenchmarking.org

NCNN

Target: CPU - Model: squeezenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: squeezenetIntel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW76231428425670SE +/- 0.10, N = 3SE +/- 0.18, N = 3SE +/- 0.04, N = 363.7759.9660.35MIN: 62.25 / MAX: 84.24MIN: 57.25 / MAX: 74.47MIN: 57.85 / MAX: 911. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mobilenetIntel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW76231020304050SE +/- 0.18, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 341.8339.6439.89MIN: 39.85 / MAX: 59.73MIN: 38.52 / MAX: 57.96MIN: 38.75 / MAX: 55.851. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v2-v2 - Model: mobilenet-v2Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW76233691215SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.05, N = 310.9310.3610.45MIN: 10.24 / MAX: 29.62MIN: 9.78 / MAX: 14.78MIN: 9.78 / MAX: 15.311. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v3-v3 - Model: mobilenet-v3Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW76233691215SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.02, N = 39.168.718.69MIN: 8.72 / MAX: 14.29MIN: 8.44 / MAX: 26.86MIN: 8.48 / MAX: 13.341. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: shufflenet-v2Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW7623246810SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 36.816.426.48MIN: 6.6 / MAX: 11.84MIN: 6.35 / MAX: 11.01MIN: 6.37 / MAX: 11.141. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mnasnetIntel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW76233691215SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 39.779.269.24MIN: 9.15 / MAX: 20.81MIN: 8.87 / MAX: 21.51MIN: 8.87 / MAX: 14.111. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: efficientnet-b0Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW762348121620SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 315.1014.4014.45MIN: 14.59 / MAX: 31.7MIN: 13.87 / MAX: 32.98MIN: 13.88 / MAX: 19.621. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: blazefaceIntel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW76230.64351.2871.93052.5743.2175SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 32.852.712.86MIN: 2.57 / MAX: 7.33MIN: 2.53 / MAX: 6.03MIN: 2.55 / MAX: 20.451. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: googlenetIntel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW762320406080100SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.09, N = 387.1882.7782.87MIN: 83.44 / MAX: 105.08MIN: 79.66 / MAX: 101.28MIN: 79.91 / MAX: 100.781. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: vgg16Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW762370140210280350SE +/- 0.85, N = 3SE +/- 0.26, N = 3SE +/- 0.53, N = 3318.71300.21300.90MIN: 250.09 / MAX: 417.94MIN: 214.03 / MAX: 328.86MIN: 214.06 / MAX: 327.471. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet18Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW76231224364860SE +/- 0.21, N = 3SE +/- 0.12, N = 3SE +/- 0.09, N = 354.9851.9951.98MIN: 52.75 / MAX: 102.39MIN: 50.43 / MAX: 72.64MIN: 50.67 / MAX: 68.991. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: alexnetIntel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW7623714212835SE +/- 0.13, N = 3SE +/- 0.19, N = 3SE +/- 0.05, N = 329.7729.7529.96MIN: 27.99 / MAX: 39.96MIN: 27.51 / MAX: 44.47MIN: 25.69 / MAX: 52.11. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet50Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW76234080120160200SE +/- 0.37, N = 3SE +/- 0.06, N = 3SE +/- 0.10, N = 3181.24171.65172.02MIN: 174.72 / MAX: 203.17MIN: 167.34 / MAX: 191.12MIN: 168.04 / MAX: 198.491. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: yolov4-tinyIntel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW76231224364860SE +/- 0.25, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 354.7952.3452.53MIN: 53.4 / MAX: 72.1MIN: 50.61 / MAX: 58.42MIN: 50.99 / MAX: 70.351. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: squeezenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: squeezenetIntel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW76231122334455SE +/- 0.07, N = 3SE +/- 0.12, N = 3SE +/- 0.23, N = 348.3244.7544.70MIN: 38.42 / MAX: 70.08MIN: 38.86 / MAX: 75.98MIN: 38.73 / MAX: 72.881. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: mobilenetIntel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW762320406080100SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.19, N = 3110.21109.66109.94MIN: 104.36 / MAX: 166.37MIN: 92.15 / MAX: 122.04MIN: 89.84 / MAX: 141.111. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW7623918273645SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.65, N = 340.3940.3739.73MIN: 37.9 / MAX: 41.91MIN: 38.25 / MAX: 41.29MIN: 11.8 / MAX: 41.171. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW76231020304050SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 344.1344.1144.10MIN: 37.05 / MAX: 45.32MIN: 41.5 / MAX: 44.94MIN: 41.73 / MAX: 44.971. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: shufflenet-v2Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW7623612182430SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 327.2227.2527.23MIN: 25.28 / MAX: 28.14MIN: 24.48 / MAX: 28.55MIN: 25.24 / MAX: 27.651. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: mnasnetIntel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW76231020304050SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.91, N = 341.8741.8740.98MIN: 39.48 / MAX: 42.65MIN: 35.34 / MAX: 42.7MIN: 12.2 / MAX: 42.871. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: efficientnet-b0Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW762320406080100SE +/- 1.16, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 379.4180.5280.60MIN: 25.07 / MAX: 82.28MIN: 37.32 / MAX: 82.28MIN: 74.2 / MAX: 82.111. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: blazefaceIntel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW7623246810SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 37.297.327.26MIN: 6.94 / MAX: 7.9MIN: 7 / MAX: 14.92MIN: 6.93 / MAX: 16.131. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: googlenetIntel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW76231428425670SE +/- 1.77, N = 3SE +/- 0.26, N = 3SE +/- 0.22, N = 364.7157.6457.32MIN: 53.65 / MAX: 702.89MIN: 53.44 / MAX: 88.21MIN: 53.4 / MAX: 87.151. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: vgg16Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW762370140210280350SE +/- 1.14, N = 3SE +/- 1.00, N = 3SE +/- 0.49, N = 3310.29290.70293.39MIN: 209.24 / MAX: 335.01MIN: 206.96 / MAX: 321.26MIN: 208.62 / MAX: 351.91. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: resnet18Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW7623918273645SE +/- 0.28, N = 3SE +/- 0.22, N = 3SE +/- 0.18, N = 340.0437.4436.91MIN: 31.42 / MAX: 73.09MIN: 31.04 / MAX: 57.83MIN: 31.01 / MAX: 77.771. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: alexnetIntel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW762320406080100SE +/- 2.00, N = 3SE +/- 0.35, N = 3SE +/- 0.49, N = 3107.31110.40111.14MIN: 47.26 / MAX: 125.65MIN: 69.1 / MAX: 127.26MIN: 72.5 / MAX: 117.71. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: resnet50Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW76234080120160200SE +/- 0.40, N = 3SE +/- 0.17, N = 3SE +/- 0.14, N = 3169.25158.89158.85MIN: 108.48 / MAX: 255.78MIN: 107.75 / MAX: 189.15MIN: 108.05 / MAX: 188.721. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: yolov4-tinyIntel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW7623306090120150SE +/- 0.50, N = 3SE +/- 0.30, N = 3SE +/- 0.04, N = 3153.31152.52152.39MIN: 118.91 / MAX: 173.01MIN: 89.11 / MAX: 194.2MIN: 96.27 / MAX: 176.121. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Phoronix Test Suite v10.8.4