NCNN Laptop

Intel Core i7-8565U testing with a Dell 0KTW76 (1.0.0 BIOS) and Intel UHD 620 3GB on Ubuntu 20.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2009248-PTS-NCNNLAPT77&sor.

NCNN LaptopProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLOpenCLVulkanCompilerFile-SystemScreen ResolutionIntel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW7623Intel Core i7-8565U @ 4.60GHz (4 Cores / 8 Threads)Dell 0KTW76 (1.0.0 BIOS)Intel Cannon Point-LP16GBPC401 NVMe SK hynix 256GBIntel UHD 620 3GB (1150MHz)Realtek ALC3271Qualcomm Atheros QCA6174 802.11acUbuntu 20.045.4.0-47-generic (x86_64)GNOME Shell 3.36.4X Server 1.20.8modesetting 1.20.84.6 Mesa 20.0.4OpenCL 2.11.2.131GCC 9.3.0ext41920x1080OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate powersave - CPU Microcode: 0xd6Security Details- itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full generic retpoline IBPB: conditional IBRS_FW STIBP: conditional RSB filling + srbds: Mitigation of Microcode + tsx_async_abort: Not affected

NCNN Laptopncnn: CPU - squeezenetncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPU - yolov4-tinyncnn: Vulkan GPU - squeezenetncnn: Vulkan GPU - mobilenetncnn: Vulkan GPU-v2-v2 - mobilenet-v2ncnn: Vulkan GPU-v3-v3 - mobilenet-v3ncnn: Vulkan GPU - shufflenet-v2ncnn: Vulkan GPU - mnasnetncnn: Vulkan GPU - efficientnet-b0ncnn: Vulkan GPU - blazefacencnn: Vulkan GPU - googlenetncnn: Vulkan GPU - vgg16ncnn: Vulkan GPU - resnet18ncnn: Vulkan GPU - alexnetncnn: Vulkan GPU - resnet50ncnn: Vulkan GPU - yolov4-tinyIntel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW762363.7741.8310.939.166.819.7715.102.8587.18318.7154.9829.77181.2454.7948.32110.2140.3944.1327.2241.8779.417.2964.71310.2940.04107.31169.25153.3159.9639.6410.368.716.429.2614.402.7182.77300.2151.9929.75171.6552.3444.75109.6640.3744.1127.2541.8780.527.3257.64290.7037.44110.40158.89152.5260.3539.8910.458.696.489.2414.452.8682.87300.9051.9829.96172.0252.5344.70109.9439.7344.1027.2340.9880.607.2657.32293.3936.91111.14158.85152.39OpenBenchmarking.org

NCNN

Target: CPU - Model: squeezenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: squeezenet23Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW761428425670SE +/- 0.18, N = 3SE +/- 0.04, N = 3SE +/- 0.10, N = 359.9660.3563.77MIN: 57.25 / MAX: 74.47MIN: 57.85 / MAX: 91MIN: 62.25 / MAX: 84.241. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mobilenet23Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW761020304050SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.18, N = 339.6439.8941.83MIN: 38.52 / MAX: 57.96MIN: 38.75 / MAX: 55.85MIN: 39.85 / MAX: 59.731. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v2-v2 - Model: mobilenet-v223Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW763691215SE +/- 0.00, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 310.3610.4510.93MIN: 9.78 / MAX: 14.78MIN: 9.78 / MAX: 15.31MIN: 10.24 / MAX: 29.621. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU-v3-v3 - Model: mobilenet-v332Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW763691215SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.02, N = 38.698.719.16MIN: 8.48 / MAX: 13.34MIN: 8.44 / MAX: 26.86MIN: 8.72 / MAX: 14.291. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: shufflenet-v223Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW76246810SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 36.426.486.81MIN: 6.35 / MAX: 11.01MIN: 6.37 / MAX: 11.14MIN: 6.6 / MAX: 11.841. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: mnasnet32Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW763691215SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 39.249.269.77MIN: 8.87 / MAX: 14.11MIN: 8.87 / MAX: 21.51MIN: 9.15 / MAX: 20.811. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: efficientnet-b023Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW7648121620SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 314.4014.4515.10MIN: 13.87 / MAX: 32.98MIN: 13.88 / MAX: 19.62MIN: 14.59 / MAX: 31.71. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: blazeface2Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW7630.64351.2871.93052.5743.2175SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 32.712.852.86MIN: 2.53 / MAX: 6.03MIN: 2.57 / MAX: 7.33MIN: 2.55 / MAX: 20.451. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: googlenet23Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW7620406080100SE +/- 0.05, N = 3SE +/- 0.09, N = 3SE +/- 0.04, N = 382.7782.8787.18MIN: 79.66 / MAX: 101.28MIN: 79.91 / MAX: 100.78MIN: 83.44 / MAX: 105.081. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: vgg1623Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW7670140210280350SE +/- 0.26, N = 3SE +/- 0.53, N = 3SE +/- 0.85, N = 3300.21300.90318.71MIN: 214.03 / MAX: 328.86MIN: 214.06 / MAX: 327.47MIN: 250.09 / MAX: 417.941. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet1832Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW761224364860SE +/- 0.09, N = 3SE +/- 0.12, N = 3SE +/- 0.21, N = 351.9851.9954.98MIN: 50.67 / MAX: 68.99MIN: 50.43 / MAX: 72.64MIN: 52.75 / MAX: 102.391. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: alexnet2Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW763714212835SE +/- 0.19, N = 3SE +/- 0.13, N = 3SE +/- 0.05, N = 329.7529.7729.96MIN: 27.51 / MAX: 44.47MIN: 27.99 / MAX: 39.96MIN: 25.69 / MAX: 52.11. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: resnet5023Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW764080120160200SE +/- 0.06, N = 3SE +/- 0.10, N = 3SE +/- 0.37, N = 3171.65172.02181.24MIN: 167.34 / MAX: 191.12MIN: 168.04 / MAX: 198.49MIN: 174.72 / MAX: 203.171. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: CPU - Model: yolov4-tiny23Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW761224364860SE +/- 0.09, N = 3SE +/- 0.05, N = 3SE +/- 0.25, N = 352.3452.5354.79MIN: 50.61 / MAX: 58.42MIN: 50.99 / MAX: 70.35MIN: 53.4 / MAX: 72.11. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: squeezenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: squeezenet32Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW761122334455SE +/- 0.23, N = 3SE +/- 0.12, N = 3SE +/- 0.07, N = 344.7044.7548.32MIN: 38.73 / MAX: 72.88MIN: 38.86 / MAX: 75.98MIN: 38.42 / MAX: 70.081. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: mobilenet23Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW7620406080100SE +/- 0.07, N = 3SE +/- 0.19, N = 3SE +/- 0.05, N = 3109.66109.94110.21MIN: 92.15 / MAX: 122.04MIN: 89.84 / MAX: 141.11MIN: 104.36 / MAX: 166.371. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU-v2-v2 - Model: mobilenet-v232Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW76918273645SE +/- 0.65, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 339.7340.3740.39MIN: 11.8 / MAX: 41.17MIN: 38.25 / MAX: 41.29MIN: 37.9 / MAX: 41.911. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU-v3-v3 - Model: mobilenet-v332Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW761020304050SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 344.1044.1144.13MIN: 41.73 / MAX: 44.97MIN: 41.5 / MAX: 44.94MIN: 37.05 / MAX: 45.321. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: shufflenet-v2Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW7632612182430SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 327.2227.2327.25MIN: 25.28 / MAX: 28.14MIN: 25.24 / MAX: 27.65MIN: 24.48 / MAX: 28.551. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: mnasnet3Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW7621020304050SE +/- 0.91, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 340.9841.8741.87MIN: 12.2 / MAX: 42.87MIN: 39.48 / MAX: 42.65MIN: 35.34 / MAX: 42.71. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: efficientnet-b0Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW762320406080100SE +/- 1.16, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 379.4180.5280.60MIN: 25.07 / MAX: 82.28MIN: 37.32 / MAX: 82.28MIN: 74.2 / MAX: 82.111. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: blazeface3Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW762246810SE +/- 0.04, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 37.267.297.32MIN: 6.93 / MAX: 16.13MIN: 6.94 / MAX: 7.9MIN: 7 / MAX: 14.921. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: googlenet32Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW761428425670SE +/- 0.22, N = 3SE +/- 0.26, N = 3SE +/- 1.77, N = 357.3257.6464.71MIN: 53.4 / MAX: 87.15MIN: 53.44 / MAX: 88.21MIN: 53.65 / MAX: 702.891. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: vgg1623Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW7670140210280350SE +/- 1.00, N = 3SE +/- 0.49, N = 3SE +/- 1.14, N = 3290.70293.39310.29MIN: 206.96 / MAX: 321.26MIN: 208.62 / MAX: 351.9MIN: 209.24 / MAX: 335.011. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: resnet1832Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW76918273645SE +/- 0.18, N = 3SE +/- 0.22, N = 3SE +/- 0.28, N = 336.9137.4440.04MIN: 31.01 / MAX: 77.77MIN: 31.04 / MAX: 57.83MIN: 31.42 / MAX: 73.091. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: alexnetIntel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW762320406080100SE +/- 2.00, N = 3SE +/- 0.35, N = 3SE +/- 0.49, N = 3107.31110.40111.14MIN: 47.26 / MAX: 125.65MIN: 69.1 / MAX: 127.26MIN: 72.5 / MAX: 117.71. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: resnet5032Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW764080120160200SE +/- 0.14, N = 3SE +/- 0.17, N = 3SE +/- 0.40, N = 3158.85158.89169.25MIN: 108.05 / MAX: 188.72MIN: 107.75 / MAX: 189.15MIN: 108.48 / MAX: 255.781. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: Vulkan GPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20200916Target: Vulkan GPU - Model: yolov4-tiny32Intel Core i7-8565U - Intel UHD 620 3GB - Dell 0KTW76306090120150SE +/- 0.04, N = 3SE +/- 0.30, N = 3SE +/- 0.50, N = 3152.39152.52153.31MIN: 96.27 / MAX: 176.12MIN: 89.11 / MAX: 194.2MIN: 118.91 / MAX: 173.011. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Phoronix Test Suite v10.8.4