icelake nn

Intel Core i7-1065G7 testing with a Dell 06CDVY (1.0.9 BIOS) and Intel Iris Plus ICL GT2 3GB on Ubuntu 21.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2106191-IB-ICELAKENN91&grs.

icelake nnProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen Resolution1234Intel Core i7-1065G7 @ 3.90GHz (4 Cores / 8 Threads)Dell 06CDVY (1.0.9 BIOS)Intel Ice Lake-LP DRAM16GBToshiba KBG40ZPZ512G NVMe 512GBIntel Iris Plus ICL GT2 3GB (1100MHz)Realtek ALC289Intel Killer Wi-Fi 6 AX1650i 160MHzUbuntu 21.045.11.0-17-generic (x86_64)GNOME Shell 3.38.4X Server + Wayland4.6 Mesa 21.0.11.2.145GCC 10.3.0ext41920x1200OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-gDeRY6/gcc-10-10.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-gDeRY6/gcc-10-10.3.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate powersave - CPU Microcode: 0xa0 - Thermald 2.4.3 Security Details- itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

icelake nnncnn: CPU - yolov4-tinyncnn: CPU - mobilenettnn: CPU - DenseNetncnn: CPU - resnet18tnn: CPU - MobileNet v2tnn: CPU - SqueezeNet v1.1tnn: CPU - SqueezeNet v2ncnn: CPU - regnety_400mncnn: CPU - squeezenet_ssdncnn: CPU - resnet50ncnn: CPU - alexnetncnn: CPU - vgg16ncnn: CPU - googlenetncnn: CPU - blazefacencnn: CPU - efficientnet-b0ncnn: CPU - mnasnetncnn: CPU - shufflenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU-v2-v2 - mobilenet-v2mnn: inception-v3mnn: mobilenet-v1-1.0mnn: MobileNetV2_224mnn: SqueezeNetV1.0mnn: resnet-v2-50mnn: squeezenetv1.1mnn: mobilenetV3123442.4329.325483.67224.47373.710334.36469.48614.9587.99106.4739.27124.9626.412.7212.067.576.216.346.0964.9675.5486.0599.96346.4846.0563.15744.5530.505345.16925.10364.751336.38269.42215.3340.0749.7422.1480.0026.852.7811.747.506.686.846.8369.7095.9246.0939.97251.5106.3833.13343.9129.775321.93925.28364.373334.07369.80914.3639.4248.2221.8178.2824.302.5010.877.006.066.316.3266.1885.5326.0549.96946.6995.9713.11942.8729.405293.76424.93365.412336.85669.76614.1138.7047.9422.1777.2624.282.5210.856.816.106.496.2070.0976.0296.15210.01850.8646.3303.152OpenBenchmarking.org

NCNN

Target: CPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: yolov4-tiny12341020304050SE +/- 0.19, N = 3SE +/- 0.35, N = 9SE +/- 1.00, N = 3SE +/- 0.47, N = 342.4344.5543.9142.87MIN: 39.87 / MAX: 72.26MIN: 39.84 / MAX: 61.79MIN: 40.59 / MAX: 57.72MIN: 39.61 / MAX: 56.141. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: mobilenet1234714212835SE +/- 0.25, N = 3SE +/- 0.25, N = 9SE +/- 0.04, N = 3SE +/- 0.29, N = 329.3230.5029.7729.40MIN: 27.05 / MAX: 44.13MIN: 27.01 / MAX: 55.7MIN: 27.55 / MAX: 46MIN: 26.99 / MAX: 46.91. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

TNN

Target: CPU - Model: DenseNet

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: DenseNet123412002400360048006000SE +/- 56.57, N = 3SE +/- 69.51, N = 3SE +/- 56.05, N = 3SE +/- 52.06, N = 35483.675345.175321.945293.76MIN: 5296.65 / MAX: 5841.75MIN: 4289.4 / MAX: 5766.66MIN: 4298.57 / MAX: 5621.48MIN: 4304.76 / MAX: 5401.981. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O3 -rdynamic -ldl

NCNN

Target: CPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: resnet181234612182430SE +/- 0.01, N = 3SE +/- 0.26, N = 9SE +/- 0.31, N = 3SE +/- 0.34, N = 324.4725.1025.2824.93MIN: 21.71 / MAX: 38.08MIN: 21.62 / MAX: 46.25MIN: 21.91 / MAX: 39.57MIN: 21.63 / MAX: 39.21. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

TNN

Target: CPU - Model: MobileNet v2

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: MobileNet v2123480160240320400SE +/- 3.80, N = 5SE +/- 3.28, N = 3SE +/- 2.33, N = 3SE +/- 3.41, N = 3373.71364.75364.37365.41MIN: 353.55 / MAX: 423.92MIN: 353.86 / MAX: 420.78MIN: 354.83 / MAX: 393.85MIN: 353.55 / MAX: 392.391. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O3 -rdynamic -ldl

TNN

Target: CPU - Model: SqueezeNet v1.1

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: SqueezeNet v1.1123470140210280350SE +/- 1.32, N = 3SE +/- 1.85, N = 3SE +/- 0.96, N = 3SE +/- 0.07, N = 3334.36336.38334.07336.86MIN: 327.33 / MAX: 341.58MIN: 327.69 / MAX: 347.72MIN: 327.9 / MAX: 339.68MIN: 329.44 / MAX: 344.11. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O3 -rdynamic -ldl

TNN

Target: CPU - Model: SqueezeNet v2

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: SqueezeNet v212341632486480SE +/- 0.39, N = 3SE +/- 0.41, N = 3SE +/- 0.34, N = 3SE +/- 0.34, N = 369.4969.4269.8169.77MIN: 67.79 / MAX: 76.19MIN: 67.94 / MAX: 71.64MIN: 68.45 / MAX: 71.1MIN: 68.18 / MAX: 75.941. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O3 -rdynamic -ldl

NCNN

Target: CPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: regnety_400m123448121620SE +/- 0.05, N = 3SE +/- 0.12, N = 9SE +/- 1.28, N = 3SE +/- 1.16, N = 314.9515.3314.3614.11MIN: 13.24 / MAX: 27.19MIN: 13.23 / MAX: 28.79MIN: 10.33 / MAX: 28.27MIN: 10.36 / MAX: 27.751. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: squeezenet_ssd123420406080100SE +/- 49.48, N = 3SE +/- 0.40, N = 9SE +/- 0.45, N = 3SE +/- 0.39, N = 387.9940.0739.4238.70MIN: 33.42 / MAX: 2888.34MIN: 36.13 / MAX: 57.54MIN: 36.61 / MAX: 52.48MIN: 36.36 / MAX: 52.831. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: resnet50123420406080100SE +/- 58.61, N = 3SE +/- 0.51, N = 9SE +/- 0.36, N = 3SE +/- 0.31, N = 3106.4749.7448.2247.94MIN: 39.84 / MAX: 7159.77MIN: 43.79 / MAX: 69.39MIN: 44.45 / MAX: 66.58MIN: 43.94 / MAX: 651. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: alexnet1234918273645SE +/- 17.26, N = 3SE +/- 0.27, N = 9SE +/- 0.28, N = 3SE +/- 0.31, N = 339.2722.1421.8122.17MIN: 18.52 / MAX: 1739.82MIN: 19.25 / MAX: 36.37MIN: 19.53 / MAX: 37.84MIN: 19.78 / MAX: 56.491. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: vgg161234306090120150SE +/- 42.73, N = 3SE +/- 0.52, N = 9SE +/- 0.83, N = 3SE +/- 0.13, N = 3124.9680.0078.2877.26MIN: 68.18 / MAX: 2216.9MIN: 73.21 / MAX: 255.42MIN: 73.21 / MAX: 99.15MIN: 73.52 / MAX: 94.771. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: googlenet1234612182430SE +/- 0.35, N = 3SE +/- 0.25, N = 9SE +/- 2.11, N = 3SE +/- 2.09, N = 326.4126.8524.3024.28MIN: 23.55 / MAX: 42.67MIN: 22.77 / MAX: 42.41MIN: 16.71 / MAX: 39.34MIN: 17.12 / MAX: 42.051. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: blazeface12340.62551.2511.87652.5023.1275SE +/- 0.05, N = 3SE +/- 0.03, N = 9SE +/- 0.25, N = 3SE +/- 0.26, N = 32.722.782.502.52MIN: 2.25 / MAX: 15.64MIN: 2.24 / MAX: 15.93MIN: 1.75 / MAX: 7.14MIN: 1.72 / MAX: 14.211. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: efficientnet-b012343691215SE +/- 0.14, N = 3SE +/- 0.41, N = 9SE +/- 1.06, N = 3SE +/- 1.07, N = 312.0611.7410.8710.85MIN: 9.89 / MAX: 24.61MIN: 7.38 / MAX: 34.42MIN: 7.59 / MAX: 25.92MIN: 7.41 / MAX: 25.91. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: mnasnet1234246810SE +/- 0.06, N = 3SE +/- 0.29, N = 9SE +/- 0.82, N = 3SE +/- 0.76, N = 37.577.507.006.81MIN: 6.15 / MAX: 19.43MIN: 4.57 / MAX: 21.61MIN: 4.65 / MAX: 18.66MIN: 4.58 / MAX: 19.671. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU - Model: shufflenet-v21234246810SE +/- 0.61, N = 3SE +/- 0.28, N = 9SE +/- 0.69, N = 3SE +/- 0.67, N = 36.216.686.066.10MIN: 4.1 / MAX: 18.78MIN: 4.07 / MAX: 19.09MIN: 4.09 / MAX: 19.61MIN: 4.14 / MAX: 20.261. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU-v3-v3 - Model: mobilenet-v31234246810SE +/- 0.69, N = 3SE +/- 0.25, N = 9SE +/- 0.67, N = 3SE +/- 0.80, N = 36.346.846.316.49MIN: 4.28 / MAX: 18.14MIN: 4.25 / MAX: 20.34MIN: 4.28 / MAX: 22.77MIN: 4.25 / MAX: 18.661. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

NCNN

Target: CPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20210525Target: CPU-v2-v2 - Model: mobilenet-v21234246810SE +/- 0.30, N = 3SE +/- 0.24, N = 9SE +/- 0.33, N = 3SE +/- 0.35, N = 36.096.836.326.20MIN: 4.71 / MAX: 21.72MIN: 4.65 / MAX: 22.51MIN: 4.69 / MAX: 21.2MIN: 4.75 / MAX: 21.651. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread -pthread

Mobile Neural Network

Model: inception-v3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: inception-v312341632486480SE +/- 3.19, N = 3SE +/- 1.37, N = 12SE +/- 4.54, N = 3SE +/- 1.39, N = 1264.9769.7166.1970.10MIN: 49.32 / MAX: 172.12MIN: 49.53 / MAX: 125.54MIN: 49.62 / MAX: 143.18MIN: 51.09 / MAX: 103.851. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: mobilenet-v1-1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: mobilenet-v1-1.01234246810SE +/- 0.422, N = 3SE +/- 0.185, N = 12SE +/- 0.502, N = 3SE +/- 0.152, N = 125.5485.9245.5326.029MIN: 3.88 / MAX: 22.02MIN: 3.8 / MAX: 25.69MIN: 3.82 / MAX: 22.23MIN: 3.81 / MAX: 49.351. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: MobileNetV2_224

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: MobileNetV2_2241234246810SE +/- 0.037, N = 3SE +/- 0.145, N = 12SE +/- 0.014, N = 3SE +/- 0.032, N = 126.0596.0936.0546.152MIN: 5.04 / MAX: 24.45MIN: 3.98 / MAX: 26.16MIN: 5.06 / MAX: 22.01MIN: 5.03 / MAX: 24.251. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: SqueezeNetV1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: SqueezeNetV1.012343691215SE +/- 0.027, N = 3SE +/- 0.192, N = 12SE +/- 0.093, N = 3SE +/- 0.202, N = 129.9639.9729.96910.018MIN: 8.24 / MAX: 25.76MIN: 6.48 / MAX: 35.76MIN: 8.22 / MAX: 30.76MIN: 6.44 / MAX: 28.611. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: resnet-v2-50

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: resnet-v2-5012341224364860SE +/- 4.81, N = 3SE +/- 1.38, N = 12SE +/- 4.96, N = 3SE +/- 1.27, N = 1246.4851.5146.7050.86MIN: 32.46 / MAX: 76.6MIN: 31.89 / MAX: 76.61MIN: 31.6 / MAX: 71.65MIN: 32.17 / MAX: 112.911. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: squeezenetv1.1

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: squeezenetv1.11234246810SE +/- 0.538, N = 3SE +/- 0.145, N = 12SE +/- 0.534, N = 3SE +/- 0.132, N = 126.0566.3835.9716.330MIN: 4.18 / MAX: 22.96MIN: 4.21 / MAX: 25.53MIN: 4.16 / MAX: 24.61MIN: 4.21 / MAX: 23.861. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: mobilenetV3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 1.2Model: mobilenetV312340.71031.42062.13092.84123.5515SE +/- 0.004, N = 3SE +/- 0.065, N = 12SE +/- 0.001, N = 3SE +/- 0.061, N = 123.1573.1333.1193.152MIN: 2.53 / MAX: 21.15MIN: 2.02 / MAX: 21.49MIN: 2.54 / MAX: 17.79MIN: 2.07 / MAX: 21.691. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Phoronix Test Suite v10.8.4