OpenVINO with GPU

Intel Core i7-1065G7 testing with a Dell 06CDVY (1.0.9 BIOS) and Intel Iris Plus G7 3GB on Ubuntu 20.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2010089-PTS-OPENVINO10&grs.

OpenVINO with GPUProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLOpenCLVulkanCompilerFile-SystemScreen ResolutionIntel Core i7-1065G7 - Intel Iris Plus G7 3GB - Dell23Intel Core i7-1065G7 @ 3.90GHz (4 Cores / 8 Threads)Dell 06CDVY (1.0.9 BIOS)Intel Device 34ef16GBKBG40ZPZ512G NVMe TOSHIBA 512GBIntel Iris Plus G7 3GB (1100MHz)Realtek ALC289Intel Killer Wi-Fi 6 AX1650i 160MHzUbuntu 20.045.9.0-050900rc7daily20201003-generic (x86_64) 20201002GNOME Shell 3.36.4X Server 1.20.8modesetting 1.20.84.6 Mesa 20.3.0-devel (git-81cd4c8 2020-10-03 focal-oibaf-ppa)OpenCL 2.11.2.145GCC 9.3.0ext41920x1200OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-9-HskZEa/gcc-9-9.3.0/debian/tmp-nvptx/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate powersave - CPU Microcode: 0x78Python Details- Python 2.7.18 + Python 3.8.5Security Details- itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

OpenVINO with GPUopenvino: Age Gender Recognition Retail 0013 FP16 - Intel GPUopenvino: Age Gender Recognition Retail 0013 FP16 - Intel GPUopenvino: Face Detection 0106 FP32 - CPUopenvino: Age Gender Recognition Retail 0013 FP32 - Intel GPUopenvino: Person Detection 0106 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP32 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP32 - Intel GPUopenvino: Person Detection 0106 FP32 - CPUopenvino: Face Detection 0106 FP32 - CPUopenvino: Face Detection 0106 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP32 - CPUopenvino: Person Detection 0106 FP32 - CPUopenvino: Person Detection 0106 FP16 - CPUopenvino: Face Detection 0106 FP16 - CPUIntel Core i7-1065G7 - Intel Iris Plus G7 3GB - Dell231829.432.160.651549.209877.451.882122.212163.032.5410031.896196.946113.341.930.40.400.671827.302.160.661542.759914.411.882131.912173.602.5410022.606189.586110.721.930.400.400.671793.932.200.661553.889935.651.892132.782172.822.5310035.856190.416111.591.930.400.400.67OpenBenchmarking.org

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: Intel GPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP16 - Device: Intel GPUIntel Core i7-1065G7 - Intel Iris Plus G7 3GB - Dell23400800120016002000SE +/- 5.52, N = 3SE +/- 15.21, N = 3SE +/- 24.35, N = 31829.431827.301793.931. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: Intel GPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP16 - Device: Intel GPUIntel Core i7-1065G7 - Intel Iris Plus G7 3GB - Dell230.4950.991.4851.982.475SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 32.162.162.201. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Face Detection 0106 FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP32 - Device: CPUIntel Core i7-1065G7 - Intel Iris Plus G7 3GB - Dell230.14850.2970.44550.5940.7425SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 30.650.660.661. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Age Gender Recognition Retail 0013 FP32 - Device: Intel GPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP32 - Device: Intel GPUIntel Core i7-1065G7 - Intel Iris Plus G7 3GB - Dell2330060090012001500SE +/- 8.52, N = 3SE +/- 7.43, N = 3SE +/- 11.22, N = 31549.201542.751553.881. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Person Detection 0106 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP16 - Device: CPUIntel Core i7-1065G7 - Intel Iris Plus G7 3GB - Dell232K4K6K8K10KSE +/- 26.28, N = 3SE +/- 12.40, N = 3SE +/- 8.65, N = 39877.459914.419935.651. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUIntel Core i7-1065G7 - Intel Iris Plus G7 3GB - Dell230.42530.85061.27591.70122.1265SE +/- 0.01, N = 8SE +/- 0.01, N = 3SE +/- 0.01, N = 31.881.881.891. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP32 - Device: CPUIntel Core i7-1065G7 - Intel Iris Plus G7 3GB - Dell235001000150020002500SE +/- 17.00, N = 3SE +/- 28.16, N = 3SE +/- 32.34, N = 32122.212131.912132.781. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUIntel Core i7-1065G7 - Intel Iris Plus G7 3GB - Dell235001000150020002500SE +/- 22.85, N = 8SE +/- 32.76, N = 3SE +/- 32.85, N = 32163.032173.602172.821. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Age Gender Recognition Retail 0013 FP32 - Device: Intel GPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP32 - Device: Intel GPUIntel Core i7-1065G7 - Intel Iris Plus G7 3GB - Dell230.57151.1431.71452.2862.8575SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 32.542.542.531. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Person Detection 0106 FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP32 - Device: CPUIntel Core i7-1065G7 - Intel Iris Plus G7 3GB - Dell232K4K6K8K10KSE +/- 12.97, N = 3SE +/- 27.80, N = 3SE +/- 11.21, N = 310031.8910022.6010035.851. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Face Detection 0106 FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP32 - Device: CPUIntel Core i7-1065G7 - Intel Iris Plus G7 3GB - Dell2313002600390052006500SE +/- 0.26, N = 3SE +/- 2.85, N = 3SE +/- 1.24, N = 36196.946189.586190.411. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Face Detection 0106 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP16 - Device: CPUIntel Core i7-1065G7 - Intel Iris Plus G7 3GB - Dell2313002600390052006500SE +/- 4.03, N = 5SE +/- 3.85, N = 7SE +/- 2.42, N = 96113.346110.726111.591. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP32 - Device: CPUIntel Core i7-1065G7 - Intel Iris Plus G7 3GB - Dell230.43430.86861.30291.73722.1715SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.931.931.931. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Person Detection 0106 FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP32 - Device: CPUIntel Core i7-1065G7 - Intel Iris Plus G7 3GB - Dell230.090.180.270.360.45SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.400.400.401. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Person Detection 0106 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP16 - Device: CPUIntel Core i7-1065G7 - Intel Iris Plus G7 3GB - Dell230.090.180.270.360.45SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.400.400.401. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

OpenVINO

Model: Face Detection 0106 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP16 - Device: CPUIntel Core i7-1065G7 - Intel Iris Plus G7 3GB - Dell230.15080.30160.45240.60320.754SE +/- 0.01, N = 5SE +/- 0.01, N = 7SE +/- 0.01, N = 90.670.670.671. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -pie -pthread -lpthread

Phoronix Test Suite v10.8.4