openvino-2024

Intel Core Ultra 7 155H testing with a MTL Swift SFG14-72T Coral_MTH (V1.01 BIOS) and Intel Arc MTL 8GB on Ubuntu 23.10 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2403078-NE-OPENVINO276&grs&sor&rro.

openvino-2024 ProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerOpenGLCompilerFile-SystemScreen ResolutionabcdeIntel Core Ultra 7 155H @ 4.80GHz (16 Cores / 22 Threads)MTL Swift SFG14-72T Coral_MTH (V1.01 BIOS)Intel Device 7e7f8 x 2GB DRAM-6400MT/s Micron MT62F1G32D2DS-0261024GB Micron_2550_MTFDKBA1T0TGEIntel Arc MTL 8GB (2250MHz)Intel Meteor Lake-P HD AudioIntel Device 7e40Ubuntu 23.106.8.0-060800rc1daily20240126-generic (x86_64)GNOME Shell 45.2X Server 1.21.1.7 + Wayland4.6 Mesa 24.1~git2401200600.ebcab1~oibaf~m (git-ebcab14 2024-01-20 mantic-oibaf-ppa)GCC 13.2.0ext41920x1200OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x13 - Thermald 2.5.4Python Details- Python 3.11.6Security Details- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

openvino-2024 openvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUabcde341.2620.4747.86146.15349.7819.9715.36454.1952.321.82323.313797.30355.6119.6797.43173.8624.88280.816.3326.011099.33643.51186.7190.8858.84118.81104.8666.7030.29230.7316.551002.41156.10108.7127.24256.364823.263.311.2712466.99317.4522.0142.72163.56325.8221.4313.9501.5348.81.91345.963557.43326.621.3989.36189.1922.95304.166.8224.11021.76693.74178.2495.1554.94127.297.971.3928.31246.6115.631059.77152.02111.626.28265.614958.113.231.2212915.87318.0221.9742.78163.33326.3821.4113.75506.7648.421.95348.693543.9325.621.4589.94188.1822.93304.56.7624.091023.44693.66177.8195.3454.73127.797.6771.5628.32246.5915.651058.96151.19112.2126.12267.314962.193.221.2212894.54321.6921.6843.75159.69331.4821.0714.13493.1450.081.91337.293562.54333.5120.9491.19185.5223.33299.196.7424.491030.08682.02183.2892.5255.6125.6499.5270.2428.64243.8415.821045.93152.48111.2927.09257.644908.523.261.2612467.6359.3719.4648.22145.05366.1019.1015.31455.7453.701.76315.383912.27351.7319.8696.16176.0924.75282.226.3025.591103.12653.79191.3688.6058.38119.74103.8867.3330.13231.8016.64996.96160.66105.7027.61252.964709.823.391.2712467.50OpenBenchmarking.org

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPUeadcb80160240320400SE +/- 3.72, N = 15SE +/- 3.98, N = 3359.37341.26321.69318.02317.45MIN: 181.92 / MAX: 496.2MIN: 177.09 / MAX: 488.59MIN: 228.05 / MAX: 462.91MIN: 175.18 / MAX: 464.55MIN: 224.7 / MAX: 464.251. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPUeadcb510152025SE +/- 0.20, N = 15SE +/- 0.23, N = 319.4620.4721.6821.9722.011. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16 - Device: CPUeadcb1122334455SE +/- 0.40, N = 15SE +/- 0.40, N = 1548.2247.8643.7542.7842.72MIN: 21.22 / MAX: 118.95MIN: 18.18 / MAX: 104.89MIN: 23.92 / MAX: 118.28MIN: 19.12 / MAX: 66.42MIN: 23.22 / MAX: 67.871. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16 - Device: CPUeadcb4080120160200SE +/- 1.21, N = 15SE +/- 1.22, N = 15145.05146.15159.69163.33163.561. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Detection FP32 - Device: CPUeadcb80160240320400SE +/- 3.98, N = 15SE +/- 4.98, N = 3366.10349.78331.48326.38325.82MIN: 173.32 / MAX: 500.3MIN: 176.64 / MAX: 492.35MIN: 221.77 / MAX: 461.89MIN: 225.82 / MAX: 460.08MIN: 220.85 / MAX: 464.291. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Detection FP32 - Device: CPUeadcb510152025SE +/- 0.21, N = 15SE +/- 0.27, N = 319.1019.9721.0721.4121.431. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16 - Device: CPUaedbc48121620SE +/- 0.17, N = 5SE +/- 0.13, N = 1515.3615.3114.1313.9013.75MIN: 6.94 / MAX: 39.47MIN: 6.83 / MAX: 39.1MIN: 8.44 / MAX: 37.62MIN: 7.85 / MAX: 35.11MIN: 7.71 / MAX: 30.861. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16 - Device: CPUaedbc110220330440550SE +/- 4.97, N = 5SE +/- 3.85, N = 15454.19455.74493.14501.53506.761. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Noise Suppression Poconet-Like FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPUeadbc1224364860SE +/- 0.67, N = 15SE +/- 0.44, N = 1553.7052.3250.0848.8048.42MIN: 24.32 / MAX: 89.77MIN: 24.2 / MAX: 79.7MIN: 24.33 / MAX: 73.52MIN: 24.49 / MAX: 74.38MIN: 24.4 / MAX: 71.851. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection FP16 - Device: CPUeabdc0.43880.87761.31641.75522.194SE +/- 0.01, N = 15SE +/- 0.02, N = 81.761.821.911.911.951. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Noise Suppression Poconet-Like FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPUeadbc80160240320400SE +/- 3.89, N = 15SE +/- 2.66, N = 15315.38323.31337.29345.96348.691. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection FP16 - Device: CPUeadbc8001600240032004000SE +/- 31.91, N = 15SE +/- 32.88, N = 83912.273797.303562.543557.433543.90MIN: 2798.1 / MAX: 5581.53MIN: 1742.11 / MAX: 5264.59MIN: 1816.87 / MAX: 5174.72MIN: 2757.58 / MAX: 5221.58MIN: 2743.85 / MAX: 5185.691. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPUaedbc80160240320400SE +/- 3.64, N = 15SE +/- 2.64, N = 15355.61351.73333.51326.60325.60MIN: 163.07 / MAX: 515.11MIN: 137.63 / MAX: 624.33MIN: 227.46 / MAX: 479.39MIN: 127.63 / MAX: 466.63MIN: 217.98 / MAX: 455.751. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPUaedbc510152025SE +/- 0.20, N = 15SE +/- 0.15, N = 1519.6719.8620.9421.3921.451. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16 - Device: CPUaedcb20406080100SE +/- 0.81, N = 15SE +/- 0.70, N = 1297.4396.1691.1989.9489.36MIN: 46.27 / MAX: 163.7MIN: 45.85 / MAX: 157.97MIN: 46.11 / MAX: 142.48MIN: 46.46 / MAX: 140.34MIN: 46.01 / MAX: 136.051. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16 - Device: CPUaedcb4080120160200SE +/- 1.41, N = 15SE +/- 1.26, N = 12173.86176.09185.52188.18189.191. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPUaedbc612182430SE +/- 0.20, N = 15SE +/- 0.18, N = 1524.8824.7523.3322.9522.93MIN: 12.66 / MAX: 47.23MIN: 11.42 / MAX: 47.13MIN: 13.63 / MAX: 40.97MIN: 11.9 / MAX: 43.97MIN: 11.91 / MAX: 43.961. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPUaedbc70140210280350SE +/- 2.21, N = 15SE +/- 2.03, N = 15280.81282.22299.19304.16304.501. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPUeadcb246810SE +/- 0.04, N = 13SE +/- 0.05, N = 156.306.336.746.766.821. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPUaedbc612182430SE +/- 0.21, N = 15SE +/- 0.20, N = 1026.0125.5924.4924.1024.09MIN: 10.92 / MAX: 57.13MIN: 12.13 / MAX: 55.42MIN: 12.24 / MAX: 41.08MIN: 12.07 / MAX: 40.91MIN: 11.69 / MAX: 42.691. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPUeadcb2004006008001000SE +/- 7.33, N = 13SE +/- 9.38, N = 151103.121099.331030.081023.441021.76MIN: 406.78 / MAX: 1728.53MIN: 459.81 / MAX: 1740.17MIN: 733.36 / MAX: 1612.47MIN: 727.38 / MAX: 1604.26MIN: 721.29 / MAX: 1599.181. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPUaedcb150300450600750SE +/- 5.15, N = 15SE +/- 5.14, N = 10643.51653.79682.02693.66693.741. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16 - Device: CPUeadbc4080120160200SE +/- 1.32, N = 3SE +/- 1.41, N = 10191.36186.71183.28178.24177.81MIN: 101.79 / MAX: 268.9MIN: 101.83 / MAX: 274.05MIN: 101.8 / MAX: 248.36MIN: 101.95 / MAX: 247.18MIN: 102.85 / MAX: 239.141. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16 - Device: CPUeadbc20406080100SE +/- 0.61, N = 3SE +/- 0.70, N = 1088.6090.8892.5295.1595.341. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPUaedbc1326395265SE +/- 0.58, N = 6SE +/- 0.67, N = 458.8458.3855.6054.9454.73MIN: 28.65 / MAX: 92.74MIN: 25.03 / MAX: 96.63MIN: 32.5 / MAX: 89.87MIN: 32.3 / MAX: 87.41MIN: 32.28 / MAX: 86.231. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPUaedbc306090120150SE +/- 1.16, N = 6SE +/- 1.39, N = 4118.81119.74125.64127.20127.701. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16 - Device: CPUaedbc20406080100SE +/- 1.16, N = 4SE +/- 1.04, N = 6104.86103.8899.5297.9097.67MIN: 43.38 / MAX: 358.76MIN: 44.02 / MAX: 396.62MIN: 39.25 / MAX: 383.84MIN: 37.33 / MAX: 376.3MIN: 51.53 / MAX: 347.081. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16 - Device: CPUaedbc1632486480SE +/- 0.75, N = 4SE +/- 0.68, N = 666.7067.3370.2471.3971.561. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPUaedcb714212835SE +/- 0.22, N = 15SE +/- 0.25, N = 330.2930.1328.6428.3228.31MIN: 13.26 / MAX: 59.59MIN: 14.67 / MAX: 57.69MIN: 16.72 / MAX: 56.71MIN: 17.27 / MAX: 57.04MIN: 17.01 / MAX: 55.631. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPUaedcb50100150200250SE +/- 1.67, N = 15SE +/- 1.91, N = 3230.73231.80243.84246.59246.611. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPUeadcb48121620SE +/- 0.12, N = 15SE +/- 0.11, N = 1516.6416.5515.8215.6515.63MIN: 7.02 / MAX: 37.41MIN: 6.65 / MAX: 34.71MIN: 6.52 / MAX: 29.45MIN: 7.08 / MAX: 26.33MIN: 7.37 / MAX: 26.391. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPUeadcb2004006008001000SE +/- 7.15, N = 15SE +/- 6.75, N = 15996.961002.411045.931058.961059.771. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPUeadbc4080120160200SE +/- 1.27, N = 15SE +/- 2.14, N = 3160.66156.10152.48152.02151.19MIN: 88.95 / MAX: 239.44MIN: 89.74 / MAX: 233.97MIN: 89.77 / MAX: 219.3MIN: 88.01 / MAX: 226.83MIN: 89.51 / MAX: 211.521. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPUeadbc306090120150SE +/- 0.83, N = 15SE +/- 1.48, N = 3105.70108.71111.29111.60112.211. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Re-Identification Retail FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPUeadbc612182430SE +/- 0.27, N = 6SE +/- 0.31, N = 427.6127.2427.0926.2826.12MIN: 11.88 / MAX: 54.33MIN: 15.08 / MAX: 47.91MIN: 15.78 / MAX: 43.25MIN: 16.16 / MAX: 43.57MIN: 15.46 / MAX: 41.861. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Re-Identification Retail FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPUeadbc60120180240300SE +/- 2.45, N = 6SE +/- 2.88, N = 4252.96256.36257.64265.61267.311. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUeadbc11002200330044005500SE +/- 46.64, N = 6SE +/- 39.34, N = 34709.824823.264908.524958.114962.191. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUeadbc0.76281.52562.28843.05123.814SE +/- 0.03, N = 6SE +/- 0.03, N = 33.393.313.263.233.22MIN: 1.06 / MAX: 14.99MIN: 1.1 / MAX: 12.43MIN: 1.04 / MAX: 8MIN: 1.1 / MAX: 8.44MIN: 1.04 / MAX: 15.361. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUeadcb0.28580.57160.85741.14321.429SE +/- 0.01, N = 3SE +/- 0.02, N = 41.271.271.261.221.22MIN: 0.38 / MAX: 12.95MIN: 0.38 / MAX: 11.64MIN: 0.4 / MAX: 6.52MIN: 0.4 / MAX: 5.49MIN: 0.39 / MAX: 6.571. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUaedcb3K6K9K12K15KSE +/- 151.02, N = 4SE +/- 146.93, N = 312466.9912467.5012467.6012894.5412915.871. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Phoronix Test Suite v10.8.5