openvino-2024

Intel Core Ultra 7 155H testing with a MTL Swift SFG14-72T Coral_MTH (V1.01 BIOS) and Intel Arc MTL 8GB on Ubuntu 23.10 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2403078-NE-OPENVINO276.

openvino-2024 ProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerOpenGLCompilerFile-SystemScreen ResolutionabcdeIntel Core Ultra 7 155H @ 4.80GHz (16 Cores / 22 Threads)MTL Swift SFG14-72T Coral_MTH (V1.01 BIOS)Intel Device 7e7f8 x 2GB DRAM-6400MT/s Micron MT62F1G32D2DS-0261024GB Micron_2550_MTFDKBA1T0TGEIntel Arc MTL 8GB (2250MHz)Intel Meteor Lake-P HD AudioIntel Device 7e40Ubuntu 23.106.8.0-060800rc1daily20240126-generic (x86_64)GNOME Shell 45.2X Server 1.21.1.7 + Wayland4.6 Mesa 24.1~git2401200600.ebcab1~oibaf~m (git-ebcab14 2024-01-20 mantic-oibaf-ppa)GCC 13.2.0ext41920x1200OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x13 - Thermald 2.5.4Python Details- Python 3.11.6Security Details- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

openvino-2024 openvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUabcde1.823797.3020.47341.2619.97349.78146.1547.866.331099.33454.1915.3666.70104.86280.8124.88173.8697.431002.4116.55118.8158.8419.67355.61643.5126.01230.7330.29323.3152.3290.88186.71256.3627.244823.263.31108.71156.1012466.991.271.913557.4322.01317.4521.43325.82163.5642.726.821021.76501.5313.971.3997.9304.1622.95189.1989.361059.7715.63127.254.9421.39326.6693.7424.1246.6128.31345.9648.895.15178.24265.6126.284958.113.23111.6152.0212915.871.221.953543.921.97318.0221.41326.38163.3342.786.761023.44506.7613.7571.5697.67304.522.93188.1889.941058.9615.65127.754.7321.45325.6693.6624.09246.5928.32348.6948.4295.34177.81267.3126.124962.193.22112.21151.1912894.541.221.913562.5421.68321.6921.07331.48159.6943.756.741030.08493.1414.1370.2499.52299.1923.33185.5291.191045.9315.82125.6455.620.94333.51682.0224.49243.8428.64337.2950.0892.52183.28257.6427.094908.523.26111.29152.4812467.61.261.763912.2719.46359.3719.10366.10145.0548.226.301103.12455.7415.3167.33103.88282.2224.75176.0996.16996.9616.64119.7458.3819.86351.73653.7925.59231.8030.13315.3853.7088.60191.36252.9627.614709.823.39105.70160.6612467.501.27OpenBenchmarking.org

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection FP16 - Device: CPUabcde0.43880.87761.31641.75522.194SE +/- 0.02, N = 8SE +/- 0.01, N = 151.821.911.951.911.761. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection FP16 - Device: CPUabcde8001600240032004000SE +/- 32.88, N = 8SE +/- 31.91, N = 153797.303557.433543.903562.543912.27MIN: 1742.11 / MAX: 5264.59MIN: 2757.58 / MAX: 5221.58MIN: 2743.85 / MAX: 5185.69MIN: 1816.87 / MAX: 5174.72MIN: 2798.1 / MAX: 5581.531. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPUabcde510152025SE +/- 0.23, N = 3SE +/- 0.20, N = 1520.4722.0121.9721.6819.461. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPUabcde80160240320400SE +/- 3.98, N = 3SE +/- 3.72, N = 15341.26317.45318.02321.69359.37MIN: 177.09 / MAX: 488.59MIN: 224.7 / MAX: 464.25MIN: 175.18 / MAX: 464.55MIN: 228.05 / MAX: 462.91MIN: 181.92 / MAX: 496.21. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Detection FP32 - Device: CPUabcde510152025SE +/- 0.27, N = 3SE +/- 0.21, N = 1519.9721.4321.4121.0719.101. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Detection FP32 - Device: CPUabcde80160240320400SE +/- 4.98, N = 3SE +/- 3.98, N = 15349.78325.82326.38331.48366.10MIN: 176.64 / MAX: 492.35MIN: 220.85 / MAX: 464.29MIN: 225.82 / MAX: 460.08MIN: 221.77 / MAX: 461.89MIN: 173.32 / MAX: 500.31. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16 - Device: CPUabcde4080120160200SE +/- 1.22, N = 15SE +/- 1.21, N = 15146.15163.56163.33159.69145.051. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16 - Device: CPUabcde1122334455SE +/- 0.40, N = 15SE +/- 0.40, N = 1547.8642.7242.7843.7548.22MIN: 18.18 / MAX: 104.89MIN: 23.22 / MAX: 67.87MIN: 19.12 / MAX: 66.42MIN: 23.92 / MAX: 118.28MIN: 21.22 / MAX: 118.951. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPUabcde246810SE +/- 0.05, N = 15SE +/- 0.04, N = 136.336.826.766.746.301. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPUabcde2004006008001000SE +/- 9.38, N = 15SE +/- 7.33, N = 131099.331021.761023.441030.081103.12MIN: 459.81 / MAX: 1740.17MIN: 721.29 / MAX: 1599.18MIN: 727.38 / MAX: 1604.26MIN: 733.36 / MAX: 1612.47MIN: 406.78 / MAX: 1728.531. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16 - Device: CPUabcde110220330440550SE +/- 4.97, N = 5SE +/- 3.85, N = 15454.19501.53506.76493.14455.741. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16 - Device: CPUabcde48121620SE +/- 0.17, N = 5SE +/- 0.13, N = 1515.3613.9013.7514.1315.31MIN: 6.94 / MAX: 39.47MIN: 7.85 / MAX: 35.11MIN: 7.71 / MAX: 30.86MIN: 8.44 / MAX: 37.62MIN: 6.83 / MAX: 39.11. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16 - Device: CPUabcde1632486480SE +/- 0.75, N = 4SE +/- 0.68, N = 666.7071.3971.5670.2467.331. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16 - Device: CPUabcde20406080100SE +/- 1.16, N = 4SE +/- 1.04, N = 6104.8697.9097.6799.52103.88MIN: 43.38 / MAX: 358.76MIN: 37.33 / MAX: 376.3MIN: 51.53 / MAX: 347.08MIN: 39.25 / MAX: 383.84MIN: 44.02 / MAX: 396.621. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPUabcde70140210280350SE +/- 2.21, N = 15SE +/- 2.03, N = 15280.81304.16304.50299.19282.221. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPUabcde612182430SE +/- 0.20, N = 15SE +/- 0.18, N = 1524.8822.9522.9323.3324.75MIN: 12.66 / MAX: 47.23MIN: 11.9 / MAX: 43.97MIN: 11.91 / MAX: 43.96MIN: 13.63 / MAX: 40.97MIN: 11.42 / MAX: 47.131. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16 - Device: CPUabcde4080120160200SE +/- 1.41, N = 15SE +/- 1.26, N = 12173.86189.19188.18185.52176.091. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16 - Device: CPUabcde20406080100SE +/- 0.81, N = 15SE +/- 0.70, N = 1297.4389.3689.9491.1996.16MIN: 46.27 / MAX: 163.7MIN: 46.01 / MAX: 136.05MIN: 46.46 / MAX: 140.34MIN: 46.11 / MAX: 142.48MIN: 45.85 / MAX: 157.971. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPUabcde2004006008001000SE +/- 6.75, N = 15SE +/- 7.15, N = 151002.411059.771058.961045.93996.961. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPUabcde48121620SE +/- 0.11, N = 15SE +/- 0.12, N = 1516.5515.6315.6515.8216.64MIN: 6.65 / MAX: 34.71MIN: 7.37 / MAX: 26.39MIN: 7.08 / MAX: 26.33MIN: 6.52 / MAX: 29.45MIN: 7.02 / MAX: 37.411. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPUabcde306090120150SE +/- 1.16, N = 6SE +/- 1.39, N = 4118.81127.20127.70125.64119.741. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPUabcde1326395265SE +/- 0.58, N = 6SE +/- 0.67, N = 458.8454.9454.7355.6058.38MIN: 28.65 / MAX: 92.74MIN: 32.3 / MAX: 87.41MIN: 32.28 / MAX: 86.23MIN: 32.5 / MAX: 89.87MIN: 25.03 / MAX: 96.631. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPUabcde510152025SE +/- 0.20, N = 15SE +/- 0.15, N = 1519.6721.3921.4520.9419.861. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPUabcde80160240320400SE +/- 3.64, N = 15SE +/- 2.64, N = 15355.61326.60325.60333.51351.73MIN: 163.07 / MAX: 515.11MIN: 127.63 / MAX: 466.63MIN: 217.98 / MAX: 455.75MIN: 227.46 / MAX: 479.39MIN: 137.63 / MAX: 624.331. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPUabcde150300450600750SE +/- 5.15, N = 15SE +/- 5.14, N = 10643.51693.74693.66682.02653.791. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPUabcde612182430SE +/- 0.21, N = 15SE +/- 0.20, N = 1026.0124.1024.0924.4925.59MIN: 10.92 / MAX: 57.13MIN: 12.07 / MAX: 40.91MIN: 11.69 / MAX: 42.69MIN: 12.24 / MAX: 41.08MIN: 12.13 / MAX: 55.421. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPUabcde50100150200250SE +/- 1.67, N = 15SE +/- 1.91, N = 3230.73246.61246.59243.84231.801. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPUabcde714212835SE +/- 0.22, N = 15SE +/- 0.25, N = 330.2928.3128.3228.6430.13MIN: 13.26 / MAX: 59.59MIN: 17.01 / MAX: 55.63MIN: 17.27 / MAX: 57.04MIN: 16.72 / MAX: 56.71MIN: 14.67 / MAX: 57.691. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Noise Suppression Poconet-Like FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPUabcde80160240320400SE +/- 2.66, N = 15SE +/- 3.89, N = 15323.31345.96348.69337.29315.381. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Noise Suppression Poconet-Like FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPUabcde1224364860SE +/- 0.44, N = 15SE +/- 0.67, N = 1552.3248.8048.4250.0853.70MIN: 24.2 / MAX: 79.7MIN: 24.49 / MAX: 74.38MIN: 24.4 / MAX: 71.85MIN: 24.33 / MAX: 73.52MIN: 24.32 / MAX: 89.771. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16 - Device: CPUabcde20406080100SE +/- 0.70, N = 10SE +/- 0.61, N = 390.8895.1595.3492.5288.601. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16 - Device: CPUabcde4080120160200SE +/- 1.41, N = 10SE +/- 1.32, N = 3186.71178.24177.81183.28191.36MIN: 101.83 / MAX: 274.05MIN: 101.95 / MAX: 247.18MIN: 102.85 / MAX: 239.14MIN: 101.8 / MAX: 248.36MIN: 101.79 / MAX: 268.91. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Re-Identification Retail FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPUabcde60120180240300SE +/- 2.88, N = 4SE +/- 2.45, N = 6256.36265.61267.31257.64252.961. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Re-Identification Retail FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPUabcde612182430SE +/- 0.31, N = 4SE +/- 0.27, N = 627.2426.2826.1227.0927.61MIN: 15.08 / MAX: 47.91MIN: 16.16 / MAX: 43.57MIN: 15.46 / MAX: 41.86MIN: 15.78 / MAX: 43.25MIN: 11.88 / MAX: 54.331. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUabcde11002200330044005500SE +/- 39.34, N = 3SE +/- 46.64, N = 64823.264958.114962.194908.524709.821. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUabcde0.76281.52562.28843.05123.814SE +/- 0.03, N = 3SE +/- 0.03, N = 63.313.233.223.263.39MIN: 1.1 / MAX: 12.43MIN: 1.1 / MAX: 8.44MIN: 1.04 / MAX: 15.36MIN: 1.04 / MAX: 8MIN: 1.06 / MAX: 14.991. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPUabcde306090120150SE +/- 1.48, N = 3SE +/- 0.83, N = 15108.71111.60112.21111.29105.701. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPUabcde4080120160200SE +/- 2.14, N = 3SE +/- 1.27, N = 15156.10152.02151.19152.48160.66MIN: 89.74 / MAX: 233.97MIN: 88.01 / MAX: 226.83MIN: 89.51 / MAX: 211.52MIN: 89.77 / MAX: 219.3MIN: 88.95 / MAX: 239.441. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUabcde3K6K9K12K15KSE +/- 151.02, N = 4SE +/- 146.93, N = 312466.9912915.8712894.5412467.6012467.501. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUabcde0.28580.57160.85741.14321.429SE +/- 0.02, N = 4SE +/- 0.01, N = 31.271.221.221.261.27MIN: 0.38 / MAX: 11.64MIN: 0.39 / MAX: 6.57MIN: 0.4 / MAX: 5.49MIN: 0.4 / MAX: 6.52MIN: 0.38 / MAX: 12.951. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Phoronix Test Suite v10.8.4