openvino 2024

Intel Core i9-14900K testing with a ASUS PRIME Z790-P WIFI (1402 BIOS) and ASUS Intel RPL-S 31GB on Ubuntu 23.10 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2403078-PTS-OPENVINO47&grs&sor.

openvino 2024ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorOSKernelDesktopDisplay ServerOpenGLOpenCLCompilerFile-SystemScreen ResolutionabcdIntel Core i9-14900K @ 5.70GHz (24 Cores / 32 Threads)ASUS PRIME Z790-P WIFI (1402 BIOS)Intel Device 7a272 x 16GB DRAM-6000MT/s Corsair CMK32GX5M2B6000C36Western Digital WD_BLACK SN850X 1000GBASUS Intel RPL-S 31GB (1650MHz)Realtek ALC897ASUS VP28UUbuntu 23.106.7.0-060700rc7daily20231224-generic (x86_64)GNOME Shell 45.1X Server 1.21.1.74.6 Mesa 24.0~git2312240600.c05261~oibaf~m (git-c05261a 2023-12-24 mantic-oibaf-ppa)OpenCL 3.0GCC 13.2.0ext41920x1080OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate powersave (EPP: performance) - CPU Microcode: 0x11d - Thermald 2.5.4Python Details- Python 3.11.6Security Details- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

openvino 2024openvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Face Detection Retail FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUabcd145.3354.935.541431.13679.7011.69352.1168.051794.4355.47143.8921.62368.478.9522.92878.051036.42123.8864.521.511562.69124.9663.915.0814614.4837990.69359.1222.1918.55545.8443.55300.1879.809.52430.29828.4413.028.332769.950.57145.4754.855.551431.83679.9211.69353.9167.701807.9155.03145.0621.52370.478.9422.92880.341036.04123.0264.951.521569.94124.6664.075.0614529.6438013.05359.9622.1418.57548.7443.34301.7079.419.48429.54828.9113.008.322771.590.57144.5255.225.611418.37675.9011.76354.0767.661791.9655.42144.0421.63368.588.9322.89880.301037.16123.6664.611.511560.24125.4263.695.0914538.0137977.98360.6722.1018.53548.0343.38301.6279.419.50430.40829.2913.038.322770.840.57147.254.235.641409.95672.6511.81355.5267.411791.0354.98145.1321.45371.528.8822.75884.451043.4123.4464.711.511569.18124.7564.045.0614593.4638193.92358.6422.2218.63548.4443.32301.1179.559.5428.9783113.028.322772.320.57OpenBenchmarking.org

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Detection FP32 - Device: CPUcabd306090120150SE +/- 0.23, N = 3SE +/- 2.13, N = 3SE +/- 0.79, N = 3144.52145.33145.47147.20MIN: 64.95 / MAX: 367.87MIN: 71.2 / MAX: 360.27MIN: 68.34 / MAX: 419.01MIN: 107.25 / MAX: 337.031. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Detection FP32 - Device: CPUcabd1224364860SE +/- 0.10, N = 3SE +/- 0.78, N = 3SE +/- 0.29, N = 355.2254.9354.8554.231. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection FP16 - Device: CPUdcba1.2692.5383.8075.0766.345SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 45.645.615.555.541. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection FP16 - Device: CPUdcab30060090012001500SE +/- 15.78, N = 3SE +/- 12.71, N = 4SE +/- 13.01, N = 31409.951418.371431.131431.83MIN: 1082.33 / MAX: 2001.47MIN: 1085.81 / MAX: 2027.91MIN: 605.23 / MAX: 2285.53MIN: 1082.62 / MAX: 2031.971. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPUbacd150300450600750SE +/- 3.96, N = 3SE +/- 3.82, N = 3SE +/- 3.61, N = 3679.92679.70675.90672.651. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPUabcd3691215SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 311.6911.6911.7611.81MIN: 4.9 / MAX: 58.96MIN: 5.25 / MAX: 61.44MIN: 5.18 / MAX: 59.34MIN: 5.07 / MAX: 58.591. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPUdcba80160240320400SE +/- 1.54, N = 3SE +/- 1.22, N = 3SE +/- 1.31, N = 3355.52354.07353.91352.111. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPUdcba1530456075SE +/- 0.30, N = 3SE +/- 0.24, N = 3SE +/- 0.26, N = 367.4167.6667.7068.05MIN: 46.04 / MAX: 238.59MIN: 41.62 / MAX: 242.27MIN: 41.88 / MAX: 256.01MIN: 43.11 / MAX: 237.321. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPUbacd400800120016002000SE +/- 9.52, N = 3SE +/- 1.23, N = 3SE +/- 2.14, N = 31807.911794.431791.961791.031. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPUacbd1224364860SE +/- 0.59, N = 3SE +/- 0.41, N = 3SE +/- 0.34, N = 355.4755.4255.0354.981. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPUacbd306090120150SE +/- 1.52, N = 3SE +/- 1.08, N = 3SE +/- 0.90, N = 3143.89144.04145.06145.13MIN: 102.76 / MAX: 364.23MIN: 103.76 / MAX: 357.67MIN: 104.99 / MAX: 332.47MIN: 61.17 / MAX: 331.831. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPUdbac510152025SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.07, N = 321.4521.5221.6221.63MIN: 11.1 / MAX: 130.92MIN: 9.3 / MAX: 140.98MIN: 10.64 / MAX: 138.55MIN: 10.36 / MAX: 139.061. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPUdbca80160240320400SE +/- 0.92, N = 3SE +/- 1.20, N = 3SE +/- 0.66, N = 3371.52370.47368.58368.471. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPUdcba3691215SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 38.888.938.948.95MIN: 3.79 / MAX: 62.98MIN: 3.76 / MAX: 63.07MIN: 3.61 / MAX: 64.78MIN: 3.77 / MAX: 63.031. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Noise Suppression Poconet-Like FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPUdcab510152025SE +/- 0.02, N = 3SE +/- 0.08, N = 3SE +/- 0.01, N = 322.7522.8922.9222.92MIN: 13.27 / MAX: 84.75MIN: 16.2 / MAX: 85.68MIN: 12.82 / MAX: 88.3MIN: 12.52 / MAX: 85.71. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPUdbca2004006008001000SE +/- 3.18, N = 3SE +/- 2.34, N = 3SE +/- 1.46, N = 3884.45880.34880.30878.051. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Noise Suppression Poconet-Like FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPUdcab2004006008001000SE +/- 0.95, N = 3SE +/- 3.66, N = 3SE +/- 0.29, N = 31043.401037.161036.421036.041. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPUbdca306090120150SE +/- 0.60, N = 3SE +/- 0.29, N = 3SE +/- 0.15, N = 3123.02123.44123.66123.88MIN: 71.26 / MAX: 344.75MIN: 82.38 / MAX: 360.11MIN: 83.99 / MAX: 339.58MIN: 80.92 / MAX: 345.321. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPUbdca1428425670SE +/- 0.29, N = 3SE +/- 0.15, N = 3SE +/- 0.08, N = 364.9564.7164.6164.521. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUacdb0.3420.6841.0261.3681.71SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.511.511.511.52MIN: 0.67 / MAX: 8.28MIN: 0.68 / MAX: 10.22MIN: 0.69 / MAX: 8.28MIN: 0.68 / MAX: 8.231. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16 - Device: CPUbdac30060090012001500SE +/- 7.83, N = 3SE +/- 12.14, N = 3SE +/- 9.44, N = 31569.941569.181562.691560.241. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16 - Device: CPUcadb306090120150SE +/- 0.08, N = 3SE +/- 0.10, N = 3SE +/- 0.50, N = 3125.42124.96124.75124.661. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16 - Device: CPUcadb1428425670SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.26, N = 363.6963.9164.0464.07MIN: 16.35 / MAX: 179.48MIN: 16.56 / MAX: 179.66MIN: 20.67 / MAX: 176.81MIN: 16.45 / MAX: 185.41. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16 - Device: CPUbdac1.14532.29063.43594.58125.7265SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 35.065.065.085.09MIN: 1.96 / MAX: 30.61MIN: 2.02 / MAX: 31.5MIN: 2 / MAX: 30.7MIN: 1.97 / MAX: 30.61. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUadcb3K6K9K12K15KSE +/- 11.80, N = 3SE +/- 8.93, N = 3SE +/- 42.40, N = 314614.4814593.4614538.0114529.641. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUdbac8K16K24K32K40KSE +/- 66.76, N = 3SE +/- 92.87, N = 3SE +/- 41.99, N = 338193.9238013.0537990.6937977.981. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16 - Device: CPUcbad80160240320400SE +/- 0.80, N = 3SE +/- 0.80, N = 3SE +/- 0.77, N = 3360.67359.96359.12358.641. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16 - Device: CPUcbad510152025SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 322.1022.1422.1922.22MIN: 8.57 / MAX: 94.59MIN: 10.45 / MAX: 95.33MIN: 8.4 / MAX: 93.5MIN: 8.85 / MAX: 89.641. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPUdbac510152025SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 318.6318.5718.5518.531. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16 - Device: CPUbdca120240360480600SE +/- 1.71, N = 3SE +/- 1.63, N = 3SE +/- 1.65, N = 3548.74548.44548.03545.841. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16 - Device: CPUdbca1020304050SE +/- 0.14, N = 3SE +/- 0.13, N = 3SE +/- 0.13, N = 343.3243.3443.3843.55MIN: 23.33 / MAX: 168.29MIN: 22.94 / MAX: 153.89MIN: 30.58 / MAX: 167.2MIN: 27.71 / MAX: 168.541. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16 - Device: CPUbcda70140210280350SE +/- 1.69, N = 3SE +/- 1.02, N = 3SE +/- 1.26, N = 3301.70301.62301.11300.181. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16 - Device: CPUbcda20406080100SE +/- 0.44, N = 3SE +/- 0.27, N = 3SE +/- 0.33, N = 379.4179.4179.5579.80MIN: 51.94 / MAX: 280.13MIN: 50.66 / MAX: 284.03MIN: 53.81 / MAX: 254.14MIN: 47.2 / MAX: 301.271. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Re-Identification Retail FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPUbcda3691215SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 39.489.509.509.52MIN: 3.92 / MAX: 63.93MIN: 3.91 / MAX: 57.65MIN: 4.01 / MAX: 56.18MIN: 3.74 / MAX: 55.081. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPUdbac90180270360450SE +/- 0.40, N = 3SE +/- 0.18, N = 3SE +/- 0.49, N = 3428.97429.54430.29430.40MIN: 257.33 / MAX: 1070.48MIN: 257.8 / MAX: 1074.48MIN: 257.52 / MAX: 1279.77MIN: 257.56 / MAX: 1108.131. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Re-Identification Retail FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPUdcba2004006008001000SE +/- 1.98, N = 3SE +/- 0.77, N = 3SE +/- 1.67, N = 3831.00829.29828.91828.441. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPUbadc3691215SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 313.0013.0213.0213.03MIN: 6.29 / MAX: 87.94MIN: 6.59 / MAX: 76.06MIN: 6.66 / MAX: 73.73MIN: 6.57 / MAX: 80.021. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPUbcda246810SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 38.328.328.328.33MIN: 4.14 / MAX: 42.15MIN: 4.19 / MAX: 44.33MIN: 4.24 / MAX: 45.21MIN: 4.31 / MAX: 43.341. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPUdbca6001200180024003000SE +/- 3.98, N = 3SE +/- 1.46, N = 3SE +/- 2.31, N = 32772.322771.592770.842769.951. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUabcd0.12830.25660.38490.51320.6415SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.570.570.570.57MIN: 0.26 / MAX: 7.31MIN: 0.26 / MAX: 6.35MIN: 0.26 / MAX: 5.44MIN: 0.26 / MAX: 5.161. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Phoronix Test Suite v10.8.5