Intel Core i9-14900K testing with a ASUS PRIME Z790-P WIFI (1402 BIOS) and ASUS Intel RPL-S 31GB on Ubuntu 23.10 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2403078-PTS-OPENVINO47 openvino 2024 - Phoronix Test Suite openvino 2024 Intel Core i9-14900K testing with a ASUS PRIME Z790-P WIFI (1402 BIOS) and ASUS Intel RPL-S 31GB on Ubuntu 23.10 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2403078-PTS-OPENVINO47&grs&rdt .
openvino 2024 Processor Motherboard Chipset Memory Disk Graphics Audio Monitor OS Kernel Desktop Display Server OpenGL OpenCL Compiler File-System Screen Resolution a b c d Intel Core i9-14900K @ 5.70GHz (24 Cores / 32 Threads) ASUS PRIME Z790-P WIFI (1402 BIOS) Intel Device 7a27 2 x 16GB DRAM-6000MT/s Corsair CMK32GX5M2B6000C36 Western Digital WD_BLACK SN850X 1000GB ASUS Intel RPL-S 31GB (1650MHz) Realtek ALC897 ASUS VP28U Ubuntu 23.10 6.7.0-060700rc7daily20231224-generic (x86_64) GNOME Shell 45.1 X Server 1.21.1.7 4.6 Mesa 24.0~git2312240600.c05261~oibaf~m (git-c05261a 2023-12-24 mantic-oibaf-ppa) OpenCL 3.0 GCC 13.2.0 ext4 1920x1080 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: intel_pstate powersave (EPP: performance) - CPU Microcode: 0x11d - Thermald 2.5.4 Python Details - Python 3.11.6 Security Details - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
openvino 2024 openvino: Person Detection FP32 - CPU openvino: Person Detection FP32 - CPU openvino: Face Detection FP16 - CPU openvino: Face Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Handwritten English Recognition FP16-INT8 - CPU openvino: Handwritten English Recognition FP16-INT8 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Road Segmentation ADAS FP16-INT8 - CPU openvino: Road Segmentation ADAS FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Noise Suppression Poconet-Like FP16 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Noise Suppression Poconet-Like FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Face Detection Retail FP16 - CPU openvino: Road Segmentation ADAS FP16 - CPU openvino: Road Segmentation ADAS FP16 - CPU openvino: Face Detection Retail FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Handwritten English Recognition FP16 - CPU openvino: Handwritten English Recognition FP16 - CPU openvino: Person Re-Identification Retail FP16 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Person Re-Identification Retail FP16 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Face Detection Retail FP16-INT8 - CPU openvino: Face Detection Retail FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU a b c d 145.33 54.93 5.54 1431.13 679.70 11.69 352.11 68.05 1794.43 55.47 143.89 21.62 368.47 8.95 22.92 878.05 1036.42 123.88 64.52 1.51 1562.69 124.96 63.91 5.08 14614.48 37990.69 359.12 22.19 18.55 545.84 43.55 300.18 79.80 9.52 430.29 828.44 13.02 8.33 2769.95 0.57 145.47 54.85 5.55 1431.83 679.92 11.69 353.91 67.70 1807.91 55.03 145.06 21.52 370.47 8.94 22.92 880.34 1036.04 123.02 64.95 1.52 1569.94 124.66 64.07 5.06 14529.64 38013.05 359.96 22.14 18.57 548.74 43.34 301.70 79.41 9.48 429.54 828.91 13.00 8.32 2771.59 0.57 144.52 55.22 5.61 1418.37 675.90 11.76 354.07 67.66 1791.96 55.42 144.04 21.63 368.58 8.93 22.89 880.30 1037.16 123.66 64.61 1.51 1560.24 125.42 63.69 5.09 14538.01 37977.98 360.67 22.10 18.53 548.03 43.38 301.62 79.41 9.50 430.40 829.29 13.03 8.32 2770.84 0.57 147.2 54.23 5.64 1409.95 672.65 11.81 355.52 67.41 1791.03 54.98 145.13 21.45 371.52 8.88 22.75 884.45 1043.4 123.44 64.71 1.51 1569.18 124.75 64.04 5.06 14593.46 38193.92 358.64 22.22 18.63 548.44 43.32 301.11 79.55 9.5 428.97 831 13.02 8.32 2772.32 0.57 OpenBenchmarking.org
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Detection FP32 - Device: CPU a b c d 30 60 90 120 150 SE +/- 2.13, N = 3 SE +/- 0.79, N = 3 SE +/- 0.23, N = 3 145.33 145.47 144.52 147.20 MIN: 71.2 / MAX: 360.27 MIN: 68.34 / MAX: 419.01 MIN: 64.95 / MAX: 367.87 MIN: 107.25 / MAX: 337.03 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Detection FP32 - Device: CPU a b c d 12 24 36 48 60 SE +/- 0.78, N = 3 SE +/- 0.29, N = 3 SE +/- 0.10, N = 3 54.93 54.85 55.22 54.23 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Face Detection FP16 - Device: CPU a b c d 1.269 2.538 3.807 5.076 6.345 SE +/- 0.06, N = 4 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 5.54 5.55 5.61 5.64 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Face Detection FP16 - Device: CPU a b c d 300 600 900 1200 1500 SE +/- 12.71, N = 4 SE +/- 13.01, N = 3 SE +/- 15.78, N = 3 1431.13 1431.83 1418.37 1409.95 MIN: 605.23 / MAX: 2285.53 MIN: 1082.62 / MAX: 2031.97 MIN: 1085.81 / MAX: 2027.91 MIN: 1082.33 / MAX: 2001.47 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU a b c d 150 300 450 600 750 SE +/- 3.82, N = 3 SE +/- 3.96, N = 3 SE +/- 3.61, N = 3 679.70 679.92 675.90 672.65 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU a b c d 3 6 9 12 15 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 SE +/- 0.07, N = 3 11.69 11.69 11.76 11.81 MIN: 4.9 / MAX: 58.96 MIN: 5.25 / MAX: 61.44 MIN: 5.18 / MAX: 59.34 MIN: 5.07 / MAX: 58.59 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Handwritten English Recognition FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU a b c d 80 160 240 320 400 SE +/- 1.31, N = 3 SE +/- 1.22, N = 3 SE +/- 1.54, N = 3 352.11 353.91 354.07 355.52 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Handwritten English Recognition FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU a b c d 15 30 45 60 75 SE +/- 0.26, N = 3 SE +/- 0.24, N = 3 SE +/- 0.30, N = 3 68.05 67.70 67.66 67.41 MIN: 43.11 / MAX: 237.32 MIN: 41.88 / MAX: 256.01 MIN: 41.62 / MAX: 242.27 MIN: 46.04 / MAX: 238.59 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU a b c d 400 800 1200 1600 2000 SE +/- 1.23, N = 3 SE +/- 9.52, N = 3 SE +/- 2.14, N = 3 1794.43 1807.91 1791.96 1791.03 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU a b c d 12 24 36 48 60 SE +/- 0.59, N = 3 SE +/- 0.34, N = 3 SE +/- 0.41, N = 3 55.47 55.03 55.42 54.98 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU a b c d 30 60 90 120 150 SE +/- 1.52, N = 3 SE +/- 0.90, N = 3 SE +/- 1.08, N = 3 143.89 145.06 144.04 145.13 MIN: 102.76 / MAX: 364.23 MIN: 104.99 / MAX: 332.47 MIN: 103.76 / MAX: 357.67 MIN: 61.17 / MAX: 331.83 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Road Segmentation ADAS FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU a b c d 5 10 15 20 25 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 21.62 21.52 21.63 21.45 MIN: 10.64 / MAX: 138.55 MIN: 9.3 / MAX: 140.98 MIN: 10.36 / MAX: 139.06 MIN: 11.1 / MAX: 130.92 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Road Segmentation ADAS FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU a b c d 80 160 240 320 400 SE +/- 0.66, N = 3 SE +/- 0.92, N = 3 SE +/- 1.20, N = 3 368.47 370.47 368.58 371.52 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU a b c d 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 8.95 8.94 8.93 8.88 MIN: 3.77 / MAX: 63.03 MIN: 3.61 / MAX: 64.78 MIN: 3.76 / MAX: 63.07 MIN: 3.79 / MAX: 62.98 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Noise Suppression Poconet-Like FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU a b c d 5 10 15 20 25 SE +/- 0.08, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 22.92 22.92 22.89 22.75 MIN: 12.82 / MAX: 88.3 MIN: 12.52 / MAX: 85.7 MIN: 16.2 / MAX: 85.68 MIN: 13.27 / MAX: 84.75 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU a b c d 200 400 600 800 1000 SE +/- 1.46, N = 3 SE +/- 3.18, N = 3 SE +/- 2.34, N = 3 878.05 880.34 880.30 884.45 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Noise Suppression Poconet-Like FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU a b c d 200 400 600 800 1000 SE +/- 3.66, N = 3 SE +/- 0.29, N = 3 SE +/- 0.95, N = 3 1036.42 1036.04 1037.16 1043.40 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU a b c d 30 60 90 120 150 SE +/- 0.15, N = 3 SE +/- 0.60, N = 3 SE +/- 0.29, N = 3 123.88 123.02 123.66 123.44 MIN: 80.92 / MAX: 345.32 MIN: 71.26 / MAX: 344.75 MIN: 83.99 / MAX: 339.58 MIN: 82.38 / MAX: 360.11 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU a b c d 14 28 42 56 70 SE +/- 0.08, N = 3 SE +/- 0.29, N = 3 SE +/- 0.15, N = 3 64.52 64.95 64.61 64.71 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU a b c d 0.342 0.684 1.026 1.368 1.71 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 1.51 1.52 1.51 1.51 MIN: 0.67 / MAX: 8.28 MIN: 0.68 / MAX: 8.23 MIN: 0.68 / MAX: 10.22 MIN: 0.69 / MAX: 8.28 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection Retail FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Face Detection Retail FP16 - Device: CPU a b c d 300 600 900 1200 1500 SE +/- 12.14, N = 3 SE +/- 7.83, N = 3 SE +/- 9.44, N = 3 1562.69 1569.94 1560.24 1569.18 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Road Segmentation ADAS FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Road Segmentation ADAS FP16 - Device: CPU a b c d 30 60 90 120 150 SE +/- 0.10, N = 3 SE +/- 0.50, N = 3 SE +/- 0.08, N = 3 124.96 124.66 125.42 124.75 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Road Segmentation ADAS FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Road Segmentation ADAS FP16 - Device: CPU a b c d 14 28 42 56 70 SE +/- 0.04, N = 3 SE +/- 0.26, N = 3 SE +/- 0.05, N = 3 63.91 64.07 63.69 64.04 MIN: 16.56 / MAX: 179.66 MIN: 16.45 / MAX: 185.4 MIN: 16.35 / MAX: 179.48 MIN: 20.67 / MAX: 176.81 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection Retail FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Face Detection Retail FP16 - Device: CPU a b c d 1.1453 2.2906 3.4359 4.5812 5.7265 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 5.08 5.06 5.09 5.06 MIN: 2 / MAX: 30.7 MIN: 1.96 / MAX: 30.61 MIN: 1.97 / MAX: 30.6 MIN: 2.02 / MAX: 31.5 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU a b c d 3K 6K 9K 12K 15K SE +/- 11.80, N = 3 SE +/- 42.40, N = 3 SE +/- 8.93, N = 3 14614.48 14529.64 14538.01 14593.46 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU a b c d 8K 16K 24K 32K 40K SE +/- 92.87, N = 3 SE +/- 66.76, N = 3 SE +/- 41.99, N = 3 37990.69 38013.05 37977.98 38193.92 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Vehicle Detection FP16 - Device: CPU a b c d 80 160 240 320 400 SE +/- 0.77, N = 3 SE +/- 0.80, N = 3 SE +/- 0.80, N = 3 359.12 359.96 360.67 358.64 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Vehicle Detection FP16 - Device: CPU a b c d 5 10 15 20 25 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 22.19 22.14 22.10 22.22 MIN: 8.4 / MAX: 93.5 MIN: 10.45 / MAX: 95.33 MIN: 8.57 / MAX: 94.59 MIN: 8.85 / MAX: 89.64 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU a b c d 5 10 15 20 25 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 18.55 18.57 18.53 18.63 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Weld Porosity Detection FP16 - Device: CPU a b c d 120 240 360 480 600 SE +/- 1.65, N = 3 SE +/- 1.71, N = 3 SE +/- 1.63, N = 3 545.84 548.74 548.03 548.44 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Weld Porosity Detection FP16 - Device: CPU a b c d 10 20 30 40 50 SE +/- 0.13, N = 3 SE +/- 0.14, N = 3 SE +/- 0.13, N = 3 43.55 43.34 43.38 43.32 MIN: 27.71 / MAX: 168.54 MIN: 22.94 / MAX: 153.89 MIN: 30.58 / MAX: 167.2 MIN: 23.33 / MAX: 168.29 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Handwritten English Recognition FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16 - Device: CPU a b c d 70 140 210 280 350 SE +/- 1.26, N = 3 SE +/- 1.69, N = 3 SE +/- 1.02, N = 3 300.18 301.70 301.62 301.11 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Handwritten English Recognition FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16 - Device: CPU a b c d 20 40 60 80 100 SE +/- 0.33, N = 3 SE +/- 0.44, N = 3 SE +/- 0.27, N = 3 79.80 79.41 79.41 79.55 MIN: 47.2 / MAX: 301.27 MIN: 51.94 / MAX: 280.13 MIN: 50.66 / MAX: 284.03 MIN: 53.81 / MAX: 254.14 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Re-Identification Retail FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU a b c d 3 6 9 12 15 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 9.52 9.48 9.50 9.50 MIN: 3.74 / MAX: 55.08 MIN: 3.92 / MAX: 63.93 MIN: 3.91 / MAX: 57.65 MIN: 4.01 / MAX: 56.18 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU a b c d 90 180 270 360 450 SE +/- 0.18, N = 3 SE +/- 0.40, N = 3 SE +/- 0.49, N = 3 430.29 429.54 430.40 428.97 MIN: 257.52 / MAX: 1279.77 MIN: 257.8 / MAX: 1074.48 MIN: 257.56 / MAX: 1108.13 MIN: 257.33 / MAX: 1070.48 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Re-Identification Retail FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU a b c d 200 400 600 800 1000 SE +/- 1.67, N = 3 SE +/- 0.77, N = 3 SE +/- 1.98, N = 3 828.44 828.91 829.29 831.00 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU a b c d 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 13.02 13.00 13.03 13.02 MIN: 6.59 / MAX: 76.06 MIN: 6.29 / MAX: 87.94 MIN: 6.57 / MAX: 80.02 MIN: 6.66 / MAX: 73.73 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection Retail FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU a b c d 2 4 6 8 10 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 8.33 8.32 8.32 8.32 MIN: 4.31 / MAX: 43.34 MIN: 4.14 / MAX: 42.15 MIN: 4.19 / MAX: 44.33 MIN: 4.24 / MAX: 45.21 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection Retail FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU a b c d 600 1200 1800 2400 3000 SE +/- 2.31, N = 3 SE +/- 3.98, N = 3 SE +/- 1.46, N = 3 2769.95 2771.59 2770.84 2772.32 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU a b c d 0.1283 0.2566 0.3849 0.5132 0.6415 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.57 0.57 0.57 0.57 MIN: 0.26 / MAX: 7.31 MIN: 0.26 / MAX: 6.35 MIN: 0.26 / MAX: 5.44 MIN: 0.26 / MAX: 5.16 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Phoronix Test Suite v10.8.4