Intel Core Ultra 7 155H testing with a MTL Swift SFG14-72T Coral_MTH (V1.01 BIOS) and Intel Arc MTL 8GB on Ubuntu 23.10 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2403078-NE-OPENVINO276 openvino-2024 - Phoronix Test Suite openvino-2024 Intel Core Ultra 7 155H testing with a MTL Swift SFG14-72T Coral_MTH (V1.01 BIOS) and Intel Arc MTL 8GB on Ubuntu 23.10 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2403078-NE-OPENVINO276&rdt&grs&export=pdf .
openvino-2024 Processor Motherboard Chipset Memory Disk Graphics Audio Network OS Kernel Desktop Display Server OpenGL Compiler File-System Screen Resolution a b c d e Intel Core Ultra 7 155H @ 4.80GHz (16 Cores / 22 Threads) MTL Swift SFG14-72T Coral_MTH (V1.01 BIOS) Intel Device 7e7f 8 x 2GB DRAM-6400MT/s Micron MT62F1G32D2DS-026 1024GB Micron_2550_MTFDKBA1T0TGE Intel Arc MTL 8GB (2250MHz) Intel Meteor Lake-P HD Audio Intel Device 7e40 Ubuntu 23.10 6.8.0-060800rc1daily20240126-generic (x86_64) GNOME Shell 45.2 X Server 1.21.1.7 + Wayland 4.6 Mesa 24.1~git2401200600.ebcab1~oibaf~m (git-ebcab14 2024-01-20 mantic-oibaf-ppa) GCC 13.2.0 ext4 1920x1200 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x13 - Thermald 2.5.4 Python Details - Python 3.11.6 Security Details - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
openvino-2024 openvino: Person Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Person Detection FP32 - CPU openvino: Person Detection FP32 - CPU openvino: Face Detection Retail FP16 - CPU openvino: Face Detection Retail FP16 - CPU openvino: Noise Suppression Poconet-Like FP16 - CPU openvino: Face Detection FP16 - CPU openvino: Noise Suppression Poconet-Like FP16 - CPU openvino: Face Detection FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Handwritten English Recognition FP16 - CPU openvino: Handwritten English Recognition FP16 - CPU openvino: Road Segmentation ADAS FP16-INT8 - CPU openvino: Road Segmentation ADAS FP16-INT8 - CPU openvino: Road Segmentation ADAS FP16 - CPU openvino: Road Segmentation ADAS FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Face Detection Retail FP16-INT8 - CPU openvino: Face Detection Retail FP16-INT8 - CPU openvino: Handwritten English Recognition FP16-INT8 - CPU openvino: Handwritten English Recognition FP16-INT8 - CPU openvino: Person Re-Identification Retail FP16 - CPU openvino: Person Re-Identification Retail FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU a b c d e 341.26 20.47 47.86 146.15 349.78 19.97 15.36 454.19 52.32 1.82 323.31 3797.30 355.61 19.67 97.43 173.86 24.88 280.81 6.33 26.01 1099.33 643.51 186.71 90.88 58.84 118.81 104.86 66.70 30.29 230.73 16.55 1002.41 156.10 108.71 27.24 256.36 4823.26 3.31 1.27 12466.99 317.45 22.01 42.72 163.56 325.82 21.43 13.9 501.53 48.8 1.91 345.96 3557.43 326.6 21.39 89.36 189.19 22.95 304.16 6.82 24.1 1021.76 693.74 178.24 95.15 54.94 127.2 97.9 71.39 28.31 246.61 15.63 1059.77 152.02 111.6 26.28 265.61 4958.11 3.23 1.22 12915.87 318.02 21.97 42.78 163.33 326.38 21.41 13.75 506.76 48.42 1.95 348.69 3543.9 325.6 21.45 89.94 188.18 22.93 304.5 6.76 24.09 1023.44 693.66 177.81 95.34 54.73 127.7 97.67 71.56 28.32 246.59 15.65 1058.96 151.19 112.21 26.12 267.31 4962.19 3.22 1.22 12894.54 321.69 21.68 43.75 159.69 331.48 21.07 14.13 493.14 50.08 1.91 337.29 3562.54 333.51 20.94 91.19 185.52 23.33 299.19 6.74 24.49 1030.08 682.02 183.28 92.52 55.6 125.64 99.52 70.24 28.64 243.84 15.82 1045.93 152.48 111.29 27.09 257.64 4908.52 3.26 1.26 12467.6 359.37 19.46 48.22 145.05 366.10 19.10 15.31 455.74 53.70 1.76 315.38 3912.27 351.73 19.86 96.16 176.09 24.75 282.22 6.30 25.59 1103.12 653.79 191.36 88.60 58.38 119.74 103.88 67.33 30.13 231.80 16.64 996.96 160.66 105.70 27.61 252.96 4709.82 3.39 1.27 12467.50 OpenBenchmarking.org
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU a b c d e 80 160 240 320 400 SE +/- 3.98, N = 3 SE +/- 3.72, N = 15 341.26 317.45 318.02 321.69 359.37 MIN: 177.09 / MAX: 488.59 MIN: 224.7 / MAX: 464.25 MIN: 175.18 / MAX: 464.55 MIN: 228.05 / MAX: 462.91 MIN: 181.92 / MAX: 496.2 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU a b c d e 5 10 15 20 25 SE +/- 0.23, N = 3 SE +/- 0.20, N = 15 20.47 22.01 21.97 21.68 19.46 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Vehicle Detection FP16 - Device: CPU a b c d e 11 22 33 44 55 SE +/- 0.40, N = 15 SE +/- 0.40, N = 15 47.86 42.72 42.78 43.75 48.22 MIN: 18.18 / MAX: 104.89 MIN: 23.22 / MAX: 67.87 MIN: 19.12 / MAX: 66.42 MIN: 23.92 / MAX: 118.28 MIN: 21.22 / MAX: 118.95 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Vehicle Detection FP16 - Device: CPU a b c d e 40 80 120 160 200 SE +/- 1.22, N = 15 SE +/- 1.21, N = 15 146.15 163.56 163.33 159.69 145.05 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Detection FP32 - Device: CPU a b c d e 80 160 240 320 400 SE +/- 4.98, N = 3 SE +/- 3.98, N = 15 349.78 325.82 326.38 331.48 366.10 MIN: 176.64 / MAX: 492.35 MIN: 220.85 / MAX: 464.29 MIN: 225.82 / MAX: 460.08 MIN: 221.77 / MAX: 461.89 MIN: 173.32 / MAX: 500.3 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Detection FP32 - Device: CPU a b c d e 5 10 15 20 25 SE +/- 0.27, N = 3 SE +/- 0.21, N = 15 19.97 21.43 21.41 21.07 19.10 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection Retail FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Face Detection Retail FP16 - Device: CPU a b c d e 4 8 12 16 20 SE +/- 0.17, N = 5 SE +/- 0.13, N = 15 15.36 13.90 13.75 14.13 15.31 MIN: 6.94 / MAX: 39.47 MIN: 7.85 / MAX: 35.11 MIN: 7.71 / MAX: 30.86 MIN: 8.44 / MAX: 37.62 MIN: 6.83 / MAX: 39.1 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection Retail FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Face Detection Retail FP16 - Device: CPU a b c d e 110 220 330 440 550 SE +/- 4.97, N = 5 SE +/- 3.85, N = 15 454.19 501.53 506.76 493.14 455.74 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Noise Suppression Poconet-Like FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU a b c d e 12 24 36 48 60 SE +/- 0.44, N = 15 SE +/- 0.67, N = 15 52.32 48.80 48.42 50.08 53.70 MIN: 24.2 / MAX: 79.7 MIN: 24.49 / MAX: 74.38 MIN: 24.4 / MAX: 71.85 MIN: 24.33 / MAX: 73.52 MIN: 24.32 / MAX: 89.77 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Face Detection FP16 - Device: CPU a b c d e 0.4388 0.8776 1.3164 1.7552 2.194 SE +/- 0.02, N = 8 SE +/- 0.01, N = 15 1.82 1.91 1.95 1.91 1.76 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Noise Suppression Poconet-Like FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU a b c d e 80 160 240 320 400 SE +/- 2.66, N = 15 SE +/- 3.89, N = 15 323.31 345.96 348.69 337.29 315.38 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Face Detection FP16 - Device: CPU a b c d e 800 1600 2400 3200 4000 SE +/- 32.88, N = 8 SE +/- 31.91, N = 15 3797.30 3557.43 3543.90 3562.54 3912.27 MIN: 1742.11 / MAX: 5264.59 MIN: 2757.58 / MAX: 5221.58 MIN: 2743.85 / MAX: 5185.69 MIN: 1816.87 / MAX: 5174.72 MIN: 2798.1 / MAX: 5581.53 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU a b c d e 80 160 240 320 400 SE +/- 3.64, N = 15 SE +/- 2.64, N = 15 355.61 326.60 325.60 333.51 351.73 MIN: 163.07 / MAX: 515.11 MIN: 127.63 / MAX: 466.63 MIN: 217.98 / MAX: 455.75 MIN: 227.46 / MAX: 479.39 MIN: 137.63 / MAX: 624.33 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU a b c d e 5 10 15 20 25 SE +/- 0.20, N = 15 SE +/- 0.15, N = 15 19.67 21.39 21.45 20.94 19.86 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Weld Porosity Detection FP16 - Device: CPU a b c d e 20 40 60 80 100 SE +/- 0.81, N = 15 SE +/- 0.70, N = 12 97.43 89.36 89.94 91.19 96.16 MIN: 46.27 / MAX: 163.7 MIN: 46.01 / MAX: 136.05 MIN: 46.46 / MAX: 140.34 MIN: 46.11 / MAX: 142.48 MIN: 45.85 / MAX: 157.97 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Weld Porosity Detection FP16 - Device: CPU a b c d e 40 80 120 160 200 SE +/- 1.41, N = 15 SE +/- 1.26, N = 12 173.86 189.19 188.18 185.52 176.09 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU a b c d e 6 12 18 24 30 SE +/- 0.20, N = 15 SE +/- 0.18, N = 15 24.88 22.95 22.93 23.33 24.75 MIN: 12.66 / MAX: 47.23 MIN: 11.9 / MAX: 43.97 MIN: 11.91 / MAX: 43.96 MIN: 13.63 / MAX: 40.97 MIN: 11.42 / MAX: 47.13 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU a b c d e 70 140 210 280 350 SE +/- 2.21, N = 15 SE +/- 2.03, N = 15 280.81 304.16 304.50 299.19 282.22 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU a b c d e 2 4 6 8 10 SE +/- 0.05, N = 15 SE +/- 0.04, N = 13 6.33 6.82 6.76 6.74 6.30 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU a b c d e 6 12 18 24 30 SE +/- 0.21, N = 15 SE +/- 0.20, N = 10 26.01 24.10 24.09 24.49 25.59 MIN: 10.92 / MAX: 57.13 MIN: 12.07 / MAX: 40.91 MIN: 11.69 / MAX: 42.69 MIN: 12.24 / MAX: 41.08 MIN: 12.13 / MAX: 55.42 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU a b c d e 200 400 600 800 1000 SE +/- 9.38, N = 15 SE +/- 7.33, N = 13 1099.33 1021.76 1023.44 1030.08 1103.12 MIN: 459.81 / MAX: 1740.17 MIN: 721.29 / MAX: 1599.18 MIN: 727.38 / MAX: 1604.26 MIN: 733.36 / MAX: 1612.47 MIN: 406.78 / MAX: 1728.53 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU a b c d e 150 300 450 600 750 SE +/- 5.15, N = 15 SE +/- 5.14, N = 10 643.51 693.74 693.66 682.02 653.79 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Handwritten English Recognition FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16 - Device: CPU a b c d e 40 80 120 160 200 SE +/- 1.41, N = 10 SE +/- 1.32, N = 3 186.71 178.24 177.81 183.28 191.36 MIN: 101.83 / MAX: 274.05 MIN: 101.95 / MAX: 247.18 MIN: 102.85 / MAX: 239.14 MIN: 101.8 / MAX: 248.36 MIN: 101.79 / MAX: 268.9 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Handwritten English Recognition FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16 - Device: CPU a b c d e 20 40 60 80 100 SE +/- 0.70, N = 10 SE +/- 0.61, N = 3 90.88 95.15 95.34 92.52 88.60 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Road Segmentation ADAS FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU a b c d e 13 26 39 52 65 SE +/- 0.58, N = 6 SE +/- 0.67, N = 4 58.84 54.94 54.73 55.60 58.38 MIN: 28.65 / MAX: 92.74 MIN: 32.3 / MAX: 87.41 MIN: 32.28 / MAX: 86.23 MIN: 32.5 / MAX: 89.87 MIN: 25.03 / MAX: 96.63 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Road Segmentation ADAS FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU a b c d e 30 60 90 120 150 SE +/- 1.16, N = 6 SE +/- 1.39, N = 4 118.81 127.20 127.70 125.64 119.74 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Road Segmentation ADAS FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Road Segmentation ADAS FP16 - Device: CPU a b c d e 20 40 60 80 100 SE +/- 1.16, N = 4 SE +/- 1.04, N = 6 104.86 97.90 97.67 99.52 103.88 MIN: 43.38 / MAX: 358.76 MIN: 37.33 / MAX: 376.3 MIN: 51.53 / MAX: 347.08 MIN: 39.25 / MAX: 383.84 MIN: 44.02 / MAX: 396.62 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Road Segmentation ADAS FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Road Segmentation ADAS FP16 - Device: CPU a b c d e 16 32 48 64 80 SE +/- 0.75, N = 4 SE +/- 0.68, N = 6 66.70 71.39 71.56 70.24 67.33 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU a b c d e 7 14 21 28 35 SE +/- 0.22, N = 15 SE +/- 0.25, N = 3 30.29 28.31 28.32 28.64 30.13 MIN: 13.26 / MAX: 59.59 MIN: 17.01 / MAX: 55.63 MIN: 17.27 / MAX: 57.04 MIN: 16.72 / MAX: 56.71 MIN: 14.67 / MAX: 57.69 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU a b c d e 50 100 150 200 250 SE +/- 1.67, N = 15 SE +/- 1.91, N = 3 230.73 246.61 246.59 243.84 231.80 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection Retail FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU a b c d e 4 8 12 16 20 SE +/- 0.11, N = 15 SE +/- 0.12, N = 15 16.55 15.63 15.65 15.82 16.64 MIN: 6.65 / MAX: 34.71 MIN: 7.37 / MAX: 26.39 MIN: 7.08 / MAX: 26.33 MIN: 6.52 / MAX: 29.45 MIN: 7.02 / MAX: 37.41 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection Retail FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU a b c d e 200 400 600 800 1000 SE +/- 6.75, N = 15 SE +/- 7.15, N = 15 1002.41 1059.77 1058.96 1045.93 996.96 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Handwritten English Recognition FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU a b c d e 40 80 120 160 200 SE +/- 2.14, N = 3 SE +/- 1.27, N = 15 156.10 152.02 151.19 152.48 160.66 MIN: 89.74 / MAX: 233.97 MIN: 88.01 / MAX: 226.83 MIN: 89.51 / MAX: 211.52 MIN: 89.77 / MAX: 219.3 MIN: 88.95 / MAX: 239.44 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Handwritten English Recognition FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU a b c d e 30 60 90 120 150 SE +/- 1.48, N = 3 SE +/- 0.83, N = 15 108.71 111.60 112.21 111.29 105.70 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Re-Identification Retail FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU a b c d e 6 12 18 24 30 SE +/- 0.31, N = 4 SE +/- 0.27, N = 6 27.24 26.28 26.12 27.09 27.61 MIN: 15.08 / MAX: 47.91 MIN: 16.16 / MAX: 43.57 MIN: 15.46 / MAX: 41.86 MIN: 15.78 / MAX: 43.25 MIN: 11.88 / MAX: 54.33 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Re-Identification Retail FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU a b c d e 60 120 180 240 300 SE +/- 2.88, N = 4 SE +/- 2.45, N = 6 256.36 265.61 267.31 257.64 252.96 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU a b c d e 1100 2200 3300 4400 5500 SE +/- 39.34, N = 3 SE +/- 46.64, N = 6 4823.26 4958.11 4962.19 4908.52 4709.82 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU a b c d e 0.7628 1.5256 2.2884 3.0512 3.814 SE +/- 0.03, N = 3 SE +/- 0.03, N = 6 3.31 3.23 3.22 3.26 3.39 MIN: 1.1 / MAX: 12.43 MIN: 1.1 / MAX: 8.44 MIN: 1.04 / MAX: 15.36 MIN: 1.04 / MAX: 8 MIN: 1.06 / MAX: 14.99 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU a b c d e 0.2858 0.5716 0.8574 1.1432 1.429 SE +/- 0.02, N = 4 SE +/- 0.01, N = 3 1.27 1.22 1.22 1.26 1.27 MIN: 0.38 / MAX: 11.64 MIN: 0.39 / MAX: 6.57 MIN: 0.4 / MAX: 5.49 MIN: 0.4 / MAX: 6.52 MIN: 0.38 / MAX: 12.95 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU a b c d e 3K 6K 9K 12K 15K SE +/- 151.02, N = 4 SE +/- 146.93, N = 3 12466.99 12915.87 12894.54 12467.60 12467.50 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Phoronix Test Suite v10.8.4