openvino 2023 ryzen AMD Ryzen 9 7950X 16-Core testing with a ASUS ROG STRIX X670E-E GAMING WIFI (1416 BIOS) and AMD Radeon RX 7900 XTX 24GB on Ubuntu 23.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2309298-PTS-OPENVINO16&gru&sor .
openvino 2023 ryzen Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server OpenGL Compiler File-System Screen Resolution a b c d AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads) ASUS ROG STRIX X670E-E GAMING WIFI (1416 BIOS) AMD Device 14d8 32GB Western Digital WD_BLACK SN850X 1000GB + 4001GB Western Digital WD_BLACK SN850X 4000GB AMD Radeon RX 7900 XTX 24GB (2304/1249MHz) AMD Device ab30 ASUS MG28U Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411 Ubuntu 23.04 6.6.0-060600rc1daily20230915-generic (x86_64) GNOME Shell 44.3 X Server 1.21.1.7 + Wayland 4.6 Mesa 23.3~git2309150600.b73ebc~oibaf~l (git-b73ebc6 2023-09-15 lunar-oibaf-ppa) (LLVM 15.0.7 DRM 3.54) GCC 12.3.0 ext4 3840x2160 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-DAPbBt/gcc-12-12.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-DAPbBt/gcc-12-12.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: amd-pstate-epp powersave (EPP: performance) - CPU Microcode: 0xa601203 Python Details - Python 3.11.4 Security Details - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
openvino 2023 ryzen openvino: Face Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP32 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Face Detection Retail FP16 - CPU openvino: Road Segmentation ADAS FP16 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Face Detection Retail FP16-INT8 - CPU openvino: Road Segmentation ADAS FP16-INT8 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Handwritten English Recognition FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Handwritten English Recognition FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Face Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP32 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Face Detection Retail FP16 - CPU openvino: Road Segmentation ADAS FP16 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Face Detection Retail FP16-INT8 - CPU openvino: Road Segmentation ADAS FP16-INT8 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Handwritten English Recognition FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Handwritten English Recognition FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU a b c d 14.44 94.40 93.90 775.86 28.05 3275.16 314.13 1741.10 1461.97 4856.05 509.63 140.22 2834.15 1644.97 754.63 36592.00 638.64 51738.41 551.63 84.67 85.13 10.27 284.84 2.35 25.38 4.56 10.92 3.22 15.63 56.96 5.6 4.84 21.17 0.39 25.02 0.27 14.48 95.73 95.73 777.66 28.10 3283.21 319.41 1739.67 1462.55 4851.36 513.37 141.16 2832.56 1634.02 756.95 36637.93 628.81 51802.94 550.38 83.52 83.49 10.24 284.22 2.35 24.97 4.56 10.92 3.22 15.52 56.57 5.60 4.87 21.10 0.39 25.45 0.27 14.45 96.37 94.20 788.48 28.06 3285.23 315.73 1742.06 1462.73 4845.87 510.02 140.75 2832.55 1637.51 753.48 36618.96 639.23 51736.91 551.82 82.95 84.83 10.10 284.72 2.34 25.25 4.56 10.91 3.22 15.62 56.74 5.60 4.86 21.19 0.39 25.00 0.27 14.44 93.93 94.79 788.19 28.20 3286.37 315.58 1738.35 1463.02 4861.84 508.90 140.73 2830.09 1648.16 752.41 36655.67 644.72 51783.42 552.10 85.09 84.35 10.11 283.18 2.35 25.27 4.57 10.91 3.21 15.65 56.8 5.60 4.83 21.23 0.39 24.78 0.27 OpenBenchmarking.org
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Face Detection FP16 - Device: CPU b c d a 4 8 12 16 20 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 14.48 14.45 14.44 14.44 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Person Detection FP16 - Device: CPU c b a d 20 40 60 80 100 SE +/- 0.87, N = 3 SE +/- 0.97, N = 5 SE +/- 0.59, N = 3 SE +/- 0.42, N = 3 96.37 95.73 94.40 93.93 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Person Detection FP32 - Device: CPU b d c a 20 40 60 80 100 SE +/- 0.60, N = 3 SE +/- 1.32, N = 3 SE +/- 0.44, N = 3 SE +/- 0.27, N = 3 95.73 94.79 94.20 93.90 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Vehicle Detection FP16 - Device: CPU c d b a 200 400 600 800 1000 SE +/- 4.18, N = 3 SE +/- 3.84, N = 3 SE +/- 1.96, N = 3 SE +/- 5.37, N = 3 788.48 788.19 777.66 775.86 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Face Detection FP16-INT8 - Device: CPU d b c a 7 14 21 28 35 SE +/- 0.07, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 28.20 28.10 28.06 28.05 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Face Detection Retail FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Face Detection Retail FP16 - Device: CPU d c b a 700 1400 2100 2800 3500 SE +/- 3.83, N = 3 SE +/- 3.35, N = 3 SE +/- 1.36, N = 3 SE +/- 3.86, N = 3 3286.37 3285.23 3283.21 3275.16 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Road Segmentation ADAS FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Road Segmentation ADAS FP16 - Device: CPU b c d a 70 140 210 280 350 SE +/- 3.12, N = 3 SE +/- 0.75, N = 3 SE +/- 0.82, N = 3 SE +/- 0.83, N = 3 319.41 315.73 315.58 314.13 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Vehicle Detection FP16-INT8 - Device: CPU c a b d 400 800 1200 1600 2000 SE +/- 1.78, N = 3 SE +/- 4.42, N = 3 SE +/- 3.38, N = 3 SE +/- 0.90, N = 3 1742.06 1741.10 1739.67 1738.35 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Weld Porosity Detection FP16 - Device: CPU d c b a 300 600 900 1200 1500 SE +/- 0.14, N = 3 SE +/- 0.42, N = 3 SE +/- 0.07, N = 3 SE +/- 0.32, N = 3 1463.02 1462.73 1462.55 1461.97 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Face Detection Retail FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Face Detection Retail FP16-INT8 - Device: CPU d a b c 1000 2000 3000 4000 5000 SE +/- 9.80, N = 3 SE +/- 6.39, N = 3 SE +/- 11.64, N = 3 SE +/- 12.42, N = 3 4861.84 4856.05 4851.36 4845.87 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Road Segmentation ADAS FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU b c a d 110 220 330 440 550 SE +/- 3.27, N = 3 SE +/- 2.09, N = 3 SE +/- 1.73, N = 3 SE +/- 1.95, N = 3 513.37 510.02 509.63 508.90 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Machine Translation EN To DE FP16 - Device: CPU b c d a 30 60 90 120 150 SE +/- 0.51, N = 3 SE +/- 0.19, N = 3 SE +/- 0.32, N = 3 SE +/- 0.07, N = 3 141.16 140.75 140.73 140.22 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Weld Porosity Detection FP16-INT8 - Device: CPU a b c d 600 1200 1800 2400 3000 SE +/- 0.44, N = 3 SE +/- 1.40, N = 3 SE +/- 1.63, N = 3 SE +/- 2.25, N = 3 2834.15 2832.56 2832.55 2830.09 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Person Vehicle Bike Detection FP16 - Device: CPU d a c b 400 800 1200 1600 2000 SE +/- 3.31, N = 3 SE +/- 8.79, N = 3 SE +/- 3.33, N = 3 SE +/- 0.66, N = 3 1648.16 1644.97 1637.51 1634.02 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Handwritten English Recognition FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Handwritten English Recognition FP16 - Device: CPU b a c d 160 320 480 640 800 SE +/- 1.00, N = 3 SE +/- 4.96, N = 3 SE +/- 1.25, N = 3 SE +/- 3.65, N = 3 756.95 754.63 753.48 752.41 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU d b c a 8K 16K 24K 32K 40K SE +/- 29.05, N = 3 SE +/- 35.30, N = 3 SE +/- 25.78, N = 3 SE +/- 42.09, N = 3 36655.67 36637.93 36618.96 36592.00 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Handwritten English Recognition FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Handwritten English Recognition FP16-INT8 - Device: CPU d c a b 140 280 420 560 700 SE +/- 1.78, N = 3 SE +/- 2.06, N = 3 SE +/- 1.40, N = 3 SE +/- 6.41, N = 15 644.72 639.23 638.64 628.81 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU b d a c 11K 22K 33K 44K 55K SE +/- 90.98, N = 3 SE +/- 111.48, N = 3 SE +/- 15.29, N = 3 SE +/- 62.15, N = 3 51802.94 51783.42 51738.41 51736.91 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Face Detection FP16 - Device: CPU b a c d 120 240 360 480 600 SE +/- 1.41, N = 3 SE +/- 0.68, N = 3 SE +/- 0.39, N = 3 SE +/- 0.06, N = 3 550.38 551.63 551.82 552.10 MIN: 277.83 / MAX: 573.87 MIN: 494.18 / MAX: 577.07 MIN: 489.13 / MAX: 574.74 MIN: 498.67 / MAX: 579.19 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Person Detection FP16 - Device: CPU c b a d 20 40 60 80 100 SE +/- 0.74, N = 3 SE +/- 0.86, N = 5 SE +/- 0.53, N = 3 SE +/- 0.38, N = 3 82.95 83.52 84.67 85.09 MIN: 63.4 / MAX: 115.79 MIN: 55.18 / MAX: 114.03 MIN: 57.93 / MAX: 118.94 MIN: 57.13 / MAX: 115.96 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Person Detection FP32 - Device: CPU b d c a 20 40 60 80 100 SE +/- 0.52, N = 3 SE +/- 1.15, N = 3 SE +/- 0.40, N = 3 SE +/- 0.24, N = 3 83.49 84.35 84.83 85.13 MIN: 60.81 / MAX: 115.9 MIN: 35.39 / MAX: 114.46 MIN: 62.75 / MAX: 116.36 MIN: 58.25 / MAX: 116.82 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Vehicle Detection FP16 - Device: CPU c d b a 3 6 9 12 15 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 10.10 10.11 10.24 10.27 MIN: 3.86 / MAX: 20.61 MIN: 4.23 / MAX: 19.8 MIN: 3.93 / MAX: 17.98 MIN: 3.83 / MAX: 23.02 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Face Detection FP16-INT8 - Device: CPU d b c a 60 120 180 240 300 SE +/- 0.81, N = 3 SE +/- 0.46, N = 3 SE +/- 0.15, N = 3 SE +/- 0.19, N = 3 283.18 284.22 284.72 284.84 MIN: 148.13 / MAX: 297.23 MIN: 272.33 / MAX: 290.91 MIN: 253.14 / MAX: 292.23 MIN: 272.17 / MAX: 293.27 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Face Detection Retail FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Face Detection Retail FP16 - Device: CPU c a b d 0.5288 1.0576 1.5864 2.1152 2.644 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 2.34 2.35 2.35 2.35 MIN: 1.23 / MAX: 9.27 MIN: 1.23 / MAX: 9.23 MIN: 1.23 / MAX: 9.49 MIN: 1.24 / MAX: 11.05 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Road Segmentation ADAS FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Road Segmentation ADAS FP16 - Device: CPU b c d a 6 12 18 24 30 SE +/- 0.24, N = 3 SE +/- 0.06, N = 3 SE +/- 0.07, N = 3 SE +/- 0.07, N = 3 24.97 25.25 25.27 25.38 MIN: 9.41 / MAX: 42.14 MIN: 9.11 / MAX: 36.02 MIN: 10.71 / MAX: 33.35 MIN: 8.89 / MAX: 35.26 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Vehicle Detection FP16-INT8 - Device: CPU a b c d 1.0283 2.0566 3.0849 4.1132 5.1415 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 4.56 4.56 4.56 4.57 MIN: 2.63 / MAX: 13.84 MIN: 2.61 / MAX: 12.41 MIN: 2.62 / MAX: 12.29 MIN: 2.62 / MAX: 12.3 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Weld Porosity Detection FP16 - Device: CPU c d a b 3 6 9 12 15 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 10.91 10.91 10.92 10.92 MIN: 6.03 / MAX: 18.7 MIN: 5.64 / MAX: 18.96 MIN: 5.58 / MAX: 19.13 MIN: 5.73 / MAX: 22.33 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Face Detection Retail FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Face Detection Retail FP16-INT8 - Device: CPU d a b c 0.7245 1.449 2.1735 2.898 3.6225 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 3.21 3.22 3.22 3.22 MIN: 1.79 / MAX: 10.71 MIN: 1.78 / MAX: 10.8 MIN: 1.8 / MAX: 10.48 MIN: 1.8 / MAX: 10.23 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Road Segmentation ADAS FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU b c a d 4 8 12 16 20 SE +/- 0.10, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.06, N = 3 15.52 15.62 15.63 15.65 MIN: 8.31 / MAX: 21.58 MIN: 8.29 / MAX: 22.27 MIN: 8.4 / MAX: 22.84 MIN: 8.48 / MAX: 22.9 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Machine Translation EN To DE FP16 - Device: CPU b c d a 13 26 39 52 65 SE +/- 0.20, N = 3 SE +/- 0.07, N = 3 SE +/- 0.12, N = 3 SE +/- 0.03, N = 3 56.57 56.74 56.80 56.96 MIN: 27.28 / MAX: 65.55 MIN: 26.01 / MAX: 65.6 MIN: 33.66 / MAX: 70.03 MIN: 30.93 / MAX: 74.12 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Weld Porosity Detection FP16-INT8 - Device: CPU a b c d 1.26 2.52 3.78 5.04 6.3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 5.60 5.60 5.60 5.60 MIN: 2.92 / MAX: 13.06 MIN: 2.92 / MAX: 12.76 MIN: 2.93 / MAX: 13.03 MIN: 2.92 / MAX: 12.35 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Person Vehicle Bike Detection FP16 - Device: CPU d a c b 1.0958 2.1916 3.2874 4.3832 5.479 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 4.83 4.84 4.86 4.87 MIN: 3.16 / MAX: 12.35 MIN: 3.28 / MAX: 13.19 MIN: 3.2 / MAX: 16.94 MIN: 3.19 / MAX: 12.27 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Handwritten English Recognition FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Handwritten English Recognition FP16 - Device: CPU b a c d 5 10 15 20 25 SE +/- 0.03, N = 3 SE +/- 0.14, N = 3 SE +/- 0.03, N = 3 SE +/- 0.10, N = 3 21.10 21.17 21.19 21.23 MIN: 13.13 / MAX: 31.96 MIN: 12.98 / MAX: 34.35 MIN: 15.94 / MAX: 31.78 MIN: 13.16 / MAX: 31.24 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU a b c d 0.0878 0.1756 0.2634 0.3512 0.439 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.39 0.39 0.39 0.39 MIN: 0.2 / MAX: 7.21 MIN: 0.2 / MAX: 6.72 MIN: 0.2 / MAX: 6.68 MIN: 0.2 / MAX: 7.13 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Handwritten English Recognition FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Handwritten English Recognition FP16-INT8 - Device: CPU d c a b 6 12 18 24 30 SE +/- 0.07, N = 3 SE +/- 0.08, N = 3 SE +/- 0.06, N = 3 SE +/- 0.27, N = 15 24.78 25.00 25.02 25.45 MIN: 16.23 / MAX: 33.37 MIN: 16.35 / MAX: 34.49 MIN: 16.53 / MAX: 35.6 MIN: 16.19 / MAX: 35.92 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU a b c d 0.0608 0.1216 0.1824 0.2432 0.304 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.27 0.27 0.27 0.27 MIN: 0.15 / MAX: 6.43 MIN: 0.15 / MAX: 7.1 MIN: 0.15 / MAX: 6.59 MIN: 0.15 / MAX: 6.59 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
Phoronix Test Suite v10.8.5