openvino 2023 ryzen AMD Ryzen 9 7950X 16-Core testing with a ASUS ROG STRIX X670E-E GAMING WIFI (1416 BIOS) and AMD Radeon RX 7900 XTX 24GB on Ubuntu 23.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2309298-PTS-OPENVINO16&sro .
openvino 2023 ryzen Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server OpenGL Compiler File-System Screen Resolution a b c d AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads) ASUS ROG STRIX X670E-E GAMING WIFI (1416 BIOS) AMD Device 14d8 32GB Western Digital WD_BLACK SN850X 1000GB + 4001GB Western Digital WD_BLACK SN850X 4000GB AMD Radeon RX 7900 XTX 24GB (2304/1249MHz) AMD Device ab30 ASUS MG28U Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411 Ubuntu 23.04 6.6.0-060600rc1daily20230915-generic (x86_64) GNOME Shell 44.3 X Server 1.21.1.7 + Wayland 4.6 Mesa 23.3~git2309150600.b73ebc~oibaf~l (git-b73ebc6 2023-09-15 lunar-oibaf-ppa) (LLVM 15.0.7 DRM 3.54) GCC 12.3.0 ext4 3840x2160 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-DAPbBt/gcc-12-12.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-DAPbBt/gcc-12-12.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: amd-pstate-epp powersave (EPP: performance) - CPU Microcode: 0xa601203 Python Details - Python 3.11.4 Security Details - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
openvino 2023 ryzen openvino: Face Detection FP16 - CPU openvino: Face Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP32 - CPU openvino: Person Detection FP32 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Face Detection Retail FP16 - CPU openvino: Face Detection Retail FP16 - CPU openvino: Road Segmentation ADAS FP16 - CPU openvino: Road Segmentation ADAS FP16 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Face Detection Retail FP16-INT8 - CPU openvino: Face Detection Retail FP16-INT8 - CPU openvino: Road Segmentation ADAS FP16-INT8 - CPU openvino: Road Segmentation ADAS FP16-INT8 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Handwritten English Recognition FP16 - CPU openvino: Handwritten English Recognition FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Handwritten English Recognition FP16-INT8 - CPU openvino: Handwritten English Recognition FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU a b c d 14.44 551.63 94.40 84.67 93.90 85.13 775.86 10.27 28.05 284.84 3275.16 2.35 314.13 25.38 1741.10 4.56 1461.97 10.92 4856.05 3.22 509.63 15.63 140.22 56.96 2834.15 5.6 1644.97 4.84 754.63 21.17 36592.00 0.39 638.64 25.02 51738.41 0.27 14.48 550.38 95.73 83.52 95.73 83.49 777.66 10.24 28.10 284.22 3283.21 2.35 319.41 24.97 1739.67 4.56 1462.55 10.92 4851.36 3.22 513.37 15.52 141.16 56.57 2832.56 5.60 1634.02 4.87 756.95 21.10 36637.93 0.39 628.81 25.45 51802.94 0.27 14.45 551.82 96.37 82.95 94.20 84.83 788.48 10.10 28.06 284.72 3285.23 2.34 315.73 25.25 1742.06 4.56 1462.73 10.91 4845.87 3.22 510.02 15.62 140.75 56.74 2832.55 5.60 1637.51 4.86 753.48 21.19 36618.96 0.39 639.23 25.00 51736.91 0.27 14.44 552.10 93.93 85.09 94.79 84.35 788.19 10.11 28.20 283.18 3286.37 2.35 315.58 25.27 1738.35 4.57 1463.02 10.91 4861.84 3.21 508.90 15.65 140.73 56.8 2830.09 5.60 1648.16 4.83 752.41 21.23 36655.67 0.39 644.72 24.78 51783.42 0.27 OpenBenchmarking.org
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Face Detection FP16 - Device: CPU a b c d 4 8 12 16 20 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 14.44 14.48 14.45 14.44 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Face Detection FP16 - Device: CPU a b c d 120 240 360 480 600 SE +/- 0.68, N = 3 SE +/- 1.41, N = 3 SE +/- 0.39, N = 3 SE +/- 0.06, N = 3 551.63 550.38 551.82 552.10 MIN: 494.18 / MAX: 577.07 MIN: 277.83 / MAX: 573.87 MIN: 489.13 / MAX: 574.74 MIN: 498.67 / MAX: 579.19 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Person Detection FP16 - Device: CPU a b c d 20 40 60 80 100 SE +/- 0.59, N = 3 SE +/- 0.97, N = 5 SE +/- 0.87, N = 3 SE +/- 0.42, N = 3 94.40 95.73 96.37 93.93 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Person Detection FP16 - Device: CPU a b c d 20 40 60 80 100 SE +/- 0.53, N = 3 SE +/- 0.86, N = 5 SE +/- 0.74, N = 3 SE +/- 0.38, N = 3 84.67 83.52 82.95 85.09 MIN: 57.93 / MAX: 118.94 MIN: 55.18 / MAX: 114.03 MIN: 63.4 / MAX: 115.79 MIN: 57.13 / MAX: 115.96 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Person Detection FP32 - Device: CPU a b c d 20 40 60 80 100 SE +/- 0.27, N = 3 SE +/- 0.60, N = 3 SE +/- 0.44, N = 3 SE +/- 1.32, N = 3 93.90 95.73 94.20 94.79 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Person Detection FP32 - Device: CPU a b c d 20 40 60 80 100 SE +/- 0.24, N = 3 SE +/- 0.52, N = 3 SE +/- 0.40, N = 3 SE +/- 1.15, N = 3 85.13 83.49 84.83 84.35 MIN: 58.25 / MAX: 116.82 MIN: 60.81 / MAX: 115.9 MIN: 62.75 / MAX: 116.36 MIN: 35.39 / MAX: 114.46 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Vehicle Detection FP16 - Device: CPU a b c d 200 400 600 800 1000 SE +/- 5.37, N = 3 SE +/- 1.96, N = 3 SE +/- 4.18, N = 3 SE +/- 3.84, N = 3 775.86 777.66 788.48 788.19 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Vehicle Detection FP16 - Device: CPU a b c d 3 6 9 12 15 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 10.27 10.24 10.10 10.11 MIN: 3.83 / MAX: 23.02 MIN: 3.93 / MAX: 17.98 MIN: 3.86 / MAX: 20.61 MIN: 4.23 / MAX: 19.8 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Face Detection FP16-INT8 - Device: CPU a b c d 7 14 21 28 35 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.07, N = 3 28.05 28.10 28.06 28.20 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Face Detection FP16-INT8 - Device: CPU a b c d 60 120 180 240 300 SE +/- 0.19, N = 3 SE +/- 0.46, N = 3 SE +/- 0.15, N = 3 SE +/- 0.81, N = 3 284.84 284.22 284.72 283.18 MIN: 272.17 / MAX: 293.27 MIN: 272.33 / MAX: 290.91 MIN: 253.14 / MAX: 292.23 MIN: 148.13 / MAX: 297.23 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Face Detection Retail FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Face Detection Retail FP16 - Device: CPU a b c d 700 1400 2100 2800 3500 SE +/- 3.86, N = 3 SE +/- 1.36, N = 3 SE +/- 3.35, N = 3 SE +/- 3.83, N = 3 3275.16 3283.21 3285.23 3286.37 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Face Detection Retail FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Face Detection Retail FP16 - Device: CPU a b c d 0.5288 1.0576 1.5864 2.1152 2.644 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 2.35 2.35 2.34 2.35 MIN: 1.23 / MAX: 9.23 MIN: 1.23 / MAX: 9.49 MIN: 1.23 / MAX: 9.27 MIN: 1.24 / MAX: 11.05 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Road Segmentation ADAS FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Road Segmentation ADAS FP16 - Device: CPU a b c d 70 140 210 280 350 SE +/- 0.83, N = 3 SE +/- 3.12, N = 3 SE +/- 0.75, N = 3 SE +/- 0.82, N = 3 314.13 319.41 315.73 315.58 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Road Segmentation ADAS FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Road Segmentation ADAS FP16 - Device: CPU a b c d 6 12 18 24 30 SE +/- 0.07, N = 3 SE +/- 0.24, N = 3 SE +/- 0.06, N = 3 SE +/- 0.07, N = 3 25.38 24.97 25.25 25.27 MIN: 8.89 / MAX: 35.26 MIN: 9.41 / MAX: 42.14 MIN: 9.11 / MAX: 36.02 MIN: 10.71 / MAX: 33.35 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Vehicle Detection FP16-INT8 - Device: CPU a b c d 400 800 1200 1600 2000 SE +/- 4.42, N = 3 SE +/- 3.38, N = 3 SE +/- 1.78, N = 3 SE +/- 0.90, N = 3 1741.10 1739.67 1742.06 1738.35 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Vehicle Detection FP16-INT8 - Device: CPU a b c d 1.0283 2.0566 3.0849 4.1132 5.1415 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 4.56 4.56 4.56 4.57 MIN: 2.63 / MAX: 13.84 MIN: 2.61 / MAX: 12.41 MIN: 2.62 / MAX: 12.29 MIN: 2.62 / MAX: 12.3 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Weld Porosity Detection FP16 - Device: CPU a b c d 300 600 900 1200 1500 SE +/- 0.32, N = 3 SE +/- 0.07, N = 3 SE +/- 0.42, N = 3 SE +/- 0.14, N = 3 1461.97 1462.55 1462.73 1463.02 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Weld Porosity Detection FP16 - Device: CPU a b c d 3 6 9 12 15 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 10.92 10.92 10.91 10.91 MIN: 5.58 / MAX: 19.13 MIN: 5.73 / MAX: 22.33 MIN: 6.03 / MAX: 18.7 MIN: 5.64 / MAX: 18.96 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Face Detection Retail FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Face Detection Retail FP16-INT8 - Device: CPU a b c d 1000 2000 3000 4000 5000 SE +/- 6.39, N = 3 SE +/- 11.64, N = 3 SE +/- 12.42, N = 3 SE +/- 9.80, N = 3 4856.05 4851.36 4845.87 4861.84 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Face Detection Retail FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Face Detection Retail FP16-INT8 - Device: CPU a b c d 0.7245 1.449 2.1735 2.898 3.6225 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 3.22 3.22 3.22 3.21 MIN: 1.78 / MAX: 10.8 MIN: 1.8 / MAX: 10.48 MIN: 1.8 / MAX: 10.23 MIN: 1.79 / MAX: 10.71 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Road Segmentation ADAS FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU a b c d 110 220 330 440 550 SE +/- 1.73, N = 3 SE +/- 3.27, N = 3 SE +/- 2.09, N = 3 SE +/- 1.95, N = 3 509.63 513.37 510.02 508.90 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Road Segmentation ADAS FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU a b c d 4 8 12 16 20 SE +/- 0.05, N = 3 SE +/- 0.10, N = 3 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 15.63 15.52 15.62 15.65 MIN: 8.4 / MAX: 22.84 MIN: 8.31 / MAX: 21.58 MIN: 8.29 / MAX: 22.27 MIN: 8.48 / MAX: 22.9 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Machine Translation EN To DE FP16 - Device: CPU a b c d 30 60 90 120 150 SE +/- 0.07, N = 3 SE +/- 0.51, N = 3 SE +/- 0.19, N = 3 SE +/- 0.32, N = 3 140.22 141.16 140.75 140.73 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Machine Translation EN To DE FP16 - Device: CPU a b c d 13 26 39 52 65 SE +/- 0.03, N = 3 SE +/- 0.20, N = 3 SE +/- 0.07, N = 3 SE +/- 0.12, N = 3 56.96 56.57 56.74 56.80 MIN: 30.93 / MAX: 74.12 MIN: 27.28 / MAX: 65.55 MIN: 26.01 / MAX: 65.6 MIN: 33.66 / MAX: 70.03 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Weld Porosity Detection FP16-INT8 - Device: CPU a b c d 600 1200 1800 2400 3000 SE +/- 0.44, N = 3 SE +/- 1.40, N = 3 SE +/- 1.63, N = 3 SE +/- 2.25, N = 3 2834.15 2832.56 2832.55 2830.09 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Weld Porosity Detection FP16-INT8 - Device: CPU a b c d 1.26 2.52 3.78 5.04 6.3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 5.60 5.60 5.60 5.60 MIN: 2.92 / MAX: 13.06 MIN: 2.92 / MAX: 12.76 MIN: 2.93 / MAX: 13.03 MIN: 2.92 / MAX: 12.35 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Person Vehicle Bike Detection FP16 - Device: CPU a b c d 400 800 1200 1600 2000 SE +/- 8.79, N = 3 SE +/- 0.66, N = 3 SE +/- 3.33, N = 3 SE +/- 3.31, N = 3 1644.97 1634.02 1637.51 1648.16 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Person Vehicle Bike Detection FP16 - Device: CPU a b c d 1.0958 2.1916 3.2874 4.3832 5.479 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 4.84 4.87 4.86 4.83 MIN: 3.28 / MAX: 13.19 MIN: 3.19 / MAX: 12.27 MIN: 3.2 / MAX: 16.94 MIN: 3.16 / MAX: 12.35 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Handwritten English Recognition FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Handwritten English Recognition FP16 - Device: CPU a b c d 160 320 480 640 800 SE +/- 4.96, N = 3 SE +/- 1.00, N = 3 SE +/- 1.25, N = 3 SE +/- 3.65, N = 3 754.63 756.95 753.48 752.41 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Handwritten English Recognition FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Handwritten English Recognition FP16 - Device: CPU a b c d 5 10 15 20 25 SE +/- 0.14, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.10, N = 3 21.17 21.10 21.19 21.23 MIN: 12.98 / MAX: 34.35 MIN: 13.13 / MAX: 31.96 MIN: 15.94 / MAX: 31.78 MIN: 13.16 / MAX: 31.24 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU a b c d 8K 16K 24K 32K 40K SE +/- 42.09, N = 3 SE +/- 35.30, N = 3 SE +/- 25.78, N = 3 SE +/- 29.05, N = 3 36592.00 36637.93 36618.96 36655.67 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU a b c d 0.0878 0.1756 0.2634 0.3512 0.439 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.39 0.39 0.39 0.39 MIN: 0.2 / MAX: 7.21 MIN: 0.2 / MAX: 6.72 MIN: 0.2 / MAX: 6.68 MIN: 0.2 / MAX: 7.13 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Handwritten English Recognition FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Handwritten English Recognition FP16-INT8 - Device: CPU a b c d 140 280 420 560 700 SE +/- 1.40, N = 3 SE +/- 6.41, N = 15 SE +/- 2.06, N = 3 SE +/- 1.78, N = 3 638.64 628.81 639.23 644.72 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Handwritten English Recognition FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Handwritten English Recognition FP16-INT8 - Device: CPU a b c d 6 12 18 24 30 SE +/- 0.06, N = 3 SE +/- 0.27, N = 15 SE +/- 0.08, N = 3 SE +/- 0.07, N = 3 25.02 25.45 25.00 24.78 MIN: 16.53 / MAX: 35.6 MIN: 16.19 / MAX: 35.92 MIN: 16.35 / MAX: 34.49 MIN: 16.23 / MAX: 33.37 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU a b c d 11K 22K 33K 44K 55K SE +/- 15.29, N = 3 SE +/- 90.98, N = 3 SE +/- 62.15, N = 3 SE +/- 111.48, N = 3 51738.41 51802.94 51736.91 51783.42 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU a b c d 0.0608 0.1216 0.1824 0.2432 0.304 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.27 0.27 0.27 0.27 MIN: 0.15 / MAX: 6.43 MIN: 0.15 / MAX: 7.1 MIN: 0.15 / MAX: 6.59 MIN: 0.15 / MAX: 6.59 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
Phoronix Test Suite v10.8.5