AMD Ryzen 9 7950X 16-Core testing with a ASUS ROG STRIX X670E-E GAMING WIFI (1416 BIOS) and AMD Radeon RX 7900 XTX 24GB on Ubuntu 23.04 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2309298-PTS-OPENVINO16 openvino 2023 ryzen - Phoronix Test Suite openvino 2023 ryzen AMD Ryzen 9 7950X 16-Core testing with a ASUS ROG STRIX X670E-E GAMING WIFI (1416 BIOS) and AMD Radeon RX 7900 XTX 24GB on Ubuntu 23.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2309298-PTS-OPENVINO16&sro .
openvino 2023 ryzen Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server OpenGL Compiler File-System Screen Resolution a b c d AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads) ASUS ROG STRIX X670E-E GAMING WIFI (1416 BIOS) AMD Device 14d8 32GB Western Digital WD_BLACK SN850X 1000GB + 4001GB Western Digital WD_BLACK SN850X 4000GB AMD Radeon RX 7900 XTX 24GB (2304/1249MHz) AMD Device ab30 ASUS MG28U Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411 Ubuntu 23.04 6.6.0-060600rc1daily20230915-generic (x86_64) GNOME Shell 44.3 X Server 1.21.1.7 + Wayland 4.6 Mesa 23.3~git2309150600.b73ebc~oibaf~l (git-b73ebc6 2023-09-15 lunar-oibaf-ppa) (LLVM 15.0.7 DRM 3.54) GCC 12.3.0 ext4 3840x2160 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-DAPbBt/gcc-12-12.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-DAPbBt/gcc-12-12.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: amd-pstate-epp powersave (EPP: performance) - CPU Microcode: 0xa601203 Python Details - Python 3.11.4 Security Details - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET no microcode + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
openvino 2023 ryzen openvino: Face Detection FP16 - CPU openvino: Face Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP32 - CPU openvino: Person Detection FP32 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Face Detection Retail FP16 - CPU openvino: Face Detection Retail FP16 - CPU openvino: Road Segmentation ADAS FP16 - CPU openvino: Road Segmentation ADAS FP16 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Face Detection Retail FP16-INT8 - CPU openvino: Face Detection Retail FP16-INT8 - CPU openvino: Road Segmentation ADAS FP16-INT8 - CPU openvino: Road Segmentation ADAS FP16-INT8 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Handwritten English Recognition FP16 - CPU openvino: Handwritten English Recognition FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Handwritten English Recognition FP16-INT8 - CPU openvino: Handwritten English Recognition FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU a b c d 14.44 551.63 94.40 84.67 93.90 85.13 775.86 10.27 28.05 284.84 3275.16 2.35 314.13 25.38 1741.10 4.56 1461.97 10.92 4856.05 3.22 509.63 15.63 140.22 56.96 2834.15 5.6 1644.97 4.84 754.63 21.17 36592.00 0.39 638.64 25.02 51738.41 0.27 14.48 550.38 95.73 83.52 95.73 83.49 777.66 10.24 28.10 284.22 3283.21 2.35 319.41 24.97 1739.67 4.56 1462.55 10.92 4851.36 3.22 513.37 15.52 141.16 56.57 2832.56 5.60 1634.02 4.87 756.95 21.10 36637.93 0.39 628.81 25.45 51802.94 0.27 14.45 551.82 96.37 82.95 94.20 84.83 788.48 10.10 28.06 284.72 3285.23 2.34 315.73 25.25 1742.06 4.56 1462.73 10.91 4845.87 3.22 510.02 15.62 140.75 56.74 2832.55 5.60 1637.51 4.86 753.48 21.19 36618.96 0.39 639.23 25.00 51736.91 0.27 14.44 552.10 93.93 85.09 94.79 84.35 788.19 10.11 28.20 283.18 3286.37 2.35 315.58 25.27 1738.35 4.57 1463.02 10.91 4861.84 3.21 508.90 15.65 140.73 56.8 2830.09 5.60 1648.16 4.83 752.41 21.23 36655.67 0.39 644.72 24.78 51783.42 0.27 OpenBenchmarking.org
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Face Detection FP16 - Device: CPU a b c d 4 8 12 16 20 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 14.44 14.48 14.45 14.44 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Face Detection FP16 - Device: CPU a b c d 120 240 360 480 600 SE +/- 0.68, N = 3 SE +/- 1.41, N = 3 SE +/- 0.39, N = 3 SE +/- 0.06, N = 3 551.63 550.38 551.82 552.10 MIN: 494.18 / MAX: 577.07 MIN: 277.83 / MAX: 573.87 MIN: 489.13 / MAX: 574.74 MIN: 498.67 / MAX: 579.19 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Person Detection FP16 - Device: CPU a b c d 20 40 60 80 100 SE +/- 0.59, N = 3 SE +/- 0.97, N = 5 SE +/- 0.87, N = 3 SE +/- 0.42, N = 3 94.40 95.73 96.37 93.93 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Person Detection FP16 - Device: CPU a b c d 20 40 60 80 100 SE +/- 0.53, N = 3 SE +/- 0.86, N = 5 SE +/- 0.74, N = 3 SE +/- 0.38, N = 3 84.67 83.52 82.95 85.09 MIN: 57.93 / MAX: 118.94 MIN: 55.18 / MAX: 114.03 MIN: 63.4 / MAX: 115.79 MIN: 57.13 / MAX: 115.96 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Person Detection FP32 - Device: CPU a b c d 20 40 60 80 100 SE +/- 0.27, N = 3 SE +/- 0.60, N = 3 SE +/- 0.44, N = 3 SE +/- 1.32, N = 3 93.90 95.73 94.20 94.79 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Person Detection FP32 - Device: CPU a b c d 20 40 60 80 100 SE +/- 0.24, N = 3 SE +/- 0.52, N = 3 SE +/- 0.40, N = 3 SE +/- 1.15, N = 3 85.13 83.49 84.83 84.35 MIN: 58.25 / MAX: 116.82 MIN: 60.81 / MAX: 115.9 MIN: 62.75 / MAX: 116.36 MIN: 35.39 / MAX: 114.46 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Vehicle Detection FP16 - Device: CPU a b c d 200 400 600 800 1000 SE +/- 5.37, N = 3 SE +/- 1.96, N = 3 SE +/- 4.18, N = 3 SE +/- 3.84, N = 3 775.86 777.66 788.48 788.19 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Vehicle Detection FP16 - Device: CPU a b c d 3 6 9 12 15 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 10.27 10.24 10.10 10.11 MIN: 3.83 / MAX: 23.02 MIN: 3.93 / MAX: 17.98 MIN: 3.86 / MAX: 20.61 MIN: 4.23 / MAX: 19.8 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Face Detection FP16-INT8 - Device: CPU a b c d 7 14 21 28 35 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.07, N = 3 28.05 28.10 28.06 28.20 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Face Detection FP16-INT8 - Device: CPU a b c d 60 120 180 240 300 SE +/- 0.19, N = 3 SE +/- 0.46, N = 3 SE +/- 0.15, N = 3 SE +/- 0.81, N = 3 284.84 284.22 284.72 283.18 MIN: 272.17 / MAX: 293.27 MIN: 272.33 / MAX: 290.91 MIN: 253.14 / MAX: 292.23 MIN: 148.13 / MAX: 297.23 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Face Detection Retail FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Face Detection Retail FP16 - Device: CPU a b c d 700 1400 2100 2800 3500 SE +/- 3.86, N = 3 SE +/- 1.36, N = 3 SE +/- 3.35, N = 3 SE +/- 3.83, N = 3 3275.16 3283.21 3285.23 3286.37 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Face Detection Retail FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Face Detection Retail FP16 - Device: CPU a b c d 0.5288 1.0576 1.5864 2.1152 2.644 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 2.35 2.35 2.34 2.35 MIN: 1.23 / MAX: 9.23 MIN: 1.23 / MAX: 9.49 MIN: 1.23 / MAX: 9.27 MIN: 1.24 / MAX: 11.05 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Road Segmentation ADAS FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Road Segmentation ADAS FP16 - Device: CPU a b c d 70 140 210 280 350 SE +/- 0.83, N = 3 SE +/- 3.12, N = 3 SE +/- 0.75, N = 3 SE +/- 0.82, N = 3 314.13 319.41 315.73 315.58 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Road Segmentation ADAS FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Road Segmentation ADAS FP16 - Device: CPU a b c d 6 12 18 24 30 SE +/- 0.07, N = 3 SE +/- 0.24, N = 3 SE +/- 0.06, N = 3 SE +/- 0.07, N = 3 25.38 24.97 25.25 25.27 MIN: 8.89 / MAX: 35.26 MIN: 9.41 / MAX: 42.14 MIN: 9.11 / MAX: 36.02 MIN: 10.71 / MAX: 33.35 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Vehicle Detection FP16-INT8 - Device: CPU a b c d 400 800 1200 1600 2000 SE +/- 4.42, N = 3 SE +/- 3.38, N = 3 SE +/- 1.78, N = 3 SE +/- 0.90, N = 3 1741.10 1739.67 1742.06 1738.35 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Vehicle Detection FP16-INT8 - Device: CPU a b c d 1.0283 2.0566 3.0849 4.1132 5.1415 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 4.56 4.56 4.56 4.57 MIN: 2.63 / MAX: 13.84 MIN: 2.61 / MAX: 12.41 MIN: 2.62 / MAX: 12.29 MIN: 2.62 / MAX: 12.3 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Weld Porosity Detection FP16 - Device: CPU a b c d 300 600 900 1200 1500 SE +/- 0.32, N = 3 SE +/- 0.07, N = 3 SE +/- 0.42, N = 3 SE +/- 0.14, N = 3 1461.97 1462.55 1462.73 1463.02 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Weld Porosity Detection FP16 - Device: CPU a b c d 3 6 9 12 15 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 10.92 10.92 10.91 10.91 MIN: 5.58 / MAX: 19.13 MIN: 5.73 / MAX: 22.33 MIN: 6.03 / MAX: 18.7 MIN: 5.64 / MAX: 18.96 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Face Detection Retail FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Face Detection Retail FP16-INT8 - Device: CPU a b c d 1000 2000 3000 4000 5000 SE +/- 6.39, N = 3 SE +/- 11.64, N = 3 SE +/- 12.42, N = 3 SE +/- 9.80, N = 3 4856.05 4851.36 4845.87 4861.84 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Face Detection Retail FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Face Detection Retail FP16-INT8 - Device: CPU a b c d 0.7245 1.449 2.1735 2.898 3.6225 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 3.22 3.22 3.22 3.21 MIN: 1.78 / MAX: 10.8 MIN: 1.8 / MAX: 10.48 MIN: 1.8 / MAX: 10.23 MIN: 1.79 / MAX: 10.71 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Road Segmentation ADAS FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU a b c d 110 220 330 440 550 SE +/- 1.73, N = 3 SE +/- 3.27, N = 3 SE +/- 2.09, N = 3 SE +/- 1.95, N = 3 509.63 513.37 510.02 508.90 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Road Segmentation ADAS FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU a b c d 4 8 12 16 20 SE +/- 0.05, N = 3 SE +/- 0.10, N = 3 SE +/- 0.06, N = 3 SE +/- 0.06, N = 3 15.63 15.52 15.62 15.65 MIN: 8.4 / MAX: 22.84 MIN: 8.31 / MAX: 21.58 MIN: 8.29 / MAX: 22.27 MIN: 8.48 / MAX: 22.9 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Machine Translation EN To DE FP16 - Device: CPU a b c d 30 60 90 120 150 SE +/- 0.07, N = 3 SE +/- 0.51, N = 3 SE +/- 0.19, N = 3 SE +/- 0.32, N = 3 140.22 141.16 140.75 140.73 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Machine Translation EN To DE FP16 - Device: CPU a b c d 13 26 39 52 65 SE +/- 0.03, N = 3 SE +/- 0.20, N = 3 SE +/- 0.07, N = 3 SE +/- 0.12, N = 3 56.96 56.57 56.74 56.80 MIN: 30.93 / MAX: 74.12 MIN: 27.28 / MAX: 65.55 MIN: 26.01 / MAX: 65.6 MIN: 33.66 / MAX: 70.03 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Weld Porosity Detection FP16-INT8 - Device: CPU a b c d 600 1200 1800 2400 3000 SE +/- 0.44, N = 3 SE +/- 1.40, N = 3 SE +/- 1.63, N = 3 SE +/- 2.25, N = 3 2834.15 2832.56 2832.55 2830.09 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Weld Porosity Detection FP16-INT8 - Device: CPU a b c d 1.26 2.52 3.78 5.04 6.3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 5.60 5.60 5.60 5.60 MIN: 2.92 / MAX: 13.06 MIN: 2.92 / MAX: 12.76 MIN: 2.93 / MAX: 13.03 MIN: 2.92 / MAX: 12.35 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Person Vehicle Bike Detection FP16 - Device: CPU a b c d 400 800 1200 1600 2000 SE +/- 8.79, N = 3 SE +/- 0.66, N = 3 SE +/- 3.33, N = 3 SE +/- 3.31, N = 3 1644.97 1634.02 1637.51 1648.16 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Person Vehicle Bike Detection FP16 - Device: CPU a b c d 1.0958 2.1916 3.2874 4.3832 5.479 SE +/- 0.03, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 4.84 4.87 4.86 4.83 MIN: 3.28 / MAX: 13.19 MIN: 3.19 / MAX: 12.27 MIN: 3.2 / MAX: 16.94 MIN: 3.16 / MAX: 12.35 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Handwritten English Recognition FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Handwritten English Recognition FP16 - Device: CPU a b c d 160 320 480 640 800 SE +/- 4.96, N = 3 SE +/- 1.00, N = 3 SE +/- 1.25, N = 3 SE +/- 3.65, N = 3 754.63 756.95 753.48 752.41 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Handwritten English Recognition FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Handwritten English Recognition FP16 - Device: CPU a b c d 5 10 15 20 25 SE +/- 0.14, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.10, N = 3 21.17 21.10 21.19 21.23 MIN: 12.98 / MAX: 34.35 MIN: 13.13 / MAX: 31.96 MIN: 15.94 / MAX: 31.78 MIN: 13.16 / MAX: 31.24 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU a b c d 8K 16K 24K 32K 40K SE +/- 42.09, N = 3 SE +/- 35.30, N = 3 SE +/- 25.78, N = 3 SE +/- 29.05, N = 3 36592.00 36637.93 36618.96 36655.67 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU a b c d 0.0878 0.1756 0.2634 0.3512 0.439 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.39 0.39 0.39 0.39 MIN: 0.2 / MAX: 7.21 MIN: 0.2 / MAX: 6.72 MIN: 0.2 / MAX: 6.68 MIN: 0.2 / MAX: 7.13 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Handwritten English Recognition FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Handwritten English Recognition FP16-INT8 - Device: CPU a b c d 140 280 420 560 700 SE +/- 1.40, N = 3 SE +/- 6.41, N = 15 SE +/- 2.06, N = 3 SE +/- 1.78, N = 3 638.64 628.81 639.23 644.72 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Handwritten English Recognition FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Handwritten English Recognition FP16-INT8 - Device: CPU a b c d 6 12 18 24 30 SE +/- 0.06, N = 3 SE +/- 0.27, N = 15 SE +/- 0.08, N = 3 SE +/- 0.07, N = 3 25.02 25.45 25.00 24.78 MIN: 16.53 / MAX: 35.6 MIN: 16.19 / MAX: 35.92 MIN: 16.35 / MAX: 34.49 MIN: 16.23 / MAX: 33.37 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU a b c d 11K 22K 33K 44K 55K SE +/- 15.29, N = 3 SE +/- 90.98, N = 3 SE +/- 62.15, N = 3 SE +/- 111.48, N = 3 51738.41 51802.94 51736.91 51783.42 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU a b c d 0.0608 0.1216 0.1824 0.2432 0.304 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.27 0.27 0.27 0.27 MIN: 0.15 / MAX: 6.43 MIN: 0.15 / MAX: 7.1 MIN: 0.15 / MAX: 6.59 MIN: 0.15 / MAX: 6.59 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
Phoronix Test Suite v10.8.4