ov AMD Ryzen Threadripper 7980X 64-Cores testing with a System76 Thelio Major (FA Z5 BIOS) and AMD Radeon Pro W7900 45GB on Ubuntu 23.10 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2403062-PTS-OV40027790&grr .
ov Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server OpenGL Compiler File-System Screen Resolution a b c AMD Ryzen Threadripper 7980X 64-Cores @ 7.79GHz (64 Cores / 128 Threads) System76 Thelio Major (FA Z5 BIOS) AMD Device 14a4 4 x 32GB DRAM-4800MT/s Micron MTC20F1045S1RC48BA2 1000GB CT1000T700SSD5 AMD Radeon Pro W7900 45GB (1760/1124MHz) AMD Device 14cc DELL P2415Q Aquantia AQC113C NBase-T/IEEE + Realtek RTL8125 2.5GbE + Intel Wi-Fi 6 AX210/AX211/AX411 Ubuntu 23.10 6.5.0-21-generic (x86_64) GNOME Shell 45.2 X Server + Wayland 4.6 Mesa 23.2.1-1ubuntu3.1 (LLVM 15.0.7 DRM 3.54) GCC 13.2.0 ext4 1920x1080 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xa108105 Python Details - Python 3.11.6 Security Details - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
ov openvino: Vehicle Detection FP16 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Noise Suppression Poconet-Like FP16 - CPU openvino: Noise Suppression Poconet-Like FP16 - CPU openvino: Road Segmentation ADAS FP16 - CPU openvino: Road Segmentation ADAS FP16 - CPU openvino: Person Detection FP32 - CPU openvino: Person Detection FP32 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Face Detection FP16 - CPU openvino: Face Detection FP16 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Person Re-Identification Retail FP16 - CPU openvino: Person Re-Identification Retail FP16 - CPU openvino: Road Segmentation ADAS FP16-INT8 - CPU openvino: Road Segmentation ADAS FP16-INT8 - CPU openvino: Face Detection Retail FP16-INT8 - CPU openvino: Face Detection Retail FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Handwritten English Recognition FP16-INT8 - CPU openvino: Handwritten English Recognition FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Handwritten English Recognition FP16 - CPU openvino: Handwritten English Recognition FP16 - CPU openvino: Face Detection Retail FP16 - CPU openvino: Face Detection Retail FP16 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU a b c 21.99 1455.73 18.99 3272.51 56.52 565.80 163.55 195.46 90.71 352.60 753.55 42.27 375.06 85.08 162.56 196.62 6.88 4642.38 5.21 6129.68 23.89 1337.88 4.07 15686.29 0.41 123999.65 0.56 94091.47 27.78 2302.64 6.22 5138.22 31.60 2023.65 2.88 11065.62 14.69 4350.92 7.42 8613.69 24.49 1305.37 19.82 3138.21 59.22 540.40 185.33 172.89 96.46 331.58 753.76 42.25 376.17 84.86 163.41 195.63 6.84 4667.85 5.21 6130.41 24.32 1314.48 4.08 15648.36 0.40 124193.43 0.56 94317.14 27.86 2296.07 6.23 5126.71 31.61 2023.16 2.90 11010.41 14.73 4338.94 7.43 8596.02 18.95 1684.93 16.45 3770.89 52.32 610.82 162.59 196.61 87.63 364.91 745.39 42.71 372.55 85.63 160.95 198.58 6.87 4646.38 5.21 6132.62 23.86 1339.37 4.05 15757.59 0.4 124357.62 0.56 94492.54 28.12 2274.13 6.2 5154.36 31.62 2022.82 2.87 11129.19 14.63 4371.21 7.4 8643.02 OpenBenchmarking.org
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Vehicle Detection FP16 - Device: CPU a b c 6 12 18 24 30 SE +/- 0.27, N = 15 SE +/- 0.21, N = 15 21.99 24.49 18.95 MIN: 6.94 / MAX: 123.03 MIN: 4.61 / MAX: 132.07 MIN: 6.8 / MAX: 68.11 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Vehicle Detection FP16 - Device: CPU a b c 400 800 1200 1600 2000 SE +/- 19.10, N = 15 SE +/- 12.09, N = 15 1455.73 1305.37 1684.93 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Noise Suppression Poconet-Like FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU a b c 5 10 15 20 25 SE +/- 0.16, N = 15 SE +/- 0.19, N = 13 18.99 19.82 16.45 MIN: 7.69 / MAX: 149.17 MIN: 7.31 / MAX: 143.42 MIN: 8.42 / MAX: 75.99 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Noise Suppression Poconet-Like FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU a b c 800 1600 2400 3200 4000 SE +/- 30.85, N = 15 SE +/- 33.49, N = 13 3272.51 3138.21 3770.89 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Road Segmentation ADAS FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Road Segmentation ADAS FP16 - Device: CPU a b c 13 26 39 52 65 SE +/- 0.42, N = 12 SE +/- 0.64, N = 12 56.52 59.22 52.32 MIN: 14.85 / MAX: 215.8 MIN: 12.32 / MAX: 240.61 MIN: 21.39 / MAX: 90.32 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Road Segmentation ADAS FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Road Segmentation ADAS FP16 - Device: CPU a b c 130 260 390 520 650 SE +/- 4.42, N = 12 SE +/- 6.18, N = 12 565.80 540.40 610.82 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Detection FP32 - Device: CPU a b c 40 80 120 160 200 SE +/- 0.79, N = 3 SE +/- 2.40, N = 15 163.55 185.33 162.59 MIN: 72.85 / MAX: 308.92 MIN: 55.21 / MAX: 418.14 MIN: 73.73 / MAX: 226.73 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Detection FP32 - Device: CPU a b c 40 80 120 160 200 SE +/- 0.96, N = 3 SE +/- 2.36, N = 15 195.46 172.89 196.61 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU a b c 20 40 60 80 100 SE +/- 1.28, N = 3 SE +/- 0.91, N = 6 90.71 96.46 87.63 MIN: 43.8 / MAX: 208.3 MIN: 38.48 / MAX: 286.5 MIN: 51.83 / MAX: 121.81 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU a b c 80 160 240 320 400 SE +/- 4.99, N = 3 SE +/- 3.24, N = 6 352.60 331.58 364.91 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Face Detection FP16 - Device: CPU a b c 160 320 480 640 800 SE +/- 1.36, N = 3 SE +/- 2.10, N = 3 753.55 753.76 745.39 MIN: 397.27 / MAX: 864.01 MIN: 383.05 / MAX: 847.61 MIN: 392.44 / MAX: 808.45 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Face Detection FP16 - Device: CPU a b c 10 20 30 40 50 SE +/- 0.08, N = 3 SE +/- 0.12, N = 3 42.27 42.25 42.71 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU a b c 80 160 240 320 400 SE +/- 0.40, N = 3 SE +/- 0.46, N = 3 375.06 376.17 372.55 MIN: 224.6 / MAX: 433.91 MIN: 230.91 / MAX: 439.54 MIN: 231.27 / MAX: 422.2 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU a b c 20 40 60 80 100 SE +/- 0.09, N = 3 SE +/- 0.09, N = 3 85.08 84.86 85.63 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU a b c 40 80 120 160 200 SE +/- 0.03, N = 3 SE +/- 0.79, N = 3 162.56 163.41 160.95 MIN: 72.5 / MAX: 251.65 MIN: 63.65 / MAX: 289.17 MIN: 82.14 / MAX: 227.75 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU a b c 40 80 120 160 200 SE +/- 0.04, N = 3 SE +/- 0.95, N = 3 196.62 195.63 198.58 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU a b c 2 4 6 8 10 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 6.88 6.84 6.87 MIN: 4.26 / MAX: 33.56 MIN: 4.41 / MAX: 34.34 MIN: 4.54 / MAX: 31.23 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU a b c 1000 2000 3000 4000 5000 SE +/- 27.53, N = 3 SE +/- 18.87, N = 3 4642.38 4667.85 4646.38 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Re-Identification Retail FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU a b c 1.1723 2.3446 3.5169 4.6892 5.8615 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 5.21 5.21 5.21 MIN: 3.34 / MAX: 26.1 MIN: 3.27 / MAX: 32.05 MIN: 3.24 / MAX: 21.41 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Re-Identification Retail FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU a b c 1300 2600 3900 5200 6500 SE +/- 16.76, N = 3 SE +/- 18.80, N = 3 6129.68 6130.41 6132.62 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Road Segmentation ADAS FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU a b c 6 12 18 24 30 SE +/- 0.02, N = 3 SE +/- 0.31, N = 3 23.89 24.32 23.86 MIN: 11.09 / MAX: 60.97 MIN: 10.39 / MAX: 80.37 MIN: 12.87 / MAX: 46.25 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Road Segmentation ADAS FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU a b c 300 600 900 1200 1500 SE +/- 0.85, N = 3 SE +/- 16.48, N = 3 1337.88 1314.48 1339.37 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection Retail FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU a b c 0.918 1.836 2.754 3.672 4.59 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 4.07 4.08 4.05 MIN: 2.42 / MAX: 32.85 MIN: 2.41 / MAX: 31.88 MIN: 2.56 / MAX: 28.2 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection Retail FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU a b c 3K 6K 9K 12K 15K SE +/- 19.64, N = 3 SE +/- 13.11, N = 3 15686.29 15648.36 15757.59 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU a b c 0.0923 0.1846 0.2769 0.3692 0.4615 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.41 0.40 0.40 MIN: 0.18 / MAX: 25.63 MIN: 0.18 / MAX: 27.21 MIN: 0.18 / MAX: 20.31 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU a b c 30K 60K 90K 120K 150K SE +/- 221.07, N = 3 SE +/- 115.28, N = 3 123999.65 124193.43 124357.62 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU a b c 0.126 0.252 0.378 0.504 0.63 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.56 0.56 0.56 MIN: 0.24 / MAX: 24.72 MIN: 0.23 / MAX: 27.21 MIN: 0.25 / MAX: 21.86 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU a b c 20K 40K 60K 80K 100K SE +/- 16.08, N = 3 SE +/- 231.73, N = 3 94091.47 94317.14 94492.54 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Handwritten English Recognition FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU a b c 7 14 21 28 35 SE +/- 0.17, N = 3 SE +/- 0.10, N = 3 27.78 27.86 28.12 MIN: 15.61 / MAX: 55.03 MIN: 15.98 / MAX: 54.84 MIN: 16.85 / MAX: 54.17 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Handwritten English Recognition FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU a b c 500 1000 1500 2000 2500 SE +/- 13.86, N = 3 SE +/- 8.18, N = 3 2302.64 2296.07 2274.13 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU a b c 2 4 6 8 10 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 6.22 6.23 6.20 MIN: 3.4 / MAX: 49.19 MIN: 3.49 / MAX: 32 MIN: 3.59 / MAX: 37.96 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU a b c 1100 2200 3300 4400 5500 SE +/- 6.84, N = 3 SE +/- 12.57, N = 3 5138.22 5126.71 5154.36 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Handwritten English Recognition FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16 - Device: CPU a b c 7 14 21 28 35 SE +/- 0.03, N = 3 SE +/- 0.08, N = 3 31.60 31.61 31.62 MIN: 17.31 / MAX: 56.19 MIN: 17.14 / MAX: 55.5 MIN: 19.28 / MAX: 52.88 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Handwritten English Recognition FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16 - Device: CPU a b c 400 800 1200 1600 2000 SE +/- 2.04, N = 3 SE +/- 4.80, N = 3 2023.65 2023.16 2022.82 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection Retail FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Face Detection Retail FP16 - Device: CPU a b c 0.6525 1.305 1.9575 2.61 3.2625 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 2.88 2.90 2.87 MIN: 1.77 / MAX: 32.2 MIN: 1.8 / MAX: 27.83 MIN: 1.79 / MAX: 19.8 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection Retail FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Face Detection Retail FP16 - Device: CPU a b c 2K 4K 6K 8K 10K SE +/- 16.01, N = 3 SE +/- 9.78, N = 3 11065.62 11010.41 11129.19 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Weld Porosity Detection FP16 - Device: CPU a b c 4 8 12 16 20 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 14.69 14.73 14.63 MIN: 7.15 / MAX: 38.65 MIN: 7.56 / MAX: 41.95 MIN: 7.7 / MAX: 33.59 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Weld Porosity Detection FP16 - Device: CPU a b c 900 1800 2700 3600 4500 SE +/- 2.03, N = 3 SE +/- 3.24, N = 3 4350.92 4338.94 4371.21 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU a b c 2 4 6 8 10 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 7.42 7.43 7.40 MIN: 4.01 / MAX: 35.25 MIN: 3.8 / MAX: 32.23 MIN: 3.93 / MAX: 35.31 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU a b c 2K 4K 6K 8K 10K SE +/- 7.23, N = 3 SE +/- 7.39, N = 3 8613.69 8596.02 8643.02 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Phoronix Test Suite v10.8.4