ov AMD Ryzen Threadripper 7980X 64-Cores testing with a System76 Thelio Major (FA Z5 BIOS) and AMD Radeon Pro W7900 45GB on Ubuntu 23.10 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2403062-PTS-OV40027790&sor .
ov Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server OpenGL Compiler File-System Screen Resolution a b c AMD Ryzen Threadripper 7980X 64-Cores @ 7.79GHz (64 Cores / 128 Threads) System76 Thelio Major (FA Z5 BIOS) AMD Device 14a4 4 x 32GB DRAM-4800MT/s Micron MTC20F1045S1RC48BA2 1000GB CT1000T700SSD5 AMD Radeon Pro W7900 45GB (1760/1124MHz) AMD Device 14cc DELL P2415Q Aquantia AQC113C NBase-T/IEEE + Realtek RTL8125 2.5GbE + Intel Wi-Fi 6 AX210/AX211/AX411 Ubuntu 23.10 6.5.0-21-generic (x86_64) GNOME Shell 45.2 X Server + Wayland 4.6 Mesa 23.2.1-1ubuntu3.1 (LLVM 15.0.7 DRM 3.54) GCC 13.2.0 ext4 1920x1080 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xa108105 Python Details - Python 3.11.6 Security Details - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
ov openvino: Face Detection FP16 - CPU openvino: Face Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP32 - CPU openvino: Person Detection FP32 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Face Detection Retail FP16 - CPU openvino: Face Detection Retail FP16 - CPU openvino: Road Segmentation ADAS FP16 - CPU openvino: Road Segmentation ADAS FP16 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Face Detection Retail FP16-INT8 - CPU openvino: Face Detection Retail FP16-INT8 - CPU openvino: Road Segmentation ADAS FP16-INT8 - CPU openvino: Road Segmentation ADAS FP16-INT8 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Noise Suppression Poconet-Like FP16 - CPU openvino: Noise Suppression Poconet-Like FP16 - CPU openvino: Handwritten English Recognition FP16 - CPU openvino: Handwritten English Recognition FP16 - CPU openvino: Person Re-Identification Retail FP16 - CPU openvino: Person Re-Identification Retail FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Handwritten English Recognition FP16-INT8 - CPU openvino: Handwritten English Recognition FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU a b c 42.27 753.55 196.62 162.56 195.46 163.55 1455.73 21.99 85.08 375.06 11065.62 2.88 565.80 56.52 5138.22 6.22 4350.92 14.69 15686.29 4.07 1337.88 23.89 352.60 90.71 8613.69 7.42 4642.38 6.88 3272.51 18.99 2023.65 31.60 6129.68 5.21 94091.47 0.56 2302.64 27.78 123999.65 0.41 42.25 753.76 195.63 163.41 172.89 185.33 1305.37 24.49 84.86 376.17 11010.41 2.90 540.40 59.22 5126.71 6.23 4338.94 14.73 15648.36 4.08 1314.48 24.32 331.58 96.46 8596.02 7.43 4667.85 6.84 3138.21 19.82 2023.16 31.61 6130.41 5.21 94317.14 0.56 2296.07 27.86 124193.43 0.40 42.71 745.39 198.58 160.95 196.61 162.59 1684.93 18.95 85.63 372.55 11129.19 2.87 610.82 52.32 5154.36 6.2 4371.21 14.63 15757.59 4.05 1339.37 23.86 364.91 87.63 8643.02 7.4 4646.38 6.87 3770.89 16.45 2022.82 31.62 6132.62 5.21 94492.54 0.56 2274.13 28.12 124357.62 0.4 OpenBenchmarking.org
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Face Detection FP16 - Device: CPU c a b 10 20 30 40 50 SE +/- 0.08, N = 3 SE +/- 0.12, N = 3 42.71 42.27 42.25 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Face Detection FP16 - Device: CPU c a b 160 320 480 640 800 SE +/- 1.36, N = 3 SE +/- 2.10, N = 3 745.39 753.55 753.76 MIN: 392.44 / MAX: 808.45 MIN: 397.27 / MAX: 864.01 MIN: 383.05 / MAX: 847.61 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU c a b 40 80 120 160 200 SE +/- 0.04, N = 3 SE +/- 0.95, N = 3 198.58 196.62 195.63 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU c a b 40 80 120 160 200 SE +/- 0.03, N = 3 SE +/- 0.79, N = 3 160.95 162.56 163.41 MIN: 82.14 / MAX: 227.75 MIN: 72.5 / MAX: 251.65 MIN: 63.65 / MAX: 289.17 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Detection FP32 - Device: CPU c a b 40 80 120 160 200 SE +/- 0.96, N = 3 SE +/- 2.36, N = 15 196.61 195.46 172.89 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Detection FP32 - Device: CPU c a b 40 80 120 160 200 SE +/- 0.79, N = 3 SE +/- 2.40, N = 15 162.59 163.55 185.33 MIN: 73.73 / MAX: 226.73 MIN: 72.85 / MAX: 308.92 MIN: 55.21 / MAX: 418.14 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Vehicle Detection FP16 - Device: CPU c a b 400 800 1200 1600 2000 SE +/- 19.10, N = 15 SE +/- 12.09, N = 15 1684.93 1455.73 1305.37 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Vehicle Detection FP16 - Device: CPU c a b 6 12 18 24 30 SE +/- 0.27, N = 15 SE +/- 0.21, N = 15 18.95 21.99 24.49 MIN: 6.8 / MAX: 68.11 MIN: 6.94 / MAX: 123.03 MIN: 4.61 / MAX: 132.07 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU c a b 20 40 60 80 100 SE +/- 0.09, N = 3 SE +/- 0.09, N = 3 85.63 85.08 84.86 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU c a b 80 160 240 320 400 SE +/- 0.40, N = 3 SE +/- 0.46, N = 3 372.55 375.06 376.17 MIN: 231.27 / MAX: 422.2 MIN: 224.6 / MAX: 433.91 MIN: 230.91 / MAX: 439.54 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection Retail FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Face Detection Retail FP16 - Device: CPU c a b 2K 4K 6K 8K 10K SE +/- 16.01, N = 3 SE +/- 9.78, N = 3 11129.19 11065.62 11010.41 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection Retail FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Face Detection Retail FP16 - Device: CPU c a b 0.6525 1.305 1.9575 2.61 3.2625 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 2.87 2.88 2.90 MIN: 1.79 / MAX: 19.8 MIN: 1.77 / MAX: 32.2 MIN: 1.8 / MAX: 27.83 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Road Segmentation ADAS FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Road Segmentation ADAS FP16 - Device: CPU c a b 130 260 390 520 650 SE +/- 4.42, N = 12 SE +/- 6.18, N = 12 610.82 565.80 540.40 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Road Segmentation ADAS FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Road Segmentation ADAS FP16 - Device: CPU c a b 13 26 39 52 65 SE +/- 0.42, N = 12 SE +/- 0.64, N = 12 52.32 56.52 59.22 MIN: 21.39 / MAX: 90.32 MIN: 14.85 / MAX: 215.8 MIN: 12.32 / MAX: 240.61 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU c a b 1100 2200 3300 4400 5500 SE +/- 6.84, N = 3 SE +/- 12.57, N = 3 5154.36 5138.22 5126.71 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU c a b 2 4 6 8 10 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 6.20 6.22 6.23 MIN: 3.59 / MAX: 37.96 MIN: 3.4 / MAX: 49.19 MIN: 3.49 / MAX: 32 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Weld Porosity Detection FP16 - Device: CPU c a b 900 1800 2700 3600 4500 SE +/- 2.03, N = 3 SE +/- 3.24, N = 3 4371.21 4350.92 4338.94 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Weld Porosity Detection FP16 - Device: CPU c a b 4 8 12 16 20 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 14.63 14.69 14.73 MIN: 7.7 / MAX: 33.59 MIN: 7.15 / MAX: 38.65 MIN: 7.56 / MAX: 41.95 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection Retail FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU c a b 3K 6K 9K 12K 15K SE +/- 19.64, N = 3 SE +/- 13.11, N = 3 15757.59 15686.29 15648.36 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection Retail FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU c a b 0.918 1.836 2.754 3.672 4.59 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 4.05 4.07 4.08 MIN: 2.56 / MAX: 28.2 MIN: 2.42 / MAX: 32.85 MIN: 2.41 / MAX: 31.88 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Road Segmentation ADAS FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU c a b 300 600 900 1200 1500 SE +/- 0.85, N = 3 SE +/- 16.48, N = 3 1339.37 1337.88 1314.48 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Road Segmentation ADAS FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU c a b 6 12 18 24 30 SE +/- 0.02, N = 3 SE +/- 0.31, N = 3 23.86 23.89 24.32 MIN: 12.87 / MAX: 46.25 MIN: 11.09 / MAX: 60.97 MIN: 10.39 / MAX: 80.37 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU c a b 80 160 240 320 400 SE +/- 4.99, N = 3 SE +/- 3.24, N = 6 364.91 352.60 331.58 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU c a b 20 40 60 80 100 SE +/- 1.28, N = 3 SE +/- 0.91, N = 6 87.63 90.71 96.46 MIN: 51.83 / MAX: 121.81 MIN: 43.8 / MAX: 208.3 MIN: 38.48 / MAX: 286.5 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU c a b 2K 4K 6K 8K 10K SE +/- 7.23, N = 3 SE +/- 7.39, N = 3 8643.02 8613.69 8596.02 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU c a b 2 4 6 8 10 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 7.40 7.42 7.43 MIN: 3.93 / MAX: 35.31 MIN: 4.01 / MAX: 35.25 MIN: 3.8 / MAX: 32.23 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU b c a 1000 2000 3000 4000 5000 SE +/- 18.87, N = 3 SE +/- 27.53, N = 3 4667.85 4646.38 4642.38 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU b c a 2 4 6 8 10 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 6.84 6.87 6.88 MIN: 4.41 / MAX: 34.34 MIN: 4.54 / MAX: 31.23 MIN: 4.26 / MAX: 33.56 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Noise Suppression Poconet-Like FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU c a b 800 1600 2400 3200 4000 SE +/- 30.85, N = 15 SE +/- 33.49, N = 13 3770.89 3272.51 3138.21 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Noise Suppression Poconet-Like FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU c a b 5 10 15 20 25 SE +/- 0.16, N = 15 SE +/- 0.19, N = 13 16.45 18.99 19.82 MIN: 8.42 / MAX: 75.99 MIN: 7.69 / MAX: 149.17 MIN: 7.31 / MAX: 143.42 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Handwritten English Recognition FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16 - Device: CPU a b c 400 800 1200 1600 2000 SE +/- 2.04, N = 3 SE +/- 4.80, N = 3 2023.65 2023.16 2022.82 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Handwritten English Recognition FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16 - Device: CPU a b c 7 14 21 28 35 SE +/- 0.03, N = 3 SE +/- 0.08, N = 3 31.60 31.61 31.62 MIN: 17.31 / MAX: 56.19 MIN: 17.14 / MAX: 55.5 MIN: 19.28 / MAX: 52.88 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Re-Identification Retail FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU c b a 1300 2600 3900 5200 6500 SE +/- 18.80, N = 3 SE +/- 16.76, N = 3 6132.62 6130.41 6129.68 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Re-Identification Retail FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU a b c 1.1723 2.3446 3.5169 4.6892 5.8615 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 5.21 5.21 5.21 MIN: 3.34 / MAX: 26.1 MIN: 3.27 / MAX: 32.05 MIN: 3.24 / MAX: 21.41 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU c b a 20K 40K 60K 80K 100K SE +/- 231.73, N = 3 SE +/- 16.08, N = 3 94492.54 94317.14 94091.47 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU a b c 0.126 0.252 0.378 0.504 0.63 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.56 0.56 0.56 MIN: 0.24 / MAX: 24.72 MIN: 0.23 / MAX: 27.21 MIN: 0.25 / MAX: 21.86 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Handwritten English Recognition FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU a b c 500 1000 1500 2000 2500 SE +/- 13.86, N = 3 SE +/- 8.18, N = 3 2302.64 2296.07 2274.13 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Handwritten English Recognition FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU a b c 7 14 21 28 35 SE +/- 0.17, N = 3 SE +/- 0.10, N = 3 27.78 27.86 28.12 MIN: 15.61 / MAX: 55.03 MIN: 15.98 / MAX: 54.84 MIN: 16.85 / MAX: 54.17 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU c b a 30K 60K 90K 120K 150K SE +/- 115.28, N = 3 SE +/- 221.07, N = 3 124357.62 124193.43 123999.65 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU b c a 0.0923 0.1846 0.2769 0.3692 0.4615 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.40 0.40 0.41 MIN: 0.18 / MAX: 27.21 MIN: 0.18 / MAX: 20.31 MIN: 0.18 / MAX: 25.63 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Phoronix Test Suite v10.8.4