OpenVINO AMD Ryzen 7 8845HS testing with a NB04 TUXEDO Sirius 16 Gen2 AHP958 (AHP958_V1.00A00_20240528 BIOS) and AMD Radeon RX 7600/7600 XT/7600M XT/7600S/7700S / PRO W7600 512MB on Ubuntu 24.10 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2409090-NE-OPENVINO321 .
OpenVINO Processor Motherboard Chipset Memory Disk Graphics Audio Network OS Kernel Desktop Display Server OpenGL Compiler File-System Screen Resolution Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 AMD Ryzen 7 8845HS @ 5.14GHz (8 Cores / 16 Threads) NB04 TUXEDO Sirius 16 Gen2 AHP958 (AHP958_V1.00A00_20240528 BIOS) AMD Device 14e8 2 x 32GB DDR5-5600MT/s CMS5X32G2A56C48A2 1000GB Samsung SSD 990 PRO 1TB AMD Radeon RX 7600/7600 XT/7600M XT/7600S/7700S / PRO W7600 512MB AMD Navi 31 HDMI/DP Realtek RTL8111/8168/8211/8411 + Intel Wi-Fi 6E Ubuntu 24.10 6.11.0-rc6-phx (x86_64) GNOME Shell X Server + Wayland 4.6 Mesa 24.2.2-1ubuntu1 (LLVM 18.1.8 DRM 3.58) GCC 14.2.0 ext4 2560x1440 OpenBenchmarking.org - Transparent Huge Pages: madvise - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2,rust --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-14-CWPfvr/gcc-14-14.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-14-CWPfvr/gcc-14-14.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: amd-pstate-epp powersave (Boost: Enabled EPP: performance) - Platform Profile: balanced - CPU Microcode: 0xa705203 - ACPI Profile: balanced - Python 3.12.5 - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected
OpenVINO openvino: Face Detection FP16-INT8 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP32 - CPU openvino: Person Detection FP32 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Face Detection Retail FP16-INT8 - CPU openvino: Face Detection Retail FP16-INT8 - CPU openvino: Handwritten English Recognition FP16-INT8 - CPU openvino: Handwritten English Recognition FP16-INT8 - CPU openvino: Road Segmentation ADAS FP16-INT8 - CPU openvino: Road Segmentation ADAS FP16-INT8 - CPU openvino: Person Re-Identification Retail FP16 - CPU openvino: Person Re-Identification Retail FP16 - CPU openvino: Noise Suppression Poconet-Like FP16 - CPU openvino: Noise Suppression Poconet-Like FP16 - CPU Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 12.28 325.18 49.82 80.21 49.87 80.14 1259.06 6.33 711.60 5.59 664.26 5.99 72.45 55.16 2205.72 3.61 353.54 22.59 229.73 17.37 844.69 4.72 831.56 9.53 OpenBenchmarking.org
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 3 6 9 12 15 SE +/- 0.02, N = 3 12.28 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 70 140 210 280 350 SE +/- 0.39, N = 3 325.18 MIN: 174.63 / MAX: 391.64 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO CPU Power Consumption Monitor Min Avg Max Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 8.5 74.2 83.0 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2024.0 CPU Power Consumption Monitor 20 40 60 80 100
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 11 22 33 44 55 SE +/- 0.35, N = 3 49.82 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 20 40 60 80 100 SE +/- 0.56, N = 3 80.21 MIN: 37.36 / MAX: 105.52 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO CPU Power Consumption Monitor Min Avg Max Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 8.5 66.5 76.0 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2024.0 CPU Power Consumption Monitor 20 40 60 80 100
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Detection FP32 - Device: CPU Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 11 22 33 44 55 SE +/- 0.30, N = 3 49.87 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Detection FP32 - Device: CPU Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 20 40 60 80 100 SE +/- 0.49, N = 3 80.14 MIN: 38.71 / MAX: 105.99 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO CPU Power Consumption Monitor Min Avg Max Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 8.8 66.5 75.5 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2024.0 CPU Power Consumption Monitor 20 40 60 80 100
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 300 600 900 1200 1500 SE +/- 0.38, N = 3 1259.06 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 2 4 6 8 10 SE +/- 0.00, N = 3 6.33 MIN: 3.36 / MAX: 21.51 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO CPU Power Consumption Monitor Min Avg Max Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 8.8 76.1 83.0 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2024.0 CPU Power Consumption Monitor 20 40 60 80 100
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 150 300 450 600 750 SE +/- 1.30, N = 3 711.60 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 1.2578 2.5156 3.7734 5.0312 6.289 SE +/- 0.01, N = 3 5.59 MIN: 3.28 / MAX: 21.18 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO CPU Power Consumption Monitor Min Avg Max Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 8.7 73.2 79.6 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2024.0 CPU Power Consumption Monitor 20 40 60 80 100
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 140 280 420 560 700 SE +/- 1.01, N = 3 664.26 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 1.3478 2.6956 4.0434 5.3912 6.739 SE +/- 0.01, N = 3 5.99 MIN: 4.04 / MAX: 13.63 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO CPU Power Consumption Monitor Min Avg Max Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 8.8 70.9 77.5 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2024.0 CPU Power Consumption Monitor 20 40 60 80 100
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 16 32 48 64 80 SE +/- 0.14, N = 3 72.45 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 12 24 36 48 60 SE +/- 0.11, N = 3 55.16 MIN: 34.14 / MAX: 84.9 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO CPU Power Consumption Monitor Min Avg Max Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 8.9 74.5 82.0 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2024.0 CPU Power Consumption Monitor 20 40 60 80 100
OpenVINO Model: Face Detection Retail FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 500 1000 1500 2000 2500 SE +/- 3.78, N = 3 2205.72 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection Retail FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 0.8123 1.6246 2.4369 3.2492 4.0615 SE +/- 0.01, N = 3 3.61 MIN: 2.2 / MAX: 9.75 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO CPU Power Consumption Monitor Min Avg Max Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 8.9 75.7 82.1 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2024.0 CPU Power Consumption Monitor 20 40 60 80 100
OpenVINO Model: Handwritten English Recognition FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 80 160 240 320 400 SE +/- 0.30, N = 3 353.54 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Handwritten English Recognition FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 5 10 15 20 25 SE +/- 0.02, N = 3 22.59 MIN: 17.1 / MAX: 42.08 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO CPU Power Consumption Monitor Min Avg Max Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 8.7 76.4 82.9 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2024.0 CPU Power Consumption Monitor 20 40 60 80 100
OpenVINO Model: Road Segmentation ADAS FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 50 100 150 200 250 SE +/- 0.17, N = 3 229.73 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Road Segmentation ADAS FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 4 8 12 16 20 SE +/- 0.01, N = 3 17.37 MIN: 11.46 / MAX: 29 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO CPU Power Consumption Monitor Min Avg Max Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 8.9 67.2 73.6 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2024.0 CPU Power Consumption Monitor 20 40 60 80 100
OpenVINO Model: Person Re-Identification Retail FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 200 400 600 800 1000 SE +/- 0.74, N = 3 844.69 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Re-Identification Retail FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 1.062 2.124 3.186 4.248 5.31 SE +/- 0.00, N = 3 4.72 MIN: 2.93 / MAX: 20.69 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO CPU Power Consumption Monitor Min Avg Max Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 8.9 73.9 80.8 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2024.0 CPU Power Consumption Monitor 20 40 60 80 100
OpenVINO Model: Noise Suppression Poconet-Like FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 200 400 600 800 1000 SE +/- 0.45, N = 3 831.56 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Noise Suppression Poconet-Like FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 3 6 9 12 15 SE +/- 0.01, N = 3 9.53 MIN: 6.38 / MAX: 20.47 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO CPU Power Consumption Monitor Min Avg Max Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 8.9 73.6 79.6 OpenBenchmarking.org Watts, Fewer Is Better OpenVINO 2024.0 CPU Power Consumption Monitor 20 40 60 80 100
CPU Power Consumption Monitor Phoronix Test Suite System Monitoring OpenBenchmarking.org Watts CPU Power Consumption Monitor Phoronix Test Suite System Monitoring Ryzen 7 8845HS - TUXEDO Sirius 16 Gen2 16 32 48 64 80 Min: 8.37 / Avg: 68.55 / Max: 83.01
Phoronix Test Suite v10.8.5