vino AMD Ryzen 9 5900X 12-Core testing with a ASRock X570 Steel Legend (P5.63 BIOS) and MSI NVIDIA GeForce RTX 3080 12GB on Ubuntu 22.04 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2501174-NE-VINO8137317 AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX Processor: AMD Ryzen 9 5900X 12-Core @ 3.70GHz (12 Cores / 24 Threads), Motherboard: ASRock X570 Steel Legend (P5.63 BIOS), Chipset: AMD Starship/Matisse, Memory: 4 x 16GB DDR4-3600MT/s TEAMGROUP-UD4-3200, Disk: 1000GB Western Digital WDS100T3X0C-00SJG0 + 1000GB Western Digital WD Blue SN580 1TB + 2000GB Seagate ST2000DX001-1CM1 + 250GB Samsung SSD 840, Graphics: MSI NVIDIA GeForce RTX 3080 12GB, Audio: NVIDIA GA102 HD Audio, Monitor: DELL S2721QS, Network: Intel I211 + Intel Dual Band-AC 3168NGW
OS: Ubuntu 22.04, Kernel: 6.8.0-51-generic (x86_64), Desktop: GNOME Shell 42.9, Display Server: X Server 1.21.1.4, Display Driver: NVIDIA 565.57.01, OpenGL: 4.6.0, Vulkan: 1.3.289, Compiler: GCC 11.4.0 + CUDA 12.6, File-System: ext4, Screen Resolution: 5120x2880
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0xa20102bPython Notes: Python 3.10.12Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines; IBPB: conditional; IBRS_FW; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected
vino OpenBenchmarking.org Phoronix Test Suite AMD Ryzen 9 5900X 12-Core @ 3.70GHz (12 Cores / 24 Threads) ASRock X570 Steel Legend (P5.63 BIOS) AMD Starship/Matisse 4 x 16GB DDR4-3600MT/s TEAMGROUP-UD4-3200 1000GB Western Digital WDS100T3X0C-00SJG0 + 1000GB Western Digital WD Blue SN580 1TB + 2000GB Seagate ST2000DX001-1CM1 + 250GB Samsung SSD 840 MSI NVIDIA GeForce RTX 3080 12GB NVIDIA GA102 HD Audio DELL S2721QS Intel I211 + Intel Dual Band-AC 3168NGW Ubuntu 22.04 6.8.0-51-generic (x86_64) GNOME Shell 42.9 X Server 1.21.1.4 NVIDIA 565.57.01 4.6.0 1.3.289 GCC 11.4.0 + CUDA 12.6 ext4 5120x2880 Processor Motherboard Chipset Memory Disk Graphics Audio Monitor Network OS Kernel Desktop Display Server Display Driver OpenGL Vulkan Compiler File-System Screen Resolution Vino Benchmarks System Logs - Transparent Huge Pages: madvise - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0xa20102b - Python 3.10.12 - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines; IBPB: conditional; IBRS_FW; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected
vino openvino: Face Detection FP16 - CPU openvino: Face Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP32 - CPU openvino: Person Detection FP32 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Face Detection Retail FP16 - CPU openvino: Face Detection Retail FP16 - CPU openvino: Road Segmentation ADAS FP16 - CPU openvino: Road Segmentation ADAS FP16 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Face Detection Retail FP16-INT8 - CPU openvino: Face Detection Retail FP16-INT8 - CPU openvino: Road Segmentation ADAS FP16-INT8 - CPU openvino: Road Segmentation ADAS FP16-INT8 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Noise Suppression Poconet-Like FP16 - CPU openvino: Noise Suppression Poconet-Like FP16 - CPU openvino: Handwritten English Recognition FP16 - CPU openvino: Handwritten English Recognition FP16 - CPU openvino: Person Re-Identification Retail FP16 - CPU openvino: Person Re-Identification Retail FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Handwritten English Recognition FP16-INT8 - CPU openvino: Handwritten English Recognition FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 3.68 1623.53 18.84 318.09 18.74 319.80 143.49 41.76 8.10 737.71 1064.26 5.62 52.87 113.38 551.47 10.86 376.62 15.89 1585.32 3.75 217.20 27.58 43.15 138.96 789.46 15.17 417.12 14.36 387.06 15.40 171.86 69.78 584.13 10.24 10148.33 1.10 201.02 59.64 17580.69 0.62 OpenBenchmarking.org
OpenVINO GenAI Model: Gemma-7b-int4-ov - Device: CPU
AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX: The test quit with a non-zero exit status. E: RuntimeError: Exception from src/inference/src/cpp/core.cpp:90:
Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU
AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX: The test quit with a non-zero exit status. E: RuntimeError: Exception from src/inference/src/cpp/core.cpp:90:
Model: Falcon-7b-instruct-int4-ov - Device: CPU
AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX: The test quit with a non-zero exit status. E: RuntimeError: Exception from src/inference/src/cpp/core.cpp:90:
Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU
AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX: The test quit with a non-zero exit status. E: RuntimeError: Exception from src/inference/src/cpp/core.cpp:90:
OpenVINO OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Face Detection FP16 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 0.828 1.656 2.484 3.312 4.14 SE +/- 0.01, N = 3 3.68 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Face Detection FP16 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 300 600 900 1200 1500 SE +/- 4.80, N = 3 1623.53 MIN: 1318.79 / MAX: 1742.09 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Person Detection FP16 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 5 10 15 20 25 SE +/- 0.04, N = 3 18.84 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Person Detection FP16 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 70 140 210 280 350 SE +/- 0.69, N = 3 318.09 MIN: 164.4 / MAX: 424.43 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Person Detection FP32 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 5 10 15 20 25 SE +/- 0.05, N = 3 18.74 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Person Detection FP32 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 70 140 210 280 350 SE +/- 0.88, N = 3 319.80 MIN: 148.04 / MAX: 454.02 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Vehicle Detection FP16 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 30 60 90 120 150 SE +/- 0.09, N = 3 143.49 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Vehicle Detection FP16 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 10 20 30 40 50 SE +/- 0.03, N = 3 41.76 MIN: 12.34 / MAX: 77.32 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Face Detection FP16-INT8 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 2 4 6 8 10 SE +/- 0.01, N = 3 8.10 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Face Detection FP16-INT8 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 160 320 480 640 800 SE +/- 0.71, N = 3 737.71 MIN: 496.83 / MAX: 751.96 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Face Detection Retail FP16 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 200 400 600 800 1000 SE +/- 1.83, N = 3 1064.26 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Face Detection Retail FP16 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 1.2645 2.529 3.7935 5.058 6.3225 SE +/- 0.01, N = 3 5.62 MIN: 3.14 / MAX: 17.67 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Road Segmentation ADAS FP16 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 12 24 36 48 60 SE +/- 0.11, N = 3 52.87 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Road Segmentation ADAS FP16 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 30 60 90 120 150 SE +/- 0.24, N = 3 113.38 MIN: 23.62 / MAX: 165.34 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Vehicle Detection FP16-INT8 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 120 240 360 480 600 SE +/- 0.43, N = 3 551.47 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Vehicle Detection FP16-INT8 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 3 6 9 12 15 SE +/- 0.01, N = 3 10.86 MIN: 7.14 / MAX: 21.62 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Weld Porosity Detection FP16 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 80 160 240 320 400 SE +/- 0.20, N = 3 376.62 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Weld Porosity Detection FP16 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 4 8 12 16 20 SE +/- 0.01, N = 3 15.89 MIN: 8.22 / MAX: 31.22 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Face Detection Retail FP16-INT8 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 300 600 900 1200 1500 SE +/- 1.77, N = 3 1585.32 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Face Detection Retail FP16-INT8 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 0.8438 1.6876 2.5314 3.3752 4.219 SE +/- 0.01, N = 3 3.75 MIN: 2.24 / MAX: 13.39 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 50 100 150 200 250 SE +/- 0.82, N = 3 217.20 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 6 12 18 24 30 SE +/- 0.10, N = 3 27.58 MIN: 14.13 / MAX: 40.46 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Machine Translation EN To DE FP16 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 10 20 30 40 50 SE +/- 0.12, N = 3 43.15 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Machine Translation EN To DE FP16 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 30 60 90 120 150 SE +/- 0.40, N = 3 138.96 MIN: 71.59 / MAX: 198 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Weld Porosity Detection FP16-INT8 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 200 400 600 800 1000 SE +/- 0.69, N = 3 789.46 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Weld Porosity Detection FP16-INT8 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 4 8 12 16 20 SE +/- 0.01, N = 3 15.17 MIN: 8.85 / MAX: 24.57 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Person Vehicle Bike Detection FP16 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 90 180 270 360 450 SE +/- 0.36, N = 3 417.12 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Person Vehicle Bike Detection FP16 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 4 8 12 16 20 SE +/- 0.01, N = 3 14.36 MIN: 7.78 / MAX: 30.78 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Noise Suppression Poconet-Like FP16 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 80 160 240 320 400 SE +/- 1.59, N = 3 387.06 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Noise Suppression Poconet-Like FP16 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 4 8 12 16 20 SE +/- 0.06, N = 3 15.40 MIN: 9.88 / MAX: 48.94 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Handwritten English Recognition FP16 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 40 80 120 160 200 SE +/- 1.92, N = 5 171.86 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Handwritten English Recognition FP16 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 16 32 48 64 80 SE +/- 0.78, N = 5 69.78 MIN: 39.49 / MAX: 109.1 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Person Re-Identification Retail FP16 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 130 260 390 520 650 SE +/- 0.62, N = 3 584.13 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Person Re-Identification Retail FP16 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 3 6 9 12 15 SE +/- 0.01, N = 3 10.24 MIN: 6.43 / MAX: 22.36 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 2K 4K 6K 8K 10K SE +/- 4.61, N = 3 10148.33 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 0.2475 0.495 0.7425 0.99 1.2375 SE +/- 0.00, N = 3 1.10 MIN: 0.47 / MAX: 21.06 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Handwritten English Recognition FP16-INT8 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 40 80 120 160 200 SE +/- 0.82, N = 3 201.02 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Handwritten English Recognition FP16-INT8 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 13 26 39 52 65 SE +/- 0.25, N = 3 59.64 MIN: 38.32 / MAX: 73.98 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.5 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 4K 8K 12K 16K 20K SE +/- 63.48, N = 3 17580.69 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.5 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX 0.1395 0.279 0.4185 0.558 0.6975 SE +/- 0.00, N = 3 0.62 MIN: 0.28 / MAX: 10.12 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl -lstdc++fs
AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX Processor: AMD Ryzen 9 5900X 12-Core @ 3.70GHz (12 Cores / 24 Threads), Motherboard: ASRock X570 Steel Legend (P5.63 BIOS), Chipset: AMD Starship/Matisse, Memory: 4 x 16GB DDR4-3600MT/s TEAMGROUP-UD4-3200, Disk: 1000GB Western Digital WDS100T3X0C-00SJG0 + 1000GB Western Digital WD Blue SN580 1TB + 2000GB Seagate ST2000DX001-1CM1 + 250GB Samsung SSD 840, Graphics: MSI NVIDIA GeForce RTX 3080 12GB, Audio: NVIDIA GA102 HD Audio, Monitor: DELL S2721QS, Network: Intel I211 + Intel Dual Band-AC 3168NGW
OS: Ubuntu 22.04, Kernel: 6.8.0-51-generic (x86_64), Desktop: GNOME Shell 42.9, Display Server: X Server 1.21.1.4, Display Driver: NVIDIA 565.57.01, OpenGL: 4.6.0, Vulkan: 1.3.289, Compiler: GCC 11.4.0 + CUDA 12.6, File-System: ext4, Screen Resolution: 5120x2880
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0xa20102bPython Notes: Python 3.10.12Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines; IBPB: conditional; IBRS_FW; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 17 January 2025 11:30 by user ce.