vino AMD Ryzen 9 5900X 12-Core testing with a ASRock X570 Steel Legend (P5.63 BIOS) and MSI NVIDIA GeForce RTX 3080 12GB on Ubuntu 22.04 via the Phoronix Test Suite. AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX: Processor: AMD Ryzen 9 5900X 12-Core @ 3.70GHz (12 Cores / 24 Threads), Motherboard: ASRock X570 Steel Legend (P5.63 BIOS), Chipset: AMD Starship/Matisse, Memory: 4 x 16GB DDR4-3600MT/s TEAMGROUP-UD4-3200, Disk: 1000GB Western Digital WDS100T3X0C-00SJG0 + 1000GB Western Digital WD Blue SN580 1TB + 2000GB Seagate ST2000DX001-1CM1 + 250GB Samsung SSD 840, Graphics: MSI NVIDIA GeForce RTX 3080 12GB, Audio: NVIDIA GA102 HD Audio, Monitor: DELL S2721QS, Network: Intel I211 + Intel Dual Band-AC 3168NGW OS: Ubuntu 22.04, Kernel: 6.8.0-51-generic (x86_64), Desktop: GNOME Shell 42.9, Display Server: X Server 1.21.1.4, Display Driver: NVIDIA 565.57.01, OpenGL: 4.6.0, Vulkan: 1.3.289, Compiler: GCC 11.4.0 + CUDA 12.6, File-System: ext4, Screen Resolution: 5120x2880 OpenVINO 2024.5 Model: Face Detection FP16 - Device: CPU FPS > Higher Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 3.68 |==================== OpenVINO 2024.5 Model: Person Detection FP16 - Device: CPU FPS > Higher Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 18.84 |=================== OpenVINO 2024.5 Model: Person Detection FP32 - Device: CPU FPS > Higher Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 18.74 |=================== OpenVINO 2024.5 Model: Vehicle Detection FP16 - Device: CPU FPS > Higher Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 143.49 |================== OpenVINO 2024.5 Model: Face Detection FP16-INT8 - Device: CPU FPS > Higher Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 8.10 |==================== OpenVINO 2024.5 Model: Face Detection Retail FP16 - Device: CPU FPS > Higher Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 1064.26 |================= OpenVINO 2024.5 Model: Road Segmentation ADAS FP16 - Device: CPU FPS > Higher Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 52.87 |=================== OpenVINO 2024.5 Model: Vehicle Detection FP16-INT8 - Device: CPU FPS > Higher Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 551.47 |================== OpenVINO 2024.5 Model: Weld Porosity Detection FP16 - Device: CPU FPS > Higher Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 376.62 |================== OpenVINO 2024.5 Model: Face Detection Retail FP16-INT8 - Device: CPU FPS > Higher Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 1585.32 |================= OpenVINO 2024.5 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU FPS > Higher Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 217.20 |================== OpenVINO 2024.5 Model: Machine Translation EN To DE FP16 - Device: CPU FPS > Higher Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 43.15 |=================== OpenVINO 2024.5 Model: Weld Porosity Detection FP16-INT8 - Device: CPU FPS > Higher Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 789.46 |================== OpenVINO 2024.5 Model: Person Vehicle Bike Detection FP16 - Device: CPU FPS > Higher Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 417.12 |================== OpenVINO 2024.5 Model: Noise Suppression Poconet-Like FP16 - Device: CPU FPS > Higher Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 387.06 |================== OpenVINO 2024.5 Model: Handwritten English Recognition FP16 - Device: CPU FPS > Higher Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 171.86 |================== OpenVINO 2024.5 Model: Person Re-Identification Retail FP16 - Device: CPU FPS > Higher Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 584.13 |================== OpenVINO 2024.5 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU FPS > Higher Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 10148.33 |================ OpenVINO 2024.5 Model: Handwritten English Recognition FP16-INT8 - Device: CPU FPS > Higher Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 201.02 |================== OpenVINO 2024.5 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU FPS > Higher Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 17580.69 |================ OpenVINO GenAI 2024.5 Model: Gemma-7b-int4-ov - Device: CPU tokens/s > Higher Is Better OpenVINO GenAI 2024.5 Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU tokens/s > Higher Is Better OpenVINO GenAI 2024.5 Model: Falcon-7b-instruct-int4-ov - Device: CPU tokens/s > Higher Is Better OpenVINO GenAI 2024.5 Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU tokens/s > Higher Is Better OpenVINO 2024.5 Model: Face Detection FP16 - Device: CPU ms < Lower Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 1623.53 |================= OpenVINO 2024.5 Model: Person Detection FP16 - Device: CPU ms < Lower Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 318.09 |================== OpenVINO 2024.5 Model: Person Detection FP32 - Device: CPU ms < Lower Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 319.80 |================== OpenVINO 2024.5 Model: Vehicle Detection FP16 - Device: CPU ms < Lower Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 41.76 |=================== OpenVINO 2024.5 Model: Face Detection FP16-INT8 - Device: CPU ms < Lower Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 737.71 |================== OpenVINO 2024.5 Model: Face Detection Retail FP16 - Device: CPU ms < Lower Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 5.62 |==================== OpenVINO 2024.5 Model: Road Segmentation ADAS FP16 - Device: CPU ms < Lower Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 113.38 |================== OpenVINO 2024.5 Model: Vehicle Detection FP16-INT8 - Device: CPU ms < Lower Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 10.86 |=================== OpenVINO 2024.5 Model: Weld Porosity Detection FP16 - Device: CPU ms < Lower Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 15.89 |=================== OpenVINO 2024.5 Model: Face Detection Retail FP16-INT8 - Device: CPU ms < Lower Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 3.75 |==================== OpenVINO 2024.5 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU ms < Lower Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 27.58 |=================== OpenVINO 2024.5 Model: Machine Translation EN To DE FP16 - Device: CPU ms < Lower Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 138.96 |================== OpenVINO 2024.5 Model: Weld Porosity Detection FP16-INT8 - Device: CPU ms < Lower Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 15.17 |=================== OpenVINO 2024.5 Model: Person Vehicle Bike Detection FP16 - Device: CPU ms < Lower Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 14.36 |=================== OpenVINO 2024.5 Model: Noise Suppression Poconet-Like FP16 - Device: CPU ms < Lower Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 15.40 |=================== OpenVINO 2024.5 Model: Handwritten English Recognition FP16 - Device: CPU ms < Lower Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 69.78 |=================== OpenVINO 2024.5 Model: Person Re-Identification Retail FP16 - Device: CPU ms < Lower Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 10.24 |=================== OpenVINO 2024.5 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU ms < Lower Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 1.10 |==================== OpenVINO 2024.5 Model: Handwritten English Recognition FP16-INT8 - Device: CPU ms < Lower Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 59.64 |=================== OpenVINO 2024.5 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU ms < Lower Is Better AMD Ryzen 9 5900X 12-Core - MSI NVIDIA GeForce RTX . 0.62 |====================