openvino 2024 AMD Ryzen 9 7950X 16-Core testing with a ASUS ROG STRIX X670E-E GAMING WIFI (1416 BIOS) and NVIDIA GeForce RTX 4090 24GB on Ubuntu 23.10 via the Phoronix Test Suite. a: Processor: AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG STRIX X670E-E GAMING WIFI (1416 BIOS), Chipset: AMD Device 14d8, Memory: 2 x 16GB DRAM-6000MT/s G Skill F5-6000J3038F16G, Disk: 2000GB Samsung SSD 980 PRO 2TB + 4001GB Western Digital WD_BLACK SN850X 4000GB, Graphics: NVIDIA GeForce RTX 4090 24GB, Audio: NVIDIA AD102 HD Audio, Monitor: DELL U2723QE, Network: Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411 OS: Ubuntu 23.10, Kernel: 6.7.0-060700-generic (x86_64), Desktop: GNOME Shell 45.2, Display Server: X Server 1.21.1.7, Display Driver: NVIDIA 550.54.14, OpenGL: 4.6.0, OpenCL: OpenCL 3.0 CUDA 12.4.89, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 3840x2160 b: Processor: AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG STRIX X670E-E GAMING WIFI (1416 BIOS), Chipset: AMD Device 14d8, Memory: 2 x 16GB DRAM-6000MT/s G Skill F5-6000J3038F16G, Disk: 2000GB Samsung SSD 980 PRO 2TB + 4001GB Western Digital WD_BLACK SN850X 4000GB, Graphics: NVIDIA GeForce RTX 4090 24GB, Audio: NVIDIA AD102 HD Audio, Monitor: DELL U2723QE, Network: Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411 OS: Ubuntu 23.10, Kernel: 6.7.0-060700-generic (x86_64), Desktop: GNOME Shell 45.2, Display Server: X Server 1.21.1.7, Display Driver: NVIDIA 550.54.14, OpenGL: 4.6.0, OpenCL: OpenCL 3.0 CUDA 12.4.89, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 3840x2160 c: Processor: AMD Ryzen 9 7950X 16-Core @ 5.88GHz (16 Cores / 32 Threads), Motherboard: ASUS ROG STRIX X670E-E GAMING WIFI (1416 BIOS), Chipset: AMD Device 14d8, Memory: 2 x 16GB DRAM-6000MT/s G Skill F5-6000J3038F16G, Disk: 2000GB Samsung SSD 980 PRO 2TB + 4001GB Western Digital WD_BLACK SN850X 4000GB, Graphics: NVIDIA GeForce RTX 4090 24GB, Audio: NVIDIA AD102 HD Audio, Monitor: DELL U2723QE, Network: Intel I225-V + Intel Wi-Fi 6 AX210/AX211/AX411 OS: Ubuntu 23.10, Kernel: 6.7.0-060700-generic (x86_64), Desktop: GNOME Shell 45.2, Display Server: X Server 1.21.1.7, Display Driver: NVIDIA 550.54.14, OpenGL: 4.6.0, OpenCL: OpenCL 3.0 CUDA 12.4.89, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 3840x2160 OpenVINO 2024.0 Model: Face Detection FP16 - Device: CPU FPS > Higher Is Better a . 13.33 |==================================================================== b . 13.37 |==================================================================== c . 13.27 |=================================================================== OpenVINO 2024.0 Model: Face Detection FP16 - Device: CPU ms < Lower Is Better a . 597.87 |=================================================================== b . 597.06 |=================================================================== c . 600.09 |=================================================================== OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU FPS > Higher Is Better a . 91.57 |=================================================================== b . 91.68 |=================================================================== c . 92.75 |==================================================================== OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU ms < Lower Is Better a . 87.30 |==================================================================== b . 87.18 |==================================================================== c . 86.18 |=================================================================== OpenVINO 2024.0 Model: Person Detection FP32 - Device: CPU FPS > Higher Is Better a . 91.17 |=================================================================== b . 92.16 |==================================================================== c . 90.77 |=================================================================== OpenVINO 2024.0 Model: Person Detection FP32 - Device: CPU ms < Lower Is Better a . 87.68 |==================================================================== b . 86.76 |=================================================================== c . 88.04 |==================================================================== OpenVINO 2024.0 Model: Vehicle Detection FP16 - Device: CPU FPS > Higher Is Better a . 762.88 |================================================================== b . 765.09 |=================================================================== c . 770.59 |=================================================================== OpenVINO 2024.0 Model: Vehicle Detection FP16 - Device: CPU ms < Lower Is Better a . 10.45 |==================================================================== b . 10.42 |==================================================================== c . 10.35 |=================================================================== OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a . 25.43 |==================================================================== b . 25.48 |==================================================================== c . 25.51 |==================================================================== OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU ms < Lower Is Better a . 314.05 |=================================================================== b . 313.43 |=================================================================== c . 313.05 |=================================================================== OpenVINO 2024.0 Model: Face Detection Retail FP16 - Device: CPU FPS > Higher Is Better a . 3082.02 |================================================================== b . 3095.79 |================================================================== c . 3080.88 |================================================================== OpenVINO 2024.0 Model: Face Detection Retail FP16 - Device: CPU ms < Lower Is Better a . 2.52 |===================================================================== b . 2.51 |===================================================================== c . 2.51 |===================================================================== OpenVINO 2024.0 Model: Road Segmentation ADAS FP16 - Device: CPU FPS > Higher Is Better a . 284.77 |=================================================================== b . 282.73 |=================================================================== c . 278.19 |================================================================= OpenVINO 2024.0 Model: Road Segmentation ADAS FP16 - Device: CPU ms < Lower Is Better a . 28.02 |================================================================== b . 28.22 |=================================================================== c . 28.67 |==================================================================== OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a . 1596.86 |================================================================== b . 1594.16 |================================================================== c . 1596.03 |================================================================== OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU ms < Lower Is Better a . 4.99 |===================================================================== b . 4.99 |===================================================================== c . 4.99 |===================================================================== OpenVINO 2024.0 Model: Weld Porosity Detection FP16 - Device: CPU FPS > Higher Is Better a . 1316.13 |================================================================== b . 1316.73 |================================================================== c . 1319.50 |================================================================== OpenVINO 2024.0 Model: Weld Porosity Detection FP16 - Device: CPU ms < Lower Is Better a . 12.13 |==================================================================== b . 12.12 |==================================================================== c . 12.10 |==================================================================== OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU FPS > Higher Is Better a . 4479.95 |================================================================== b . 4496.75 |================================================================== c . 4498.33 |================================================================== OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU ms < Lower Is Better a . 3.50 |===================================================================== b . 3.50 |===================================================================== c . 3.49 |===================================================================== OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU FPS > Higher Is Better a . 452.34 |=================================================================== b . 455.46 |=================================================================== c . 455.05 |=================================================================== OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU ms < Lower Is Better a . 17.63 |==================================================================== b . 17.51 |==================================================================== c . 17.52 |==================================================================== OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU FPS > Higher Is Better a . 135.42 |=================================================================== b . 134.73 |=================================================================== c . 135.70 |=================================================================== OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU ms < Lower Is Better a . 58.97 |==================================================================== b . 59.27 |==================================================================== c . 58.85 |==================================================================== OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a . 2577.45 |================================================================== b . 2578.49 |================================================================== c . 2583.01 |================================================================== OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU ms < Lower Is Better a . 6.18 |===================================================================== b . 6.17 |===================================================================== c . 6.16 |===================================================================== OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU FPS > Higher Is Better a . 1494.15 |================================================================= b . 1492.34 |================================================================= c . 1514.65 |================================================================== OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU ms < Lower Is Better a . 5.33 |===================================================================== b . 5.34 |===================================================================== c . 5.26 |==================================================================== OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU FPS > Higher Is Better a . 1591.11 |================================================================== b . 1592.23 |================================================================== c . 1591.45 |================================================================== OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU ms < Lower Is Better a . 9.87 |===================================================================== b . 9.87 |===================================================================== c . 9.87 |===================================================================== OpenVINO 2024.0 Model: Handwritten English Recognition FP16 - Device: CPU FPS > Higher Is Better a . 711.30 |=================================================================== b . 710.16 |=================================================================== c . 711.57 |=================================================================== OpenVINO 2024.0 Model: Handwritten English Recognition FP16 - Device: CPU ms < Lower Is Better a . 22.46 |==================================================================== b . 22.49 |==================================================================== c . 22.45 |==================================================================== OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU FPS > Higher Is Better a . 1883.10 |================================================================== b . 1887.22 |================================================================== c . 1891.57 |================================================================== OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU ms < Lower Is Better a . 4.23 |===================================================================== b . 4.22 |===================================================================== c . 4.21 |===================================================================== OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU FPS > Higher Is Better a . 34012.20 |================================================================= b . 34014.57 |================================================================= c . 34096.41 |================================================================= OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU ms < Lower Is Better a . 0.42 |===================================================================== b . 0.42 |===================================================================== c . 0.42 |===================================================================== OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU FPS > Higher Is Better a . 765.51 |=================================================================== b . 763.84 |=================================================================== c . 765.23 |=================================================================== OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU ms < Lower Is Better a . 20.85 |==================================================================== b . 20.90 |==================================================================== c . 20.86 |==================================================================== OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU FPS > Higher Is Better a . 48218.14 |================================================================= b . 48211.96 |================================================================= c . 48255.24 |================================================================= OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU ms < Lower Is Better a . 0.29 |===================================================================== b . 0.29 |===================================================================== c . 0.29 |=====================================================================