openvino 2022.3 threadripper AMD Ryzen Threadripper 3990X 64-Core testing with a Gigabyte TRX40 AORUS PRO WIFI (F4p BIOS) and AMD Radeon RX 5700 8GB on Ubuntu 22.10 via the Phoronix Test Suite. a: Processor: AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores / 128 Threads), Motherboard: Gigabyte TRX40 AORUS PRO WIFI (F4p BIOS), Chipset: AMD Starship/Matisse, Memory: 128GB, Disk: Samsung SSD 970 EVO Plus 500GB, Graphics: AMD Radeon RX 5700 8GB (1750/875MHz), Audio: AMD Navi 10 HDMI Audio, Monitor: DELL P2415Q, Network: Intel I211 + Intel Wi-Fi 6 AX200 OS: Ubuntu 22.10, Kernel: 6.1.0-rc8-phx-mglru (x86_64), Desktop: GNOME Shell 43.0, Display Server: X Server 1.21.1.4 + Wayland, OpenGL: 4.6 Mesa 22.2.1 (LLVM 15.0.2 DRM 3.49), Vulkan: 1.3.224, Compiler: GCC 12.2.0 + LLVM 15.0.2, File-System: ext4, Screen Resolution: 3840x2160 b: Processor: AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores / 128 Threads), Motherboard: Gigabyte TRX40 AORUS PRO WIFI (F4p BIOS), Chipset: AMD Starship/Matisse, Memory: 128GB, Disk: Samsung SSD 970 EVO Plus 500GB, Graphics: AMD Radeon RX 5700 8GB (1750/875MHz), Audio: AMD Navi 10 HDMI Audio, Monitor: DELL P2415Q, Network: Intel I211 + Intel Wi-Fi 6 AX200 OS: Ubuntu 22.10, Kernel: 6.1.0-rc8-phx-mglru (x86_64), Desktop: GNOME Shell 43.0, Display Server: X Server 1.21.1.4 + Wayland, OpenGL: 4.6 Mesa 22.2.1 (LLVM 15.0.2 DRM 3.49), Vulkan: 1.3.224, Compiler: GCC 12.2.0 + LLVM 15.0.2, File-System: ext4, Screen Resolution: 3840x2160 c: Processor: AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores / 128 Threads), Motherboard: Gigabyte TRX40 AORUS PRO WIFI (F4p BIOS), Chipset: AMD Starship/Matisse, Memory: 128GB, Disk: Samsung SSD 970 EVO Plus 500GB, Graphics: AMD Radeon RX 5700 8GB (1750/875MHz), Audio: AMD Navi 10 HDMI Audio, Monitor: DELL P2415Q, Network: Intel I211 + Intel Wi-Fi 6 AX200 OS: Ubuntu 22.10, Kernel: 6.1.0-rc8-phx-mglru (x86_64), Desktop: GNOME Shell 43.0, Display Server: X Server 1.21.1.4 + Wayland, OpenGL: 4.6 Mesa 22.2.1 (LLVM 15.0.2 DRM 3.49), Vulkan: 1.3.224, Compiler: GCC 12.2.0 + LLVM 15.0.2, File-System: ext4, Screen Resolution: 3840x2160 d: Processor: AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores / 128 Threads), Motherboard: Gigabyte TRX40 AORUS PRO WIFI (F4p BIOS), Chipset: AMD Starship/Matisse, Memory: 128GB, Disk: Samsung SSD 970 EVO Plus 500GB, Graphics: AMD Radeon RX 5700 8GB (1750/875MHz), Audio: AMD Navi 10 HDMI Audio, Monitor: DELL P2415Q, Network: Intel I211 + Intel Wi-Fi 6 AX200 OS: Ubuntu 22.10, Kernel: 6.1.0-rc8-phx-mglru (x86_64), Desktop: GNOME Shell 43.0, Display Server: X Server 1.21.1.4 + Wayland, OpenGL: 4.6 Mesa 22.2.1 (LLVM 15.0.2 DRM 3.49), Vulkan: 1.3.224, Compiler: GCC 12.2.0 + LLVM 15.0.2, File-System: ext4, Screen Resolution: 3840x2160 OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU FPS > Higher Is Better a . 11.01 |==================================================================== b . 10.75 |================================================================== c . 10.49 |================================================================= d . 10.78 |=================================================================== OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU FPS > Higher Is Better a . 6.61 |===================================================================== b . 6.64 |===================================================================== c . 6.62 |===================================================================== d . 6.65 |===================================================================== OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU FPS > Higher Is Better a . 6.64 |===================================================================== b . 6.51 |==================================================================== c . 6.63 |===================================================================== d . 6.57 |==================================================================== OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU FPS > Higher Is Better a . 530.64 |=================================================================== b . 534.33 |=================================================================== c . 530.50 |=================================================================== d . 530.36 |=================================================================== OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a . 17.84 |==================================================================== b . 17.47 |=================================================================== c . 17.13 |================================================================= d . 17.82 |==================================================================== OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a . 1421.13 |================================================================== b . 1388.12 |================================================================ c . 1365.93 |=============================================================== d . 1415.78 |================================================================== OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU FPS > Higher Is Better a . 1145.29 |================================================================== b . 1125.98 |================================================================= c . 1111.16 |================================================================ d . 1138.29 |================================================================== OpenVINO 2022.3 Model: Machine Translation EN To DE FP16 - Device: CPU FPS > Higher Is Better a . 98.26 |==================================================================== b . 96.26 |================================================================== c . 98.45 |==================================================================== d . 97.33 |=================================================================== OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a . 1745.74 |================================================================== b . 1696.89 |================================================================ c . 1676.55 |=============================================================== d . 1735.97 |================================================================== OpenVINO 2022.3 Model: Person Vehicle Bike Detection FP16 - Device: CPU FPS > Higher Is Better a . 1549.69 |================================================================== b . 1537.31 |================================================================= c . 1537.82 |================================================================= d . 1550.99 |================================================================== OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU FPS > Higher Is Better a . 36482.67 |================================================================= b . 35908.39 |================================================================ c . 35835.38 |================================================================ d . 36377.07 |================================================================= OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU FPS > Higher Is Better a . 37993.62 |================================================================ b . 38224.59 |================================================================= c . 37989.06 |================================================================ d . 38421.84 |================================================================= OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU ms < Lower Is Better a . 2860.36 |=============================================================== b . 2929.15 |================================================================ c . 2999.47 |================================================================== d . 2913.96 |================================================================ OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU ms < Lower Is Better a . 4735.88 |================================================================== b . 4721.60 |================================================================== c . 4717.00 |================================================================== d . 4714.02 |================================================================== OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU ms < Lower Is Better a . 4707.96 |================================================================= b . 4791.99 |================================================================== c . 4718.10 |================================================================= d . 4764.70 |================================================================== OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU ms < Lower Is Better a . 60.24 |==================================================================== b . 59.81 |=================================================================== c . 60.24 |==================================================================== d . 60.26 |==================================================================== OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU ms < Lower Is Better a . 1785.64 |=============================================================== b . 1826.42 |================================================================= c . 1860.49 |================================================================== d . 1790.43 |================================================================ OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU ms < Lower Is Better a . 22.50 |================================================================= b . 23.04 |=================================================================== c . 23.41 |==================================================================== d . 22.59 |================================================================== OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU ms < Lower Is Better a . 27.91 |================================================================== b . 28.40 |=================================================================== c . 28.77 |==================================================================== d . 28.08 |================================================================== OpenVINO 2022.3 Model: Machine Translation EN To DE FP16 - Device: CPU ms < Lower Is Better a . 325.14 |================================================================== b . 331.91 |=================================================================== c . 324.30 |================================================================= d . 327.99 |================================================================== OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU ms < Lower Is Better a . 36.64 |================================================================= b . 37.69 |=================================================================== c . 38.15 |==================================================================== d . 36.85 |================================================================== OpenVINO 2022.3 Model: Person Vehicle Bike Detection FP16 - Device: CPU ms < Lower Is Better a . 20.63 |=================================================================== b . 20.79 |==================================================================== c . 20.79 |==================================================================== d . 20.61 |=================================================================== OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU ms < Lower Is Better a . 1.74 |==================================================================== b . 1.77 |===================================================================== c . 1.77 |===================================================================== d . 1.74 |==================================================================== OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU ms < Lower Is Better a . 1.63 |=================================================================== b . 1.66 |===================================================================== c . 1.67 |===================================================================== d . 1.65 |====================================================================