ov AMD Ryzen Threadripper 7980X 64-Cores testing with a System76 Thelio Major (FA Z5 BIOS) and AMD Radeon Pro W7900 45GB on Ubuntu 23.10 via the Phoronix Test Suite. a: Processor: AMD Ryzen Threadripper 7980X 64-Cores @ 7.79GHz (64 Cores / 128 Threads), Motherboard: System76 Thelio Major (FA Z5 BIOS), Chipset: AMD Device 14a4, Memory: 4 x 32GB DRAM-4800MT/s Micron MTC20F1045S1RC48BA2, Disk: 1000GB CT1000T700SSD5, Graphics: AMD Radeon Pro W7900 45GB (1760/1124MHz), Audio: AMD Device 14cc, Monitor: DELL P2415Q, Network: Aquantia AQC113C NBase-T/IEEE + Realtek RTL8125 2.5GbE + Intel Wi-Fi 6 AX210/AX211/AX411 OS: Ubuntu 23.10, Kernel: 6.5.0-21-generic (x86_64), Desktop: GNOME Shell 45.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 23.2.1-1ubuntu3.1 (LLVM 15.0.7 DRM 3.54), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1080 b: Processor: AMD Ryzen Threadripper 7980X 64-Cores @ 7.79GHz (64 Cores / 128 Threads), Motherboard: System76 Thelio Major (FA Z5 BIOS), Chipset: AMD Device 14a4, Memory: 4 x 32GB DRAM-4800MT/s Micron MTC20F1045S1RC48BA2, Disk: 1000GB CT1000T700SSD5, Graphics: AMD Radeon Pro W7900 45GB (1760/1124MHz), Audio: AMD Device 14cc, Monitor: DELL P2415Q, Network: Aquantia AQC113C NBase-T/IEEE + Realtek RTL8125 2.5GbE + Intel Wi-Fi 6 AX210/AX211/AX411 OS: Ubuntu 23.10, Kernel: 6.5.0-21-generic (x86_64), Desktop: GNOME Shell 45.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 23.2.1-1ubuntu3.1 (LLVM 15.0.7 DRM 3.54), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1080 c: Processor: AMD Ryzen Threadripper 7980X 64-Cores @ 7.79GHz (64 Cores / 128 Threads), Motherboard: System76 Thelio Major (FA Z5 BIOS), Chipset: AMD Device 14a4, Memory: 4 x 32GB DRAM-4800MT/s Micron MTC20F1045S1RC48BA2, Disk: 1000GB CT1000T700SSD5, Graphics: AMD Radeon Pro W7900 45GB (1760/1124MHz), Audio: AMD Device 14cc, Monitor: DELL P2415Q, Network: Aquantia AQC113C NBase-T/IEEE + Realtek RTL8125 2.5GbE + Intel Wi-Fi 6 AX210/AX211/AX411 OS: Ubuntu 23.10, Kernel: 6.5.0-21-generic (x86_64), Desktop: GNOME Shell 45.2, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 23.2.1-1ubuntu3.1 (LLVM 15.0.7 DRM 3.54), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1080 OpenVINO 2024.0 Model: Face Detection FP16 - Device: CPU FPS > Higher Is Better a . 42.27 |=================================================================== b . 42.25 |=================================================================== c . 42.71 |==================================================================== OpenVINO 2024.0 Model: Face Detection FP16 - Device: CPU ms < Lower Is Better a . 753.55 |=================================================================== b . 753.76 |=================================================================== c . 745.39 |================================================================== OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU FPS > Higher Is Better a . 196.62 |================================================================== b . 195.63 |================================================================== c . 198.58 |=================================================================== OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU ms < Lower Is Better a . 162.56 |=================================================================== b . 163.41 |=================================================================== c . 160.95 |================================================================== OpenVINO 2024.0 Model: Person Detection FP32 - Device: CPU FPS > Higher Is Better a . 195.46 |=================================================================== b . 172.89 |=========================================================== c . 196.61 |=================================================================== OpenVINO 2024.0 Model: Person Detection FP32 - Device: CPU ms < Lower Is Better a . 163.55 |=========================================================== b . 185.33 |=================================================================== c . 162.59 |=========================================================== OpenVINO 2024.0 Model: Vehicle Detection FP16 - Device: CPU FPS > Higher Is Better a . 1455.73 |========================================================= b . 1305.37 |=================================================== c . 1684.93 |================================================================== OpenVINO 2024.0 Model: Vehicle Detection FP16 - Device: CPU ms < Lower Is Better a . 21.99 |============================================================= b . 24.49 |==================================================================== c . 18.95 |===================================================== OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a . 85.08 |==================================================================== b . 84.86 |=================================================================== c . 85.63 |==================================================================== OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU ms < Lower Is Better a . 375.06 |=================================================================== b . 376.17 |=================================================================== c . 372.55 |================================================================== OpenVINO 2024.0 Model: Face Detection Retail FP16 - Device: CPU FPS > Higher Is Better a . 11065.62 |================================================================= b . 11010.41 |================================================================ c . 11129.19 |================================================================= OpenVINO 2024.0 Model: Face Detection Retail FP16 - Device: CPU ms < Lower Is Better a . 2.88 |===================================================================== b . 2.90 |===================================================================== c . 2.87 |==================================================================== OpenVINO 2024.0 Model: Road Segmentation ADAS FP16 - Device: CPU FPS > Higher Is Better a . 565.80 |============================================================== b . 540.40 |=========================================================== c . 610.82 |=================================================================== OpenVINO 2024.0 Model: Road Segmentation ADAS FP16 - Device: CPU ms < Lower Is Better a . 56.52 |================================================================= b . 59.22 |==================================================================== c . 52.32 |============================================================ OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a . 5138.22 |================================================================== b . 5126.71 |================================================================== c . 5154.36 |================================================================== OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU ms < Lower Is Better a . 6.22 |===================================================================== b . 6.23 |===================================================================== c . 6.20 |===================================================================== OpenVINO 2024.0 Model: Weld Porosity Detection FP16 - Device: CPU FPS > Higher Is Better a . 4350.92 |================================================================== b . 4338.94 |================================================================== c . 4371.21 |================================================================== OpenVINO 2024.0 Model: Weld Porosity Detection FP16 - Device: CPU ms < Lower Is Better a . 14.69 |==================================================================== b . 14.73 |==================================================================== c . 14.63 |==================================================================== OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU FPS > Higher Is Better a . 15686.29 |================================================================= b . 15648.36 |================================================================= c . 15757.59 |================================================================= OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU ms < Lower Is Better a . 4.07 |===================================================================== b . 4.08 |===================================================================== c . 4.05 |==================================================================== OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU FPS > Higher Is Better a . 1337.88 |================================================================== b . 1314.48 |================================================================= c . 1339.37 |================================================================== OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU ms < Lower Is Better a . 23.89 |=================================================================== b . 24.32 |==================================================================== c . 23.86 |=================================================================== OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU FPS > Higher Is Better a . 352.60 |================================================================= b . 331.58 |============================================================= c . 364.91 |=================================================================== OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU ms < Lower Is Better a . 90.71 |================================================================ b . 96.46 |==================================================================== c . 87.63 |============================================================== OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a . 8613.69 |================================================================== b . 8596.02 |================================================================== c . 8643.02 |================================================================== OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU ms < Lower Is Better a . 7.42 |===================================================================== b . 7.43 |===================================================================== c . 7.40 |===================================================================== OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU FPS > Higher Is Better a . 4642.38 |================================================================== b . 4667.85 |================================================================== c . 4646.38 |================================================================== OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU ms < Lower Is Better a . 6.88 |===================================================================== b . 6.84 |===================================================================== c . 6.87 |===================================================================== OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU FPS > Higher Is Better a . 3272.51 |========================================================= b . 3138.21 |======================================================= c . 3770.89 |================================================================== OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU ms < Lower Is Better a . 18.99 |================================================================= b . 19.82 |==================================================================== c . 16.45 |======================================================== OpenVINO 2024.0 Model: Handwritten English Recognition FP16 - Device: CPU FPS > Higher Is Better a . 2023.65 |================================================================== b . 2023.16 |================================================================== c . 2022.82 |================================================================== OpenVINO 2024.0 Model: Handwritten English Recognition FP16 - Device: CPU ms < Lower Is Better a . 31.60 |==================================================================== b . 31.61 |==================================================================== c . 31.62 |==================================================================== OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU FPS > Higher Is Better a . 6129.68 |================================================================== b . 6130.41 |================================================================== c . 6132.62 |================================================================== OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU ms < Lower Is Better a . 5.21 |===================================================================== b . 5.21 |===================================================================== c . 5.21 |===================================================================== OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU FPS > Higher Is Better a . 94091.47 |================================================================= b . 94317.14 |================================================================= c . 94492.54 |================================================================= OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU ms < Lower Is Better a . 0.56 |===================================================================== b . 0.56 |===================================================================== c . 0.56 |===================================================================== OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU FPS > Higher Is Better a . 2302.64 |================================================================== b . 2296.07 |================================================================== c . 2274.13 |================================================================= OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU ms < Lower Is Better a . 27.78 |=================================================================== b . 27.86 |=================================================================== c . 28.12 |==================================================================== OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU FPS > Higher Is Better a . 123999.65 |================================================================ b . 124193.43 |================================================================ c . 124357.62 |================================================================ OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU ms < Lower Is Better a . 0.41 |===================================================================== b . 0.40 |=================================================================== c . 0.40 |===================================================================