openvino 2024 Intel Core i9-14900K testing with a ASUS PRIME Z790-P WIFI (1402 BIOS) and ASUS Intel RPL-S 31GB on Ubuntu 23.10 via the Phoronix Test Suite. a: Processor: Intel Core i9-14900K @ 5.70GHz (24 Cores / 32 Threads), Motherboard: ASUS PRIME Z790-P WIFI (1402 BIOS), Chipset: Intel Device 7a27, Memory: 2 x 16GB DRAM-6000MT/s Corsair CMK32GX5M2B6000C36, Disk: Western Digital WD_BLACK SN850X 1000GB, Graphics: ASUS Intel RPL-S 31GB (1650MHz), Audio: Realtek ALC897, Monitor: ASUS VP28U OS: Ubuntu 23.10, Kernel: 6.7.0-060700rc7daily20231224-generic (x86_64), Desktop: GNOME Shell 45.1, Display Server: X Server 1.21.1.7, OpenGL: 4.6 Mesa 24.0~git2312240600.c05261~oibaf~m (git-c05261a 2023-12-24 mantic-oibaf-ppa), OpenCL: OpenCL 3.0, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1080 b: Processor: Intel Core i9-14900K @ 5.70GHz (24 Cores / 32 Threads), Motherboard: ASUS PRIME Z790-P WIFI (1402 BIOS), Chipset: Intel Device 7a27, Memory: 2 x 16GB DRAM-6000MT/s Corsair CMK32GX5M2B6000C36, Disk: Western Digital WD_BLACK SN850X 1000GB, Graphics: ASUS Intel RPL-S 31GB (1650MHz), Audio: Realtek ALC897, Monitor: ASUS VP28U OS: Ubuntu 23.10, Kernel: 6.7.0-060700rc7daily20231224-generic (x86_64), Desktop: GNOME Shell 45.1, Display Server: X Server 1.21.1.7, OpenGL: 4.6 Mesa 24.0~git2312240600.c05261~oibaf~m (git-c05261a 2023-12-24 mantic-oibaf-ppa), OpenCL: OpenCL 3.0, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1080 c: Processor: Intel Core i9-14900K @ 5.70GHz (24 Cores / 32 Threads), Motherboard: ASUS PRIME Z790-P WIFI (1402 BIOS), Chipset: Intel Device 7a27, Memory: 2 x 16GB DRAM-6000MT/s Corsair CMK32GX5M2B6000C36, Disk: Western Digital WD_BLACK SN850X 1000GB, Graphics: ASUS Intel RPL-S 31GB (1650MHz), Audio: Realtek ALC897, Monitor: ASUS VP28U OS: Ubuntu 23.10, Kernel: 6.7.0-060700rc7daily20231224-generic (x86_64), Desktop: GNOME Shell 45.1, Display Server: X Server 1.21.1.7, OpenGL: 4.6 Mesa 24.0~git2312240600.c05261~oibaf~m (git-c05261a 2023-12-24 mantic-oibaf-ppa), OpenCL: OpenCL 3.0, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1080 d: Processor: Intel Core i9-14900K @ 5.70GHz (24 Cores / 32 Threads), Motherboard: ASUS PRIME Z790-P WIFI (1402 BIOS), Chipset: Intel Device 7a27, Memory: 2 x 16GB DRAM-6000MT/s Corsair CMK32GX5M2B6000C36, Disk: Western Digital WD_BLACK SN850X 1000GB, Graphics: ASUS Intel RPL-S 31GB (1650MHz), Audio: Realtek ALC897, Monitor: ASUS VP28U OS: Ubuntu 23.10, Kernel: 6.7.0-060700rc7daily20231224-generic (x86_64), Desktop: GNOME Shell 45.1, Display Server: X Server 1.21.1.7, OpenGL: 4.6 Mesa 24.0~git2312240600.c05261~oibaf~m (git-c05261a 2023-12-24 mantic-oibaf-ppa), OpenCL: OpenCL 3.0, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1080 OpenVINO 2024.0 Model: Face Detection FP16 - Device: CPU ms < Lower Is Better a . 1431.13 |================================================================== b . 1431.83 |================================================================== c . 1418.37 |================================================================= d . 1409.95 |================================================================= OpenVINO 2024.0 Model: Face Detection FP16 - Device: CPU FPS > Higher Is Better a . 5.54 |==================================================================== b . 5.55 |==================================================================== c . 5.61 |===================================================================== d . 5.64 |===================================================================== OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU ms < Lower Is Better a . 430.29 |=================================================================== b . 429.54 |=================================================================== c . 430.40 |=================================================================== d . 428.97 |=================================================================== OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a . 18.55 |==================================================================== b . 18.57 |==================================================================== c . 18.53 |==================================================================== d . 18.63 |==================================================================== OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU ms < Lower Is Better a . 143.89 |================================================================== b . 145.06 |=================================================================== c . 144.04 |================================================================== d . 145.13 |=================================================================== OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU FPS > Higher Is Better a . 55.47 |==================================================================== b . 55.03 |=================================================================== c . 55.42 |==================================================================== d . 54.98 |=================================================================== OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU ms < Lower Is Better a . 123.88 |=================================================================== b . 123.02 |=================================================================== c . 123.66 |=================================================================== d . 123.44 |=================================================================== OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU FPS > Higher Is Better a . 64.52 |==================================================================== b . 64.95 |==================================================================== c . 64.61 |==================================================================== d . 64.71 |==================================================================== OpenVINO 2024.0 Model: Person Detection FP32 - Device: CPU ms < Lower Is Better a . 145.33 |================================================================== b . 145.47 |================================================================== c . 144.52 |================================================================== d . 147.20 |=================================================================== OpenVINO 2024.0 Model: Person Detection FP32 - Device: CPU FPS > Higher Is Better a . 54.93 |==================================================================== b . 54.85 |==================================================================== c . 55.22 |==================================================================== d . 54.23 |=================================================================== OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU ms < Lower Is Better a . 22.92 |==================================================================== b . 22.92 |==================================================================== c . 22.89 |==================================================================== d . 22.75 |=================================================================== OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU FPS > Higher Is Better a . 1036.42 |================================================================== b . 1036.04 |================================================================== c . 1037.16 |================================================================== d . 1043.40 |================================================================== OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU ms < Lower Is Better a . 21.62 |==================================================================== b . 21.52 |==================================================================== c . 21.63 |==================================================================== d . 21.45 |=================================================================== OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU FPS > Higher Is Better a . 368.47 |================================================================== b . 370.47 |=================================================================== c . 368.58 |================================================================== d . 371.52 |=================================================================== OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU ms < Lower Is Better a . 11.69 |=================================================================== b . 11.69 |=================================================================== c . 11.76 |==================================================================== d . 11.81 |==================================================================== OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU FPS > Higher Is Better a . 679.70 |=================================================================== b . 679.92 |=================================================================== c . 675.90 |=================================================================== d . 672.65 |================================================================== OpenVINO 2024.0 Model: Handwritten English Recognition FP16 - Device: CPU ms < Lower Is Better a . 79.80 |==================================================================== b . 79.41 |==================================================================== c . 79.41 |==================================================================== d . 79.55 |==================================================================== OpenVINO 2024.0 Model: Handwritten English Recognition FP16 - Device: CPU FPS > Higher Is Better a . 300.18 |=================================================================== b . 301.70 |=================================================================== c . 301.62 |=================================================================== d . 301.11 |=================================================================== OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU ms < Lower Is Better a . 68.05 |==================================================================== b . 67.70 |==================================================================== c . 67.66 |==================================================================== d . 67.41 |=================================================================== OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU FPS > Higher Is Better a . 352.11 |================================================================== b . 353.91 |=================================================================== c . 354.07 |=================================================================== d . 355.52 |=================================================================== OpenVINO 2024.0 Model: Road Segmentation ADAS FP16 - Device: CPU ms < Lower Is Better a . 63.91 |==================================================================== b . 64.07 |==================================================================== c . 63.69 |==================================================================== d . 64.04 |==================================================================== OpenVINO 2024.0 Model: Road Segmentation ADAS FP16 - Device: CPU FPS > Higher Is Better a . 124.96 |=================================================================== b . 124.66 |=================================================================== c . 125.42 |=================================================================== d . 124.75 |=================================================================== OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU ms < Lower Is Better a . 9.52 |===================================================================== b . 9.48 |===================================================================== c . 9.50 |===================================================================== d . 9.50 |===================================================================== OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU FPS > Higher Is Better a . 828.44 |=================================================================== b . 828.91 |=================================================================== c . 829.29 |=================================================================== d . 831.00 |=================================================================== OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU ms < Lower Is Better a . 8.33 |===================================================================== b . 8.32 |===================================================================== c . 8.32 |===================================================================== d . 8.32 |===================================================================== OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU FPS > Higher Is Better a . 2769.95 |================================================================== b . 2771.59 |================================================================== c . 2770.84 |================================================================== d . 2772.32 |================================================================== OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU ms < Lower Is Better a . 8.95 |===================================================================== b . 8.94 |===================================================================== c . 8.93 |===================================================================== d . 8.88 |==================================================================== OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a . 878.05 |=================================================================== b . 880.34 |=================================================================== c . 880.30 |=================================================================== d . 884.45 |=================================================================== OpenVINO 2024.0 Model: Weld Porosity Detection FP16 - Device: CPU ms < Lower Is Better a . 43.55 |==================================================================== b . 43.34 |==================================================================== c . 43.38 |==================================================================== d . 43.32 |==================================================================== OpenVINO 2024.0 Model: Weld Porosity Detection FP16 - Device: CPU FPS > Higher Is Better a . 545.84 |=================================================================== b . 548.74 |=================================================================== c . 548.03 |=================================================================== d . 548.44 |=================================================================== OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU ms < Lower Is Better a . 0.57 |===================================================================== b . 0.57 |===================================================================== c . 0.57 |===================================================================== d . 0.57 |===================================================================== OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU FPS > Higher Is Better a . 37990.69 |================================================================= b . 38013.05 |================================================================= c . 37977.98 |================================================================= d . 38193.92 |================================================================= OpenVINO 2024.0 Model: Vehicle Detection FP16 - Device: CPU ms < Lower Is Better a . 22.19 |==================================================================== b . 22.14 |==================================================================== c . 22.10 |==================================================================== d . 22.22 |==================================================================== OpenVINO 2024.0 Model: Vehicle Detection FP16 - Device: CPU FPS > Higher Is Better a . 359.12 |=================================================================== b . 359.96 |=================================================================== c . 360.67 |=================================================================== d . 358.64 |=================================================================== OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU ms < Lower Is Better a . 13.02 |==================================================================== b . 13.00 |==================================================================== c . 13.03 |==================================================================== d . 13.02 |==================================================================== OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a . 1794.43 |================================================================== b . 1807.91 |================================================================== c . 1791.96 |================================================================= d . 1791.03 |================================================================= OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU ms < Lower Is Better a . 1.51 |===================================================================== b . 1.52 |===================================================================== c . 1.51 |===================================================================== d . 1.51 |===================================================================== OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU FPS > Higher Is Better a . 14614.48 |================================================================= b . 14529.64 |================================================================= c . 14538.01 |================================================================= d . 14593.46 |================================================================= OpenVINO 2024.0 Model: Face Detection Retail FP16 - Device: CPU ms < Lower Is Better a . 5.08 |===================================================================== b . 5.06 |===================================================================== c . 5.09 |===================================================================== d . 5.06 |===================================================================== OpenVINO 2024.0 Model: Face Detection Retail FP16 - Device: CPU FPS > Higher Is Better a . 1562.69 |================================================================== b . 1569.94 |================================================================== c . 1560.24 |================================================================== d . 1569.18 |==================================================================