openvino-2024 Intel Core Ultra 7 155H testing with a MTL Swift SFG14-72T Coral_MTH (V1.01 BIOS) and Intel Arc MTL 8GB on Ubuntu 23.10 via the Phoronix Test Suite. a: Processor: Intel Core Ultra 7 155H @ 4.80GHz (16 Cores / 22 Threads), Motherboard: MTL Swift SFG14-72T Coral_MTH (V1.01 BIOS), Chipset: Intel Device 7e7f, Memory: 8 x 2GB DRAM-6400MT/s Micron MT62F1G32D2DS-026, Disk: 1024GB Micron_2550_MTFDKBA1T0TGE, Graphics: Intel Arc MTL 8GB (2250MHz), Audio: Intel Meteor Lake-P HD Audio, Network: Intel Device 7e40 OS: Ubuntu 23.10, Kernel: 6.8.0-060800rc1daily20240126-generic (x86_64), Desktop: GNOME Shell 45.2, Display Server: X Server 1.21.1.7 + Wayland, OpenGL: 4.6 Mesa 24.1~git2401200600.ebcab1~oibaf~m (git-ebcab14 2024-01-20 mantic-oibaf-ppa), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200 b: Processor: Intel Core Ultra 7 155H @ 4.80GHz (16 Cores / 22 Threads), Motherboard: MTL Swift SFG14-72T Coral_MTH (V1.01 BIOS), Chipset: Intel Device 7e7f, Memory: 8 x 2GB DRAM-6400MT/s Micron MT62F1G32D2DS-026, Disk: 1024GB Micron_2550_MTFDKBA1T0TGE, Graphics: Intel Arc MTL 8GB (2250MHz), Audio: Intel Meteor Lake-P HD Audio, Network: Intel Device 7e40 OS: Ubuntu 23.10, Kernel: 6.8.0-060800rc1daily20240126-generic (x86_64), Desktop: GNOME Shell 45.2, Display Server: X Server 1.21.1.7 + Wayland, OpenGL: 4.6 Mesa 24.1~git2401200600.ebcab1~oibaf~m (git-ebcab14 2024-01-20 mantic-oibaf-ppa), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200 c: Processor: Intel Core Ultra 7 155H @ 4.80GHz (16 Cores / 22 Threads), Motherboard: MTL Swift SFG14-72T Coral_MTH (V1.01 BIOS), Chipset: Intel Device 7e7f, Memory: 8 x 2GB DRAM-6400MT/s Micron MT62F1G32D2DS-026, Disk: 1024GB Micron_2550_MTFDKBA1T0TGE, Graphics: Intel Arc MTL 8GB (2250MHz), Audio: Intel Meteor Lake-P HD Audio, Network: Intel Device 7e40 OS: Ubuntu 23.10, Kernel: 6.8.0-060800rc1daily20240126-generic (x86_64), Desktop: GNOME Shell 45.2, Display Server: X Server 1.21.1.7 + Wayland, OpenGL: 4.6 Mesa 24.1~git2401200600.ebcab1~oibaf~m (git-ebcab14 2024-01-20 mantic-oibaf-ppa), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200 d: Processor: Intel Core Ultra 7 155H @ 4.80GHz (16 Cores / 22 Threads), Motherboard: MTL Swift SFG14-72T Coral_MTH (V1.01 BIOS), Chipset: Intel Device 7e7f, Memory: 8 x 2GB DRAM-6400MT/s Micron MT62F1G32D2DS-026, Disk: 1024GB Micron_2550_MTFDKBA1T0TGE, Graphics: Intel Arc MTL 8GB (2250MHz), Audio: Intel Meteor Lake-P HD Audio, Network: Intel Device 7e40 OS: Ubuntu 23.10, Kernel: 6.8.0-060800rc1daily20240126-generic (x86_64), Desktop: GNOME Shell 45.2, Display Server: X Server 1.21.1.7 + Wayland, OpenGL: 4.6 Mesa 24.1~git2401200600.ebcab1~oibaf~m (git-ebcab14 2024-01-20 mantic-oibaf-ppa), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200 e: Processor: Intel Core Ultra 7 155H @ 4.80GHz (16 Cores / 22 Threads), Motherboard: MTL Swift SFG14-72T Coral_MTH (V1.01 BIOS), Chipset: Intel Device 7e7f, Memory: 8 x 2GB DRAM-6400MT/s Micron MT62F1G32D2DS-026, Disk: 1024GB Micron_2550_MTFDKBA1T0TGE, Graphics: Intel Arc MTL 8GB (2250MHz), Audio: Intel Meteor Lake-P HD Audio, Network: Intel Device 7e40 OS: Ubuntu 23.10, Kernel: 6.8.0-060800rc1daily20240126-generic (x86_64), Desktop: GNOME Shell 45.2, Display Server: X Server 1.21.1.7 + Wayland, OpenGL: 4.6 Mesa 24.1~git2401200600.ebcab1~oibaf~m (git-ebcab14 2024-01-20 mantic-oibaf-ppa), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200 OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU ms < Lower Is Better a . 355.61 |=================================================================== b . 326.60 |============================================================== c . 325.60 |============================================================= d . 333.51 |=============================================================== e . 351.73 |================================================================== OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU FPS > Higher Is Better a . 19.67 |============================================================== b . 21.39 |==================================================================== c . 21.45 |==================================================================== d . 20.94 |================================================================== e . 19.86 |=============================================================== OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU ms < Lower Is Better a . 52.32 |================================================================== b . 48.80 |============================================================== c . 48.42 |============================================================= d . 50.08 |=============================================================== e . 53.70 |==================================================================== OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU FPS > Higher Is Better a . 323.31 |============================================================== b . 345.96 |================================================================== c . 348.69 |=================================================================== d . 337.29 |================================================================= e . 315.38 |============================================================= OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU ms < Lower Is Better a . 24.88 |==================================================================== b . 22.95 |=============================================================== c . 22.93 |=============================================================== d . 23.33 |================================================================ e . 24.75 |==================================================================== OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a . 280.81 |============================================================== b . 304.16 |=================================================================== c . 304.50 |=================================================================== d . 299.19 |================================================================== e . 282.22 |============================================================== OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU ms < Lower Is Better a . 16.55 |==================================================================== b . 15.63 |================================================================ c . 15.65 |================================================================ d . 15.82 |================================================================= e . 16.64 |==================================================================== OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU FPS > Higher Is Better a . 1002.41 |============================================================== b . 1059.77 |================================================================== c . 1058.96 |================================================================== d . 1045.93 |================================================================= e . 996.96 |============================================================== OpenVINO 2024.0 Model: Vehicle Detection FP16 - Device: CPU ms < Lower Is Better a . 47.86 |=================================================================== b . 42.72 |============================================================ c . 42.78 |============================================================ d . 43.75 |============================================================== e . 48.22 |==================================================================== OpenVINO 2024.0 Model: Vehicle Detection FP16 - Device: CPU FPS > Higher Is Better a . 146.15 |============================================================ b . 163.56 |=================================================================== c . 163.33 |=================================================================== d . 159.69 |================================================================= e . 145.05 |=========================================================== OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU ms < Lower Is Better a . 1099.33 |================================================================== b . 1021.76 |============================================================= c . 1023.44 |============================================================= d . 1030.08 |============================================================== e . 1103.12 |================================================================== OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a . 6.33 |================================================================ b . 6.82 |===================================================================== c . 6.76 |==================================================================== d . 6.74 |==================================================================== e . 6.30 |================================================================ OpenVINO 2024.0 Model: Face Detection FP16 - Device: CPU ms < Lower Is Better a . 3797.30 |================================================================ b . 3557.43 |============================================================ c . 3543.90 |============================================================ d . 3562.54 |============================================================ e . 3912.27 |================================================================== OpenVINO 2024.0 Model: Face Detection FP16 - Device: CPU FPS > Higher Is Better a . 1.82 |================================================================ b . 1.91 |==================================================================== c . 1.95 |===================================================================== d . 1.91 |==================================================================== e . 1.76 |============================================================== OpenVINO 2024.0 Model: Weld Porosity Detection FP16 - Device: CPU ms < Lower Is Better a . 97.43 |==================================================================== b . 89.36 |============================================================== c . 89.94 |=============================================================== d . 91.19 |================================================================ e . 96.16 |=================================================================== OpenVINO 2024.0 Model: Weld Porosity Detection FP16 - Device: CPU FPS > Higher Is Better a . 173.86 |============================================================== b . 189.19 |=================================================================== c . 188.18 |=================================================================== d . 185.52 |================================================================== e . 176.09 |============================================================== OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU ms < Lower Is Better a . 26.01 |==================================================================== b . 24.10 |=============================================================== c . 24.09 |=============================================================== d . 24.49 |================================================================ e . 25.59 |=================================================================== OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a . 643.51 |============================================================== b . 693.74 |=================================================================== c . 693.66 |=================================================================== d . 682.02 |================================================================== e . 653.79 |=============================================================== OpenVINO 2024.0 Model: Face Detection Retail FP16 - Device: CPU ms < Lower Is Better a . 15.36 |==================================================================== b . 13.90 |============================================================== c . 13.75 |============================================================= d . 14.13 |=============================================================== e . 15.31 |==================================================================== OpenVINO 2024.0 Model: Face Detection Retail FP16 - Device: CPU FPS > Higher Is Better a . 454.19 |============================================================ b . 501.53 |================================================================== c . 506.76 |=================================================================== d . 493.14 |================================================================= e . 455.74 |============================================================ OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU ms < Lower Is Better a . 341.26 |================================================================ b . 317.45 |=========================================================== c . 318.02 |=========================================================== d . 321.69 |============================================================ e . 359.37 |=================================================================== OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU FPS > Higher Is Better a . 20.47 |=============================================================== b . 22.01 |==================================================================== c . 21.97 |==================================================================== d . 21.68 |=================================================================== e . 19.46 |============================================================ OpenVINO 2024.0 Model: Person Detection FP32 - Device: CPU ms < Lower Is Better a . 349.78 |================================================================ b . 325.82 |============================================================ c . 326.38 |============================================================ d . 331.48 |============================================================= e . 366.10 |=================================================================== OpenVINO 2024.0 Model: Person Detection FP32 - Device: CPU FPS > Higher Is Better a . 19.97 |=============================================================== b . 21.43 |==================================================================== c . 21.41 |==================================================================== d . 21.07 |=================================================================== e . 19.10 |============================================================= OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU ms < Lower Is Better a . 156.10 |================================================================= b . 152.02 |=============================================================== c . 151.19 |=============================================================== d . 152.48 |================================================================ e . 160.66 |=================================================================== OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU FPS > Higher Is Better a . 108.71 |================================================================= b . 111.60 |=================================================================== c . 112.21 |=================================================================== d . 111.29 |================================================================== e . 105.70 |=============================================================== OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU ms < Lower Is Better a . 30.29 |==================================================================== b . 28.31 |================================================================ c . 28.32 |================================================================ d . 28.64 |================================================================ e . 30.13 |==================================================================== OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU FPS > Higher Is Better a . 230.73 |=============================================================== b . 246.61 |=================================================================== c . 246.59 |=================================================================== d . 243.84 |================================================================== e . 231.80 |=============================================================== OpenVINO 2024.0 Model: Handwritten English Recognition FP16 - Device: CPU ms < Lower Is Better a . 186.71 |================================================================= b . 178.24 |============================================================== c . 177.81 |============================================================== d . 183.28 |================================================================ e . 191.36 |=================================================================== OpenVINO 2024.0 Model: Handwritten English Recognition FP16 - Device: CPU FPS > Higher Is Better a . 90.88 |================================================================= b . 95.15 |==================================================================== c . 95.34 |==================================================================== d . 92.52 |================================================================== e . 88.60 |=============================================================== OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU ms < Lower Is Better a . 58.84 |==================================================================== b . 54.94 |=============================================================== c . 54.73 |=============================================================== d . 55.60 |================================================================ e . 58.38 |=================================================================== OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU FPS > Higher Is Better a . 118.81 |============================================================== b . 127.20 |=================================================================== c . 127.70 |=================================================================== d . 125.64 |================================================================== e . 119.74 |=============================================================== OpenVINO 2024.0 Model: Road Segmentation ADAS FP16 - Device: CPU ms < Lower Is Better a . 104.86 |=================================================================== b . 97.90 |=============================================================== c . 97.67 |============================================================== d . 99.52 |================================================================ e . 103.88 |================================================================== OpenVINO 2024.0 Model: Road Segmentation ADAS FP16 - Device: CPU FPS > Higher Is Better a . 66.70 |=============================================================== b . 71.39 |==================================================================== c . 71.56 |==================================================================== d . 70.24 |=================================================================== e . 67.33 |================================================================ OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU ms < Lower Is Better a . 27.24 |=================================================================== b . 26.28 |================================================================= c . 26.12 |================================================================ d . 27.09 |=================================================================== e . 27.61 |==================================================================== OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU FPS > Higher Is Better a . 256.36 |================================================================ b . 265.61 |=================================================================== c . 267.31 |=================================================================== d . 257.64 |================================================================= e . 252.96 |=============================================================== OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU ms < Lower Is Better a . 3.31 |=================================================================== b . 3.23 |================================================================== c . 3.22 |================================================================== d . 3.26 |================================================================== e . 3.39 |===================================================================== OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU FPS > Higher Is Better a . 4823.26 |================================================================ b . 4958.11 |================================================================== c . 4962.19 |================================================================== d . 4908.52 |================================================================= e . 4709.82 |=============================================================== OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU ms < Lower Is Better a . 1.27 |===================================================================== b . 1.22 |================================================================== c . 1.22 |================================================================== d . 1.26 |==================================================================== e . 1.27 |===================================================================== OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU FPS > Higher Is Better a . 12466.99 |=============================================================== b . 12915.87 |================================================================= c . 12894.54 |================================================================= d . 12467.60 |=============================================================== e . 12467.50 |===============================================================