openvino emerald rapids 2 x INTEL XEON PLATINUM 8592+ testing with a Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS) and ASPEED on Ubuntu 24.04 via the Phoronix Test Suite. a: Processor: 2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 1008GB, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS + 257GB Flash Drive, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T OS: Ubuntu 24.04, Kernel: 6.8.0-11-generic (x86_64), Desktop: GNOME Shell 45.3, Display Server: X Server 1.21.1.11, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200 b: Processor: 2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 1008GB, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS + 257GB Flash Drive, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T OS: Ubuntu 24.04, Kernel: 6.8.0-11-generic (x86_64), Desktop: GNOME Shell 45.3, Display Server: X Server 1.21.1.11, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200 c: Processor: 2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 1008GB, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS + 257GB Flash Drive, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T OS: Ubuntu 24.04, Kernel: 6.8.0-11-generic (x86_64), Desktop: GNOME Shell 45.3, Display Server: X Server 1.21.1.11, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200 OpenVINO 2024.0 Model: Face Detection FP16 - Device: CPU FPS > Higher Is Better a . 105.38 |================================================================= b . 104.49 |================================================================= c . 108.01 |=================================================================== OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU FPS > Higher Is Better a . 408.09 |================================================================== b . 407.63 |================================================================== c . 413.42 |=================================================================== OpenVINO 2024.0 Model: Person Detection FP32 - Device: CPU FPS > Higher Is Better a . 407.33 |================================================================== b . 409.43 |=================================================================== c . 412.39 |=================================================================== OpenVINO 2024.0 Model: Vehicle Detection FP16 - Device: CPU FPS > Higher Is Better a . 5395.52 |================================================================== b . 5059.89 |============================================================== c . 5122.52 |=============================================================== OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a . 551.64 |=================================================================== b . 539.65 |================================================================== c . 548.67 |=================================================================== OpenVINO 2024.0 Model: Face Detection Retail FP16 - Device: CPU FPS > Higher Is Better a . 18649.87 |================================================================= b . 18654.59 |================================================================= c . 18196.20 |=============================================================== OpenVINO 2024.0 Model: Road Segmentation ADAS FP16 - Device: CPU FPS > Higher Is Better a . 1157.35 |================================================================== b . 1141.41 |================================================================= c . 1135.04 |================================================================= OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a . 8599.53 |================================================================== b . 8419.14 |================================================================= c . 8493.38 |================================================================= OpenVINO 2024.0 Model: Weld Porosity Detection FP16 - Device: CPU FPS > Higher Is Better a . 32527.70 |================================================================= b . 32438.54 |================================================================ c . 32738.60 |================================================================= OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU FPS > Higher Is Better a . 24398.42 |================================================================= b . 24431.97 |================================================================= c . 24581.79 |================================================================= OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU FPS > Higher Is Better a . 2203.96 |================================================================== b . 2189.14 |================================================================== c . 2179.38 |================================================================= OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU FPS > Higher Is Better a . 1160.65 |================================================================== b . 1107.25 |=============================================================== c . 1149.17 |================================================================= OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a . 50775.08 |================================================================ b . 49677.14 |=============================================================== c . 51367.64 |================================================================= OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU FPS > Higher Is Better a . 10650.91 |================================================================= b . 10634.19 |================================================================ c . 10726.06 |================================================================= OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU FPS > Higher Is Better a . 9176.37 |================================================================== b . 9181.33 |================================================================== c . 9186.36 |================================================================== OpenVINO 2024.0 Model: Handwritten English Recognition FP16 - Device: CPU FPS > Higher Is Better a . 5180.56 |================================================================= b . 5232.27 |================================================================== c . 5211.85 |================================================================== OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU FPS > Higher Is Better a . 18172.69 |================================================================ b . 18467.48 |================================================================= c . 18437.66 |================================================================= OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU FPS > Higher Is Better a . 93808.72 |================================================================= b . 84580.23 |=========================================================== c . 88649.99 |============================================================= OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU FPS > Higher Is Better a . 5485.16 |================================================================== b . 5423.85 |================================================================= c . 5479.42 |================================================================== OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU FPS > Higher Is Better a . 83080.90 |============================================================== b . 87346.93 |================================================================= c . 86048.44 |================================================================ OpenVINO 2024.0 Model: Face Detection FP16 - Device: CPU ms < Lower Is Better a . 302.95 |================================================================== b . 305.42 |=================================================================== c . 295.47 |================================================================= OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU ms < Lower Is Better a . 78.32 |==================================================================== b . 78.41 |==================================================================== c . 77.30 |=================================================================== OpenVINO 2024.0 Model: Person Detection FP32 - Device: CPU ms < Lower Is Better a . 78.47 |==================================================================== b . 78.07 |==================================================================== c . 77.49 |=================================================================== OpenVINO 2024.0 Model: Vehicle Detection FP16 - Device: CPU ms < Lower Is Better a . 5.92 |================================================================= b . 6.31 |===================================================================== c . 6.24 |==================================================================== OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU ms < Lower Is Better a . 231.66 |================================================================== b . 236.68 |=================================================================== c . 232.84 |================================================================== OpenVINO 2024.0 Model: Face Detection Retail FP16 - Device: CPU ms < Lower Is Better a . 6.86 |=================================================================== b . 6.85 |=================================================================== c . 7.02 |===================================================================== OpenVINO 2024.0 Model: Road Segmentation ADAS FP16 - Device: CPU ms < Lower Is Better a . 27.62 |=================================================================== b . 28.00 |==================================================================== c . 28.16 |==================================================================== OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU ms < Lower Is Better a . 14.87 |=================================================================== b . 15.19 |==================================================================== c . 15.06 |=================================================================== OpenVINO 2024.0 Model: Weld Porosity Detection FP16 - Device: CPU ms < Lower Is Better a . 3.92 |===================================================================== b . 3.92 |===================================================================== c . 3.89 |==================================================================== OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU ms < Lower Is Better a . 5.24 |===================================================================== b . 5.23 |===================================================================== c . 5.20 |==================================================================== OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU ms < Lower Is Better a . 57.99 |=================================================================== b . 58.38 |==================================================================== c . 58.65 |==================================================================== OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU ms < Lower Is Better a . 27.46 |================================================================= b . 28.74 |==================================================================== c . 27.69 |================================================================== OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU ms < Lower Is Better a . 2.48 |=================================================================== b . 2.55 |===================================================================== c . 2.46 |=================================================================== OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU ms < Lower Is Better a . 12.01 |==================================================================== b . 12.02 |==================================================================== c . 11.92 |=================================================================== OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU ms < Lower Is Better a . 13.48 |==================================================================== b . 13.46 |==================================================================== c . 13.40 |==================================================================== OpenVINO 2024.0 Model: Handwritten English Recognition FP16 - Device: CPU ms < Lower Is Better a . 24.69 |==================================================================== b . 24.45 |=================================================================== c . 24.54 |==================================================================== OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU ms < Lower Is Better a . 7.03 |===================================================================== b . 6.92 |==================================================================== c . 6.93 |==================================================================== OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU ms < Lower Is Better a . 0.82 |================================================================== b . 0.86 |===================================================================== c . 0.83 |=================================================================== OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU ms < Lower Is Better a . 23.32 |=================================================================== b . 23.59 |==================================================================== c . 23.35 |=================================================================== OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU ms < Lower Is Better a . 0.73 |===================================================================== b . 0.70 |================================================================== c . 0.70 |==================================================================