2 x INTEL XEON PLATINUM 8592+ testing with a Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS) and ASPEED on Ubuntu 24.04 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2403076-NE-OPENVINOE21
openvino emerald rapids
2 x INTEL XEON PLATINUM 8592+ testing with a Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS) and ASPEED on Ubuntu 24.04 via the Phoronix Test Suite.
a:
Processor: 2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 1008GB, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS + 257GB Flash Drive, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T
OS: Ubuntu 24.04, Kernel: 6.8.0-11-generic (x86_64), Desktop: GNOME Shell 45.3, Display Server: X Server 1.21.1.11, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
b:
Processor: 2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 1008GB, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS + 257GB Flash Drive, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T
OS: Ubuntu 24.04, Kernel: 6.8.0-11-generic (x86_64), Desktop: GNOME Shell 45.3, Display Server: X Server 1.21.1.11, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
c:
Processor: 2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 1008GB, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS + 257GB Flash Drive, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T
OS: Ubuntu 24.04, Kernel: 6.8.0-11-generic (x86_64), Desktop: GNOME Shell 45.3, Display Server: X Server 1.21.1.11, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200
OpenVINO 2024.0
Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU
FPS > Higher Is Better
a . 93808.72 |=================================================================
b . 84580.23 |===========================================================
c . 88649.99 |=============================================================
OpenVINO 2024.0
Model: Vehicle Detection FP16 - Device: CPU
FPS > Higher Is Better
a . 5395.52 |==================================================================
b . 5059.89 |==============================================================
c . 5122.52 |===============================================================
OpenVINO 2024.0
Model: Vehicle Detection FP16 - Device: CPU
ms < Lower Is Better
a . 5.92 |=================================================================
b . 6.31 |=====================================================================
c . 6.24 |====================================================================
OpenVINO 2024.0
Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU
FPS > Higher Is Better
a . 83080.90 |==============================================================
b . 87346.93 |=================================================================
c . 86048.44 |================================================================
OpenVINO 2024.0
Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU
ms < Lower Is Better
a . 0.82 |==================================================================
b . 0.86 |=====================================================================
c . 0.83 |===================================================================
OpenVINO 2024.0
Model: Machine Translation EN To DE FP16 - Device: CPU
FPS > Higher Is Better
a . 1160.65 |==================================================================
b . 1107.25 |===============================================================
c . 1149.17 |=================================================================
OpenVINO 2024.0
Model: Machine Translation EN To DE FP16 - Device: CPU
ms < Lower Is Better
a . 27.46 |=================================================================
b . 28.74 |====================================================================
c . 27.69 |==================================================================
OpenVINO 2024.0
Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU
ms < Lower Is Better
a . 0.73 |=====================================================================
b . 0.70 |==================================================================
c . 0.70 |==================================================================
OpenVINO 2024.0
Model: Weld Porosity Detection FP16-INT8 - Device: CPU
ms < Lower Is Better
a . 2.48 |===================================================================
b . 2.55 |=====================================================================
c . 2.46 |===================================================================
OpenVINO 2024.0
Model: Weld Porosity Detection FP16-INT8 - Device: CPU
FPS > Higher Is Better
a . 50775.08 |================================================================
b . 49677.14 |===============================================================
c . 51367.64 |=================================================================
OpenVINO 2024.0
Model: Face Detection FP16 - Device: CPU
FPS > Higher Is Better
a . 105.38 |=================================================================
b . 104.49 |=================================================================
c . 108.01 |===================================================================
OpenVINO 2024.0
Model: Face Detection FP16 - Device: CPU
ms < Lower Is Better
a . 302.95 |==================================================================
b . 305.42 |===================================================================
c . 295.47 |=================================================================
OpenVINO 2024.0
Model: Face Detection Retail FP16 - Device: CPU
FPS > Higher Is Better
a . 18649.87 |=================================================================
b . 18654.59 |=================================================================
c . 18196.20 |===============================================================
OpenVINO 2024.0
Model: Face Detection Retail FP16 - Device: CPU
ms < Lower Is Better
a . 6.86 |===================================================================
b . 6.85 |===================================================================
c . 7.02 |=====================================================================
OpenVINO 2024.0
Model: Face Detection FP16-INT8 - Device: CPU
FPS > Higher Is Better
a . 551.64 |===================================================================
b . 539.65 |==================================================================
c . 548.67 |===================================================================
OpenVINO 2024.0
Model: Face Detection FP16-INT8 - Device: CPU
ms < Lower Is Better
a . 231.66 |==================================================================
b . 236.68 |===================================================================
c . 232.84 |==================================================================
OpenVINO 2024.0
Model: Vehicle Detection FP16-INT8 - Device: CPU
ms < Lower Is Better
a . 14.87 |===================================================================
b . 15.19 |====================================================================
c . 15.06 |===================================================================
OpenVINO 2024.0
Model: Vehicle Detection FP16-INT8 - Device: CPU
FPS > Higher Is Better
a . 8599.53 |==================================================================
b . 8419.14 |=================================================================
c . 8493.38 |=================================================================
OpenVINO 2024.0
Model: Road Segmentation ADAS FP16 - Device: CPU
FPS > Higher Is Better
a . 1157.35 |==================================================================
b . 1141.41 |=================================================================
c . 1135.04 |=================================================================
OpenVINO 2024.0
Model: Road Segmentation ADAS FP16 - Device: CPU
ms < Lower Is Better
a . 27.62 |===================================================================
b . 28.00 |====================================================================
c . 28.16 |====================================================================
OpenVINO 2024.0
Model: Person Re-Identification Retail FP16 - Device: CPU
FPS > Higher Is Better
a . 18172.69 |================================================================
b . 18467.48 |=================================================================
c . 18437.66 |=================================================================
OpenVINO 2024.0
Model: Person Re-Identification Retail FP16 - Device: CPU
ms < Lower Is Better
a . 7.03 |=====================================================================
b . 6.92 |====================================================================
c . 6.93 |====================================================================
OpenVINO 2024.0
Model: Person Detection FP16 - Device: CPU
ms < Lower Is Better
a . 78.32 |====================================================================
b . 78.41 |====================================================================
c . 77.30 |===================================================================
OpenVINO 2024.0
Model: Person Detection FP16 - Device: CPU
FPS > Higher Is Better
a . 408.09 |==================================================================
b . 407.63 |==================================================================
c . 413.42 |===================================================================
OpenVINO 2024.0
Model: Person Detection FP32 - Device: CPU
ms < Lower Is Better
a . 78.47 |====================================================================
b . 78.07 |====================================================================
c . 77.49 |===================================================================
OpenVINO 2024.0
Model: Person Detection FP32 - Device: CPU
FPS > Higher Is Better
a . 407.33 |==================================================================
b . 409.43 |===================================================================
c . 412.39 |===================================================================
OpenVINO 2024.0
Model: Handwritten English Recognition FP16-INT8 - Device: CPU
ms < Lower Is Better
a . 23.32 |===================================================================
b . 23.59 |====================================================================
c . 23.35 |===================================================================
OpenVINO 2024.0
Model: Road Segmentation ADAS FP16-INT8 - Device: CPU
ms < Lower Is Better
a . 57.99 |===================================================================
b . 58.38 |====================================================================
c . 58.65 |====================================================================
OpenVINO 2024.0
Model: Handwritten English Recognition FP16-INT8 - Device: CPU
FPS > Higher Is Better
a . 5485.16 |==================================================================
b . 5423.85 |=================================================================
c . 5479.42 |==================================================================
OpenVINO 2024.0
Model: Road Segmentation ADAS FP16-INT8 - Device: CPU
FPS > Higher Is Better
a . 2203.96 |==================================================================
b . 2189.14 |==================================================================
c . 2179.38 |=================================================================
OpenVINO 2024.0
Model: Handwritten English Recognition FP16 - Device: CPU
FPS > Higher Is Better
a . 5180.56 |=================================================================
b . 5232.27 |==================================================================
c . 5211.85 |==================================================================
OpenVINO 2024.0
Model: Handwritten English Recognition FP16 - Device: CPU
ms < Lower Is Better
a . 24.69 |====================================================================
b . 24.45 |===================================================================
c . 24.54 |====================================================================
OpenVINO 2024.0
Model: Weld Porosity Detection FP16 - Device: CPU
FPS > Higher Is Better
a . 32527.70 |=================================================================
b . 32438.54 |================================================================
c . 32738.60 |=================================================================
OpenVINO 2024.0
Model: Person Vehicle Bike Detection FP16 - Device: CPU
FPS > Higher Is Better
a . 10650.91 |=================================================================
b . 10634.19 |================================================================
c . 10726.06 |=================================================================
OpenVINO 2024.0
Model: Person Vehicle Bike Detection FP16 - Device: CPU
ms < Lower Is Better
a . 12.01 |====================================================================
b . 12.02 |====================================================================
c . 11.92 |===================================================================
OpenVINO 2024.0
Model: Weld Porosity Detection FP16 - Device: CPU
ms < Lower Is Better
a . 3.92 |=====================================================================
b . 3.92 |=====================================================================
c . 3.89 |====================================================================
OpenVINO 2024.0
Model: Face Detection Retail FP16-INT8 - Device: CPU
ms < Lower Is Better
a . 5.24 |=====================================================================
b . 5.23 |=====================================================================
c . 5.20 |====================================================================
OpenVINO 2024.0
Model: Face Detection Retail FP16-INT8 - Device: CPU
FPS > Higher Is Better
a . 24398.42 |=================================================================
b . 24431.97 |=================================================================
c . 24581.79 |=================================================================
OpenVINO 2024.0
Model: Noise Suppression Poconet-Like FP16 - Device: CPU
ms < Lower Is Better
a . 13.48 |====================================================================
b . 13.46 |====================================================================
c . 13.40 |====================================================================
OpenVINO 2024.0
Model: Noise Suppression Poconet-Like FP16 - Device: CPU
FPS > Higher Is Better
a . 9176.37 |==================================================================
b . 9181.33 |==================================================================
c . 9186.36 |==================================================================