openvino-all-1-5-5600RAM
2 x INTEL XEON PLATINUM 8568Y+ testing with a Supermicro X13DAI-T v1.01 (2.4 BIOS) and NVIDIA A100-SXM4-40GB on Ubuntu 24.04 via the Phoronix Test Suite.


2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA: 

	Processor: 2 x INTEL XEON PLATINUM 8568Y+ @ 4.00GHz (96 Cores / 192 Threads), Motherboard: Supermicro X13DAI-T v1.01 (2.4 BIOS), Chipset: Intel Device 1bce, Memory: 1008GB, Disk: 2 x 15363GB SAMSUNG MZQL215THBLA-00A07 + 30725GB 9620-16i, Graphics: NVIDIA A100-SXM4-40GB, Audio: Realtek ALC888-VD, Monitor: VGA HDMI, Network: 2 x Broadcom BCM57416 NetXtreme-E Dual-Media 10G RDMA

	OS: Ubuntu 24.04, Kernel: 6.8.0-49-generic (x86_64), Desktop: GNOME Shell 46.0, Display Server: X Server 1.21.1.11, Display Driver: NVIDIA 565.57.01, OpenGL: 4.6.0, OpenCL: OpenCL 3.0 CUDA 12.7.33, Compiler: GCC 13.2.0 + CUDA 12.0, File-System: ext4, Screen Resolution: 1920x1080


OpenVINO 2024.0
Model: Face Detection FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 217.65 |=============================


OpenVINO 2024.0
Model: Face Detection FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 110.15 |=============================


OpenVINO 2024.0
Model: Person Detection FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 640.18 |=============================


OpenVINO 2024.0
Model: Person Detection FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 37.44 |==============================


OpenVINO 2024.0
Model: Person Detection FP32 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 639.27 |=============================


OpenVINO 2024.0
Model: Person Detection FP32 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 37.50 |==============================


OpenVINO 2024.0
Model: Vehicle Detection FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 4718.51 |============================


OpenVINO 2024.0
Model: Vehicle Detection FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 5.08 |===============================


OpenVINO 2024.0
Model: Face Detection FP16-INT8 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 485.08 |=============================


OpenVINO 2024.0
Model: Face Detection FP16-INT8 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 197.61 |=============================


OpenVINO 2024.0
Model: Face Detection Retail FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 15822.91 |===========================


OpenVINO 2024.0
Model: Face Detection Retail FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 6.06 |===============================


OpenVINO 2024.0
Model: Road Segmentation ADAS FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 1533.13 |============================


OpenVINO 2024.0
Model: Road Segmentation ADAS FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 15.62 |==============================


OpenVINO 2024.0
Model: Vehicle Detection FP16-INT8 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 7453.60 |============================


OpenVINO 2024.0
Model: Vehicle Detection FP16-INT8 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 12.86 |==============================


OpenVINO 2024.0
Model: Weld Porosity Detection FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 27449.74 |===========================


OpenVINO 2024.0
Model: Weld Porosity Detection FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 3.48 |===============================


OpenVINO 2024.0
Model: Face Detection Retail FP16-INT8 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 21237.30 |===========================


OpenVINO 2024.0
Model: Face Detection Retail FP16-INT8 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 4.51 |===============================


OpenVINO 2024.0
Model: Road Segmentation ADAS FP16-INT8 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 1911.37 |============================


OpenVINO 2024.0
Model: Road Segmentation ADAS FP16-INT8 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 50.12 |==============================


OpenVINO 2024.0
Model: Machine Translation EN To DE FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 979.61 |=============================


OpenVINO 2024.0
Model: Machine Translation EN To DE FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 24.40 |==============================


OpenVINO 2024.0
Model: Weld Porosity Detection FP16-INT8 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 41978.13 |===========================


OpenVINO 2024.0
Model: Weld Porosity Detection FP16-INT8 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 2.19 |===============================


OpenVINO 2024.0
Model: Person Vehicle Bike Detection FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 9369.40 |============================


OpenVINO 2024.0
Model: Person Vehicle Bike Detection FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 10.23 |==============================


OpenVINO 2024.0
Model: Noise Suppression Poconet-Like FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 7708.27 |============================


OpenVINO 2024.0
Model: Noise Suppression Poconet-Like FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 12.33 |==============================


OpenVINO 2024.0
Model: Handwritten English Recognition FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 4811.57 |============================


OpenVINO 2024.0
Model: Handwritten English Recognition FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 19.94 |==============================


OpenVINO 2024.0
Model: Person Re-Identification Retail FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 15649.17 |===========================


OpenVINO 2024.0
Model: Person Re-Identification Retail FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 6.12 |===============================


OpenVINO 2024.0
Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 112806.06 |==========================


OpenVINO 2024.0
Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 0.45 |===============================


OpenVINO 2024.0
Model: Handwritten English Recognition FP16-INT8 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 4866.77 |============================


OpenVINO 2024.0
Model: Handwritten English Recognition FP16-INT8 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 19.71 |==============================


OpenVINO 2024.0
Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 124878.26 |==========================


OpenVINO 2024.0
Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 0.39 |===============================