openvino-all-1-5
2 x INTEL XEON PLATINUM 8568Y+ testing with a Supermicro X13DAI-T v1.01 (2.4 BIOS) and NVIDIA A100-SXM4-40GB on Ubuntu 24.04 via the Phoronix Test Suite.


2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA: 

	Processor: 2 x INTEL XEON PLATINUM 8568Y+ @ 4.00GHz (96 Cores / 192 Threads), Motherboard: Supermicro X13DAI-T v1.01 (2.4 BIOS), Chipset: Intel Device 1bce, Memory: 2016GB, Disk: 2 x 15363GB SAMSUNG MZQL215THBLA-00A07 + 30725GB 9620-16i, Graphics: NVIDIA A100-SXM4-40GB, Audio: Realtek ALC888-VD, Monitor: VGA HDMI, Network: 2 x Broadcom BCM57416 NetXtreme-E Dual-Media 10G RDMA

	OS: Ubuntu 24.04, Kernel: 6.8.0-49-generic (x86_64), Desktop: GNOME Shell 46.0, Display Server: X Server 1.21.1.11, Display Driver: NVIDIA 565.57.01, OpenGL: 4.6.0, OpenCL: OpenCL 3.0 CUDA 12.7.33, Compiler: GCC 13.2.0 + CUDA 12.0, File-System: ext4, Screen Resolution: 1920x1080


OpenVINO 2024.0
Model: Face Detection FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 215.06 |=============================


OpenVINO 2024.0
Model: Face Detection FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 111.48 |=============================


OpenVINO 2024.0
Model: Person Detection FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 618.85 |=============================


OpenVINO 2024.0
Model: Person Detection FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 38.73 |==============================


OpenVINO 2024.0
Model: Person Detection FP32 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 616.77 |=============================


OpenVINO 2024.0
Model: Person Detection FP32 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 38.86 |==============================


OpenVINO 2024.0
Model: Vehicle Detection FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 4746.55 |============================


OpenVINO 2024.0
Model: Vehicle Detection FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 5.05 |===============================


OpenVINO 2024.0
Model: Face Detection FP16-INT8 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 482.28 |=============================


OpenVINO 2024.0
Model: Face Detection FP16-INT8 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 198.76 |=============================


OpenVINO 2024.0
Model: Face Detection Retail FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 15885.16 |===========================


OpenVINO 2024.0
Model: Face Detection Retail FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 6.03 |===============================


OpenVINO 2024.0
Model: Road Segmentation ADAS FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 1530.35 |============================


OpenVINO 2024.0
Model: Road Segmentation ADAS FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 15.65 |==============================


OpenVINO 2024.0
Model: Vehicle Detection FP16-INT8 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 7450.74 |============================


OpenVINO 2024.0
Model: Vehicle Detection FP16-INT8 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 12.87 |==============================


OpenVINO 2024.0
Model: Weld Porosity Detection FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 27517.08 |===========================


OpenVINO 2024.0
Model: Weld Porosity Detection FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 3.47 |===============================


OpenVINO 2024.0
Model: Face Detection Retail FP16-INT8 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 21307.79 |===========================


OpenVINO 2024.0
Model: Face Detection Retail FP16-INT8 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 4.50 |===============================


OpenVINO 2024.0
Model: Road Segmentation ADAS FP16-INT8 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 1871.28 |============================


OpenVINO 2024.0
Model: Road Segmentation ADAS FP16-INT8 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 51.20 |==============================


OpenVINO 2024.0
Model: Machine Translation EN To DE FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 937.26 |=============================


OpenVINO 2024.0
Model: Machine Translation EN To DE FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 25.51 |==============================


OpenVINO 2024.0
Model: Weld Porosity Detection FP16-INT8 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 41958.32 |===========================


OpenVINO 2024.0
Model: Weld Porosity Detection FP16-INT8 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 2.19 |===============================


OpenVINO 2024.0
Model: Person Vehicle Bike Detection FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 9297.54 |============================


OpenVINO 2024.0
Model: Person Vehicle Bike Detection FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 10.31 |==============================


OpenVINO 2024.0
Model: Noise Suppression Poconet-Like FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 7544.76 |============================


OpenVINO 2024.0
Model: Noise Suppression Poconet-Like FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 12.58 |==============================


OpenVINO 2024.0
Model: Handwritten English Recognition FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 4775.80 |============================


OpenVINO 2024.0
Model: Handwritten English Recognition FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 20.09 |==============================


OpenVINO 2024.0
Model: Person Re-Identification Retail FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 15740.84 |===========================


OpenVINO 2024.0
Model: Person Re-Identification Retail FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 6.09 |===============================


OpenVINO 2024.0
Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 112701.14 |==========================


OpenVINO 2024.0
Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 0.45 |===============================


OpenVINO 2024.0
Model: Handwritten English Recognition FP16-INT8 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 4866.12 |============================


OpenVINO 2024.0
Model: Handwritten English Recognition FP16-INT8 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 19.71 |==============================


OpenVINO 2024.0
Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 123918.92 |==========================


OpenVINO 2024.0
Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 0.39 |===============================