openvino16all
2 x INTEL XEON PLATINUM 8568Y+ testing with a Supermicro X13DAI-T v1.01 (2.4 BIOS) and NVIDIA A100-SXM4-40GB on Ubuntu 24.04 via the Phoronix Test Suite.


2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA: 

	Processor: 2 x INTEL XEON PLATINUM 8568Y+ @ 4.00GHz (96 Cores / 192 Threads), Motherboard: Supermicro X13DAI-T v1.01 (2.4 BIOS), Chipset: Intel Device 1bce, Memory: 2016GB, Disk: 2 x 15363GB SAMSUNG MZQL215THBLA-00A07 + 30725GB 9620-16i, Graphics: NVIDIA A100-SXM4-40GB, Audio: Realtek ALC888-VD, Monitor: HP 527sh, Network: 2 x Broadcom BCM57416 NetXtreme-E Dual-Media 10G RDMA

	OS: Ubuntu 24.04, Kernel: 6.8.0-49-generic (x86_64), Desktop: GNOME Shell 46.0, Display Server: X Server 1.21.1.11, Display Driver: NVIDIA 550.127.08, OpenGL: 4.6.0, Compiler: GCC 13.2.0 + CUDA 12.6, File-System: ext4, Screen Resolution: 1920x1080


OpenVINO 2024.5
Model: Face Detection FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 213.64 |=============================


OpenVINO 2024.5
Model: Person Detection FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 614.46 |=============================


OpenVINO 2024.5
Model: Person Detection FP32 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 618.29 |=============================


OpenVINO 2024.5
Model: Vehicle Detection FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 4752.80 |============================


OpenVINO 2024.5
Model: Face Detection FP16-INT8 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 484.30 |=============================


OpenVINO 2024.5
Model: Face Detection Retail FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 15872.82 |===========================


OpenVINO 2024.5
Model: Road Segmentation ADAS FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 1690.04 |============================


OpenVINO 2024.5
Model: Vehicle Detection FP16-INT8 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 7881.61 |============================


OpenVINO 2024.5
Model: Weld Porosity Detection FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 27196.66 |===========================


OpenVINO 2024.5
Model: Face Detection Retail FP16-INT8 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 22368.06 |===========================


OpenVINO 2024.5
Model: Road Segmentation ADAS FP16-INT8 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 1918.18 |============================


OpenVINO 2024.5
Model: Machine Translation EN To DE FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 1130.95 |============================


OpenVINO 2024.5
Model: Weld Porosity Detection FP16-INT8 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 41774.02 |===========================


OpenVINO 2024.5
Model: Person Vehicle Bike Detection FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 9693.90 |============================


OpenVINO 2024.5
Model: Noise Suppression Poconet-Like FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 6846.31 |============================


OpenVINO 2024.5
Model: Handwritten English Recognition FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 4630.33 |============================


OpenVINO 2024.5
Model: Person Re-Identification Retail FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 15773.94 |===========================


OpenVINO 2024.5
Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 109518.05 |==========================


OpenVINO 2024.5
Model: Handwritten English Recognition FP16-INT8 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 4787.63 |============================


OpenVINO 2024.5
Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU
FPS > Higher Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 119366.46 |==========================


OpenVINO 2024.5
Model: Face Detection FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 112.23 |=============================


OpenVINO 2024.5
Model: Person Detection FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 39.01 |==============================


OpenVINO 2024.5
Model: Person Detection FP32 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 38.77 |==============================


OpenVINO 2024.5
Model: Vehicle Detection FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 5.04 |===============================


OpenVINO 2024.5
Model: Face Detection FP16-INT8 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 197.93 |=============================


OpenVINO 2024.5
Model: Face Detection Retail FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 6.04 |===============================


OpenVINO 2024.5
Model: Road Segmentation ADAS FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 14.18 |==============================


OpenVINO 2024.5
Model: Vehicle Detection FP16-INT8 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 12.17 |==============================


OpenVINO 2024.5
Model: Weld Porosity Detection FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 3.51 |===============================


OpenVINO 2024.5
Model: Face Detection Retail FP16-INT8 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 4.28 |===============================


OpenVINO 2024.5
Model: Road Segmentation ADAS FP16-INT8 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 49.97 |==============================


OpenVINO 2024.5
Model: Machine Translation EN To DE FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 21.17 |==============================


OpenVINO 2024.5
Model: Weld Porosity Detection FP16-INT8 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 2.20 |===============================


OpenVINO 2024.5
Model: Person Vehicle Bike Detection FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 9.89 |===============================


OpenVINO 2024.5
Model: Noise Suppression Poconet-Like FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 13.88 |==============================


OpenVINO 2024.5
Model: Handwritten English Recognition FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 20.72 |==============================


OpenVINO 2024.5
Model: Person Re-Identification Retail FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 6.07 |===============================


OpenVINO 2024.5
Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 0.46 |===============================


OpenVINO 2024.5
Model: Handwritten English Recognition FP16-INT8 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 20.04 |==============================


OpenVINO 2024.5
Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU
ms < Lower Is Better
2 x INTEL XEON PLATINUM 8568Y+ - NVIDIA . 0.42 |===============================