openvino-benchmark-2024-03-04 2 x Intel Xeon E5-2699 v4 testing with a Supermicro X10DRL-i v1.01 (3.4 BIOS) and ASPEED on Ubuntu 22.04 via the Phoronix Test Suite. 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro: Processor: 2 x Intel Xeon E5-2699 v4 @ 3.60GHz (44 Cores / 88 Threads), Motherboard: Supermicro X10DRL-i v1.01 (3.4 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 128GB, Disk: 1920GB INTEL SSDSC2KG01, Graphics: ASPEED, Network: 2 x Intel I210 OS: Ubuntu 22.04, Kernel: 6.5.0-21-generic (x86_64), Display Server: X Server 1.21.1.4, Vulkan: 1.3.255, Compiler: GCC 11.4.0, File-System: ext4, Screen Resolution: 1024x768 OpenVINO 2023.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU ms < Lower Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 1.41 |======================= OpenVINO 2023.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 31001.30 |=================== OpenVINO 2023.2.dev Model: Handwritten English Recognition FP16-INT8 - Device: CPU ms < Lower Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 171.28 |===================== OpenVINO 2023.2.dev Model: Handwritten English Recognition FP16-INT8 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 256.62 |===================== OpenVINO 2023.2.dev Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU ms < Lower Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 2.03 |======================= OpenVINO 2023.2.dev Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 21554.33 |=================== OpenVINO 2023.2.dev Model: Handwritten English Recognition FP16 - Device: CPU ms < Lower Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 63.50 |====================== OpenVINO 2023.2.dev Model: Handwritten English Recognition FP16 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 173.11 |===================== OpenVINO 2023.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU ms < Lower Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 18.67 |====================== OpenVINO 2023.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 587.92 |===================== OpenVINO 2023.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU ms < Lower Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 43.35 |====================== OpenVINO 2023.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 1013.58 |==================== OpenVINO 2023.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU ms < Lower Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 152.76 |===================== OpenVINO 2023.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 71.92 |====================== OpenVINO 2023.2.dev Model: Road Segmentation ADAS FP16-INT8 - Device: CPU ms < Lower Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 35.85 |====================== OpenVINO 2023.2.dev Model: Road Segmentation ADAS FP16-INT8 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 306.63 |===================== OpenVINO 2023.2.dev Model: Face Detection Retail FP16-INT8 - Device: CPU ms < Lower Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 5.77 |======================= OpenVINO 2023.2.dev Model: Face Detection Retail FP16-INT8 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 1902.65 |==================== OpenVINO 2023.2.dev Model: Weld Porosity Detection FP16 - Device: CPU ms < Lower Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 15.91 |====================== OpenVINO 2023.2.dev Model: Weld Porosity Detection FP16 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 689.92 |===================== OpenVINO 2023.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU ms < Lower Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 16.57 |====================== OpenVINO 2023.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 663.07 |===================== OpenVINO 2023.2.dev Model: Road Segmentation ADAS FP16 - Device: CPU ms < Lower Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 58.85 |====================== OpenVINO 2023.2.dev Model: Road Segmentation ADAS FP16 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 186.72 |===================== OpenVINO 2023.2.dev Model: Face Detection Retail FP16 - Device: CPU ms < Lower Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 5.53 |======================= OpenVINO 2023.2.dev Model: Face Detection Retail FP16 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 1984.59 |==================== OpenVINO 2023.2.dev Model: Face Detection FP16-INT8 - Device: CPU ms < Lower Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 1091.37 |==================== OpenVINO 2023.2.dev Model: Face Detection FP16-INT8 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 9.98 |======================= OpenVINO 2023.2.dev Model: Vehicle Detection FP16 - Device: CPU ms < Lower Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 22.69 |====================== OpenVINO 2023.2.dev Model: Vehicle Detection FP16 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 484.10 |===================== OpenVINO 2023.2.dev Model: Person Detection FP32 - Device: CPU ms < Lower Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 164.48 |===================== OpenVINO 2023.2.dev Model: Person Detection FP32 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 66.81 |====================== OpenVINO 2023.2.dev Model: Person Detection FP16 - Device: CPU ms < Lower Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 162.65 |===================== OpenVINO 2023.2.dev Model: Person Detection FP16 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 67.54 |====================== OpenVINO 2023.2.dev Model: Face Detection FP16 - Device: CPU ms < Lower Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 1422.71 |==================== OpenVINO 2023.2.dev Model: Face Detection FP16 - Device: CPU FPS > Higher Is Better 2 x Intel Xeon E5-2699 v4 - ASPEED - Supermicro . 7.67 |=======================