openvino cascade lake refresh 2 x Intel Xeon Gold 5220R testing with a TYAN S7106 (V2.01.B40 BIOS) and ASPEED on Ubuntu 20.04 via the Phoronix Test Suite. a: Processor: 2 x Intel Xeon Gold 5220R @ 3.90GHz (36 Cores / 72 Threads), Motherboard: TYAN S7106 (V2.01.B40 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 94GB, Disk: 500GB Samsung SSD 860, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel I210 + 2 x QLogic cLOM8214 1/10GbE OS: Ubuntu 20.04, Kernel: 6.1.0-phx (x86_64), Desktop: GNOME Shell 3.36.9, Display Server: X Server 1.20.13, Compiler: GCC 9.4.0, File-System: ext4, Screen Resolution: 1920x1080 b: Processor: 2 x Intel Xeon Gold 5220R @ 3.90GHz (36 Cores / 72 Threads), Motherboard: TYAN S7106 (V2.01.B40 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 94GB, Disk: 500GB Samsung SSD 860, Graphics: ASPEED, Monitor: VE228, Network: 2 x Intel I210 + 2 x QLogic cLOM8214 1/10GbE OS: Ubuntu 20.04, Kernel: 6.1.0-phx (x86_64), Desktop: GNOME Shell 3.36.9, Display Server: X Server 1.20.13, Compiler: GCC 9.4.0, File-System: ext4, Screen Resolution: 1920x1080 OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU FPS > Higher Is Better a . 6.88 |===================================================================== b . 6.85 |===================================================================== OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU FPS > Higher Is Better a . 3.92 |===================================================================== b . 3.92 |===================================================================== OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU FPS > Higher Is Better a . 3.89 |===================================================================== b . 3.91 |===================================================================== OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU FPS > Higher Is Better a . 427.24 |=================================================================== b . 408.82 |================================================================ OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a . 26.13 |==================================================================== b . 26.11 |==================================================================== OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a . 1376.97 |================================================================== b . 1380.04 |================================================================== OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU FPS > Higher Is Better a . 701.82 |=================================================================== b . 702.32 |=================================================================== OpenVINO 2022.3 Model: Machine Translation EN To DE FP16 - Device: CPU FPS > Higher Is Better a . 80.59 |==================================================================== b . 80.65 |==================================================================== OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU FPS > Higher Is Better a . 2647.09 |================================================================== b . 2643.93 |================================================================== OpenVINO 2022.3 Model: Person Vehicle Bike Detection FP16 - Device: CPU FPS > Higher Is Better a . 684.15 |================================================================== b . 694.51 |=================================================================== OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU FPS > Higher Is Better a . 21582.80 |================================================================= b . 21549.31 |================================================================= OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU FPS > Higher Is Better a . 23351.09 |================================================================= b . 23345.40 |================================================================= OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU ms < Lower Is Better a . 1293.77 |================================================================== b . 1298.59 |================================================================== OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU ms < Lower Is Better a . 2251.68 |================================================================== b . 2254.07 |================================================================== OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU ms < Lower Is Better a . 2270.61 |================================================================== b . 2264.97 |================================================================== OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU ms < Lower Is Better a . 21.02 |================================================================= b . 21.97 |==================================================================== OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU ms < Lower Is Better a . 343.65 |=================================================================== b . 343.67 |=================================================================== OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU ms < Lower Is Better a . 6.51 |===================================================================== b . 6.50 |===================================================================== OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU ms < Lower Is Better a . 51.20 |==================================================================== b . 51.18 |==================================================================== OpenVINO 2022.3 Model: Machine Translation EN To DE FP16 - Device: CPU ms < Lower Is Better a . 111.59 |=================================================================== b . 111.43 |=================================================================== OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU ms < Lower Is Better a . 13.51 |==================================================================== b . 13.54 |==================================================================== OpenVINO 2022.3 Model: Person Vehicle Bike Detection FP16 - Device: CPU ms < Lower Is Better a . 13.11 |==================================================================== b . 12.92 |=================================================================== OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU ms < Lower Is Better a . 1.66 |===================================================================== b . 1.66 |===================================================================== OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU ms < Lower Is Better a . 1.53 |===================================================================== b . 1.53 |=====================================================================