OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models.


OpenVINO 2024.5

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.org metrics for this test profile configuration based on 56 public results since 24 November 2024 with the latest data as of 15 December 2024.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Details
Percentile Rank
# Compatible Public Results
ms (Average)
Zen 5 [8 Cores / 16 Threads]
97th
4
31 +/- 1
Zen 5 [64 Cores / 128 Threads]
88th
4
49
Zen 5 [96 Cores / 192 Threads]
79th
6
67 +/- 1
Mid-Tier
75th
> 68
Zen 5 [16 Cores / 32 Threads]
68th
4
73
Zen 5 [10 Cores / 20 Threads]
61st
3
91
Zen 4 [8 Cores / 16 Threads]
54th
4
107 +/- 1
Median
50th
115
Arrow Lake [24 Cores / 24 Threads]
43rd
3
118 +/- 1
Zen 5 [12 Cores / 24 Threads]
40th
5
124 +/- 11
Zen 4 [64 Cores / 128 Threads]
34th
3
158 +/- 1
Low-Tier
25th
> 228
Lunar Lake [8 Cores / 8 Threads]
24th
4
228
Alder Lake [14 Cores / 20 Threads]
20th
4
429 +/- 22