This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models.
To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark openvino.
OpenBenchmarking.org metrics for this test profile configuration based on 590 public results since 7 October 2020 with the latest data as of 10 April 2021.
Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.
Based on OpenBenchmarking.org data, the selected test / test configuration (OpenVINO 2021.1 - Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU) has an average run-time of 3 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.
Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.1%.
Yes, based on the automated analysis of the collected public benchmark data, this test / test settings does generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.
26 Systems - 438 Benchmark Results |
Intel Xeon Platinum 8280 - GIGABYTE MD61-SC2-00 v01000100 - Intel Sky Lake-E DMI3 Registers Ubuntu 20.04 - 5.11.0-051100rc6daily20210201-generic - GNOME Shell 3.36.4 |
25 Systems - 438 Benchmark Results |
AMD Ryzen Threadripper PRO 3975WX 32-Cores - ASUS Pro WS WRX80E-SAGE SE WIFI - AMD Starship Fedora 33 - 5.11.7-200.fc33.x86_64 - GNOME Shell 3.38.4 |
24 Systems - 333 Benchmark Results |
AMD EPYC 7542 32-Core - ASRockRack EPYCD8 - AMD Starship Ubuntu 20.04 - 5.11.0-051100rc6daily20210201-generic - GNOME Shell 3.36.4 |
24 Systems - 307 Benchmark Results |
2 x AMD EPYC 75F3 32-Core - AMD DAYTONA_X - AMD Starship Ubuntu 20.04 - 5.11.0-051100rc6daily20210201-generic - GNOME Shell 3.36.4 |
2 Systems - 255 Benchmark Results |
2 x AMD EPYC 7763 64-Core - AMD DAYTONA_X - AMD Starship Ubuntu 20.04 - 5.11.6-051106-generic - GNOME Shell 3.36.4 |
2 Systems - 240 Benchmark Results |
2 x Intel Xeon Platinum 8275CL - Amazon EC2 c5d.24xlarge - Intel 440FX 82441FX PMC Ubuntu 20.04 - 5.4.0-1039-aws - GNOME Shell 3.36.7 |
1 System - 255 Benchmark Results |
2 x AMD EPYC 7763 64-Core - AMD DAYTONA_X - AMD Starship Ubuntu 20.04 - 5.11.6-051106-generic - GNOME Shell 3.36.4 |
3 Systems - 253 Benchmark Results |
Intel Core i9-10885H - HP 8736 - Intel Comet Lake PCH Ubuntu 20.04 - 5.6.0-1034-oem - GNOME Shell 3.36.4 |
3 Systems - 313 Benchmark Results |
Intel Core i7-5960X - ASRock X99 Extreme3 - Intel Xeon E7 v3 Ubuntu 20.04 - 5.4.0-58-generic - GNOME Shell 3.36.4 |
Featured Kernel Comparison |
|
Featured Kernel Comparison |
|
Featured Kernel Comparison |
11 Systems - 217 Benchmark Results |
AMD Ryzen 9 3900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4 |
3 Systems - 40 Benchmark Results |
2 x Intel Xeon Gold 5220R - TYAN S7106 - Intel Sky Lake-E DMI3 Registers Ubuntu 20.04 - 5.9.0-050900rc6-generic - GNOME Shell 3.36.4 |
3 Systems - 25 Benchmark Results |
AMD Ryzen 7 3800XT 8-Core - ASRock X570 Pro4 - AMD Starship Ubuntu 20.04 - 5.9.0-050900rc7daily20201003-generic - GNOME Shell 3.36.4 |
12 Systems - 229 Benchmark Results |
AMD Ryzen 5 3600X 6-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4 |
3 Systems - 131 Benchmark Results |
Intel Core i5-10600K - ASUS PRIME Z490M-PLUS - Intel Comet Lake PCH Ubuntu 20.04 - 5.9.0-050900daily20201012-generic - GNOME Shell 3.36.4 |
3 Systems - 31 Benchmark Results |
AMD Ryzen 5 3600XT 6-Core - MSI X470 GAMING M7 AC - AMD Starship Ubuntu 20.04 - 5.8.0-050800-generic - GNOME Shell 3.36.4 |
Featured Processor Comparison |
Intel Xeon Silver 4214R - Supermicro X11SPL-F v1.02 - Intel Sky Lake-E DMI3 Registers Ubuntu 20.10 - 5.8.0-20-generic - GNOME Shell 3.38.0 |
3 Systems - 202 Benchmark Results |
Intel Core i7-7700K - MSI Z270-A PRO - Intel Xeon E3-1200 v6 Ubuntu 20.04 - 5.9.0-050900rc8daily20201011-generic - GNOME Shell 3.36.4 |
3 Systems - 32 Benchmark Results |
AMD Ryzen 9 3900X 12-Core - ASUS TUF GAMING X570-PLUS - AMD Starship Ubuntu 20.04 - 5.9.0-050900rc6daily20200922-generic - GNOME Shell 3.36.4 |
3 Systems - 100 Benchmark Results |
AMD Ryzen Threadripper 3990X 64-Core - System76 Thelio Major - AMD Starship Ubuntu 20.04 - 5.4.0-47-generic - GNOME Shell 3.36.4 |
12 Systems - 383 Benchmark Results |
AMD Ryzen 9 5900X 12-Core - Gigabyte B550I AORUS PRO AX - AMD Starship Ubuntu 20.04 - 5.4.0-53-generic - GNOME Shell 3.36.4 |
3 Systems - 23 Benchmark Results |
AMD Ryzen Threadripper 2970WX 24-Core - Gigabyte X399 AORUS Gaming 7 - AMD 17h Ubuntu 20.04 - 5.9.0-050900rc6daily20200926-generic - GNOME Shell 3.36.4 |