OpenVINO Benchmark - OpenBenchmarking.org

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark openvino.

Revision History

pts/openvino-1.0.4 [View Source] Thu, 19 Nov 2020 13:48:10 GMT
Fix for running OpenVINO on AArch64.

pts/openvino-1.0.3 [View Source] Thu, 08 Oct 2020 18:19:27 GMT
Expose Intel GPU option that works on Intel GPU setups having their GPU compute stack installed at OpenVINO build time.

pts/openvino-1.0.2 [View Source] Wed, 07 Oct 2020 20:43:13 GMT
Add python2 as a system dependency - still needed for OpenVINO, yuck.

pts/openvino-1.0.1 [View Source] Wed, 07 Oct 2020 18:36:20 GMT
Ensure OpenCV gets included as a system dependency.

pts/openvino-1.0.0 [View Source] Wed, 07 Oct 2020 16:55:46 GMT
Initial commit of OpenVINO benchmark.

Performance Metrics

OpenVINO 2021.1

Model: Person Detection 0106 FP16 - Device: CPU

OpenBenchmarking.org metrics for this test profile configuration based on 435 public results since 7 October 2020 with the latest data as of 19 January 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component

Percentile Rank

# Matching Public Results

FPS (Average)

2 x AMD EPYC 7742 64-Core

100th

12.67 ^{+/- 0.05}

2 x Intel Xeon Platinum 8280

99th

8.77 ^{+/- 0.11}

AMD Ryzen Threadripper 3990X 64-Core

97th

6.64 ^{+/- 0.04}

AMD EPYC 7662 64-Core

97th

6.56

AMD EPYC 7702 64-Core

96th

6.10

AMD Ryzen Threadripper 3970X 32-Core

94th

5.79 ^{+/- 0.03}

AMD EPYC 7642 48-Core

94th

5.64

AMD EPYC 7552 48-Core

93rd

5.61

AMD EPYC 7542 32-Core

92nd

4.75

Intel Xeon Platinum 8280

90th

4.47 ^{+/- 0.21}

AMD EPYC 7502P 32-Core

90th

4.38

AMD EPYC 7502 32-Core

89th

4.35

AMD Ryzen Threadripper 3960X 24-Core

87th

4.32 ^{+/- 0.03}

2 x Intel Xeon Gold 5220R

86th

4.15 ^{+/- 0.01}

AMD EPYC 7532 32-Core

85th

4.12

AMD EPYC 7F72 24-Core

84th

3.95

AMD EPYC 7452 32-Core

83rd

3.89

AMD EPYC 7402P 24-Core

81st

3.48

Intel Core i9-7980XE

80th

3.13 ^{+/- 0.02}

Intel Core i9-7960X

77th

3.04 ^{+/- 0.02}

AMD EPYC 7F52 16-Core

77th

3.01 ^{+/- 0.05}

AMD EPYC 7352 24-Core

77th

3.01

Mid-Tier

75th

< 3.00

Intel Core i9-10980XE

75th

2.99 ^{+/- 0.01}

Intel Xeon Gold 6226R

72nd

2.86 ^{+/- 0.07}

AMD Ryzen 9 5950X 16-Core

70th

2.48 ^{+/- 0.04}

AMD EPYC 7302P 16-Core

66th

2.43

AMD Ryzen 9 3950X 16-Core

66th

2.43 ^{+/- 0.02}

Intel Xeon Gold 5218R

63rd

2.37 ^{+/- 0.01}

AMD EPYC 7282 16-Core

62nd

2.28

AMD Ryzen 9 5900X 12-Core

61st

2.21 ^{+/- 0.03}

AMD EPYC 7601 32-Core

58th

2.08

AMD Ryzen 9 3900X 12-Core

58th

2.08 ^{+/- 0.02}

AMD Ryzen 9 3900XT 12-Core

56th

1.97

Intel Core i9-10900K

54th

1.91 ^{+/- 0.02}

AMD EPYC 7272 12-Core

53rd

1.76

AMD Ryzen Threadripper 2970WX 24-Core

52nd

1.69 ^{+/- 0.02}

AMD EPYC 7F32 8-Core

51st

1.59 ^{+/- 0.04}

Median

50th

1.57

Intel Core i9-9900KS

50th

1.56 ^{+/- 0.01}

AMD Ryzen 7 3700X 8-Core

46th

1.52 ^{+/- 0.01}

AMD Ryzen 7 3800XT 8-Core

46th

1.52 ^{+/- 0.04}

Intel Core i9-9900K

44th

1.43 ^{+/- 0.01}

Intel Xeon Silver 4216

43rd

1.40

AMD EPYC 7262 8-Core

41st

1.30

AMD Ryzen 5 3600X 6-Core

40th

1.29

AMD Ryzen 5 5600X 6-Core

40th

1.29 ^{+/- 0.01}

Intel Xeon E5-1680 v3

40th

1.29 ^{+/- 0.02}

Intel Core i5-10600K

38th

1.28 ^{+/- 0.01}

Intel Core i7-8086K

36th

1.24 ^{+/- 0.01}

AMD EPYC 7252 8-Core

36th

1.24

Intel Core i7-5960X

34th

1.22

AMD EPYC 7232P 8-Core

34th

1.22

Intel Core i7-8700K

32nd

1.20 ^{+/- 0.01}

AMD Ryzen 5 3600XT 6-Core

31st

1.11 ^{+/- 0.01}

Intel Core i5-8400

30th

1.04 ^{+/- 0.01}

Intel Core i5-9400F

30th

1.03

Intel Core i7-7700K

28th

0.91 ^{+/- 0.01}

AMD Ryzen 3 3300X 4-Core

27th

0.88

Intel Core i7-9750H

26th

0.85 ^{+/- 0.01}

Low-Tier

25th

< 0.85

AMD Ryzen 5 4500U

24th

0.81 ^{+/- 0.01}

Intel Core i9-10885H

23rd

0.80

Intel Xeon E3-1275 v6

23rd

0.80 ^{+/- 0.01}

AMD Ryzen 7 2700X Eight-Core

21st

0.79 ^{+/- 0.02}

Intel Core i3-10100

20th

0.76 ^{+/- 0.01}

Intel Xeon E3-1245 v5

20th

0.73

Intel Xeon E3-1280 v5

20th

0.73

Intel Core i3-8100

18th

0.71 ^{+/- 0.01}

Intel Xeon E5-2609 v4

16th

0.68

Intel Core i7-5775C

15th

0.67 ^{+/- 0.01}

Intel Core i5-6500

14th

0.64

Intel Core i5-7600K

13th

0.63 ^{+/- 0.01}

Intel Core i7-6700HQ

12th

0.60 ^{+/- 0.01}

Intel Core i7-8550U

10th

0.43 ^{+/- 0.01}

Intel Core i7-8565U

9th

0.41 ^{+/- 0.01}

AMD Ryzen 3 1300X

9th

0.41

Intel Core i7-1065G7

8th

0.40 ^{+/- 0.01}

Intel Core i5-2500K

7th

0.35

Intel Core i7-3770K

6th

0.32

Intel Core i7-5600U

5th

0.26

Intel Core i7-2700K

4th

0.24

AMD Ryzen 3 3200U

4th

0.15

Intel Pentium G3258

3rd

0.12

AMD A10-7850K APU

2nd

0.09

Based on OpenBenchmarking.org data, the selected test / test configuration (OpenVINO 2021.1 - Model: Person Detection 0106 FP16 - Device: CPU) has an average run-time of 4 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.2%.

HP Zbook 3 Systems - 253 Benchmark Results	Intel Core i9-10885H - HP 8736 - Intel Comet Lake PCH Ubuntu 20.04 - 5.6.0-1034-oem - GNOME Shell 3.36.4
Core i7 5960X 2021 3 Systems - 313 Benchmark Results	Intel Core i7-5960X - ASRock X99 Extreme3 - Intel Xeon E7 v3 Ubuntu 20.04 - 5.4.0-58-generic - GNOME Shell 3.36.4
3900X + Polaris Featured Kernel Comparison	5.9.0-050900rc6daily20200922-generic - 5.10.4-051004-generic - 5.11.0-rc1-phx
AMD EPYC 7F52 Featured Kernel Comparison	5.10.3-051003-generic - 5.11.0-rc1-phx
AMD EPYC 7F52 Featured Kernel Comparison	5.8.0-050800rc6daily20200721-generic - 5.10.3-051003-generic
Ryzen 3 3300X Xmas 3 Systems - 75 Benchmark Results	AMD Ryzen 3 3300X 4-Core - MSI B350M GAMING PRO - AMD Starship Ubuntu 20.04 - 5.9.0-rc5-14sep-patch - GNOME Shell 3.36.4
Ryzen 9 5950X Linux 5.11 Regression Schedutil Featured Kernel Comparison	5.10.2-051002-generic - 5.10.0-phx
Xeon E5 1680 v3 Xmas 3 Systems - 141 Benchmark Results	Intel Xeon E5-1680 v3 - ASUS X99-A - Intel Xeon E7 v3 Ubuntu 20.04 - 5.4.0-47-generic - GNOME Shell 3.36.4
Core i3 8100 December 3 Systems - 101 Benchmark Results	Intel Core i3-8100 - ASRock Z370M-ITX/ac - Intel 8th Gen Core 4-core Desktop Ubuntu 20.04 - 5.9.0-050900rc1daily20200819-generic - GNOME Shell 3.36.4
Core i5 8400 Xmas 3 Systems - 95 Benchmark Results	Intel Core i5-8400 - MSI Z370M MORTAR - Intel 8th Gen Core Ubuntu 20.04 - 5.9.0-050900rc7daily20200929-generic - GNOME Shell 3.36.4
Core i7 3770K 2020 3 Systems - 107 Benchmark Results	Intel Core i7-3770K - ECS Z77H2-A2X v1.0 - Intel Xeon E3-1200 v2 Ubuntu 20.04 - 5.4.0-47-generic - GNOME Shell 3.36.4
ryzen 7 3700x dec 4 Systems - 83 Benchmark Results	AMD Ryzen 7 3700X 8-Core - Gigabyte A320M-S2H-CF - AMD Starship Ubuntu 20.04 - 5.8.1-050801-generic - GNOME Shell 3.36.4

Ryzen 9 5900X / Ryzen 9 5950X Linux Performance 11 Systems - 217 Benchmark Results	Intel Core i5-10600K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4
3800XT october 3 Systems - 25 Benchmark Results	AMD Ryzen 7 3800XT 8-Core - ASRock X570 Pro4 - AMD Starship Ubuntu 20.04 - 5.9.0-050900rc7daily20201003-generic - GNOME Shell 3.36.4
Pre 10.0 Xeon 3 Systems - 40 Benchmark Results	2 x Intel Xeon Gold 5220R - TYAN S7106 - Intel Sky Lake-E DMI3 Registers Ubuntu 20.04 - 5.9.0-050900rc6-generic - GNOME Shell 3.36.4
Core i5 10600K October 3 Systems - 131 Benchmark Results	Intel Core i5-10600K - ASUS PRIME Z490M-PLUS - Intel Comet Lake PCH Ubuntu 20.04 - 5.9.0-050900daily20201012-generic - GNOME Shell 3.36.4
Ryzen 5 3600X 10.0 L 3 Systems - 31 Benchmark Results	AMD Ryzen 5 3600XT 6-Core - MSI X470 GAMING M7 AC - AMD Starship Ubuntu 20.04 - 5.8.0-050800-generic - GNOME Shell 3.36.4
7700K Intel 2020 3 Systems - 202 Benchmark Results	Intel Core i7-7700K - MSI Z270-A PRO - Intel Xeon E3-1200 v6 Ubuntu 20.04 - 5.8.14-050814-generic - GNOME Shell 3.36.4
TR 3990X Okt 3 Systems - 100 Benchmark Results	AMD Ryzen Threadripper 3990X 64-Core - System76 Thelio Major - AMD Starship Ubuntu 20.04 - 5.4.0-47-generic - GNOME Shell 3.36.4
TR Okt 3 Systems - 23 Benchmark Results	AMD Ryzen Threadripper 2970WX 24-Core - Gigabyte X399 AORUS Gaming 7 - AMD 17h Ubuntu 20.04 - 5.9.0-050900rc6daily20200926-generic - GNOME Shell 3.36.4
Ryzen 5 5600X Linux Performance 12 Systems - 229 Benchmark Results	AMD Ryzen 9 3950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4
Ryzen 9 3900X Pre 10.0 3 Systems - 32 Benchmark Results	AMD Ryzen 9 3900X 12-Core - ASUS TUF GAMING X570-PLUS - AMD Starship Ubuntu 20.04 - 5.9.0-050900rc6daily20200922-generic - GNOME Shell 3.36.4
Intel Xeon On Ubuntu 20.10 Featured Processor Comparison	Intel Xeon Silver 4214R - Supermicro X11SPL-F v1.02 - Intel Sky Lake-E DMI3 Registers Ubuntu 20.10 - 5.8.0-20-generic - GNOME Shell 3.38.0
Core i5 2500K October 2020 3 Systems - 68 Benchmark Results	Intel Core i5-2500K - SAPPHIRE Pure Black P67 Hydra - Intel 2nd Generation Core DRAM Ubuntu 20.04 - 5.4.0-40-generic - GNOME Shell 3.36.4

OpenVINO

Project Site

Test Created

Last Updated

Test Maintainer

Test Type

Average Install Time

Average Run Time

Accolades

Supported Platforms

Revision History

Suites Using This Test

Performance Metrics

OpenVINO 2021.1

Model: Person Detection 0106 FP16 - Device: CPU

Recent Test Results

Most Popular Test Results

User Comments