OpenVINO Benchmark - OpenBenchmarking.org

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark openvino.

Revision History

pts/openvino-1.0.4 [View Source] Thu, 19 Nov 2020 13:48:10 GMT
Fix for running OpenVINO on AArch64.

pts/openvino-1.0.3 [View Source] Thu, 08 Oct 2020 18:19:27 GMT
Expose Intel GPU option that works on Intel GPU setups having their GPU compute stack installed at OpenVINO build time.

pts/openvino-1.0.2 [View Source] Wed, 07 Oct 2020 20:43:13 GMT
Add python2 as a system dependency - still needed for OpenVINO, yuck.

pts/openvino-1.0.1 [View Source] Wed, 07 Oct 2020 18:36:20 GMT
Ensure OpenCV gets included as a system dependency.

pts/openvino-1.0.0 [View Source] Wed, 07 Oct 2020 16:55:46 GMT
Initial commit of OpenVINO benchmark.

Performance Metrics

OpenVINO 2021.1

Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU

OpenBenchmarking.org metrics for this test profile configuration based on 436 public results since 7 October 2020 with the latest data as of 20 January 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component

Percentile Rank

# Matching Public Results

FPS (Average)

2 x AMD EPYC 7742 64-Core

100th

40760 ^{+/- 449}

2 x Intel Xeon Platinum 8280

99th

38037 ^{+/- 740}

AMD Ryzen Threadripper 3990X 64-Core

98th

32953 ^{+/- 54}

AMD EPYC 7662 64-Core

96th

29381

AMD EPYC 7702 64-Core

95th

26399

AMD Ryzen Threadripper 3970X 32-Core

94th

25582 ^{+/- 79}

AMD EPYC 7552 48-Core

94th

23915

AMD EPYC 7642 48-Core

92nd

22787

Intel Xeon Platinum 8280

91st

22154 ^{+/- 557}

2 x Intel Xeon Gold 5220R

90th

21614 ^{+/- 17}

AMD EPYC 7542 32-Core

89th

20076

AMD EPYC 7502P 32-Core

87th

19121

AMD EPYC 7502 32-Core

87th

18724

AMD Ryzen Threadripper 3960X 24-Core

86th

17361 ^{+/- 30}

AMD EPYC 7452 32-Core

84th

16906

AMD EPYC 7532 32-Core

83rd

16112

Intel Core i9-7980XE

82nd

15849 ^{+/- 15}

Intel Core i9-10980XE

80th

15456 ^{+/- 28}

Intel Core i9-7960X

79th

14560 ^{+/- 33}

AMD EPYC 7F72 24-Core

79th

14163

Intel Xeon Gold 6226R

76th

13696 ^{+/- 22}

Mid-Tier

75th

< 13573

AMD Ryzen 9 5950X 16-Core

72nd

13467 ^{+/- 127}

AMD EPYC 7402P 24-Core

71st

13267

AMD Ryzen 9 3950X 16-Core

69th

12490 ^{+/- 119}

Intel Xeon Gold 5218R

68th

12475 ^{+/- 29}

AMD EPYC 7352 24-Core

67th

11839

AMD Ryzen 9 5900X 12-Core

64th

10973 ^{+/- 53}

Intel Core i9-10900K

62nd

9818 ^{+/- 20}

AMD EPYC 7F52 16-Core

60th

9773 ^{+/- 166}

AMD EPYC 7282 16-Core

59th

9710

AMD Ryzen 9 3900X 12-Core

57th

9075 ^{+/- 49}

AMD EPYC 7302P 16-Core

56th

8844

AMD Ryzen 9 3900XT 12-Core

55th

8749

AMD EPYC 7601 32-Core

54th

7689

Intel Xeon Silver 4216

52nd

7447

AMD Ryzen 7 3800XT 8-Core

51st

6933 ^{+/- 176}

AMD Ryzen Threadripper 2970WX 24-Core

51st

6928 ^{+/- 6}

Median

50th

6898

Intel Core i9-9900KS

50th

6877 ^{+/- 18}

AMD Ryzen 7 3700X 8-Core

47th

6696 ^{+/- 52}

AMD EPYC 7272 12-Core

46th

6551

AMD Ryzen 5 5600X 6-Core

45th

6216 ^{+/- 13}

Intel Core i9-9900K

44th

6127 ^{+/- 38}

AMD Ryzen 5 3600X 6-Core

43rd

5701

Intel Core i5-10600K

39th

5469 ^{+/- 19}

Intel Core i7-8086K

39th

5408 ^{+/- 169}

Intel Core i7-8700K

38th

5343 ^{+/- 20}

Intel Xeon E5-1680 v3

37th

5068 ^{+/- 9}

AMD Ryzen 5 3600XT 6-Core

36th

5036 ^{+/- 45}

AMD EPYC 7F32 8-Core

35th

4915 ^{+/- 120}

Intel Core i7-5960X

35th

4831 ^{+/- 15}

AMD EPYC 7252 8-Core

32nd

4463

AMD EPYC 7262 8-Core

32nd

4377

AMD EPYC 7232P 8-Core

31st

4157

AMD Ryzen 3 3300X 4-Core

29th

3959 ^{+/- 33}

Intel Core i5-8400

28th

3879 ^{+/- 43}

Intel Core i5-9400F

27th

3739 ^{+/- 49}

Intel Core i7-7700K

26th

3703 ^{+/- 8}

Low-Tier

25th

< 3559

Intel Core i7-9750H

25th

3549 ^{+/- 6}

Intel Core i9-10885H

24th

3340 ^{+/- 29}

Intel Xeon E3-1275 v6

23rd

3217 ^{+/- 12}

Intel Xeon E3-1245 v5

21st

2945 ^{+/- 12}

Intel Core i3-10100

21st

2903 ^{+/- 17}

Intel Xeon E3-1280 v5

20th

2896 ^{+/- 6}

AMD Ryzen 7 2700X Eight-Core

19th

2877 ^{+/- 16}

Intel Xeon E5-2609 v4

17th

2692 ^{+/- 3}

Intel Core i3-8100

16th

2547 ^{+/- 5}

Intel Core i7-5775C

14th

2413 ^{+/- 25}

Intel Core i5-6500

13th

2338 ^{+/- 8}

Intel Core i7-6700HQ

12th

2230 ^{+/- 6}

Intel Core i7-1065G7

11th

2100 ^{+/- 38}

Intel Core i5-7600K

10th

2019 ^{+/- 7}

AMD Ryzen 5 4500U

9th

1946 ^{+/- 10}

Intel Core i7-8550U

8th

1815 ^{+/- 10}

Intel Core i7-8565U

8th

1760 ^{+/- 56}

AMD Ryzen 3 1300X

7th

1733 ^{+/- 5}

Intel Core i5-2500K

6th

1370 ^{+/- 2}

Intel Core i7-3770K

5th

1163 ^{+/- 13}

Intel Core i7-5600U

4th

987 ^{+/- 2}

Intel Core i7-2700K

4th

969 ^{+/- 1}

AMD Ryzen 3 3200U

3rd

693 ^{+/- 2}

Intel Pentium G3258

2nd

470 ^{+/- 6}

AMD A10-7850K APU

2nd

459 ^{+/- 5}

Based on OpenBenchmarking.org data, the selected test / test configuration (OpenVINO 2021.1 - Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU) has an average run-time of 4 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.1%.

HP Zbook 3 Systems - 253 Benchmark Results	Intel Core i9-10885H - HP 8736 - Intel Comet Lake PCH Ubuntu 20.04 - 5.6.0-1034-oem - GNOME Shell 3.36.4
Core i7 5960X 2021 3 Systems - 313 Benchmark Results	Intel Core i7-5960X - ASRock X99 Extreme3 - Intel Xeon E7 v3 Ubuntu 20.04 - 5.4.0-58-generic - GNOME Shell 3.36.4
3900X + Polaris Featured Kernel Comparison	5.9.0-050900rc6daily20200922-generic - 5.10.4-051004-generic - 5.11.0-rc1-phx
AMD EPYC 7F52 Featured Kernel Comparison	5.10.3-051003-generic - 5.11.0-rc1-phx
AMD EPYC 7F52 Featured Kernel Comparison	5.8.0-050800rc6daily20200721-generic - 5.10.3-051003-generic
Ryzen 3 3300X Xmas 3 Systems - 75 Benchmark Results	AMD Ryzen 3 3300X 4-Core - MSI B350M GAMING PRO - AMD Starship Ubuntu 20.04 - 5.9.0-rc5-14sep-patch - GNOME Shell 3.36.4
Ryzen 9 5950X Linux 5.11 Regression Schedutil Featured Kernel Comparison	5.10.2-051002-generic - 5.10.0-phx
Xeon E5 1680 v3 Xmas 3 Systems - 141 Benchmark Results	Intel Xeon E5-1680 v3 - ASUS X99-A - Intel Xeon E7 v3 Ubuntu 20.04 - 5.4.0-47-generic - GNOME Shell 3.36.4
Core i3 8100 December 3 Systems - 101 Benchmark Results	Intel Core i3-8100 - ASRock Z370M-ITX/ac - Intel 8th Gen Core 4-core Desktop Ubuntu 20.04 - 5.9.0-050900rc1daily20200819-generic - GNOME Shell 3.36.4
Core i5 8400 Xmas 3 Systems - 95 Benchmark Results	Intel Core i5-8400 - MSI Z370M MORTAR - Intel 8th Gen Core Ubuntu 20.04 - 5.9.0-050900rc7daily20200929-generic - GNOME Shell 3.36.4
Core i7 3770K 2020 3 Systems - 107 Benchmark Results	Intel Core i7-3770K - ECS Z77H2-A2X v1.0 - Intel Xeon E3-1200 v2 Ubuntu 20.04 - 5.4.0-47-generic - GNOME Shell 3.36.4
ryzen 7 3700x dec 4 Systems - 83 Benchmark Results	AMD Ryzen 7 3700X 8-Core - Gigabyte A320M-S2H-CF - AMD Starship Ubuntu 20.04 - 5.8.1-050801-generic - GNOME Shell 3.36.4

Ryzen 9 5900X / Ryzen 9 5950X Linux Performance 11 Systems - 217 Benchmark Results	AMD Ryzen 5 2600X Six-Core - ASUS ROG CROSSHAIR VIII HERO - AMD 17h Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4
3800XT october 3 Systems - 25 Benchmark Results	AMD Ryzen 7 3800XT 8-Core - ASRock X570 Pro4 - AMD Starship Ubuntu 20.04 - 5.9.0-050900rc7daily20201003-generic - GNOME Shell 3.36.4
Pre 10.0 Xeon 3 Systems - 40 Benchmark Results	2 x Intel Xeon Gold 5220R - TYAN S7106 - Intel Sky Lake-E DMI3 Registers Ubuntu 20.04 - 5.9.0-050900rc6-generic - GNOME Shell 3.36.4
Core i5 10600K October 3 Systems - 131 Benchmark Results	Intel Core i5-10600K - ASUS PRIME Z490M-PLUS - Intel Comet Lake PCH Ubuntu 20.04 - 5.8.14-050814-generic - GNOME Shell 3.36.4
Ryzen 5 3600X 10.0 L 3 Systems - 31 Benchmark Results	AMD Ryzen 5 3600XT 6-Core - MSI X470 GAMING M7 AC - AMD Starship Ubuntu 20.04 - 5.8.0-050800-generic - GNOME Shell 3.36.4
7700K Intel 2020 3 Systems - 202 Benchmark Results	Intel Core i7-7700K - MSI Z270-A PRO - Intel Xeon E3-1200 v6 Ubuntu 20.04 - 5.8.14-050814-generic - GNOME Shell 3.36.4
TR 3990X Okt 3 Systems - 100 Benchmark Results	AMD Ryzen Threadripper 3990X 64-Core - System76 Thelio Major - AMD Starship Ubuntu 20.04 - 5.4.0-47-generic - GNOME Shell 3.36.4
TR Okt 3 Systems - 23 Benchmark Results	AMD Ryzen Threadripper 2970WX 24-Core - Gigabyte X399 AORUS Gaming 7 - AMD 17h Ubuntu 20.04 - 5.9.0-050900rc6daily20200926-generic - GNOME Shell 3.36.4
Ryzen 5 5600X Linux Performance 12 Systems - 229 Benchmark Results	AMD Ryzen 5 2600 Six-Core - ASUS ROG CROSSHAIR VIII HERO - AMD 17h Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4
Ryzen 9 3900X Pre 10.0 3 Systems - 32 Benchmark Results	AMD Ryzen 9 3900X 12-Core - ASUS TUF GAMING X570-PLUS - AMD Starship Ubuntu 20.04 - 5.9.0-050900rc6daily20200922-generic - GNOME Shell 3.36.4
Intel Xeon On Ubuntu 20.10 Featured Processor Comparison	Intel Xeon Silver 4215R - Supermicro X11SPL-F v1.02 - Intel Sky Lake-E DMI3 Registers Ubuntu 20.10 - 5.8.0-20-generic - GNOME Shell 3.38.0
Core i5 2500K October 2020 3 Systems - 68 Benchmark Results	Intel Core i5-2500K - SAPPHIRE Pure Black P67 Hydra - Intel 2nd Generation Core DRAM Ubuntu 20.04 - 5.4.0-40-generic - GNOME Shell 3.36.4

OpenVINO

Project Site

Test Created

Last Updated

Test Maintainer

Test Type

Average Install Time

Average Run Time

Accolades

Supported Platforms

Revision History

Suites Using This Test

Performance Metrics

OpenVINO 2021.1

Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU

Recent Test Results

Most Popular Test Results

User Comments