oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI initiative.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark onednn.

Project Site

github.com

Test Created

17 June 2020

Last Updated

20 December 2020

Test Maintainer

Michael Larabel

Test Type

Processor

Average Install Time

8 Minutes, 38 Seconds

Average Run Time

2 Minutes, 2 Seconds

Test Dependencies

C/C++ Compiler Toolchain + CMake

Accolades

5k+ Downloads

Supported Platforms

* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data current as of Tue, 26 Jan 2021 07:06:13 GMT.

Revision History

pts/onednn-1.6.1 [View Source] Sun, 20 Dec 2020 09:58:16 GMT
This test profile builds and works fine on macOS so enable it (MacOSX).

pts/onednn-1.6.0 [View Source] Wed, 09 Dec 2020 13:47:31 GMT
Update against oneDNN 2.0 upstream.

pts/onednn-1.5.0 [View Source] Wed, 17 Jun 2020 16:26:39 GMT
Initial commit of oneDNN test profile based on Intel oneDNN 1.5, forked from existing mkl-dnn test profile that is named from MKL-DNN before it was renamed to DNNL and then oneDNN. So create new test profile to match Intel naming convention.

Suites Using This Test

Multi-Core

Machine Learning

Intel oneAPI

CPU Massive

Server CPU Tests

Creator Workloads

HPC - High Performance Computing

Performance Metrics

Analyze Test Configuration:

oneDNN 2.0

Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU

OpenBenchmarking.org metrics for this test profile configuration based on 406 public results since 9 December 2020 with the latest data as of 26 January 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component

Percentile Rank

# Matching Public Results

ms (Average)

2 x Intel Xeon Platinum 8280

100th

993 ^{+/- 5}

2 x AMD EPYC 7F72 24-Core

98th

1211 ^{+/- 74}

Intel Core i9-7960X

97th

1434 ^{+/- 7}

Intel Core i9-7980XE

95th

1483 ^{+/- 20}

Intel Core i9-10980XE

94th

1560 ^{+/- 4}

AMD EPYC 7F72 24-Core

93rd

1612 ^{+/- 1}

Intel Xeon Gold 6226R

92nd

1646 ^{+/- 2}

Intel Core i7-7900X

90th

2097 ^{+/- 1}

AMD EPYC 7F52 16-Core

90th

2187 ^{+/- 126}

AMD Ryzen Threadripper 3960X 24-Core

88th

2369 ^{+/- 9}

AMD Ryzen 9 5950X 16-Core

86th

2731 ^{+/- 245}

Intel Core i9-10900K

84th

2858 ^{+/- 26}

AMD EPYC 7502 32-Core

83rd

2988 ^{+/- 233}

AMD Ryzen 7 5800X 8-Core

81st

3042 ^{+/- 46}

AMD Ryzen 9 5900X 12-Core

80th

3242 ^{+/- 465}

Intel Core i9-9900KS

80th

3407 ^{+/- 3}

AMD EPYC 7F32 8-Core

78th

3487 ^{+/- 81}

Intel Xeon Silver 4216

77th

3608 ^{+/- 8}

Mid-Tier

75th

> 3674

AMD Ryzen Threadripper 3990X 64-Core

74th

3732 ^{+/- 5}

AMD Ryzen 7 3800XT 8-Core

73rd

3740 ^{+/- 17}

Intel Core i9-9900K

70th

3786 ^{+/- 51}

AMD Ryzen 9 3900X 12-Core

70th

3815 ^{+/- 138}

AMD Ryzen 7 3700X 8-Core

70th

3837 ^{+/- 31}

AMD Ryzen 5 5600X 6-Core

68th

3894 ^{+/- 36}

Intel Core i9-9900

66th

3960 ^{+/- 523}

AMD Ryzen Threadripper 3970X 32-Core

66th

3975 ^{+/- 7}

Intel Core i5-10600K

64th

4000 ^{+/- 2}

Intel Core i7-8700K

62nd

4023 ^{+/- 3}

Intel Xeon E5-2687W v3

62nd

4038 ^{+/- 19}

AMD Ryzen 9 3900XT 12-Core

60th

4179 ^{+/- 18}

Intel Core i7-8086K

60th

4187 ^{+/- 48}

AMD Ryzen Threadripper 2950X 16-Core

60th

4265 ^{+/- 3}

Intel Core i5-8400

58th

4478 ^{+/- 29}

Intel Xeon E5-1680 v3

57th

4530 ^{+/- 4}

2 x AMD EPYC 7601 32-Core

56th

4696 ^{+/- 230}

Intel Core i5-9400F

55th

4763 ^{+/- 3}

Intel Core i7-5960X

54th

4808 ^{+/- 11}

AMD Ryzen 5 3600XT 6-Core

53rd

5076 ^{+/- 6}

AMD Ryzen 9 3950X 16-Core

52nd

5301 ^{+/- 17}

AMD Ryzen 3 3300X 4-Core

51st

5961 ^{+/- 35}

Intel Core i7-7700K

51st

6058 ^{+/- 14}

Median

50th

6074

Intel Core i7-7740K

50th

6241 ^{+/- 22}

Intel Core i7-9750H

49th

6374 ^{+/- 26}

AMD Ryzen Threadripper 2970WX 24-Core

48th

6559 ^{+/- 106}

Intel Core i7-10700T

47th

6702 ^{+/- 25}

Intel Core i3-8100

47th

6761 ^{+/- 1}

Intel Xeon E3-1275 v6

46th

6772 ^{+/- 3}

Intel Core i3-10100

44th

6867 ^{+/- 32}

Intel Xeon E3-1270 v5

44th

6877 ^{+/- 13}

Intel Core i9-10885H

43rd

7161 ^{+/- 7}

Intel Core i5-6500

41st

7394 ^{+/- 13}

Intel Core i7-5775C

41st

7400 ^{+/- 4}

Intel Xeon E3-1280 v5

41st

7402

Intel Xeon E3-1245 v5

39th

7484 ^{+/- 9}

AMD Ryzen 7 1800X Eight-Core

38th

7620 ^{+/- 20}

AMD Ryzen 5 4500U

38th

7717 ^{+/- 74}

Intel Core i5-7600K

37th

7743 ^{+/- 2}

Intel Xeon E5-2609 v4

36th

7909 ^{+/- 11}

AMD Ryzen 7 2700 Eight-Core

34th

8166 ^{+/- 32}

AMD Ryzen 5 2400G

34th

8249 ^{+/- 141}

AMD Ryzen 3 2200G

34th

8352 ^{+/- 80}

Intel Core i7-4790K

33rd

8451 ^{+/- 43}

AMD Ryzen 7 1700 Eight-Core

31st

8690 ^{+/- 231}

Intel Core i5-4670

30th

8915 ^{+/- 111}

Intel Xeon E3-1260L v5

29th

8935 ^{+/- 26}

Intel Core i7-1165G7

26th

9304 ^{+/- 348}

Low-Tier

25th

> 9350

Intel Xeon E3-1235L v5

25th

9569 ^{+/- 30}

Intel Xeon E3-1231 v3

25th

9585 ^{+/- 399}

Intel Core i7-4770K

23rd

10525 ^{+/- 140}

AMD EPYC 7601 32-Core

23rd

10598 ^{+/- 246}

Intel Core i7-6800K

21st

11081 ^{+/- 25}

AMD Ryzen 3 3200U

20th

12586 ^{+/- 31}

Intel Core i7-8550U

19th

12673 ^{+/- 557}

AMD Ryzen 3 1300X

19th

12791 ^{+/- 156}

Intel Core i7-1065G7

18th

12863 ^{+/- 7}

POWER9 44-Core

16th

13094 ^{+/- 60}

Intel Core i3-7100

16th

13137 ^{+/- 231}

Intel Core i7-8565U

15th

13181 ^{+/- 226}

AMD Ryzen 5 3400G

13th

13566 ^{+/- 25}

AMD Ryzen Threadripper 2990WX 32-Core

12th

13715 ^{+/- 170}

Intel Core i5-3470

11th

14756 ^{+/- 297}

Intel Core i7-5600U

9th

20832 ^{+/- 20}

Intel Core i7-8700B

9th

21280 ^{+/- 32}

Intel Core i7-4960X

8th

22097 ^{+/- 177}

Ampere eMAG ARMv8 32-Core

7th

31372 ^{+/- 674}

Intel Core i7-3770K

6th

31708 ^{+/- 36}

AMD FX-8370 Eight-Core

4th

44764 ^{+/- 28}

Apple M1

3rd

66778 ^{+/- 8}

POWER9 4-Core

2nd

68457 ^{+/- 393}

Intel Core i7-2700K

2nd

73528 ^{+/- 27}

AMD A10-7850K APU

1st

77508 ^{+/- 465}

Based on OpenBenchmarking.org data, the selected test / test configuration (oneDNN 2.0 - Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU) has an average run-time of 7 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.8%.

Does It Scale Well With Increasing Cores?

Yes, based on the automated analysis of the collected public benchmark data, this test / test settings does generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

AMD EPYC 7F72 2P Linux 5.11 Perf Governor 3 Systems - 376 Benchmark Results	2 x AMD EPYC 7F72 24-Core - Supermicro H11DSi-NT v2.00 - AMD Starship Ubuntu 20.10 - 5.11.0-051100rc4daily20210122-generic - GNOME Shell 3.38.1
AMD Ryzen 9 5950X Linux 5.11 Schedutil vs. Performance 2 Systems - 220 Benchmark Results	AMD Ryzen 9 5950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 20.10 - 5.11.0-rc4-max-boost-inv-patch - GNOME Shell 3.38.1
AMD EPYC 7F72 2P Linux 5.11 3 Systems - 376 Benchmark Results	2 x AMD EPYC 7F72 24-Core - Supermicro H11DSi-NT v2.00 - AMD Starship Ubuntu 20.10 - 5.11.0-rc4-max-boost-inv-patch - GNOME Shell 3.38.1
AMD Ryzen 9 5950X Linux 5.11 Featured Kernel Comparison	5.10.9-051009-generic - 5.11.0-051100rc4daily20210121-generic - 5.11.0-rc4-max-boost-inv-patch
AMD EPYC 7F72 2P Linux 5.11 1 System - 466 Benchmark Results	2 x AMD EPYC 7F72 24-Core - Supermicro H11DSi-NT v2.00 - AMD Starship Ubuntu 20.10 - 5.10.9-051009-generic - GNOME Shell 3.38.1
AMD EPYC 7601 2P 2021 3 Systems - 74 Benchmark Results	2 x AMD EPYC 7601 32-Core - Dell 02MJ3T - AMD 17h Ubuntu 19.10 - 5.9.0-050900rc6daily20200922-generic - GNOME Shell 3.34.1
5950X ASUS ROG CROSSHAIR VIII HERO WiFi BIOS 2 Systems - 129 Benchmark Results	AMD Ryzen 9 5950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 20.10 - 5.11.0-051100rc2daily20210108-generic - GNOME Shell 3.38.1
Ryzen 3 2200G 2021 3 Systems - 191 Benchmark Results	AMD Ryzen 3 2200G - ASUS PRIME B350M-E - AMD Raven Ubuntu 20.10 - 5.8.0-38-generic - GNOME Shell 3.38.1
2400G 2021 4 Systems - 104 Benchmark Results	AMD Ryzen 5 2400G - MSI B350M GAMING PRO - AMD Raven Ubuntu 19.10 - 5.3.0-64-generic - GNOME Shell 3.34.1
Core i9 7960X 2021 4 Systems - 61 Benchmark Results	Intel Core i9-7960X - MSI X299 SLI PLUS - Intel Sky Lake-E DMI3 Registers Ubuntu 20.04 - 5.4.0-58-generic - X Server 1.20.8
Core i9 7980XE 3 Systems - 113 Benchmark Results	Intel Core i9-7980XE - ASUS PRIME X299-A - Intel Sky Lake-E DMI3 Registers Ubuntu 20.10 - 5.8.0-36-generic - GNOME Shell 3.38.1
core-i7-10700t-pts-102-test-run-onlogic Featured Graphics Comparison	i915drmfb - Intel UHD 630 3GB

AMD EPYC 7601 2P 2021 3 Systems - 74 Benchmark Results	2 x AMD EPYC 7601 32-Core - Dell 02MJ3T - AMD 17h Ubuntu 19.10 - 5.9.0-050900rc6daily20200922-generic - GNOME Shell 3.34.1
Ryzen 3 2200G 2021 3 Systems - 191 Benchmark Results	AMD Ryzen 3 2200G - ASUS PRIME B350M-E - AMD Raven Ubuntu 20.10 - 5.8.0-38-generic - GNOME Shell 3.38.1
3990x onednn 2.0 3 Systems - 19 Benchmark Results	AMD Ryzen Threadripper 3990X 64-Core - System76 Thelio Major - AMD Starship Pop 20.10 - 5.8.0-7625-generic - GNOME Shell 3.38.1
AMD Ryzen 9 5950X Linux 5.11 Featured Kernel Comparison	AMD Ryzen 9 5950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 20.10 - 5.11.0-rc4-max-boost-inv-patch - GNOME Shell 3.38.1
AMD EPYC 7F72 2P Linux 5.11 3 Systems - 376 Benchmark Results	2 x AMD EPYC 7F72 24-Core - Supermicro H11DSi-NT v2.00 - AMD Starship Ubuntu 20.10 - 5.11.0-051100rc4daily20210122-generic - GNOME Shell 3.38.1
TR 3970X oneDNN + clash 3 Systems - 23 Benchmark Results	AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship Ubuntu 20.10 - 5.8.0-29-generic - GNOME Shell 3.38.1
2400G 2021 4 Systems - 104 Benchmark Results	AMD Ryzen 5 2400G - MSI B350M GAMING PRO - AMD Raven Ubuntu 19.10 - 5.3.0-64-generic - GNOME Shell 3.34.1
AMD Ryzen 9 5950X Linux 5.11 Schedutil vs. Performance 2 Systems - 220 Benchmark Results	AMD Ryzen 9 5950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 20.10 - 5.11.0-rc4-max-boost-inv-patch - GNOME Shell 3.38.1
5800X oneDNN 2.0 4 Systems - 18 Benchmark Results	AMD Ryzen 7 5800X 8-Core - ASRock X570 Pro4 - AMD Starship Ubuntu 20.10 - 5.8.0-31-generic - GNOME Shell 3.38.1
Ryzen 9 5900X LInux 5.11 Featured Kernel Comparison	AMD Ryzen 9 5900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 20.10 - 5.10.2-051002-generic - GNOME Shell 3.38.1
Apple M1 Pre Xmas 4 Systems - 35 Benchmark Results	Apple M1 - Apple Mac mini - 8GB macOS 11.1 - 20.2.0 - OpenCL 1.2
Core i7 4790K 202 3 Systems - 148 Benchmark Results	Intel Core i7-4790K - Gigabyte Z97-HD3P - Intel 4th Gen Core DRAM Ubuntu 19.10 - 5.9.0-050900rc8daily20201009-generic - GNOME Shell 3.34.1

oneDNN

Project Site

Test Created

Last Updated

Test Maintainer

Test Type

Average Install Time

Average Run Time

Test Dependencies

Accolades

Supported Platforms

Revision History

Suites Using This Test

Performance Metrics

oneDNN 2.0

Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU

Does It Scale Well With Increasing Cores?

Recent Test Results

Most Popular Test Results

User Comments