oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI initiative.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark onednn.

Project Site

github.com

Test Created

17 June 2020

Last Updated

20 December 2020

Test Maintainer

Michael Larabel

Test Type

Processor

Average Install Time

7 Minutes, 35 Seconds

Average Run Time

2 Minutes, 2 Seconds

Test Dependencies

C/C++ Compiler Toolchain + CMake

Accolades

5k+ Downloads

Supported Platforms

* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data current as of Thu, 04 Mar 2021 09:56:31 GMT.

Revision History

pts/onednn-1.6.1 [View Source] Sun, 20 Dec 2020 09:58:16 GMT
This test profile builds and works fine on macOS so enable it (MacOSX).

pts/onednn-1.6.0 [View Source] Wed, 09 Dec 2020 13:47:31 GMT
Update against oneDNN 2.0 upstream.

pts/onednn-1.5.0 [View Source] Wed, 17 Jun 2020 16:26:39 GMT
Initial commit of oneDNN test profile based on Intel oneDNN 1.5, forked from existing mkl-dnn test profile that is named from MKL-DNN before it was renamed to DNNL and then oneDNN. So create new test profile to match Intel naming convention.

Suites Using This Test

Multi-Core

Machine Learning

Intel oneAPI

CPU Massive

Server CPU Tests

Creator Workloads

HPC - High Performance Computing

Performance Metrics

Analyze Test Configuration:

oneDNN 2.0

Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU

OpenBenchmarking.org metrics for this test profile configuration based on 496 public results since 9 December 2020 with the latest data as of 4 March 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component

Percentile Rank

# Matching Public Results

ms (Average)

2 x Intel Xeon Platinum 8280

99th

991 ^{+/- 7}

2 x AMD EPYC 7F72 24-Core

97th

1205 ^{+/- 64}

AMD EPYC 7642 48-Core

97th

1214

AMD EPYC 7552 48-Core

95th

1351

Intel Core i9-7960X

95th

1434 ^{+/- 7}

Intel Core i9-7980XE

93rd

1483 ^{+/- 20}

Intel Core i9-10980XE

92nd

1560 ^{+/- 4}

AMD EPYC 7F72 24-Core

92nd

1571 ^{+/- 83}

Intel Xeon Gold 6226R

91st

1646 ^{+/- 2}

AMD EPYC 7402P 24-Core

90th

1672

Intel Core i7-7900X

88th

2112 ^{+/- 37}

AMD EPYC 7F52 16-Core

88th

2129 ^{+/- 132}

AMD EPYC 7532 32-Core

87th

2215

AMD EPYC 7662 64-Core

86th

2221

AMD EPYC 7702 64-Core

85th

2280 ^{+/- 43}

AMD Ryzen Threadripper 3960X 24-Core

84th

2369 ^{+/- 9}

AMD EPYC 7302P 16-Core

83rd

2413

AMD Ryzen 9 5950X 16-Core

81st

2731 ^{+/- 245}

AMD EPYC 7502P 32-Core

81st

2738

AMD EPYC 7282 16-Core

79th

2837

Intel Core i9-10900K

78th

2858 ^{+/- 26}

AMD EPYC 7502 32-Core

77th

2988 ^{+/- 233}

AMD Ryzen 7 5800X 8-Core

76th

3042 ^{+/- 46}

AMD EPYC 7272 12-Core

76th

3056

Mid-Tier

75th

> 3056

AMD Ryzen 9 5900X 12-Core

74th

3242 ^{+/- 465}

Intel Core i9-9900KS

73rd

3407 ^{+/- 3}

AMD EPYC 7F32 8-Core

72nd

3448 ^{+/- 95}

Intel Xeon Silver 4216

70th

3608 ^{+/- 8}

AMD Ryzen Threadripper 3990X 64-Core

68th

3732 ^{+/- 5}

AMD Ryzen 7 3800XT 8-Core

67th

3740 ^{+/- 17}

Intel Core i9-9900K

65th

3786 ^{+/- 51}

AMD Ryzen 9 3900X 12-Core

65th

3815 ^{+/- 138}

AMD Ryzen 7 3700X 8-Core

65th

3834 ^{+/- 190}

AMD Ryzen 5 5600X 6-Core

64th

3894 ^{+/- 36}

Intel Core i9-9900

62nd

3960 ^{+/- 523}

AMD Ryzen Threadripper 3970X 32-Core

61st

3975 ^{+/- 7}

Intel Core i5-10600K

60th

4000 ^{+/- 2}

Intel Core i7-8700K

58th

4023 ^{+/- 3}

Intel Xeon E5-2687W v3

57th

4044 ^{+/- 14}

Intel Core i7-8086K

56th

4096 ^{+/- 90}

AMD Ryzen 7 PRO 4750G

55th

4160 ^{+/- 87}

AMD Ryzen 9 3900XT 12-Core

55th

4179 ^{+/- 18}

AMD Ryzen Threadripper 2950X 16-Core

54th

4210 ^{+/- 111}

AMD EPYC 7232P 8-Core

53rd

4345

Intel Core i5-8400

52nd

4478 ^{+/- 29}

Intel Xeon E5-1680 v3

51st

4530 ^{+/- 4}

Median

50th

4531

2 x AMD EPYC 7601 32-Core

49th

4696 ^{+/- 230}

Intel Core i5-9400F

49th

4763 ^{+/- 3}

Intel Core i7-5960X

48th

4808 ^{+/- 11}

AMD Ryzen 5 3600XT 6-Core

47th

5076 ^{+/- 6}

AMD Ryzen 9 3950X 16-Core

46th

5301 ^{+/- 17}

Intel Xeon E-2278GEL

45th

5926 ^{+/- 77}

AMD Ryzen 3 3300X 4-Core

45th

5961 ^{+/- 35}

Intel Core i7-7700K

44th

6058 ^{+/- 14}

Intel Core i7-7740K

43rd

6241 ^{+/- 22}

AMD Ryzen Threadripper 2970WX 24-Core

42nd

6559 ^{+/- 106}

Intel Core i7-9750H

42nd

6661 ^{+/- 641}

Intel Core i7-10700T

41st

6698 ^{+/- 23}

Intel Core i3-8100

40th

6761 ^{+/- 1}

Intel Xeon E3-1275 v6

40th

6772 ^{+/- 3}

Intel Core i3-10100

39th

6867 ^{+/- 32}

Intel Xeon E3-1270 v5

39th

6877 ^{+/- 13}

Intel Core i9-10885H

37th

7147 ^{+/- 29}

Intel Core i5-6500

36th

7394 ^{+/- 13}

Intel Core i7-5775C

36th

7400 ^{+/- 4}

Intel Xeon E3-1280 v5

35th

7402

Intel Xeon E3-1245 v5

34th

7479 ^{+/- 9}

AMD Ryzen 7 1800X Eight-Core

33rd

7620 ^{+/- 20}

AMD Ryzen 5 4500U

32nd

7717 ^{+/- 74}

Intel Core i5-7600K

32nd

7743 ^{+/- 2}

Intel Xeon E5-2609 v4

31st

7909 ^{+/- 11}

AMD Ryzen 7 2700 Eight-Core

30th

8166 ^{+/- 32}

AMD Ryzen 5 2400G

29th

8249 ^{+/- 141}

AMD Ryzen 3 2200G

29th

8352 ^{+/- 80}

Intel Core i7-4790K

28th

8451 ^{+/- 43}

AMD Ryzen 7 1700 Eight-Core

27th

8690 ^{+/- 231}

Intel Core i5-4670

26th

8915 ^{+/- 111}

Low-Tier

25th

> 8929

Intel Xeon E3-1260L v5

25th

8930 ^{+/- 18}

Intel Core i7-1165G7

22nd

9304 ^{+/- 348}

Intel Xeon E3-1235L v5

21st

9569 ^{+/- 30}

Intel Xeon E3-1231 v3

21st

9585 ^{+/- 399}

Intel Core i7-4770K

19th

10525 ^{+/- 140}

AMD EPYC 7601 32-Core

19th

10598 ^{+/- 246}

Intel Core i7-6800K

18th

11081 ^{+/- 25}

AMD Ryzen 3 3200U

17th

12586 ^{+/- 31}

Intel Core i7-8550U

16th

12673 ^{+/- 557}

AMD Ryzen 3 1300X

16th

12791 ^{+/- 156}

Intel Core i7-1065G7

16th

12863 ^{+/- 7}

POWER9 44-Core

14th

13094 ^{+/- 60}

Intel Core i3-7100

13th

13137 ^{+/- 231}

Intel Core i7-8565U

13th

13181 ^{+/- 226}

AMD Ryzen 5 3400G

11th

13566 ^{+/- 25}

AMD Ryzen Threadripper 2990WX 32-Core

11th

13715 ^{+/- 170}

Intel Core i5-3470

10th

14756 ^{+/- 297}

Intel Core i7-5600U

8th

20832 ^{+/- 20}

Intel Core i7-8700B

8th

21280 ^{+/- 32}

Intel Core i7-4960X

7th

22097 ^{+/- 177}

Ampere eMAG ARMv8 32-Core

6th

31372 ^{+/- 674}

Intel Core i7-3770K

6th

31708 ^{+/- 36}

AMD FX-8370 Eight-Core

4th

44764 ^{+/- 28}

Apple M1

3rd

66778 ^{+/- 8}

POWER9 4-Core

2nd

68457 ^{+/- 393}

Intel Core i7-2700K

2nd

73528 ^{+/- 27}

AMD A10-7850K APU

1st

77508 ^{+/- 465}

Based on OpenBenchmarking.org data, the selected test / test configuration (oneDNN 2.0 - Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU) has an average run-time of 7 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.7%.

Does It Scale Well With Increasing Cores?

Yes, based on the automated analysis of the collected public benchmark data, this test / test settings does generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set

Support

Instructions Detected

SSE2 (SSE2)

Used by default on supported hardware.

MOVAPD MOVDQU MOVD CVTSS2SD MOVDQA CVTSI2SD DIVSD ADDSD UCOMISD COMISD MULSD CVTSD2SS MAXSD SQRTSD SUBSD MINSD MOVUPD ADDPD PUNPCKLQDQ PSRLDQ PUNPCKHQDQ SHUFPD PSHUFD CVTTSD2SI PADDQ PSHUFLW CVTDQ2PS CVTTPS2DQ MULPD MOVHPD UNPCKHPD MOVMSKPD CMPNLESD XORPD

SSE3 (SSE3)

Used by default on supported hardware.

MOVDDUP

SSSE3 (SSSE3)

Used by default on supported hardware.

PSHUFB PALIGNR

Advanced Vector Extensions (AVX)

Requires passing a supported compiler/build flag (verified with targets: sandybridge, skylake, tigerlake, cascadelake, znver2).
Found on Intel processors since Sandy Bridge (2011).
Found on AMD processors since Bulldozer (2011).

VZEROUPPER VEXTRACTF128 VINSERTF128 VBROADCASTSS VMASKMOVPS VPERM2F128 VBROADCASTSD VPERMILPS

Advanced Vector Extensions 2 (AVX2)

Requires passing a supported compiler/build flag (verified with targets: skylake, tigerlake, cascadelake, znver2).
Found on Intel processors since Haswell (2013).
Found on AMD processors since Excavator (2016).

VPERM2I128 VPSLLVD VEXTRACTI128 VPBROADCASTD VINSERTI128 VPSRAVD VPMASKMOVQ VPERMQ VPBROADCASTQ VGATHERQPS VPBROADCASTW VPSRLVQ VGATHERDPS VPBROADCASTB VPGATHERQQ VPGATHERQD VPSLLVQ VPGATHERDD VPGATHERDQ VPERMD

FMA (FMA)

VFMADD213SS VFMADD132SS VFMADD231SS VFMADD132PS VFMADD231PS VFMADD213PS VFNMSUB231SS VFNMADD132SS VFNMSUB132SS VFNMADD231SS VFNMADD231PS VFMADD132SD VFMADD231SD VFNMADD213SS VFMSUB231SS VFMSUB231PS VFMADD231PD VFMADD213PD VFMADD132PD VFMSUB231SD VFNMSUB231PS VFNMADD132PS VFNMSUB132PS

The test / benchmark does honor compiler flag changes.

Last automated analysis: 31 January 2021

This test profile binary relies on the shared libraries libdnnl.so.2, libpthread.so.0, libm.so.6, libgomp.so.1, libc.so.6, libdl.so.2.

eMAG 5 Systems - 42 Benchmark Results	Ampere eMAG ARMv8 - AmpereComputing OSPREY - Applied Micro Circuits X-Gene Ubuntu 20.04 - 5.7.0-050700-generic - GNOME Shell 3.36.3
zbook creator 1 System - 144 Benchmark Results	Intel Core i9-10885H - HP 8736 - Intel Comet Lake PCH Ubuntu 20.10 - 5.8.0-43-generic - GNOME Shell 3.38.2
bench-pts-multicore-20210216 1 System - 2393 Benchmark Results	AMD Ryzen 7 PRO 4750G - ASRock A520M-ITX/ac - AMD Renoir Root Complex Gentoo - 5.10.16 - amd
core-i7-8086k-2021 5 Systems - 131 Benchmark Results	Intel Core i7-8086K - ASUS PRIME Z370-A - Intel 8th Gen Core Ubuntu 20.04 - 5.9.0-050900rc8daily20201009-generic - GNOME Shell 3.36.4
OnLogic Helix 500 Linux benchmarks 2 Systems - 151 Benchmark Results	Intel Xeon E-2278GEL - Logic Supply RXM-181 - Intel Cannon Lake PCH Ubuntu 20.10 - 5.8.0-41-generic - GNOME Shell 3.38.2
bench-pts-multicore-20210214 1 System - 2388 Benchmark Results	AMD Ryzen 7 PRO 4750G - ASRock A520M-ITX/ac - AMD Renoir Root Complex Gentoo - 5.10.16 - amd
bench-pts-multicore-20210212 1 System - 2326 Benchmark Results	AMD Ryzen 7 PRO 4750G - ASRock A520M-ITX/ac - AMD Renoir Root Complex Gentoo - 5.10.15 - GCC 10.2.0 + Clang 11.0.0 + LLVM 11.0.0
3700x_multicore 1 System - 158 Benchmark Results	AMD Ryzen 7 3700X 8-Core - MSI A520M-A PRO - AMD Starship Fedora 33 - 5.10.14-200.fc33.x86_64 - Clang 11.0.0
bench-pts-multicore-20210210 1 System - 2276 Benchmark Results
gpu3Multicore1 1 System - 167 Benchmark Results	AMD Ryzen Threadripper 2950X 16-Core - ASRock X399 Professional Gaming - AMD 17h Ubuntu 16.04 - 4.19.174-custom - X Server 1.19.6
Xeon Platinum Ubuntu 19.04 1 System - 143 Benchmark Results	2 x Intel Xeon Platinum 8280 - GIGABYTE MD61-SC2-00 v01000100 - Intel Sky Lake-E DMI3 Registers Ubuntu 19.04 - 5.0.0-38-generic - GNOME Shell 3.32.2
Ubuntu 20.10 Kernels AMD Zen 3 6 Systems - 143 Benchmark Results	AMD Ryzen 9 5900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 20.10 - 5.10.0-7.1-liquorix-amd64 - GNOME Shell 3.38.1

eMAG 5 Systems - 42 Benchmark Results	Ampere eMAG ARMv8 - AmpereComputing OSPREY - Applied Micro Circuits X-Gene Ubuntu 20.04 - 5.7.0-050700-generic - GNOME Shell 3.36.3
AMD EPYC 7601 2P 2021 3 Systems - 74 Benchmark Results	2 x AMD EPYC 7601 32-Core - Dell 02MJ3T - AMD 17h Ubuntu 19.10 - 5.9.0-050900rc6daily20200922-generic - GNOME Shell 3.34.1
Ryzen 3 2200G 2021 3 Systems - 191 Benchmark Results	AMD Ryzen 3 2200G - ASUS PRIME B350M-E - AMD Raven Ubuntu 20.10 - 5.8.0-38-generic - GNOME Shell 3.38.1
Core i7 9750H EOY 4 Systems - 80 Benchmark Results	Intel Core i7-9750H - Notebook P95_96_97Ex Rx - Intel Cannon Lake PCH Ubuntu 20.04 - 5.7.0-999-generic - GNOME Shell 3.36.4
AMD EPYC 7F72 2P Linux 5.11 3 Systems - 376 Benchmark Results	2 x AMD EPYC 7F72 24-Core - Supermicro H11DSi-NT v2.00 - AMD Starship Ubuntu 20.10 - 5.10.9-051009-generic - GNOME Shell 3.38.1
AMD Ryzen 9 5950X Linux 5.11 Schedutil vs. Performance 2 Systems - 220 Benchmark Results	AMD Ryzen 9 5950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 20.10 - 5.11.0-rc4-max-boost-inv-patch - GNOME Shell 3.38.1
AMD Ryzen 9 5950X Linux 5.11 Featured Kernel Comparison	AMD Ryzen 9 5950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 20.10 - 5.11.0-rc4-max-boost-inv-patch - GNOME Shell 3.38.1
Ryzen 9 5900X LInux 5.11 Featured Kernel Comparison	AMD Ryzen 9 5900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 20.10 - 5.10.2-051002-generic - GNOME Shell 3.38.1
3990x onednn 2.0 3 Systems - 19 Benchmark Results	AMD Ryzen Threadripper 3990X 64-Core - System76 Thelio Major - AMD Starship Pop 20.10 - 5.8.0-7625-generic - GNOME Shell 3.38.1
2400G 2021 4 Systems - 104 Benchmark Results	AMD Ryzen 5 2400G - MSI B350M GAMING PRO - AMD Raven Ubuntu 19.10 - 5.3.0-64-generic - GNOME Shell 3.34.1
AMD EPYC 7702 Linux 5.11 Featured Kernel Comparison	AMD EPYC 7702 64-Core - ASRockRack EPYCD8 - AMD Starship Ubuntu 20.10 - 5.10.2-051002-generic - GNOME Shell 3.38.1
E3-1260L 2021 4 Systems - 133 Benchmark Results	Intel Xeon E3-1260L v5 - ASRock E3V5 WS - Intel Xeon E3-1200 v5 Ubuntu 20.10 - 5.8.0-33-generic - GNOME Shell 3.38.1

oneDNN

Project Site

Test Created

Last Updated

Test Maintainer

Test Type

Average Install Time

Average Run Time

Test Dependencies

Accolades

Supported Platforms

Revision History

Suites Using This Test

Performance Metrics

oneDNN 2.0

Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU

Does It Scale Well With Increasing Cores?

Notable Instruction Set Usage

Recent Test Results

Most Popular Test Results