oneDNN

This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the oneAPI initiative.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark onednn.

Project Site

github.com

Test Created

17 June 2020

Last Updated

20 December 2020

Test Maintainer

Michael Larabel

Test Type

Processor

Average Install Time

9 Minutes, 3 Seconds

Average Run Time

2 Minutes, 2 Seconds

Accolades

5k+ Downloads

Supported Platforms


Public Result UploadsReported Installs*Test Completions*OpenBenchmarking.orgEventsoneDNN Popularity Statisticspts/onednn2020.062020.072020.082020.092020.102020.112020.122021.014K8K12K16K20K
* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data current as of Tue, 19 Jan 2021 15:40:39 GMT.
Deconvolution Batch shapes_3d11.4%Recurrent Neural Network Training15.9%IP Shapes 1D11.5%Convolution Batch Shapes Auto11.5%Matrix Multiply Batch Shapes Transformer11.3%Recurrent Neural Network Inference15.7%IP Shapes 3D11.5%Deconvolution Batch shapes_1d11.4%Harness Option PopularityOpenBenchmarking.org
bf16bf16bf1614.1%u8s8f3240.0%f3245.9%Data Type Option PopularityOpenBenchmarking.org

Revision History

pts/onednn-1.6.1   [View Source]   Sun, 20 Dec 2020 09:58:16 GMT
This test profile builds and works fine on macOS so enable it (MacOSX).

pts/onednn-1.6.0   [View Source]   Wed, 09 Dec 2020 13:47:31 GMT
Update against oneDNN 2.0 upstream.

pts/onednn-1.5.0   [View Source]   Wed, 17 Jun 2020 16:26:39 GMT
Initial commit of oneDNN test profile based on Intel oneDNN 1.5, forked from existing mkl-dnn test profile that is named from MKL-DNN before it was renamed to DNNL and then oneDNN. So create new test profile to match Intel naming convention.

Suites Using This Test

Multi-Core

Machine Learning

Intel oneAPI

CPU Massive

Server CPU Tests

Creator Workloads

HPC - High Performance Computing


Performance Metrics

Analyze Test Configuration:

oneDNN 1.5

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.org metrics for this test profile configuration based on 513 public results since 17 June 2020 with the latest data as of 1 December 2020.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Matching Public Results
ms (Average)
100th
3
0.27 +/- 0.04
99th
4
0.29 +/- 0.02
94th
4
0.36 +/- 0.02
92nd
4
0.42 +/- 0.01
92nd
19
0.42 +/- 0.12
87th
3
0.62 +/- 0.01
87th
5
0.66 +/- 0.17
86th
4
0.67 +/- 0.01
77th
5
0.77 +/- 0.01
76th
6
0.78 +/- 0.04
Mid-Tier
75th
> 0.79
70th
9
0.82 +/- 0.02
68th
3
0.86 +/- 0.01
67th
4
0.87 +/- 0.01
64th
9
0.91 +/- 0.01
60th
10
1.00 +/- 0.03
56th
9
1.05 +/- 0.01
53rd
6
1.08 +/- 0.03
Median
50th
1.17
49th
11
1.23 +/- 0.08
48th
4
1.27 +/- 0.01
46th
12
1.39 +/- 0.05
38th
10
1.69 +/- 0.08
33rd
6
1.88 +/- 0.14
32nd
7
1.92 +/- 0.02
32nd
6
1.93 +/- 0.01
28th
5
2.49 +/- 0.06
28th
3
2.55 +/- 0.18
26th
4
2.66 +/- 0.07
Low-Tier
25th
> 2.70
25th
7
2.74 +/- 0.46
24th
10
2.77 +/- 0.05
17th
11
3.45 +/- 0.28
13th
3
5.03 +/- 0.10
12th
3
5.55 +/- 0.20
11th
3
5.73 +/- 0.04
10th
4
5.90 +/- 0.02
8th
3
6.96 +/- 0.03
7th
3
7.19 +/- 0.02
6th
3
7.99 +/- 0.13
3rd
3
14.08 +/- 0.31
1st
3
23.49 +/- 1.70
OpenBenchmarking.orgDistribution Of Public Results - Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU513 Results Range From 0 To 95 ms081624324048566472808896100200300400500

Based on OpenBenchmarking.org data, the selected test / test configuration (oneDNN 1.5 - Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU) has an average run-time of 2 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkHarness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPURun-Time246810Min: 1 / Avg: 1.03 / Max: 3

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.6%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsHarness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPUDeviation246810Min: 0 / Avg: 0.63 / Max: 6

Recent Test Results

OpenBenchmarking.org Results Compare

1 System - 189 Benchmark Results

Intel Core i7-4790K - ASRock Z97 Pro4 - Intel 4th Gen Core DRAM

Arch rolling - 5.9.10-arch1-1 - Xfce 4.14

1 System - 41 Benchmark Results

Intel Core i7-6700 - ASUS Z170I PRO GAMING - Intel Xeon E3-1200 v5

Fedora 33 - 5.8.16-300.fc33.x86_64 - Cinnamon 4.6.7

3 Systems - 218 Benchmark Results

AMD Ryzen 9 5900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.10 - 5.8.0-29-generic - GNOME Shell 3.38.1

1 System - 73 Benchmark Results

Intel Core i7-4700HQ - ASUS G750JX v1.0 - Intel Xeon E3-1200 v3

Arch rolling - 5.9.8-arch1-1 - X Server 1.20.9

1 System - 214 Benchmark Results

Intel Xeon Platinum 8275CL - Amazon EC2 c5.2xlarge - Intel 440FX 82441FX PMC

Ubuntu 20.04 - 5.4.0-1029-aws - GCC 9.3.0

12 Systems - 383 Benchmark Results

AMD Ryzen 9 5900X 12-Core - Gigabyte B550I AORUS PRO AX - AMD Starship

Ubuntu 20.04 - 5.4.0-53-generic - GNOME Shell 3.36.4

19 Systems - 176 Benchmark Results

AMD EPYC 7352 24-Core - ASRockRack EPYCD8 - AMD Starship

Ubuntu 20.10 - 5.8.0-21-generic - GNOME Shell 3.38.0

1 System - 201 Benchmark Results

AMD Ryzen 9 3900XT 12-Core - MSI MEG X570 GODLIKE - AMD Starship

Ubuntu 20.10 - 5.8.0-21-generic - GNOME Shell 3.38.0

7 Systems - 349 Benchmark Results

AMD Ryzen 5 5600X 6-Core - ASRock X570 Pro4 - AMD Starship

Ubuntu 20.10 - 5.8.0-26-generic - GNOME Shell 3.38.1

6 Systems - 349 Benchmark Results

AMD Ryzen 5 5600X 6-Core - ASRock X570 Pro4 - AMD Starship

Ubuntu 20.10 - 5.8.0-26-generic - GNOME Shell 3.38.1

1 System - 282 Benchmark Results

AMD Ryzen 9 5900X 12-Core - ASRock X570 Pro4 - AMD Starship

Ubuntu 20.10 - 5.8.0-26-generic - GNOME Shell 3.38.1

Most Popular Test Results

OpenBenchmarking.org Results Compare

6 Systems - 136 Benchmark Results

Intel Core i9-10980XE - ASRock X299 Steel Legend - Intel Sky Lake-E DMI3 Registers

Ubuntu 20.04 - 5.4.0-42-generic - GNOME Shell 3.36.3

2 Systems - 403 Benchmark Results

Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH

Ubuntu 20.04 - 5.4.0-48-generic - GNOME Shell 3.36.4

3 Systems - 406 Benchmark Results

AMD Ryzen 9 3900XT 12-Core - MSI MEG X570 GODLIKE - AMD Starship

Ubuntu 20.04 - 5.4.0-48-generic - GNOME Shell 3.36.4

5 Systems - 68 Benchmark Results

AMD Ryzen 9 3900X 12-Core - MSI MPG X570 GAMING PLUS - AMD Starship

Debian testing - 5.7.10-xanmod1 - X Server 1.20.8

3 Systems - 202 Benchmark Results

Intel Core i7-7700K - MSI Z270-A PRO - Intel Xeon E3-1200 v6

Ubuntu 20.04 - 5.8.14-050814-generic - GNOME Shell 3.36.4

3 Systems - 173 Benchmark Results

AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship

Ubuntu 20.04 - 5.4.0-37-generic - GNOME Shell 3.36.2

6 Systems - 733 Benchmark Results

AMD Ryzen 7 3700X 8-Core - MSI MEG X570 GODLIKE - AMD Starship

Ubuntu 20.04 - 5.8.0-050800daily20200622-generic - GNOME Shell 3.36.2

3 Systems - 138 Benchmark Results

Intel Xeon E3-1245 v5 - MSI C236A WORKSTATION - Intel Xeon E3-1200 v5

Ubuntu 20.04 - 5.9.0-050900rc7daily20201003-generic - GNOME Shell 3.36.4

3 Systems - 301 Benchmark Results

Intel Core i5-4670 - MSI B85M-P33 - Intel 4th Gen Core DRAM

Ubuntu 20.04 - 5.4.0-40-generic - GNOME Shell 3.36.3

Find More Test Results

OpenBenchmarking.org Community User Comments

Post A Comment