oneDNN MKL-DNN

This is a test of the Intel oneDNN (formerly DNNL / Deep Neural Network Library / MKL-DNN) as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported.

The pts/mkl-dnn test profile has been succeeded by the pts/onednn test profile to match the naming convetion used by Intel following their renaming to oneDNN. Run pts/onednn test profile to use the latest version of Intel oneDNN benchmark.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark mkl-dnn.

Project Site

github.com

Test Created

16 April 2019

Last Updated

17 June 2020

Test Maintainer

Michael Larabel 

Test Type

Processor

Average Install Time

3 Minutes, 32 Seconds

Average Run Time

8 Minutes, 21 Seconds

Test Dependencies

C/C++ Compiler Toolchain + CMake

Accolades

20k+ Downloads

Supported Platforms


Public Result UploadsReported Installs*Test Completions*OpenBenchmarking.orgEventsoneDNN MKL-DNN Popularity Statisticspts/mkl-dnn2019.042019.052019.062019.072019.082019.092019.102019.112019.122020.012020.022020.032020.042020.052020.062020.072020.082020.092020.102020.112020.122021.012021.0212K24K36K48K60K
* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data current as of Wed, 03 Mar 2021 06:37:09 GMT.
Deconvolution Batch deconv_3d19.7%Deconvolution Batch deconv_1d20.2%IP Batch All19.9%IP Batch 1D20.2%Recurrent Neural Network Training9.9%Recurrent Neural Network Inference10.1%Harness Option PopularityOpenBenchmarking.org
u8s8f3236.7%f3263.3%Data Type Option PopularityOpenBenchmarking.org

Revision History

pts/mkl-dnn-1.3.1   [View Source]   Wed, 17 Jun 2020 16:31:48 GMT
NOTICE: The pts/mkl-dnn test profile has been succeeded by the pts/onednn test profile to match the naming convetion used by Intel following their renaming to oneDNN. Run pts/onednn test profile to use the latest version of Intel oneDNN benchmark

pts/mkl-dnn-1.3.0   [View Source]   Thu, 09 Apr 2020 18:14:05 GMT
Fix as did not mean to expose f16 option.

pts/mkl-dnn-1.2.0   [View Source]   Thu, 09 Apr 2020 18:10:17 GMT
Update against oneDNN 1.3 sources.

pts/mkl-dnn-1.1.1   [View Source]   Thu, 03 Oct 2019 19:35:40 GMT
Update data types.

pts/mkl-dnn-1.1.0   [View Source]   Thu, 03 Oct 2019 16:09:23 GMT
Update against MKL-DNN DNNL 1.1.

pts/mkl-dnn-1.0.2   [View Source]   Thu, 18 Apr 2019 20:44:30 GMT
Fixes per reported test argument reporting and setting of OMP env vars.

pts/mkl-dnn-1.0.1   [View Source]   Wed, 17 Apr 2019 09:20:39 GMT
MKLDNN_ARCH_OPT_FLAGS="-O3 $CXXFLAGS"

pts/mkl-dnn-1.0.0   [View Source]   Tue, 16 Apr 2019 20:44:47 GMT
Initial commit of Intel MKL-DNN benchdnn benchmark.


Performance Metrics

Analyze Test Configuration:

oneDNN MKL-DNN 1.3

Harness: Deconvolution Batch deconv_1d - Data Type: f32

OpenBenchmarking.org metrics for this test profile configuration based on 151 public results since 9 April 2020 with the latest data as of 25 December 2020.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

OpenBenchmarking.orgDistribution Of Public Results - Harness: Deconvolution Batch deconv_1d - Data Type: f32151 Results Range From 1 To 303 ms11835526986103120137154171188205222239256273290307306090120150

Based on OpenBenchmarking.org data, the selected test / test configuration (oneDNN MKL-DNN 1.3 - Harness: Deconvolution Batch deconv_1d - Data Type: f32) has an average run-time of 2 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkHarness: Deconvolution Batch deconv_1d - Data Type: f32Run-Time246810Min: 1 / Avg: 1.43 / Max: 5

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.8%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsHarness: Deconvolution Batch deconv_1d - Data Type: f32Deviation3691215Min: 0 / Avg: 0.77 / Max: 8

Recent Test Results

OpenBenchmarking.org Results Compare

8 Systems - 69 Benchmark Results

Intel Core i9-7980XE - ASUS PRIME X299-A - Intel Sky Lake-E DMI3 Registers

Ubuntu 18.10 - 4.18.0-25-generic - GNOME Shell 3.30.1

18 Systems - 77 Benchmark Results

AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship

Ubuntu 20.04 - 5.4.0-12-generic - GNOME Shell 3.34.3

16 Systems - 77 Benchmark Results

AMD Ryzen Threadripper 2990WX 32-Core - ASUS ROG ZENITH EXTREME - AMD 17h

Ubuntu 20.04 - 5.4.0-12-generic - GNOME Shell 3.34.3

15 Systems - 77 Benchmark Results

2 x Intel Xeon Platinum 8280 - GIGABYTE MD61-SC2-00 v01000100 - Intel Sky Lake-E DMI3 Registers

Ubuntu 20.04 - 5.4.0-12-generic - GNOME Shell 3.34.3

14 Systems - 41 Benchmark Results

AMD Ryzen Threadripper 2990WX 32-Core - ASUS ROG ZENITH EXTREME - AMD 17h

Ubuntu 20.04 - 5.4.0-12-generic - GNOME Shell 3.34.3

22 Systems - 70 Benchmark Results

2 x AMD EPYC 7302 16-Core - AMD DAYTONA_X - AMD Device 1480

Ubuntu 19.04 - 5.3.0-999-generic - GNOME Shell 3.32.2

21 Systems - 70 Benchmark Results

2 x AMD Eng Sample ZS222445TGG44_32/22/2_2/16 - Supermicro H8DG6/H8DGi v1.0 - AMD RD890 + SB7x0

Gentoo - 4.19.66-gentoo - KDE Plasma 5.17.4

1 System - 10 Benchmark Results

2 x Intel Xeon E5-2680 v2 - Supermicro X9DRW v0123456789 - Intel Xeon E7 v2

Peppermint 10 - 5.0.0-37-generic - LXDE

13 Systems - 41 Benchmark Results

AMD Ryzen Threadripper 3960X 24-Core - MSI Creator TRX40 - AMD Starship

Ubuntu 20.04 - 5.4.0-12-generic - GNOME Shell 3.34.3

12 Systems - 41 Benchmark Results

AMD Ryzen Threadripper 3990X 64-Core - ASRock TRX40 Creator - AMD Starship

Ubuntu 20.04 - 5.4.0-58-generic - X Server

11 Systems - 41 Benchmark Results

Intel Core i9-10980XE - Gigabyte X299X DESIGNARE 10G - Intel Sky Lake-E DMI3 Registers

Ubuntu 20.04 - 5.4.0-12-generic - GNOME Shell 3.34.3

11 Systems - 41 Benchmark Results

Intel Xeon Platinum 8253 - Supermicro X11SPL-F v1.02 - Intel Sky Lake-E DMI3 Registers

Ubuntu 20.04 - 5.4.0-12-generic - GNOME Shell 3.34.3

Most Popular Test Results

OpenBenchmarking.org Results Compare

2 Systems - 269 Benchmark Results

AMD Ryzen Threadripper 3990X 64-Core - System76 Thelio Major - AMD Starship

Pop 20.04 - 5.4.0-7626-generic - GNOME Shell 3.36.1

8 Systems - 246 Benchmark Results

AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship

ManjaroLinux 20.0 - 5.6.7-1-MANJARO - Xfce 4.14

3 Systems - 777 Benchmark Results

Intel Core i3-10100 - ASUS PRIME Z490M-PLUS - Intel Comet Lake PCH

Ubuntu 20.04 - 5.7.0-rc6-amd-energy - GNOME Shell 3.36.2

2 Systems - 1708 Benchmark Results

AMD Ryzen 3 3300X 4-Core - ASRock X570 Pro4 - AMD Starship

Ubuntu 20.04 - 5.7.0-rc6-amd-energy - GNOME Shell 3.36.2

5 Systems - 385 Benchmark Results

Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH

Ubuntu 20.04 - 5.7.0-999-generic - GNOME Shell 3.36.1

4 Systems - 381 Benchmark Results

AMD Ryzen 9 3950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.04 - 5.7.0-999-generic - GNOME Shell 3.36.1

18 Systems - 19 Benchmark Results

AMD EPYC 7452 32-Core - AMD DAYTONA_X - AMD Device 1480

Ubuntu 18.04 - 5.3.0-40-generic - GNOME Shell 3.28.4

1 System - 3 Benchmark Results

Intel Core i7-6820HQ - Dell Latitude E5470 - Intel Xeon E3-1200 v5

Fedora 33 - 5.8.14-300.fc33.x86_64 - GNOME Shell 3.38.1

Find More Test Results