TNN

TNN is an open-source deep learning reasoning framework developed by Tencent.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark tnn.

Project Site

github.com

Test Created

24 September 2020

Last Updated

18 June 2021

Test Maintainer

Michael Larabel

Test Type

System

Average Install Time

1 Minute, 3 Seconds

Average Run Time

1 Minute, 29 Seconds

Test Dependencies

CMake + C/C++ Compiler Toolchain

Accolades

5k+ Downloads

Supported Platforms

* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
*** Test profile page view reporting began March 2021.
Data current as of 17 October 2021.

Revision History

pts/tnn-1.1.0 [View Source] Fri, 18 Jun 2021 07:29:44 GMT
Update against TNN 0.3 upstream release.

pts/tnn-1.0.1 [View Source] Mon, 11 Jan 2021 13:15:50 GMT
Update download mirror as the GitHub URL changed its checksums...

pts/tnn-1.0.0 [View Source] Thu, 24 Sep 2020 18:33:29 GMT
Initial commit of Tencent TNN framework.

Suites Using This Test

Machine Learning

HPC - High Performance Computing

Performance Metrics

Analyze Test Configuration:

TNN 0.3

Target: CPU - Model: DenseNet

OpenBenchmarking.org metrics for this test profile configuration based on 354 public results since 18 June 2021 with the latest data as of 16 October 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component

Percentile Rank

# Compatible Public Results

ms (Average)

AMD Ryzen 9 5950X 16-Core

95th

2421 ^{+/- 19}

AMD Ryzen 9 5900X 12-Core

89th

2520 ^{+/- 25}

AMD Ryzen Threadripper 3960X 24-Core

88th

2549 ^{+/- 3}

AMD Ryzen 9 5900HX

83rd

2602 ^{+/- 31}

AMD Ryzen 5 5600X 6-Core

83rd

2615 ^{+/- 39}

AMD Ryzen 9 3950X 16-Core

83rd

2638 ^{+/- 7}

AMD Ryzen Threadripper 3970X 32-Core

82nd

2655 ^{+/- 4}

Intel Core i9-11900K

79th

2714 ^{+/- 22}

AMD Ryzen 7 5700G

78th

2722 ^{+/- 3}

Mid-Tier

75th

> 2730

AMD Ryzen Threadripper 2950X 16-Core

73rd

2791 ^{+/- 14}

AMD EPYC 74F3 24-Core

73rd

2814 ^{+/- 52}

AMD Ryzen 5 5600G

71st

2836 ^{+/- 5}

AMD Ryzen Threadripper 3990X 64-Core

71st

2843 ^{+/- 106}

Intel Core i9-10900K

70th

2868 ^{+/- 15}

AMD Ryzen 7 5800X 8-Core

70th

2871 ^{+/- 243}

Ampere Altra ARMv8 Neoverse-N1 160-Core

69th

2877 ^{+/- 165}

AMD Ryzen 7 3800XT 8-Core

69th

2883 ^{+/- 6}

AMD EPYC 7543 32-Core

65th

2984 ^{+/- 94}

2 x AMD EPYC 7742 64-Core

63rd

2995 ^{+/- 15}

AMD Ryzen 7 3700X 8-Core

62nd

3005 ^{+/- 13}

AMD Ryzen 9 3900XT 12-Core

61st

3014 ^{+/- 16}

AMD Ryzen Threadripper 2970WX 24-Core

60th

3031 ^{+/- 6}

AMD EPYC 7742 64-Core

58th

3058 ^{+/- 1}

AMD Ryzen 5 3600XT 6-Core

55th

3120 ^{+/- 11}

Intel Xeon E-2288G

54th

3137 ^{+/- 14}

AMD EPYC 7F52 16-Core

53rd

3152 ^{+/- 6}

Intel Core i5-10600K

52nd

3277 ^{+/- 19}

Median

50th

3321

2 x AMD EPYC 7601 32-Core

50th

3331 ^{+/- 8}

AMD Ryzen 3 3300X 4-Core

49th

3380 ^{+/- 15}

AMD Ryzen 5 5500U

46th

3455 ^{+/- 24}

Intel Core i7-8700K

44th

3475 ^{+/- 12}

Intel Core i9-10980XE

44th

3490 ^{+/- 35}

AMD Ryzen 7 2700X Eight-Core

41st

3519 ^{+/- 31}

AMD Ryzen 7 2700 Eight-Core

38th

3655 ^{+/- 3}

AMD EPYC 7551 32-Core

37th

3674 ^{+/- 4}

AMD Ryzen 5 3400G

36th

3728 ^{+/- 9}

AMD EPYC 72F3 8-Core

34th

3793 ^{+/- 3}

2 x Intel Xeon Gold 5220R

33rd

3806 ^{+/- 18}

Intel Xeon Gold 6226R

31st

3956 ^{+/- 1}

2 x Intel Xeon Platinum 8280

31st

3962 ^{+/- 52}

Intel Core i7-4770K

30th

4026 ^{+/- 9}

Intel Xeon E3-1231 v3

28th

4081 ^{+/- 12}

2 x Intel Xeon Platinum 8380

27th

4124 ^{+/- 308}

Low-Tier

25th

> 4207

Intel Core i5-8400

25th

4253 ^{+/- 142}

Intel Core i7-10700T

25th

4255 ^{+/- 36}

Intel Xeon E3-1275 v6

25th

4257 ^{+/- 5}

Intel Core i7-1165G7

24th

4264 ^{+/- 182}

Intel Core i5-7600K

23rd

4290 ^{+/- 7}

Intel Core i7-1185G7

19th

4463 ^{+/- 117}

Intel Xeon E3-1270 v5

18th

4467 ^{+/- 26}

Intel Xeon E3-1280 v5

17th

4523 ^{+/- 5}

AMD Ryzen 5 4500U

16th

4544 ^{+/- 24}

Intel Core i7-3770K

15th

4565 ^{+/- 5}

Intel Xeon Silver 4216

13th

4738 ^{+/- 8}

Intel Core i7-2700K

12th

4873 ^{+/- 44}

Intel Core i3-8100

12th

4878 ^{+/- 1}

Intel Core i7-8550U

10th

4999 ^{+/- 7}

Intel Core i7-8565U

9th

5056 ^{+/- 96}

Intel Core i7-1065G7

9th

5280 ^{+/- 195}

Intel Core i3-7100

7th

5822 ^{+/- 11}

Intel Xeon E3-1235L v5

6th

6179 ^{+/- 5}

AMD Ryzen 3 3200U

6th

6188 ^{+/- 41}

AMD FX-8150 Eight-Core

4th

7748 ^{+/- 8}

Intel Core i5-6300U

3rd

8548 ^{+/- 10}

ARMv8 Cortex-A72 4-Core

1st

21542 ^{+/- 42}

Based on OpenBenchmarking.org data, the selected test / test configuration (TNN 0.3 - Target: CPU - Model: DenseNet) has an average run-time of 11 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

Does It Scale Well With Increasing Cores?

No, based on the automated analysis of the collected public benchmark data, this test / test settings does not generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set

Support

Instructions Detected

SSE2 (SSE2)

Used by default on supported hardware.

MOVDQA PUNPCKLQDQ MOVDQU CVTSS2SD MOVD CVTSI2SD ANDPD COMISD CVTSD2SS UCOMISD PSRLDQ ADDSD PSHUFD PMULUDQ DIVSD CVTTSD2SI MOVUPD CVTPD2PS MOVAPD MAXSD SUBSD XORPD CVTDQ2PS UNPCKLPD CVTTPS2DQ CVTPS2PD MULPD SUBPD ADDPD DIVPD SQRTSD MULSD CVTDQ2PD CMPLEPD ANDNPD ORPD CVTTPD2DQ MOVHPD

Advanced Vector Extensions (AVX)

Requires passing a supported compiler/build flag (verified with targets: sandybridge, skylake, tigerlake, cascadelake, znver2, znver3).
Found on Intel processors since Sandy Bridge (2011).
Found on AMD processors since Bulldozer (2011).

VZEROUPPER VEXTRACTF128 VINSERTF128 VPERM2F128 VPERMILPS VBROADCASTSS VMASKMOVPS VBROADCASTSD

Advanced Vector Extensions 2 (AVX2)

Requires passing a supported compiler/build flag (verified with targets: skylake, tigerlake, cascadelake, znver2, znver3).
Found on Intel processors since Haswell (2013).
Found on AMD processors since Excavator (2016).

VEXTRACTI128 VPERMD VPBROADCASTD VPERMQ VINSERTI128 VPBROADCASTW VPERM2I128 VPBROADCASTQ

FMA (FMA)

VFMADD231SS VFMADD132SS VFNMADD132SS VFMADD213SS VFNMADD132PD VFMADD132PD VFNMADD132SD VFMADD132SD VFNMADD132PS VFMADD132PS VFMADD213PS VFMADD231PS VFNMADD231SD VFMADD231PD VFMADD231SD VFMSUB213SS VFMSUB231SD VFNMSUB231SD VFNMSUB132SD VFMADD213SD

The test / benchmark does honor compiler flag changes.

Last automated analysis: 10 May 2021

This test profile binary relies on the shared libraries libTNN.so.0, libm.so.6, libpthread.so.0, libc.so.6, libgomp.so.1, libdl.so.2.

amd-epyc-rome 8 Systems - 364 Benchmark Results	2 x AMD EPYC 7742 64-Core - Supermicro H11DSi-NT v2.00 - AMD Starship Ubuntu 21.10 - 5.13.0-19-generic - GNOME Shell 40.5
EPYC 75F3 1 System - 495 Benchmark Results	AMD EPYC 75F3 32-Core - ASRockRack ROME2D16-2T - AMD Starship Ubuntu 21.10 - 5.13.0-19-generic - GNOME Shell 40.5
amd-epyc- 7742 Linux 3 Systems - 326 Benchmark Results	AMD EPYC 7742 64-Core - Supermicro H11DSi-NT v2.00 - AMD Starship Ubuntu 21.10 - 5.13.0-19-generic - GNOME Shell 40.5
AMD EPYC Rome 4 Systems - 318 Benchmark Results	AMD EPYC 7F52 16-Core - Supermicro H11DSi-NT v2.00 - AMD Starship Ubuntu 21.10 - 5.13.0-19-generic - GNOME Shell 40.5
Ubuntu 21.10 EPYC Milan 3 Systems - 210 Benchmark Results	AMD EPYC 74F3 24-Core - ASRockRack ROME2D16-2T - AMD Starship Ubuntu 21.04 - 5.11.0-37-generic - X Server
Ubuntu 21.10 EPYC Milan Featured Kernel Comparison	5.13.0-16-generic - 5.15.0-051500rc5daily20211011-generic
epyc 7601 october 2021 3 Systems - 185 Benchmark Results	2 x AMD EPYC 7601 32-Core - Dell 02MJ3T - AMD 17h Ubuntu 19.10 - 5.9.0-050900rc6daily20200922-generic - GNOME Shell 3.34.1
3600X Okt 2 Systems - 149 Benchmark Results	AMD Ryzen 5 3600XT 6-Core - MSI X470 GAMING M7 AC - AMD Starship Ubuntu 20.10 - 5.8.0-55-generic - GNOME Shell 3.38.1
3300X Oktober 3 Systems - 126 Benchmark Results	AMD Ryzen 3 3300X 4-Core - MSI B350M GAMING PRO - AMD Starship Ubuntu 20.04 - 5.9.0-rc5-14sep-patch - GNOME Shell 3.36.4
Xeon Platinum 8380 Linux Distro Performance 8 Systems - 111 Benchmark Results	2 x Intel Xeon Platinum 8380 - Intel M50CYP2SB2U - Intel Device 0998 CentOS Stream 8 - 4.18.0-338.el8.x86_64 - GNOME Shell 3.32.2
Xeon Platinum 8380 Linux Distro Performance 7 Systems - 110 Benchmark Results	2 x Intel Xeon Platinum 8380 - Intel M50CYP2SB2U - Intel Device 0998 Arch Linux - 5.14.9-arch2-1 - GCC 11.1.0
Xeon Platinum 8380 Fedora 6 Systems - 186 Benchmark Results	2 x Intel Xeon Platinum 8380 - Intel M50CYP2SB2U - Intel Device 0998 Arch Linux - 5.14.9-arch2-1 - GCC 11.1.0
Ryzen 9 5900HX AMD Ubuntu Linux 1 System - 130 Benchmark Results	AMD Ryzen 9 5900HX - ASUS G513QY v1.0 - AMD Renoir Root Complex Ubuntu 21.04 - 5.11.0-37-generic - GNOME Shell 3.38.4
Xeon Platinum 8380 Fedora 5 Systems - 186 Benchmark Results	2 x Intel Xeon Platinum 8380 - Intel M50CYP2SB2U - Intel Device 0998 Debian 11 - 5.10.0-8-amd64 - 1.0.2
Xeon Platinum 8380 Fedora 4 Systems - 186 Benchmark Results	2 x Intel Xeon Platinum 8380 - Intel M50CYP2SB2U - Intel Device 0998 Ubuntu 21.10 - 5.13.0-16-generic - GNOME Shell 40.5

WSL2 Windows 11 vs. Ubuntu Linux Benchmarks 4 Systems - 42 Benchmark Results	AMD Ryzen 9 5950X 16-Core - 32GB - 466GB Ubuntu 20.04 - 4.4.0-19041-Microsoft - GCC 9.3.0
Pop OS 21.04 2 Systems - 354 Benchmark Results	AMD Ryzen Threadripper 3990X 64-Core - Gigabyte TRX40 AORUS PRO WIFI - AMD Starship Pop 20.04 - 5.11.0-7620-generic - GNOME Shell 3.36.7
Ubuntu vs. Arch Linux On Ryzen 9 5900HX 4 Systems - 78 Benchmark Results	AMD Ryzen 9 5900HX - ASUS G513QY v1.0 - AMD Renoir Fedora 34 - 5.13.4-200.fc34.x86_64 - GNOME Shell 40.3
Ubuntu vs. Arch Linux On Ryzen 9 5900HX 2 Systems - 75 Benchmark Results	AMD Ryzen 9 5900HX - ASUS G513QY v1.0 - AMD Renoir Root Complex Arch Linux - 5.13.4-arch1-1 - GNOME Shell 40.3
Ubuntu vs. Arch Linux On Ryzen 9 5900HX 3 Systems - 78 Benchmark Results	AMD Ryzen 9 5900HX - ASUS G513QY v1.0 - AMD Renoir Root Complex Clear Linux OS 34860 - 5.12.16-1054.native - GNOME Shell 40.3
AMD Ryzen 9 5950X - Ubuntu 21.04 vs. Ubuntu 21.10 2 Systems - 115 Benchmark Results	AMD Ryzen 9 5950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 21.04 - 5.11.0-31-generic - GNOME Shell 3.38.4
nn gravity too 3 Systems - 34 Benchmark Results	Intel Xeon E-2288G - Compulab SBC-ATCFL v1.2 - Intel Cannon Lake PCH Ubuntu 20.10 - 5.8.0-41-generic - GNOME Shell 3.38.2
Linux Kernels Test On AMD Ryzen 5 5500U Featured Kernel Comparison	AMD Ryzen 5 5500U - LENOVO LNVNB161216 - AMD Renoir Root Complex Ubuntu 21.04 - 5.13.2-xanmod1-edge - GNOME Shell 3.38.4
10900k june 3 Systems - 89 Benchmark Results	Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH Ubuntu 20.04 - 5.9.0-050900daily20201012-generic - GNOME Shell 3.36.4
nn 4500u 3 Systems - 41 Benchmark Results	AMD Ryzen 5 4500U - LENOVO LNVNB161216 - AMD Renoir Root Complex Ubuntu 21.04 - 5.11.0-17-generic - GNOME Shell 3.38.4
tr 3970x eo june 3 Systems - 45 Benchmark Results	AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship Ubuntu 20.10 - 5.11.0-rc6-phx - GNOME Shell 3.38.1
AMD Ryzen 7 5700G Linux Benchmarks 2 Systems - 237 Benchmark Results	AMD Ryzen 7 5700G - ASUS TUF GAMING B550M-PLUS - AMD Renoir Root Complex Ubuntu 21.04 - 5.11.0-25-generic - GNOME Shell 3.38.4
Intel vs. Graviton2 Amazon EC2 Benchmarks 3 Systems - 24 Benchmark Results	2 x Intel Xeon Platinum 8259CL - Amazon EC2 m5.24xlarge - Intel 440FX 82441FX PMC Ubuntu 20.04 - 5.4.0-1045-aws - 1.0.2
Rocket Lake Microcode 2 Systems - 69 Benchmark Results	Intel Core i9-11900K - ASUS ROG MAXIMUS XIII HERO - Intel Tiger Lake-H Fedora 34 - 5.12.9-300.fc34.x86_64 - GNOME Shell 40.1
3770k june 3 Systems - 100 Benchmark Results	Intel Core i7-3770K - ECS Z77H2-A2X v1.0 - Intel Xeon E3-1200 v2 Ubuntu 20.04 - 5.8.0-55-generic - GNOME Shell 3.36.9

TNN

Project Site

Test Created

Last Updated

Test Maintainer

Test Type

Average Install Time

Average Run Time

Test Dependencies

Accolades

Supported Platforms

Revision History

Suites Using This Test

Performance Metrics

TNN 0.3

Target: CPU - Model: DenseNet

Does It Scale Well With Increasing Cores?

Notable Instruction Set Usage

Recent Test Results

Most Popular Test Results