TNN

TNN is an open-source deep learning reasoning framework developed by Tencent.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark tnn.

Project Site

github.com

Test Created

24 September 2020

Last Updated

11 January 2021

Test Maintainer

Michael Larabel

Test Type

System

Average Install Time

52 Seconds

Average Run Time

1 Minute, 29 Seconds

Test Dependencies

CMake + C/C++ Compiler Toolchain

Supported Platforms

* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
*** Test profile page view reporting began March 2021.
Data current as of 15 June 2021.

Revision History

pts/tnn-1.0.1 [View Source] Mon, 11 Jan 2021 13:15:50 GMT
Update download mirror as the GitHub URL changed its checksums...

pts/tnn-1.0.0 [View Source] Thu, 24 Sep 2020 18:33:29 GMT
Initial commit of Tencent TNN framework.

Suites Using This Test

Machine Learning

HPC - High Performance Computing

Performance Metrics

Analyze Test Configuration:

TNN 0.2.3

Target: CPU - Model: SqueezeNet v1.1

OpenBenchmarking.org metrics for this test profile configuration based on 1,168 public results since 24 September 2020 with the latest data as of 13 June 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component

Percentile Rank

# Compatible Public Results

ms (Average)

AMD Ryzen 9 5950X 16-Core

96th

211 ^{+/- 4}

AMD Ryzen 9 5900X 12-Core

96th

211 ^{+/- 3}

AMD Ryzen 7 5800X 8-Core

95th

212 ^{+/- 2}

AMD Ryzen 5 5600X 6-Core

90th

218 ^{+/- 3}

AMD Ryzen 9 3900XT 12-Core

87th

230 ^{+/- 4}

AMD Ryzen 7 3800XT 8-Core

87th

230 ^{+/- 4}

AMD Ryzen 5 3600XT 6-Core

85th

234 ^{+/- 3}

AMD Ryzen Threadripper 3970X 32-Core

84th

235 ^{+/- 4}

AMD Ryzen 9 3950X 16-Core

82nd

238 ^{+/- 5}

AMD Ryzen 5 3600X 6-Core

81st

240

AMD Ryzen Threadripper 3960X 24-Core

81st

240 ^{+/- 3}

AMD Ryzen 9 3900X 12-Core

81st

240 ^{+/- 14}

AMD Ryzen Threadripper 2950X 16-Core

79th

243 ^{+/- 1}

AMD Ryzen 3 3300X 4-Core

79th

243 ^{+/- 3}

AMD Ryzen 7 3700X 8-Core

79th

243 ^{+/- 6}

AMD EPYC 72F3 8-Core

78th

244 ^{+/- 2}

AMD Ryzen Threadripper 3990X 64-Core

78th

245 ^{+/- 4}

AMD Ryzen 7 4700U

78th

245

Intel Core i9-11900K

77th

246 ^{+/- 14}

AMD Ryzen 7 2700X Eight-Core

77th

249 ^{+/- 1}

Intel Core i7-4790K

76th

251

AMD Ryzen Threadripper 2990WX 32-Core

76th

251

Mid-Tier

75th

> 252

2 x AMD EPYC 73F3 16-Core

74th

254

2 x AMD EPYC 75F3 32-Core

74th

254 ^{+/- 3}

AMD EPYC 73F3 16-Core

74th

254

AMD EPYC 74F3 24-Core

73rd

255

AMD EPYC 75F3 32-Core

73rd

255 ^{+/- 1}

AMD Ryzen 5 4500U

72nd

256 ^{+/- 1}

AMD Ryzen 5 2600X Six-Core

70th

260 ^{+/- 1}

AMD Ryzen 3 3100 4-Core

70th

260

Intel Core i9-10900K

67th

261 ^{+/- 1}

AMD Ryzen Threadripper 2970WX 24-Core

67th

261 ^{+/- 3}

AMD Ryzen 5 3400G

66th

262

AMD EPYC 7F32 8-Core

65th

263 ^{+/- 1}

AMD EPYC 7F52 16-Core

65th

263 ^{+/- 3}

AMD Ryzen 7 1800X Eight-Core

65th

263 ^{+/- 3}

Intel Core i5-11600K

63rd

266 ^{+/- 1}

AMD Ryzen 7 2700 Eight-Core

62nd

267

Ampere Altra ARMv8 Neoverse-N1 160-Core

61st

268 ^{+/- 13}

Intel Core i9-9900K

61st

268

Intel Core i9-10885H

61st

268 ^{+/- 5}

Intel Core i9-9900KS

59th

269 ^{+/- 1}

Intel Xeon E-2288G

59th

269

Intel Core i7-8086K

59th

270 ^{+/- 2}

2 x AMD EPYC 7F72 24-Core

57th

274

AMD Ryzen 5 2400G

56th

275 ^{+/- 1}

AMD EPYC 7F72 24-Core

54th

277 ^{+/- 1}

AMD Ryzen 5 2600 Six-Core

54th

278

Intel Core i5-10600K

53rd

279 ^{+/- 1}

2 x AMD EPYC 7513 32-Core

51st

281

Intel Core i9-10980XE

51st

282 ^{+/- 3}

Median

50th

283

AMD Ryzen 3 1300X

49th

285 ^{+/- 1}

Intel Xeon E3-1231 v3

49th

285

Intel Core i7-8700K

48th

286 ^{+/- 2}

AMD Ryzen 3 2200G

47th

288 ^{+/- 1}

Intel Core i7-5775C

47th

289 ^{+/- 2}

Intel Core i5-4670

46th

290

Intel Core i7-7740K

45th

294

Intel Core i7-7900X

45th

296

2 x AMD EPYC 7763 64-Core

45th

296

Intel Xeon E5-1680 v3

45th

296

Intel Core i7-6800K

43rd

298 ^{+/- 4}

Intel Core i7-7700K

43rd

299 ^{+/- 2}

Intel Core i7-9750H

41st

301 ^{+/- 1}

AMD Ryzen 7 1700 Eight-Core

41st

301 ^{+/- 16}

AMD EPYC 7542 32-Core

41st

301 ^{+/- 4}

AMD EPYC 7262 8-Core

41st

302

2 x AMD EPYC 7742 64-Core

40th

303 ^{+/- 4}

AMD EPYC 7452 32-Core

38th

304

AMD EPYC 7402P 24-Core

37th

305 ^{+/- 4}

AMD EPYC 7502P 32-Core

37th

305 ^{+/- 4}

AMD EPYC 7702 64-Core

37th

305 ^{+/- 3}

AMD EPYC 7502 32-Core

37th

306 ^{+/- 3}

Intel Core i7-4770K

37th

306 ^{+/- 44}

Intel Core i7-4960X

36th

308 ^{+/- 8}

AMD Ryzen 3 3200U

35th

309 ^{+/- 3}

AMD EPYC 7532 32-Core

34th

310 ^{+/- 4}

AMD EPYC 7552 48-Core

34th

310 ^{+/- 4}

AMD EPYC 7662 64-Core

34th

310 ^{+/- 4}

AMD EPYC 7642 48-Core

34th

311 ^{+/- 4}

AMD EPYC 7302P 16-Core

34th

311 ^{+/- 4}

Intel Core i9-7980XE

33rd

313 ^{+/- 7}

Intel Core i3-10100

33rd

313

Intel Core i7-3770K

32nd

316 ^{+/- 1}

AMD EPYC 7282 16-Core

31st

319 ^{+/- 5}

AMD EPYC 7252 8-Core

29th

320

Intel Core i7-5960X

29th

320

AMD EPYC 7272 12-Core

28th

321 ^{+/- 5}

AMD EPYC 7232P 8-Core

28th

321 ^{+/- 3}

Intel Core i5-7600K

28th

322 ^{+/- 2}

Intel Core i7-8565U

28th

322 ^{+/- 2}

Intel Xeon E3-1275 v6

28th

322 ^{+/- 3}

AMD EPYC 7352 24-Core

28th

323

Intel Core i7-1065G7

26th

325 ^{+/- 4}

Low-Tier

25th

> 326

Intel Core i7-2700K

25th

326 ^{+/- 1}

Intel Core i5-3470

25th

326 ^{+/- 1}

Intel Xeon E5-2687W v3

24th

328 ^{+/- 1}

Intel Core i5-2500K

23rd

330 ^{+/- 1}

Intel Core i5-9400F

23rd

330

2 x Intel Xeon Platinum 8280

22nd

333 ^{+/- 6}

2 x AMD EPYC 7601 32-Core

22nd

335 ^{+/- 3}

Intel Core i7-8550U

21st

336

Intel Core i7-4558U

20th

337 ^{+/- 3}

Intel Xeon Silver 4215R

20th

337

Intel Core i5-8400

19th

339 ^{+/- 2}

AMD EPYC 7601 32-Core

18th

340 ^{+/- 1}

Intel Xeon E3-1270 v5

18th

341 ^{+/- 8}

Intel Xeon E3-1280 v5

18th

341 ^{+/- 2}

Intel Xeon E-2278GEL

17th

343

Intel Xeon Gold 5218

15th

345

Intel Core i3-7100

15th

345 ^{+/- 2}

Intel Core i7-5600U

15th

346 ^{+/- 4}

2 x Intel Xeon Gold 5220R

14th

348 ^{+/- 2}

Intel Xeon E3-1245 v5

14th

348 ^{+/- 2}

AMD EPYC 7551 32-Core

14th

348

Intel Xeon Gold 6226R

13th

350 ^{+/- 7}

Intel Xeon E3-1240 v5

13th

351 ^{+/- 1}

Intel Xeon E3-1260L v5

13th

355 ^{+/- 10}

Intel Core i7-10700T

11th

360

Intel Core i7-9700TE

11th

362

Intel Xeon Gold 5217

11th

363

2 x Intel Xeon Platinum 8380

9th

371 ^{+/- 12}

Intel Core i3-8100

9th

374 ^{+/- 2}

Intel Core i5-6500

9th

376 ^{+/- 2}

Intel Core i3-4130

8th

378 ^{+/- 3}

Intel Xeon Silver 4214R

8th

384

Intel Core i7-6700HQ

7th

390 ^{+/- 2}

Intel Core i5-2520M

7th

395

Intel Xeon Silver 4216

6th

420 ^{+/- 1}

Intel Xeon E3-1235L v5

5th

454

AMD FX-8370 Eight-Core

5th

514 ^{+/- 1}

AMD FX-8150 Eight-Core

4th

548 ^{+/- 8}

AMD A10-7850K APU

4th

555 ^{+/- 4}

POWER9 44-Core

3rd

612

POWER9 4-Core

3rd

612

Intel Xeon E5-2609 v4

2nd

641 ^{+/- 1}

Ampere eMAG ARMv8 32-Core

2nd

969 ^{+/- 11}

ARMv8 Cortex-A72 4-Core

1st

1189 ^{+/- 97}

Based on OpenBenchmarking.org data, the selected test / test configuration (TNN 0.2.3 - Target: CPU - Model: SqueezeNet v1.1) has an average run-time of 2 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

Does It Scale Well With Increasing Cores?

No, based on the automated analysis of the collected public benchmark data, this test / test settings does not generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set

Support

Instructions Detected

SSE2 (SSE2)

Used by default on supported hardware.

MOVDQA PUNPCKLQDQ MOVDQU CVTSS2SD MOVD CVTSI2SD ANDPD COMISD CVTSD2SS UCOMISD PSRLDQ ADDSD PSHUFD PMULUDQ DIVSD CVTTSD2SI MOVUPD CVTPD2PS MOVAPD MAXSD SUBSD XORPD CVTDQ2PS UNPCKLPD CVTTPS2DQ CVTPS2PD MULPD SUBPD ADDPD DIVPD SQRTSD MULSD CVTDQ2PD CMPLEPD ANDNPD ORPD CVTTPD2DQ MOVHPD

Advanced Vector Extensions (AVX)

Requires passing a supported compiler/build flag (verified with targets: sandybridge, skylake, tigerlake, cascadelake, znver2, znver3).
Found on Intel processors since Sandy Bridge (2011).
Found on AMD processors since Bulldozer (2011).

VZEROUPPER VEXTRACTF128 VINSERTF128 VPERM2F128 VPERMILPS VBROADCASTSS VMASKMOVPS VBROADCASTSD

Advanced Vector Extensions 2 (AVX2)

Requires passing a supported compiler/build flag (verified with targets: skylake, tigerlake, cascadelake, znver2, znver3).
Found on Intel processors since Haswell (2013).
Found on AMD processors since Excavator (2016).

VEXTRACTI128 VPERMD VPBROADCASTD VPERMQ VINSERTI128 VPBROADCASTW VPERM2I128 VPBROADCASTQ

FMA (FMA)

VFMADD231SS VFMADD132SS VFNMADD132SS VFMADD213SS VFNMADD132PD VFMADD132PD VFNMADD132SD VFMADD132SD VFNMADD132PS VFMADD132PS VFMADD213PS VFMADD231PS VFNMADD231SD VFMADD231PD VFMADD231SD VFMSUB213SS VFMSUB231SD VFNMSUB231SD VFNMSUB132SD VFMADD213SD

The test / benchmark does honor compiler flag changes.

Last automated analysis: 10 May 2021

This test profile binary relies on the shared libraries libTNN.so.0, libm.so.6, libpthread.so.0, libc.so.6, libgomp.so.1, libdl.so.2.

Compiler Optimization Levels 2 Systems - 118 Benchmark Results	Intel Core i9-11900K - ASUS ROG MAXIMUS XIII HERO - Intel Tiger Lake-H Fedora 34 - 5.12.9-300.fc34.x86_64 - GNOME Shell 40.1
Raspberry Pi 400 5 Systems - 148 Benchmark Results	SiFive RISC-V - BeagleV Starlight Beta - 8GB Fedora 33 - 5.13.0-rc3-starlight-307480-g8c24396a867e - Xfce
Intel Core i5 11600K + Core i9 11900K Linux Performance 11 Systems - 454 Benchmark Results	AMD Ryzen 7 5800X 8-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 21.04 - 5.12.0-051200rc3daily20210315-generic - GNOME Shell 3.38.3
GCC 11 vs. LLVM Clang 12 Benchmarks On Xeon Ice Lake Featured Compiler Comparison	GCC 11.1.1 20210428 - Clang 12.0.0
tnnresults 1 System - 2 Benchmark Results	Intel Core i7-7700HQ - Oracle VirtualBox v1.2 - Intel 440FX 82441FX PMC CentOS Linux 8 - 4.18.0-193.el8.x86_64 - xfs
tnnresults 1 System - 2 Benchmark Results	Intel Core i7-7700HQ - Oracle VirtualBox v1.2 - Intel 440FX 82441FX PMC Ubuntu 20.04 - 5.4.0-72-generic - GCC 9.3.0
Ubuntu 21.04 Laptops 5 Systems - 190 Benchmark Results	Intel Core i7-1165G7 - Dell 0GG9PT - Intel Tiger Lake-LP Ubuntu 21.04 - 5.11.0-17-generic - GNOME Shell 3.38.4
bench1 1 System - 2 Benchmark Results	AMD Ryzen 7 3700X 8-Core - Oracle VirtualBox v1.2 - Intel 440FX 82441FX PMC CentOS Linux 8 - 4.18.0-193.el8.x86_64 - xfs
bench3 1 System - 2 Benchmark Results	AMD Ryzen 7 3700X 8-Core - Oracle VirtualBox v1.2 - Intel 440FX 82441FX PMC Ubuntu 20.04 - 5.4.0-70-generic - GCC 9.3.0
Ubuntu 21.04 Laptops 4 Systems - 178 Benchmark Results	AMD Ryzen 5 4500U - LENOVO LNVNB161216 - AMD Renoir Root Complex Ubuntu 21.04 - 5.11.0-17-generic - GNOME Shell 3.38.4
Ubuntu 21.04 Laptops 4 Systems - 178 Benchmark Results	Intel Core i7-1065G7 - Dell 06CDVY - Intel Ice Lake-LP DRAM Ubuntu 21.04 - 5.11.0-17-generic - GNOME Shell 3.38.4
Ubuntu 21.04 Laptops 3 Systems - 218 Benchmark Results	AMD Ryzen 5 4500U - LENOVO LNVNB161216 - AMD Renoir Root Complex Ubuntu 21.04 - 5.11.0-17-generic - GNOME Shell 3.38.4

Sandy 3 Systems - 268 Benchmark Results	Intel Core i5-2520M - HP 161C - Intel 2nd Generation Core DRAM Ubuntu 18.04 - 4.18.0-20-generic - GNOME Shell 3.28.3
Renoir vs. Icelake Benchmarks 2 Systems - 535 Benchmark Results	Intel Core i7-1065G7 - Dell 06CDVY - Intel Device 34ef Ubuntu 20.04 - 5.9.0-050900rc7daily20201003-generic - GNOME Shell 3.36.4
Ryzen 9 5900X / Ryzen 9 5950X Linux Performance 11 Systems - 217 Benchmark Results	Intel Core i5-10600K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4
Ubuntu 20.10 Kernels AMD Zen 3 6 Systems - 143 Benchmark Results	AMD Ryzen 9 5900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 20.10 - 5.10.7-051007-generic - GNOME Shell 3.38.1
Xeon Gold 5220R 2P 2021 3 Systems - 32 Benchmark Results	2 x Intel Xeon Gold 5220R - TYAN S7106 - Intel Sky Lake-E DMI3 Registers Ubuntu 20.04 - 5.9.0-050900rc6-generic - GNOME Shell 3.36.4
Fedora 32 vs. Fedora 33 Beta Benchmarks 3 Systems - 174 Benchmark Results	Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH Fedora 32 - 5.8.11-200.fc32.x86_64 - GNOME Shell 3.36.6
7980XE Feb 2921 5 Systems - 89 Benchmark Results	Intel Core i9-7980XE - ASUS PRIME X299-A - Intel Sky Lake-E DMI3 Registers Ubuntu 20.10 - 5.8.0-36-generic - GNOME Shell 3.38.1
3770K 2021 3 Systems - 108 Benchmark Results	Intel Core i7-3770K - ECS Z77H2-A2X v1.0 - Intel Xeon E3-1200 v2 Ubuntu 20.04 - 5.4.0-58-generic - GNOME Shell 3.36.4
Ryzen 5 3600XT 2021 AMD 4 Systems - 62 Benchmark Results	AMD Ryzen 5 3600XT 6-Core - MSI X470 GAMING M7 AC - AMD Starship Ubuntu 20.10 - 5.8.0-28-generic - GNOME Shell 3.38.1
Ryzen 5 5600X Linux Performance 12 Systems - 229 Benchmark Results	Intel Core i5-10600K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4
7700K Mon 3 Systems - 31 Benchmark Results	Intel Core i7-7700K - MSI Z270-A PRO - Intel Xeon E3-1200 v6 Ubuntu 20.04 - 5.9.0-050900rc8daily20201011-generic - X Server 1.20.8
5775C Broadwell 2021 3 Systems - 37 Benchmark Results	Intel Core i7-5775C - MSI Z97-G45 GAMING - Intel Broadwell-U DMI Ubuntu 18.10 - 5.0.0-999-generic - GNOME Shell 3.30.2

TNN

Project Site

Test Created

Last Updated

Test Maintainer

Test Type

Average Install Time

Average Run Time

Test Dependencies

Supported Platforms

Revision History

Suites Using This Test

Performance Metrics

TNN 0.2.3

Target: CPU - Model: SqueezeNet v1.1

Does It Scale Well With Increasing Cores?

Notable Instruction Set Usage

Recent Test Results

Most Popular Test Results