TensorFlow Lite

This is a benchmark of the TensorFlow Lite implementation. The current Linux support is limited to running on CPUs. This test profile is measuring the average inference time.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark tensorflow-lite.

Project Site

tensorflow.org

Test Created

23 August 2020

Last Updated

23 August 2020

Test Maintainer

Michael Larabel

Test Type

System

Average Install Time

9 Seconds

Average Run Time

4 Minutes, 44 Seconds

Supported Platforms

* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data current as of Fri, 26 Feb 2021 12:49:57 GMT.

Revision History

pts/tensorflow-lite-1.0.0 [View Source] Sun, 23 Aug 2020 14:13:10 GMT
TensorFlow Lite initial commit.

Suites Using This Test

Machine Learning

HPC - High Performance Computing

Performance Metrics

Analyze Test Configuration:

TensorFlow Lite 2020-08-23

Model: Inception V4

OpenBenchmarking.org metrics for this test profile configuration based on 862 public results since 23 August 2020 with the latest data as of 24 February 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component

Percentile Rank

# Matching Public Results

Microseconds (Average)

2 x AMD EPYC 7742 64-Core

100th

642483 ^{+/- 93685}

AMD Ryzen Threadripper 3990X 64-Core

99th

702509 ^{+/- 25703}

AMD Ryzen Threadripper 3970X 32-Core

97th

808868 ^{+/- 46592}

2 x AMD EPYC 7F72 24-Core

95th

837153 ^{+/- 26938}

AMD EPYC 7662 64-Core

95th

843892 ^{+/- 97728}

AMD EPYC 7702 64-Core

92nd

928155 ^{+/- 81159}

AMD EPYC 7742 64-Core

92nd

939558 ^{+/- 123052}

AMD EPYC 7542 32-Core

91st

953713 ^{+/- 5861}

AMD EPYC 7642 48-Core

90th

964418 ^{+/- 17575}

AMD EPYC 7502P 32-Core

87th

1012771 ^{+/- 4208}

AMD EPYC 7552 48-Core

87th

1016970 ^{+/- 26056}

AMD EPYC 7502 32-Core

86th

1018660

2 x AMD EPYC 7282 16-Core

84th

1062883 ^{+/- 9744}

AMD EPYC 7532 32-Core

84th

1078691 ^{+/- 30279}

2 x AMD EPYC 7601 32-Core

83rd

1091599 ^{+/- 32213}

2 x Intel Xeon Platinum 8280

83rd

1091624 ^{+/- 74485}

AMD EPYC 7452 32-Core

83rd

1098850

AMD Ryzen Threadripper 3960X 24-Core

81st

1136995 ^{+/- 1699}

2 x Intel Xeon Gold 5220R

80th

1267651 ^{+/- 3250}

AMD EPYC 7601 32-Core

79th

1301404 ^{+/- 1089}

AMD EPYC 7F72 24-Core

79th

1323553 ^{+/- 16184}

AMD EPYC 7551 32-Core

78th

1337462 ^{+/- 11159}

Mid-Tier

75th

> 1346957

AMD Ryzen 9 5950X 16-Core

75th

1349681 ^{+/- 8115}

AMD EPYC 7402P 24-Core

72nd

1394181 ^{+/- 33012}

AMD Ryzen 9 3950X 16-Core

71st

1450834 ^{+/- 20299}

AMD EPYC 7F52 16-Core

69th

1501519 ^{+/- 3477}

2 x AMD EPYC 7272 12-Core

68th

1513658 ^{+/- 9274}

Intel Xeon Platinum 8280

68th

1553774 ^{+/- 19410}

AMD EPYC 7352 24-Core

67th

1651693

AMD EPYC 7302P 16-Core

66th

1744999 ^{+/- 5566}

2 x AMD EPYC 7262 8-Core

65th

1760707 ^{+/- 423}

AMD Ryzen 9 5900X 12-Core

63rd

1788370 ^{+/- 6831}

AMD EPYC 7282 16-Core

60th

1818832 ^{+/- 903}

Intel Core i9-10980XE

59th

1853381 ^{+/- 4345}

2 x AMD EPYC 7252 8-Core

58th

1859435 ^{+/- 323}

AMD Ryzen 9 3900XT 12-Core

55th

1993321 ^{+/- 120555}

Intel Xeon Gold 6226R

55th

2001020

AMD Ryzen 9 3900X 12-Core

54th

2007173 ^{+/- 8923}

Intel Core i9-10900K

52nd

2375080 ^{+/- 2802}

Median

50th

2379217

AMD Ryzen 7 5800X 8-Core

50th

2478724 ^{+/- 67692}

AMD EPYC 7272 12-Core

50th

2522157 ^{+/- 25935}

Intel Xeon Gold 5218

49th

2564657

AMD Ryzen 7 3800XT 8-Core

48th

2642372 ^{+/- 33013}

Intel Xeon Silver 4216

47th

2661069 ^{+/- 1826}

Intel Core i7-7900X

45th

2833567 ^{+/- 2924}

AMD EPYC 7F32 8-Core

44th

2926770 ^{+/- 61822}

AMD Ryzen 7 3700X 8-Core

44th

2945565 ^{+/- 425896}

AMD Ryzen 7 1800X Eight-Core

41st

3276896 ^{+/- 257101}

AMD Ryzen 5 5600X 6-Core

41st

3294265 ^{+/- 28269}

Intel Xeon E-2288G

41st

3300646 ^{+/- 87576}

AMD Ryzen 7 2700 Eight-Core

40th

3336966 ^{+/- 60324}

Intel Xeon Silver 4214R

40th

3390153

AMD EPYC 7262 8-Core

40th

3449200

AMD EPYC 7232P 8-Core

39th

3474556 ^{+/- 6813}

Intel Xeon E5-2687W v3

37th

3622617 ^{+/- 2512}

AMD EPYC 7252 8-Core

36th

3658017

AMD Ryzen 7 4700U

36th

3661980

AMD Ryzen 5 3600X 6-Core

35th

3713107

AMD Ryzen 5 3600XT 6-Core

35th

3755293 ^{+/- 15369}

AMD Ryzen 7 1700 Eight-Core

35th

3781791 ^{+/- 225796}

AMD Ryzen 5 2600X Six-Core

34th

3826542 ^{+/- 9266}

Intel Xeon Silver 4215R

34th

3951900

Intel Core i7-8086K

33rd

4177253 ^{+/- 958}

Intel Xeon Gold 5217

33rd

4178070

Intel Core i7-8700K

32nd

4180822 ^{+/- 3737}

Intel Core i7-5960X

31st

4293005 ^{+/- 83}

Intel Core i5-10600K

30th

4351155 ^{+/- 3520}

Intel Xeon E-2278GEL

29th

4382592 ^{+/- 18386}

Intel Core i5-9400F

29th

4508289 ^{+/- 101}

AMD Ryzen 5 4500U

29th

4609940 ^{+/- 213154}

Intel Core i5-8400

29th

4614180 ^{+/- 249}

Intel Core i9-10885H

27th

4891576 ^{+/- 670870}

Intel Core i7-10700T

26th

5162842 ^{+/- 37359}

Low-Tier

25th

> 5203603

AMD Ryzen 3 3300X 4-Core

25th

5278125 ^{+/- 1884}

Intel Core i7-6800K

23rd

5442567 ^{+/- 32231}

Intel Core i7-4960X

23rd

5522806 ^{+/- 31927}

AMD Ryzen 3 3100 4-Core

22nd

5573186 ^{+/- 1449}

Intel Core i7-9750H

22nd

5653801 ^{+/- 292314}

Intel Core i7-7700K

22nd

5748968 ^{+/- 566}

Intel Core i7-7740K

21st

5758377 ^{+/- 384}

AMD Ryzen 5 3400G

21st

5785801 ^{+/- 15088}

Intel Core i7-9700TE

20th

5956926 ^{+/- 108509}

AMD Ryzen 3 1300X

20th

5972134 ^{+/- 13379}

AMD Ryzen 5 2400G

19th

6420592 ^{+/- 84632}

Intel Core i5-7600K

19th

6467311 ^{+/- 629}

Intel Xeon E3-1275 v6

18th

6490153 ^{+/- 11453}

Intel Xeon E3-1270 v5

18th

6832660 ^{+/- 679}

Intel Core i3-10100

17th

6894610 ^{+/- 1092}

Intel Core i7-4790K

17th

6924027 ^{+/- 10096}

Intel Xeon E3-1280 v5

17th

7025878 ^{+/- 25406}

Intel Core i3-8100

16th

7167092 ^{+/- 714}

Intel Xeon E3-1245 v5

16th

7203782 ^{+/- 760}

AMD FX-8370 Eight-Core

15th

7346190 ^{+/- 2925}

Intel Xeon E3-1260L v5

15th

7780924 ^{+/- 7562}

Intel Core i5-4670

15th

7807922 ^{+/- 893}

Intel Core i7-5775C

14th

7820482 ^{+/- 12835}

Intel Core i7-4770K

13th

7994576 ^{+/- 8535}

Intel Core i7-1165G7

12th

8101477 ^{+/- 364988}

Intel Xeon E5-2609 v4

11th

8293764 ^{+/- 3127}

Intel Core i7-6700HQ

10th

8372534 ^{+/- 1682}

AMD FX-8150 Eight-Core

9th

8575365 ^{+/- 28108}

Intel Core i5-2500K

7th

9377187 ^{+/- 336}

Intel Core i7-1065G7

7th

9442529 ^{+/- 379360}

Intel Xeon E3-1235L v5

7th

9554590 ^{+/- 2649}

Intel Core i5-3470

6th

10007035 ^{+/- 85830}

Intel Core i7-8550U

6th

10027546 ^{+/- 724872}

Intel Core i7-8565U

5th

10339239 ^{+/- 631305}

Intel Core i3-7100

4th

13230678 ^{+/- 805}

AMD Ryzen 3 3200U

4th

14680022 ^{+/- 88498}

Intel Core i3-4130

3rd

16580844 ^{+/- 6996}

Intel Core i7-4558U

2nd

17609975 ^{+/- 5034}

Intel Core 2 Quad Q8300

2nd

17668280 ^{+/- 497696}

Intel Core i7-5600U

2nd

19554807 ^{+/- 24764}

Intel Core i5-5300U

1st

20841444 ^{+/- 11702}

Intel Core i5-2520M

1st

21619078 ^{+/- 8720}

Based on OpenBenchmarking.org data, the selected test / test configuration (TensorFlow Lite 2020-08-23 - Model: Inception V4) has an average run-time of 6 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.1%.

Does It Scale Well With Increasing Cores?

Yes, based on the automated analysis of the collected public benchmark data, this test / test settings does generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set

Support

Instructions Detected

SSE2 (SSE2)

Used by default on supported hardware.

MOVDQA PMULUDQ PSHUFD PSRLDQ MOVD CVTSI2SD ADDSD MULSD SUBSD DIVSD MOVAPD CVTSS2SD CVTTSD2SI SQRTSD UCOMISD XORPD CVTSD2SS CVTTPS2DQ CVTDQ2PS PADDQ MOVDQU PUNPCKLQDQ UNPCKLPD CVTDQ2PD MULPD CVTPD2PS ANDPD MAXSD PSUBQ CVTPS2PD MINSD MOVUPD UNPCKHPD ADDPD PUNPCKHQDQ CVTPS2DQ

Advanced Vector Extensions (AVX)

Used by default on supported hardware.
Found on Intel processors since Sandy Bridge (2011).
Found on AMD processors since Bulldozer (2011).

VBROADCASTF128 VZEROUPPER VMASKMOVPS VEXTRACTF128 VBROADCASTSS VINSERTF128 VPERMILPS

FMA (FMA)

Used by default on supported hardware.
Found on Intel processors since Haswell (2013).
Found on AMD processors since Bulldozer (2011).

VFMADD132PS VFMADD231PS VFMADD213PS

Last automated analysis: 31 January 2021

This test profile binary relies on the shared libraries libm.so.6, libpthread.so.0, libdl.so.2, librt.so.1, libc.so.6.

5900X LInux 5.12 Test 2 Systems - 95 Benchmark Results	AMD Ryzen 9 5900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 20.10 - 5.11.0-051100-generic - GNOME Shell 3.38.1
Intel Tiger Lake Mitigation COmparison 10 Systems - 47 Benchmark Results	Intel Core i7-1165G7 - LENOVO LNVNB161216 - Intel Tiger Lake-LP ManjaroLinux 20.2.1 - 5.11.1-1-MANJARO - GNOME Shell 3.38.3
Intel Tiger Lake Mitigation COmparison 9 Systems - 47 Benchmark Results	Intel Core i7-1165G7 - Dell 0GG9PT - Intel Tiger Lake-LP Ubuntu 20.10 - 5.8.0-31-generic - GNOME Shell 3.38.1
HP ZBook Studio G7 Ubuntu 20.10 2 Systems - 243 Benchmark Results	Intel Core i9-10885H - HP 8736 - Intel Comet Lake PCH Ubuntu 20.10 - 5.8.0-43-generic - GNOME Shell 3.38.2
HP ZBook Studio G7 Ubuntu 20.10 1 System - 238 Benchmark Results	Intel Core i9-10885H - HP 8736 - Intel Comet Lake PCH Ubuntu 20.10 - 5.8.0-43-generic - GNOME Shell 3.38.2
Core i7 10700T Garage 3 Systems - 108 Benchmark Results	Intel Core i7-10700T - Logic Supply RXM-181 - Intel Comet Lake PCH Ubuntu 20.10 - 5.8.0-43-generic - GNOME Shell 3.38.2
OnLogic Helix 500 Core i7 10700T 2 Systems - 86 Benchmark Results	Intel Core i7-10700T - Logic Supply RXM-181 - Intel Comet Lake PCH Ubuntu 20.10 - 5.8.0-43-generic - GNOME Shell 3.38.2
Ubuntu 20.04 Performance 1 System - 2 Benchmark Results	AMD EPYC 7542 32-Core - UpCloud Cloud Server - Intel 440FX 82441FX PMC Ubuntu 20.04 - 5.4.0-58-generic - bochs-drmdrmfb
SalientOS 5 Systems - 118 Benchmark Results	AMD Ryzen 9 5900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Fedora 33 - 5.10.13-200.fc33.x86_64 - GNOME Shell 3.38.3
SalientOS 4 Systems - 114 Benchmark Results	AMD Ryzen 9 5900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Clear Linux OS 34220 - 5.10.10-1017.native - GNOME Shell 3.38.3
SalientOS 3 Systems - 113 Benchmark Results	AMD Ryzen 9 5900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship salientos rolling - 5.10.14-arch1-1 - Xfce 4.16
SalientOS 2 Systems - 113 Benchmark Results	AMD Ryzen 9 5900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship salientos rolling - 5.10.14-arch1-1 - Xfce 4.16

Sandy 3 Systems - 268 Benchmark Results	Intel Core i5-2520M - HP 161C - Intel 2nd Generation Core DRAM Ubuntu 18.04 - 4.18.0-20-generic - GNOME Shell 3.28.3
Renoir vs. Icelake Benchmarks 2 Systems - 535 Benchmark Results	AMD Ryzen 5 4500U - LENOVO LNVNB161216 - AMD Renoir Root Complex Ubuntu 20.04 - 5.9.0-050900rc7daily20201002-generic - GNOME Shell 3.36.4
Ryzen 9 5900X / Ryzen 9 5950X Linux Performance 11 Systems - 217 Benchmark Results	AMD Ryzen 5 3600X 6-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4
Fedora 32 vs. Fedora 33 Beta Benchmarks 3 Systems - 174 Benchmark Results	Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH Fedora 32 - 5.8.11-200.fc32.x86_64 - GNOME Shell 3.36.6
Core i9 10900K - Ubuntu 20.04 LTS vs. Ubuntu 20.10 2 Systems - 403 Benchmark Results	Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH Ubuntu 20.10 - 5.8.0-22-generic - GNOME Shell 3.38.0
Ryzen 7 3800XT New Tests End Of August 3 Systems - 11 Benchmark Results	AMD Ryzen 7 3800XT 8-Core - ASRock X570 Pro4 - AMD Starship Ubuntu 20.04 - 5.4.0-42-generic - GNOME Shell 3.36.1
Ryzen 9 3900XT Ubuntu 20.04 LTS vs. Ubuntu 20.10 3 Systems - 406 Benchmark Results	AMD Ryzen 9 3900XT 12-Core - MSI MEG X570 GODLIKE - AMD Starship Ubuntu 20.04 - 5.4.0-48-generic - GNOME Shell 3.36.4
Core i5 9400F Linux 5.9 Kernel Featured Kernel Comparison	Intel Core i5-9400F - MSI B360M GAMING PLUS - Intel Cannon Lake PCH Ubuntu 20.04 - 5.4.0-21-generic - GNOME Shell 3.36.0
Ryzen 7 1700 Summer Featured Kernel Comparison	AMD Ryzen 7 1700 Eight-Core - MSI B350 TOMAHAWK - AMD 17h Ubuntu 19.10 - 5.8.3-050803-generic - GNOME Shell 3.34.1
IceLake TensorFlow Lite 4 Systems - 6 Benchmark Results	Intel Core i7-1065G7 - Dell 06CDVY - Intel Device 34ef Ubuntu 20.04 - 5.9.0-050900rc1daily20200819-generic - GNOME Shell 3.36.4
Ryzen 5 5600X Linux Performance 12 Systems - 229 Benchmark Results	AMD Ryzen 5 2600 Six-Core - ASUS ROG CROSSHAIR VIII HERO - AMD 17h Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4
Ryzen 3 3300X Linux 5.9 Kernel Test Featured Kernel Comparison	AMD Ryzen 3 3300X 4-Core - MSI B350M GAMING PRO - AMD Starship Ubuntu 20.04 - 5.9.0-050900rc4daily20200911-generic - GNOME Shell 3.36.4

TensorFlow Lite

Project Site

Test Created

Last Updated

Test Maintainer

Test Type

Average Install Time

Average Run Time

Supported Platforms

Revision History

Suites Using This Test

Performance Metrics

TensorFlow Lite 2020-08-23

Model: Inception V4

Does It Scale Well With Increasing Cores?

Notable Instruction Set Usage

Recent Test Results

Most Popular Test Results

User Comments