TensorFlow Lite

This is a benchmark of the TensorFlow Lite implementation. The current Linux support is limited to running on CPUs. This test profile is measuring the average inference time.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark tensorflow-lite.

Project Site

tensorflow.org

Test Created

23 August 2020

Test Maintainer

Michael Larabel

Test Type

System

Average Install Time

12 Seconds

Average Run Time

5 Minutes, 25 Seconds

Accolades

5k+ Downloads

Supported Platforms

* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
*** Test profile page view reporting began March 2021.
Data current as of 26 July 2021.

Revision History

pts/tensorflow-lite-1.0.0 [View Source] Sun, 23 Aug 2020 14:13:10 GMT
TensorFlow Lite initial commit.

Suites Using This Test

Machine Learning

HPC - High Performance Computing

Performance Metrics

Analyze Test Configuration:

TensorFlow Lite 2020-08-23

Model: Inception ResNet V2

OpenBenchmarking.org metrics for this test profile configuration based on 1,218 public results since 23 August 2020 with the latest data as of 20 July 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component

Percentile Rank

# Compatible Public Results

Microseconds (Average)

2 x AMD EPYC 7763 64-Core

100th

408330 ^{+/- 23263}

2 x AMD EPYC 7713 64-Core

98th

474952 ^{+/- 42645}

2 x AMD EPYC 7742 64-Core

98th

483074 ^{+/- 41759}

2 x Intel Xeon Platinum 8380

96th

572097 ^{+/- 2125}

AMD EPYC 7763 64-Core

95th

590211 ^{+/- 52444}

AMD EPYC 7713 64-Core

94th

616954 ^{+/- 5125}

AMD Ryzen Threadripper 3990X 64-Core

94th

620059 ^{+/- 29194}

2 x AMD EPYC 7643 48-Core

93rd

629609 ^{+/- 37273}

2 x AMD EPYC 75F3 32-Core

91st

677870 ^{+/- 7485}

2 x AMD EPYC 7663 56-Core

91st

693216 ^{+/- 25653}

AMD EPYC 7662 64-Core

90th

712514 ^{+/- 59513}

AMD Ryzen Threadripper 3970X 32-Core

89th

724357 ^{+/- 40339}

AMD EPYC 75F3 32-Core

87th

739529 ^{+/- 6732}

2 x AMD EPYC 7F72 24-Core

87th

742157 ^{+/- 10612}

2 x AMD EPYC 7513 32-Core

86th

752316 ^{+/- 16452}

2 x AMD EPYC 7443 24-Core

84th

773867 ^{+/- 6436}

2 x AMD EPYC 7F52 16-Core

84th

783144 ^{+/- 3102}

AMD EPYC 7643 48-Core

84th

783761 ^{+/- 74}

AMD EPYC 7702 64-Core

83rd

808932 ^{+/- 79114}

2 x AMD EPYC 7453 28-Core

82nd

823239 ^{+/- 17126}

AMD EPYC 7543 32-Core

81st

833509 ^{+/- 9845}

2 x AMD EPYC 73F3 16-Core

80th

839110 ^{+/- 1510}

AMD EPYC 7642 48-Core

79th

842083 ^{+/- 10627}

AMD EPYC 7542 32-Core

79th

845935 ^{+/- 4924}

2 x AMD EPYC 7343 16-Core

77th

872338 ^{+/- 9172}

AMD EPYC 7552 48-Core

76th

893295 ^{+/- 2101}

Mid-Tier

75th

> 893517

AMD EPYC 7502P 32-Core

74th

901895 ^{+/- 3202}

AMD EPYC 7502 32-Core

74th

907005

2 x AMD EPYC 7282 16-Core

72nd

941316 ^{+/- 7242}

AMD EPYC 7532 32-Core

72nd

948359 ^{+/- 26294}

2 x Intel Xeon Platinum 8280

72nd

968716 ^{+/- 98133}

AMD EPYC 7452 32-Core

72nd

979887

AMD Ryzen Threadripper 3960X 24-Core

70th

1010464 ^{+/- 4158}

2 x AMD EPYC 7601 32-Core

70th

1015399 ^{+/- 27906}

Intel Xeon Platinum 8380

70th

1025480 ^{+/- 870}

AMD EPYC 74F3 24-Core

68th

1076460 ^{+/- 108}

2 x Intel Xeon Gold 5220R

68th

1116116 ^{+/- 6778}

AMD EPYC 7443 24-Core

67th

1116922 ^{+/- 708}

AMD EPYC 7453 28-Core

67th

1130599 ^{+/- 166}

AMD EPYC 7601 32-Core

66th

1157025 ^{+/- 3764}

AMD EPYC 7F72 24-Core

66th

1160719 ^{+/- 14921}

AMD EPYC 7551 32-Core

65th

1188341 ^{+/- 9223}

AMD Ryzen 9 5950X 16-Core

62nd

1216392 ^{+/- 7457}

AMD EPYC 7402P 24-Core

61st

1220830 ^{+/- 15671}

AMD Ryzen 9 3950X 16-Core

59th

1306424 ^{+/- 19882}

AMD EPYC 73F3 16-Core

59th

1330458 ^{+/- 74}

2 x AMD EPYC 7272 12-Core

58th

1336200 ^{+/- 3981}

AMD EPYC 7F52 16-Core

57th

1348022 ^{+/- 3910}

Intel Xeon Gold 6258R

56th

1354931 ^{+/- 6254}

AMD EPYC 7343 16-Core

56th

1384993 ^{+/- 1241}

Intel Xeon Platinum 8280

56th

1395324 ^{+/- 9478}

AMD EPYC 7352 24-Core

55th

1457950

AMD EPYC 7302P 16-Core

54th

1568169 ^{+/- 3906}

2 x AMD EPYC 7262 8-Core

53rd

1584948 ^{+/- 2624}

AMD Ryzen 9 5900X 12-Core

52nd

1606310 ^{+/- 6788}

Median

50th

1614363

AMD EPYC 7282 16-Core

49th

1639392 ^{+/- 7060}

Intel Core i9-10980XE

49th

1641106 ^{+/- 2915}

2 x AMD EPYC 7252 8-Core

47th

1671634 ^{+/- 1070}

AMD Ryzen 9 3900XT 12-Core

46th

1799772 ^{+/- 132080}

AMD Ryzen 9 3900X 12-Core

46th

1803461 ^{+/- 9325}

Intel Xeon Gold 6226R

46th

1804003

Intel Xeon Gold 5220R

45th

2073899 ^{+/- 16742}

Intel Core i9-11900K

44th

2124050 ^{+/- 8609}

Intel Core i9-10900K

41st

2147387 ^{+/- 15250}

AMD Ryzen 7 5800X 8-Core

40th

2229494 ^{+/- 45228}

AMD EPYC 7272 12-Core

40th

2258168 ^{+/- 16637}

Intel Xeon Gold 5218

39th

2318708 ^{+/- 9939}

AMD Ryzen 7 3800XT 8-Core

38th

2389486 ^{+/- 30432}

Intel Xeon Silver 4216

38th

2402267 ^{+/- 1343}

AMD EPYC 72F3 8-Core

36th

2460004 ^{+/- 12844}

Intel Core i7-7900X

36th

2557136 ^{+/- 5957}

AMD EPYC 7F32 8-Core

35th

2656161 ^{+/- 65836}

AMD Ryzen 7 1800X Eight-Core

33rd

2960190 ^{+/- 231889}

AMD Ryzen 5 5600X 6-Core

32nd

2999394 ^{+/- 48980}

Intel Core i5-11600K

32nd

3003547

Intel Xeon E-2288G

32nd

3003644 ^{+/- 98341}

AMD Ryzen 7 2700 Eight-Core

32nd

3013723 ^{+/- 53347}

Intel Xeon Silver 4214R

31st

3047600

AMD EPYC 7262 8-Core

31st

3131150

AMD EPYC 7232P 8-Core

30th

3140318 ^{+/- 6414}

Intel Xeon E5-2687W v3

29th

3268110 ^{+/- 1072}

AMD EPYC 7252 8-Core

28th

3312693

AMD Ryzen 7 4700U

28th

3338235 ^{+/- 28880}

AMD Ryzen 5 3600X 6-Core

28th

3356693

AMD Ryzen 7 1700 Eight-Core

27th

3414240 ^{+/- 197816}

AMD Ryzen 5 3600XT 6-Core

27th

3415448 ^{+/- 3867}

AMD Ryzen 5 2600X Six-Core

27th

3456231 ^{+/- 10852}

Intel Xeon Silver 4215R

26th

3572553

Low-Tier

25th

> 3745460

Intel Xeon Gold 5217

25th

3774800

Intel Core i7-8086K

25th

3777707 ^{+/- 2332}

Intel Core i7-8700K

25th

3781611 ^{+/- 1933}

Intel Core i7-5960X

24th

3881257 ^{+/- 177}

Intel Core i5-10600K

23rd

3937052 ^{+/- 6822}

Intel Xeon E-2278GEL

23rd

3959302 ^{+/- 11505}

Intel Core i5-9400F

22nd

4075158 ^{+/- 484}

Intel Core i5-8400

22nd

4170277 ^{+/- 287}

AMD Ryzen 5 4500U

22nd

4192119 ^{+/- 192307}

AMD Ryzen 5 5500U

21st

4399915 ^{+/- 37099}

Intel Core i9-10885H

19th

4667686 ^{+/- 8700}

Intel Core i7-10700T

19th

4668485 ^{+/- 45809}

AMD Ryzen 3 3300X 4-Core

18th

4779473 ^{+/- 830}

Intel Core i7-6800K

17th

4914079 ^{+/- 50617}

Intel Core i7-4960X

17th

4997320 ^{+/- 36672}

AMD Ryzen 3 3100 4-Core

17th

5048004 ^{+/- 835}

Intel Core i7-9750H

16th

5132820 ^{+/- 257709}

AMD Ryzen 5 3400G

16th

5195028 ^{+/- 11376}

Intel Core i7-7740K

16th

5211162 ^{+/- 52}

Intel Core i7-7700K

15th

5305553 ^{+/- 207541}

Intel Core i7-9700TE

15th

5390148 ^{+/- 102304}

AMD Ryzen 3 1300X

15th

5417777 ^{+/- 12455}

AMD Ryzen 5 2400G

14th

5491067 ^{+/- 39015}

Intel Core i5-7600K

13th

5851123 ^{+/- 1227}

Intel Xeon E3-1275 v6

13th

5870767 ^{+/- 8482}

Intel Xeon E3-1270 v5

13th

6181699 ^{+/- 1037}

Intel Core i3-10100

13th

6233168 ^{+/- 78}

Intel Core i7-4790K

12th

6259003 ^{+/- 6450}

Intel Xeon E3-1280 v5

12th

6369685 ^{+/- 23995}

Intel Core i3-8100

12th

6490521 ^{+/- 1102}

Intel Xeon E3-1245 v5

12th

6518117 ^{+/- 687}

AMD FX-8370 Eight-Core

11th

6619217 ^{+/- 789}

Intel Xeon E3-1260L v5

11th

7042845 ^{+/- 6315}

Intel Core i5-4670

10th

7065428 ^{+/- 997}

Intel Core i7-5775C

10th

7073255 ^{+/- 11170}

Intel Core i7-1165G7

9th

7330607 ^{+/- 326563}

Intel Xeon E5-2609 v4

8th

7504205 ^{+/- 2901}

Intel Core i7-6700HQ

7th

7575542 ^{+/- 1773}

AMD FX-8150 Eight-Core

7th

7811175 ^{+/- 20167}

Intel Core i5-2500K

5th

8485620 ^{+/- 495}

Intel Core i7-1065G7

5th

8586017 ^{+/- 357886}

Intel Xeon E3-1235L v5

5th

8650855 ^{+/- 2272}

Intel Core i7-8550U

5th

8769820 ^{+/- 742969}

Intel Core i5-3470

4th

8994871 ^{+/- 29228}

Intel Core i7-8565U

4th

9137310 ^{+/- 695148}

Intel Core i3-7100

3rd

11974722 ^{+/- 850}

AMD Ryzen 3 3200U

3rd

13315667 ^{+/- 15674}

Intel Core i3-4130

2nd

14999222 ^{+/- 700}

Intel Core i7-4558U

2nd

15930567 ^{+/- 5075}

Intel Core i7-5600U

2nd

17693280 ^{+/- 18145}

Intel Core i5-5300U

1st

18852389 ^{+/- 703}

Intel Core i5-2520M

1st

19548311 ^{+/- 4409}

Based on OpenBenchmarking.org data, the selected test / test configuration (TensorFlow Lite 2020-08-23 - Model: Inception ResNet V2) has an average run-time of 6 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.1%.

Does It Scale Well With Increasing Cores?

Yes, based on the automated analysis of the collected public benchmark data, this test / test settings does generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set

Support

Instructions Detected

SSE2 (SSE2)

Used by default on supported hardware.

MOVDQA PMULUDQ PSHUFD PSRLDQ MOVD CVTSI2SD ADDSD MULSD SUBSD DIVSD MOVAPD CVTSS2SD CVTTSD2SI SQRTSD UCOMISD XORPD CVTSD2SS CVTTPS2DQ CVTDQ2PS PADDQ MOVDQU PUNPCKLQDQ UNPCKLPD CVTDQ2PD MULPD CVTPD2PS ANDPD MAXSD PSUBQ CVTPS2PD MINSD MOVUPD UNPCKHPD ADDPD PUNPCKHQDQ CVTPS2DQ

Advanced Vector Extensions (AVX)

Used by default on supported hardware.
Found on Intel processors since Sandy Bridge (2011).
Found on AMD processors since Bulldozer (2011).

VBROADCASTF128 VZEROUPPER VMASKMOVPS VEXTRACTF128 VBROADCASTSS VINSERTF128 VPERMILPS

FMA (FMA)

Used by default on supported hardware.
Found on Intel processors since Haswell (2013).
Found on AMD processors since Bulldozer (2011).

VFMADD132PS VFMADD231PS VFMADD213PS

Last automated analysis: 10 May 2021

This test profile binary relies on the shared libraries libm.so.6, libpthread.so.0, libdl.so.2, librt.so.1, libc.so.6.

AMD EPYC 72F3 Performance Benchmarks 3 Systems - 240 Benchmark Results	AMD EPYC 7F32 8-Core - Supermicro H12SSL-i v1.01 - AMD Starship Ubuntu 21.04 - 5.11.0-16-generic - GNOME Shell 3.38.4
AMD EPYC 72F3 Performance Benchmarks 3 Systems - 240 Benchmark Results	AMD EPYC 7F32 8-Core - Supermicro H12SSL-i v1.01 - AMD Starship Ubuntu 21.04 - 5.11.0-16-generic - GNOME Shell 3.38.4
saba 1 System - 12 Benchmark Results	Intel Core i5-8600K - ASRock Z390 Extreme4 - 32GB Ubuntu 20.04.2 LTS - 4.15.0-66-generic - NVIDIA
kaiwari 1 System - 27 Benchmark Results	Intel Core i5-8600K - ASRock Z390 Extreme4 - 32GB Ubuntu 20.04.2 LTS - 4.15.0-66-generic - NVIDIA
Linux Kernels Test On AMD Ryzen 5 5500U Featured Kernel Comparison	5.12.17-051217-generic - 5.13.2-051302-generic - 5.14.0-rc1-vanilla - 5.12.17-xanmod1 - 5.13.2-xanmod1-edge - 5.12.0-17.2-liquorix-amd64
4700U 2021 3 Systems - 253 Benchmark Results	AMD Ryzen 7 4700U - LENOVO LNVNB161216 - AMD Renoir Root Complex Ubuntu 20.04 - 5.9.0-050900rc7daily20201003-generic - GNOME Shell 3.36.9
Memory Folios AMD EPYC 1 System - 162 Benchmark Results	2 x AMD EPYC 7763 64-Core - AMD DAYTONA_X - AMD Starship Ubuntu 21.04 - 5.14.0-rc1-vanilla - X Server 1.20.11
2107171-PTS-ML 1 System - 88 Benchmark Results	AMD Ryzen 5 3600 6-Core - Gigabyte X570 AORUS PRO - AMD Starship ManjaroLinux 21.1.0 - 5.13.1-3-MANJARO - X Server 1.20.11
Memory Folios Featured Kernel Comparison	5.14.0-rc1-folio - 5.14.0-rc1-vanilla
AMD EPYC 7543 Tyan Linux Benchmarks 11 Systems - 56 Benchmark Results	AMD EPYC 7543 32-Core - TYAN S8036GM2NE-LE - AMD Starship Rocky Linux 8.4 - 4.18.0-305.3.1.el8_4.x86_64 - GNOME Shell 3.32.2
EPYC Tyan Server 10 Systems - 77 Benchmark Results	AMD EPYC 7543 32-Core - TYAN S8036GM2NE-LE - AMD Starship Debian 11 - 5.10.0-7-amd64 - GNOME Shell 3.38.4
EPYC Tyan Server 9 Systems - 77 Benchmark Results	AMD EPYC 7543 32-Core - TYAN S8036GM2NE-LE - AMD Starship Clear Linux OS 34770 - 5.12.8-1045.native - GNOME Shell 40.2

Sandy 3 Systems - 268 Benchmark Results	Intel Core i5-2520M - HP 161C - Intel 2nd Generation Core DRAM Ubuntu 18.04 - 4.18.0-20-generic - GNOME Shell 3.28.3
Renoir vs. Icelake Benchmarks 2 Systems - 535 Benchmark Results	AMD Ryzen 5 4500U - LENOVO LNVNB161216 - AMD Renoir Root Complex Ubuntu 20.04 - 5.9.0-050900rc7daily20201002-generic - GNOME Shell 3.36.4
Ryzen 9 5900X / Ryzen 9 5950X Linux Performance 11 Systems - 217 Benchmark Results	AMD Ryzen 5 3600X 6-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4
Fedora 32 vs. Fedora 33 Beta Benchmarks 3 Systems - 174 Benchmark Results	Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH Fedora 32 - 5.6.6-300.fc32.x86_64 - GNOME Shell 3.36.1
Ryzen 5 5600X Linux Performance 12 Systems - 229 Benchmark Results	AMD Ryzen 9 5950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4
10700T openSUSE 2 Systems - 78 Benchmark Results	Intel Core i7-10700T - Logic Supply RXM-181 - Intel Comet Lake PCH openSUSE 15.3 - 5.3.18-47-default - KDE Plasma 5.18.6
Intel Tiger Lake Mitigation COmparison 8 Systems - 32 Benchmark Results	Intel Core i7-1165G7 - Dell 0GG9PT - Intel Tiger Lake-LP Ubuntu 20.10 - 5.8.0-31-generic - GNOME Shell 3.38.1
Intel Core i5 11600K + Core i9 11900K Linux Performance 8 Systems - 439 Benchmark Results	AMD Ryzen 7 5800X 8-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 21.04 - 5.12.0-051200rc3daily20210315-generic - GNOME Shell 3.38.3
Core i9 10900K - Ubuntu 20.04 LTS vs. Ubuntu 20.10 2 Systems - 403 Benchmark Results	Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH Ubuntu 20.10 - 5.8.0-22-generic - GNOME Shell 3.38.0
Aventinus 2 Systems - 81 Benchmark Results	2 x AMD EPYC 7742 64-Core - Supermicro H11DSi-NT v2.00 - AMD Starship Ubuntu 20.04 - 5.8.0-44-generic - GNOME Shell 3.36.4
Ryzen 9 3900XT Ubuntu 20.04 LTS vs. Ubuntu 20.10 3 Systems - 406 Benchmark Results	AMD Ryzen 9 3900XT 12-Core - MSI MEG X570 GODLIKE - AMD Starship Ubuntu 20.10 - 5.8.0-20-generic - GNOME Shell 3.38.0
5900X LInux 5.12 Test 2 Systems - 95 Benchmark Results	AMD Ryzen 9 5900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 20.10 - 5.12.0-051200rc2-generic - GNOME Shell 3.38.1

TensorFlow Lite

Project Site

Test Created

Test Maintainer

Test Type

Average Install Time

Average Run Time

Accolades

Supported Platforms

Revision History

Suites Using This Test

Performance Metrics

TensorFlow Lite 2020-08-23

Model: Inception ResNet V2

Does It Scale Well With Increasing Cores?

Notable Instruction Set Usage

Recent Test Results

Most Popular Test Results