TensorFlow Lite

This is a benchmark of the TensorFlow Lite implementation. The current Linux support is limited to running on CPUs. This test profile is measuring the average inference time.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark tensorflow-lite.

Project Site

tensorflow.org

Test Created

23 August 2020

Test Maintainer

Michael Larabel

Test Type

System

Average Install Time

11 Seconds

Average Run Time

5 Minutes, 25 Seconds

Accolades

5k+ Downloads

Supported Platforms

* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
*** Test profile page view reporting began March 2021.
Data current as of 22 October 2021.

Revision History

pts/tensorflow-lite-1.0.0 [View Source] Sun, 23 Aug 2020 14:13:10 GMT
TensorFlow Lite initial commit.

Suites Using This Test

Machine Learning

HPC - High Performance Computing

Performance Metrics

Analyze Test Configuration:

TensorFlow Lite 2020-08-23

Model: Inception ResNet V2

OpenBenchmarking.org metrics for this test profile configuration based on 1,261 public results since 23 August 2020 with the latest data as of 23 October 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component

Percentile Rank

# Compatible Public Results

Microseconds (Average)

2 x AMD EPYC 7763 64-Core

100th

408330 ^{+/- 23263}

2 x AMD EPYC 7713 64-Core

98th

474952 ^{+/- 42645}

2 x AMD EPYC 7742 64-Core

98th

483074 ^{+/- 41759}

2 x Intel Xeon Platinum 8380

95th

575678 ^{+/- 8160}

AMD EPYC 7763 64-Core

94th

590211 ^{+/- 52444}

AMD EPYC 7713 64-Core

93rd

616954 ^{+/- 5125}

AMD Ryzen Threadripper 3990X 64-Core

93rd

620059 ^{+/- 29194}

2 x AMD EPYC 7643 48-Core

93rd

629609 ^{+/- 37273}

2 x AMD EPYC 7663 56-Core

91st

693216 ^{+/- 25653}

2 x AMD EPYC 75F3 32-Core

90th

709525 ^{+/- 77942}

AMD EPYC 7662 64-Core

90th

712514 ^{+/- 59513}

AMD Ryzen Threadripper 3970X 32-Core

89th

724357 ^{+/- 40339}

AMD EPYC 75F3 32-Core

87th

739529 ^{+/- 6732}

2 x AMD EPYC 7F72 24-Core

87th

742157 ^{+/- 10612}

2 x AMD EPYC 7513 32-Core

86th

752316 ^{+/- 16452}

2 x AMD EPYC 7443 24-Core

84th

773867 ^{+/- 6436}

2 x AMD EPYC 7F52 16-Core

84th

783144 ^{+/- 3102}

AMD EPYC 7643 48-Core

84th

783761 ^{+/- 74}

AMD EPYC 7702 64-Core

83rd

808932 ^{+/- 79114}

2 x AMD EPYC 7453 28-Core

82nd

823239 ^{+/- 17126}

AMD EPYC 7543 32-Core

81st

834802 ^{+/- 8751}

2 x AMD EPYC 73F3 16-Core

80th

839110 ^{+/- 1510}

AMD EPYC 7642 48-Core

79th

842083 ^{+/- 10627}

AMD EPYC 7542 32-Core

79th

845935 ^{+/- 4924}

2 x AMD EPYC 7343 16-Core

77th

872338 ^{+/- 9172}

Mid-Tier

75th

> 892001

AMD EPYC 7552 48-Core

75th

893295 ^{+/- 2101}

AMD EPYC 7502P 32-Core

74th

901895 ^{+/- 3202}

AMD EPYC 7502 32-Core

74th

907005

2 x AMD EPYC 7282 16-Core

72nd

941316 ^{+/- 7242}

AMD EPYC 7532 32-Core

72nd

948359 ^{+/- 26294}

2 x Intel Xeon Platinum 8280

72nd

968716 ^{+/- 98133}

AMD EPYC 7452 32-Core

71st

979887

AMD Ryzen Threadripper 3960X 24-Core

70th

1010464 ^{+/- 4158}

2 x AMD EPYC 7601 32-Core

70th

1015399 ^{+/- 27906}

Intel Xeon Platinum 8380

69th

1025480 ^{+/- 870}

AMD EPYC 74F3 24-Core

68th

1076420 ^{+/- 1944}

2 x Intel Xeon Gold 5220R

67th

1116116 ^{+/- 6778}

AMD EPYC 7443 24-Core

67th

1116922 ^{+/- 708}

AMD EPYC 7453 28-Core

66th

1130599 ^{+/- 166}

AMD EPYC 7601 32-Core

66th

1157025 ^{+/- 3764}

AMD EPYC 7F72 24-Core

65th

1160719 ^{+/- 14921}

AMD EPYC 7551 32-Core

64th

1188341 ^{+/- 9223}

AMD Ryzen 9 5950X 16-Core

61st

1216906 ^{+/- 7662}

AMD EPYC 7402P 24-Core

61st

1220830 ^{+/- 15671}

AMD Ryzen 9 3950X 16-Core

59th

1306424 ^{+/- 19882}

AMD EPYC 73F3 16-Core

58th

1330458 ^{+/- 74}

2 x AMD EPYC 7272 12-Core

58th

1336200 ^{+/- 3981}

AMD EPYC 7F52 16-Core

57th

1348022 ^{+/- 3910}

Intel Xeon Gold 6258R

56th

1354931 ^{+/- 6254}

AMD EPYC 7343 16-Core

56th

1384993 ^{+/- 1241}

Intel Xeon Platinum 8280

56th

1395324 ^{+/- 9478}

AMD EPYC 7352 24-Core

55th

1457950

AMD EPYC 7302P 16-Core

54th

1568169 ^{+/- 3906}

2 x AMD EPYC 7262 8-Core

53rd

1584948 ^{+/- 2624}

AMD Ryzen 9 5900X 12-Core

52nd

1607121 ^{+/- 7317}

Median

50th

1613467

Intel Core i9-10980XE

50th

1623994 ^{+/- 45263}

AMD EPYC 7282 16-Core

49th

1639392 ^{+/- 7060}

2 x AMD EPYC 7252 8-Core

47th

1671634 ^{+/- 1070}

AMD Ryzen 9 3900XT 12-Core

46th

1799772 ^{+/- 132080}

AMD Ryzen 9 3900X 12-Core

46th

1803461 ^{+/- 9325}

Intel Xeon Gold 6226R

46th

1804003

Intel Xeon Gold 5220R

45th

2073899 ^{+/- 16742}

Intel Core i9-11900K

44th

2123109 ^{+/- 8912}

Intel Core i9-10900K

41st

2147387 ^{+/- 15250}

AMD Ryzen 7 5800X 8-Core

40th

2257575 ^{+/- 106406}

AMD EPYC 7272 12-Core

40th

2258168 ^{+/- 16637}

AMD Ryzen 9 5900HX

39th

2312644 ^{+/- 7942}

Intel Xeon Gold 5218

39th

2318708 ^{+/- 9939}

AMD Ryzen 7 3800XT 8-Core

38th

2389486 ^{+/- 30432}

Intel Xeon Silver 4216

38th

2402267 ^{+/- 1343}

AMD EPYC 72F3 8-Core

36th

2460004 ^{+/- 12844}

Intel Core i7-7900X

35th

2557136 ^{+/- 5957}

AMD EPYC 7F32 8-Core

35th

2656161 ^{+/- 65836}

AMD Ryzen 7 1800X Eight-Core

33rd

2960190 ^{+/- 231889}

AMD Ryzen 5 5600X 6-Core

32nd

2997286 ^{+/- 48065}

Intel Xeon E-2288G

32nd

3003644 ^{+/- 98341}

AMD Ryzen 7 2700 Eight-Core

32nd

3013723 ^{+/- 53347}

Intel Xeon Silver 4214R

31st

3047600

AMD EPYC 7262 8-Core

31st

3131150

AMD EPYC 7232P 8-Core

30th

3140318 ^{+/- 6414}

Intel Xeon E5-2687W v3

28th

3268110 ^{+/- 1072}

AMD EPYC 7252 8-Core

28th

3312693

AMD Ryzen 7 4700U

28th

3338235 ^{+/- 28880}

AMD Ryzen 5 3600X 6-Core

28th

3356693

AMD Ryzen 7 1700 Eight-Core

27th

3414240 ^{+/- 197816}

AMD Ryzen 5 3600XT 6-Core

27th

3415448 ^{+/- 3867}

AMD Ryzen 5 2600X Six-Core

27th

3456231 ^{+/- 10852}

Intel Xeon Silver 4215R

26th

3572553

Low-Tier

25th

> 3664460

Intel Xeon Gold 5217

25th

3774800

Intel Core i7-8086K

25th

3777707 ^{+/- 2332}

Intel Core i7-8700K

25th

3781611 ^{+/- 1933}

Intel Core i7-5960X

24th

3881257 ^{+/- 177}

Intel Core i5-10600K

23rd

3937052 ^{+/- 6822}

Intel Xeon E-2278GEL

23rd

3959302 ^{+/- 11505}

Intel Core i5-9400F

22nd

4075158 ^{+/- 484}

Intel Core i5-8400

22nd

4170277 ^{+/- 287}

AMD Ryzen 5 4500U

22nd

4192119 ^{+/- 192307}

AMD Ryzen 5 5500U

21st

4399915 ^{+/- 37099}

Intel Core i9-10885H

20th

4667686 ^{+/- 8700}

Intel Core i7-10700T

19th

4668485 ^{+/- 45809}

AMD Ryzen 3 3300X 4-Core

18th

4779473 ^{+/- 830}

Intel Core i7-6800K

17th

4914079 ^{+/- 50617}

Intel Core i7-4960X

17th

4997320 ^{+/- 36672}

AMD Ryzen 3 3100 4-Core

17th

5048004 ^{+/- 835}

Intel Core i7-9750H

16th

5132820 ^{+/- 257709}

AMD Ryzen 5 3400G

16th

5195028 ^{+/- 11376}

Intel Core i7-7740K

16th

5211162 ^{+/- 52}

Intel Core i7-7700K

15th

5305553 ^{+/- 207541}

Intel Core i7-9700TE

15th

5390148 ^{+/- 102304}

AMD Ryzen 3 1300X

15th

5417777 ^{+/- 12455}

AMD Ryzen 5 2400G

14th

5491067 ^{+/- 39015}

Intel Core i5-7600K

14th

5851123 ^{+/- 1227}

Intel Xeon E3-1275 v6

13th

5870767 ^{+/- 8482}

Intel Xeon E3-1270 v5

13th

6181699 ^{+/- 1037}

Intel Core i3-10100

13th

6233168 ^{+/- 78}

Intel Core i7-4790K

13th

6259003 ^{+/- 6450}

Intel Xeon E3-1280 v5

12th

6369685 ^{+/- 23995}

Intel Core i3-8100

12th

6490521 ^{+/- 1102}

Intel Xeon E3-1245 v5

12th

6518117 ^{+/- 687}

AMD FX-8370 Eight-Core

11th

6619217 ^{+/- 789}

Intel Xeon E3-1260L v5

11th

7042845 ^{+/- 6315}

Intel Core i5-4670

11th

7065428 ^{+/- 997}

Intel Core i7-5775C

10th

7073255 ^{+/- 11170}

Intel Core i7-1165G7

9th

7288337 ^{+/- 330881}

Intel Xeon E5-2609 v4

8th

7504205 ^{+/- 2901}

Intel Core i7-6700HQ

7th

7575542 ^{+/- 1773}

AMD FX-8150 Eight-Core

7th

7811175 ^{+/- 20167}

Intel Core i5-2500K

5th

8485620 ^{+/- 495}

Intel Core i7-1065G7

5th

8586017 ^{+/- 357886}

Intel Xeon E3-1235L v5

5th

8650855 ^{+/- 2272}

Intel Core i7-8550U

5th

8769820 ^{+/- 742969}

Intel Core i5-3470

4th

8994871 ^{+/- 29228}

Intel Core i7-8565U

4th

9137310 ^{+/- 695148}

Intel Core i3-7100

3rd

11974722 ^{+/- 850}

AMD Ryzen 3 3200U

3rd

13315667 ^{+/- 15674}

Intel Core i3-4130

2nd

14999222 ^{+/- 700}

Intel Core i7-4558U

2nd

15930567 ^{+/- 5075}

Intel Core i7-5600U

2nd

17693280 ^{+/- 18145}

Intel Core i5-5300U

1st

18852389 ^{+/- 703}

Intel Core i5-2520M

1st

19548311 ^{+/- 4409}

Based on OpenBenchmarking.org data, the selected test / test configuration (TensorFlow Lite 2020-08-23 - Model: Inception ResNet V2) has an average run-time of 6 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.2%.

Does It Scale Well With Increasing Cores?

Yes, based on the automated analysis of the collected public benchmark data, this test / test settings does generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set

Support

Instructions Detected

SSE2 (SSE2)

Used by default on supported hardware.

MOVDQA PMULUDQ PSHUFD PSRLDQ MOVD CVTSI2SD ADDSD MULSD SUBSD DIVSD MOVAPD CVTSS2SD CVTTSD2SI SQRTSD UCOMISD XORPD CVTSD2SS CVTTPS2DQ CVTDQ2PS PADDQ MOVDQU PUNPCKLQDQ UNPCKLPD CVTDQ2PD MULPD CVTPD2PS ANDPD MAXSD PSUBQ CVTPS2PD MINSD MOVUPD UNPCKHPD ADDPD PUNPCKHQDQ CVTPS2DQ

Advanced Vector Extensions (AVX)

Used by default on supported hardware.
Found on Intel processors since Sandy Bridge (2011).
Found on AMD processors since Bulldozer (2011).

VBROADCASTF128 VZEROUPPER VMASKMOVPS VEXTRACTF128 VBROADCASTSS VINSERTF128 VPERMILPS

FMA (FMA)

Used by default on supported hardware.
Found on Intel processors since Haswell (2013).
Found on AMD processors since Bulldozer (2011).

VFMADD132PS VFMADD231PS VFMADD213PS

Last automated analysis: 10 May 2021

This test profile binary relies on the shared libraries libm.so.6, libpthread.so.0, libdl.so.2, librt.so.1, libc.so.6.

Intel Core i7-1065G7 Benchmarks 1 System - 3 Benchmark Results	Intel Core i7-1065G7 - Oracle VirtualBox v1.2 - Intel 440FX 82441FX PMC Ubuntu 20.04 - 5.11.0-38-generic - GNOME Shell 3.36.9
Smoke Run 1 System - 290 Benchmark Results	AMD Ryzen 9 5900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 21.10 - 5.13.0-20-generic - GNOME Shell 40.5
Intel Core i7-1065G7 Benchmarks 1 System - 3 Benchmark Results	Intel Core i7-1065G7 - Oracle VirtualBox v1.2 - Intel 440FX 82441FX PMC Ubuntu 20.04 - 5.11.0-38-generic - GNOME Shell 3.36.9
5.11.22-5-pve + Debian GNU/Linux 11 Tests 1 System - 3 Benchmark Results	Intel Core i5-8500 - Dell 0NC2VH - Intel Cannon Lake PCH Debian GNU - 5.11.22-5-pve - GCC 10.2.1 20210110
Intel Core i5-8500 Performance 1 System - 8 Benchmark Results	Intel Core i5-8500 - Dell 0NC2VH - Intel Cannon Lake PCH Debian GNU - 5.11.22-5-pve - GCC 10.2.1 20210110
5.11.22-5-pve + Debian GNU/Linux 11 Tests 1 System - 1 Benchmark Result	Intel Core i5-8500 - Dell 0NC2VH - Intel Cannon Lake PCH Debian GNU - 5.11.22-5-pve - GCC 10.2.1 20210110
Clear Linux 2 Systems - 160 Benchmark Results	Intel Core i9-10980XE - ASRock X299 Steel Legend - Intel Sky Lake-E DMI3 Registers Clear Linux OS 35000 - 5.13.13-1070.native - GNOME Shell 40.4
Intel Core i5-4590 Benchmarks 1 System - 1 Benchmark Result	Intel Core i5-4590 - Dell 0WMJ54 - 16GB Ubuntu 20.04.1 LTS - 5.14.11-300.fc35.x86_64 - i915
Intel Core i5-4590 Benchmarks 1 System - 1 Benchmark Result	Intel Core i5-4590 - Dell 0WMJ54 - 16GB Ubuntu 20.04.1 LTS - 5.14.11-300.fc35.x86_64 - i915
Intel Core i5-4590 On Ubuntu 20.04.1 LTS 1 System - 1 Benchmark Result	Intel Core i5-4590 - Dell 0WMJ54 - 16GB Ubuntu 20.04.1 LTS - 5.14.11-300.fc35.x86_64 - i915
Dell 0WMJ54 (A17 BIOS) On Ubuntu 20.04.1 LTS 1 System - 2 Benchmark Results	Intel Core i5-4590 - Dell 0WMJ54 - 16GB Ubuntu 20.04.1 LTS - 5.14.11-300.fc35.x86_64 - i915
Intel Core i5-4590 Performance 1 System - 4 Benchmark Results	Intel Core i5-4590 - Dell 0WMJ54 - 16GB Ubuntu 20.04.1 LTS - 5.14.11-300.fc35.x86_64 - i915
Intel Core i5-4590 On Ubuntu 20.04.1 LTS 1 System - 1 Benchmark Result	Intel Core i5-4590 - Dell 0WMJ54 - 16GB Ubuntu 20.04.1 LTS - 5.14.11-300.fc35.x86_64 - i915
Intel Core i5-4590 On Ubuntu 20.04.1 LTS 1 System - 2 Benchmark Results	Intel Core i5-4590 - Dell 0WMJ54 - 16GB Ubuntu 20.04.1 LTS - 5.14.11-300.fc35.x86_64 - i915
Dell 0WMJ54 (A17 BIOS) On Ubuntu 20.04.1 LTS 1 System - 1 Benchmark Result	Intel Core i5-4590 - Dell 0WMJ54 - 16GB Ubuntu 20.04.1 LTS - 5.14.11-300.fc35.x86_64 - i915

Sandy 3 Systems - 268 Benchmark Results	Intel Core i5-2520M - HP 161C - Intel 2nd Generation Core DRAM Ubuntu 18.04 - 4.18.0-20-generic - GNOME Shell 3.28.3
Renoir vs. Icelake Benchmarks 2 Systems - 535 Benchmark Results	AMD Ryzen 5 4500U - LENOVO LNVNB161216 - AMD Renoir Root Complex Ubuntu 20.04 - 5.9.0-050900rc7daily20201002-generic - GNOME Shell 3.36.4
Ryzen 9 5900X / Ryzen 9 5950X Linux Performance 11 Systems - 217 Benchmark Results	AMD Ryzen 7 3800XT 8-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4
Fedora 32 vs. Fedora 33 Beta Benchmarks 3 Systems - 174 Benchmark Results	Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH Fedora 33 - 5.8.11-300.fc33.x86_64 - GNOME Shell 3.38.0
Intel Core i5 11600K + Core i9 11900K Linux Performance 8 Systems - 439 Benchmark Results	AMD Ryzen 7 5800X 8-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 21.04 - 5.12.0-051200rc3daily20210315-generic - GNOME Shell 3.38.3
Ryzen 5 5600X Linux Performance 12 Systems - 229 Benchmark Results	AMD Ryzen 5 2600X Six-Core - ASUS ROG CROSSHAIR VIII HERO - AMD 17h Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4
Intel Tiger Lake Mitigation COmparison 8 Systems - 32 Benchmark Results	Intel Core i7-1165G7 - Dell 0GG9PT - Intel Tiger Lake-LP Ubuntu 20.10 - 5.10.0-051000rc7daily20201213-generic - GNOME Shell 3.38.1
Core i9 10900K - Ubuntu 20.04 LTS vs. Ubuntu 20.10 2 Systems - 403 Benchmark Results	Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH Ubuntu 20.10 - 5.8.0-22-generic - GNOME Shell 3.38.0
10700T openSUSE 2 Systems - 78 Benchmark Results	Intel Core i7-10700T - Logic Supply RXM-181 - Intel Comet Lake PCH openSUSE 15.3 - 5.3.18-47-default - KDE Plasma 5.18.6
Ryzen 9 3900XT Ubuntu 20.04 LTS vs. Ubuntu 20.10 3 Systems - 406 Benchmark Results	Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH Ubuntu 20.04 - 5.4.0-48-generic - GNOME Shell 3.36.4
Aventinus 2 Systems - 81 Benchmark Results	2 x AMD EPYC 7742 64-Core - Supermicro H11DSi-NT v2.00 - AMD Starship Ubuntu 20.04 - 5.8.0-44-generic - GNOME Shell 3.36.4
AMD EPYC 7F72 2P Linux 5.11 3 Systems - 376 Benchmark Results	2 x AMD EPYC 7F72 24-Core - Supermicro H11DSi-NT v2.00 - AMD Starship Ubuntu 20.10 - 5.11.0-051100rc4daily20210122-generic - GNOME Shell 3.38.1
AMD EPYC 7003 Linux Benchmarks 26 Systems - 438 Benchmark Results	2 x Intel Xeon Platinum 8280 - GIGABYTE MD61-SC2-00 v01000100 - Intel Sky Lake-E DMI3 Registers Ubuntu 20.04 - 5.11.0-051100rc6daily20210201-generic - GNOME Shell 3.36.4
System76 Thelio Major 3990X Pop OS 2 Systems - 297 Benchmark Results	AMD Ryzen Threadripper 3990X 64-Core - System76 Thelio Major - AMD Starship Pop 20.10 - 5.8.0-7625-generic - GNOME Shell 3.38.1
Core i7 10700T Garage 3 Systems - 108 Benchmark Results	Intel Core i7-10700T - Logic Supply RXM-181 - Intel Comet Lake PCH Ubuntu 20.10 - 5.8.0-43-generic - GNOME Shell 3.38.2

TensorFlow Lite

Project Site

Test Created

Test Maintainer

Test Type

Average Install Time

Average Run Time

Accolades

Supported Platforms

Revision History

Suites Using This Test

Performance Metrics

TensorFlow Lite 2020-08-23

Model: Inception ResNet V2

Does It Scale Well With Increasing Cores?

Notable Instruction Set Usage

Recent Test Results

Most Popular Test Results