TensorFlow Lite

This is a benchmark of the TensorFlow Lite implementation. The current Linux support is limited to running on CPUs. This test profile is measuring the average inference time.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark tensorflow-lite.

Project Site

tensorflow.org

Test Created

23 August 2020

Test Maintainer

Michael Larabel

Test Type

System

Average Install Time

10 Seconds

Average Run Time

4 Minutes, 51 Seconds

Supported Platforms

* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data current as of Wed, 05 May 2021 04:35:24 GMT.

Revision History

pts/tensorflow-lite-1.0.0 [View Source] Sun, 23 Aug 2020 14:13:10 GMT
TensorFlow Lite initial commit.

Suites Using This Test

Machine Learning

HPC - High Performance Computing

Performance Metrics

Analyze Test Configuration:

TensorFlow Lite 2020-08-23

Model: Inception ResNet V2

OpenBenchmarking.org metrics for this test profile configuration based on 1,105 public results since 23 August 2020 with the latest data as of 3 May 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component

Percentile Rank

# Matching Public Results

Microseconds (Average)

2 x AMD EPYC 7763 64-Core

100th

414063 ^{+/- 26003}

2 x AMD EPYC 7742 64-Core

99th

483074 ^{+/- 41759}

2 x AMD EPYC 7713 64-Core

98th

499289 ^{+/- 29986}

2 x Intel Xeon Platinum 8380

97th

572083 ^{+/- 2178}

AMD EPYC 7763 64-Core

97th

592443 ^{+/- 64088}

AMD Ryzen Threadripper 3990X 64-Core

96th

620059 ^{+/- 29194}

2 x AMD EPYC 75F3 32-Core

94th

678563 ^{+/- 7509}

AMD EPYC 7662 64-Core

92nd

712514 ^{+/- 59513}

AMD Ryzen Threadripper 3970X 32-Core

91st

724357 ^{+/- 40339}

AMD EPYC 75F3 32-Core

89th

739878 ^{+/- 6990}

2 x AMD EPYC 7F72 24-Core

89th

742157 ^{+/- 10612}

2 x AMD EPYC 7513 32-Core

88th

752316 ^{+/- 16452}

2 x AMD EPYC 7443 24-Core

87th

773722 ^{+/- 3052}

2 x AMD EPYC 7F52 16-Core

86th

783144 ^{+/- 3102}

AMD EPYC 7702 64-Core

85th

808932 ^{+/- 79114}

2 x AMD EPYC 73F3 16-Core

83rd

838720 ^{+/- 1308}

AMD EPYC 7642 48-Core

83rd

842083 ^{+/- 10627}

AMD EPYC 7542 32-Core

82nd

845935 ^{+/- 4924}

AMD EPYC 7552 48-Core

79th

893295 ^{+/- 2101}

AMD EPYC 7502P 32-Core

78th

901895 ^{+/- 3202}

AMD EPYC 7502 32-Core

77th

907005

Mid-Tier

75th

> 939492

2 x AMD EPYC 7282 16-Core

75th

941316 ^{+/- 7242}

AMD EPYC 7532 32-Core

75th

948359 ^{+/- 26294}

2 x Intel Xeon Platinum 8280

75th

968716 ^{+/- 98133}

AMD EPYC 7452 32-Core

75th

979887

AMD Ryzen Threadripper 3960X 24-Core

74th

1010464 ^{+/- 4158}

2 x AMD EPYC 7601 32-Core

73rd

1015399 ^{+/- 27906}

AMD EPYC 74F3 24-Core

72nd

1076488 ^{+/- 94}

2 x Intel Xeon Gold 5220R

71st

1116116 ^{+/- 6778}

AMD EPYC 7601 32-Core

70th

1157025 ^{+/- 3764}

AMD EPYC 7F72 24-Core

70th

1160719 ^{+/- 14921}

AMD EPYC 7551 32-Core

68th

1188341 ^{+/- 9223}

AMD Ryzen 9 5950X 16-Core

65th

1215392 ^{+/- 7006}

AMD EPYC 7402P 24-Core

64th

1220830 ^{+/- 15671}

AMD Ryzen 9 3950X 16-Core

63rd

1306424 ^{+/- 19882}

AMD EPYC 73F3 16-Core

62nd

1330439 ^{+/- 64}

2 x AMD EPYC 7272 12-Core

62nd

1336200 ^{+/- 3981}

AMD EPYC 7F52 16-Core

61st

1348022 ^{+/- 3910}

Intel Xeon Gold 6258R

60th

1354931 ^{+/- 6254}

Intel Xeon Platinum 8280

59th

1395324 ^{+/- 9478}

AMD EPYC 7352 24-Core

59th

1457950

AMD EPYC 7302P 16-Core

57th

1568169 ^{+/- 3906}

2 x AMD EPYC 7262 8-Core

56th

1584948 ^{+/- 2624}

AMD Ryzen 9 5900X 12-Core

55th

1606310 ^{+/- 6788}

AMD EPYC 7282 16-Core

52nd

1639392 ^{+/- 7060}

Intel Core i9-10980XE

51st

1641106 ^{+/- 2915}

Median

50th

1658387

2 x AMD EPYC 7252 8-Core

50th

1671634 ^{+/- 1070}

AMD Ryzen 9 3900XT 12-Core

48th

1799772 ^{+/- 132080}

AMD Ryzen 9 3900X 12-Core

48th

1803461 ^{+/- 9325}

Intel Xeon Gold 6226R

48th

1804003

Intel Xeon Gold 5220R

47th

2073899 ^{+/- 16742}

Intel Core i9-11900K

46th

2122639 ^{+/- 7432}

Intel Core i9-10900K

43rd

2147387 ^{+/- 15250}

AMD Ryzen 7 5800X 8-Core

42nd

2229494 ^{+/- 45228}

AMD EPYC 7272 12-Core

42nd

2258168 ^{+/- 16637}

Intel Xeon Gold 5218

41st

2318708 ^{+/- 9939}

AMD Ryzen 7 3800XT 8-Core

40th

2389486 ^{+/- 30432}

Intel Xeon Silver 4216

40th

2402267 ^{+/- 1343}

AMD EPYC 72F3 8-Core

38th

2456745 ^{+/- 11248}

Intel Core i7-7900X

37th

2557136 ^{+/- 5957}

AMD EPYC 7F32 8-Core

36th

2656161 ^{+/- 65836}

AMD Ryzen 7 1800X Eight-Core

34th

2960190 ^{+/- 231889}

AMD Ryzen 5 5600X 6-Core

34th

2999394 ^{+/- 48980}

Intel Core i5-11600K

34th

3003547

Intel Xeon E-2288G

33rd

3003644 ^{+/- 98341}

AMD Ryzen 7 2700 Eight-Core

33rd

3013723 ^{+/- 53347}

Intel Xeon Silver 4214R

33rd

3047600

AMD EPYC 7262 8-Core

32nd

3131150

AMD EPYC 7232P 8-Core

31st

3140318 ^{+/- 6414}

Intel Xeon E5-2687W v3

30th

3268110 ^{+/- 1072}

AMD Ryzen 7 4700U

29th

3311907

AMD EPYC 7252 8-Core

29th

3312693

AMD Ryzen 5 3600X 6-Core

28th

3356693

AMD Ryzen 7 1700 Eight-Core

28th

3414240 ^{+/- 197816}

AMD Ryzen 5 3600XT 6-Core

28th

3415448 ^{+/- 3867}

AMD Ryzen 5 2600X Six-Core

28th

3456231 ^{+/- 10852}

Intel Xeon Silver 4215R

27th

3572553

Intel Xeon Gold 5217

26th

3774800

Intel Core i7-8086K

26th

3777707 ^{+/- 2332}

Intel Core i7-8700K

26th

3781611 ^{+/- 1933}

Low-Tier

25th

> 3783777

Intel Core i7-5960X

25th

3881257 ^{+/- 177}

Intel Core i5-10600K

24th

3937052 ^{+/- 6822}

Intel Xeon E-2278GEL

23rd

3959302 ^{+/- 11505}

Intel Core i5-9400F

23rd

4075158 ^{+/- 484}

Intel Core i5-8400

23rd

4170277 ^{+/- 287}

AMD Ryzen 5 4500U

23rd

4205257 ^{+/- 191481}

Intel Core i9-10885H

21st

4667686 ^{+/- 8700}

Intel Core i7-10700T

21st

4668485 ^{+/- 45809}

AMD Ryzen 3 3300X 4-Core

20th

4779473 ^{+/- 830}

Intel Core i7-6800K

19th

4914079 ^{+/- 50617}

Intel Core i7-4960X

18th

4997320 ^{+/- 36672}

AMD Ryzen 3 3100 4-Core

18th

5048004 ^{+/- 835}

Intel Core i7-9750H

17th

5110812 ^{+/- 263186}

AMD Ryzen 5 3400G

17th

5195028 ^{+/- 11376}

Intel Core i7-7700K

17th

5201783 ^{+/- 906}

Intel Core i7-7740K

17th

5211162 ^{+/- 52}

Intel Core i7-9700TE

16th

5390148 ^{+/- 102304}

AMD Ryzen 3 1300X

16th

5417777 ^{+/- 12455}

AMD Ryzen 5 2400G

15th

5491067 ^{+/- 39015}

Intel Core i5-7600K

14th

5851123 ^{+/- 1227}

Intel Xeon E3-1275 v6

14th

5870767 ^{+/- 8482}

Intel Xeon E3-1270 v5

14th

6181699 ^{+/- 1037}

Intel Core i3-10100

14th

6233168 ^{+/- 78}

Intel Core i7-4790K

13th

6259003 ^{+/- 6450}

Intel Xeon E3-1280 v5

13th

6369685 ^{+/- 23995}

Intel Core i3-8100

13th

6490521 ^{+/- 1102}

Intel Xeon E3-1245 v5

12th

6518117 ^{+/- 687}

AMD FX-8370 Eight-Core

12th

6619217 ^{+/- 789}

Intel Xeon E3-1260L v5

12th

7042845 ^{+/- 6315}

Intel Core i5-4670

11th

7065428 ^{+/- 997}

Intel Core i7-5775C

11th

7073255 ^{+/- 11170}

Intel Core i7-1165G7

10th

7345226 ^{+/- 323894}

Intel Xeon E5-2609 v4

9th

7504205 ^{+/- 2901}

Intel Core i7-6700HQ

8th

7575542 ^{+/- 1773}

AMD FX-8150 Eight-Core

7th

7811175 ^{+/- 20167}

Intel Core i5-2500K

6th

8485620 ^{+/- 495}

Intel Core i7-1065G7

6th

8585390 ^{+/- 373792}

Intel Xeon E3-1235L v5

5th

8650855 ^{+/- 2272}

Intel Core i7-8550U

5th

8769820 ^{+/- 742969}

Intel Core i5-3470

5th

8994871 ^{+/- 29228}

Intel Core i7-8565U

4th

9256685 ^{+/- 656327}

Intel Core i3-7100

3rd

11974722 ^{+/- 850}

AMD Ryzen 3 3200U

3rd

13315667 ^{+/- 15674}

Intel Core i3-4130

3rd

14999222 ^{+/- 700}

Intel Core i7-4558U

2nd

15930567 ^{+/- 5075}

Intel Core i7-5600U

2nd

17693280 ^{+/- 18145}

Intel Core i5-5300U

1st

18852389 ^{+/- 703}

Intel Core i5-2520M

1st

19548311 ^{+/- 4409}

Based on OpenBenchmarking.org data, the selected test / test configuration (TensorFlow Lite 2020-08-23 - Model: Inception ResNet V2) has an average run-time of 6 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.2%.

Does It Scale Well With Increasing Cores?

Yes, based on the automated analysis of the collected public benchmark data, this test / test settings does generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set

Support

Instructions Detected

SSE2 (SSE2)

Used by default on supported hardware.

MOVDQA PMULUDQ PSHUFD PSRLDQ MOVD CVTSI2SD ADDSD MULSD SUBSD DIVSD MOVAPD CVTSS2SD CVTTSD2SI SQRTSD UCOMISD XORPD CVTSD2SS CVTTPS2DQ CVTDQ2PS PADDQ MOVDQU PUNPCKLQDQ UNPCKLPD CVTDQ2PD MULPD CVTPD2PS ANDPD MAXSD PSUBQ CVTPS2PD MINSD MOVUPD UNPCKHPD ADDPD PUNPCKHQDQ CVTPS2DQ

Advanced Vector Extensions (AVX)

Used by default on supported hardware.
Found on Intel processors since Sandy Bridge (2011).
Found on AMD processors since Bulldozer (2011).

VBROADCASTF128 VZEROUPPER VMASKMOVPS VEXTRACTF128 VBROADCASTSS VINSERTF128 VPERMILPS

FMA (FMA)

Used by default on supported hardware.
Found on Intel processors since Haswell (2013).
Found on AMD processors since Bulldozer (2011).

VFMADD132PS VFMADD231PS VFMADD213PS

Last automated analysis: 31 January 2021

This test profile binary relies on the shared libraries libm.so.6, libpthread.so.0, libdl.so.2, librt.so.1, libc.so.6.

Xeon Platinum 8380 2P 1 System - 732 Benchmark Results	2 x Intel Xeon Platinum 8380 - Intel M50CYP2SB2U - Intel Device 0998 Ubuntu 20.04 - 5.11.6-051106-generic - GNOME Shell 3.36.4
AMD EPYC 72F3 Performance Benchmarks Featured Processor Comparison	AMD EPYC 7F32 8-Core - AMD EPYC 72F3 8-Core
Clear Linux vs. Ubuntu 21.04 Benchmarks 3 Systems - 101 Benchmark Results	Intel Core i9-10980XE - ASRock X299 Steel Legend - Intel Sky Lake-E DMI3 Registers Ubuntu 20.10 - 5.8.0-50-generic - GNOME Shell 3.38.1
Ubuntu 21.04 EPYC 2 Systems - 434 Benchmark Results	AMD EPYC 72F3 8-Core - Supermicro H12SSL-i v1.01 - AMD Starship Ubuntu 21.04 - 5.11.0-16-generic - GNOME Shell 3.38.4
Clear Linux April 2021 Intel Core i9 2 Systems - 102 Benchmark Results	Intel Core i9-10980XE - ASRock X299 Steel Legend - Intel Sky Lake-E DMI3 Registers Clear Linux OS 34530 - 5.10.31-1033.native - GNOME Shell 3.38.4
Clear Linux April 2021 Intel Core i9 1 System - 103 Benchmark Results	Intel Core i9-10980XE - ASRock X299 Steel Legend - Intel Sky Lake-E DMI3 Registers Clear Linux OS 34530 - 5.10.31-1033.native - GNOME Shell 3.38.4
Core i7 4770K On Ubuntu 20.10 Featured Kernel Comparison	4.15.0-141-generic - 4.15.0-142-generic
Intel Core i5 11600K + Core i9 11900K Linux Performance 10 Systems - 454 Benchmark Results	Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH Ubuntu 21.04 - 5.12.0-051200rc3daily20210315-generic - GNOME Shell 3.38.3
Ubuntu Comparison AMD EPYC 7763 1 System - 136 Benchmark Results	AMD EPYC 7763 64-Core - Supermicro H12SSL-i v1.01 - AMD Starship Ubuntu 20.04 - 5.4.0-72-generic - GNOME Shell 3.36.7
tensor_linux 1 System - 1 Benchmark Result	Intel Core i5-8250U - Dell 0RKTGR - Intel Xeon E3-1200 v6 Arch Linux - 5.11.13-arch1-1 - KDE Plasma 5.21.4
Microsoft Azure EPYC 7003 HBv3 Benchmarks 3 Systems - 95 Benchmark Results	2 x AMD EPYC 7551 32-Core - Microsoft Virtual Machine - 226GB CentOS Linux 8 - 4.18.0-147.8.1.el8_1.x86_64 - GCC 8.3.1 20190507
Microsoft Azure EPYC 7003 HBv3 Benchmarks 2 Systems - 86 Benchmark Results	2 x AMD EPYC 7V12 64-Core - Microsoft Virtual Machine - 450GB CentOS Linux 8 - 4.18.0-147.8.1.el8_1.x86_64 - GCC 8.3.1 20190507

Sandy 3 Systems - 268 Benchmark Results	Intel Core i5-2520M - HP 161C - Intel 2nd Generation Core DRAM Ubuntu 18.04 - 4.18.0-20-generic - GNOME Shell 3.28.3
Renoir vs. Icelake Benchmarks 2 Systems - 535 Benchmark Results	AMD Ryzen 5 4500U - LENOVO LNVNB161216 - AMD Renoir Root Complex Ubuntu 20.04 - 5.9.0-050900rc7daily20201002-generic - GNOME Shell 3.36.4
Ryzen 9 5900X / Ryzen 9 5950X Linux Performance 11 Systems - 217 Benchmark Results	AMD Ryzen 5 2600 Six-Core - ASUS ROG CROSSHAIR VIII HERO - AMD 17h Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4
Fedora 32 vs. Fedora 33 Beta Benchmarks 3 Systems - 174 Benchmark Results	Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH Fedora 32 - 5.8.11-200.fc32.x86_64 - GNOME Shell 3.36.6
Core i9 10900K - Ubuntu 20.04 LTS vs. Ubuntu 20.10 2 Systems - 403 Benchmark Results	Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH Ubuntu 20.04 - 5.4.0-48-generic - GNOME Shell 3.36.4
Ryzen 5 5600X Linux Performance 12 Systems - 229 Benchmark Results	AMD Ryzen 9 3900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4
Ryzen 9 3900XT Ubuntu 20.04 LTS vs. Ubuntu 20.10 3 Systems - 406 Benchmark Results	AMD Ryzen 9 3900XT 12-Core - MSI MEG X570 GODLIKE - AMD Starship Ubuntu 20.04 - 5.4.0-48-generic - GNOME Shell 3.36.4
Ryzen 7 3800XT New Tests End Of August 3 Systems - 11 Benchmark Results	AMD Ryzen 7 3800XT 8-Core - ASRock X570 Pro4 - AMD Starship Ubuntu 20.04 - 5.4.0-42-generic - GNOME Shell 3.36.1
Intel Tiger Lake Mitigation COmparison 8 Systems - 32 Benchmark Results	Intel Core i7-1065G7 - Dell 06CDVY - Intel Device 34ef Ubuntu 20.10 - 5.8.0-25-generic - GNOME Shell 3.38.1
10700T openSUSE 2 Systems - 78 Benchmark Results	Intel Core i7-10700T - Logic Supply RXM-181 - Intel Comet Lake PCH openSUSE 15.3 - 5.3.18-47-default - KDE Plasma 5.18.6
Aventinus 2 Systems - 81 Benchmark Results	2 x AMD EPYC 7742 64-Core - Supermicro H11DSi-NT v2.00 - AMD Starship Ubuntu 20.04 - 5.8.0-44-generic - GNOME Shell 3.36.4
Ryzen 7 1700 Summer Featured Kernel Comparison	AMD Ryzen 7 1700 Eight-Core - MSI B350 TOMAHAWK - AMD 17h Ubuntu 19.10 - 5.3.0-46-generic - GNOME Shell 3.34.1

TensorFlow Lite

Project Site

Test Created

Test Maintainer

Test Type

Average Install Time

Average Run Time

Supported Platforms

Revision History

Suites Using This Test

Performance Metrics

TensorFlow Lite 2020-08-23

Model: Inception ResNet V2

Does It Scale Well With Increasing Cores?

Notable Instruction Set Usage

Recent Test Results

Most Popular Test Results