TensorFlow Lite

This is a benchmark of the TensorFlow Lite implementation. The current Linux support is limited to running on CPUs. This test profile is measuring the average inference time.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark tensorflow-lite.

Project Site

tensorflow.org

Test Created

23 August 2020

Test Maintainer

Michael Larabel 

Test Type

System

Average Install Time

12 Seconds

Average Run Time

5 Minutes, 25 Seconds

Accolades

5k+ Downloads

Supported Platforms


Public Result Uploads *Reported Installs **Reported Test Completions **Test Profile Page Views ***OpenBenchmarking.orgEventsTensorFlow Lite Popularity Statisticspts/tensorflow-lite2020.082020.092020.102020.112020.122021.012021.022021.032021.042021.052021.062021.072K4K6K8K10K
* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
*** Test profile page view reporting began March 2021.
Data current as of 26 July 2021.
Mobilenet Float16.2%Inception ResNet V218.0%SqueezeNet16.5%Inception V416.9%Mobilenet Quant16.4%NASNet Mobile15.9%Model Option PopularityOpenBenchmarking.org

Revision History

pts/tensorflow-lite-1.0.0   [View Source]   Sun, 23 Aug 2020 14:13:10 GMT
TensorFlow Lite initial commit.

Suites Using This Test

Machine Learning

HPC - High Performance Computing


Performance Metrics

Analyze Test Configuration:

TensorFlow Lite 2020-08-23

Model: Inception ResNet V2

OpenBenchmarking.org metrics for this test profile configuration based on 1,218 public results since 23 August 2020 with the latest data as of 20 July 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Compatible Public Results
Microseconds (Average)
100th
18
408330 +/- 23263
98th
11
474952 +/- 42645
98th
16
483074 +/- 41759
96th
18
572097 +/- 2125
95th
13
590211 +/- 52444
94th
11
616954 +/- 5125
93rd
3
629609 +/- 37273
91st
11
677870 +/- 7485
91st
3
693216 +/- 25653
90th
10
712514 +/- 59513
87th
11
739529 +/- 6732
87th
21
742157 +/- 10612
86th
5
752316 +/- 16452
84th
7
773867 +/- 6436
84th
4
783144 +/- 3102
84th
3
783761 +/- 74
83rd
45
808932 +/- 79114
82nd
4
823239 +/- 17126
81st
13
833509 +/- 9845
80th
6
839110 +/- 1510
79th
10
842083 +/- 10627
79th
8
845935 +/- 4924
77th
7
872338 +/- 9172
76th
10
893295 +/- 2101
Mid-Tier
75th
> 893517
74th
16
901895 +/- 3202
72nd
5
941316 +/- 7242
72nd
10
948359 +/- 26294
72nd
19
968716 +/- 98133
70th
7
1015399 +/- 27906
70th
9
1025480 +/- 870
68th
6
1076460 +/- 108
68th
10
1116116 +/- 6778
67th
3
1116922 +/- 708
67th
3
1130599 +/- 166
66th
4
1157025 +/- 3764
66th
15
1160719 +/- 14921
65th
6
1188341 +/- 9223
62nd
42
1216392 +/- 7457
61st
16
1220830 +/- 15671
59th
8
1306424 +/- 19882
59th
6
1330458 +/- 74
58th
5
1336200 +/- 3981
57th
18
1348022 +/- 3910
56th
3
1354931 +/- 6254
56th
3
1384993 +/- 1241
56th
7
1395324 +/- 9478
54th
15
1568169 +/- 3906
53rd
6
1584948 +/- 2624
52nd
32
1606310 +/- 6788
Median
50th
1614363
49th
10
1639392 +/- 7060
49th
21
1641106 +/- 2915
47th
6
1671634 +/- 1070
46th
13
1799772 +/- 132080
46th
6
1803461 +/- 9325
45th
3
2073899 +/- 16742
44th
12
2124050 +/- 8609
41st
28
2147387 +/- 15250
40th
11
2229494 +/- 45228
40th
8
2258168 +/- 16637
39th
6
2318708 +/- 9939
38th
15
2389486 +/- 30432
38th
8
2402267 +/- 1343
36th
6
2460004 +/- 12844
36th
3
2557136 +/- 5957
35th
17
2656161 +/- 65836
33rd
7
2960190 +/- 231889
32nd
15
2999394 +/- 48980
32nd
10
3003644 +/- 98341
32nd
4
3013723 +/- 53347
30th
16
3140318 +/- 6414
29th
3
3268110 +/- 1072
28th
6
3338235 +/- 28880
27th
11
3414240 +/- 197816
27th
3
3415448 +/- 3867
27th
4
3456231 +/- 10852
Low-Tier
25th
> 3745460
25th
3
3777707 +/- 2332
25th
3
3781611 +/- 1933
24th
4
3881257 +/- 177
23rd
14
3937052 +/- 6822
23rd
3
3959302 +/- 11505
22nd
3
4075158 +/- 484
22nd
3
4170277 +/- 287
22nd
16
4192119 +/- 192307
21st
10
4399915 +/- 37099
19th
6
4667686 +/- 8700
19th
13
4668485 +/- 45809
18th
9
4779473 +/- 830
17th
4
4914079 +/- 50617
17th
6
4997320 +/- 36672
17th
6
5048004 +/- 835
16th
10
5132820 +/- 257709
16th
3
5195028 +/- 11376
16th
3
5211162 +/- 52
15th
4
5305553 +/- 207541
15th
4
5390148 +/- 102304
15th
3
5417777 +/- 12455
14th
3
5491067 +/- 39015
13th
3
5851123 +/- 1227
13th
4
5870767 +/- 8482
13th
3
6181699 +/- 1037
13th
3
6233168 +/- 78
12th
3
6259003 +/- 6450
12th
3
6369685 +/- 23995
12th
3
6490521 +/- 1102
12th
3
6518117 +/- 687
11th
4
6619217 +/- 789
11th
3
7042845 +/- 6315
10th
3
7065428 +/- 997
10th
4
7073255 +/- 11170
9th
29
7330607 +/- 326563
8th
3
7504205 +/- 2901
7th
3
7575542 +/- 1773
7th
4
7811175 +/- 20167
5th
3
8485620 +/- 495
5th
13
8586017 +/- 357886
5th
3
8650855 +/- 2272
5th
7
8769820 +/- 742969
4th
3
8994871 +/- 29228
4th
8
9137310 +/- 695148
3rd
3
11974722 +/- 850
3rd
3
13315667 +/- 15674
2nd
3
14999222 +/- 700
2nd
4
15930567 +/- 5075
2nd
5
17693280 +/- 18145
1st
3
18852389 +/- 703
1st
3
19548311 +/- 4409
OpenBenchmarking.orgDistribution Of Public Results - Model: Inception ResNet V21218 Results Range From 382316 To 31032833 Microseconds38231699532716083382221349283436034473714060382467339352864045899415651242671254377738448835145989644709577481101904921080350311416514120295251264253613255547138685581448156915094580157075911632060216933613175466241815963518772646193856571999866820611679212246902183770122450712230637232367673424289745249027562551576726128778267417892735480027967811285808222919383329806844304198553103286680160240320400

Based on OpenBenchmarking.org data, the selected test / test configuration (TensorFlow Lite 2020-08-23 - Model: Inception ResNet V2) has an average run-time of 6 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkModel: Inception ResNet V2Run-Time48121620Min: 1 / Avg: 5.41 / Max: 16

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.1%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsModel: Inception ResNet V2Deviation246810Min: 0 / Avg: 0.15 / Max: 3

Does It Scale Well With Increasing Cores?

Yes, based on the automated analysis of the collected public benchmark data, this test / test settings does generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

IntelAMDOpenBenchmarking.orgRelative Core Scaling To BaseTensorFlow Lite CPU Core ScalingModel: Inception ResNet V22468121624324864128612182430

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set
Support
Instructions Detected
SSE2 (SSE2)
Used by default on supported hardware.
 
MOVDQA PMULUDQ PSHUFD PSRLDQ MOVD CVTSI2SD ADDSD MULSD SUBSD DIVSD MOVAPD CVTSS2SD CVTTSD2SI SQRTSD UCOMISD XORPD CVTSD2SS CVTTPS2DQ CVTDQ2PS PADDQ MOVDQU PUNPCKLQDQ UNPCKLPD CVTDQ2PD MULPD CVTPD2PS ANDPD MAXSD PSUBQ CVTPS2PD MINSD MOVUPD UNPCKHPD ADDPD PUNPCKHQDQ CVTPS2DQ
Used by default on supported hardware.
Found on Intel processors since Sandy Bridge (2011).
Found on AMD processors since Bulldozer (2011).

 
VBROADCASTF128 VZEROUPPER VMASKMOVPS VEXTRACTF128 VBROADCASTSS VINSERTF128 VPERMILPS
FMA (FMA)
Used by default on supported hardware.
Found on Intel processors since Haswell (2013).
Found on AMD processors since Bulldozer (2011).

 
VFMADD132PS VFMADD231PS VFMADD213PS
Last automated analysis: 10 May 2021

This test profile binary relies on the shared libraries libm.so.6, libpthread.so.0, libdl.so.2, librt.so.1, libc.so.6.

Recent Test Results

OpenBenchmarking.org Results Compare

3 Systems - 240 Benchmark Results

AMD EPYC 7F32 8-Core - Supermicro H12SSL-i v1.01 - AMD Starship

Ubuntu 21.04 - 5.11.0-16-generic - GNOME Shell 3.38.4

3 Systems - 240 Benchmark Results

AMD EPYC 7F32 8-Core - Supermicro H12SSL-i v1.01 - AMD Starship

Ubuntu 21.04 - 5.11.0-16-generic - GNOME Shell 3.38.4

1 System - 12 Benchmark Results

Intel Core i5-8600K - ASRock Z390 Extreme4 - 32GB

Ubuntu 20.04.2 LTS - 4.15.0-66-generic - NVIDIA

1 System - 27 Benchmark Results

Intel Core i5-8600K - ASRock Z390 Extreme4 - 32GB

Ubuntu 20.04.2 LTS - 4.15.0-66-generic - NVIDIA

3 Systems - 253 Benchmark Results

AMD Ryzen 7 4700U - LENOVO LNVNB161216 - AMD Renoir Root Complex

Ubuntu 20.04 - 5.9.0-050900rc7daily20201003-generic - GNOME Shell 3.36.9

1 System - 162 Benchmark Results

2 x AMD EPYC 7763 64-Core - AMD DAYTONA_X - AMD Starship

Ubuntu 21.04 - 5.14.0-rc1-vanilla - X Server 1.20.11

1 System - 88 Benchmark Results

AMD Ryzen 5 3600 6-Core - Gigabyte X570 AORUS PRO - AMD Starship

ManjaroLinux 21.1.0 - 5.13.1-3-MANJARO - X Server 1.20.11

11 Systems - 56 Benchmark Results

AMD EPYC 7543 32-Core - TYAN S8036GM2NE-LE - AMD Starship

Rocky Linux 8.4 - 4.18.0-305.3.1.el8_4.x86_64 - GNOME Shell 3.32.2

10 Systems - 77 Benchmark Results

AMD EPYC 7543 32-Core - TYAN S8036GM2NE-LE - AMD Starship

Debian 11 - 5.10.0-7-amd64 - GNOME Shell 3.38.4

9 Systems - 77 Benchmark Results

AMD EPYC 7543 32-Core - TYAN S8036GM2NE-LE - AMD Starship

Clear Linux OS 34770 - 5.12.8-1045.native - GNOME Shell 40.2

Most Popular Test Results

OpenBenchmarking.org Results Compare

3 Systems - 268 Benchmark Results

Intel Core i5-2520M - HP 161C - Intel 2nd Generation Core DRAM

Ubuntu 18.04 - 4.18.0-20-generic - GNOME Shell 3.28.3

2 Systems - 535 Benchmark Results

AMD Ryzen 5 4500U - LENOVO LNVNB161216 - AMD Renoir Root Complex

Ubuntu 20.04 - 5.9.0-050900rc7daily20201002-generic - GNOME Shell 3.36.4

11 Systems - 217 Benchmark Results

AMD Ryzen 5 3600X 6-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4

3 Systems - 174 Benchmark Results

Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH

Fedora 32 - 5.6.6-300.fc32.x86_64 - GNOME Shell 3.36.1

12 Systems - 229 Benchmark Results

AMD Ryzen 9 5950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4

2 Systems - 78 Benchmark Results

Intel Core i7-10700T - Logic Supply RXM-181 - Intel Comet Lake PCH

openSUSE 15.3 - 5.3.18-47-default - KDE Plasma 5.18.6

8 Systems - 32 Benchmark Results

Intel Core i7-1165G7 - Dell 0GG9PT - Intel Tiger Lake-LP

Ubuntu 20.10 - 5.8.0-31-generic - GNOME Shell 3.38.1

8 Systems - 439 Benchmark Results

AMD Ryzen 7 5800X 8-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 21.04 - 5.12.0-051200rc3daily20210315-generic - GNOME Shell 3.38.3

2 Systems - 403 Benchmark Results

Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH

Ubuntu 20.10 - 5.8.0-22-generic - GNOME Shell 3.38.0

2 Systems - 81 Benchmark Results

2 x AMD EPYC 7742 64-Core - Supermicro H11DSi-NT v2.00 - AMD Starship

Ubuntu 20.04 - 5.8.0-44-generic - GNOME Shell 3.36.4

3 Systems - 406 Benchmark Results

AMD Ryzen 9 3900XT 12-Core - MSI MEG X570 GODLIKE - AMD Starship

Ubuntu 20.10 - 5.8.0-20-generic - GNOME Shell 3.38.0

2 Systems - 95 Benchmark Results

AMD Ryzen 9 5900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.10 - 5.12.0-051200rc2-generic - GNOME Shell 3.38.1

Find More Test Results