TensorFlow Lite

This is a benchmark of the TensorFlow Lite implementation. The current Linux support is limited to running on CPUs. This test profile is measuring the average inference time.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark tensorflow-lite.

Project Site

tensorflow.org

Test Created

23 August 2020

Test Maintainer

Michael Larabel 

Test Type

System

Average Install Time

11 Seconds

Average Run Time

5 Minutes, 25 Seconds

Accolades

5k+ Downloads

Supported Platforms


Public Result Uploads *Reported Installs **Reported Test Completions **Test Profile Page Views ***OpenBenchmarking.orgEventsTensorFlow Lite Popularity Statisticspts/tensorflow-lite2020.082020.092020.102020.112020.122021.012021.022021.032021.042021.052021.062021.072021.082021.092021.102K4K6K8K10K
* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
*** Test profile page view reporting began March 2021.
Data current as of 22 October 2021.
Mobilenet Float16.3%Inception ResNet V217.7%SqueezeNet16.2%Inception V416.7%Mobilenet Quant16.2%NASNet Mobile16.8%Model Option PopularityOpenBenchmarking.org

Revision History

pts/tensorflow-lite-1.0.0   [View Source]   Sun, 23 Aug 2020 14:13:10 GMT
TensorFlow Lite initial commit.

Suites Using This Test

Machine Learning

HPC - High Performance Computing


Performance Metrics

Analyze Test Configuration:

TensorFlow Lite 2020-08-23

Model: Inception ResNet V2

OpenBenchmarking.org metrics for this test profile configuration based on 1,261 public results since 23 August 2020 with the latest data as of 23 October 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Compatible Public Results
Microseconds (Average)
100th
18
408330 +/- 23263
98th
11
474952 +/- 42645
98th
16
483074 +/- 41759
95th
25
575678 +/- 8160
94th
13
590211 +/- 52444
93rd
11
616954 +/- 5125
93rd
3
629609 +/- 37273
91st
3
693216 +/- 25653
90th
13
709525 +/- 77942
90th
10
712514 +/- 59513
87th
11
739529 +/- 6732
87th
21
742157 +/- 10612
86th
5
752316 +/- 16452
84th
7
773867 +/- 6436
84th
4
783144 +/- 3102
84th
3
783761 +/- 74
83rd
45
808932 +/- 79114
82nd
4
823239 +/- 17126
81st
19
834802 +/- 8751
80th
6
839110 +/- 1510
79th
10
842083 +/- 10627
79th
8
845935 +/- 4924
77th
7
872338 +/- 9172
Mid-Tier
75th
> 892001
75th
10
893295 +/- 2101
74th
16
901895 +/- 3202
72nd
5
941316 +/- 7242
72nd
10
948359 +/- 26294
72nd
19
968716 +/- 98133
70th
7
1015399 +/- 27906
69th
9
1025480 +/- 870
68th
9
1076420 +/- 1944
67th
10
1116116 +/- 6778
67th
3
1116922 +/- 708
66th
3
1130599 +/- 166
66th
4
1157025 +/- 3764
65th
15
1160719 +/- 14921
64th
6
1188341 +/- 9223
61st
44
1216906 +/- 7662
61st
16
1220830 +/- 15671
59th
8
1306424 +/- 19882
58th
6
1330458 +/- 74
58th
5
1336200 +/- 3981
57th
18
1348022 +/- 3910
56th
3
1354931 +/- 6254
56th
3
1384993 +/- 1241
56th
7
1395324 +/- 9478
54th
15
1568169 +/- 3906
53rd
6
1584948 +/- 2624
52nd
34
1607121 +/- 7317
Median
50th
1613467
50th
23
1623994 +/- 45263
49th
10
1639392 +/- 7060
47th
6
1671634 +/- 1070
46th
13
1799772 +/- 132080
46th
6
1803461 +/- 9325
45th
3
2073899 +/- 16742
44th
13
2123109 +/- 8912
41st
28
2147387 +/- 15250
40th
12
2257575 +/- 106406
40th
8
2258168 +/- 16637
39th
3
2312644 +/- 7942
39th
6
2318708 +/- 9939
38th
15
2389486 +/- 30432
38th
8
2402267 +/- 1343
36th
6
2460004 +/- 12844
35th
3
2557136 +/- 5957
35th
17
2656161 +/- 65836
33rd
7
2960190 +/- 231889
32nd
16
2997286 +/- 48065
32nd
10
3003644 +/- 98341
32nd
4
3013723 +/- 53347
30th
16
3140318 +/- 6414
28th
3
3268110 +/- 1072
28th
6
3338235 +/- 28880
27th
11
3414240 +/- 197816
27th
3
3415448 +/- 3867
27th
4
3456231 +/- 10852
Low-Tier
25th
> 3664460
25th
3
3777707 +/- 2332
25th
3
3781611 +/- 1933
24th
4
3881257 +/- 177
23rd
15
3937052 +/- 6822
23rd
3
3959302 +/- 11505
22nd
3
4075158 +/- 484
22nd
3
4170277 +/- 287
22nd
16
4192119 +/- 192307
21st
10
4399915 +/- 37099
20th
6
4667686 +/- 8700
19th
13
4668485 +/- 45809
18th
9
4779473 +/- 830
17th
4
4914079 +/- 50617
17th
6
4997320 +/- 36672
17th
6
5048004 +/- 835
16th
10
5132820 +/- 257709
16th
3
5195028 +/- 11376
16th
3
5211162 +/- 52
15th
4
5305553 +/- 207541
15th
4
5390148 +/- 102304
15th
3
5417777 +/- 12455
14th
3
5491067 +/- 39015
14th
3
5851123 +/- 1227
13th
4
5870767 +/- 8482
13th
3
6181699 +/- 1037
13th
3
6233168 +/- 78
13th
3
6259003 +/- 6450
12th
3
6369685 +/- 23995
12th
3
6490521 +/- 1102
12th
3
6518117 +/- 687
11th
4
6619217 +/- 789
11th
3
7042845 +/- 6315
11th
3
7065428 +/- 997
10th
4
7073255 +/- 11170
9th
38
7288337 +/- 330881
8th
3
7504205 +/- 2901
7th
3
7575542 +/- 1773
7th
4
7811175 +/- 20167
5th
3
8485620 +/- 495
5th
13
8586017 +/- 357886
5th
3
8650855 +/- 2272
5th
7
8769820 +/- 742969
4th
3
8994871 +/- 29228
4th
8
9137310 +/- 695148
3rd
3
11974722 +/- 850
3rd
3
13315667 +/- 15674
2nd
3
14999222 +/- 700
2nd
4
15930567 +/- 5075
2nd
5
17693280 +/- 18145
1st
3
18852389 +/- 703
1st
3
19548311 +/- 4409
OpenBenchmarking.orgDistribution Of Public Results - Model: Inception ResNet V21260 Results Range From 382316 To 31032833 Microseconds38231699532716083382221349283436034473714060382467339352864045899415651242671254377738448835145989644709577481101904921080350311416514120295251264253613255547138685581448156915094580157075911632060216933613175466241815963518772646193856571999866820611679212246902183770122450712230637232367673424289745249027562551576726128778267417892735480027967811285808222919383329806844304198553103286680160240320400

Based on OpenBenchmarking.org data, the selected test / test configuration (TensorFlow Lite 2020-08-23 - Model: Inception ResNet V2) has an average run-time of 6 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkModel: Inception ResNet V2Run-Time48121620Min: 1 / Avg: 5.51 / Max: 16

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.2%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsModel: Inception ResNet V2Deviation246810Min: 0 / Avg: 0.15 / Max: 3

Does It Scale Well With Increasing Cores?

Yes, based on the automated analysis of the collected public benchmark data, this test / test settings does generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

IntelAMDOpenBenchmarking.orgRelative Core Scaling To BaseTensorFlow Lite CPU Core ScalingModel: Inception ResNet V2246812162432486412848121620

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set
Support
Instructions Detected
SSE2 (SSE2)
Used by default on supported hardware.
 
MOVDQA PMULUDQ PSHUFD PSRLDQ MOVD CVTSI2SD ADDSD MULSD SUBSD DIVSD MOVAPD CVTSS2SD CVTTSD2SI SQRTSD UCOMISD XORPD CVTSD2SS CVTTPS2DQ CVTDQ2PS PADDQ MOVDQU PUNPCKLQDQ UNPCKLPD CVTDQ2PD MULPD CVTPD2PS ANDPD MAXSD PSUBQ CVTPS2PD MINSD MOVUPD UNPCKHPD ADDPD PUNPCKHQDQ CVTPS2DQ
Used by default on supported hardware.
Found on Intel processors since Sandy Bridge (2011).
Found on AMD processors since Bulldozer (2011).

 
VBROADCASTF128 VZEROUPPER VMASKMOVPS VEXTRACTF128 VBROADCASTSS VINSERTF128 VPERMILPS
FMA (FMA)
Used by default on supported hardware.
Found on Intel processors since Haswell (2013).
Found on AMD processors since Bulldozer (2011).

 
VFMADD132PS VFMADD231PS VFMADD213PS
Last automated analysis: 10 May 2021

This test profile binary relies on the shared libraries libm.so.6, libpthread.so.0, libdl.so.2, librt.so.1, libc.so.6.

Recent Test Results

OpenBenchmarking.org Results Compare

1 System - 3 Benchmark Results

Intel Core i7-1065G7 - Oracle VirtualBox v1.2 - Intel 440FX 82441FX PMC

Ubuntu 20.04 - 5.11.0-38-generic - GNOME Shell 3.36.9

1 System - 290 Benchmark Results

AMD Ryzen 9 5900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 21.10 - 5.13.0-20-generic - GNOME Shell 40.5

1 System - 3 Benchmark Results

Intel Core i7-1065G7 - Oracle VirtualBox v1.2 - Intel 440FX 82441FX PMC

Ubuntu 20.04 - 5.11.0-38-generic - GNOME Shell 3.36.9

1 System - 3 Benchmark Results

Intel Core i5-8500 - Dell 0NC2VH - Intel Cannon Lake PCH

Debian GNU - 5.11.22-5-pve - GCC 10.2.1 20210110

1 System - 8 Benchmark Results

Intel Core i5-8500 - Dell 0NC2VH - Intel Cannon Lake PCH

Debian GNU - 5.11.22-5-pve - GCC 10.2.1 20210110

1 System - 1 Benchmark Result

Intel Core i5-8500 - Dell 0NC2VH - Intel Cannon Lake PCH

Debian GNU - 5.11.22-5-pve - GCC 10.2.1 20210110

2 Systems - 160 Benchmark Results

Intel Core i9-10980XE - ASRock X299 Steel Legend - Intel Sky Lake-E DMI3 Registers

Clear Linux OS 35000 - 5.13.13-1070.native - GNOME Shell 40.4

1 System - 1 Benchmark Result

Intel Core i5-4590 - Dell 0WMJ54 - 16GB

Ubuntu 20.04.1 LTS - 5.14.11-300.fc35.x86_64 - i915

1 System - 1 Benchmark Result

Intel Core i5-4590 - Dell 0WMJ54 - 16GB

Ubuntu 20.04.1 LTS - 5.14.11-300.fc35.x86_64 - i915

1 System - 1 Benchmark Result

Intel Core i5-4590 - Dell 0WMJ54 - 16GB

Ubuntu 20.04.1 LTS - 5.14.11-300.fc35.x86_64 - i915

1 System - 2 Benchmark Results

Intel Core i5-4590 - Dell 0WMJ54 - 16GB

Ubuntu 20.04.1 LTS - 5.14.11-300.fc35.x86_64 - i915

1 System - 4 Benchmark Results

Intel Core i5-4590 - Dell 0WMJ54 - 16GB

Ubuntu 20.04.1 LTS - 5.14.11-300.fc35.x86_64 - i915

1 System - 1 Benchmark Result

Intel Core i5-4590 - Dell 0WMJ54 - 16GB

Ubuntu 20.04.1 LTS - 5.14.11-300.fc35.x86_64 - i915

1 System - 2 Benchmark Results

Intel Core i5-4590 - Dell 0WMJ54 - 16GB

Ubuntu 20.04.1 LTS - 5.14.11-300.fc35.x86_64 - i915

1 System - 1 Benchmark Result

Intel Core i5-4590 - Dell 0WMJ54 - 16GB

Ubuntu 20.04.1 LTS - 5.14.11-300.fc35.x86_64 - i915

Most Popular Test Results

OpenBenchmarking.org Results Compare

3 Systems - 268 Benchmark Results

Intel Core i5-2520M - HP 161C - Intel 2nd Generation Core DRAM

Ubuntu 18.04 - 4.18.0-20-generic - GNOME Shell 3.28.3

2 Systems - 535 Benchmark Results

AMD Ryzen 5 4500U - LENOVO LNVNB161216 - AMD Renoir Root Complex

Ubuntu 20.04 - 5.9.0-050900rc7daily20201002-generic - GNOME Shell 3.36.4

11 Systems - 217 Benchmark Results

AMD Ryzen 7 3800XT 8-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4

3 Systems - 174 Benchmark Results

Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH

Fedora 33 - 5.8.11-300.fc33.x86_64 - GNOME Shell 3.38.0

8 Systems - 439 Benchmark Results

AMD Ryzen 7 5800X 8-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 21.04 - 5.12.0-051200rc3daily20210315-generic - GNOME Shell 3.38.3

12 Systems - 229 Benchmark Results

AMD Ryzen 5 2600X Six-Core - ASUS ROG CROSSHAIR VIII HERO - AMD 17h

Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4

8 Systems - 32 Benchmark Results

Intel Core i7-1165G7 - Dell 0GG9PT - Intel Tiger Lake-LP

Ubuntu 20.10 - 5.10.0-051000rc7daily20201213-generic - GNOME Shell 3.38.1

2 Systems - 403 Benchmark Results

Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH

Ubuntu 20.10 - 5.8.0-22-generic - GNOME Shell 3.38.0

2 Systems - 78 Benchmark Results

Intel Core i7-10700T - Logic Supply RXM-181 - Intel Comet Lake PCH

openSUSE 15.3 - 5.3.18-47-default - KDE Plasma 5.18.6

3 Systems - 406 Benchmark Results

Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH

Ubuntu 20.04 - 5.4.0-48-generic - GNOME Shell 3.36.4

2 Systems - 81 Benchmark Results

2 x AMD EPYC 7742 64-Core - Supermicro H11DSi-NT v2.00 - AMD Starship

Ubuntu 20.04 - 5.8.0-44-generic - GNOME Shell 3.36.4

3 Systems - 376 Benchmark Results

2 x AMD EPYC 7F72 24-Core - Supermicro H11DSi-NT v2.00 - AMD Starship

Ubuntu 20.10 - 5.11.0-051100rc4daily20210122-generic - GNOME Shell 3.38.1

26 Systems - 438 Benchmark Results

2 x Intel Xeon Platinum 8280 - GIGABYTE MD61-SC2-00 v01000100 - Intel Sky Lake-E DMI3 Registers

Ubuntu 20.04 - 5.11.0-051100rc6daily20210201-generic - GNOME Shell 3.36.4

2 Systems - 297 Benchmark Results

AMD Ryzen Threadripper 3990X 64-Core - System76 Thelio Major - AMD Starship

Pop 20.10 - 5.8.0-7625-generic - GNOME Shell 3.38.1

3 Systems - 108 Benchmark Results

Intel Core i7-10700T - Logic Supply RXM-181 - Intel Comet Lake PCH

Ubuntu 20.10 - 5.8.0-43-generic - GNOME Shell 3.38.2

Find More Test Results