TensorFlow Lite

This is a benchmark of the TensorFlow Lite implementation. The current Linux support is limited to running on CPUs. This test profile is measuring the average inference time.

Learn more about this test at the upstream project site: https://www.tensorflow.org/lite/performance/measurement.

This benchmark test profile is maintained by Michael Larabel. This OpenBenchmarking.org test profile was created on 23 August 2020. To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark tensorflow-lite.

This test has an average install time of 9 seconds and an average run-time of 4 minutes, 41 seconds.

Mobilenet Float16.7%Inception ResNet V216.8%SqueezeNet16.4%Inception V417.0%Mobilenet Quant16.8%NASNet Mobile16.2%Model Option PopularityOpenBenchmarking.org

Revision History

pts/tensorflow-lite-1.0.0   [View Source]   23 Aug 2020 14:13 EDT
TensorFlow Lite initial commit.

Suites Using This Test

Machine Learning

Performance Metrics

Analyze Test Configuration:

TensorFlow Lite 2020-08-23

Model: Inception V4

OpenBenchmarking.org metrics for this test profile configuration based on 631 public samples since 23 August 2020 with the latest data as of 17 November 2020.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
Microseconds (Average)
Mid-Tier
75th
> 1356853
Median
50th
2541097
Low-Tier
25th
> 5277420
OpenBenchmarking.orgDistribution Of Public Results - Model: Inception V4631 Results Range From 552858 To 28134967 Microseconds55285811045011656144220778727594303311073386271644143594966002551764560692886620931717257477242178275860882750393791469930789104824321103407511585718121373611268900413240647137922901434393314895576154472191599886216550505171021481765379118205434187570771930872019860363204120062096364921515292220669352261857823170221237218642427350724825150253767932592843626480079270317222758336528135008306090120150

Based on OpenBenchmarking.org data, the selected test / test configuration (TensorFlow Lite 2020-08-23 - Model: Inception V4) has an average run-time of 6 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkModel: Inception V4Run-Time48121620Min: 3 / Avg: 6.13 / Max: 14

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.1%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsModel: Inception V4Deviation246810Min: 0 / Avg: 0.11 / Max: 2

Recent Test Results

Compare

12 Systems - 224 Benchmark Results

AMD Ryzen 9 3900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4

19 Systems - 176 Benchmark Results

AMD EPYC 7402P 24-Core - ASRockRack EPYCD8 - AMD Starship

Ubuntu 20.10 - 5.8.0-21-generic - GNOME Shell 3.38.0

1 System - 6 Benchmark Results

AMD Ryzen 9 5900X 12-Core - MSI MAG X570 TOMAHAWK WIFI - 32GB

Ubuntu 20.04 LTS - 5.9.0-1-amd64 - overlayfs

7 Systems - 349 Benchmark Results

AMD Ryzen 7 5800X 8-Core - ASRock X570 Pro4 - AMD Starship

Ubuntu 20.10 - 5.8.0-26-generic - GNOME Shell 3.38.1

6 Systems - 349 Benchmark Results

AMD Ryzen 9 5900X 12-Core - ASRock X570 Pro4 - AMD Starship

Ubuntu 20.10 - 5.8.0-26-generic - GNOME Shell 3.38.1

1 System - 282 Benchmark Results

AMD Ryzen 9 5900X 12-Core - ASRock X570 Pro4 - AMD Starship

Ubuntu 20.10 - 5.8.0-26-generic - GNOME Shell 3.38.1

2 Systems - 229 Benchmark Results

AMD Ryzen 5 5600X 6-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4

12 Systems - 229 Benchmark Results

AMD Ryzen 5 5600X 6-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4

11 Systems - 217 Benchmark Results

AMD Ryzen 9 5950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4

3 Systems - 165 Benchmark Results

Intel Xeon E-2288G - Compulab SBC-ATCFL v1.2 - Intel Cannon Lake PCH

Ubuntu 20.10 - 5.8.0-26-generic - GNOME Shell 3.38.1

4 Systems - 63 Benchmark Results

AMD Ryzen 7 3800XT 8-Core - MSI X370 XPOWER GAMING TITANIUM - AMD Starship

Debian 10 - 4.19.0-12-amd64 - X Server 1.20.4

Most Popular Test Results

Compare

3 Systems - 268 Benchmark Results

Intel Core i5-2520M - HP 161C - Intel 2nd Generation Core DRAM

Ubuntu 18.04 - 4.18.0-20-generic - GNOME Shell 3.28.3

2 Systems - 535 Benchmark Results

AMD Ryzen 5 4500U - LENOVO LNVNB161216 - AMD Renoir Root Complex

Ubuntu 20.04 - 5.9.0-050900rc7daily20201002-generic - GNOME Shell 3.36.4

11 Systems - 217 Benchmark Results

AMD Ryzen 9 3900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4

3 Systems - 174 Benchmark Results

Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH

Fedora 32 - 5.8.11-200.fc32.x86_64 - GNOME Shell 3.36.6

2 Systems - 403 Benchmark Results

Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH

Ubuntu 20.04 - 5.4.0-48-generic - GNOME Shell 3.36.4

3 Systems - 11 Benchmark Results

AMD Ryzen 7 3800XT 8-Core - ASRock X570 Pro4 - AMD Starship

Ubuntu 20.04 - 5.4.0-42-generic - GNOME Shell 3.36.1

3 Systems - 406 Benchmark Results

AMD Ryzen 9 3900XT 12-Core - MSI MEG X570 GODLIKE - AMD Starship

Ubuntu 20.10 - 5.8.0-20-generic - GNOME Shell 3.38.0

3 Systems - 202 Benchmark Results

Intel Core i7-7700K - MSI Z270-A PRO - Intel Xeon E3-1200 v6

Ubuntu 20.04 - 5.8.14-050814-generic - GNOME Shell 3.36.4

3 Systems - 197 Benchmark Results

Intel Core i7-4790K - Gigabyte Z97-HD3P - Intel 4th Gen Core DRAM

Ubuntu 19.10 - 5.5.0-rc2-patched - GNOME Shell 3.34.1

Find More Test Results


User Comments

Post A Comment