TensorFlow Lite

This is a benchmark of the TensorFlow Lite implementation. The current Linux support is limited to running on CPUs. This test profile is measuring the average inference time.

Learn more about this test at the upstream project site: tensorflow.org.

This benchmark test is maintained by Michael Larabel. This OpenBenchmarking.org test profile was created on 23 August 2020. To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark tensorflow-lite.

This test has an average install time of 8 seconds and an average run-time of 4 minutes, 40 seconds.

Mobilenet Float16.0%Inception ResNet V217.2%SqueezeNet16.0%Inception V417.4%Mobilenet Quant17.3%NASNet Mobile16.0%Model Option PopularityOpenBenchmarking.org

Revision History

pts/tensorflow-lite-1.0.0   [View Source]   23 Aug 2020 14:13 EDT
TensorFlow Lite initial commit.

Performance Metrics

Analyze Test Configuration:

TensorFlow Lite 2020-08-23

Model: Inception V4

OpenBenchmarking.org metrics for this test profile configuration based on 254 public samples since 23 August 2020 with the latest data as of 19 September 2020.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
Microseconds (Average)
Mid-Tier
75th
> 1136157
Median
50th
1952597
Low-Tier
25th
> 4508380
OpenBenchmarking.orgDistribution Of Public Results - Model: Inception V4254 Results Range From 644059 To 28134967 Microseconds644059119387817436972293516284333533931543942973449279250426115592430614224966920687241887779170683415258891344944116399909821054080111090620116404391219025812740077132898961383971514389534149393531548917216038991165888101713862917688448182382671878808619337905198877242043754320987362215371812208700022636819231866382373645724286276248360952538591425935733264855522703537127585190281350091530456075

Based on OpenBenchmarking.org data, the selected test / test configuration (TensorFlow Lite 2020-08-23 - Model: Inception V4) has an average run-time of 6 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkModel: Inception V4Run-Time3691215Min: 3 / Avg: 5.8 / Max: 10

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.2%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsModel: Inception V4Deviation246810Min: 0 / Avg: 0.24 / Max: 3

Recent Test Results

Compare

3 Systems - 54 Benchmark Results

Intel Core i7-7740K - Gigabyte X299 AORUS Gaming-CF - Intel Xeon E3-1200 v6

Ubuntu 18.10 - 4.18.0-25-generic - GNOME Shell 3.30.2

3 Systems - 26 Benchmark Results

AMD EPYC 7551 32-Core - GIGABYTE MZ31-AR0-00 v01010101 - AMD 17h

Debian 10 - 4.19.0-10-amd64 - GCC 8.3.0

1 System - 35 Benchmark Results

Intel Xeon E3-1231 v3 - Gigabyte H81M-S1 - Intel Xeon E3-1200 v3 DRAM

Debian 10 - 4.19.0-10-amd64 - X Server 1.20.4

1 System - 36 Benchmark Results

AMD Ryzen 7 1800X Eight-Core - MSI X370 XPOWER GAMING TITANIUM - AMD 17h

Debian 10 - 4.19.0-10-amd64 - X Server 1.20.4

1 System - 2 Benchmark Results

AMD Ryzen 7 2700X Eight-Core - ASUS PRIME X470-PRO - AMD 17h

Debian 10 - 4.19.0-10-amd64 - GNOME Shell 3.30.2

1 System - 80 Benchmark Results

AMD Ryzen 9 3950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.04 - 5.4.0-47-generic - GNOME Shell 3.36.4

3 Systems - 68 Benchmark Results

AMD Ryzen Threadripper 3960X 24-Core - MSI Creator TRX40 - AMD Starship

Ubuntu 20.04 - 5.9.0-rc5-14sep-patch - GNOME Shell 3.36.4

1 System - 69 Benchmark Results

AMD EPYC 7601 32-Core - TYAN B8026T70AE24HR - AMD 17h

Ubuntu 20.04 - 5.4.0-47-generic - GNOME Shell 3.36.3

1 System - 69 Benchmark Results

AMD EPYC 7601 32-Core - TYAN B8026T70AE24HR - AMD 17h

Ubuntu 20.04 - 5.4.0-47-generic - GNOME Shell 3.36.3

1 System - 69 Benchmark Results

AMD EPYC 7601 32-Core - TYAN B8026T70AE24HR - AMD 17h

Ubuntu 20.04 - 5.4.0-47-generic - GNOME Shell 3.36.3

1 System - 68 Benchmark Results

AMD Ryzen Threadripper 3960X 24-Core - MSI Creator TRX40 - AMD Starship

Ubuntu 20.04 - 5.9.0-rc5-14sep-patch - GNOME Shell 3.36.4

1 System - 48 Benchmark Results

2 x AMD EPYC 7272 12-Core - Supermicro H11DSi-NT v2.00 - AMD Starship

Ubuntu 20.04 - 5.8.0-050800rc6daily20200721-generic - GNOME Shell 3.36.1

Most Popular Test Results

Compare

3 Systems - 11 Benchmark Results

AMD Ryzen 7 3800XT 8-Core - ASRock X570 Pro4 - AMD Starship

Ubuntu 20.04 - 5.4.0-42-generic - GNOME Shell 3.36.1

3 Systems - 11 Benchmark Results

AMD Ryzen Threadripper 3990X 64-Core - System76 Thelio Major - AMD Starship

Pop 20.04 - 5.4.0-7634-generic - GNOME Shell 3.36.3

3 Systems - 59 Benchmark Results

Intel Core i7-3517U - ASUS UX32VDA v1.0 - Intel 3rd Gen Core DRAM

Ubuntu 20.04 - 5.4.0-12-generic - GNOME Shell 3.34.3

4 Systems - 176 Benchmark Results

AMD EPYC 7702 64-Core - ASRockRack EPYCD8 - AMD Starship

Ubuntu 20.04 - 5.5.0-050500-generic - GNOME Shell 3.36.4

4 Systems - 72 Benchmark Results

AMD Ryzen 9 3900XT 12-Core - MSI MEG X570 GODLIKE - AMD Starship

Ubuntu 20.04 - 5.9.0-050900rc2daily20200827-generic - GNOME Shell 3.36.4

3 Systems - 7 Benchmark Results

AMD Ryzen 3 3300X 4-Core - MSI B350M GAMING PRO - AMD Starship

Ubuntu 20.04 - 5.9.0-050900rc1daily20200819-generic - GNOME Shell 3.36.4

Find More Test Results


User Comments

Post A Comment