LiteRT
This is a benchmark of LiteRT (formerly known as TensorFlow Lite) focused on TensorFlow machine learning for mobile, IoT, edge, and other cases. The current Linux support is limited to running on CPUs. This LiteRT benchmark test profile is measuring the average inference time.
LiteRT 2024-10-15
Model: Mobilenet Float
OpenBenchmarking.org metrics for this test profile configuration based on 220 public results since 15 October 2024 with the latest data as of 25 December 2024.
Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.
Component
Details
Percentile Rank
# Compatible Public Results
Microseconds (Average)
Zen 5 [8 Cores / 16 Threads]
96th
4
724 +/- 2
Arrow Lake [24 Cores / 24 Threads]
91st
17
873 +/- 21
Raptor Lake [24 Cores / 32 Threads]
86th
4
989 +/- 4
Zen 5 [16 Cores / 32 Threads]
84th
4
1019 +/- 28
Zen 4 [8 Cores / 16 Threads]
83rd
3
1045 +/- 1
Arrow Lake [14 Cores / 14 Threads]
80th
5
1083 +/- 5
Zen 4 [16 Cores / 32 Threads]
77th
7
1173 +/- 6
Zen 4 [16 Cores / 32 Threads]
73rd
7
1226 +/- 54
Zen 4 [12 Cores / 24 Threads]
72nd
7
1244 +/- 3
Zen 4 [12 Cores / 24 Threads]
70th
5
1247 +/- 4
Cascade Lake [18 Cores / 36 Threads]
66th
3
1331 +/- 15
Zen 4 [8 Cores / 16 Threads]
64th
3
1547 +/- 68
Alder Lake [10 Cores / 16 Threads]
58th
3
1820 +/- 10
Zen 2 [32 Cores / 64 Threads]
56th
4
1843 +/- 32
Zen 4 [64 Cores / 128 Threads]
54th
7
2125 +/- 13
Cascade Lake [16 Cores / 32 Threads]
50th
5
2184 +/- 20
Zen 4 [4 Cores / 8 Threads]
49th
5
2193 +/- 2
Zen 2 [12 Cores / 24 Threads]
45th
3
2261 +/- 22
Zen 5 [12 Cores / 24 Threads]
45th
4
2264 +/- 4
Zen 5 [10 Cores / 20 Threads]
43rd
3
2286 +/- 124
Zen 5 [64 Cores / 128 Threads]
41st
4
2427 +/- 2
Zen 4 [8 Cores / 16 Threads]
40th
4
3050 +/- 146
Alder Lake [14 Cores / 20 Threads]
37th
4
3242 +/- 30
Zen 3 [8 Cores / 16 Threads]
36th
3
3295 +/- 104
Lunar Lake [8 Cores / 8 Threads]
35th
4
3381 +/- 28
Zen 3 [8 Cores / 16 Threads]
33rd
4
3707 +/- 58
Tiger Lake [4 Cores / 8 Threads]
31st
3
3819 +/- 83
Meteor Lake [16 Cores / 22 Threads]
30th
4
3887 +/- 115
Zen 2 [64 Cores / 128 Threads]
28th
3
4202 +/- 37
Zen 5 [96 Cores / 192 Threads]
23rd
22
4415 +/- 29
Zen 5 [128 Cores / 256 Threads]
16th
6
5921 +/- 270
Granite Rapids [128 Cores / 256 Threads]
12th
3
8182 +/- 434
