This is a benchmark of the TensorFlow Lite implementation focused on TensorFlow machine learning for mobile, IoT, edge, and other cases. The current Linux support is limited to running on CPUs. This test profile is measuring the average inference time.
Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.
Component
Details
Percentile Rank
# Compatible Public Results
Microseconds (Average)
Zen 5 [8 Cores / 16 Threads]
100th
3
737 +/- 2
Zen 4 [8 Cores / 16 Threads]
98th
10
1017 +/- 8
Zen 4 [16 Cores / 32 Threads]
97th
10
1076 +/- 49
Zen 4 [12 Cores / 24 Threads]
96th
8
1110 +/- 9
Zen 4 [16 Cores / 32 Threads]
95th
6
1139 +/- 76
Ice Lake [24 Cores / 48 Threads]
93rd
4
1297 +/- 2
Zen 4 [6 Cores / 12 Threads]
92nd
7
1334 +/- 6
Raptor Lake [14 Cores / 20 Threads]
91st
9
1406 +/- 30
Ice Lake [40 Cores / 80 Threads]
90th
4
1411 +/- 2
Rocket Lake [8 Cores / 16 Threads]
89th
7
1434 +/- 13
Cascade Lake [16 Cores / 32 Threads]
88th
3
1518 +/- 6
Ice Lake [16 Cores / 32 Threads]
88th
3
1527 +/- 5
Zen 3 [16 Cores / 32 Threads]
86th
13
1605 +/- 2
Alder Lake [12 Cores / 20 Threads]
86th
3
1606 +/- 113
Zen 4 [6 Cores / 12 Threads]
85th
4
1619
Alder Lake [10 Cores / 16 Threads]
83rd
10
1706 +/- 70
Zen 3 [12 Cores / 24 Threads]
83rd
7
1718 +/- 14
Raptor Lake [10 Cores / 16 Threads]
81st
4
1796 +/- 6
Zen 3 [8 Cores / 16 Threads]
80th
13
1806 +/- 24
Zen 3 [8 Cores / 16 Threads]
80th
8
1814 +/- 134
Ice Lake [32 Cores / 64 Threads]
80th
4
1818 +/- 10
Zen 2 [24 Cores / 48 Threads]
77th
4
1888 +/- 7
Zen 2 [32 Cores / 64 Threads]
77th
4
1891 +/- 8
Comet Lake [10 Cores / 20 Threads]
77th
3
1901 +/- 39
Cascade Lake [16 Cores / 32 Threads]
72nd
73
2072 +/- 22
Ice Lake [48 Cores / 96 Threads]
69th
4
2084 +/- 3
Cascade Lake [48 Cores / 96 Threads]
68th
4
2091 +/- 6
Raptor Lake [14 Cores / 20 Threads]
65th
3
2165
Alder Lake [6 Cores / 12 Threads]
65th
9
2171 +/- 81
Cascade Lake [16 Cores / 32 Threads]
64th
4
2216 +/- 18
Kaby/Coffee/Whiskey Lake [8 Cores / 16 Threads]
62nd
3
2339 +/- 38
Zen 3 [8 Cores / 16 Threads]
62nd
6
2345 +/- 7
Zen 3 [8 Cores / 16 Threads]
61st
12
2396 +/- 38
Zen 2 [12 Cores / 24 Threads]
59th
7
2455 +/- 18
Zen 2 [16 Cores / 32 Threads]
58th
6
2480 +/- 40
Zen 3 [6 Cores / 12 Threads]
58th
4
2482 +/- 108
Rocket Lake [6 Cores / 12 Threads]
57th
3
2542 +/- 10
Comet Lake [6 Cores / 12 Threads]
55th
4
2655 +/- 12
Ice Lake [64 Cores / 128 Threads]
54th
4
2667 +/- 50
Haswell [16 Cores / 16 Threads]
54th
3
2692 +/- 53
Zen 3 [6 Cores / 12 Threads]
54th
6
2759 +/- 23
Raptor Lake [4 Cores / 8 Threads]
53rd
3
2766
Kaby/Coffee/Whiskey Lake [6 Cores / 12 Threads]
53rd
3
2788 +/- 12
Zen 2 [8 Cores / 16 Threads]
52nd
22
2814 +/- 136
Zen 2 [8 Cores / 16 Threads]
49th
5
2972 +/- 278
Zen 2 [8 Cores / 16 Threads]
48th
5
3033 +/- 59
Zen 2 [8 Cores / 16 Threads]
47th
4
3156 +/- 77
Zen 3 [8 Cores / 16 Threads]
46th
7
3246 +/- 65
Cascade Lake [56 Cores / 112 Threads]
45th
3
3392 +/- 17
Ice Lake [80 Cores / 160 Threads]
44th
15
3428 +/- 303
Meteor Lake [16 Cores / 22 Threads]
43rd
6
3445 +/- 258
Zen 3 [8 Cores / 16 Threads]
42nd
16
3526 +/- 522
Zen+ [24 Cores / 48 Threads]
41st
4
3666 +/- 37
Zen 4 [96 Cores / 192 Threads]
40th
5
3778 +/- 138
Tiger Lake [4 Cores / 8 Threads]
34th
65
3939 +/- 15
Zen 2 [4 Cores / 8 Threads]
32nd
4
3953 +/- 15
[8 Cores / 8 Threads]
32nd
11
3954 +/- 64
Tiger Lake [4 Cores / 8 Threads]
30th
11
3999 +/- 166
Alder Lake [14 Cores / 20 Threads]
30th
8
4017 +/- 257
Tiger Lake [4 Cores / 8 Threads]
29th
3
4091 +/- 50
Comet Lake [8 Cores / 16 Threads]
29th
3
4110 +/- 99
Zen 2 [64 Cores / 128 Threads]
28th
5
4228 +/- 64
Kaby/Coffee/Whiskey Lake [4 Cores / 8 Threads]
27th
3
4257 +/- 8
Alder Lake [4 Cores / 8 Threads]
25th
8
4470 +/- 366
Zen 2 [6 Cores / 12 Threads]
25th
9
4541 +/- 219
Comet Lake [4 Cores / 8 Threads]
25th
5
4547 +/- 675
Skylake [8 Cores / 8 Threads]
24th
3
4660 +/- 5
Zen 2 [8 Cores / 16 Threads]
21st
3
4909 +/- 23
[4 Cores / 8 Threads]
20th
17
4963 +/- 450
Zen [32 Cores / 64 Threads]
20th
4
4965 +/- 398
Skylake [4 Cores / 8 Threads]
20th
4
5387 +/- 53
Zen 3 [64 Cores / 128 Threads]
19th
3
5606 +/- 173
Kaby/Coffee/Whiskey Lake [4 Cores / 4 Threads]
17th
5
5955 +/- 4
Haswell [8 Cores / 8 Threads]
16th
3
6049 +/- 99
Ice Lake [4 Cores / 8 Threads]
16th
7
6147 +/- 270
Kaby/Coffee/Whiskey Lake [2 Cores / 8 Threads]
14th
5
6857 +/- 528
Zen [4 Cores / 8 Threads]
14th
3
6917 +/- 5
Zen 2 [6 Cores / 6 Threads]
14th
6
6974 +/- 145
Broadwell [8 Cores / 8 Threads]
13th
4
7159 +/- 10
Kaby/Coffee/Whiskey Lake [4 Cores / 4 Threads]
12th
13
7316 +/- 37
Kaby/Coffee/Whiskey Lake [2 Cores / 4 Threads]
10th
4
8069 +/- 17
Zen [64 Cores / 128 Threads]
10th
4
8393 +/- 520
Ice Lake [2 Cores / 4 Threads]
9th
4
9975 +/- 7
Zen 3 [128 Cores / 256 Threads]
8th
8
10045 +/- 535
Zen [2 Cores / 4 Threads]
4th
3
23400 +/- 1608
Ivy Bridge [2 Cores / 4 Threads]
4th
3
27422 +/- 55
