XNNPACK

XNNPACK is a Google library for high efficiency floating-point neural network inference operators across mobile / server / web use. XNNPACK is used by machine learning frameworks like TensorFlow, PyTorch, ONNX Runtime, MediaPipe, and others. This test profile uses XNNPACK with its bench-models benchmark and testing all available CPU threads.


XNNPACK b7b048

Model: QS8MobileNetV2

OpenBenchmarking.org metrics for this test profile configuration based on 240 public results since 15 October 2024 with the latest data as of 26 January 2025.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Details
Percentile Rank
# Compatible Public Results
us (Average)
Zen 5 [8 Cores / 16 Threads]
100th
5
309 +/- 6
Zen 4 [8 Cores / 16 Threads]
98th
3
400
Zen 4 [8 Cores / 16 Threads]
96th
3
547 +/- 30
Zen 4 [4 Cores / 8 Threads]
93rd
5
624 +/- 3
Arrow Lake [24 Cores / 24 Threads]
91st
7
649 +/- 25
Arrow Lake [14 Cores / 14 Threads]
88th
5
696 +/- 8
Zen 4 [12 Cores / 24 Threads]
88th
5
703 +/- 1
Zen 4 [12 Cores / 24 Threads]
83rd
7
730 +/- 27
Zen 5 [16 Cores / 32 Threads]
82nd
4
762 +/- 20
Raptor Lake [24 Cores / 32 Threads]
81st
4
781 +/- 6
Zen 4 [16 Cores / 32 Threads]
78th
9
808 +/- 5
Zen 4 [16 Cores / 32 Threads]
76th
7
836 +/- 29
Mid-Tier
75th
> 844
Alder Lake [10 Cores / 16 Threads]
72nd
3
932 +/- 131
Zen 4 [8 Cores / 16 Threads]
69th
4
984 +/- 53
Zen 5 [10 Cores / 20 Threads]
67th
3
1097 +/- 12
Zen 5 [12 Cores / 24 Threads]
65th
4
1145 +/- 18
Tiger Lake [4 Cores / 8 Threads]
63rd
3
1239 +/- 7
Zen 2 [12 Cores / 24 Threads]
61st
3
1373 +/- 3
Zen 3 [8 Cores / 16 Threads]
59th
4
1409 +/- 5
Lunar Lake [8 Cores / 8 Threads]
57th
4
1425 +/- 9
Cascade Lake [18 Cores / 36 Threads]
56th
3
1451 +/- 37
Zen 3 [8 Cores / 16 Threads]
55th
4
1781
Alder Lake [14 Cores / 20 Threads]
53rd
4
1866 +/- 26
Zen 3 [8 Cores / 16 Threads]
51st
3
1939 +/- 3
Median
50th
1970
Ice Lake [4 Cores / 8 Threads]
46th
3
2071 +/- 285
Zen 2 [32 Cores / 64 Threads]
46th
4
2075 +/- 19
Meteor Lake [16 Cores / 22 Threads]
46th
4
2092 +/- 39
45th
11
2117 +/- 126
Cascade Lake [16 Cores / 32 Threads]
40th
3
2480 +/- 23
Zen 4 [32 Cores / 64 Threads]
38th
4
3579 +/- 37
Zen 4 [64 Cores / 128 Threads]
36th
5
4015 +/- 27
Zen 2 [64 Cores / 128 Threads]
31st
3
5808 +/- 199
Low-Tier
25th
> 9945
Zen 5 [96 Cores / 192 Threads]
21st
21
10163 +/- 686
Granite Rapids [128 Cores / 256 Threads]
18th
3
16276 +/- 298
Zen 4 [192 Cores / 384 Threads]
12th
6
51721 +/- 6963