This is a benchmark of PyTorch making use of pytorch-benchmark [https://github.com/LukasHedegaard/pytorch-benchmark].
Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.
Component
Details
Percentile Rank
# Compatible Public Results
batches/sec (Average)
Zen 5 [8 Cores / 16 Threads]
100th
6
78.7 +/- 0.2
Zen 5 [8 Cores / 16 Threads]
99th
10
64.6 +/- 1.9
Emerald Rapids [64 Cores / 128 Threads]
97th
4
63.1
Zen 5 [16 Cores / 32 Threads]
94th
16
58.4 +/- 1.5
Arrow Lake [24 Cores / 24 Threads]
93rd
8
57.7 +/- 2.9
Sapphire Rapids [60 Cores / 120 Threads]
91st
4
56.0
Zen 5 [6 Cores / 12 Threads]
88th
10
55.5 +/- 1.0
Zen 5 [12 Cores / 24 Threads]
85th
7
52.5 +/- 0.5
Zen 4 [16 Cores / 32 Threads]
80th
12
48.5 +/- 2.6
Zen 4 [64 Cores / 128 Threads]
80th
4
47.9 +/- 0.3
Zen 5 [96 Cores / 192 Threads]
79th
3
47.8 +/- 1.5
Zen 4 [8 Cores / 16 Threads]
79th
4
47.2
Zen 4 [16 Cores / 32 Threads]
77th
4
46.2
Zen 4 [8 Cores / 16 Threads]
76th
4
46.0
Zen 4 [8 Cores / 16 Threads]
75th
5
45.3
Zen 4 [8 Cores / 16 Threads]
73rd
4
45.1 +/- 0.1
Arrow Lake [14 Cores / 14 Threads]
72nd
5
44.6 +/- 0.1
Zen 4 [8 Cores / 16 Threads]
71st
3
43.9
Zen 4 [16 Cores / 32 Threads]
70th
5
43.9 +/- 1.1
Zen 5 [128 Cores / 256 Threads]
69th
8
43.5 +/- 0.2
Zen 4 [12 Cores / 24 Threads]
67th
5
43.3
Zen 4 [12 Cores / 24 Threads]
65th
5
42.6
Raptor Lake [24 Cores / 32 Threads]
61st
3
42.3
Raptor Lake [24 Cores / 32 Threads]
61st
9
42.2 +/- 1.3
Emerald Rapids [128 Cores / 256 Threads]
60th
6
41.8 +/- 1.0
Zen 4 [12 Cores / 24 Threads]
60th
4
41.3
Zen 4 [12 Cores / 24 Threads]
58th
3
39.5
Zen 4 [16 Cores / 32 Threads]
57th
5
38.4
Zen 4 [6 Cores / 12 Threads]
54th
4
35.5
Zen 4 [6 Cores / 12 Threads]
53rd
3
34.9
Zen 4 [96 Cores / 192 Threads]
52nd
3
34.7
Zen 4 [12 Cores / 24 Threads]
51st
5
34.3
Zen 4 [64 Cores / 128 Threads]
49th
5
33.6 +/- 0.2
Zen 3 [8 Cores / 16 Threads]
48th
5
33.5
Zen 3 [16 Cores / 32 Threads]
45th
5
31.9
Zen 3 [24 Cores / 48 Threads]
43rd
4
31.7 +/- 0.1
Raptor Lake [8 Cores / 16 Threads]
43rd
9
31.6 +/- 4.6
Zen 4 [8 Cores / 16 Threads]
42nd
5
31.6
Zen 4 [6 Cores / 12 Threads]
41st
4
31.1
Zen 3 [8 Cores / 16 Threads]
40th
5
31.1
Sierra Forest [144 Cores / 144 Threads]
38th
4
30.7
Zen 4 [6 Cores / 12 Threads]
37th
5
30.4 +/- 4.1
Raptor Lake [14 Cores / 20 Threads]
37th
3
30.1
Zen 2 [32 Cores / 64 Threads]
36th
3
30.0 +/- 0.2
Zen 3 [12 Cores / 24 Threads]
36th
7
29.9 +/- 0.7
Raptor Lake [14 Cores / 20 Threads]
33rd
5
29.1
Zen 5 [12 Cores / 24 Threads]
31st
3
28.1 +/- 2.2
Zen 4 [128 Cores / 256 Threads]
31st
3
27.7
Sierra Forest [144 Cores / 144 Threads]
30th
4
26.9
Zen 4 [6 Cores / 12 Threads]
28th
4
25.1
Zen 4 [4 Cores / 8 Threads]
25th
4
23.1 +/- 0.2
Raptor Lake [14 Cores / 20 Threads]
24th
4
22.7
Zen 3 [6 Cores / 12 Threads]
23rd
4
21.6
Zen 4 [192 Cores / 384 Threads]
19th
8
20.8 +/- 1.4
Raptor Lake [4 Cores / 8 Threads]
19th
5
20.4
Zen 3 [6 Cores / 12 Threads]
17th
5
19.4
Raptor Lake [10 Cores / 16 Threads]
16th
3
18.9
Zen 3 [8 Cores / 16 Threads]
15th
5
18.7 +/- 1.6
Raptor Lake [10 Cores / 16 Threads]
14th
5
18.2
Granite Rapids [256 Cores / 512 Threads]
12th
3
17.0 +/- 0.5
Meteor Lake [16 Cores / 22 Threads]
9th
5
15.2 +/- 0.9
Zen 3 [8 Cores / 16 Threads]
9th
4
15.2
Alder Lake [14 Cores / 20 Threads]
8th
5
15.1 +/- 0.7
Zen 2 [6 Cores / 12 Threads]
5th
4
12.8 +/- 0.1
Ice Lake [4 Cores / 8 Threads]
3rd
4
8.6 +/- 0.1
