This is a benchmark of the Caffe deep learning framework and currently supports the AlexNet and Googlenet model and execution on both CPUs and NVIDIA GPUs.
Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.
Component
Details
Percentile Rank
# Compatible Public Results
Milli-Seconds (Average)
Alder Lake [16 Cores / 24 Threads]
99th
6
26346 +/- 1357
Zen 3 [8 Cores / 16 Threads]
97th
5
30515 +/- 283
Kaby/Coffee/Whiskey Lake [6 Cores / 6 Threads]
95th
3
31313 +/- 140
Kaby/Coffee/Whiskey Lake [6 Cores / 6 Threads]
94th
3
32010 +/- 67
Alder Lake [6 Cores / 12 Threads]
94th
3
32397 +/- 27
Zen 3 [8 Cores / 16 Threads]
93rd
12
33106 +/- 2611
Zen 3 [6 Cores / 12 Threads]
91st
11
34498 +/- 2825
Kaby/Coffee/Whiskey Lake [4 Cores / 4 Threads]
89th
3
34822 +/- 9
Rocket Lake [8 Cores / 16 Threads]
88th
10
35102 +/- 789
Zen 3 [12 Cores / 24 Threads]
85th
18
36960 +/- 2697
Kaby/Coffee/Whiskey Lake [4 Cores / 4 Threads]
85th
3
37173 +/- 22
Zen 3 [8 Cores / 16 Threads]
84th
4
37366 +/- 34
Zen 2 [4 Cores / 8 Threads]
82nd
3
37955 +/- 132
Zen 3 [16 Cores / 32 Threads]
82nd
15
38312 +/- 2455
Skylake [4 Cores / 4 Threads]
82nd
3
38315 +/- 72
Rocket Lake [6 Cores / 12 Threads]
82nd
3
38595
Kaby/Coffee/Whiskey Lake [8 Cores / 16 Threads]
79th
7
39617 +/- 443
Zen 3 [16 Cores / 32 Threads]
78th
5
39924 +/- 210
Haswell [4 Cores / 4 Threads]
78th
3
40100 +/- 99
Comet Lake [6 Cores / 12 Threads]
76th
7
40411 +/- 5457
Kaby/Coffee/Whiskey Lake [8 Cores / 16 Threads]
75th
3
40696 +/- 46
Zen [4 Cores / 4 Threads]
74th
7
41490 +/- 228
Zen 3 [64 Cores / 128 Threads]
72nd
10
42438 +/- 811
Cascade Lake [18 Cores / 36 Threads]
72nd
3
42896 +/- 16
Zen 3 [32 Cores / 64 Threads]
71st
4
43033 +/- 98
Kaby/Coffee/Whiskey Lake [4 Cores / 4 Threads]
71st
4
43703 +/- 1085
Kaby/Coffee/Whiskey Lake [8 Cores / 16 Threads]
70th
3
44032 +/- 123
Zen [4 Cores / 4 Threads]
68th
3
46908 +/- 38
Cascade Lake [20 Cores / 20 Threads]
67th
3
48030 +/- 65
Cascade Lake [8 Cores / 16 Threads]
66th
4
48632
Zen 2 [4 Cores / 8 Threads]
65th
6
49030 +/- 55
Zen 2 [6 Cores / 12 Threads]
64th
3
50195 +/- 92
Cascade Lake [8 Cores / 16 Threads]
64th
3
50835
Zen 2 [16 Cores / 32 Threads]
63rd
3
51637 +/- 187
Zen 2 [8 Cores / 16 Threads]
63rd
4
51649 +/- 260
Zen 2 [8 Cores / 16 Threads]
63rd
6
51822 +/- 2121
Cascade Lake [16 Cores / 32 Threads]
61st
4
52864
Kaby/Coffee/Whiskey Lake [8 Cores / 8 Threads]
59th
4
53293 +/- 1907
Kaby/Coffee/Whiskey Lake [6 Cores / 12 Threads]
58th
3
53894 +/- 254
Zen 2 [12 Cores / 24 Threads]
58th
5
53938 +/- 2643
Kaby/Coffee/Whiskey Lake [6 Cores / 12 Threads]
58th
3
54246 +/- 97
Zen 2 [12 Cores / 24 Threads]
57th
3
54528 +/- 194
Kaby/Coffee/Whiskey Lake [8 Cores / 16 Threads]
57th
3
54762 +/- 50
Zen 2 [64 Cores / 128 Threads]
57th
6
54816 +/- 1272
Zen 2 [6 Cores / 6 Threads]
56th
3
55743 +/- 343
Cascade Lake [16 Cores / 32 Threads]
56th
4
55863
Cascade Lake [12 Cores / 24 Threads]
54th
3
56188
Haswell [8 Cores / 8 Threads]
54th
3
57031 +/- 72
Zen [8 Cores / 16 Threads]
53rd
3
58695 +/- 367
Kaby/Coffee/Whiskey Lake [4 Cores / 8 Threads]
52nd
3
58792 +/- 45
Haswell [16 Cores / 16 Threads]
51st
3
59244 +/- 55
Zen 3 [32 Cores / 64 Threads]
50th
6
59844 +/- 767
Broadwell [8 Cores / 8 Threads]
50th
4
59847 +/- 31
Zen+ [8 Cores / 16 Threads]
49th
3
60184 +/- 65
Cascade Lake [18 Cores / 36 Threads]
49th
3
60383 +/- 85
Kaby/Coffee/Whiskey Lake [8 Cores / 8 Threads]
47th
3
60847 +/- 97
Comet Lake [4 Cores / 8 Threads]
45th
4
61414 +/- 2732
Zen+ [8 Cores / 16 Threads]
45th
3
61442 +/- 484
Zen 2 [64 Cores / 128 Threads]
45th
5
61568
Zen 2 [64 Cores / 128 Threads]
44th
5
62139
Ivy Bridge [4 Cores / 4 Threads]
43rd
3
62756 +/- 661
Cascade Lake [16 Cores / 32 Threads]
42nd
7
63592 +/- 3987
Zen 2 [24 Cores / 48 Threads]
42nd
3
63674 +/- 138
Zen 2 [32 Cores / 64 Threads]
42nd
5
63878 +/- 2643
Haswell [16 Cores / 16 Threads]
41st
4
64167 +/- 112
Broadwell [8 Cores / 8 Threads]
40th
4
64360 +/- 4536
Ice Lake [4 Cores / 8 Threads]
40th
6
64670 +/- 1103
Cascade Lake [48 Cores / 96 Threads]
39th
3
65462 +/- 825
Skylake [8 Cores / 8 Threads]
39th
3
65525 +/- 14
Skylake [8 Cores / 8 Threads]
37th
3
66966 +/- 92
Haswell [20 Cores / 20 Threads]
36th
3
67388 +/- 194
Skylake [4 Cores / 8 Threads]
35th
3
68781 +/- 164
Zen 2 [48 Cores / 96 Threads]
34th
5
68979
Zen 2 [8 Cores / 16 Threads]
32nd
12
69338 +/- 471
Zen 2 [48 Cores / 96 Threads]
31st
5
70290
Zen 2 [16 Cores / 32 Threads]
30th
9
70420 +/- 1606
Bulldozer [8 Cores / 8 Threads]
29th
4
70911 +/- 127
Kaby/Coffee/Whiskey Lake [6 Cores / 12 Threads]
29th
3
71502 +/- 272
Ivy Bridge [12 Cores / 12 Threads]
28th
3
71788 +/- 91
Kaby/Coffee/Whiskey Lake [2 Cores / 4 Threads]
27th
3
73006 +/- 157
Zen 2 [16 Cores / 32 Threads]
27th
5
73660
Zen 2 [8 Cores / 16 Threads]
26th
3
74361
Zen 2 [24 Cores / 48 Threads]
25th
5
74842
Zen 2 [24 Cores / 48 Threads]
24th
8
75063 +/- 162
Zen 2 [16 Cores / 32 Threads]
23rd
5
75192
Zen 2 [8 Cores / 16 Threads]
22nd
5
75301
Zen+ [16 Cores / 32 Threads]
21st
3
75656 +/- 796
Zen 2 [8 Cores / 16 Threads]
21st
3
76141
Zen 2 [128 Cores / 256 Threads]
20th
4
76325 +/- 1670
Zen 2 [32 Cores / 64 Threads]
19th
4
79050
Skylake [8 Cores / 8 Threads]
18th
3
79454 +/- 240
Zen 2 [12 Cores / 24 Threads]
18th
3
80200
Zen 2 [32 Cores / 64 Threads]
17th
3
81683
Bulldozer [8 Cores / 8 Threads]
16th
4
81789 +/- 576
Zen 2 [32 Cores / 64 Threads]
16th
5
81848
Zen 2 [24 Cores / 48 Threads]
15th
5
84809
Zen 2 [32 Cores / 64 Threads]
13th
5
85230
Zen+ [24 Cores / 48 Threads]
12th
3
85495 +/- 382
Tiger Lake [4 Cores / 8 Threads]
12th
9
85526 +/- 1817
Broadwell [4 Cores / 4 Threads]
11th
3
86210 +/- 644
Zen 2 [32 Cores / 64 Threads]
10th
5
88694
Kaby/Coffee/Whiskey Lake [2 Cores / 8 Threads]
8th
5
95251 +/- 13722
Steamroller [2 Cores / 4 Threads]
8th
3
96699 +/- 6657
Zen [2 Cores / 4 Threads]
8th
3
103280 +/- 3062
Zen [32 Cores / 64 Threads]
7th
3
107071
Sandy Bridge [4 Cores / 8 Threads]
4th
3
121367 +/- 4283
Zen [32 Cores / 64 Threads]
4th
3
124930 +/- 1779
Haswell [4 Cores / 4 Threads]
3rd
3
127752 +/- 382
Sandy Bridge [4 Cores / 4 Threads]
3rd
3
151504 +/- 48
