Whisper.cpp

Whisper.cpp is a port of OpenAI's Whisper model in C/C++. Whisper.cpp is developed by Georgi Gerganov for transcribing WAV audio files to text / speech recognition. Whisper.cpp supports ARM NEON, x86 AVX, and other advanced CPU features.


Whisper.cpp 1.6.2

Model: ggml-base.en - Input: 2016 State of the Union

OpenBenchmarking.org metrics for this test profile configuration based on 335 public results since 2 June 2024 with the latest data as of 20 December 2024.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Details
Percentile Rank
# Compatible Public Results
Seconds (Average)
Zen 5 [16 Cores / 32 Threads]
100th
10
60 +/- 1
Zen 5 [8 Cores / 16 Threads]
98th
6
62
Zen 5 [12 Cores / 24 Threads]
95th
7
65 +/- 1
Zen 5 [8 Cores / 16 Threads]
93rd
8
76 +/- 3
Zen 4 [16 Cores / 32 Threads]
87th
10
82 +/- 4
Zen 4 [16 Cores / 32 Threads]
87th
6
84
Zen 5 [6 Cores / 12 Threads]
85th
10
85 +/- 2
Zen 4 [16 Cores / 32 Threads]
83rd
6
87
Zen 4 [12 Cores / 24 Threads]
80th
5
92
Zen 4 [12 Cores / 24 Threads]
78th
6
93
Zen 4 [12 Cores / 24 Threads]
77th
5
94
Mid-Tier
75th
> 98
Zen 4 [12 Cores / 24 Threads]
74th
4
98
Zen 4 [8 Cores / 16 Threads]
74th
4
100
Zen 3 [12 Cores / 24 Threads]
72nd
6
102
Zen 4 [8 Cores / 16 Threads]
70th
4
105
Zen 4 [8 Cores / 16 Threads]
67th
5
107
Zen 3 [8 Cores / 16 Threads]
66th
5
108
Zen 4 [16 Cores / 32 Threads]
64th
5
109
Zen 3 [8 Cores / 16 Threads]
63rd
5
114
Arrow Lake [24 Cores / 24 Threads]
63rd
8
116 +/- 15
Zen 4 [64 Cores / 128 Threads]
62nd
6
118 +/- 2
Arrow Lake [14 Cores / 14 Threads]
59th
5
122
Zen 4 [12 Cores / 24 Threads]
59th
5
122
Zen 4 [8 Cores / 16 Threads]
57th
4
124 +/- 1
Zen 2 [32 Cores / 64 Threads]
54th
4
129
Zen 3 [16 Cores / 32 Threads]
54th
5
129
Cascade Lake [18 Cores / 36 Threads]
52nd
3
131
Median
50th
132
Zen 4 [6 Cores / 12 Threads]
50th
4
132
Zen 4 [6 Cores / 12 Threads]
46th
4
137
Zen 4 [8 Cores / 16 Threads]
45th
6
139 +/- 7
Zen 4 [8 Cores / 16 Threads]
43rd
9
151 +/- 11
Zen 3 [8 Cores / 16 Threads]
43rd
3
156 +/- 9
Raptor Lake [24 Cores / 32 Threads]
41st
9
159 +/- 2
Zen 4 [8 Cores / 16 Threads]
37th
5
176
Zen 4 [4 Cores / 8 Threads]
36th
4
187 +/- 1
Zen 3 [8 Cores / 16 Threads]
35th
3
188
Raptor Lake [24 Cores / 32 Threads]
33rd
3
191
Zen 5 [12 Cores / 24 Threads]
33rd
6
191 +/- 12
Zen 5 [10 Cores / 20 Threads]
32nd
3
194
Raptor Lake [4 Cores / 8 Threads]
30th
5
199
Zen 3 [6 Cores / 12 Threads]
29th
4
211
Zen 4 [6 Cores / 12 Threads]
27th
4
213
Zen 3 [8 Cores / 16 Threads]
27th
4
213 +/- 1
Low-Tier
25th
> 213
Raptor Lake [14 Cores / 20 Threads]
24th
5
217
Zen 4 [128 Cores / 256 Threads]
24th
4
218
Raptor Lake [14 Cores / 20 Threads]
22nd
3
222
Zen 3 [6 Cores / 12 Threads]
20th
5
228
Lunar Lake [8 Cores / 8 Threads]
20th
4
254 +/- 31
Raptor Lake [14 Cores / 20 Threads]
18th
4
275
Tiger Lake [4 Cores / 8 Threads]
16th
7
314 +/- 9
Raptor Lake [10 Cores / 16 Threads]
15th
3
327
Raptor Lake [10 Cores / 16 Threads]
14th
5
337
Haswell [8 Cores / 8 Threads]
12th
5
345 +/- 3
Zen [32 Cores / 64 Threads]
9th
4
402 +/- 49
Meteor Lake [16 Cores / 22 Threads]
8th
12
408 +/- 10
Alder Lake [14 Cores / 20 Threads]
5th
7
433 +/- 22