Whisper.cpp

Whisper.cpp is a port of OpenAI's Whisper model in C/C++. Whisper.cpp is developed by Georgi Gerganov for transcribing WAV audio files to text / speech recognition. Whisper.cpp supports ARM NEON, x86 AVX, and other advanced CPU features.


Whisper.cpp 1.4

Model: ggml-base.en - Input: 2016 State of the Union

OpenBenchmarking.org metrics for this test profile configuration based on 181 public results since 16 June 2023 with the latest data as of 26 May 2024.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Details
Percentile Rank
# Compatible Public Results
Seconds (Average)
Zen 4 [8 Cores / 16 Threads]
98th
3
80
Zen 4 [12 Cores / 24 Threads]
96th
4
86
Zen 4 [8 Cores / 16 Threads]
93rd
5
88
Zen 4 [12 Cores / 24 Threads]
91st
4
90
Zen 4 [16 Cores / 32 Threads]
80th
5
92 +/- 3
Zen 4 [6 Cores / 12 Threads]
77th
6
94 +/- 4
Mid-Tier
75th
> 108
Zen 4 [8 Cores / 16 Threads]
70th
11
115 +/- 10
Zen 4 [6 Cores / 12 Threads]
66th
11
120 +/- 10
Zen 4 [6 Cores / 12 Threads]
60th
5
136 +/- 8
Zen 4 [8 Cores / 16 Threads]
59th
4
137 +/- 1
Raptor Lake [24 Cores / 32 Threads]
55th
4
149 +/- 1
Zen 3 [24 Cores / 48 Threads]
51st
4
152 +/- 6
Zen 2 [32 Cores / 64 Threads]
51st
4
154 +/- 3
Raptor Lake [24 Cores / 32 Threads]
51st
4
154 +/- 2
Median
50th
156
Zen 3 [6 Cores / 12 Threads]
44th
4
160
Zen 2 [12 Cores / 24 Threads]
44th
4
160
Zen 3 [8 Cores / 16 Threads]
43rd
4
162
Raptor Lake [4 Cores / 8 Threads]
39th
6
167
Cascade Lake [18 Cores / 36 Threads]
34th
4
174
Sapphire Rapids [32 Cores / 64 Threads]
34th
4
174 +/- 7
Zen 3 [8 Cores / 16 Threads]
30th
4
193
Raptor Lake [14 Cores / 20 Threads]
29th
5
203 +/- 27
Low-Tier
25th
> 234
Raptor Lake [14 Cores / 20 Threads]
25th
7
235 +/- 4
Alder Lake [10 Cores / 16 Threads]
21st
4
246 +/- 1
Zen 2 [64 Cores / 128 Threads]
18th
4
256 +/- 11
Sapphire Rapids [64 Cores / 128 Threads]
17th
4
286 +/- 39
Zen 2 [6 Cores / 6 Threads]
13th
4
337
Alder Lake [14 Cores / 20 Threads]
11th
3
340 +/- 11
Tiger Lake [4 Cores / 8 Threads]
11th
4
349 +/- 13
Zen [32 Cores / 64 Threads]
4th
4
986 +/- 34