VOSK Speech Recognition Toolkit

VOSK is an open-source offline speech recognition API/toolkit. VOSK supports speech recognition in 17 languages and has a variety of models available and interfaces for different programming languages. This test profile times the speech-to-text process for a roughly three minute audio recording.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark vosk.

Project Site

alphacephei.com

Test Created

27 April 2021

Test Maintainer

Michael Larabel 

Test Type

Processor

Average Install Time

24 Seconds

Average Run Time

1 Minute, 24 Seconds

Test Dependencies

Python

Accolades

5k+ Downloads

Supported Platforms


Public Result Uploads *Reported Installs **Reported Test Completions **Test Profile Page ViewsOpenBenchmarking.orgEventsVOSK Speech Recognition Toolkit Popularity Statisticspts/vosk2021.042021.052021.062021.072021.082021.092021.102021.112021.122022.012022.022022.032022.042022.052022.062022.072022.082022.092022.102022.1111002200330044005500
* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data current as of 26 November 2022.

Revision History

pts/vosk-1.0.1   [View Source]   Tue, 27 Apr 2021 14:09:26 GMT
Set python external dependency.

pts/vosk-1.0.0   [View Source]   Tue, 27 Apr 2021 14:06:19 GMT
Initial commit of VOSK.

Suites Using This Test

Creator Workloads

Speech

Telephony


Performance Metrics

Analyze Test Configuration:

VOSK Speech Recognition Toolkit 0.3.21

OpenBenchmarking.org metrics for this test profile configuration based on 419 public results since 27 April 2021 with the latest data as of 1 December 2022.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Compatible Public Results
Seconds (Average)
97th
6
12.4 +/- 0.2
97th
6
12.5 +/- 0.2
97th
8
12.5 +/- 0.2
92nd
10
13.9 +/- 0.3
88th
7
14.4 +/- 0.4
87th
7
14.5 +/- 0.1
84th
9
14.6 +/- 0.1
82nd
16
14.9 +/- 0.9
81st
8
15.3 +/- 0.3
78th
4
16.0 +/- 0.1
Mid-Tier
75th
> 16.3
75th
5
16.4 +/- 0.3
73rd
3
16.6 +/- 0.1
69th
13
17.1 +/- 0.3
69th
7
17.1 +/- 1.3
68th
3
17.1 +/- 0.2
68th
3
17.2 +/- 0.3
65th
3
17.5 +/- 0.3
65th
3
17.6 +/- 0.1
62nd
3
18.0 +/- 1.2
58th
10
19.1 +/- 0.9
56th
3
19.6 +/- 0.2
53rd
3
20.1 +/- 0.3
51st
3
20.2 +/- 0.1
Median
50th
20.2
50th
4
20.2 +/- 0.2
50th
3
20.3 +/- 0.1
48th
4
20.4 +/- 0.1
48th
3
20.5 +/- 0.1
46th
10
20.6 +/- 0.3
46th
3
20.6 +/- 0.1
43rd
4
20.9 +/- 0.1
42nd
3
21.0 +/- 0.1
38th
4
21.5 +/- 0.1
37th
10
21.6 +/- 0.2
34th
3
22.2 +/- 0.1
33rd
4
22.2 +/- 0.1
32nd
10
22.4 +/- 0.3
30th
6
22.6 +/- 0.1
30th
3
22.6 +/- 0.1
28th
3
22.7 +/- 0.4
27th
3
22.9 +/- 0.1
Low-Tier
25th
> 23.3
23rd
4
23.8 +/- 0.1
22nd
6
23.9 +/- 0.2
21st
3
24.1 +/- 1.4
19th
4
24.6 +/- 0.1
19th
5
24.7 +/- 0.2
17th
4
24.9 +/- 0.1
16th
3
25.0 +/- 0.7
16th
3
25.0 +/- 0.1
13th
8
26.2 +/- 0.3
11th
3
26.6 +/- 0.2
10th
3
27.2 +/- 0.1
8th
3
28.3 +/- 1.4
8th
3
28.4 +/- 1.5
7th
3
28.6 +/- 1.6
6th
3
29.4 +/- 0.4
5th
4
30.9 +/- 2.4
3rd
3
37.0 +/- 0.1
2nd
3
37.8 +/- 0.2
1st
3
44.9 +/- 0.7
OpenBenchmarking.orgDistribution Of Public Results417 Results Range From 12 To 46 Seconds1215182124273033363942454820406080100

Based on OpenBenchmarking.org data, the selected test / test configuration (VOSK Speech Recognition Toolkit 0.3.21) has an average run-time of 2 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkRun-Time246810Min: 1 / Avg: 1.21 / Max: 5

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.4%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsDeviation246810Min: 0 / Avg: 0.39 / Max: 3

Does It Scale Well With Increasing Cores?

No, based on the automated analysis of the collected public benchmark data, this test / test settings does not generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

IntelAMDOpenBenchmarking.orgRelative Core Scaling To BaseVOSK Speech Recognition Toolkit CPU Core Scaling24681216640.38960.77921.16881.55841.948

Tested CPU Architectures

This benchmark has been successfully tested on the below mentioned architectures. The CPU architectures listed is where successful OpenBenchmarking.org result uploads occurred, namely for helping to determine if a given test is compatible with various alternative CPU architectures.

CPU Architecture
Kernel Identifier
Verified On
Intel / AMD x86 64-bit
x86_64
(Many Processors)

Recent Test Results

OpenBenchmarking.org Results Compare

1 System - 214 Benchmark Results

Apple M1 - Apple MacBook Pro - 16GB

macOS 11.7.1 - 20.6.0 - OpenCL 1.2

1 System - 3 Benchmark Results

Intel Core i5-4250U - Apple MacBook Air - Apple SSD

macOS 10.15.7 - 19.6.0 - Clang 12.0.0 + GCC 12.0.0

1 System - 3 Benchmark Results

Intel Core i5-4250U - Apple MacBook Air - Apple SSD

macOS 10.15.7 - 19.6.0 - Clang 12.0.0 + GCC 12.0.0

1 System - 3 Benchmark Results

Intel Core i5-4250U - Apple MacBook Air - Apple SSD

macOS 10.15.7 - 19.6.0 - Clang 12.0.0 + GCC 12.0.0

1 System - 3 Benchmark Results

Intel Core i5-4250U - Apple MacBook Air - Apple SSD

macOS 10.15.7 - 19.6.0 - Clang 12.0.0 + GCC 12.0.0

1 System - 3 Benchmark Results

Apple M1 - Apple Mac mini - 8GB

macOS 12.0.1 - 21.1.0 - GCC 13.0.0 + Clang 13.0.0 + Xcode 13.1

1 System - 208 Benchmark Results

Apple M1 - Apple Mac mini - 8GB

macOS 12.0.1 - 21.1.0 - OpenCL 1.2

1 System - 208 Benchmark Results

Apple M1 - Apple Mac mini - 8GB

macOS 12.0.1 - 21.1.0 - OpenCL 1.2

1 System - 100 Benchmark Results

AMD Ryzen 5 7600X 6-Core - ASUS ROG CROSSHAIR X670E HERO - AMD Device 14d8

Ubuntu 22.04 - 6.0.0-060000rc1daily20220820-generic - GNOME Shell 42.2

3 Systems - 357 Benchmark Results

AMD Ryzen 7 7700X 8-Core - ASUS ROG CROSSHAIR X670E HERO - AMD Device 14d8

Ubuntu 22.04 - 6.0.0-060000rc1daily20220820-generic - GNOME Shell 42.2

3 Systems - 357 Benchmark Results

4 Systems - 361 Benchmark Results

AMD Ryzen 9 7950X 16-Core - ASUS ROG CROSSHAIR X670E HERO - AMD Device 14d8

Ubuntu 22.04 - 6.0.0-060000rc1daily20220820-generic - GNOME Shell 42.2

13 Systems - 333 Benchmark Results

AMD Ryzen 9 5900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 22.04 - 6.0.0-060000rc1daily20220820-generic - GNOME Shell 42.2

Find More Test Results