DeepSpeech

Mozilla DeepSpeech is a speech-to-text engine powered by TensorFlow for machine learning and derived from Baidu's Deep Speech research paper. This test profile times the speech-to-text process for a roughly three minute audio recording.

Learn more about this test at the upstream project site: https://github.com/mozilla/DeepSpeech.

This utility test profile is maintained by Michael Larabel. This OpenBenchmarking.org test profile was created on 8 December 2019. To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark deepspeech.

This test has an average install time of 17 seconds and an average run-time of 5 minutes, 14 seconds.

5k+ Downloads

Installation StatsTest Completion StatsPublic Result UploadsOpenBenchmarking.orgEventsDeepSpeech Popularitypts/deepspeech2019.122020.012020.022020.032020.042020.052020.062020.072020.082020.092020.102020.114080120160200

* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting.

Revision History

pts/deepspeech-1.0.0   [View Source]   08 Dec 2019 12:41 EST
Initial commit of Mozilla DeepSpeech

Suites Using This Test

Machine Learning

Creator Workloads

Single-Threaded

Speech

Performance Metrics

Analyze Test Configuration:

DeepSpeech 0.6

Acceleration: CPU

OpenBenchmarking.org metrics for this test profile configuration based on 1,042 public samples since 8 December 2019 with the latest data as of 1 December 2020.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
Seconds (Average)
Mid-Tier
75th
> 69
Median
50th
81
Low-Tier
25th
> 114
OpenBenchmarking.orgDistribution Of Public Results - Acceleration: CPU1042 Results Range From 49 To 377 Seconds49678510312113915717519321122924726528330131933735537339180160240320400

Based on OpenBenchmarking.org data, the selected test / test configuration (DeepSpeech 0.6 - Acceleration: CPU) has an average run-time of 4 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkAcceleration: CPURun-Time48121620Min: 1 / Avg: 3.96 / Max: 17

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.6%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsAcceleration: CPUDeviation3691215Min: 0 / Avg: 0.62 / Max: 7

Recent Test Results

Compare

1 System - 41 Benchmark Results

Intel Core i7-6700 - ASUS Z170I PRO GAMING - Intel Xeon E3-1200 v5

Fedora 33 - 5.8.16-300.fc33.x86_64 - Cinnamon 4.6.7

1 System - 73 Benchmark Results

Intel Core i7-4700HQ - ASUS G750JX v1.0 - Intel Xeon E3-1200 v3

Arch rolling - 5.9.8-arch1-1 - X Server 1.20.9

3 Systems - 23 Benchmark Results

Intel Core i7-1165G7 - Dell 0GG9PT - Intel Tiger Lake-LP

Ubuntu 20.10 - 5.8.0-29-generic - GNOME Shell 3.38.1

4 Systems - 99 Benchmark Results

Intel Core i7-1165G7 - Dell 0GG9PT - Intel Tiger Lake-LP

Ubuntu 20.10 - 5.8.0-29-generic - GNOME Shell 3.38.1

12 Systems - 383 Benchmark Results

AMD Ryzen 9 5900X 12-Core - Gigabyte B550I AORUS PRO AX - AMD Starship

Ubuntu 20.04 - 5.4.0-53-generic - GNOME Shell 3.36.4

12 Systems - 224 Benchmark Results

AMD Ryzen 7 3800XT 8-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4

1 System - 201 Benchmark Results

AMD Ryzen 9 3900XT 12-Core - MSI MEG X570 GODLIKE - AMD Starship

Ubuntu 20.10 - 5.8.0-21-generic - GNOME Shell 3.38.0

2 Systems - 154 Benchmark Results

2 x Intel Xeon E5-2630 v4 - Dell 0KJCC5 - Intel Xeon E7 v4

Ubuntu 18.04 - 5.4.0-42-generic - GNOME Shell 3.28.4

1 System - 154 Benchmark Results

AMD Ryzen 9 5900X 12-Core - Gigabyte B550I AORUS PRO AX - AMD Starship

Ubuntu 20.04 - 5.4.0-53-generic - GNOME Shell 3.36.4

7 Systems - 349 Benchmark Results

AMD Ryzen 5 5600X 6-Core - ASRock X570 Pro4 - AMD Starship

Ubuntu 20.10 - 5.8.0-26-generic - GNOME Shell 3.38.1

1 System - 152 Benchmark Results

AMD Ryzen 7 3700X 8-Core - MSI MEG X570 UNIFY - AMD Starship

Ubuntu 20.04 - 5.4.0-53-generic - GNOME Shell 3.36.4

6 Systems - 349 Benchmark Results

AMD Ryzen 5 5600X 6-Core - ASRock X570 Pro4 - AMD Starship

Ubuntu 20.10 - 5.8.0-26-generic - GNOME Shell 3.38.1

Most Popular Test Results

Compare

3 Systems - 268 Benchmark Results

Intel Core i5-2520M - HP 161C - Intel 2nd Generation Core DRAM

Ubuntu 18.04 - 4.18.0-20-generic - GNOME Shell 3.28.3

16 Systems - 119 Benchmark Results

Intel Xeon Gold 5220R - GIGABYTE MD61-SC2-00 v01000100 - Intel Sky Lake-E DMI3 Registers

Ubuntu 20.04 - 5.4.0-18-generic - GNOME Shell 3.36.0

2 Systems - 535 Benchmark Results

AMD Ryzen 5 4500U - LENOVO LNVNB161216 - AMD Renoir Root Complex

Ubuntu 20.04 - 5.9.0-050900rc7daily20201002-generic - GNOME Shell 3.36.4

12 Systems - 593 Benchmark Results

AMD Ryzen 5 3600X 6-Core - MSI X470 GAMING M7 AC - AMD Starship

Ubuntu 20.04 - 5.8.0-050800daily20200622-generic - GNOME Shell 3.36.2

11 Systems - 217 Benchmark Results

AMD Ryzen 7 3800XT 8-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4

4 Systems - 55 Benchmark Results

AMD Ryzen 3 3200U - MOTILE PF4PU1F - AMD Raven

Clear Linux OS 32230 - 5.4.16-900.native - GNOME Shell 3.34.3

3 Systems - 174 Benchmark Results

Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH

Fedora 32 - 5.6.6-300.fc32.x86_64 - GNOME Shell 3.36.1

2 Systems - 403 Benchmark Results

Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH

Ubuntu 20.10 - 5.8.0-22-generic - GNOME Shell 3.38.0

2 Systems - 736 Benchmark Results

Intel Core i5-6500 - MSI Z170-A PRO - Intel Xeon E3-1200 v5

ManjaroLinux 20.0.3 - 5.4.52-1-MANJARO - GNOME Shell 3.36.4

5 Systems - 68 Benchmark Results

AMD Ryzen 9 3900X 12-Core - MSI MPG X570 GAMING PLUS - AMD Starship

Debian testing - 5.7.10-xanmod1 - X Server 1.20.8

3 Systems - 406 Benchmark Results

Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH

Ubuntu 20.04 - 5.4.0-48-generic - GNOME Shell 3.36.4

Find More Test Results


User Comments

Post A Comment