spaCy

The spaCy library is an open-source solution for advanced neural language processing (NLP). The spaCy library leverages Python and is a leading neural language processing solution. This test profile times the spaCy CPU performance with various models.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark spacy.

Project Site

spacy.io

Source Repository

github.com

Test Created

7 October 2022

Test Maintainer

Michael Larabel 

Test Type

System

Average Install Time

5 Minutes, 33 Seconds

Average Run Time

2 Minutes, 55 Seconds

Test Dependencies

Python

Supported Platforms


Revision History

pts/spacy-1.0.0   [View Source]   Fri, 07 Oct 2022 18:55:58 GMT
Initial commit of spaCy.

Suites Using This Test

Machine Learning

HPC - High Performance Computing


Performance Metrics

Analyze Test Configuration:

spaCy 3.4.1

Model: en_core_web_lg

OpenBenchmarking.org metrics for this test profile configuration based on 184 public results since 7 October 2022 with the latest data as of 26 November 2022.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Compatible Public Results
tokens/sec (Average)
97th
18
20633 +/- 206
90th
6
19646 +/- 192
84th
3
18772 +/- 17
83rd
10
18702 +/- 117
79th
4
18571 +/- 145
76th
3
17199 +/- 72
Mid-Tier
75th
< 16982
74th
3
16012 +/- 11
73rd
3
15595 +/- 48
68th
3
14656 +/- 28
68th
3
14546 +/- 108
66th
3
14051 +/- 61
63rd
3
13815 +/- 47
63rd
3
13784 +/- 32
60th
4
13530 +/- 15
57th
3
13454 +/- 35
Median
50th
12411
49th
3
12363 +/- 18
43rd
3
12146 +/- 35
42nd
4
12079 +/- 149
38th
3
11854 +/- 23
35th
4
11710 +/- 10
28th
4
11440 +/- 13
Low-Tier
25th
< 11275
24th
4
11266 +/- 11
24th
3
11258 +/- 53
23rd
4
11242 +/- 34
16th
4
10967 +/- 13
15th
5
10951 +/- 33
13th
3
10896 +/- 44
10th
3
10419 +/- 105
9th
3
10078 +/- 79
4th
4
4914 +/- 12
OpenBenchmarking.orgDistribution Of Public Results - Model: en_core_web_lg180 Results Range From 4205 To 21022 tokens/sec420545424879521655535890622765646901723875757912824985868923926095979934102711060810945112821161911956122931263012967133041364113978143151465214989153261566316000163371667417011173481768518022183591869619033193701970720044203812071821055510152025

Based on OpenBenchmarking.org data, the selected test / test configuration (spaCy 3.4.1 - Model: en_core_web_lg) has an average run-time of 5 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkModel: en_core_web_lgRun-Time3691215Min: 2 / Avg: 4.39 / Max: 9

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set
Support
Instructions Detected
SSE2 (SSE2)
Used by default on supported hardware.
 
MOVDQA MOVDQU PUNPCKLQDQ PADDQ CVTSS2SD UCOMISD CVTSD2SS MOVD CVTSI2SD ADDSD MULSD XORPD DIVSD SUBSD CVTTSD2SI COMISD MOVAPD SHUFPD ANDPD UNPCKLPD MULPD UNPCKHPD SUBPD ADDPD PUNPCKHQDQ PSUBQ PSHUFD ORPD SQRTSD ANDNPD CMPNLESD MINSD MAXSD PSRLDQ MOVMSKPD MOVUPD CMPLTSD DIVPD
Last automated analysis: 10 October 2022

This test profile binary relies on the shared libraries libm.so.6, libexpat.so.1, libz.so.1, libc.so.6.

Tested CPU Architectures

This benchmark has been successfully tested on the below mentioned architectures. The CPU architectures listed is where successful OpenBenchmarking.org result uploads occurred, namely for helping to determine if a given test is compatible with various alternative CPU architectures.

CPU Architecture
Kernel Identifier
Verified On
Intel / AMD x86 64-bit
x86_64
(Many Processors)
ARMv8 64-bit
aarch64
Apple M2

Recent Test Results

OpenBenchmarking.org Results Compare

3 Systems - 270 Benchmark Results

AMD EPYC 7F32 8-Core - ASRockRack EPYCD8 - AMD Starship

Debian 11 - 5.10.0-10-amd64 - GNOME Shell 3.38.6

2 Systems - 270 Benchmark Results

AMD EPYC 7F32 8-Core - ASRockRack EPYCD8 - AMD Starship

Debian 11 - 5.10.0-10-amd64 - GNOME Shell 3.38.6

2 Systems - 334 Benchmark Results

2 x AMD EPYC 7601 32-Core - Dell 02MJ3T - AMD 17h

Ubuntu 22.04 - 5.15.0-40-generic - GNOME Shell 42.2

2 Systems - 334 Benchmark Results

2 x AMD EPYC 7601 32-Core - Dell 02MJ3T - AMD 17h

Ubuntu 22.04 - 5.15.0-40-generic - GNOME Shell 42.2

3 Systems - 184 Benchmark Results

AMD Ryzen 9 3900XT 12-Core - MSI MEG X570 GODLIKE - AMD Starship

Ubuntu 22.04 - 5.15.0-47-generic - GNOME Shell 42.2

2 Systems - 303 Benchmark Results

AMD Ryzen 9 7900X 12-Core - ASRock X670E PG Lightning - AMD Device 14d8

Ubuntu 22.10 - 5.19.0-23-generic - GNOME Shell 43.0

2 Systems - 384 Benchmark Results

Intel Core i9-13900K - ASUS PRIME Z790-P WIFI - Intel Device 7a27

Ubuntu 22.10 - 5.19.0-23-generic - GNOME Shell 43.0

1 System - 384 Benchmark Results

Intel Core i9-13900K - ASUS PRIME Z790-P WIFI - Intel Device 7a27

Ubuntu 22.10 - 5.19.0-23-generic - GNOME Shell 43.0

1 System - 380 Benchmark Results

Intel Core i9-13900K - ASUS PRIME Z790-P WIFI - Intel Device 7a27

Ubuntu 22.10 - 5.19.0-23-generic - GNOME Shell 43.0

1 System - 351 Benchmark Results

Intel Core i5-13600K - ASUS PRIME Z790-P WIFI - Intel Device 7a27

Ubuntu 22.10 - 5.19.0-23-generic - GNOME Shell 43.0

1 System - 2 Benchmark Results

Intel Core i7-12700K - Gigabyte Z690I A ULTRA LITE D4 - Intel Device 7aa7

Linuxmint 21 - 5.15.0-52-generic - Cinnamon 5.4.12

2 Systems - 144 Benchmark Results

AMD Ryzen 7 7700X 8-Core - ASRock X670E PG Lightning - AMD Device 14d8

Ubuntu 22.04 - 5.17.0-1013-oem - GNOME Shell 42.2

2 Systems - 552 Benchmark Results

AMD Ryzen 5 5500U - NB01 NL5xNU - AMD Renoir

Ubuntu 22.04 - 5.15.0-52-generic - KDE Plasma 5.24.6

2 Systems - 141 Benchmark Results

Intel Xeon E5-2609 v4 - MSI X99A RAIDER - Intel Xeon E7 v4

Ubuntu 20.04 - 5.9.0-050900rc6daily20200926-generic - GNOME Shell 3.36.2

3 Systems - 167 Benchmark Results

Intel Core i5-13600K - ASUS PRIME Z790-P WIFI - Intel Device 7a27

Ubuntu 22.04 - 6.0.0-060000rc1daily20220820-generic - GNOME Shell 42.2

Most Popular Test Results

OpenBenchmarking.org Results Compare

4 Systems - 145 Benchmark Results

AMD Ryzen 7 5800X3D 8-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 22.04 - 5.15.47+prerelease3723 - GNOME Shell 42.2

3 Systems - 38 Benchmark Results

Intel Core i5-13600K - ASUS ROG STRIX Z690-E GAMING WIFI - Intel Device 7aa7

Ubuntu 22.04 - 6.0.0-060000rc1daily20220820-generic - GNOME Shell 42.2

3 Systems - 167 Benchmark Results

Intel Core i5-13600K - ASUS PRIME Z790-P WIFI - Intel Device 7a27

Ubuntu 22.04 - 6.0.0-060000rc1daily20220820-generic - GNOME Shell 42.2

2 Systems - 141 Benchmark Results

Intel Xeon E5-2609 v4 - MSI X99A RAIDER - Intel Xeon E7 v4

Ubuntu 20.04 - 5.9.0-050900rc6daily20200926-generic - GNOME Shell 3.36.2

2 Systems - 384 Benchmark Results

Intel Core i9-13900K - ASUS PRIME Z790-P WIFI - Intel Device 7a27

Clear Linux OS 37600 - 6.0.7-1207.native - GNOME Shell 43.0

2 Systems - 144 Benchmark Results

AMD Ryzen 7 7700X 8-Core - ASRock X670E PG Lightning - AMD Device 14d8

Ubuntu 22.04 - 5.17.0-1013-oem - GNOME Shell 42.2

3 Systems - 110 Benchmark Results

Intel Core i9-11900K - ASUS ROG MAXIMUS XIII HERO - Intel Tiger Lake-H

Ubuntu 21.10 - 5.19.0-rc2-mmio-stale-data-patched - GNOME Shell 40.5

2 Systems - 552 Benchmark Results

AMD Ryzen 5 5500U - NB01 NL5xNU - AMD Renoir

Tuxedo 22.04 - 5.15.0-10048-tuxedo - KDE Plasma 5.24.6

2 Systems - 168 Benchmark Results

Intel Core i9-13900K - ASUS PRIME Z790-P WIFI - Intel Device 7a27

Ubuntu 22.04 - 6.0.0-060000rc1daily20220820-generic - GNOME Shell 42.2

3 Systems - 169 Benchmark Results

Intel Core i7-1165G7 - Dell 0GG9PT - Intel Tiger Lake-LP

Ubuntu 21.10 - 5.13.0-52-generic - GNOME Shell 40.5

2 Systems - 303 Benchmark Results

AMD Ryzen 9 7900X 12-Core - ASRock X670E PG Lightning - AMD Device 14d8

Ubuntu 22.10 - 5.19.0-23-generic - GNOME Shell 43.0

3 Systems - 98 Benchmark Results

AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship

Ubuntu 22.04 - 5.19.0-051900rc7-generic - GNOME Shell 42.2

3 Systems - 213 Benchmark Results

AMD Ryzen 7 4800U - ASRock 4X4-4000 - AMD Renoir

Ubuntu 22.04 - 5.19.0-rc6-phx-retbleed - GNOME Shell 42.2

3 Systems - 184 Benchmark Results

AMD Ryzen 9 3900XT 12-Core - MSI MEG X570 GODLIKE - AMD Starship

Ubuntu 22.04 - 5.15.0-47-generic - GNOME Shell 42.2

Find More Test Results