Stockfish

This is a test of Stockfish, an advanced open-source C++11 chess benchmark that can scale up to 512 CPU threads.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark stockfish.

Project Site

stockfishchess.org

Test Created

26 November 2014

Last Updated

19 March 2021

Test Maintainer

Michael Larabel 

Test Type

Processor

Average Install Time

32 Seconds

Average Run Time

37 Seconds

Test Dependencies

C/C++ Compiler Toolchain

Accolades

100k+ Downloads + 5k+ Public Benchmark Results

Supported Platforms


Public Result UploadsReported Installs*Test Completions*OpenBenchmarking.orgEventsStockfish Popularity Statisticspts/stockfish2014.112015.022015.052015.082015.112016.022016.052016.082016.112017.022017.052017.082017.112018.022018.052018.082018.112019.022019.052019.082019.112020.022020.052020.082020.112021.028K16K24K32K40K
* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data current as of Sat, 10 Apr 2021 13:01:46 GMT.

Revision History

pts/stockfish-1.3.0   [View Source]   Fri, 19 Mar 2021 10:46:31 GMT
Update against Stockfish 13 plus incorporate feedback from https://github.com/phoronix-test-suite/phoronix-test-suite/pull/513

pts/stockfish-1.2.0   [View Source]   Thu, 19 Nov 2020 13:50:00 GMT
Update against Stockfish 12, enable AArch64 optimized build.

pts/stockfish-1.1.1   [View Source]   Sat, 19 May 2018 06:26:58 GMT
Add Windows support.

pts/stockfish-1.1.0   [View Source]   Thu, 17 May 2018 15:32:30 GMT
Update Stockfish against version 9, use multi-threaded parameters.

pts/stockfish-1.0.1   [View Source]   Sun, 08 Apr 2018 06:39:33 GMT
Fix build on BSDs

pts/stockfish-1.0.0   [View Source]   Wed, 26 Nov 2014 11:32:02 GMT
Initial commit of Stockfish benchmark.

Suites Using This Test

Chess Test Suite

C/C++ Compiler Tests

Multi-Core

CPU Massive

Server CPU Tests


Performance Metrics

Analyze Test Configuration:

Stockfish 13

Total Time

OpenBenchmarking.org metrics for this test profile configuration based on 273 public results since 19 March 2021 with the latest data as of 10 April 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Matching Public Results
Nodes Per Second (Average)
100th
6
282267234 +/- 3600093
99th
7
180073809 +/- 4351101
96th
6
169979608 +/- 3811321
94th
3
158425447 +/- 1727111
92nd
3
133480591 +/- 1041216
91st
6
129784173 +/- 3840718
88th
3
103671224 +/- 1430540
84th
4
79433534 +/- 996038
82nd
8
55750188 +/- 1145293
79th
3
52599766 +/- 2470184
79th
3
51877464 +/- 1826217
77th
4
48312085 +/- 1707540
Mid-Tier
75th
< 45346615
75th
6
44977715 +/- 357345
73rd
3
40057667 +/- 1270287
71st
3
37422972 +/- 986124
71st
6
36651853 +/- 688709
68th
9
34335598 +/- 466766
66th
3
31370918 +/- 287826
62nd
11
29710510 +/- 1638772
60th
8
28455435 +/- 467182
58th
4
27135677 +/- 347006
55th
3
24963698 +/- 332303
53rd
3
23703892 +/- 177292
52nd
4
22257146 +/- 299927
51st
4
21501837 +/- 240206
Median
50th
21418006
49th
4
20358688 +/- 1317145
48th
4
19894088 +/- 191253
45th
9
19113877 +/- 151462
43rd
3
18473754 +/- 188061
41st
3
18271038 +/- 133066
41st
3
18192482 +/- 122525
39th
3
13493442 +/- 100132
38th
3
13086431 +/- 49646
36th
3
12891896 +/- 79328
35th
3
12541360 +/- 82032
35th
3
12493938 +/- 90538
33rd
4
11785273 +/- 22139
32nd
3
11467447 +/- 77326
30th
6
11230714 +/- 135405
28th
3
10312200 +/- 50276
27th
3
10031786 +/- 28076
Low-Tier
25th
< 8690579
25th
3
8445500 +/- 33887
23rd
3
7998220 +/- 28258
22nd
3
7777074 +/- 16044
21st
4
7692267 +/- 158326
19th
4
7548282 +/- 25451
18th
3
7492835 +/- 17712
17th
4
7361428 +/- 360030
16th
3
7185586 +/- 121359
14th
3
6460691 +/- 332973
13th
3
6211308 +/- 24538
11th
3
5907733 +/- 81069
10th
3
5363989 +/- 67857
8th
3
3675802 +/- 11888
7th
4
3631627 +/- 33320
6th
3
3526923 +/- 86212
4th
3
1742859 +/- 20227
OpenBenchmarking.orgDistribution Of Public Results - Total Time257 Results Range From 907320 To 289564669 Nodes Per Second9073206680467124536141822676123999908297730553554620241319349470924965286564358638790644119377018508475958231817313788750452593277672990508191048239661105971131163702601221434071279165541336897011394628481452359951510091421567822891625554361683285831741017301798748771856480241914211711971943182029674652087406122145137592202869062260600532318332002376063472433794942491526412549257882606989352664720822722452292780183762837915232895646701224364860

Based on OpenBenchmarking.org data, the selected test / test configuration (Stockfish 13 - Total Time) has an average run-time of 4 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkTotal TimeRun-Time510152025Min: 1 / Avg: 3.76 / Max: 19

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 1.1%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsTotal TimeDeviation246810Min: 0 / Avg: 1.09 / Max: 5

Does It Scale Well With Increasing Cores?

Yes, based on the automated analysis of the collected public benchmark data, this test / test settings does generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

IntelAMDOpenBenchmarking.orgRelative Core Scaling To BaseStockfish CPU Core ScalingTotal Time46816643691215

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set
Support
Instructions Detected
SSE2 (SSE2)
Used by default on supported hardware.
 
MOVDQU COMISD CVTTSD2SI UCOMISD SUBSD MOVDQA MOVD PUNPCKLQDQ PSRLDQ CVTSI2SD DIVSD SHUFPD PSHUFD MULSD MINSD MOVAPD ADDSD CVTSS2SD PADDQ
SSE3 (SSE3)
Used by default on supported hardware.
 
MOVDDUP
SSSE3 (SSSE3)
Used by default on supported hardware.
 
PMADDUBSW
SSE 4.2 (SSE4_2)
Used by default on supported hardware.
Found on Intel processors since at least 2010.
Found on AMD processors since Bulldozer (2011).

 
POPCNT
Requires passing a supported compiler/build flag (verified with targets: sandybridge, skylake, tigerlake, cascadelake, sapphirerapids, alderlake, znver2, znver3).
Found on Intel processors since Sandy Bridge (2011).
Found on AMD processors since Bulldozer (2011).

 
VINSERTF128 VZEROUPPER VEXTRACTF128 VBROADCASTSS
Requires passing a supported compiler/build flag (verified with targets: skylake, tigerlake, cascadelake, sapphirerapids, alderlake, znver2, znver3).
Found on Intel processors since Haswell (2013).
Found on AMD processors since Excavator (2016).

 
VINSERTI128 VPBROADCASTD VPERM2I128 VEXTRACTI128 VPSLLVQ VPBROADCASTQ VPBROADCASTW
FMA (FMA)
Requires passing a supported compiler/build flag (verified with targets: skylake, tigerlake, cascadelake, sapphirerapids, alderlake, znver2, znver3).
Found on Intel processors since Haswell (2013).
Found on AMD processors since Bulldozer (2011).

 
VFMADD231SD VFMADD132SD VFMADD213SD
The test / benchmark does honor compiler flag changes.
Last automated analysis: 31 January 2021

This test profile binary relies on the shared libraries libpthread.so.0, libm.so.6, libc.so.6.

Recent Test Results

OpenBenchmarking.org Results Compare

12 Systems - 453 Benchmark Results

AMD Ryzen 7 5800X 8-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 21.04 - 5.12.0-051200rc3daily20210315-generic - GNOME Shell 3.38.3

1 System - 24 Benchmark Results

Intel Xeon - Red Hat RHEL-AV - Intel 82G33

Debian 9.12 - 4.9.0-12-amd64 - GCC 6.3.0 20170516

1 System - 24 Benchmark Results

Intel Xeon - Red Hat RHEL-AV - Intel 82G33

Debian 9.12 - 4.9.0-12-amd64 - GCC 6.3.0 20170516

1 System - 24 Benchmark Results

Intel Core - Red Hat RHEL-AV - Intel 82G33

Debian 9.12 - 4.9.0-12-amd64 - GCC 6.3.0 20170516

1 System - 5 Benchmark Results

AMD Ryzen 7 5800X 8-Core - Gigabyte X570 AORUS ELITE - 2 x 32768 MB 3200MHz Kingston

Microsoft Windows 10 Build 19042 - 10.0 - 465.89

3 Systems - 189 Benchmark Results

AMD EPYC 7763 64-Core - Supermicro H12SSL-i v1.01 - AMD Starship

Ubuntu 20.04 - 5.12.0-051200rc6daily20210408-generic - GNOME Shell 3.36.4

1 System - 23 Benchmark Results

Intel Core i7-10710U - Intel NUC10i7FNB - Intel Device 02ef

Ubuntu 20.10 - 5.8.0-48-generic - GNOME Shell 3.38.1

1 System - 25 Benchmark Results

Intel Xeon E3-1225 v6 - (2.002 BIOS) - Intel Xeon E3-1200 v6

Ubuntu 20.04 - 5.4.0-70-generic - 1.2.145

1 System - 105 Benchmark Results

Intel Core - Red Hat RHEL-AV - Intel 82G33

Debian 9.12 - 4.9.0-12-amd64 - GCC 6.3.0 20170516

1 System - 12 Benchmark Results

Intel Xeon Gold 6338N - Nokia Solutions and s AE-SER1UW-A/AF1829.01 - Intel Device 0998

CentOS Linux 8 - 4.18.0-240.el8.x86_64 - GNOME Shell 3.32.2

Most Popular Test Results

Find More Test Results