Stockfish

This is a test of Stockfish, an advanced open-source C++11 chess benchmark that can scale up to 1024 CPU threads.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark stockfish.

Project Site

stockfishchess.org

Source Repository

github.com

Test Created

26 November 2014

Last Updated

15 March 2024

Test Maintainer

Michael Larabel 

Test Type

Processor

Average Install Time

1 Minute, 36 Seconds

Average Run Time

47 Seconds

Test Dependencies

C/C++ Compiler Toolchain

Accolades

150k+ Downloads + 10k+ Public Benchmark Results

Supported Platforms


Public Result Uploads *Reported Installs **Reported Test Completions **Test Profile Page Views ***OpenBenchmarking.orgEventsStockfish Popularity Statisticspts/stockfish2014.112015.032015.072015.112016.032016.072016.112017.032017.072017.112018.032018.072018.112019.032019.072019.112020.032020.072020.112021.032021.072021.112022.032022.072022.112023.032023.072023.112024.0320K40K60K80K100K
* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
*** Test profile page view reporting began March 2021.
Data updated weekly as of 21 April 2024.

Revision History

pts/stockfish-1.5.0   [View Source]   Fri, 15 Mar 2024 20:50:37 GMT
Update Stockfish from https://github.com/phoronix-test-suite/phoronix-test-suite/pull/775 though increase ttSize to 4096 as at 2048 seems to have a lot of run-to-run variance. Closes: https://github.com/phoronix-test-suite/phoronix-test-suite/pull/775

pts/stockfish-1.4.0   [View Source]   Sat, 25 Jun 2022 08:32:53 GMT
Update against Stockfish 15 upstream.

pts/stockfish-1.3.0   [View Source]   Fri, 19 Mar 2021 10:46:31 GMT
Update against Stockfish 13 plus incorporate feedback from https://github.com/phoronix-test-suite/phoronix-test-suite/pull/513

pts/stockfish-1.2.0   [View Source]   Thu, 19 Nov 2020 13:50:00 GMT
Update against Stockfish 12, enable AArch64 optimized build.

pts/stockfish-1.1.1   [View Source]   Sat, 19 May 2018 06:26:58 GMT
Add Windows support.

pts/stockfish-1.1.0   [View Source]   Thu, 17 May 2018 15:32:30 GMT
Update Stockfish against version 9, use multi-threaded parameters.

pts/stockfish-1.0.1   [View Source]   Sun, 08 Apr 2018 06:39:33 GMT
Fix build on BSDs

pts/stockfish-1.0.0   [View Source]   Wed, 26 Nov 2014 11:32:02 GMT
Initial commit of Stockfish benchmark.

Suites Using This Test

Chess Test Suite

C/C++ Compiler Tests

Multi-Core

CPU Massive

Server CPU Tests


Performance Metrics

Analyze Test Configuration:

Stockfish 13

Total Time

OpenBenchmarking.org metrics for this test profile configuration based on 1,871 public results since 19 March 2021 with the latest data as of 26 April 2024.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Compatible Public Results
Nodes Per Second (Average)
100th
20
296762614 +/- 9680961
100th
46
293686682 +/- 11806275
97th
11
251974339 +/- 22001523
97th
6
246898101 +/- 2355387
97th
3
243976675 +/- 8703759
97th
3
243788580 +/- 1921927
97th
5
233449862 +/- 1973437
96th
3
207030977 +/- 7516393
95th
27
183638186 +/- 7236917
94th
52
180774788 +/- 4074728
92nd
6
177128759 +/- 3162780
91st
16
170802551 +/- 8407829
90th
14
166758666 +/- 5064196
90th
24
166373747 +/- 7568513
89th
6
165372460 +/- 2457968
87th
5
147645345 +/- 2182147
87th
8
146912972 +/- 1481363
87th
6
144796924 +/- 3644676
87th
16
142503118 +/- 3675897
85th
9
135195088 +/- 3158257
85th
3
133480591 +/- 1041216
85th
11
133053012 +/- 4861259
84th
7
130235250 +/- 3212009
84th
6
126047366 +/- 11556213
83rd
4
121475249 +/- 7042118
83rd
3
116293994 +/- 1226370
83rd
3
103671224 +/- 1430540
82nd
18
100283545 +/- 1807276
81st
5
96914998 +/- 2565469
81st
5
96787452 +/- 2980841
81st
3
96235900 +/- 1280047
81st
16
94937231 +/- 1966926
79th
6
91726783 +/- 1326478
79th
7
91376220 +/- 487795
79th
8
90929999 +/- 3476535
78th
20
90059069 +/- 2370452
77th
4
79433534 +/- 996038
76th
9
78321656 +/- 2412322
76th
4
77555022 +/- 1202440
76th
3
76829774 +/- 312428
76th
17
74414163 +/- 3008076
Mid-Tier
75th
< 73749382
75th
3
71792288 +/- 2118960
74th
9
67881620 +/- 2482299
74th
5
66022869 +/- 4747543
71st
73
55608813 +/- 2095244
69th
10
52847935 +/- 2191033
69th
3
51877464 +/- 1826217
68th
6
50804748 +/- 231080
68th
3
50387097 +/- 617047
67th
19
50050891 +/- 1377992
66th
3
48894654 +/- 1218621
66th
4
48433146 +/- 1119933
64th
4
45383015 +/- 889734
63rd
32
44025193 +/- 1723686
62nd
3
40057667 +/- 1270287
61st
8
38035113 +/- 1380134
61st
11
37441891 +/- 1175918
61st
3
37422972 +/- 986124
60th
3
36389693 +/- 3868630
60th
12
34136846 +/- 1840742
58th
5
31712495 +/- 291217
58th
3
31370918 +/- 287826
57th
28
30459790 +/- 1880995
57th
17
30415486 +/- 1018553
55th
47
28810969 +/- 929312
53rd
3
28266621 +/- 524013
53rd
15
28207090 +/- 215522
51st
3
27701723 +/- 486165
51st
26
27440391 +/- 798517
Median
50th
27348386
50th
4
27135677 +/- 347006
50th
11
26430124 +/- 1220378
48th
11
25775516 +/- 596280
48th
7
25129680 +/- 348391
48th
4
25098939 +/- 2215460
47th
17
24620451 +/- 1484114
47th
4
24485660 +/- 168069
46th
3
23703892 +/- 177292
45th
15
22485656 +/- 976020
45th
4
22483007
44th
8
22385494 +/- 957668
43rd
11
21521966 +/- 2575732
43rd
3
21093301 +/- 409653
42nd
4
20509153 +/- 384275
42nd
9
20335489 +/- 878343
41st
4
19894088 +/- 191253
40th
11
19545283 +/- 2482978
40th
6
19418441 +/- 603027
39th
11
19154600 +/- 175633
38th
4
18518402 +/- 270812
38th
3
18473754 +/- 188061
37th
3
18271038 +/- 133066
37th
6
18241237 +/- 414342
37th
7
18227891 +/- 2084659
37th
30
17941779 +/- 1755787
36th
3
17112635 +/- 274159
36th
3
16263266 +/- 272293
34th
4
15270853 +/- 129615
34th
8
14873361 +/- 802491
33rd
3
13772451 +/- 186357
33rd
9
13693693 +/- 1042712
32nd
18
13568771 +/- 565431
32nd
3
13493442 +/- 100132
31st
6
13201755 +/- 130176
31st
9
13111174 +/- 1348880
31st
5
13077518 +/- 202096
31st
3
12891896 +/- 79328
30th
3
12854042 +/- 162969
30th
5
12578543 +/- 132364
30th
5
12545589 +/- 58294
29th
3
12357059 +/- 196636
28th
7
11812412 +/- 142081
28th
6
11512775 +/- 75125
28th
3
11496848 +/- 733827
27th
4
11148696 +/- 42319
27th
12
11109682 +/- 256755
26th
3
10312200 +/- 50276
Low-Tier
25th
< 10175492
25th
4
10150202 +/- 1122738
25th
3
10031786 +/- 28076
25th
5
9992870 +/- 968953
25th
7
9844561 +/- 321254
25th
7
9793996 +/- 316876
24th
3
9600541 +/- 166615
24th
6
9573284 +/- 286022
23rd
3
9504499 +/- 102586
23rd
7
9281563 +/- 131450
22nd
3
9028568 +/- 69509
21st
14
8649267 +/- 498108
20th
3
8445500 +/- 33887
20th
24
8098955 +/- 522284
20th
3
7998220 +/- 28258
19th
5
7812609 +/- 50050
18th
3
7492835 +/- 17712
18th
3
7435795 +/- 127248
17th
4
7239622 +/- 89645
17th
3
7188809 +/- 164548
17th
3
7185586 +/- 121359
17th
7
7134689 +/- 444246
16th
6
6914584 +/- 123389
15th
4
6779197 +/- 73645
15th
3
6702487 +/- 48796
14th
11
6426574 +/- 266686
14th
3
6211308 +/- 24538
13th
3
6135991 +/- 297981
12th
3
5907733 +/- 81069
11th
7
5267327 +/- 299645
10th
3
4421563 +/- 39888
9th
8
4307265 +/- 66712
8th
3
3675802 +/- 11888
7th
4
3631627 +/- 33320
7th
3
3526923 +/- 86212
7th
4
3433183 +/- 301932
6th
4
3074801 +/- 15351
5th
8
2628291 +/- 57881
4th
3
2457498 +/- 17761
4th
3
2339103 +/- 23044
3rd
4
1681766 +/- 123297
OpenBenchmarking.orgDistribution Of Public Results - Total Time1871 Results Range From 40213 To 322056156 Nodes Per Second402136480532129208511936117025801489322418083868212745122446515627655800308464443403708837227732404183764360902046799664499810308531710952563611596595512240627412884659313528691214172723114816755015460786916104818816748850717392882618036914518680946419324978319969010220613042121257074021901105922545137823189169723833201624477233525121265425765297326409329227053361127697393028341424928985456829629488730273520630917552531561584432205616370140210280350

Based on OpenBenchmarking.org data, the selected test / test configuration (Stockfish 13 - Total Time) has an average run-time of 6 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkTotal TimeRun-Time20406080100Min: 1 / Avg: 5.92 / Max: 112

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 1.2%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsTotal TimeDeviation246810Min: 0 / Avg: 1.22 / Max: 5

Does It Scale Well With Increasing Cores?

Yes, based on the automated analysis of the collected public benchmark data, this test / test settings does generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

IntelAMDOpenBenchmarking.orgRelative Core Scaling To BaseStockfish CPU Core ScalingTotal Time24681216243248641281020304050

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set
Support
Instructions Detected
SSE 4.2 (SSE4_2)
Used by default on supported hardware.
Found on Intel processors since at least 2010.
Found on AMD processors since Bulldozer (2011).

 
POPCNT
Used by default on supported hardware.
Found on Intel processors since Sandy Bridge (2011).
Found on AMD processors since Bulldozer (2011).

 
VZEROUPPER
Used by default on supported hardware.
Found on Intel processors since Haswell (2013).
Found on AMD processors since Excavator (2016).

 
VPBROADCASTD VPERMQ VEXTRACTI128 VPERMD VPBROADCASTQ VINSERTI128 VPBROADCASTW
AVX Vector Neural Network Instructions (AVX-VNNI)
Used by default on supported hardware.
 
VPDPBUSD
FMA (FMA)
Used by default on supported hardware.
Found on Intel processors since Haswell (2013).
Found on AMD processors since Bulldozer (2011).

 
VFMADD132SD VFMSUB231SD VFMADD213SD VFNMADD231SD VFNMADD132SD
The test / benchmark does honor compiler flag changes.
Last automated analysis: 16 March 2024

This test profile binary relies on the shared libraries libm.so.6, libc.so.6.

Tested CPU Architectures

This benchmark has been successfully tested on the below mentioned architectures. The CPU architectures listed is where successful OpenBenchmarking.org result uploads occurred, namely for helping to determine if a given test is compatible with various alternative CPU architectures.

CPU Architecture
Kernel Identifier
Verified On
Intel / AMD x86 64-bit
x86_64
(Many Processors)
IBM Z
s390x
(Many Processors)
IBM POWER (PowerPC) 64-bit
ppc64le
POWER9 4-Core
DEC Alpha
alpha
Alpha
ARMv8 64-bit
aarch64
AArch64 rev 14, ARMv8 Cortex-A53 4-Core, ARMv8 Cortex-A55 4-Core, ARMv8 Cortex-A57 4-Core, ARMv8 Cortex-A72, ARMv8 Cortex-A72 16-Core, ARMv8 Cortex-A72 4-Core, ARMv8 Neoverse-N1, ARMv8 Neoverse-N1 2-Core, ARMv8 Neoverse-N1 4-Core, ARMv8 Neoverse-N1 64-Core, ARMv8 Neoverse-N1 80-Core, ARMv8 Neoverse-V1, ARMv8 Neoverse-V1 4-Core, ARMv8 rev 0 4-Core, ARMv8 rev 0 8-Core, Ampere ARMv8 Neoverse-N1 128-Core, Ampere ARMv8 Neoverse-N1 160-Core, Ampere ARMv8 Neoverse-N1 256-Core, Ampere Altra ARMv8 Neoverse-N1 160-Core, Ampere Altra ARMv8 Neoverse-N1 80-Core, Ampere eMAG ARMv8 32-Core, Apple M1