Stockfish

This is a test of Stockfish, an advanced open-source C++11 chess benchmark that can scale up to 512 CPU threads.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark stockfish.

Project Site

stockfishchess.org

Source Repository

github.com

Test Created

26 November 2014

Last Updated

25 June 2022

Test Maintainer

Michael Larabel 

Test Type

Processor

Average Install Time

50 Seconds

Average Run Time

1 Minute, 11 Seconds

Test Dependencies

C/C++ Compiler Toolchain

Accolades

150k+ Downloads + 5k+ Public Benchmark Results

Supported Platforms


Public Result Uploads *Reported Installs **Reported Test Completions **Test Profile Page Views ***OpenBenchmarking.orgEventsStockfish Popularity Statisticspts/stockfish2014.112015.022015.052015.082015.112016.022016.052016.082016.112017.022017.052017.082017.112018.022018.052018.082018.112019.022019.052019.082019.112020.022020.052020.082020.112021.022021.052021.082021.112022.022022.052022.082022.112023.022023.052023.082023.1120K40K60K80K100K
* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
*** Test profile page view reporting began March 2021.
Data updated weekly as of 27 November 2023.

Revision History

pts/stockfish-1.4.0   [View Source]   Sat, 25 Jun 2022 08:32:53 GMT
Update against Stockfish 15 upstream.

pts/stockfish-1.3.0   [View Source]   Fri, 19 Mar 2021 10:46:31 GMT
Update against Stockfish 13 plus incorporate feedback from https://github.com/phoronix-test-suite/phoronix-test-suite/pull/513

pts/stockfish-1.2.0   [View Source]   Thu, 19 Nov 2020 13:50:00 GMT
Update against Stockfish 12, enable AArch64 optimized build.

pts/stockfish-1.1.1   [View Source]   Sat, 19 May 2018 06:26:58 GMT
Add Windows support.

pts/stockfish-1.1.0   [View Source]   Thu, 17 May 2018 15:32:30 GMT
Update Stockfish against version 9, use multi-threaded parameters.

pts/stockfish-1.0.1   [View Source]   Sun, 08 Apr 2018 06:39:33 GMT
Fix build on BSDs

pts/stockfish-1.0.0   [View Source]   Wed, 26 Nov 2014 11:32:02 GMT
Initial commit of Stockfish benchmark.

Suites Using This Test

Chess Test Suite

C/C++ Compiler Tests

Multi-Core

CPU Massive

Server CPU Tests


Performance Metrics

Analyze Test Configuration:

Stockfish 15

Total Time

OpenBenchmarking.org metrics for this test profile configuration based on 1,686 public results since 25 June 2022 with the latest data as of 2 December 2023.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Compatible Public Results
Nodes Per Second (Average)
100th
15
604072080 +/- 19468868
100th
11
510964054 +/- 30793134
99th
11
423261601 +/- 16233501
98th
5
345549243 +/- 40717832
97th
20
307720157 +/- 11353394
96th
4
296598694 +/- 15063569
95th
14
291280652 +/- 25185857
95th
6
287676826 +/- 7572143
93rd
7
274201679 +/- 4703306
93rd
14
271819086 +/- 16499566
93rd
4
261870685 +/- 12135445
93rd
5
244507997 +/- 19448269
93rd
3
241774328
92nd
6
189668352 +/- 5985608
92nd
7
187666423 +/- 4234033
91st
15
176794832 +/- 5016626
90th
6
171581082 +/- 9109270
89th
10
158404289 +/- 7156680
89th
6
152848611 +/- 8734802
88th
7
147735089 +/- 3045678
88th
5
147212488 +/- 6445035
87th
5
141773878 +/- 19406257
87th
8
140827617 +/- 6530726
87th
6
135057822 +/- 9803076
86th
6
132521379 +/- 8087217
84th
7
101888781 +/- 5928592
83rd
4
88755935 +/- 3069137
83rd
5
87783846 +/- 5376666
82nd
5
81092462 +/- 1741184
82nd
5
79114564 +/- 2435464
80th
34
74929912 +/- 2611414
79th
7
73141287 +/- 3498747
79th
3
72461172 +/- 2569162
76th
13
68610241 +/- 3306024
76th
45
68237845 +/- 3766925
76th
4
67971645 +/- 7021997
Mid-Tier
75th
< 67599924
73rd
3
57927413 +/- 1262879
72nd
15
55934857 +/- 1521360
71st
32
53646816 +/- 4475839
70th
12
51750320 +/- 1954625
68th
16
48245524 +/- 1910095
66th
3
45484798 +/- 525969
65th
7
44960618 +/- 3404502
65th
8
44038375 +/- 1560440
64th
8
41469315 +/- 1294285
64th
55
40866819 +/- 4102530
63rd
5
40205158 +/- 3753273
62nd
17
39400093 +/- 3548350
60th
10
37744472 +/- 2138839
60th
3
37049520 +/- 1971736
59th
5
36740319 +/- 1004428
58th
10
36122020 +/- 1231178
58th
8
35211744 +/- 1180283
55th
8
30153257 +/- 1713847
54th
10
29516512 +/- 2196074
54th
14
29440080 +/- 1040306
53rd
6
29139790 +/- 689956
53rd
4
28867958 +/- 1026647
52nd
7
28787827 +/- 1342093
52nd
10
28565569 +/- 1315619
52nd
11
28106268 +/- 1012889
51st
7
27836742 +/- 2469144
Median
50th
26975364
50th
4
26308388 +/- 763097
50th
3
25990414 +/- 632577
49th
10
25633638 +/- 735710
48th
7
25305874 +/- 748941
47th
3
24896419 +/- 588273
47th
4
24876554 +/- 197731
46th
5
24583187 +/- 3246969
45th
7
23126921 +/- 914521
45th
3
22695085 +/- 136863
43rd
8
20919953 +/- 440903
42nd
9
20262335 +/- 893943
41st
6
19637983 +/- 1615683
41st
4
19599754 +/- 736366
41st
6
19468514 +/- 626831
38th
4
17930651 +/- 736839
38th
6
17655558 +/- 394770
36th
4
16861399 +/- 982042
36th
3
16755318 +/- 763464
36th
4
16696788 +/- 620575
35th
21
16362789 +/- 972207
34th
3
15494470 +/- 555085
28th
4
12137661 +/- 259782
28th
8
11846907 +/- 873499
28th
4
11764236 +/- 435994
27th
10
11540074 +/- 250087
26th
28
11371728 +/- 422555
Low-Tier
25th
< 11192026
24th
3
10683934 +/- 362272
24th
3
10610009 +/- 181037
22nd
3
9848170 +/- 949982
22nd
4
9812893 +/- 504180
20th
3
9549486 +/- 25913
18th
3
8844810 +/- 310649
18th
4
8800143 +/- 204854
17th
5
8622132 +/- 285875
17th
3
8543884 +/- 400847
17th
3
8116850 +/- 306942
15th
3
7249481 +/- 665297
15th
4
7232606 +/- 353006
14th
3
6671267 +/- 218087
14th
5
6529621 +/- 399677
12th
8
5827797 +/- 253454
11th
5
5568018 +/- 225047
10th
4
4983479 +/- 46205
10th
3
4907645 +/- 69386
9th
4
4800974 +/- 240019
7th
8
4364182 +/- 536536
7th
4
3898789 +/- 23139
6th
3
3485107 +/- 87941
6th
3
3260619 +/- 98833
5th
4
2843404 +/- 259265
4th
3
2237803 +/- 42202
2nd
7
1050754 +/- 56496
OpenBenchmarking.orgDistribution Of Public Results - Total Time1682 Results Range From 191401 To 631441203 Nodes Per Second19140112816398254413953806639250691389633163867594138388566380101191377113816374126441371139066368151691365164316362176941359189566356202191353214816350227441347240066344252691341265316338277941335290566332303191329315816326328441323341066320353691317366316314378941311391566308404191305416816302429441299442066296454691293467316290479941287492566284505191281517816278530441275543066272555691269568316266580941263593566260606191257618816254631441251100200300400500

Based on OpenBenchmarking.org data, the selected test / test configuration (Stockfish 15 - Total Time) has an average run-time of 16 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkTotal TimeRun-Time1530456075Min: 2 / Avg: 15.77 / Max: 81

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 2.2%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsTotal TimeDeviation3691215Min: 0 / Avg: 2.22 / Max: 8

Does It Scale Well With Increasing Cores?

Yes, based on the automated analysis of the collected public benchmark data, this test / test settings does generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

IntelAMDOpenBenchmarking.orgRelative Core Scaling To BaseStockfish CPU Core ScalingTotal Time246812162432566496128510152025

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set
Support
Instructions Detected
SSE 4.2 (SSE4_2)
Used by default on supported hardware.
Found on Intel processors since at least 2010.
Found on AMD processors since Bulldozer (2011).

 
POPCNT
Used by default on supported hardware.
Found on Intel processors since Sandy Bridge (2011).
Found on AMD processors since Bulldozer (2011).

 
VZEROUPPER
Used by default on supported hardware.
Found on Intel processors since Haswell (2013).
Found on AMD processors since Excavator (2016).

 
VPERMQ VPBROADCASTD VPERMD VPBROADCASTQ VINSERTI128 VPBROADCASTW VEXTRACTI128
AVX Vector Neural Network Instructions (AVX-VNNI)
Used by default on supported hardware.
 
VPDPBUSD
FMA (FMA)
Used by default on supported hardware.
Found on Intel processors since Haswell (2013).
Found on AMD processors since Bulldozer (2011).

 
VFMADD132SD VFNMADD132SD VFMADD213SD VFMSUB132SD
The test / benchmark does honor compiler flag changes.
Last automated analysis: 27 June 2022

This test profile binary relies on the shared libraries libm.so.6, libc.so.6.

Tested CPU Architectures

This benchmark has been successfully tested on the below mentioned architectures. The CPU architectures listed is where successful OpenBenchmarking.org result uploads occurred, namely for helping to determine if a given test is compatible with various alternative CPU architectures.

CPU Architecture
Kernel Identifier
Verified On
Intel / AMD x86 64-bit
x86_64
(Many Processors)
IBM POWER (PowerPC) 64-bit
ppc64le
POWER8E, POWER9 44-Core
IBM POWER (PowerPC) 64-bit
ppc64
PPC970MP
Intel / AMD x86 32-bit
i686
(Many Processors)
ARMv8 64-bit
arm64
Apple M1, Apple M1 Max, Apple M1 Pro, Apple M1 Ultra, Apple M2
ARMv8 64-bit
aarch64
ARMv8 4-Core, ARMv8 Cortex-A53 4-Core, ARMv8 Cortex-A55 4-Core, ARMv8 Cortex-A72, ARMv8 Cortex-A72 4-Core, ARMv8 Cortex-A76 4-Core, ARMv8 Neoverse-N1, ARMv8 Neoverse-N1 128-Core, ARMv8 Neoverse-N1 256-Core, ARMv8 Neoverse-V1, ARMv8 rev 0, Ampere ARMv8 Neoverse-N1 256-Core, Apple M1, Apple M2, Rockchip ARMv8 Cortex-A76 4-Core, Rockchip ARMv8 Cortex-A76 6-Core