Crafty

This is a performance test of Crafty, an advanced open-source chess engine.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark crafty.

Project Site

craftychess.com

Test Created

6 December 2010

Last Updated

19 November 2020

Test Maintainer

Michael Larabel 

Test Type

Processor

Average Install Time

12 Seconds

Average Run Time

34 Minutes, 59 Seconds

Test Dependencies

C/C++ Compiler Toolchain

Accolades

250k+ Downloads + 10k+ Public Benchmark Results

Supported Platforms

Supported Architectures

x86 + x86_64

Public Result UploadsTest Completions*Reported Installs*OpenBenchmarking.orgEventsCrafty Popularity Statisticspts/crafty2011.032011.072011.112012.032012.072012.112013.032013.072013.112014.032014.072014.112015.032015.072015.112016.032016.072016.112017.032017.072017.112018.032018.072018.112019.032019.072019.112020.032020.072020.112021.0316K32K48K64K80K
* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data current as of Sat, 06 Mar 2021 18:52:14 GMT.

Revision History

pts/crafty-1.4.5   [View Source]   Thu, 19 Nov 2020 18:11:42 GMT
Limit to x86/x86_64 architecture as upstream Crafty is still not compatible with non-x86 architectures.

pts/crafty-1.4.4   [View Source]   Sun, 23 Dec 2018 10:45:36 GMT
Fix building with Clang on FreeBSD.

pts/crafty-1.4.3   [View Source]   Sat, 09 Jun 2018 10:58:29 GMT
Fix Crafty build on Linux when Clang isn't available since its upstream makefile was defaulting to Clang, so add GCC check.

pts/crafty-1.4.2   [View Source]   Sat, 07 Apr 2018 18:53:55 GMT
Update download link for Windows, fix build on FreeBSD/Clang.

pts/crafty-1.4.1   [View Source]   Sun, 04 Mar 2018 11:05:38 GMT
Add Windows support.

pts/crafty-1.4.0   [View Source]   Wed, 07 Feb 2018 15:16:24 GMT
Updated against Crafty 25.2 upstream, switch to reporting nodes per second.

pts/crafty-1.3.1   [View Source]   Thu, 25 Aug 2016 14:01:41 GMT
Update CFLAGS handling, update download links

pts/crafty-1.3.0   [View Source]   Sun, 29 Jan 2012 12:44:39 GMT
Update against Crafty 23.4 upstream. Plus makefile changes.

pts/crafty-1.2.0   [View Source]   Mon, 06 Dec 2010 14:37:37 GMT
Initial import into OpenBenchmarking.org

Suites Using This Test

Chess Test Suite

CPU Massive


Performance Metrics

Analyze Test Configuration:

Crafty 25.2

Elapsed Time

OpenBenchmarking.org metrics for this test profile configuration based on 3,883 public results since 7 February 2018 with the latest data as of 4 March 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Matching Public Results
Nodes Per Second (Average)
100th
44
11682671 +/- 243415
100th
23
11620929 +/- 276336
100th
12
11473587 +/- 293887
99th
14
11259342 +/- 200553
98th
32
10246343 +/- 243296
97th
27
9841085 +/- 476834
97th
9
9776884 +/- 576762
97th
11
9725071 +/- 87795
97th
32
9699551 +/- 327190
96th
3
9547191 +/- 44766
95th
19
9384022 +/- 97285
95th
5
9363214 +/- 556735
95th
32
9344672 +/- 465332
94th
21
9244259 +/- 122571
94th
6
9229282 +/- 238465
93rd
8
9151800 +/- 315448
92nd
23
9081152 +/- 348715
92nd
45
9056451 +/- 212873
91st
28
8989998 +/- 540746
91st
3
8986953 +/- 12690
91st
19
8980478 +/- 311743
91st
25
8945571 +/- 536315
91st
5
8945141 +/- 29621
90th
4
8924105 +/- 964375
88th
24
8793523 +/- 303613
88th
8
8782949 +/- 353136
88th
6
8775010 +/- 205190
88th
46
8727448 +/- 435667
87th
7
8682668 +/- 97438
87th
3
8639990 +/- 22089
86th
3
8578231 +/- 260438
86th
76
8571122 +/- 288492
86th
9
8527516 +/- 308399
86th
10
8508811 +/- 365048
86th
5
8508272 +/- 498486
85th
11
8475932 +/- 318822
84th
7
8329725 +/- 136296
84th
3
8303243 +/- 839546
84th
8
8301411 +/- 43533
84th
4
8300494 +/- 317611
82nd
6
8038644 +/- 25877
81st
3
8018138 +/- 821135
81st
14
7985347 +/- 443514
81st
3
7956537 +/- 96745
81st
5
7949863 +/- 15938
80th
10
7899049 +/- 195593
80th
9
7871543 +/- 89106
79th
3
7852663 +/- 16762
79th
11
7812852 +/- 336632
79th
8
7804216 +/- 405394
78th
5
7794707 +/- 562417
78th
11
7783544 +/- 110153
78th
21
7781185 +/- 230280
78th
15
7779990 +/- 439225
78th
8
7775630 +/- 164630
77th
9
7695541 +/- 303296
76th
5
7674594 +/- 140910
76th
12
7673929 +/- 110413
76th
5
7663653 +/- 20252
76th
11
7634674 +/- 310850
Mid-Tier
75th
< 7630211
75th
4
7623209 +/- 266245
75th
7
7606611 +/- 172304
75th
4
7604728 +/- 243362
74th
15
7598774 +/- 227068
74th
6
7597925 +/- 213183
74th
6
7584662 +/- 128712
74th
22
7582545 +/- 336952
74th
5
7582154 +/- 55143
73rd
8
7560577 +/- 133971
73rd
7
7559670 +/- 339210
73rd
58
7552622 +/- 332803
71st
5
7447854 +/- 100757
70th
3
7441721 +/- 593726
70th
3
7439930 +/- 282137
70th
4
7431782 +/- 512795
70th
5
7419714 +/- 21267
70th
9
7418278 +/- 30101
69th
32
7417213 +/- 452883
69th
12
7407839 +/- 441660
69th
3
7393658 +/- 9587
68th
7
7384775 +/- 43613
68th
5
7360294 +/- 439947
68th
7
7355933 +/- 200229
67th
5
7349564 +/- 293057
67th
57
7314181 +/- 396851
66th
10
7299701 +/- 790854
66th
3
7293575 +/- 782601
66th
6
7285696 +/- 135780
65th
4
7252590 +/- 116327
65th
18
7231277 +/- 478583
65th
5
7222177 +/- 221799
65th
6
7221898 +/- 685008
63rd
7
7175323 +/- 174366
63rd
5
7150934 +/- 182676
63rd
7
7143996 +/- 294005
63rd
5
7140050 +/- 959392
63rd
16
7133979 +/- 511769
63rd
10
7127481 +/- 185608
62nd
39
7097511 +/- 547347
62nd
3
7097068 +/- 40016
62nd
13
7087433 +/- 101829
62nd
4
7081629 +/- 127652
62nd
3
7075120 +/- 246201
62nd
13
7073289 +/- 292388
61st
4
7065322 +/- 20518
61st
16
7055924 +/- 134665
61st
14
7043309 +/- 586752
60th
20
7031955 +/- 201195
60th
25
7003435 +/- 463107
59th
4
7000305 +/- 421998
59th
31
6975570 +/- 747703
59th
16
6972370 +/- 36413
58th
23
6963052 +/- 350984
57th
12
6946783 +/- 21630
57th
9
6928627 +/- 440225
56th
8
6914033 +/- 161804
55th
46
6897697 +/- 95897
55th
17
6872142 +/- 151944
55th
10
6860348 +/- 156952
54th
3
6854810 +/- 176156
54th
3
6849985 +/- 180266
54th
5
6826318 +/- 294906
54th
10
6820771 +/- 150487
54th
9
6807523 +/- 870825
53rd
4
6776142 +/- 357303
53rd
12
6769982 +/- 385750
53rd
8
6754392 +/- 41332
53rd
27
6752777 +/- 240230
52nd
8
6743088 +/- 313669
51st
7
6713219 +/- 682633
51st
13
6709134 +/- 91128
51st
7
6708456 +/- 837937
Median
50th
6685602
50th
4
6677632 +/- 254483
50th
7
6672829 +/- 76082
50th
3
6646628 +/- 71135
50th
9
6641964 +/- 32513
49th
10
6617697 +/- 246529
48th
3
6590495 +/- 465714
48th
10
6587447 +/- 310203
48th
4
6583949 +/- 71488
48th
4
6577011 +/- 247840
48th
8
6561496 +/- 159327
47th
3
6551338 +/- 106771
47th
11
6547470 +/- 291548
46th
6
6518900 +/- 227347
45th
13
6483075 +/- 202102
44th
32
6451362 +/- 243560
44th
4
6450952 +/- 46850
44th
14
6434774 +/- 209860
43rd
40
6412711 +/- 386410
42nd
10
6392628 +/- 107310
42nd
8
6359084 +/- 261505
41st
6
6336642 +/- 297795
41st
9
6311654 +/- 140448
41st
14
6277107 +/- 234989
40th
4
6271764 +/- 343407
40th
5
6261926 +/- 33808
40th
3
6258188 +/- 322943
40th
16
6236198 +/- 408118
40th
6
6231209 +/- 350699
39th
9
6196992 +/- 270110
39th
3
6182269 +/- 117641
39th
8
6176520 +/- 305305
37th
26
6072494 +/- 703479
36th
27
6054861 +/- 515174
36th
4
6039822 +/- 495065
35th
6
5995192 +/- 42728
35th
3
5991537 +/- 643389
35th
7
5978934 +/- 270587
35th
6
5977876 +/- 230011
35th
3
5977744 +/- 265809
35th
8
5973477 +/- 475494
34th
6
5960654 +/- 767814
34th
3
5941774 +/- 772276
34th
4
5935476 +/- 187894
34th
8
5919119 +/- 672281
32nd
12
5866649 +/- 123908
32nd
5
5859985 +/- 569728
32nd
7
5848206 +/- 861763
32nd
5
5840132 +/- 68611
32nd
13
5829115 +/- 377088
32nd
12
5825163 +/- 121184
32nd
3
5817152 +/- 18682
32nd
9
5806916 +/- 137790
31st
28
5791520 +/- 150319
31st
17
5769392 +/- 597773
31st
3
5766876 +/- 126875
30th
26
5697801 +/- 156337
28th
9
5629745 +/- 331515
27th
7
5627818 +/- 59387
27th
3
5623730 +/- 103023
27th
3
5621919 +/- 116293
27th
16
5593819 +/- 769106
27th
6
5571001 +/- 99989
26th
16
5559728 +/- 11869
26th
4
5546345 +/- 660937
26th
9
5538528 +/- 782694
26th
7
5533930 +/- 234825
26th
3
5525797 +/- 32045
Low-Tier
25th
< 5515793
25th
5
5484781 +/- 15301
25th
4
5478604 +/- 88952
24th
3
5451428 +/- 8627
24th
17
5442554 +/- 387101
23rd
4
5401508 +/- 19334
21st
5
5282631 +/- 107132
21st
4
5271253 +/- 213511
21st
5
5254040 +/- 38373
20th
13
5239949 +/- 124233
20th
7
5223547 +/- 312225
20th
4
5196984 +/- 1977
18th
3
5108455 +/- 186874
18th
17
5101290 +/- 341637
18th
6
5099960 +/- 128459
18th
5
5099095 +/- 488114
18th
18
5091054 +/- 225032
18th
3
5060832 +/- 53894
17th
3
5035384 +/- 535606
16th
3
4968592 +/- 19551
16th
3
4968582 +/- 648736
15th
7
4916824 +/- 439929
15th
4
4881276 +/- 71907
15th
3
4874153 +/- 9423
15th
7
4867445 +/- 9145
14th
6
4825743 +/- 77788
14th
10
4819477 +/- 18251
13th
3
4797424 +/- 52980
13th
3
4749062 +/- 467246
13th
3
4736884 +/- 91823
12th
4
4695195 +/- 70807
12th
3
4689964 +/- 275408
12th
9
4656601 +/- 438885
12th
5
4642202 +/- 51169
12th
6
4640692 +/- 10270
12th
6
4632287 +/- 407123
11th
3
4502787 +/- 51057
11th
3
4482987 +/- 19702
10th
4
4371345 +/- 28762
10th
5
4337915 +/- 38563
9th
4
4317524 +/- 49115
7th
4
3791538 +/- 75279
7th
9
3614091 +/- 160529
6th
4
3221921 +/- 10958
5th
3
3212525 +/- 309953
3rd
38
2336343 +/- 2225
3rd
3
2202620 +/- 5924
3rd
3
2118380 +/- 149476
2nd
4
1965952 +/- 1848
2nd
3
1722167 +/- 256911
2nd
4
1671671 +/- 36560
OpenBenchmarking.orgDistribution Of Public Results - Elapsed Time3883 Results Range From 449797 To 12258866 Nodes Per Second449797685979922161115834313945251630707186688921030712339253257543528116173047799328398135201633756345399252742287094464891470107349372555173437540961956458015881983611816563543476590529682671170628937299075753525777714398007621824380384799858716167895234991885319424713966089598970771013325910369441106056231084180511077987113141691155035111786533120227151225889760120180240300

Based on OpenBenchmarking.org data, the selected test / test configuration (Crafty 25.2 - Elapsed Time) has an average run-time of 2 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkElapsed TimeRun-Time48121620Min: 1 / Avg: 1.88 / Max: 13

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.3%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsElapsed TimeDeviation246810Min: 0 / Avg: 0.29 / Max: 5

Does It Scale Well With Increasing Cores?

No, based on the automated analysis of the collected public benchmark data, this test / test settings does not generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

AMDIntelOpenBenchmarking.orgRelative Core Scaling To BaseCrafty CPU Core ScalingElapsed Time2468101216182024324048640.72081.44162.16242.88323.604

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set
Support
Instructions Detected
SSE2 (SSE2)
Used by default on supported hardware.
 
PUNPCKLQDQ MOVDQA CVTSS2SD DIVSD CVTSI2SD ADDSD MOVDQU MOVD PSHUFD PSRLDQ PMULUDQ PSHUFLW PADDQ PUNPCKHQDQ SHUFPD CVTTSD2SI MULSD COMISD CVTSD2SS CVTDQ2PS CVTTPS2DQ SUBSD
SSE 4.2 (SSE4_2)
Used by default on supported hardware.
Found on Intel processors since at least 2010.
Found on AMD processors since Bulldozer (2011).

 
POPCNT
Last automated analysis: 30 January 2021

This test profile binary relies on the shared libraries libm.so.6, libpthread.so.0, libc.so.6.

Recent Test Results

OpenBenchmarking.org Results Compare

2 Systems - 81 Benchmark Results

2 x AMD EPYC 7742 64-Core - Supermicro H11DSi-NT v2.00 - AMD Starship

Ubuntu 20.04 - 5.8.0-44-generic - GNOME Shell 3.36.4

2 Systems - 2 Benchmark Results

Intel Core i3-8100 - ASUS PRIME Z370-P - Intel Device 3e1f

Ubuntu 18.04 - 4.15.0-33-generic - GNOME

1 System - 1 Benchmark Result

Intel Celeron J4125 - (GB01_ZW_1_05 BIOS) - Intel Gemini Lake

ManjaroLinux 20.2.1 - 5.10.7-3-MANJARO - Xfce 4.16

3 Systems - 21 Benchmark Results

Intel Xeon - Google Compute Engine n1-standard-1 - 4096MB

Ubuntu 20.04 - 5.4.0-1036-gcp - GNOME Shell 3.36.4

1 System - 7 Benchmark Results

AMD Ryzen 9 3900X 12-Core - ASUS TUF GAMING X570-PLUS - AMD Starship

Ubuntu 20.04 - 5.10.0-051000-generic - GNOME Shell 3.36.4

2 Systems - 8 Benchmark Results

AMD Ryzen 7 1700 Eight-Core - ASUS PRIME A320M-K - AMD 17h

ManjaroLinux 20.2.1 - 5.9.16-1-MANJARO - GNOME Shell 3.38.3

4 Systems - 200 Benchmark Results

Intel Xeon E-2278GEL - Logic Supply RXM-181 - Intel Cannon Lake PCH

Ubuntu 20.10 - 5.8.0-41-generic - GNOME Shell 3.38.2

1 System - 7 Benchmark Results

AMD Ryzen 9 3900X 12-Core - ASUS TUF GAMING X570-PLUS - AMD Starship

Ubuntu 20.04 - 5.8.0-41-generic - GNOME Shell 3.36.4

1 System - 7 Benchmark Results

4 x Intel Xeon E5-4620 v4 - Dell 0VVT0H - Intel Xeon E7 v4

Debian 10 - 5.1.15 - GCC 10.2.0 + ICC

1 System - 5 Benchmark Results

4 x Intel Xeon Gold 6248 - Dell 0TF0V7 - Intel Sky Lake-E DMI3 Registers

CentOS Linux 8 - 4.18.0-80.11.2.el8_0.x86_64 - xfs

1 System - 1 Benchmark Result

AMD Ryzen 9 5950X 16-Core - ASUS ROG CROSSHAIR VIII DARK HERO - 2 x 16384 MB 3600MHz F4-3600C14-16GTZN

Microsoft Windows 10 Pro Build 19042 - 10.0 - 460.79

Most Popular Test Results

OpenBenchmarking.org Results Compare

3 Systems - 268 Benchmark Results

Intel Core i5-2520M - HP 161C - Intel 2nd Generation Core DRAM

Ubuntu 18.04 - 4.18.0-20-generic - GNOME Shell 3.28.3

12 Systems - 593 Benchmark Results

AMD Ryzen 5 3600X 6-Core - MSI X470 GAMING M7 AC - AMD Starship

Ubuntu 20.04 - 5.8.0-050800daily20200622-generic - GNOME Shell 3.36.2

11 Systems - 217 Benchmark Results

AMD Ryzen 9 3900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4

2 Systems - 178 Benchmark Results

Intel Core i9-7980XE - ASUS PRIME X299-A - Intel Sky Lake-E DMI3 Registers

Ubuntu 18.04 - 4.15.2-041502-generic - GNOME Shell 3.26.2

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.9.0-6-amd64 - GCC 6.3.0 20170516

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.9.0-6-amd64 - GCC 6.3.0 20170516

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.9.0-6-amd64 - GCC 6.3.0 20170516

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.9.0-6-amd64 - GCC 6.3.0 20170516

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.17.4-xanmod4 - GCC 6.3.0 20170516

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.17.4-xanmod4 - GCC 6.3.0 20170516

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.17.4-xanmod4 - GCC 6.3.0 20170516

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.17.4-xanmod4 - GCC 6.3.0 20170516

Find More Test Results