Crafty

This is a performance test of Crafty, an advanced open-source chess engine.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark crafty.

Project Site

craftychess.com

Test Created

6 December 2010

Last Updated

19 November 2020

Test Maintainer

Michael Larabel 

Test Type

Processor

Average Install Time

12 Seconds

Average Run Time

34 Minutes, 59 Seconds

Test Dependencies

C/C++ Compiler Toolchain

Accolades

300k+ Downloads + 10k+ Public Benchmark Results

Supported Platforms

Supported Architectures

x86 + x86_64

Public Result Uploads *Reported Test Completions **Reported Installs **Test Profile Page Views ***OpenBenchmarking.orgEventsCrafty Popularity Statisticspts/crafty2010.122011.052011.102012.032012.082013.012013.062013.112014.042014.092015.022015.072015.122016.052016.102017.032017.082018.012018.062018.112019.042019.092020.022020.072020.122021.052021.102022.032022.082023.012023.062023.112024.0440K80K120K160K200K
* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
*** Test profile page view reporting began March 2021.
Data updated weekly as of 15 June 2024.

Revision History

pts/crafty-1.4.5   [View Source]   Thu, 19 Nov 2020 18:11:42 GMT
Limit to x86/x86_64 architecture as upstream Crafty is still not compatible with non-x86 architectures.

pts/crafty-1.4.4   [View Source]   Sun, 23 Dec 2018 10:45:36 GMT
Fix building with Clang on FreeBSD.

pts/crafty-1.4.3   [View Source]   Sat, 09 Jun 2018 10:58:29 GMT
Fix Crafty build on Linux when Clang isn't available since its upstream makefile was defaulting to Clang, so add GCC check.

pts/crafty-1.4.2   [View Source]   Sat, 07 Apr 2018 18:53:55 GMT
Update download link for Windows, fix build on FreeBSD/Clang.

pts/crafty-1.4.1   [View Source]   Sun, 04 Mar 2018 11:05:38 GMT
Add Windows support.

pts/crafty-1.4.0   [View Source]   Wed, 07 Feb 2018 15:16:24 GMT
Updated against Crafty 25.2 upstream, switch to reporting nodes per second.

pts/crafty-1.3.1   [View Source]   Thu, 25 Aug 2016 14:01:41 GMT
Update CFLAGS handling, update download links

pts/crafty-1.3.0   [View Source]   Sun, 29 Jan 2012 12:44:39 GMT
Update against Crafty 23.4 upstream. Plus makefile changes.

pts/crafty-1.2.0   [View Source]   Mon, 06 Dec 2010 14:37:37 GMT
Initial import into OpenBenchmarking.org

Suites Using This Test

Chess Test Suite

CPU Massive


Performance Metrics

Analyze Test Configuration:

Crafty 25.2

Elapsed Time

OpenBenchmarking.org metrics for this test profile configuration based on 4,989 public results since 7 February 2018 with the latest data as of 20 June 2024.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Compatible Public Results
Nodes Per Second (Average)
100th
15
15050611 +/- 83498
100th
32
14968080 +/- 226090
100th
12
14908561 +/- 347510
100th
10
14855935 +/- 68439
100th
6
14688210 +/- 94290
100th
7
14564754 +/- 41631
99th
9
14472369 +/- 784938
99th
20
14303658 +/- 370981
99th
13
14299602 +/- 1362204
99th
9
13990575 +/- 168719
99th
5
13430361 +/- 93068
98th
8
13313005 +/- 458915
98th
13
12774951 +/- 169162
97th
12
12244517 +/- 315910
97th
28
12049878 +/- 1735777
96th
6
12011029 +/- 562127
96th
13
11999851 +/- 915568
96th
6
11971527 +/- 26224
95th
111
11709627 +/- 289661
94th
42
11497609 +/- 444051
93rd
36
11418793 +/- 285869
93rd
4
11394743 +/- 10333
93rd
30
11315962 +/- 742099
92nd
15
11053374 +/- 93615
91st
6
10928385 +/- 372556
91st
3
10919999 +/- 174377
91st
21
10894325 +/- 656454
91st
10
10660633 +/- 224502
91st
3
10653703 +/- 405710
90th
3
10456707 +/- 263789
90th
3
10397708 +/- 22801
90th
9
10366930 +/- 194409
89th
37
10211193 +/- 229920
89th
3
10208784
89th
7
10148999 +/- 219371
88th
3
9955476 +/- 214765
88th
5
9898719 +/- 205824
88th
10
9886835 +/- 69774
88th
10
9860840 +/- 55017
88th
27
9841085 +/- 476834
87th
9
9776884 +/- 576762
87th
13
9766424 +/- 446370
87th
11
9725071 +/- 87795
87th
32
9723010 +/- 349974
87th
3
9596227 +/- 124176
86th
3
9576145 +/- 203411
86th
3
9547191 +/- 44766
85th
8
9417836 +/- 427551
85th
3
9417411 +/- 628509
85th
23
9378600 +/- 84113
85th
32
9344672 +/- 465332
85th
4
9316933 +/- 123214
84th
6
9229282 +/- 238465
84th
22
9219949 +/- 160008
83rd
7
9201302 +/- 305322
82nd
53
9073627 +/- 258183
82nd
29
9062841 +/- 339030
82nd
7
9018627 +/- 291642
82nd
7
9017044 +/- 733738
81st
28
8989998 +/- 540746
81st
20
8968518 +/- 308106
81st
5
8964715 +/- 192698
81st
25
8945571 +/- 536315
81st
5
8945141 +/- 29621
80th
5
8923676 +/- 87109
78th
9
8785897 +/- 375836
78th
6
8775010 +/- 205190
78th
32
8738623 +/- 369287
78th
46
8727448 +/- 435667
77th
13
8674264 +/- 385550
77th
3
8603000 +/- 16929
76th
77
8564762 +/- 291685
76th
8
8547609 +/- 121833
76th
10
8508811 +/- 365048
76th
5
8508272 +/- 498486
Mid-Tier
75th
< 8506449
75th
4
8435023 +/- 53411
75th
43
8430993 +/- 288808
75th
10
8415338 +/- 224706
74th
11
8360122 +/- 642776
74th
7
8329725 +/- 136296
74th
4
8300494 +/- 317611
73rd
10
8282340 +/- 55591
72nd
11
8153318 +/- 114514
72nd
17
8096396 +/- 507278
71st
6
8049298 +/- 18058
71st
7
8021896 +/- 1081689
70th
16
7954524 +/- 421396
70th
8
7953948 +/- 110707
70th
5
7951432 +/- 198769
70th
5
7949863 +/- 15938
69th
9
7871543 +/- 89106
69th
4
7862593 +/- 739112
69th
5
7821429 +/- 44381
68th
10
7808537 +/- 358062
68th
18
7807671 +/- 409314
68th
20
7791902 +/- 221883
68th
13
7784670 +/- 103360
68th
7
7778260 +/- 233953
68th
8
7775630 +/- 164630
67th
4
7742940 +/- 630145
67th
7
7734508 +/- 108597
67th
8
7724828 +/- 81558
66th
5
7699372 +/- 524230
66th
9
7695541 +/- 303296
65th
13
7631532 +/- 283870
65th
8
7629374 +/- 172025
65th
4
7604728 +/- 243362
64th
16
7597353 +/- 219442
64th
6
7584662 +/- 128712
64th
5
7582154 +/- 55143
64th
3
7580411 +/- 325057
64th
23
7572388 +/- 332789
63rd
7
7559670 +/- 339210
63rd
58
7552622 +/- 332803
63rd
7
7549026 +/- 80883
63rd
7
7518494 +/- 66414
62nd
14
7491811 +/- 459449
62nd
4
7467337 +/- 328837
62nd
6
7463969 +/- 19338
61st
5
7447854 +/- 100757
61st
3
7441721 +/- 593726
61st
3
7439930 +/- 282137
61st
7
7438784 +/- 46321
61st
4
7431782 +/- 512795
60th
9
7418278 +/- 30101
60th
32
7417213 +/- 452883
58th
5
7360294 +/- 439947
58th
25
7356757 +/- 745929
58th
7
7355933 +/- 200229
58th
5
7349770 +/- 18626
58th
5
7349564 +/- 293057
58th
11
7313716 +/- 136603
57th
10
7299701 +/- 790854
57th
6
7285696 +/- 135780
57th
52
7285130 +/- 497556
56th
4
7252590 +/- 116327
56th
18
7231277 +/- 478583
56th
6
7221898 +/- 685008
56th
7
7218008 +/- 336960
55th
7
7175323 +/- 174366
55th
7
7168819 +/- 278886
55th
7
7143996 +/- 294005
54th
5
7140050 +/- 959392
54th
15
7128159 +/- 529183
54th
10
7127481 +/- 185608
54th
41
7108069 +/- 535635
54th
5
7100772 +/- 551131
54th
4
7081629 +/- 127652
54th
3
7075120 +/- 246201
54th
13
7073289 +/- 292388
53rd
4
7065322 +/- 20518
53rd
14
7043309 +/- 586752
53rd
17
7038342 +/- 221051
53rd
19
7038208 +/- 181694
52nd
25
7003435 +/- 463107
52nd
4
7000305 +/- 421998
52nd
6
6989589 +/- 42602
51st
3
6966562 +/- 438753
51st
24
6965996 +/- 343571
Median
50th
6946786
50th
6
6935326 +/- 23501
49th
8
6914033 +/- 161804
49th
44
6909337 +/- 89446
49th
17
6869798 +/- 116640
48th
4
6864468 +/- 150010
48th
6
6841168 +/- 295325
48th
9
6807523 +/- 870825
47th
10
6796851 +/- 299240
47th
11
6796827 +/- 163366
47th
3
6774951 +/- 15542
47th
10
6769144 +/- 49218
47th
13
6763480 +/- 366922
46th
24
6734396 +/- 249099
46th
7
6713219 +/- 682633
45th
7
6708456 +/- 837937
45th
6
6702137 +/- 402618
45th
9
6686976 +/- 102816
44th
10
6646649 +/- 38187
44th
11
6640299 +/- 245598
44th
4
6633180 +/- 124323
44th
12
6632447 +/- 206675
44th
10
6609460 +/- 174551
44th
13
6606482 +/- 302893
43rd
11
6594423 +/- 277781
43rd
4
6583949 +/- 71488
43rd
4
6577011 +/- 247840
43rd
8
6570849 +/- 296919
42nd
6
6518900 +/- 227347
41st
3
6471531 +/- 101039
40th
4
6450952 +/- 46850
40th
5
6444651 +/- 65026
40th
10
6423579 +/- 267740
39th
44
6405742 +/- 372529
39th
22
6380277 +/- 209116
38th
6
6336642 +/- 297795
38th
8
6318629 +/- 338085
38th
6
6316458 +/- 275610
37th
10
6263414 +/- 327135
37th
7
6254450 +/- 95114
36th
56
6211177 +/- 294809
36th
10
6205484 +/- 242513
35th
4
6183722 +/- 96098
35th
4
6140981 +/- 169519
34th
10
6091596 +/- 487771
33rd
3
6073574 +/- 102380
33rd
27
6054861 +/- 515174
33rd
5
6049769 +/- 429316
33rd
27
6038019 +/- 712697
32nd
3
6012694 +/- 137074
32nd
21
6010807 +/- 60987
32nd
22
6005611 +/- 573033
32nd
6
5995192 +/- 42728
31st
7
5978934 +/- 270587
31st
6
5977876 +/- 230011
31st
3
5977744 +/- 265809
31st
5
5971043 +/- 165687
31st
6
5960654 +/- 767814
30th
4
5935476 +/- 187894
30th
4
5889000 +/- 33247
29th
12
5866649 +/- 123908
29th
5
5859985 +/- 569728
29th
7
5848206 +/- 861763
29th
5
5840132 +/- 68611
29th
13
5829115 +/- 377088
28th
4
5816823 +/- 691702
28th
9
5790899 +/- 737177
28th
17
5769392 +/- 597773
28th
3
5766876 +/- 126875
27th
4
5738360 +/- 22352
27th
28
5695926 +/- 150897
26th
4
5666535 +/- 614056
Low-Tier
25th
< 5646835
25th
7
5627818 +/- 59387
25th
12
5626750 +/- 339743
25th
7
5623625 +/- 497949
25th
3
5621919 +/- 116293
25th
16
5593819 +/- 769106
24th
34
5547070 +/- 558951
24th
8
5544573 +/- 219480
24th
7
5544307 +/- 115410
24th
9
5538528 +/- 782694
23rd
4
5478604 +/- 88952
23rd
18
5461408 +/- 382785
23rd
3
5451428 +/- 8627
22nd
4
5401508 +/- 19334
20th
5
5282631 +/- 107132
20th
4
5271253 +/- 213511
19th
9
5227261 +/- 156816
19th
7
5223547 +/- 312225
19th
4
5196984 +/- 1977
18th
4
5110071 +/- 462128
18th
18
5101290 +/- 341637
18th
6
5099960 +/- 128459
18th
5
5099095 +/- 488114
18th
20
5083104 +/- 248281
17th
3
5060832 +/- 53894
17th
3
5049037 +/- 421261
17th
5
5019130 +/- 709602
16th
3
4968592 +/- 19551
15th
4
4917861 +/- 165662
15th
7
4916824 +/- 439929
15th
4
4881276 +/- 71907
15th
3
4874153 +/- 9423
14th
8
4854079 +/- 38739
14th
7
4832439 +/- 73188
14th
10
4819477 +/- 18251
13th
3
4797424 +/- 52980
13th
3
4749062 +/- 467246
12th
14
4743977 +/- 85546
12th
4
4729070 +/- 95552
12th
4
4695195 +/- 70807
12th
3
4689964 +/- 275408
12th
9
4656601 +/- 438885
11th
6
4640692 +/- 10270
11th
6
4632287 +/- 407123
10th
3
4482987 +/- 19702
10th
3
4422243 +/- 227054
9th
5
4368906 +/- 25499
9th
4
4317524 +/- 49115
8th
3
4231458 +/- 115741
8th
10
4167237 +/- 85607
8th
3
4095453 +/- 433661
7th
4
3791538 +/- 75279
6th
5
3656160 +/- 497157
6th
9
3614091 +/- 160529
5th
3
3252447 +/- 3839
5th
4
3221921 +/- 10958
5th
3
3212525 +/- 309953
3rd
38
2336343 +/- 2225
2nd
5
1737108 +/- 201387
2nd
4
1671671 +/- 36560
OpenBenchmarking.orgDistribution Of Public Results - Elapsed Time4988 Results Range From 322111 To 15902866 Nodes Per Second322111633727945343125695915685751880191219180725034232815039312665534382713749887406150343731194684735499635153079675619583593119962428156554431686604771776637489279780089581125118424127873574390473599358975967059199822071029382310605439109170551122867111540287118519031216351912475135127867511309836713409983137215991403321514344831146564471496806315279679155912951590291180160240320400

Based on OpenBenchmarking.org data, the selected test / test configuration (Crafty 25.2 - Elapsed Time) has an average run-time of 2 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkElapsed TimeRun-Time3691215Min: 1 / Avg: 1.62 / Max: 8

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.3%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsElapsed TimeDeviation246810Min: 0 / Avg: 0.3 / Max: 6

Does It Scale Well With Increasing Cores?

No, based on the automated analysis of the collected public benchmark data, this test / test settings does not generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

AMDIntelOpenBenchmarking.orgRelative Core Scaling To BaseCrafty CPU Core ScalingElapsed Time2468101216182024324048641280.80421.60842.41263.21684.021

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set
Support
Instructions Detected
SSE2 (SSE2)
Used by default on supported hardware.
 
PUNPCKLQDQ MOVDQA CVTSS2SD DIVSD MOVDQU MOVD PSHUFD PSRLDQ PMULUDQ PSHUFLW PADDQ PUNPCKHQDQ CVTSI2SD ADDSD SHUFPD CVTTSD2SI MULSD COMISD CVTSD2SS CVTDQ2PS CVTTPS2DQ SUBSD
SSE 4.2 (SSE4_2)
Used by default on supported hardware.
Found on Intel processors since at least 2010.
Found on AMD processors since Bulldozer (2011).

 
POPCNT
Last automated analysis: 17 January 2022

This test profile binary relies on the shared libraries libm.so.6, libc.so.6.

Tested CPU Architectures

This benchmark has been successfully tested on the below mentioned architectures. The CPU architectures listed is where successful OpenBenchmarking.org result uploads occurred, namely for helping to determine if a given test is compatible with various alternative CPU architectures.

CPU Architecture
Kernel Identifier
Verified On
Intel / AMD x86 64-bit
x86_64
(Many Processors)

Recent Test Results

OpenBenchmarking.org Results Compare

44 Systems - 425 Benchmark Results

Intel Core i7-14700K - ASUS ProArt B760-CREATOR - Intel Device 7a27

SystemRescue 10.01 - 6.1.30-1-lts - X Server 1.21.1.8

1 System - 3 Benchmark Results

Intel Core i7-14700K - ASUS ProArt B760-CREATOR - Intel Device 7a27

SystemRescue 10.01 - 6.1.30-1-lts - X Server 1.21.1.8

1 System - 56 Benchmark Results

AMD Ryzen 7 5800X 8-Core - ASUS ROG STRIX X370-F GAMING - AMD Starship

Linuxmint 21.3 - 6.5.0-41-lowlatency - X Server 1.21.1.4

1 System - 120 Benchmark Results

AMD Ryzen 5 3400G - HP 8643 - 2 x 16384 MB 2667MHz Unknown

Microsoft Windows 11 Home Build 22631 - 10.0.22631.3672 - 31.0.21912.14

1 System - 7 Benchmark Results

Intel Core i7-7700HQ - KBL Predator G3-571 Sienta_KLS - Intel Xeon E3-1200 v6

Pop 22.04 - 6.6.10-76060610-generic - GNOME Shell 42.5

2 Systems - 3048 Benchmark Results

1 System - 1858 Benchmark Results

1 System - 1858 Benchmark Results

2 Systems - 3610 Benchmark Results

2 Systems - 3610 Benchmark Results

2 Systems - 3062 Benchmark Results

1 System - 97 Benchmark Results

AMD EPYC 7543P 32-Core - Blade ShadowM - 1 x 16384 MB 2400MHz Blade HBXJ6XKWQK7ML5-AWA

Microsoft Windows 10 Famille Build 19045 - 10.0.19045.4412 - 546.29

1 System - 97 Benchmark Results

AMD EPYC 7543P 32-Core - Blade ShadowM - 1 x 16384 MB 2400MHz Blade HBXJ6XKWQK7ML5-AWA

Microsoft Windows 10 Famille Build 19045 - 10.0.19045.4412 - 546.29

1 System - 926 Benchmark Results

Intel Core i5-14500 - ASUS PRIME Z790-P WIFI - Intel Raptor Lake-S PCH

Ubuntu 24.04 - 6.8.0-31-generic - GNOME Shell 46.0

1 System - 1 Benchmark Result

Intel Core i5-7300U - Intel NUC7i5DNKE NUC7i5DNB - Intel Xeon E3-1200 v6

Debian 10 - 4.19.0-26-amd64 - X Server

Most Popular Test Results

OpenBenchmarking.org Results Compare

3 Systems - 268 Benchmark Results

Intel Core i5-2520M - HP 161C - Intel 2nd Generation Core DRAM

Ubuntu 18.04 - 4.18.0-20-generic - GNOME Shell 3.28.3

11 Systems - 217 Benchmark Results

AMD Ryzen 9 3950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4

4 Systems - 66 Benchmark Results

AMD Ryzen 9 5950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.04 - 5.8.0-59-generic - GNOME Shell 3.36.9

2 Systems - 601 Benchmark Results

2 x Intel Xeon E5-2690 v4 - Intel S2600WTT v.......... - Intel Xeon E7 v4

Debian 9.4 - 4.9.0-6-amd64 - GCC 6.3.0 20170516 + Clang 3.8.1-24

2 Systems - 178 Benchmark Results

AMD Ryzen Threadripper 1950X 16-Core - Gigabyte X399 AORUS Gaming 7 - AMD Family 17h

Ubuntu 18.04 - 4.15.2-041502-generic - GNOME Shell 3.26.2

12 Systems - 593 Benchmark Results

AMD Ryzen 9 5900X 12-Core - ASRock X570 Taichi - AMD Starship

Fedora 33 - 5.8.16-300.fc33.x86_64 - GNOME Shell 3.38.1

3 Systems - 79 Benchmark Results

AMD Eng Sample - Gigabyte TRX40 AORUS PRO WIFI - 4 x 32768 MB 3000MHz CMK64GX4M2D3000C16

Microsoft Windows 10 Pro Build 19042 - 10.0 - 27.20.1034.6

3 Systems - 182 Benchmark Results

Intel Core i9-7980XE - ASUS PRIME X299-A - Intel Sky Lake-E DMI3 Registers

Ubuntu 18.04 - 4.15.2-041502-generic - GNOME Shell 3.26.2

2 Systems - 66 Benchmark Results

AMD Ryzen 9 3900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - 2 x 8192 MB 3600MHz F4-3600C16-8GTRG

Microsoft Windows 10 Pro Build 18362 - 10.0 - 22.19.162.4

8 Systems - 439 Benchmark Results

Intel Core i9-11900K - ASUS ROG MAXIMUS XIII HERO - Intel Tiger Lake-H

Ubuntu 21.04 - 5.12.0-051200rc3daily20210315-generic - GNOME Shell 3.38.3

3 Systems - 174 Benchmark Results

Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH

Fedora 33 - 5.8.11-300.fc33.x86_64 - GNOME Shell 3.38.0

5 Systems - 107 Benchmark Results

Intel Core i9-12900K - ASUS ROG STRIX Z690-E GAMING WIFI - Intel Device 7aa7

Clear Linux OS 35810 - 5.16.7-1122.native - GNOME Shell 41.3

6 Systems - 104 Benchmark Results

Intel Core i9-7960X - MSI X299 SLI PLUS - Intel Sky Lake-E DMI3 Registers

Ubuntu 18.04 - 4.18.0-999-generic - GNOME Shell 3.28.2

4 Systems - 119 Benchmark Results

Intel Core i9-7980XE - ASUS PRIME X299-A - Intel Sky Lake-E DMI3 Registers

FreeBSD - 12.0-CURRENT - Clang 6.0.0

Find More Test Results