Crafty

This is a performance test of Crafty, an advanced open-source chess engine.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark crafty.

Project Site

craftychess.com

Test Created

6 December 2010

Last Updated

19 November 2020

Test Maintainer

Michael Larabel 

Test Type

Processor

Average Install Time

11 Seconds

Average Run Time

34 Minutes, 59 Seconds

Test Dependencies

C/C++ Compiler Toolchain

Accolades

300k+ Downloads + 10k+ Public Benchmark Results

Supported Platforms

Supported Architectures

x86 + x86_64

Public Result Uploads *Reported Test Completions **Reported Installs **Test Profile Page Views ***OpenBenchmarking.orgEventsCrafty Popularity Statisticspts/crafty2010.122011.052011.102012.032012.082013.012013.062013.112014.042014.092015.022015.072015.122016.052016.102017.032017.082018.012018.062018.112019.042019.092020.022020.072020.122021.052021.102022.032022.082023.012023.062023.1120K40K60K80K100K
* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
*** Test profile page view reporting began March 2021.
Data updated weekly as of 20 February 2024.

Revision History

pts/crafty-1.4.5   [View Source]   Thu, 19 Nov 2020 18:11:42 GMT
Limit to x86/x86_64 architecture as upstream Crafty is still not compatible with non-x86 architectures.

pts/crafty-1.4.4   [View Source]   Sun, 23 Dec 2018 10:45:36 GMT
Fix building with Clang on FreeBSD.

pts/crafty-1.4.3   [View Source]   Sat, 09 Jun 2018 10:58:29 GMT
Fix Crafty build on Linux when Clang isn't available since its upstream makefile was defaulting to Clang, so add GCC check.

pts/crafty-1.4.2   [View Source]   Sat, 07 Apr 2018 18:53:55 GMT
Update download link for Windows, fix build on FreeBSD/Clang.

pts/crafty-1.4.1   [View Source]   Sun, 04 Mar 2018 11:05:38 GMT
Add Windows support.

pts/crafty-1.4.0   [View Source]   Wed, 07 Feb 2018 15:16:24 GMT
Updated against Crafty 25.2 upstream, switch to reporting nodes per second.

pts/crafty-1.3.1   [View Source]   Thu, 25 Aug 2016 14:01:41 GMT
Update CFLAGS handling, update download links

pts/crafty-1.3.0   [View Source]   Sun, 29 Jan 2012 12:44:39 GMT
Update against Crafty 23.4 upstream. Plus makefile changes.

pts/crafty-1.2.0   [View Source]   Mon, 06 Dec 2010 14:37:37 GMT
Initial import into OpenBenchmarking.org

Suites Using This Test

Chess Test Suite

CPU Massive


Performance Metrics

Analyze Test Configuration:

Crafty 25.2

Elapsed Time

OpenBenchmarking.org metrics for this test profile configuration based on 4,926 public results since 7 February 2018 with the latest data as of 21 February 2024.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Compatible Public Results
Nodes Per Second (Average)
100th
15
15050611 +/- 83498
100th
32
14968080 +/- 226090
100th
12
14908561 +/- 347510
100th
10
14855935 +/- 68439
100th
6
14688210 +/- 94290
100th
7
14564754 +/- 41631
100th
8
14559001 +/- 791803
99th
20
14303658 +/- 370981
99th
9
14252363 +/- 1658210
99th
9
13990575 +/- 168719
99th
5
13430361 +/- 93068
99th
8
13313005 +/- 458915
98th
11
12768454 +/- 181101
97th
12
12244517 +/- 315910
97th
28
12049878 +/- 1735777
97th
13
11999851 +/- 915568
96th
6
11971527 +/- 26224
95th
110
11706845 +/- 289570
94th
42
11497609 +/- 444051
94th
36
11418793 +/- 285869
93rd
4
11394743 +/- 10333
93rd
29
11310432 +/- 754605
92nd
15
11053374 +/- 93615
92nd
6
10928385 +/- 372556
92nd
21
10894325 +/- 656454
91st
10
10660633 +/- 224502
91st
3
10653703 +/- 405710
91st
3
10456707 +/- 263789
91st
3
10397708 +/- 22801
91st
9
10366930 +/- 194409
90th
37
10211193 +/- 229920
90th
3
10208784
90th
7
10148999 +/- 219371
89th
3
9955476 +/- 214765
88th
5
9898719 +/- 205824
88th
10
9886835 +/- 69774
88th
10
9860840 +/- 55017
88th
27
9841085 +/- 476834
88th
9
9776884 +/- 576762
88th
13
9766424 +/- 446370
87th
11
9725071 +/- 87795
87th
32
9723010 +/- 349974
87th
3
9596227 +/- 124176
87th
3
9576145 +/- 203411
87th
3
9547191 +/- 44766
86th
8
9417836 +/- 427551
86th
3
9417411 +/- 628509
85th
23
9378600 +/- 84113
85th
32
9344672 +/- 465332
85th
4
9316933 +/- 123214
84th
6
9229282 +/- 238465
84th
22
9219949 +/- 160008
84th
7
9201302 +/- 305322
82nd
53
9073627 +/- 258183
82nd
29
9062841 +/- 339030
82nd
7
9018627 +/- 291642
82nd
7
9017044 +/- 733738
82nd
28
8989998 +/- 540746
81st
20
8968518 +/- 308106
81st
5
8964715 +/- 192698
81st
25
8945571 +/- 536315
81st
5
8945141 +/- 29621
81st
5
8923676 +/- 87109
79th
9
8785897 +/- 375836
79th
6
8775010 +/- 205190
78th
32
8738623 +/- 369287
78th
46
8727448 +/- 435667
78th
13
8674264 +/- 385550
77th
3
8603000 +/- 16929
77th
77
8564762 +/- 291685
76th
8
8547609 +/- 121833
76th
10
8508811 +/- 365048
76th
5
8508272 +/- 498486
Mid-Tier
75th
< 8491412
75th
4
8435023 +/- 53411
75th
43
8430993 +/- 288808
75th
10
8415338 +/- 224706
74th
11
8360122 +/- 642776
74th
7
8329725 +/- 136296
74th
4
8300494 +/- 317611
73rd
10
8282340 +/- 55591
72nd
11
8153318 +/- 114514
72nd
5
8122818 +/- 1205690
72nd
17
8096396 +/- 507278
72nd
6
8049298 +/- 18058
71st
16
7954524 +/- 421396
71st
8
7953948 +/- 110707
71st
5
7951432 +/- 198769
71st
5
7949863 +/- 15938
70th
9
7871543 +/- 89106
69th
4
7862593 +/- 739112
69th
5
7821429 +/- 44381
69th
10
7808537 +/- 358062
68th
18
7807671 +/- 409314
68th
20
7791902 +/- 221883
68th
13
7784670 +/- 103360
68th
7
7778260 +/- 233953
68th
8
7775630 +/- 164630
67th
4
7742940 +/- 630145
67th
7
7734508 +/- 108597
67th
8
7724828 +/- 81558
67th
5
7699372 +/- 524230
67th
9
7695541 +/- 303296
66th
13
7631532 +/- 283870
65th
8
7629374 +/- 172025
65th
4
7604728 +/- 243362
64th
16
7597353 +/- 219442
64th
6
7584662 +/- 128712
64th
5
7582154 +/- 55143
64th
3
7580411 +/- 325057
64th
23
7572388 +/- 332789
64th
7
7559670 +/- 339210
63rd
58
7552622 +/- 332803
63rd
7
7549026 +/- 80883
63rd
7
7518494 +/- 66414
62nd
14
7491811 +/- 459449
62nd
4
7467337 +/- 328837
62nd
6
7463969 +/- 19338
61st
5
7447854 +/- 100757
61st
3
7441721 +/- 593726
61st
3
7439930 +/- 282137
61st
7
7438784 +/- 46321
61st
4
7431782 +/- 512795
60th
9
7418278 +/- 30101
60th
32
7417213 +/- 452883
59th
5
7360294 +/- 439947
59th
7
7355933 +/- 200229
58th
5
7349770 +/- 18626
58th
5
7349564 +/- 293057
58th
11
7313716 +/- 136603
58th
10
7299701 +/- 790854
57th
6
7285696 +/- 135780
57th
52
7285130 +/- 497556
57th
4
7252590 +/- 116327
57th
6
7246336 +/- 207021
56th
18
7231277 +/- 478583
56th
6
7221898 +/- 685008
56th
7
7218008 +/- 336960
55th
7
7175323 +/- 174366
55th
7
7143996 +/- 294005
55th
5
7140050 +/- 959392
55th
15
7128159 +/- 529183
55th
10
7127481 +/- 185608
54th
41
7108069 +/- 535635
54th
5
7100772 +/- 551131
54th
4
7081629 +/- 127652
54th
3
7075120 +/- 246201
54th
13
7073289 +/- 292388
54th
3
7069090 +/- 748585
54th
4
7065322 +/- 20518
53rd
14
7043309 +/- 586752
53rd
17
7038342 +/- 221051
53rd
19
7038208 +/- 181694
52nd
25
7003435 +/- 463107
52nd
4
7000305 +/- 421998
52nd
6
6989589 +/- 42602
51st
3
6966562 +/- 438753
51st
24
6965996 +/- 343571
51st
33
6949324 +/- 740836
Median
50th
6939772
50th
6
6935326 +/- 23501
49th
8
6914033 +/- 161804
49th
44
6909337 +/- 89446
49th
17
6869798 +/- 116640
49th
4
6864468 +/- 150010
48th
6
6841168 +/- 295325
48th
9
6807523 +/- 870825
48th
10
6796851 +/- 299240
48th
11
6796827 +/- 163366
47th
3
6774951 +/- 15542
47th
10
6769144 +/- 49218
47th
13
6763480 +/- 366922
46th
24
6734396 +/- 249099
46th
7
6713219 +/- 682633
46th
7
6708456 +/- 837937
45th
6
6702137 +/- 402618
45th
9
6686976 +/- 102816
44th
10
6646649 +/- 38187
44th
11
6640299 +/- 245598
44th
4
6633180 +/- 124323
44th
12
6632447 +/- 206675
44th
10
6609460 +/- 174551
44th
13
6606482 +/- 302893
43rd
11
6594423 +/- 277781
43rd
4
6583949 +/- 71488
43rd
4
6577011 +/- 247840
43rd
8
6570849 +/- 296919
42nd
6
6518900 +/- 227347
41st
3
6471531 +/- 101039
40th
4
6450952 +/- 46850
40th
5
6444651 +/- 65026
40th
10
6423579 +/- 267740
39th
44
6405742 +/- 372529
39th
22
6380277 +/- 209116
38th
6
6336642 +/- 297795
38th
8
6318629 +/- 338085
38th
6
6316458 +/- 275610
37th
10
6263414 +/- 327135
37th
7
6254450 +/- 95114
36th
56
6211177 +/- 294809
36th
10
6205484 +/- 242513
36th
4
6183722 +/- 96098
35th
4
6140981 +/- 169519
34th
10
6091596 +/- 487771
33rd
3
6073574 +/- 102380
33rd
26
6072494 +/- 703479
33rd
27
6054861 +/- 515174
33rd
5
6049769 +/- 429316
32nd
3
6012694 +/- 137074
32nd
21
6010807 +/- 60987
32nd
22
6005611 +/- 573033
32nd
6
5995192 +/- 42728
31st
7
5978934 +/- 270587
31st
6
5977876 +/- 230011
31st
3
5977744 +/- 265809
31st
5
5971043 +/- 165687
31st
6
5960654 +/- 767814
30th
4
5935476 +/- 187894
29th
12
5866649 +/- 123908
29th
5
5859985 +/- 569728
29th
7
5848206 +/- 861763
29th
5
5840132 +/- 68611
29th
13
5829115 +/- 377088
29th
4
5816823 +/- 691702
28th
9
5790899 +/- 737177
28th
17
5769392 +/- 597773
28th
3
5766876 +/- 126875
28th
3
5764160 +/- 162774
27th
4
5738360 +/- 22352
27th
28
5695926 +/- 150897
Low-Tier
25th
< 5646428
25th
7
5627818 +/- 59387
25th
12
5626750 +/- 339743
25th
3
5623730 +/- 103023
25th
7
5623625 +/- 497949
25th
3
5621919 +/- 116293
25th
16
5593819 +/- 769106
24th
34
5547070 +/- 558951
24th
8
5544573 +/- 219480
24th
7
5544307 +/- 115410
24th
9
5538528 +/- 782694
23rd
4
5478604 +/- 88952
23rd
18
5461408 +/- 382785
23rd
3
5451428 +/- 8627
22nd
4
5401508 +/- 19334
20th
5
5282631 +/- 107132
20th
4
5271253 +/- 213511
19th
9
5227261 +/- 156816
19th
7
5223547 +/- 312225
19th
4
5196984 +/- 1977
18th
4
5110071 +/- 462128
18th
3
5108455 +/- 186874
18th
19
5107219 +/- 229763
18th
18
5101290 +/- 341637
18th
6
5099960 +/- 128459
18th
5
5099095 +/- 488114
17th
3
5060832 +/- 53894
17th
3
5049037 +/- 421261
17th
5
5019130 +/- 709602
15th
4
4917861 +/- 165662
15th
7
4916824 +/- 439929
15th
3
4908068 +/- 176132
15th
4
4881276 +/- 71907
15th
3
4874153 +/- 9423
14th
8
4854079 +/- 38739
14th
7
4832439 +/- 73188
14th
10
4819477 +/- 18251
13th
3
4797424 +/- 52980
12th
3
4736884 +/- 91823
12th
4
4729070 +/- 95552
12th
4
4695195 +/- 70807
12th
3
4689964 +/- 275408
12th
9
4656601 +/- 438885
12th
5
4642202 +/- 51169
11th
6
4640692 +/- 10270
11th
6
4632287 +/- 407123
10th
3
4482987 +/- 19702
10th
3
4422243 +/- 227054
10th
5
4368906 +/- 25499
9th
4
4317524 +/- 49115
8th
3
4231458 +/- 115741
8th
10
4167237 +/- 85607
8th
3
4095453 +/- 433661
7th
3
3937491 +/- 7020
7th
4
3791538 +/- 75279
6th
5
3656160 +/- 497157
6th
9
3614091 +/- 160529
5th
3
3252447 +/- 3839
5th
4
3221921 +/- 10958
5th
3
3212525 +/- 309953
3rd
38
2336343 +/- 2225
2nd
5
1737108 +/- 201387
2nd
4
1671671 +/- 36560
OpenBenchmarking.orgDistribution Of Public Results - Elapsed Time4923 Results Range From 449797 To 15902866 Nodes Per Second44979775885910679211376983168604519951072304169261323129222933231355354041738494794158541446760347766655085727539478957038516012913632197566310376940099724916175582237867285817634784854098794471910353394125959721657100307191033978110648843109579051126696711576029118850911219415312503215128122771312133913430401137394631404852514357587146666491497571115284773155938351590289770140210280350

Based on OpenBenchmarking.org data, the selected test / test configuration (Crafty 25.2 - Elapsed Time) has an average run-time of 2 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkElapsed TimeRun-Time3691215Min: 1 / Avg: 1.61 / Max: 8

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.3%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsElapsed TimeDeviation246810Min: 0 / Avg: 0.3 / Max: 5

Does It Scale Well With Increasing Cores?

No, based on the automated analysis of the collected public benchmark data, this test / test settings does not generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

AMDIntelOpenBenchmarking.orgRelative Core Scaling To BaseCrafty CPU Core ScalingElapsed Time2468101216182024324048641280.80421.60842.41263.21684.021

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set
Support
Instructions Detected
SSE2 (SSE2)
Used by default on supported hardware.
 
PUNPCKLQDQ MOVDQA CVTSS2SD DIVSD MOVDQU MOVD PSHUFD PSRLDQ PMULUDQ PSHUFLW PADDQ PUNPCKHQDQ CVTSI2SD ADDSD SHUFPD CVTTSD2SI MULSD COMISD CVTSD2SS CVTDQ2PS CVTTPS2DQ SUBSD
SSE 4.2 (SSE4_2)
Used by default on supported hardware.
Found on Intel processors since at least 2010.
Found on AMD processors since Bulldozer (2011).

 
POPCNT
Last automated analysis: 17 January 2022

This test profile binary relies on the shared libraries libm.so.6, libc.so.6.

Tested CPU Architectures

This benchmark has been successfully tested on the below mentioned architectures. The CPU architectures listed is where successful OpenBenchmarking.org result uploads occurred, namely for helping to determine if a given test is compatible with various alternative CPU architectures.

CPU Architecture
Kernel Identifier
Verified On
Intel / AMD x86 64-bit
x86_64
(Many Processors)

Recent Test Results

OpenBenchmarking.org Results Compare

2 Systems - 7 Benchmark Results

AMD Ryzen Threadripper PRO 7995WX 96-Cores - Microsoft Virtual Machine - 4 + 12

Ubuntu 22.04 - 6.2.0-1019-azure - GNOME Shell 42.9

1 System - 14 Benchmark Results

Intel Core i9-14900K - MSI Z790 GAMING PLUS WIFI - Intel Device 7a27

Debian 12 - 6.1.0-18-amd64 - GCC 12.2.0

1 System - 14 Benchmark Results

Intel Core i9-14900K - MSI Z790 GAMING PLUS WIFI - Intel Device 7a27

Debian 12 - 6.1.0-18-amd64 - GCC 12.2.0

1 System - 12 Benchmark Results

Intel Core i9-14900K - MSI Z790 GAMING PLUS WIFI - Intel Device 7a27

Debian 12 - 6.1.0-18-amd64 - GCC 12.2.0

1 System - 10 Benchmark Results

Intel Core i9-14900K - MSI Z790 GAMING PLUS WIFI - Intel Device 7a27

Debian 12 - 6.1.0-18-amd64 - GCC 12.2.0

1 System - 3 Benchmark Results

Intel Core i5-12600K - MSI PRO Z690-A WIFI DDR4 - Intel Alder Lake-S PCH

Debian 12 - 6.1.0-15-amd64 - KDE Plasma 5.27.5

1 System - 6 Benchmark Results

2 x Intel Xeon E5-2620 v4 - Placa-me - 1 x 3269 MB 48MHz

Microsoft Windows 10 Pro Build 19045 - 10.0.19045.3930 - 10.0.19041.3636

1 System - 5 Benchmark Results

2 x Intel Xeon E5-2620 v4 - Placa-me - 1 x 3269 MB 48MHz

Microsoft Windows 10 Pro Build 19045 - 10.0.19045.3930 - 10.0.19041.3636

1 System - 7 Benchmark Results

8 x Intel Xeon E5-2620 v4 - Xen HVM domU v4.13 - Intel 440FX 82441FX PMC

Debian 11 - 5.10.0-28-amd64 - GNOME Shell 3.38.6

1 System - 7 Benchmark Results

8 x Intel Xeon E5-2620 v4 - Xen HVM domU v4.13 - Intel 440FX 82441FX PMC

Debian 11 - 5.10.0-28-amd64 - GNOME Shell 3.38.6

1 System - 7 Benchmark Results

Intel Pentium N3700 - Intel NUC5PPYB - Intel Atom

Arch Linux - 6.7.1-arch1-1 - Openbox 3.6.1

3 Systems - 4 Benchmark Results

Intel Core i7-12700H - Intel Alder Lake-H PCH - Intel Alder Lake PCH

Ubuntu 22.04 - 6.5.0-17-generic - GNOME Shell 42.9

1 System - 7 Benchmark Results

8 x Intel Xeon E5-2620 v4 - QEMU Standard PC - Intel 82G33

Debian 11 - 5.10.0-27-amd64 - GNOME Shell 3.38.6

1 System - 7 Benchmark Results

8 x Intel Xeon E5-2620 v4 - QEMU Standard PC - Intel 82G33

Debian 11 - 5.10.0-27-amd64 - GNOME Shell 3.38.6

Most Popular Test Results

OpenBenchmarking.org Results Compare

3 Systems - 268 Benchmark Results

Intel Core i5-2520M - HP 161C - Intel 2nd Generation Core DRAM

Ubuntu 18.04 - 4.18.0-20-generic - GNOME Shell 3.28.3

11 Systems - 217 Benchmark Results

Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH

Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4

2 Systems - 178 Benchmark Results

Intel Core i9-7980XE - ASUS PRIME X299-A - Intel Sky Lake-E DMI3 Registers

Ubuntu 18.04 - 4.15.2-041502-generic - GNOME Shell 3.26.2

12 Systems - 593 Benchmark Results

AMD Ryzen 5 3600X 6-Core - MSI X470 GAMING M7 AC - AMD Starship

Ubuntu 20.04 - 5.8.0-050800daily20200622-generic - GNOME Shell 3.36.2

2 Systems - 601 Benchmark Results

2 x Intel Xeon E5-2690 v4 - Intel S2600WTT v.......... - Intel Xeon E7 v4

Debian 9.4 - 4.9.0-6-amd64 - GCC 6.3.0 20170516 + Clang 3.8.1-24

3 Systems - 182 Benchmark Results

AMD Ryzen Threadripper 1950X 16-Core - Gigabyte X399 AORUS Gaming 7 - AMD Family 17h

Ubuntu 18.04 - 4.15.2-041502-generic - GNOME Shell 3.26.2

2 Systems - 66 Benchmark Results

AMD Ryzen 9 3900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - 2 x 8192 MB 3600MHz F4-3600C16-8GTRG

Microsoft Windows 10 Pro Build 18362 - 10.0 - 22.19.162.4

3 Systems - 79 Benchmark Results

AMD Ryzen Threadripper 3990X 64-Core - Gigabyte TRX40 AORUS PRO WIFI - AMD Starship

Ubuntu 21.04 - 5.11.0-17-generic - GNOME Shell 3.38.4

3 Systems - 174 Benchmark Results

Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH

Fedora 32 - 5.6.6-300.fc32.x86_64 - GNOME Shell 3.36.1

6 Systems - 104 Benchmark Results

Intel Core i9-7960X - MSI X299 SLI PLUS - Intel Sky Lake-E DMI3 Registers

Ubuntu 18.04 - 4.18.0-999-generic - GNOME Shell 3.28.2

8 Systems - 439 Benchmark Results

Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH

Ubuntu 21.04 - 5.12.0-051200rc3daily20210315-generic - GNOME Shell 3.38.3

1 System - 748 Benchmark Results

Intel Core i7-7700K - MSI Z270 GAMING M7 - Intel Intel Kaby Lake + Z270

Ubuntu 18.04 - 4.15.0-23-generic - GNOME Shell 3.28.1

4 Systems - 66 Benchmark Results

AMD Ryzen 9 5950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 21.04 - 5.11.0-22-generic - GNOME Shell 3.38.4

Find More Test Results