Crafty

This is a performance test of Crafty, an advanced open-source chess engine.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark crafty.

Project Site

craftychess.com

Test Created

6 December 2010

Last Updated

19 November 2020

Test Maintainer

Michael Larabel

Test Type

Processor

Average Install Time

12 Seconds

Average Run Time

34 Minutes, 59 Seconds

Accolades

250k+ Downloads + 10k+ Public Benchmark Results

Supported Platforms

Supported Architectures

x86 + x86_64

Public Result UploadsTest Completions*Reported Installs*OpenBenchmarking.orgEventsCrafty Popularity Statisticspts/crafty2011.012011.052011.092012.012012.052012.092013.012013.052013.092014.012014.052014.092015.012015.052015.092016.012016.052016.092017.012017.052017.092018.012018.052018.092019.012019.052019.092020.012020.052020.092021.0116K32K48K64K80K
* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data current as of Sat, 23 Jan 2021 03:06:22 GMT.

Revision History

pts/crafty-1.4.5   [View Source]   Thu, 19 Nov 2020 18:11:42 GMT
Limit to x86/x86_64 architecture as upstream Crafty is still not compatible with non-x86 architectures.

pts/crafty-1.4.4   [View Source]   Sun, 23 Dec 2018 10:45:36 GMT
Fix building with Clang on FreeBSD.

pts/crafty-1.4.3   [View Source]   Sat, 09 Jun 2018 10:58:29 GMT
Fix Crafty build on Linux when Clang isn't available since its upstream makefile was defaulting to Clang, so add GCC check.

pts/crafty-1.4.2   [View Source]   Sat, 07 Apr 2018 18:53:55 GMT
Update download link for Windows, fix build on FreeBSD/Clang.

pts/crafty-1.4.1   [View Source]   Sun, 04 Mar 2018 11:05:38 GMT
Add Windows support.

pts/crafty-1.4.0   [View Source]   Wed, 07 Feb 2018 15:16:24 GMT
Updated against Crafty 25.2 upstream, switch to reporting nodes per second.

pts/crafty-1.3.1   [View Source]   Thu, 25 Aug 2016 14:01:41 GMT
Update CFLAGS handling, update download links

pts/crafty-1.3.0   [View Source]   Sun, 29 Jan 2012 12:44:39 GMT
Update against Crafty 23.4 upstream. Plus makefile changes.

pts/crafty-1.2.0   [View Source]   Mon, 06 Dec 2010 14:37:37 GMT
Initial import into OpenBenchmarking.org

Suites Using This Test

Chess Test Suite

CPU Massive


Performance Metrics

Analyze Test Configuration:

Crafty 25.2

Elapsed Time

OpenBenchmarking.org metrics for this test profile configuration based on 3,814 public results since 7 February 2018 with the latest data as of 23 January 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Matching Public Results
Nodes Per Second (Average)
100th
39
11688576 +/- 233248
100th
23
11620929 +/- 276336
100th
12
11473587 +/- 293887
100th
14
11259342 +/- 200553
98th
32
10246343 +/- 243296
97th
27
9841085 +/- 476834
97th
9
9776884 +/- 576762
97th
11
9725071 +/- 87795
97th
32
9699551 +/- 327190
96th
3
9547191 +/- 44766
95th
19
9384022 +/- 97285
95th
5
9363214 +/- 556735
95th
32
9344672 +/- 465332
94th
21
9244259 +/- 122571
94th
6
9229282 +/- 238465
93rd
8
9151800 +/- 315448
92nd
23
9081152 +/- 348715
92nd
43
9052860 +/- 217332
91st
28
8989998 +/- 540746
91st
3
8986953 +/- 12690
91st
19
8980478 +/- 311743
91st
25
8945571 +/- 536315
91st
5
8945141 +/- 29621
90th
4
8924105 +/- 964375
88th
24
8793523 +/- 303613
88th
8
8782949 +/- 353136
88th
6
8775010 +/- 205190
88th
46
8727448 +/- 435667
87th
7
8682668 +/- 97438
87th
3
8639990 +/- 22089
86th
3
8578231 +/- 260438
86th
76
8571122 +/- 288492
86th
9
8527516 +/- 308399
86th
10
8508811 +/- 365048
86th
5
8508272 +/- 498486
85th
11
8475932 +/- 318822
84th
7
8329725 +/- 136296
84th
3
8303243 +/- 839546
84th
8
8301411 +/- 43533
84th
4
8300494 +/- 317611
82nd
6
8038644 +/- 25877
81st
3
8018138 +/- 821135
81st
14
7985347 +/- 443514
81st
3
7956537 +/- 96745
81st
5
7949863 +/- 15938
80th
5
7920943 +/- 194134
80th
10
7899049 +/- 195593
80th
9
7871543 +/- 89106
79th
3
7852663 +/- 16762
79th
11
7812852 +/- 336632
79th
4
7805657 +/- 648807
79th
8
7804216 +/- 405394
78th
15
7779990 +/- 439225
78th
18
7778986 +/- 248164
78th
8
7775630 +/- 164630
78th
9
7748766 +/- 87654
76th
5
7674594 +/- 140910
76th
12
7673929 +/- 110413
76th
5
7663653 +/- 20252
76th
11
7634674 +/- 310850
Mid-Tier
75th
< 7630211
75th
4
7623209 +/- 266245
75th
7
7606611 +/- 172304
75th
4
7604728 +/- 243362
74th
15
7598774 +/- 227068
74th
6
7597925 +/- 213183
74th
6
7584662 +/- 128712
74th
22
7582545 +/- 336952
74th
5
7582154 +/- 55143
73rd
8
7560577 +/- 133971
73rd
7
7559670 +/- 339210
73rd
58
7552622 +/- 332803
71st
5
7447854 +/- 100757
70th
3
7441721 +/- 593726
70th
3
7439930 +/- 282137
70th
4
7431782 +/- 512795
69th
32
7417213 +/- 452883
69th
8
7413562 +/- 28402
69th
3
7407539 +/- 18672
69th
3
7393658 +/- 9587
68th
7
7384775 +/- 43613
68th
5
7360294 +/- 439947
68th
7
7355933 +/- 200229
67th
5
7349564 +/- 293057
67th
57
7314181 +/- 396851
66th
10
7299701 +/- 790854
66th
3
7293575 +/- 782601
66th
6
7285696 +/- 135780
65th
4
7252590 +/- 116327
65th
18
7231277 +/- 478583
65th
9
7230491 +/- 355917
65th
5
7222177 +/- 221799
65th
6
7221898 +/- 685008
63rd
7
7175323 +/- 174366
63rd
5
7150934 +/- 182676
63rd
7
7143996 +/- 294005
63rd
5
7140050 +/- 959392
63rd
16
7133979 +/- 511769
63rd
10
7127481 +/- 185608
62nd
39
7097511 +/- 547347
62nd
3
7097068 +/- 40016
62nd
13
7087433 +/- 101829
62nd
4
7081629 +/- 127652
62nd
3
7075120 +/- 246201
62nd
13
7073289 +/- 292388
61st
4
7065322 +/- 20518
61st
16
7055924 +/- 134665
61st
14
7043309 +/- 586752
60th
13
7033287 +/- 1507042
60th
20
7031955 +/- 201195
60th
15
7030031 +/- 1417314
59th
25
7003435 +/- 463107
59th
4
7000305 +/- 421998
59th
31
6975570 +/- 747703
59th
16
6972370 +/- 36413
58th
23
6963052 +/- 350984
57th
12
6946783 +/- 21630
57th
9
6928627 +/- 440225
56th
8
6914033 +/- 161804
55th
46
6897697 +/- 95897
55th
14
6860389 +/- 165918
55th
10
6860348 +/- 156952
55th
3
6854810 +/- 176156
54th
3
6849985 +/- 180266
54th
5
6826318 +/- 294906
54th
10
6820771 +/- 150487
54th
9
6807523 +/- 870825
53rd
9
6764079 +/- 452159
53rd
27
6752777 +/- 240230
52nd
7
6713219 +/- 682633
52nd
13
6709134 +/- 91128
51st
7
6708456 +/- 837937
51st
4
6677632 +/- 254483
51st
7
6672829 +/- 76082
Median
50th
6670296
50th
6
6662802 +/- 326809
50th
3
6646628 +/- 71135
50th
7
6638898 +/- 36880
50th
10
6617697 +/- 246529
49th
3
6590495 +/- 465714
49th
4
6583949 +/- 71488
48th
4
6577011 +/- 247840
48th
3
6551338 +/- 106771
47th
6
6518900 +/- 227347
46th
13
6483075 +/- 202102
45th
7
6461741 +/- 287900
45th
32
6451362 +/- 243560
45th
4
6450952 +/- 46850
44th
14
6434774 +/- 209860
44th
8
6415291 +/- 219581
43rd
10
6392628 +/- 107310
43rd
38
6384163 +/- 449999
42nd
6
6336642 +/- 297795
42nd
9
6311654 +/- 140448
41st
14
6277107 +/- 234989
41st
4
6271764 +/- 343407
41st
4
6263832 +/- 1541807
41st
5
6261926 +/- 33808
41st
3
6258188 +/- 322943
41st
16
6236198 +/- 408118
39th
3
6182269 +/- 117641
39th
5
6181686 +/- 1837903
38th
6
6088184 +/- 272238
37th
24
6082427 +/- 1026284
37th
26
6072494 +/- 703479
37th
7
6069589 +/- 1543814
37th
27
6054861 +/- 515174
37th
4
6039822 +/- 495065
36th
6
5995192 +/- 42728
35th
3
5991537 +/- 643389
35th
7
5978934 +/- 270587
35th
6
5977876 +/- 230011
35th
3
5977744 +/- 265809
35th
6
5960654 +/- 767814
34th
3
5941774 +/- 772276
34th
4
5935476 +/- 187894
34th
8
5919119 +/- 672281
33rd
12
5866649 +/- 123908
33rd
5
5859985 +/- 569728
32nd
7
5848206 +/- 861763
32nd
5
5840132 +/- 68611
32nd
13
5829115 +/- 377088
32nd
12
5825163 +/- 121184
32nd
3
5817152 +/- 18682
32nd
9
5806916 +/- 137790
32nd
28
5791520 +/- 150319
31st
17
5769392 +/- 597773
31st
3
5766876 +/- 126875
30th
26
5697801 +/- 156337
28th
9
5629745 +/- 331515
28th
7
5627818 +/- 59387
28th
3
5623730 +/- 103023
28th
3
5621919 +/- 116293
27th
16
5593819 +/- 769106
27th
6
5571001 +/- 99989
27th
16
5559728 +/- 11869
26th
4
5546345 +/- 660937
26th
9
5538528 +/- 782694
26th
7
5533930 +/- 234825
26th
3
5525797 +/- 32045
Low-Tier
25th
< 5500784
25th
7
5490521 +/- 1017606
25th
5
5484781 +/- 15301
25th
4
5478604 +/- 88952
24th
3
5451428 +/- 8627
24th
17
5442554 +/- 387101
23rd
4
5401508 +/- 19334
22nd
3
5291085 +/- 865698
21st
5
5282631 +/- 107132
21st
4
5271253 +/- 213511
21st
5
5254040 +/- 38373
21st
13
5239949 +/- 124233
20th
7
5223547 +/- 312225
20th
4
5196984 +/- 1977
19th
3
5153004 +/- 881816
19th
3
5108455 +/- 186874
19th
17
5101290 +/- 341637
18th
6
5099960 +/- 128459
18th
5
5099095 +/- 488114
18th
18
5091054 +/- 225032
18th
3
5060832 +/- 53894
18th
3
5035384 +/- 535606
17th
3
4968592 +/- 19551
17th
3
4968582 +/- 648736
16th
23
4950300 +/- 1028844
15th
7
4916824 +/- 439929
15th
4
4881276 +/- 71907
15th
7
4867445 +/- 9145
14th
6
4825743 +/- 77788
14th
5
4823774 +/- 739369
14th
10
4819477 +/- 18251
14th
3
4797424 +/- 52980
13th
3
4749062 +/- 467246
13th
3
4736884 +/- 91823
13th
3
4699947 +/- 1082650
13th
4
4695195 +/- 70807
13th
3
4689964 +/- 275408
12th
9
4656601 +/- 438885
12th
5
4642202 +/- 51169
12th
6
4640692 +/- 10270
12th
6
4632287 +/- 407123
11th
3
4502787 +/- 51057
11th
3
4482987 +/- 19702
10th
4
4371345 +/- 28762
10th
7
4361295 +/- 918742
10th
5
4337915 +/- 38563
10th
4
4317524 +/- 49115
7th
4
3791538 +/- 75279
7th
29
3659206
7th
9
3614091 +/- 160529
6th
4
3221921 +/- 10958
6th
3
3212525 +/- 309953
3rd
38
2336343 +/- 2225
3rd
3
2202620 +/- 5924
3rd
3
2118380 +/- 149476
2nd
4
1965952 +/- 1848
2nd
3
1722167 +/- 256911
2nd
4
1671671 +/- 36560
OpenBenchmarking.orgDistribution Of Public Results - Elapsed Time3814 Results Range From 449797 To 12258866 Nodes Per Second449797685979922161115834313945251630707186688921030712339253257543528116173047799328398135201633756345399252742287094464891470107349372555173437540961956458015881983611816563543476590529682671170628937299075753525777714398007621824380384799858716167895234991885319424713966089598970771013325910369441106056231084180511077987113141691155035111786533120227151225889760120180240300

Based on OpenBenchmarking.org data, the selected test / test configuration (Crafty 25.2 - Elapsed Time) has an average run-time of 2 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkElapsed TimeRun-Time48121620Min: 1 / Avg: 1.89 / Max: 13

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.3%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsElapsed TimeDeviation246810Min: 0 / Avg: 0.29 / Max: 5

Recent Test Results

OpenBenchmarking.org Results Compare

1 System - 6 Benchmark Results

Intel Core i5-4210M - LENOVO 20BFS34A00 - Intel Xeon E3-1200 v3

Fedora 33 - 5.10.7-200.fc33.x86_64 - GNOME Shell 3.38.3

2 Systems - 129 Benchmark Results

AMD Ryzen 9 5950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.10 - 5.11.0-051100rc2daily20210108-generic - GNOME Shell 3.38.1

1 System - 6 Benchmark Results

4 x Intel Xeon E5-4620 v4 - Dell 0VVT0H - Intel Xeon E7 v4

Debian 10 - 5.1.15 - 3.3 Mesa 18.3.6

3 Systems - 191 Benchmark Results

AMD Ryzen 3 2200G - ASUS PRIME B350M-E - AMD Raven

Ubuntu 20.10 - 5.8.0-38-generic - GNOME Shell 3.38.1

1 System - 7 Benchmark Results

AMD Ryzen 5 3600 6-Core - ASUS TUF GAMING B550M-PLUS - AMD Starship

Ubuntu 20.04 - 5.4.0-58-generic - GNOME Shell 3.36.4

4 Systems - 104 Benchmark Results

AMD Ryzen 5 2400G - MSI B350M GAMING PRO - AMD Raven

Ubuntu 19.10 - 5.3.0-64-generic - GNOME Shell 3.34.1

2 Systems - 2 Benchmark Results

Intel Celeron N3060 - ASUS X541SA - 1 x 2048 MB 1066MHz HMT425S6CFR6A-PB

Microsoft Windows 10 Enterprise 2016 LTSB Build 14393 - 10.0 - 20.19.15.5166

1 System - 1 Benchmark Result

Intel Celeron N3060 - ASUS X541SA - 1 x 2048 MB 1066MHz HMT425S6CFR6A-PB

Microsoft Windows 10 Enterprise 2016 LTSB Build 14393 - 10.0 - 20.19.15.5166

1 System - 7 Benchmark Results

AMD Ryzen 7 3700X 8-Core - ASRock X570 Phantom Gaming-ITX/TB3 - AMD Starship

Ubuntu 20.10 - 5.8.0-36-lowlatency - X Server 1.20.9

1 System - 1 Benchmark Result

AMD Ryzen 9 5900X 12-Core - Gigabyte X570 AORUS MASTER - 4 x 8192 MB 2133MHz F4-3200C14-8GTRS

Microsoft Windows 10 Pro Build 19042 - 10.0 - 456.71

6 Systems - 7 Benchmark Results

AMD Ryzen 7 5800X 8-Core - ASUS ROG CROSSHAIR VIII IMPACT - AMD Starship

Ubuntu 20.04 - 5.4.0-60-generic - KDE Plasma 5.18.5

5 Systems - 7 Benchmark Results

AMD Ryzen 7 3700X 8-Core - ASUS ROG CROSSHAIR VIII IMPACT - AMD Starship

Ubuntu 20.04 - 5.4.0-60-generic - KDE Plasma 5.18.5

Most Popular Test Results

OpenBenchmarking.org Results Compare

3 Systems - 268 Benchmark Results

Intel Core i5-2520M - HP 161C - Intel 2nd Generation Core DRAM

Ubuntu 18.04 - 4.18.0-20-generic - GNOME Shell 3.28.3

12 Systems - 593 Benchmark Results

AMD Ryzen 9 5900X 12-Core - ASRock X570 Taichi - AMD Starship

Fedora 33 - 5.8.16-300.fc33.x86_64 - GNOME Shell 3.38.1

11 Systems - 217 Benchmark Results

AMD Ryzen 7 3800XT 8-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4

2 Systems - 178 Benchmark Results

Intel Core i9-7980XE - ASUS PRIME X299-A - Intel Sky Lake-E DMI3 Registers

Ubuntu 18.04 - 4.15.2-041502-generic - GNOME Shell 3.26.2

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.9.0-6-amd64 - GCC 6.3.0 20170516

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.9.0-6-amd64 - GCC 6.3.0 20170516

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.9.0-6-amd64 - GCC 6.3.0 20170516

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.9.0-6-amd64 - GCC 6.3.0 20170516

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.17.4-xanmod4 - GCC 6.3.0 20170516

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.17.4-xanmod4 - GCC 6.3.0 20170516

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.17.4-xanmod4 - GCC 6.3.0 20170516

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.17.4-xanmod4 - GCC 6.3.0 20170516

Find More Test Results

OpenBenchmarking.org Community User Comments

Post A Comment