Crafty

This is a performance test of Crafty, an advanced open-source chess engine.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark crafty.

Project Site

craftychess.com

Test Created

6 December 2010

Last Updated

19 November 2020

Test Maintainer

Michael Larabel 

Test Type

Processor

Average Install Time

11 Seconds

Average Run Time

34 Minutes, 59 Seconds

Test Dependencies

C/C++ Compiler Toolchain

Accolades

250k+ Downloads + 10k+ Public Benchmark Results

Supported Platforms

Supported Architectures

x86 + x86_64

Public Result Uploads *Reported Test Completions **Reported Installs **Test Profile Page Views ***OpenBenchmarking.orgEventsCrafty Popularity Statisticspts/crafty2010.122011.042011.082011.122012.042012.082012.122013.042013.082013.122014.042014.082014.122015.042015.082015.122016.042016.082016.122017.042017.082017.122018.042018.082018.122019.042019.082019.122020.042020.082020.122021.0417K34K51K68K85K
* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
*** Test profile page view reporting began March 2021.
Data current as of 17 June 2021.

Revision History

pts/crafty-1.4.5   [View Source]   Thu, 19 Nov 2020 18:11:42 GMT
Limit to x86/x86_64 architecture as upstream Crafty is still not compatible with non-x86 architectures.

pts/crafty-1.4.4   [View Source]   Sun, 23 Dec 2018 10:45:36 GMT
Fix building with Clang on FreeBSD.

pts/crafty-1.4.3   [View Source]   Sat, 09 Jun 2018 10:58:29 GMT
Fix Crafty build on Linux when Clang isn't available since its upstream makefile was defaulting to Clang, so add GCC check.

pts/crafty-1.4.2   [View Source]   Sat, 07 Apr 2018 18:53:55 GMT
Update download link for Windows, fix build on FreeBSD/Clang.

pts/crafty-1.4.1   [View Source]   Sun, 04 Mar 2018 11:05:38 GMT
Add Windows support.

pts/crafty-1.4.0   [View Source]   Wed, 07 Feb 2018 15:16:24 GMT
Updated against Crafty 25.2 upstream, switch to reporting nodes per second.

pts/crafty-1.3.1   [View Source]   Thu, 25 Aug 2016 14:01:41 GMT
Update CFLAGS handling, update download links

pts/crafty-1.3.0   [View Source]   Sun, 29 Jan 2012 12:44:39 GMT
Update against Crafty 23.4 upstream. Plus makefile changes.

pts/crafty-1.2.0   [View Source]   Mon, 06 Dec 2010 14:37:37 GMT
Initial import into OpenBenchmarking.org

Suites Using This Test

Chess Test Suite

CPU Massive


Performance Metrics

Analyze Test Configuration:

Crafty 25.2

Elapsed Time

OpenBenchmarking.org metrics for this test profile configuration based on 4,124 public results since 7 February 2018 with the latest data as of 15 June 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Compatible Public Results
Nodes Per Second (Average)
100th
55
11665227 +/- 227196
100th
31
11585342 +/- 270657
100th
19
11418556 +/- 170836
99th
25
11288171 +/- 158601
98th
3
10653703 +/- 405710
98th
13
10552760 +/- 593836
97th
37
10225148 +/- 239023
97th
5
10029130 +/- 96559
96th
3
9955476 +/- 214765
96th
4
9856069 +/- 107603
96th
27
9841085 +/- 476834
96th
3
9787995 +/- 39441
95th
9
9776884 +/- 576762
95th
34
9730021 +/- 340422
95th
11
9725071 +/- 87795
95th
3
9576145 +/- 203411
95th
3
9547191 +/- 44766
93rd
22
9376307 +/- 92235
93rd
5
9363214 +/- 556735
93rd
32
9344672 +/- 465332
92nd
21
9244259 +/- 122571
92nd
6
9229282 +/- 238465
91st
8
9151800 +/- 315448
91st
23
9081152 +/- 348715
90th
48
9055147 +/- 247439
90th
28
8989998 +/- 540746
90th
3
8986953 +/- 12690
90th
19
8980478 +/- 311743
90th
5
8964715 +/- 192698
89th
5
8960320 +/- 839090
89th
25
8945571 +/- 536315
89th
5
8945141 +/- 29621
88th
5
8876722 +/- 72754
87th
26
8805378 +/- 293760
87th
6
8775010 +/- 205190
86th
9
8751399 +/- 343621
86th
46
8727448 +/- 435667
86th
8
8663693 +/- 104968
86th
3
8639990 +/- 22089
85th
3
8578231 +/- 260438
85th
76
8571122 +/- 288492
84th
9
8527516 +/- 308399
84th
10
8508811 +/- 365048
84th
5
8508272 +/- 498486
84th
12
8493923 +/- 310308
84th
5
8468124 +/- 62955
84th
4
8435023 +/- 53411
83rd
7
8329725 +/- 136296
82nd
3
8303243 +/- 839546
82nd
8
8301411 +/- 43533
82nd
4
8300494 +/- 317611
80th
6
8038644 +/- 25877
80th
3
8018138 +/- 821135
79th
15
7969228 +/- 431916
79th
3
7956537 +/- 96745
79th
5
7949863 +/- 15938
78th
3
7901737 +/- 45542
78th
10
7899049 +/- 195593
78th
9
7871543 +/- 89106
78th
3
7852663 +/- 16762
77th
4
7832976 +/- 187154
77th
3
7823343 +/- 746214
77th
11
7812852 +/- 336632
77th
9
7802520 +/- 379246
77th
7
7796631 +/- 460149
76th
24
7792254 +/- 217309
76th
13
7784670 +/- 103360
76th
15
7779990 +/- 439225
76th
8
7775630 +/- 164630
Mid-Tier
75th
< 7742415
75th
7
7726949 +/- 87854
75th
9
7695541 +/- 303296
75th
12
7673929 +/- 110413
74th
5
7663653 +/- 20252
74th
11
7634674 +/- 310850
73rd
4
7623209 +/- 266245
73rd
7
7606611 +/- 172304
73rd
4
7604728 +/- 243362
72nd
4
7599454 +/- 166656
72nd
16
7597353 +/- 219442
72nd
8
7596180 +/- 152957
72nd
6
7584662 +/- 128712
72nd
22
7582545 +/- 336952
72nd
5
7582154 +/- 55143
71st
8
7565817 +/- 190397
71st
8
7560577 +/- 133971
71st
7
7559670 +/- 339210
71st
58
7552622 +/- 332803
70th
14
7491811 +/- 459449
69th
5
7447854 +/- 100757
68th
3
7441721 +/- 593726
68th
3
7439930 +/- 282137
68th
7
7438784 +/- 46321
68th
4
7431782 +/- 512795
68th
9
7418278 +/- 30101
67th
32
7417213 +/- 452883
67th
3
7393658 +/- 9587
66th
7
7384775 +/- 43613
66th
5
7360294 +/- 439947
66th
7
7355933 +/- 200229
66th
5
7349564 +/- 293057
65th
57
7314181 +/- 396851
64th
10
7299701 +/- 790854
64th
3
7293575 +/- 782601
64th
6
7285696 +/- 135780
64th
4
7252590 +/- 116327
63rd
18
7231277 +/- 478583
63rd
5
7222177 +/- 221799
63rd
6
7221898 +/- 685008
62nd
7
7175323 +/- 174366
61st
5
7150934 +/- 182676
61st
7
7143996 +/- 294005
61st
5
7140050 +/- 959392
61st
16
7133979 +/- 511769
61st
10
7127481 +/- 185608
61st
39
7097511 +/- 547347
61st
3
7097068 +/- 40016
60th
13
7087433 +/- 101829
60th
4
7081629 +/- 127652
60th
3
7075120 +/- 246201
60th
13
7073289 +/- 292388
60th
4
7065322 +/- 20518
60th
16
7055924 +/- 134665
59th
14
7043309 +/- 586752
59th
20
7031955 +/- 201195
58th
25
7003435 +/- 463107
58th
4
7000305 +/- 421998
57th
31
6975570 +/- 747703
57th
16
6972370 +/- 36413
57th
24
6965996 +/- 343571
56th
12
6946783 +/- 21630
56th
3
6942847 +/- 109476
55th
9
6928627 +/- 440225
54th
8
6914033 +/- 161804
54th
46
6897697 +/- 95897
53rd
22
6879075 +/- 144437
53rd
7
6862544 +/- 275461
53rd
10
6860348 +/- 156952
53rd
3
6854810 +/- 176156
53rd
3
6849985 +/- 180266
52nd
5
6826318 +/- 294906
52nd
10
6820771 +/- 150487
52nd
9
6807523 +/- 870825
52nd
10
6796851 +/- 299240
51st
10
6769144 +/- 49218
51st
27
6752777 +/- 240230
Median
50th
6735357
50th
7
6713219 +/- 682633
50th
13
6709134 +/- 91128
50th
7
6708456 +/- 837937
49th
14
6692404 +/- 182510
49th
4
6677632 +/- 254483
48th
7
6672829 +/- 76082
48th
11
6650586 +/- 38509
48th
3
6646628 +/- 71135
48th
12
6637479 +/- 303962
48th
10
6617697 +/- 246529
47th
10
6609460 +/- 174551
47th
13
6606482 +/- 302893
47th
3
6596782 +/- 123433
47th
3
6590495 +/- 465714
47th
4
6583949 +/- 71488
46th
4
6577011 +/- 247840
46th
3
6551338 +/- 106771
44th
6
6518900 +/- 227347
44th
13
6483075 +/- 202102
43rd
32
6451362 +/- 243560
43rd
4
6450952 +/- 46850
42nd
14
6434774 +/- 209860
42nd
10
6423579 +/- 267740
41st
40
6412711 +/- 386410
41st
10
6392628 +/- 107310
40th
6
6336642 +/- 297795
40th
8
6318629 +/- 338085
40th
9
6311654 +/- 140448
39th
14
6277107 +/- 234989
39th
4
6271764 +/- 343407
39th
10
6263414 +/- 327135
39th
5
6261926 +/- 33808
39th
3
6258188 +/- 322943
39th
11
6245339 +/- 265337
39th
16
6236198 +/- 408118
38th
3
6182269 +/- 117641
36th
10
6091596 +/- 487771
36th
3
6073574 +/- 102380
36th
26
6072494 +/- 703479
35th
27
6054861 +/- 515174
35th
4
6039822 +/- 495065
34th
6
5995192 +/- 42728
34th
3
5991537 +/- 643389
34th
7
5978934 +/- 270587
34th
6
5977876 +/- 230011
34th
3
5977744 +/- 265809
33rd
6
5960654 +/- 767814
33rd
3
5941774 +/- 772276
33rd
4
5935476 +/- 187894
31st
12
5866649 +/- 123908
31st
5
5859985 +/- 569728
31st
7
5848206 +/- 861763
31st
5
5840132 +/- 68611
31st
13
5829115 +/- 377088
31st
12
5825163 +/- 121184
31st
3
5817152 +/- 18682
31st
9
5806916 +/- 137790
30th
28
5791520 +/- 150319
30th
9
5790899 +/- 737177
30th
17
5769392 +/- 597773
30th
3
5766876 +/- 126875
29th
29
5695717 +/- 147971
28th
10
5673528 +/- 341849
27th
7
5627818 +/- 59387
26th
3
5623730 +/- 103023
26th
3
5621919 +/- 116293
26th
16
5593819 +/- 769106
Low-Tier
25th
< 5561607
25th
16
5559728 +/- 11869
25th
4
5546345 +/- 660937
25th
7
5544307 +/- 115410
25th
9
5538528 +/- 782694
25th
7
5533930 +/- 234825
25th
3
5525797 +/- 32045
24th
5
5484781 +/- 15301
24th
4
5478604 +/- 88952
23rd
18
5461408 +/- 382785
23rd
3
5451428 +/- 8627
22nd
4
5401508 +/- 19334
21st
5
5282631 +/- 107132
20th
4
5271253 +/- 213511
20th
5
5254040 +/- 38373
20th
13
5239949 +/- 124233
20th
7
5223547 +/- 312225
19th
4
5196984 +/- 1977
18th
3
5108455 +/- 186874
18th
17
5101290 +/- 341637
18th
6
5099960 +/- 128459
18th
5
5099095 +/- 488114
18th
18
5091054 +/- 225032
17th
3
5060832 +/- 53894
17th
3
5035384 +/- 535606
16th
3
4968592 +/- 19551
16th
3
4968582 +/- 648736
15th
7
4916824 +/- 439929
15th
4
4881276 +/- 71907
15th
3
4874153 +/- 9423
14th
7
4867445 +/- 9145
14th
6
4825743 +/- 77788
14th
10
4819477 +/- 18251
13th
3
4797424 +/- 52980
13th
3
4749062 +/- 467246
13th
3
4736884 +/- 91823
12th
3
4701673 +/- 95874
12th
4
4695195 +/- 70807
12th
3
4689964 +/- 275408
12th
9
4656601 +/- 438885
12th
5
4642202 +/- 51169
12th
6
4640692 +/- 10270
12th
6
4632287 +/- 407123
11th
3
4502787 +/- 51057
11th
3
4482987 +/- 19702
10th
4
4371345 +/- 28762
10th
5
4337915 +/- 38563
9th
4
4317524 +/- 49115
8th
10
4167237 +/- 85607
7th
4
3791538 +/- 75279
6th
9
3614091 +/- 160529
5th
4
3221921 +/- 10958
5th
3
3212525 +/- 309953
3rd
38
2336343 +/- 2225
3rd
3
2202620 +/- 5924
3rd
3
2118380 +/- 149476
2nd
4
1965952 +/- 1848
2nd
4
1761373 +/- 223943
2nd
4
1671671 +/- 36560
OpenBenchmarking.orgDistribution Of Public Results - Elapsed Time4124 Results Range From 449797 To 12258866 Nodes Per Second449797685979922161115834313945251630707186688921030712339253257543528116173047799328398135201633756345399252742287094464891470107349372555173437540961956458015881983611816563543476590529682671170628937299075753525777714398007621824380384799858716167895234991885319424713966089598970771013325910369441106056231084180511077987113141691155035111786533120227151225889770140210280350

Based on OpenBenchmarking.org data, the selected test / test configuration (Crafty 25.2 - Elapsed Time) has an average run-time of 2 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkElapsed TimeRun-Time48121620Min: 1 / Avg: 1.84 / Max: 13

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.3%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsElapsed TimeDeviation246810Min: 0 / Avg: 0.28 / Max: 5

Does It Scale Well With Increasing Cores?

No, based on the automated analysis of the collected public benchmark data, this test / test settings does not generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

AMDIntelOpenBenchmarking.orgRelative Core Scaling To BaseCrafty CPU Core ScalingElapsed Time246810121618202428324048641280.80831.61662.42493.23324.0415

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set
Support
Instructions Detected
SSE2 (SSE2)
Used by default on supported hardware.
 
MOVDQA CVTSS2SD DIVSD MOVDQU MOVD PSHUFD PSRLDQ PMULUDQ PUNPCKLQDQ PSHUFLW PADDQ PUNPCKHQDQ CVTSI2SD ADDSD SHUFPD CVTTSD2SI MULSD COMISD CVTSD2SS CVTDQ2PS CVTTPS2DQ SUBSD
SSE 4.2 (SSE4_2)
Used by default on supported hardware.
Found on Intel processors since at least 2010.
Found on AMD processors since Bulldozer (2011).

 
POPCNT
Last automated analysis: 10 May 2021

This test profile binary relies on the shared libraries libm.so.6, libpthread.so.0, libc.so.6.

Recent Test Results

OpenBenchmarking.org Results Compare

1 System - 13 Benchmark Results

Intel Core i7-1065G7 - Oracle VirtualBox v1.2 - Intel 440FX 82441FX PMC

Ubuntu 18.04 - 4.15.0-142-generic - X Server

1 System - 1 Benchmark Result

Intel Core i7-6820HQ - Dell 0RJHDG - Intel Xeon E3-1200 v5

Uos 20 Home - 5.7.7-amd64-desktop - Deepin Desktop Environment

1 System - 1 Benchmark Result

Intel Core i3-9100F - IPASON H310MHP - 1 x 8192 MB 2400MHz

Microsoft Windows 10 Build 19043 - 10.0 - 456.71

1 System - 5 Benchmark Results

AMD Ryzen 9 5950X 16-Core - ASUS ROG CROSSHAIR VIII DARK HERO - AMD Starship

ManjaroLinux 21.0.7 - 5.13.0-1-MANJARO - KDE Plasma 5.21.5

1 System - 17 Benchmark Results

Intel Pentium G4600 - FUJITSU D3433-S2 - Intel Xeon E3-1200 v6

Ubuntu 21.04 - 5.11.0-18-generic - GCC 10.3.0

1 System - 1 Benchmark Result

Intel Core i5-1135G7 - ASUS X421EQY v1.0 - Intel Tiger Lake-LP

Ubuntu 21.04 - 5.11.0-18-generic - GNOME Shell 3.38.4

6 Systems - 7 Benchmark Results

AMD Ryzen 7 3700X 8-Core - ASUS ROG CROSSHAIR VIII IMPACT - AMD Starship

Ubuntu 20.04 - 5.4.0-60-generic - KDE Plasma 5.18.5

5 Systems - 7 Benchmark Results

AMD Ryzen 7 5800X 8-Core - ASUS ROG CROSSHAIR VIII IMPACT - AMD Starship

Ubuntu 20.04 - 5.4.0-60-generic - KDE Plasma 5.18.5

1 System - 7 Benchmark Results

Intel Core i7-6700HQ - Acer Aspire VN7-792G - Intel Xeon E3-1200 v5

Pop 20.10 - 5.11.0-7614-generic - GNOME Shell 3.38.3

13 Systems - 10 Benchmark Results

Intel Core i3-3110M - LENOVO - Intel 3rd Gen Core DRAM

OpenMandrivaLinux 4.2 - 5.11.12-desktop-1omv4002 - KDE Plasma 5.20.5

1 System - 1 Benchmark Result

Intel Core i5-1035G1 - Intel 440BX - Intel 440BX

Ubuntu 18.04 - 4.15.0-144-generic - ext4

1 System - 1 Benchmark Result

AMD A10-8750 Radeon R7 12 Compute Cores 4C+8G - Intel 440BX - Intel 440BX

Ubuntu 18.04 - 4.15.0-144-generic - ext4

Most Popular Test Results

OpenBenchmarking.org Results Compare

3 Systems - 268 Benchmark Results

Intel Core i5-2520M - HP 161C - Intel 2nd Generation Core DRAM

Ubuntu 18.04 - 4.18.0-20-generic - GNOME Shell 3.28.3

11 Systems - 217 Benchmark Results

AMD Ryzen 5 2600X Six-Core - ASUS ROG CROSSHAIR VIII HERO - AMD 17h

Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4

12 Systems - 593 Benchmark Results

AMD Ryzen 5 3600X 6-Core - MSI X470 GAMING M7 AC - AMD Starship

Ubuntu 20.04 - 5.8.0-050800daily20200622-generic - GNOME Shell 3.36.2

2 Systems - 178 Benchmark Results

Intel Core i9-7980XE - ASUS PRIME X299-A - Intel Sky Lake-E DMI3 Registers

Ubuntu 18.04 - 4.15.2-041502-generic - GNOME Shell 3.26.2

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.9.0-6-amd64 - GCC 6.3.0 20170516

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.9.0-6-amd64 - GCC 6.3.0 20170516

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.9.0-6-amd64 - GCC 6.3.0 20170516

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.9.0-6-amd64 - GCC 6.3.0 20170516

3 Systems - 174 Benchmark Results

Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH

Fedora 32 - 5.6.6-300.fc32.x86_64 - GNOME Shell 3.36.1

8 Systems - 360 Benchmark Results

AMD Ryzen Threadripper 3960X 24-Core - MSI Creator TRX40 - AMD Starship

Ubuntu 19.10 - 5.4.0-999-generic - GNOME Shell 3.34.1

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.17.4-xanmod4 - GCC 6.3.0 20170516

Find More Test Results