Crafty

This is a performance test of Crafty, an advanced open-source chess engine.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark crafty.

Project Site

craftychess.com

Test Created

6 December 2010

Last Updated

19 November 2020

Test Maintainer

Michael Larabel 

Test Type

Processor

Average Install Time

12 Seconds

Average Run Time

34 Minutes, 59 Seconds

Test Dependencies

C/C++ Compiler Toolchain

Accolades

250k+ Downloads + 10k+ Public Benchmark Results

Supported Platforms

Supported Architectures

x86 + x86_64

Public Result UploadsTest Completions*Reported Installs*OpenBenchmarking.orgEventsCrafty Popularity Statisticspts/crafty2011.042011.082011.122012.042012.082012.122013.042013.082013.122014.042014.082014.122015.042015.082015.122016.042016.082016.122017.042017.082017.122018.042018.082018.122019.042019.082019.122020.042020.082020.122021.0416K32K48K64K80K
* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
Data current as of Sat, 10 Apr 2021 11:36:21 GMT.

Revision History

pts/crafty-1.4.5   [View Source]   Thu, 19 Nov 2020 18:11:42 GMT
Limit to x86/x86_64 architecture as upstream Crafty is still not compatible with non-x86 architectures.

pts/crafty-1.4.4   [View Source]   Sun, 23 Dec 2018 10:45:36 GMT
Fix building with Clang on FreeBSD.

pts/crafty-1.4.3   [View Source]   Sat, 09 Jun 2018 10:58:29 GMT
Fix Crafty build on Linux when Clang isn't available since its upstream makefile was defaulting to Clang, so add GCC check.

pts/crafty-1.4.2   [View Source]   Sat, 07 Apr 2018 18:53:55 GMT
Update download link for Windows, fix build on FreeBSD/Clang.

pts/crafty-1.4.1   [View Source]   Sun, 04 Mar 2018 11:05:38 GMT
Add Windows support.

pts/crafty-1.4.0   [View Source]   Wed, 07 Feb 2018 15:16:24 GMT
Updated against Crafty 25.2 upstream, switch to reporting nodes per second.

pts/crafty-1.3.1   [View Source]   Thu, 25 Aug 2016 14:01:41 GMT
Update CFLAGS handling, update download links

pts/crafty-1.3.0   [View Source]   Sun, 29 Jan 2012 12:44:39 GMT
Update against Crafty 23.4 upstream. Plus makefile changes.

pts/crafty-1.2.0   [View Source]   Mon, 06 Dec 2010 14:37:37 GMT
Initial import into OpenBenchmarking.org

Suites Using This Test

Chess Test Suite

CPU Massive


Performance Metrics

Analyze Test Configuration:

Crafty 25.2

Elapsed Time

OpenBenchmarking.org metrics for this test profile configuration based on 4,043 public results since 7 February 2018 with the latest data as of 10 April 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
# Matching Public Results
Nodes Per Second (Average)
100th
51
11682151 +/- 227464
100th
29
11615330 +/- 251292
100th
18
11430906 +/- 167606
99th
25
11288171 +/- 158601
98th
10
10410661 +/- 476941
98th
37
10225148 +/- 239023
97th
5
10029130 +/- 96559
96th
4
9856069 +/- 107603
96th
27
9841085 +/- 476834
96th
3
9787995 +/- 39441
96th
9
9776884 +/- 576762
96th
11
9725071 +/- 87795
96th
32
9699551 +/- 327190
95th
3
9576145 +/- 203411
95th
3
9547191 +/- 44766
94th
22
9376307 +/- 92235
94th
5
9363214 +/- 556735
94th
32
9344672 +/- 465332
93rd
21
9244259 +/- 122571
92nd
6
9229282 +/- 238465
91st
8
9151800 +/- 315448
91st
23
9081152 +/- 348715
91st
46
9060574 +/- 212250
90th
4
9001533 +/- 201179
90th
28
8989998 +/- 540746
90th
3
8986953 +/- 12690
90th
19
8980478 +/- 311743
89th
25
8945571 +/- 536315
89th
5
8945141 +/- 29621
89th
4
8924105 +/- 964375
88th
4
8890005 +/- 76689
87th
26
8805378 +/- 293760
87th
8
8782949 +/- 353136
87th
6
8775010 +/- 205190
86th
46
8727448 +/- 435667
86th
7
8682668 +/- 97438
86th
3
8639990 +/- 22089
85th
3
8578231 +/- 260438
85th
76
8571122 +/- 288492
85th
9
8527516 +/- 308399
84th
10
8508811 +/- 365048
84th
5
8508272 +/- 498486
84th
12
8493923 +/- 310308
84th
5
8468124 +/- 62955
84th
3
8450441 +/- 53411
83rd
7
8329725 +/- 136296
83rd
3
8303243 +/- 839546
83rd
8
8301411 +/- 43533
83rd
4
8300494 +/- 317611
81st
6
8038644 +/- 25877
80th
3
8018138 +/- 821135
80th
14
7985347 +/- 443514
79th
3
7956537 +/- 96745
79th
5
7949863 +/- 15938
79th
3
7901737 +/- 45542
79th
10
7899049 +/- 195593
78th
9
7871543 +/- 89106
78th
3
7852663 +/- 16762
78th
4
7832976 +/- 187154
77th
3
7823343 +/- 746214
77th
11
7812852 +/- 336632
77th
8
7804216 +/- 405394
77th
7
7796631 +/- 460149
77th
23
7790137 +/- 221940
77th
13
7784670 +/- 103360
77th
15
7779990 +/- 439225
76th
8
7775630 +/- 164630
Mid-Tier
75th
< 7712678
75th
9
7695541 +/- 303296
75th
12
7673929 +/- 110413
75th
5
7663653 +/- 20252
74th
11
7634674 +/- 310850
74th
4
7623209 +/- 266245
73rd
7
7606611 +/- 172304
73rd
4
7604728 +/- 243362
73rd
4
7599454 +/- 166656
73rd
15
7598774 +/- 227068
73rd
8
7596180 +/- 152957
72nd
6
7584662 +/- 128712
72nd
22
7582545 +/- 336952
72nd
5
7582154 +/- 55143
72nd
8
7565817 +/- 190397
72nd
8
7560577 +/- 133971
72nd
7
7559670 +/- 339210
72nd
58
7552622 +/- 332803
70th
14
7491811 +/- 459449
69th
5
7447854 +/- 100757
69th
3
7441721 +/- 593726
69th
3
7439930 +/- 282137
69th
7
7438784 +/- 46321
68th
4
7431782 +/- 512795
68th
9
7418278 +/- 30101
68th
32
7417213 +/- 452883
67th
3
7393658 +/- 9587
67th
7
7384775 +/- 43613
66th
5
7360294 +/- 439947
66th
7
7355933 +/- 200229
66th
5
7349564 +/- 293057
65th
57
7314181 +/- 396851
65th
10
7299701 +/- 790854
65th
3
7293575 +/- 782601
65th
6
7285696 +/- 135780
64th
4
7252590 +/- 116327
64th
18
7231277 +/- 478583
63rd
5
7222177 +/- 221799
63rd
6
7221898 +/- 685008
62nd
7
7175323 +/- 174366
62nd
5
7150934 +/- 182676
62nd
7
7143996 +/- 294005
62nd
5
7140050 +/- 959392
61st
16
7133979 +/- 511769
61st
10
7127481 +/- 185608
61st
39
7097511 +/- 547347
61st
3
7097068 +/- 40016
61st
13
7087433 +/- 101829
61st
4
7081629 +/- 127652
61st
3
7075120 +/- 246201
61st
13
7073289 +/- 292388
60th
4
7065322 +/- 20518
60th
16
7055924 +/- 134665
60th
14
7043309 +/- 586752
59th
20
7031955 +/- 201195
58th
25
7003435 +/- 463107
58th
4
7000305 +/- 421998
58th
31
6975570 +/- 747703
57th
16
6972370 +/- 36413
57th
23
6963052 +/- 350984
56th
12
6946783 +/- 21630
56th
3
6942847 +/- 109476
55th
9
6928627 +/- 440225
54th
8
6914033 +/- 161804
54th
46
6897697 +/- 95897
54th
22
6879075 +/- 144437
53rd
7
6862544 +/- 275461
53rd
10
6860348 +/- 156952
53rd
3
6854810 +/- 176156
53rd
3
6849985 +/- 180266
53rd
5
6826318 +/- 294906
53rd
10
6820771 +/- 150487
52nd
9
6807523 +/- 870825
52nd
10
6796851 +/- 299240
52nd
10
6769144 +/- 49218
51st
27
6752777 +/- 240230
Median
50th
6724444
50th
7
6713219 +/- 682633
50th
13
6709134 +/- 91128
50th
7
6708456 +/- 837937
49th
14
6692404 +/- 182510
49th
4
6677632 +/- 254483
49th
7
6672829 +/- 76082
48th
11
6650586 +/- 38509
48th
3
6646628 +/- 71135
48th
12
6637479 +/- 303962
48th
10
6617697 +/- 246529
47th
10
6609460 +/- 174551
47th
13
6606482 +/- 302893
47th
3
6590495 +/- 465714
47th
4
6583949 +/- 71488
47th
4
6577011 +/- 247840
46th
3
6551338 +/- 106771
45th
6
6518900 +/- 227347
44th
13
6483075 +/- 202102
43rd
32
6451362 +/- 243560
43rd
4
6450952 +/- 46850
42nd
14
6434774 +/- 209860
42nd
10
6423579 +/- 267740
42nd
40
6412711 +/- 386410
41st
10
6392628 +/- 107310
40th
6
6336642 +/- 297795
40th
8
6318629 +/- 338085
40th
9
6311654 +/- 140448
39th
14
6277107 +/- 234989
39th
4
6271764 +/- 343407
39th
10
6263414 +/- 327135
39th
5
6261926 +/- 33808
39th
3
6258188 +/- 322943
39th
11
6245339 +/- 265337
39th
16
6236198 +/- 408118
38th
3
6182269 +/- 117641
36th
10
6091596 +/- 487771
36th
3
6073574 +/- 102380
36th
26
6072494 +/- 703479
35th
27
6054861 +/- 515174
35th
4
6039822 +/- 495065
34th
6
5995192 +/- 42728
34th
3
5991537 +/- 643389
34th
7
5978934 +/- 270587
34th
6
5977876 +/- 230011
34th
3
5977744 +/- 265809
33rd
6
5960654 +/- 767814
33rd
3
5941774 +/- 772276
33rd
4
5935476 +/- 187894
33rd
8
5919119 +/- 672281
31st
12
5866649 +/- 123908
31st
5
5859985 +/- 569728
31st
7
5848206 +/- 861763
31st
5
5840132 +/- 68611
31st
13
5829115 +/- 377088
31st
12
5825163 +/- 121184
31st
3
5817152 +/- 18682
31st
9
5806916 +/- 137790
30th
28
5791520 +/- 150319
30th
17
5769392 +/- 597773
30th
3
5766876 +/- 126875
29th
29
5695717 +/- 147971
28th
10
5673528 +/- 341849
26th
7
5627818 +/- 59387
26th
3
5623730 +/- 103023
26th
3
5621919 +/- 116293
26th
16
5593819 +/- 769106
26th
6
5571001 +/- 99989
Low-Tier
25th
< 5562960
25th
16
5559728 +/- 11869
25th
4
5546345 +/- 660937
25th
9
5538528 +/- 782694
25th
7
5533930 +/- 234825
25th
3
5525797 +/- 32045
24th
5
5484781 +/- 15301
24th
4
5478604 +/- 88952
23rd
18
5461408 +/- 382785
23rd
3
5451428 +/- 8627
22nd
4
5401508 +/- 19334
20th
5
5282631 +/- 107132
20th
4
5271253 +/- 213511
20th
5
5254040 +/- 38373
20th
13
5239949 +/- 124233
19th
7
5223547 +/- 312225
19th
4
5196984 +/- 1977
18th
3
5108455 +/- 186874
18th
17
5101290 +/- 341637
18th
6
5099960 +/- 128459
18th
5
5099095 +/- 488114
18th
18
5091054 +/- 225032
17th
3
5060832 +/- 53894
17th
3
5035384 +/- 535606
16th
3
4968592 +/- 19551
16th
3
4968582 +/- 648736
15th
7
4916824 +/- 439929
14th
4
4881276 +/- 71907
14th
3
4874153 +/- 9423
14th
7
4867445 +/- 9145
13th
6
4825743 +/- 77788
13th
10
4819477 +/- 18251
13th
3
4797424 +/- 52980
12th
3
4749062 +/- 467246
12th
3
4736884 +/- 91823
12th
4
4695195 +/- 70807
12th
3
4689964 +/- 275408
12th
9
4656601 +/- 438885
12th
5
4642202 +/- 51169
11th
6
4640692 +/- 10270
11th
6
4632287 +/- 407123
11th
3
4502787 +/- 51057
10th
3
4482987 +/- 19702
10th
4
4371345 +/- 28762
9th
5
4337915 +/- 38563
9th
4
4317524 +/- 49115
7th
4
3791538 +/- 75279
6th
9
3614091 +/- 160529
5th
4
3221921 +/- 10958
5th
3
3212525 +/- 309953
3rd
38
2336343 +/- 2225
3rd
3
2202620 +/- 5924
3rd
3
2118380 +/- 149476
2nd
4
1965952 +/- 1848
2nd
3
1722167 +/- 256911
2nd
4
1671671 +/- 36560
OpenBenchmarking.orgDistribution Of Public Results - Elapsed Time4039 Results Range From 449797 To 12258866 Nodes Per Second449797685979922161115834313945251630707186688921030712339253257543528116173047799328398135201633756345399252742287094464891470107349372555173437540961956458015881983611816563543476590529682671170628937299075753525777714398007621824380384799858716167895234991885319424713966089598970771013325910369441106056231084180511077987113141691155035111786533120227151225889770140210280350

Based on OpenBenchmarking.org data, the selected test / test configuration (Crafty 25.2 - Elapsed Time) has an average run-time of 2 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkElapsed TimeRun-Time48121620Min: 1 / Avg: 1.85 / Max: 13

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.3%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsElapsed TimeDeviation246810Min: 0 / Avg: 0.28 / Max: 5

Does It Scale Well With Increasing Cores?

No, based on the automated analysis of the collected public benchmark data, this test / test settings does not generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

AMDIntelOpenBenchmarking.orgRelative Core Scaling To BaseCrafty CPU Core ScalingElapsed Time246810121618202428324048641280.81041.62082.43123.24164.052

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set
Support
Instructions Detected
SSE2 (SSE2)
Used by default on supported hardware.
 
PUNPCKLQDQ MOVDQA CVTSS2SD DIVSD CVTSI2SD ADDSD MOVDQU MOVD PSHUFD PSRLDQ PMULUDQ PSHUFLW PADDQ PUNPCKHQDQ SHUFPD CVTTSD2SI MULSD COMISD CVTSD2SS CVTDQ2PS CVTTPS2DQ SUBSD
SSE 4.2 (SSE4_2)
Used by default on supported hardware.
Found on Intel processors since at least 2010.
Found on AMD processors since Bulldozer (2011).

 
POPCNT
Last automated analysis: 30 January 2021

This test profile binary relies on the shared libraries libm.so.6, libpthread.so.0, libc.so.6.

Recent Test Results

OpenBenchmarking.org Results Compare

12 Systems - 453 Benchmark Results

AMD Ryzen 9 5900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 21.04 - 5.12.0-051200rc3daily20210315-generic - GNOME Shell 3.38.3

1 System - 1 Benchmark Result

AMD Ryzen 7 4800H - LENOVO LNVNB161216 - AMD Renoir Root Complex

Mageia 8 - 5.10.27-desktop-1.mga8 - GNOME Shell 3.38.3

1 System - 10 Benchmark Results

Intel Core i5-7200U - HP 8314 v32.25 - Intel Xeon E3-1200 v6

Mageia 8 - 5.10.27-desktop-1.mga8 - GNOME Shell 3.38.3

1 System - 1 Benchmark Result

Intel Core i7-8565U - 14GB - 2 x 275GB Virtual Disk

Ubuntu 20.10 - 5.11.0-next-20210222-microsoft-cbl - X Server

1 System - 1 Benchmark Result

AMD Ryzen 7 5800X 8-Core - Gigabyte X570 AORUS ELITE - 2 x 32768 MB 3200MHz Kingston

Microsoft Windows 10 Build 19042 - 10.0 - 465.89

3 Systems - 94 Benchmark Results

Intel Core i9-11900K - ASUS ROG MAXIMUS XIII HERO - 2 x 16384 MB 3200MHz Corsair CMK32GX4M2Z3600C18

Microsoft Windows 10 Pro Build 19042 - 10.0 - 10.0.19041.868

2 Systems - 92 Benchmark Results

Intel Core i9-11900K - ASUS ROG MAXIMUS XIII HERO - 2 x 16384 MB 3200MHz Corsair CMK32GX4M2Z3600C18

Microsoft Windows 10 Pro Build 19042 - 10.0 - 10.0.19041.868

3 Systems - 21 Benchmark Results

AMD Ryzen 9 5900X 12-Core - MSI B550M PRO-VDH WIFI - AMD Device 1480

Ubuntu 18.04 - 5.4.0-70-generic - LXDE 0.9.3

2 Systems - 21 Benchmark Results

AMD Ryzen 9 5900X 12-Core - MSI B550M PRO-VDH WIFI - AMD Device 1480

Ubuntu 18.04 - 5.4.0-70-generic - LXDE 0.9.3

1 System - 212 Benchmark Results

Intel Core i5-8250U - LENOVO 20L7CTO1WW - Intel Xeon E3-1200 v6

Debian testing - 5.10.0-5-amd64 - GNOME Shell 3.38.4

1 System - 6 Benchmark Results

2 x Intel Xeon Gold 6238R - Delta Solutions DSS-C621LTG - 16 GB + 129408 MB + 16 GB + 129408 MB + 16 GB + 258496 MB + 16 GB + 258496 MB DDR4-2666MT

AlmaLinux 8.3 - 4.18.0-240.15.1.el8_3.x86_64 - GCC 8.3.1 20191121

9 Systems - 442 Benchmark Results

Intel Core i9-11900K - ASUS ROG MAXIMUS XIII HERO - Intel Tiger Lake-H

Ubuntu 21.04 - 5.12.0-051200rc3daily20210315-generic - GNOME Shell 3.38.3

Most Popular Test Results

OpenBenchmarking.org Results Compare

3 Systems - 268 Benchmark Results

Intel Core i5-2520M - HP 161C - Intel 2nd Generation Core DRAM

Ubuntu 18.04 - 4.18.0-20-generic - GNOME Shell 3.28.3

12 Systems - 593 Benchmark Results

AMD Ryzen 7 5800X 8-Core - Gigabyte X570 AORUS MASTER - AMD Starship

Fedora 33 - 5.8.16-300.fc33.x86_64 - GNOME Shell 3.38.1

11 Systems - 217 Benchmark Results

AMD Ryzen 7 3800XT 8-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4

2 Systems - 178 Benchmark Results

AMD Ryzen Threadripper 1950X 16-Core - Gigabyte X399 AORUS Gaming 7 - AMD Family 17h

Ubuntu 18.04 - 4.15.2-041502-generic - GNOME Shell 3.26.2

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.9.0-6-amd64 - GCC 6.3.0 20170516

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.9.0-6-amd64 - GCC 6.3.0 20170516

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.9.0-6-amd64 - GCC 6.3.0 20170516

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.9.0-6-amd64 - GCC 6.3.0 20170516

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.17.4-xanmod4 - GCC 6.3.0 20170516

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.17.4-xanmod4 - GCC 6.3.0 20170516

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.17.4-xanmod4 - GCC 6.3.0 20170516

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.17.4-xanmod4 - GCC 6.3.0 20170516

Find More Test Results