Crafty

This is a performance test of Crafty, an advanced open-source chess engine.

Learn more about this test at the upstream project site: http://craftychess.com/.

This utility test profile is maintained by Michael Larabel. This OpenBenchmarking.org test profile was created on 6 December 2010 and last updated on 23 December 2018. To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark crafty.

This test has an average install time of 1 second and an average run-time of 34 minutes, 59 seconds.

250k+ Downloads + 10k+ Public Benchmark Results

Installation StatsTest Completion StatsOpenBenchmarking.orgEventsCrafty Popularitypts/crafty2015.102015.122016.022016.042016.062016.082016.102016.122017.022017.042017.062017.082017.102017.122018.022018.042018.062018.082018.102018.122019.022019.042019.062019.082019.102019.122020.022020.042020.062020.08200040006000800010000

* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting.

Revision History

pts/crafty-1.4.4   [View Source]   23 Dec 2018 10:45 EST
Fix building with Clang on FreeBSD.

pts/crafty-1.4.3   [View Source]   09 Jun 2018 10:58 EDT
Fix Crafty build on Linux when Clang isn't available since its upstream makefile was defaulting to Clang, so add GCC check.

pts/crafty-1.4.2   [View Source]   07 Apr 2018 18:53 EDT
Update download link for Windows, fix build on FreeBSD/Clang.

pts/crafty-1.4.1   [View Source]   04 Mar 2018 11:05 EST
Add Windows support.

pts/crafty-1.4.0   [View Source]   07 Feb 2018 15:16 EST
Updated against Crafty 25.2 upstream, switch to reporting nodes per second.

pts/crafty-1.3.1   [View Source]   25 Aug 2016 14:01 EDT
Update CFLAGS handling, update download links

pts/crafty-1.3.0   [View Source]   29 Jan 2012 12:44 EST
Update against Crafty 23.4 upstream. Plus makefile changes.

pts/crafty-1.2.0   [View Source]   06 Dec 2010 14:37 EST
Initial import into OpenBenchmarking.org

Suites Using This Test

Chess Test Suite

CPU Massive

Performance Metrics

Analyze Test Configuration:

Crafty 25.2

Elapsed Time

OpenBenchmarking.org metrics for this test profile configuration based on 3,242 public samples since 7 February 2018 with the latest data as of 28 October 2020.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
Nodes Per Second (Average)
Mid-Tier
75th
< 7542240
57th
6807523
Median
50th
6549705
40th
6039822
28th
5490521
Low-Tier
25th
< 5380340
14th
4736884
14th
4689964
12th
4482987
OpenBenchmarking.orgDistribution Of Public Results - Elapsed Time3242 Results Range From 449797 To 10645517 Nodes Per Second44979765371285762710615421265457146937216732871877202208111722850322488947269286228967773100692330460735085223712437391635241202674324182452809747320124935927513984253437575547672575158759555026159417636333265672476771162697507771789927382907758682277907377994652819856784024828606397881031290142279218142942205796259729829887100338021023771710441632106455474080120160200

Based on OpenBenchmarking.org data, the selected test / test configuration (Crafty 25.2 - Elapsed Time) has an average run-time of 2 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkElapsed TimeRun-Time48121620Min: 1 / Avg: 1.94 / Max: 13

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.3%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsElapsed TimeDeviation246810Min: 0 / Avg: 0.29 / Max: 5

Recent Test Results

Compare

1 System - 49 Benchmark Results

Intel Xeon E-2288G - Compulab SBC-ATCFL v1.2 - Intel Cannon Lake PCH

Ubuntu 20.10 - 5.8.0-26-generic - GNOME Shell 3.38.1

1 System - 43 Benchmark Results

Intel Xeon E-2288G - Compulab SBC-ATCFL v1.2 - Intel Cannon Lake PCH

Ubuntu 19.10 - 5.3.0-64-generic - GNOME Shell 3.34.1

2 Systems - 47 Benchmark Results

Intel Core i5-8259U - Intel NUC8BEB - Intel Cannon Point-LP

Ubuntu 20.10 - 5.8.0-25-generic - KDE Plasma 5.19.5

1 System - 43 Benchmark Results

Intel Xeon E-2288G - Compulab SBC-ATCFL v1.2 - Intel Cannon Lake PCH

Ubuntu 19.10 - 5.3.0-64-generic - GNOME Shell 3.34.1

1 System - 7 Benchmark Results

AMD Ryzen 7 2700X Eight-Core - ASUS PRIME X470-PRO - AMD 17h

Ubuntu 20.04 - 5.4.0-52-generic - GNOME Shell 3.36.4

1 System - 43 Benchmark Results

Intel Xeon E-2288G - Compulab SBC-ATCFL v1.2 - Intel Cannon Lake PCH

Ubuntu 19.10 - 5.3.0-64-generic - GNOME Shell 3.34.1

1 System - 44 Benchmark Results

Intel Xeon E-2288G - Compulab SBC-ATCFL v1.2 - Intel Cannon Lake PCH

Ubuntu 19.10 - 5.3.0-64-generic - GNOME Shell 3.34.1

1 System - 6 Benchmark Results

AMD Ryzen 5 3400G - ASUS PRIME B450M-K - AMD Raven

Ubuntu 20.04 - 5.4.0-52-generic - KDE Plasma 5.18.5

1 System - 44 Benchmark Results

Intel Xeon E-2288G - Compulab SBC-ATCFL v1.2 - Intel Cannon Lake PCH

Ubuntu 19.10 - 5.3.0-64-generic - GNOME Shell 3.34.1

1 System - 43 Benchmark Results

Intel Xeon E-2288G - Compulab SBC-ATCFL v1.2 - Intel Cannon Lake PCH

Ubuntu 19.10 - 5.3.0-64-generic - GNOME Shell 3.34.1

1 System - 290 Benchmark Results

AMD Ryzen 9 3950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship

Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4

Most Popular Test Results

Compare

3 Systems - 268 Benchmark Results

Intel Core i5-2520M - HP 161C - Intel 2nd Generation Core DRAM

Ubuntu 18.04 - 4.18.0-20-generic - GNOME Shell 3.28.3

2 Systems - 178 Benchmark Results

AMD Ryzen Threadripper 1950X 16-Core - Gigabyte X399 AORUS Gaming 7 - AMD Family 17h

Ubuntu 18.04 - 4.15.2-041502-generic - GNOME Shell 3.26.2

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.9.0-6-amd64 - GCC 6.3.0 20170516

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.9.0-6-amd64 - GCC 6.3.0 20170516

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.9.0-6-amd64 - GCC 6.3.0 20170516

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.9.0-6-amd64 - GCC 6.3.0 20170516

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.17.4-xanmod4 - GCC 6.3.0 20170516

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.17.4-xanmod4 - GCC 6.3.0 20170516

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.17.4-xanmod4 - GCC 6.3.0 20170516

1 System - 22 Benchmark Results

Intel Xeon E3-1225 v3 - Microsoft Virtual Machine v7.0 - Intel 440BX

Debian 9.4 - 4.17.4-xanmod4 - GCC 6.3.0 20170516

8 Systems - 360 Benchmark Results

AMD Ryzen Threadripper 2970WX 24-Core - Gigabyte X399 AORUS Gaming 7 - AMD 17h

Ubuntu 19.10 - 5.4.0-999-generic - GNOME Shell 3.34.1

1 System - 248 Benchmark Results

AMD Ryzen 9 3900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Device 1480

Ubuntu 18.04 - 5.2.0-999-generic - GNOME Shell 3.28.3

Find More Test Results


User Comments

Post A Comment