LeelaChessZero

LeelaChessZero (lc0 / lczero) is a chess engine automated vian neural networks. This test profile currently is just designed for testing the program's OpenCL back-end.

Learn more about this test at the upstream project site: http://github.com/LeelaChessZero/lc0.

This benchmark test profile is maintained by Michael Larabel. This OpenBenchmarking.org test profile was created on 12 January 2019 and last updated on 27 September 2020. To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark lczero.

This test has an average install time of 19 seconds and an average run-time of 4 minutes, 22 seconds.

30k+ Downloads

Installation StatsTest Completion StatsOpenBenchmarking.orgEventsLeelaChessZero Popularitypts/lczero2019.012019.022019.032019.042019.052019.062019.072019.082019.092019.102019.112019.122020.012020.022020.032020.042020.052020.062020.072020.082020.09130260390520650

* Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting.

Random22.7%OpenCL16.9%BLAS29.9%Eigen30.4%Backend Option PopularityOpenBenchmarking.org

Revision History

pts/lczero-1.5.1   [View Source]   27 Sep 2020 17:41 EDT
Limit max CPU threads to 64 to workaround upstream issue with lc0 bailing out otherwise.

pts/lczero-1.5.0   [View Source]   06 Sep 2020 14:18 EDT
Update against latest upstream along with updated network, add eigen as possible external dependency.

pts/lczero-1.4.0   [View Source]   30 Apr 2020 09:06 EDT
Update against lc0 0.25, use new network as old one was removed.

pts/lczero-1.3.0   [View Source]   10 Jan 2020 20:28 EST
Update against latest lc0 v0.23.2 upstream, other test improvements.

pts/lczero-1.2.1   [View Source]   03 Oct 2019 14:07 EDT
Add Windows support.

pts/lczero-1.2.0   [View Source]   26 Sep 2019 16:49 EDT
Update against lczero upstream

pts/lczero-1.1.1   [View Source]   16 Jan 2019 05:41 EST
Add zlib to external dependency list.

pts/lczero-1.1.0   [View Source]   15 Jan 2019 10:11 EST
Set threads option always for CPU testing.

pts/lczero-1.0.1   [View Source]   13 Jan 2019 14:22 EST
Allow CUDA and BLAS benchmarking back-end support.

pts/lczero-1.0.0   [View Source]   12 Jan 2019 20:10 EST
Initial commit of lc0 / lczero chess benchmark using neural networks with GPU compute.

Suites Using This Test

Chess Test Suite

Machine Learning

CPU Massive

NVIDIA GPU Compute

Performance Metrics

Analyze Test Configuration:

LeelaChessZero 0.26

Backend: Eigen

OpenBenchmarking.org metrics for this test profile configuration based on 351 public samples since 6 September 2020 with the latest data as of 29 October 2020.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component
Percentile Rank
Nodes Per Second (Average)
Mid-Tier
75th
< 994
Median
50th
758
Low-Tier
25th
< 516
OpenBenchmarking.orgDistribution Of Public Results - Backend: Eigen351 Results Range From 140 To 7402 Nodes Per Second1402864325787248701016116213081454160017461892203821842330247626222768291430603206335234983644379039364082422843744520466648124958510452505396554256885834598061266272641865646710685670027148729474401428425670

Based on OpenBenchmarking.org data, the selected test / test configuration (LeelaChessZero 0.26 - Backend: Eigen) has an average run-time of 20 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

OpenBenchmarking.orgMinutesTime Required To Complete BenchmarkBackend: EigenRun-Time1020304050Min: 17 / Avg: 19.24 / Max: 47

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 1.1%.

OpenBenchmarking.orgPercent, Fewer Is BetterAverage Deviation Between RunsBackend: EigenDeviation246810Min: 0 / Avg: 1.09 / Max: 4

Recent Test Results

Compare

2 Systems - 520 Benchmark Results

Intel Core i7-9700TE - C OZE GM-1000 v0.0.01.001 - Intel Cannon Lake PCH

Ubuntu 20.10 - 5.8.0-25-generic - GNOME Shell 3.38.1

3 Systems - 536 Benchmark Results

Intel Core i7-9700TE - C OZE GM-1000 v0.0.01.001 - Intel Cannon Lake PCH

Ubuntu 20.10 - 5.8.0-25-generic - GNOME Shell 3.38.1

3 Systems - 56 Benchmark Results

Intel Core i7-9700TE - C OZE GM-1000 v0.0.01.001 - Intel Cannon Lake PCH

Ubuntu 20.10 - 5.8.0-25-generic - GNOME Shell 3.38.1

3 Systems - 56 Benchmark Results

Intel Core i7-9700TE - C OZE GM-1000 v0.0.01.001 - Intel Cannon Lake PCH

Ubuntu 20.10 - 5.8.0-25-generic - GNOME Shell 3.38.1

1 System - 56 Benchmark Results

Intel Core i7-9700TE - C OZE GM-1000 v0.0.01.001 - Intel Cannon Lake PCH

Ubuntu 20.10 - 5.8.0-25-generic - GNOME Shell 3.38.1

1 System - 1 Benchmark Result

AMD Ryzen 5 2600 Six-Core - Gigabyte B450M DS3H-CF - 1 x 8192 MB 2400MHz Unknown

Microsoft Windows 10 Home Build 19041 - 10.0 - 27.20.12033.1007

1 System - 7 Benchmark Results

AMD Ryzen 7 2700X Eight-Core - ASUS PRIME X470-PRO - AMD 17h

Ubuntu 20.04 - 5.4.0-52-generic - GNOME Shell 3.36.4

1 System - 295 Benchmark Results

AMD Ryzen Threadripper 3990X 64-Core - System76 Thelio Major - AMD Starship

Pop 20.04 - 5.4.0-7642-generic - GNOME Shell 3.36.4

1 System - 4 Benchmark Results

AMD Ryzen 5 3500U - LENOVO LNVNB161216 - AMD Raven

Ubuntu 20.04 - 5.8.0-23-generic - GNOME Shell 3.36.4

Most Popular Test Results

Compare

14 Systems - 3 Benchmark Results

AMD Ryzen Threadripper 3990X 64-Core - System76 Thelio Major - AMD Starship

Ubuntu 20.04 - 5.4.0-45-generic - GNOME Shell 3.36.3

3 Systems - 131 Benchmark Results

Intel Core i5-10600K - ASUS PRIME Z490M-PLUS - Intel Comet Lake PCH

Ubuntu 20.04 - 5.4.0-45-generic - GNOME Shell 3.36.4

3 Systems - 202 Benchmark Results

Intel Core i7-7700K - MSI Z270-A PRO - Intel Xeon E3-1200 v6

Ubuntu 20.04 - 5.8.14-050814-generic - GNOME Shell 3.36.4

3 Systems - 171 Benchmark Results

Intel Xeon E3-1270 v5 - ASUS E3 PRO GAMING V5 - Intel Xeon E3-1200 v5

Clear Linux OS 31470 - 5.3.8-854.native - GNOME Shell 3.34.1

3 Systems - 23 Benchmark Results

AMD Ryzen Threadripper 2970WX 24-Core - Gigabyte X399 AORUS Gaming 7 - AMD 17h

Ubuntu 20.04 - 5.9.0-050900rc6daily20200926-generic - GNOME Shell 3.36.4

3 Systems - 100 Benchmark Results

AMD Ryzen Threadripper 3990X 64-Core - System76 Thelio Major - AMD Starship

Ubuntu 20.04 - 5.4.0-47-generic - GNOME Shell 3.36.4

3 Systems - 39 Benchmark Results

Intel Core i7-8700K - ASUS TUF Z370-PLUS GAMING - Intel 8th Gen Core

Ubuntu 20.04 - 5.9.0-050900rc6daily20200923-generic - GNOME Shell 3.36.4

3 Systems - 119 Benchmark Results

Intel Core i9-7980XE - ASUS PRIME X299-A - Intel Sky Lake-E DMI3 Registers

Ubuntu 20.04 - 5.4.0-40-generic - GNOME Shell 3.36.1

3 Systems - 147 Benchmark Results

AMD Ryzen 7 3800XT 8-Core - ASRock X570 Pro4 - AMD Starship

Ubuntu 20.04 - 5.8.0-050800-generic - GNOME Shell 3.36.1

3 Systems - 114 Benchmark Results

AMD Ryzen 7 1800X Eight-Core - MSI X370 XPOWER GAMING TITANIUM - AMD 17h

Ubuntu 20.10 - 5.8.0-21-generic - GNOME Shell 3.38.0

4 Systems - 7 Benchmark Results

AMD Ryzen Threadripper 3960X 24-Core - MSI Creator TRX40 - AMD Starship

Ubuntu 20.04 - 5.9.0-rc5-14sep-patch - GNOME Shell 3.36.4

Find More Test Results


User Comments

Post A Comment