LeelaChessZero

LeelaChessZero (lc0 / lczero) is a chess engine automated vian neural networks. This test profile can be used for OpenCL, CUDA + cuDNN, and BLAS (CPU-based) benchmarking.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark lczero.

Project Site

lczero.org

Source Repository

github.com

Test Created

12 January 2019

Last Updated

25 August 2021

Test Maintainer

Michael Larabel

Test Type

Processor

Average Install Time

1 Minute, 16 Seconds

Average Run Time

4 Minutes, 22 Seconds

Test Dependencies

C/C++ Compiler Toolchain + BLAS (Basic Linear Algebra Sub-Routine) + OpenCL + Meson Build System + Eigen + Zlib

Accolades

40k+ Downloads

Supported Platforms

* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
*** Test profile page view reporting began March 2021.
Data current as of 20 September 2021.

Revision History

pts/lczero-1.6.0 [View Source] Wed, 25 Aug 2021 14:55:01 GMT
Update against upstream LC0 v0.28 to workaround build issues on newer Linux distributions.

pts/lczero-1.5.1 [View Source] Sun, 27 Sep 2020 17:41:46 GMT
Limit max CPU threads to 64 to workaround upstream issue with lc0 bailing out otherwise.

pts/lczero-1.5.0 [View Source] Sun, 06 Sep 2020 14:18:27 GMT
Update against latest upstream along with updated network, add eigen as possible external dependency.

pts/lczero-1.4.0 [View Source] Thu, 30 Apr 2020 09:06:47 GMT
Update against lc0 0.25, use new network as old one was removed.

pts/lczero-1.3.0 [View Source] Fri, 10 Jan 2020 20:28:53 GMT
Update against latest lc0 v0.23.2 upstream, other test improvements.

pts/lczero-1.2.1 [View Source] Thu, 03 Oct 2019 14:07:11 GMT
Add Windows support.

pts/lczero-1.2.0 [View Source] Thu, 26 Sep 2019 16:49:44 GMT
Update against lczero upstream

pts/lczero-1.1.1 [View Source] Wed, 16 Jan 2019 05:41:40 GMT
Add zlib to external dependency list.

pts/lczero-1.1.0 [View Source] Tue, 15 Jan 2019 10:11:47 GMT
Set threads option always for CPU testing.

pts/lczero-1.0.1 [View Source] Sun, 13 Jan 2019 14:22:54 GMT
Allow CUDA and BLAS benchmarking back-end support.

pts/lczero-1.0.0 [View Source] Sat, 12 Jan 2019 20:10:43 GMT
Initial commit of lc0 / lczero chess benchmark using neural networks with GPU compute.

Suites Using This Test

Chess Test Suite

Machine Learning

CPU Massive

HPC - High Performance Computing

NVIDIA GPU Compute

Performance Metrics

Analyze Test Configuration:

LeelaChessZero 0.28

Backend: BLAS

OpenBenchmarking.org metrics for this test profile configuration based on 164 public results since 25 August 2021 with the latest data as of 23 September 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component

Percentile Rank

# Compatible Public Results

Nodes Per Second (Average)

2 x Intel Xeon Platinum 8280

98th

3478 ^{+/- 178}

2 x AMD EPYC 7763 64-Core

93rd

2327 ^{+/- 41}

Ampere ARMv8 Neoverse-N1 256-Core

87th

2188 ^{+/- 81}

Ampere Altra ARMv8 Neoverse-N1 160-Core

87th

2172 ^{+/- 104}

Intel Xeon Gold 6226R

86th

2020 ^{+/- 25}

AMD EPYC 72F3 8-Core

81st

1751 ^{+/- 30}

AMD Ryzen Threadripper 3990X 64-Core

80th

1650 ^{+/- 34}

Mid-Tier

75th

< 1331

AMD EPYC 7543 32-Core

75th

1315 ^{+/- 78}

AMD Ryzen Threadripper 3970X 32-Core

73rd

1243 ^{+/- 23}

Intel Core i9-10980XE

70th

1190 ^{+/- 19}

Intel Xeon E3-1275 v6

66th

908 ^{+/- 3}

2 x Intel Xeon Platinum 8380

65th

875 ^{+/- 31}

Intel Xeon E3-1270 v5

61st

784 ^{+/- 12}

Intel Core i7-10700T

59th

741 ^{+/- 21}

AMD Ryzen 5 5600G

55th

717 ^{+/- 15}

Median

50th

683

Intel Core i7-1065G7

50th

680 ^{+/- 69}

AMD Ryzen 9 3900XT 12-Core

50th

677 ^{+/- 26}

AMD Ryzen 7 5800X 8-Core

50th

673 ^{+/- 18}

Intel Xeon E3-1235L v5

44th

637 ^{+/- 13}

AMD Ryzen 7 5700G

43rd

622 ^{+/- 19}

AMD Ryzen 9 5950X 16-Core

41st

611 ^{+/- 59}

Intel Core i5-7600K

39th

600 ^{+/- 6}

Intel Core i7-8550U

34th

573 ^{+/- 10}

Intel Core i7-4770K

32nd

557 ^{+/- 12}

Intel Core i9-11900K

28th

533 ^{+/- 14}

AMD Ryzen 9 3950X 16-Core

26th

519 ^{+/- 19}

Low-Tier

25th

< 512

Intel Core i7-8565U

23rd

473 ^{+/- 9}

AMD Ryzen 5 4500U

21st

414 ^{+/- 24}

AMD Ryzen 7 4700U

20th

409 ^{+/- 18}

AMD Ryzen 9 5900HX

16th

370 ^{+/- 7}

AMD Ryzen 5 5500U

15th

360 ^{+/- 17}

Intel Core i5-11600K

12th

245 ^{+/- 7}

Intel Core i7-1165G7

9th

183 ^{+/- 23}

AMD FX-8150 Eight-Core

6th

143 ^{+/- 7}

AMD Ryzen 3 3200U

5th

132 ^{+/- 11}

ARMv8 Cortex-A72 4-Core

3rd

27 ^{+/- 2}

Based on OpenBenchmarking.org data, the selected test / test configuration (LeelaChessZero 0.28 - Backend: BLAS) has an average run-time of 13 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.4%.

7600k oktoberfest 4 Systems - 146 Benchmark Results	Intel Core i5-7600K - Gigabyte Z270M-D3H-CF - Intel Xeon E3-1200 v6 Ubuntu 20.04 - 5.9.0-050900rc7daily20200928-generic - GNOME Shell 3.36.4
4770k wiesn 4 Systems - 113 Benchmark Results	Intel Core i7-4770K - Gigabyte Z97-HD3 - Intel 4th Gen Core DRAM Ubuntu 20.10 - 5.8.0-55-generic - GNOME Shell 3.38.3
EPYC 72F3 September 2021 Featured Processor Comparison	AMD EPYC 72F3 8-Core
1270 sep 4 Systems - 145 Benchmark Results	Intel Xeon E3-1270 v5 - ASUS E3 PRO GAMING V5 - Intel Xeon E3-1200 v5 Ubuntu 20.10 - 5.8.0-53-generic - GNOME Shell 3.38.1
1275 sep 3 Systems - 68 Benchmark Results	Intel Xeon E3-1275 v6 - ASUS P10S-M WS - Intel Xeon E3-1200 v6 Ubuntu 20.04 - 5.9.0-050900rc8daily20201007-generic - X Server 1.20.8
5700G Wiesn 4 Systems - 66 Benchmark Results	AMD Ryzen 7 5700G - ASUS TUF GAMING B550M-PLUS - AMD Renoir Root Complex Ubuntu 21.10 - 5.14.0-rc7-amd-pstate-phx - GNOME Shell 40.2
gold sep 3 Systems - 192 Benchmark Results	2 x Intel Xeon Gold 5220R - TYAN S7106 - Intel Sky Lake-E DMI3 Registers Ubuntu 20.04 - 5.9.0-050900rc6-generic - GNOME Shell 3.36.4
Xeon Gold September 3 Systems - 170 Benchmark Results	Intel Xeon Gold 6226R - Supermicro X11SPL-F v1.02 - Intel Sky Lake-E DMI3 Registers Ubuntu 20.10 - 5.11.0-rc4-max-boost-inv-patch - GNOME Shell 3.38.1
Xeon Platinum 8280 2P September 5 Systems - 186 Benchmark Results	2 x Intel Xeon Platinum 8280 - GIGABYTE MD61-SC2-00 v01000100 - Intel Sky Lake-E DMI3 Registers Ubuntu 21.04 - 5.11.0-16-generic - GNOME Shell 3.38.4
teste2 1 System - 1 Benchmark Result	AMD FX-8300 Eight-Core - ASUS M5A78L-M LX/BR - 1 x 8192 MB Microsoft Windows 10 Pro Build 19043 - 10.0 - 27.20.1034.6
RTX 30 Compute September Featured Graphics Comparison	NVIDIA GeForce RTX 3070 8GB - NVIDIA GeForce RTX 3090 24GB
/tmp/pts_chess.txt 1 System - 7 Benchmark Results	AMD Ryzen 9 5950X 16-Core - Gigabyte B550 AORUS ELITE AX - AMD Starship Ubuntu 21.04 - 5.11.0-31-generic - KDE Plasma 5.21.4
Ubuntu 21.04 Rocket Lake 1 System - 117 Benchmark Results	Intel Core i9-11900K - ASUS ROG MAXIMUS XIII HERO - Intel Device 43ef Ubuntu 21.04 - 5.11.0-31-generic - GNOME Shell 3.38.4
cmsgpu01-el7-gcc10 1 System - 19 Benchmark Results	AMD EPYC 7402P 24-Core - Supermicro H12SSW-NT v1.01 - AMD Starship CentOS 7.9.2009 - 5.13.12-1.el7.elrepo.x86_64 - X Server 1.19.2
g37n01-el7-gcc10 1 System - 19 Benchmark Results	2 x AMD EPYC 7313 16-Core - Supermicro H12DSU-iN v1.01 - AMD Starship CentOS 7.9.2009 - 5.13.12-1.el7.elrepo.x86_64 - X Server 1.19.2

lczero-onnx-core-i7 3 Systems - 7 Benchmark Results	Intel Core i7-10700T - Logic Supply RXM-181 - Intel Comet Lake PCH Ubuntu 21.04 - 5.11.0-25-generic - GNOME Shell 3.38.4
Ampere Altra 2 Systems - 16 Benchmark Results	Ampere Altra ARMv8 Neoverse-N1 - WIWYNN Mt.Jade - Ampere Computing LLC Altra PCI Root Complex A Ubuntu 21.04 - 5.11.0-25-generic - 1.0.2
10980xe-eo-aug 5 Systems - 10 Benchmark Results	Intel Core i9-10980XE - ASRock X299 Steel Legend - Intel Sky Lake-E DMI3 Registers Ubuntu 21.04 - 5.11.0-25-generic - GNOME Shell 3.38.4
epyc-7763-august 3 Systems - 55 Benchmark Results	2 x AMD EPYC 7763 64-Core - AMD DAYTONA_X - AMD Starship Ubuntu 20.10 - 5.8.0-29-generic - X Server 1.20.8
3900XT EO August 4 Systems - 10 Benchmark Results	AMD Ryzen 9 3900XT 12-Core - MSI MEG X570 GODLIKE - AMD Starship Ubuntu 20.10 - 5.11.0-rc1-phx - GNOME Shell 3.38.1
11600K tests 8 Systems - 11 Benchmark Results	AMD Ryzen 5 5600G - ASUS TUF GAMING B550M-PLUS - AMD Renoir Root Complex Ubuntu 21.04 - 5.11.0-31-generic - GNOME Shell 3.38.4
5800X EO August 5 Systems - 11 Benchmark Results	AMD Ryzen 7 5800X 8-Core - ASRock X570 Pro4 - AMD Starship Ubuntu 20.10 - 5.12.0-rc5-nopsf - GNOME Shell 3.38.1
5700G Wiesn 4 Systems - 66 Benchmark Results	AMD Ryzen 7 5700G - ASUS TUF GAMING B550M-PLUS - AMD Renoir Root Complex Ubuntu 21.10 - 5.14.0-rc7-amd-pstate-phx - GNOME Shell 40.2
3950X August 4 Systems - 26 Benchmark Results	AMD Ryzen 9 3950X 16-Core - ASUS ROG CROSSHAIR VII HERO - AMD Starship Ubuntu 20.04 - 5.9.0-050900rc6daily20200922-generic - GNOME Shell 3.36.4
ryzen-7-5700g-linux-benchmarks 8 Systems - 267 Benchmark Results	AMD Ryzen 7 5700G - ASUS TUF GAMING B550M-PLUS - AMD Renoir Root Complex Ubuntu 21.04 - 5.11.0-25-generic - GNOME Shell 3.38.4
EO August EPYC 7543 4 Systems - 31 Benchmark Results	AMD EPYC 7543 32-Core - TYAN S8036GM2NE-LE - AMD Starship Ubuntu 21.04 - 5.11.0-25-generic - GNOME Shell 3.38.4
1275 sep 3 Systems - 68 Benchmark Results	Intel Xeon E3-1275 v6 - ASUS P10S-M WS - Intel Xeon E3-1200 v6 Ubuntu 20.04 - 5.9.0-050900rc8daily20201007-generic - X Server 1.20.8
Windows 10 Benchmarks GeForce Ryzen Featured OS Comparison	AMD Ryzen 9 5900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - 2 x 8192 MB 3600MHz F4-3600C16-8GTRG Microsoft Windows 10 Pro Build 19043 - 10.0 - 471.68
Ubuntu 21.04 vs. 21.10 On Intel Rocket Lake 2 Systems - 117 Benchmark Results	Intel Core i9-11900K - ASUS ROG MAXIMUS XIII HERO - Intel Device 43ef Ubuntu 21.04 - 5.11.0-31-generic - GNOME Shell 3.38.4
3970X Aug 3 Systems - 10 Benchmark Results	AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship Ubuntu 20.10 - 5.11.0-rc6-phx - GNOME Shell 3.38.1

LeelaChessZero

Project Site

Source Repository

Test Created

Last Updated

Test Maintainer

Test Type

Average Install Time

Average Run Time

Test Dependencies

Accolades

Supported Platforms

Revision History

Suites Using This Test

Performance Metrics

LeelaChessZero 0.28

Backend: BLAS

Recent Test Results

Most Popular Test Results