LeelaChessZero

LeelaChessZero (lc0 / lczero) is a chess engine automated vian neural networks. This test profile can be used for OpenCL, CUDA + cuDNN, and BLAS (CPU-based) benchmarking.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark lczero.

Project Site

lczero.org

Source Repository

github.com

Test Created

12 January 2019

Last Updated

11 August 2024

Test Maintainer

Michael Larabel

Test Type

Processor

Average Install Time

1 Minute, 34 Seconds

Average Run Time

4 Minutes, 8 Seconds

Test Dependencies

C/C++ Compiler Toolchain + BLAS (Basic Linear Algebra Sub-Routine) + OpenCL + Meson Build System + Eigen + Zlib

Accolades

150k+ Downloads

Supported Platforms

* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
*** Test profile page view reporting began March 2021.
Data updated weekly as of 14 October 2024.

Revision History

pts/lczero-1.8.0 [View Source] Sun, 11 Aug 2024 10:10:22 GMT
Update against lc0 v0.31.1 upstream.

pts/lczero-1.7.0 [View Source] Sat, 16 Dec 2023 06:59:59 GMT
Update against lczero v0.30 upstream.

pts/lczero-1.6.0 [View Source] Wed, 25 Aug 2021 14:55:01 GMT
Update against upstream LC0 v0.28 to workaround build issues on newer Linux distributions.

pts/lczero-1.5.1 [View Source] Sun, 27 Sep 2020 17:41:46 GMT
Limit max CPU threads to 64 to workaround upstream issue with lc0 bailing out otherwise.

pts/lczero-1.5.0 [View Source] Sun, 06 Sep 2020 14:18:27 GMT
Update against latest upstream along with updated network, add eigen as possible external dependency.

pts/lczero-1.4.0 [View Source] Thu, 30 Apr 2020 09:06:47 GMT
Update against lc0 0.25, use new network as old one was removed.

pts/lczero-1.3.0 [View Source] Fri, 10 Jan 2020 20:28:53 GMT
Update against latest lc0 v0.23.2 upstream, other test improvements.

pts/lczero-1.2.1 [View Source] Thu, 03 Oct 2019 14:07:11 GMT
Add Windows support.

pts/lczero-1.2.0 [View Source] Thu, 26 Sep 2019 16:49:44 GMT
Update against lczero upstream

pts/lczero-1.1.1 [View Source] Wed, 16 Jan 2019 05:41:40 GMT
Add zlib to external dependency list.

pts/lczero-1.1.0 [View Source] Tue, 15 Jan 2019 10:11:47 GMT
Set threads option always for CPU testing.

pts/lczero-1.0.1 [View Source] Sun, 13 Jan 2019 14:22:54 GMT
Allow CUDA and BLAS benchmarking back-end support.

pts/lczero-1.0.0 [View Source] Sat, 12 Jan 2019 20:10:43 GMT
Initial commit of lc0 / lczero chess benchmark using neural networks with GPU compute.

Suites Using This Test

Chess Test Suite

Machine Learning

HPC - High Performance Computing

CPU Massive

NVIDIA GPU Compute

Performance Metrics

Analyze Test Configuration:

LeelaChessZero 0.30

Backend: BLAS

OpenBenchmarking.org metrics for this test profile configuration based on 162 public results since 16 December 2023 with the latest data as of 14 June 2024.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component

Percentile Rank

# Compatible Public Results

Nodes Per Second (Average)

AMD Ryzen Threadripper PRO 7995WX 96-Cores

99th

864 ^{+/- 23}

2 x AMD EPYC 9684X 96-Core

99th

862 ^{+/- 10}

AMD Ryzen Threadripper 7980X 64-Cores

93rd

524 ^{+/- 21}

AMD EPYC 8534PN 64-Core

87th

331 ^{+/- 21}

AMD Ryzen 9 7950X 16-Core

81st

209 ^{+/- 4}

AMD Ryzen Threadripper PRO 5965WX 24-Cores

80th

208 ^{+/- 24}

AMD Ryzen 5 8600G

79th

184

Mid-Tier

75th

< 180

AMD Ryzen 5 8500G

72nd

161 ^{+/- 1}

AMD EPYC 7F32 8-Core

68th

132 ^{+/- 2}

AMD Ryzen Threadripper 3990X 64-Core

64th

115 ^{+/- 4}

Intel Core i9-10980XE

60th

104 ^{+/- 4}

AMD Ryzen 7 7840U

58th

Intel Core i7-1165G7

52nd

70 ^{+/- 6}

INTEL XEON PLATINUM 8592

51st

67 ^{+/- 1}

Median

50th

Intel Core i7-1185G7

47th

62 ^{+/- 1}

ARMv8 Neoverse-N1 128-Core

44th

61 ^{+/- 2}

AMD Ryzen 7 4700U

43rd

60 ^{+/- 1}

Intel Core i9-14900K

38th

49 ^{+/- 3}

AMD Ryzen 7 PRO 6850U

30th

42 ^{+/- 2}

Intel Xeon Silver 4216

27th

37 ^{+/- 1}

Intel Core i7-8565U

26th

Low-Tier

25th

< 34

AMD Ryzen 9 5900HX

21st

31 ^{+/- 2}

AMD Ryzen 7 PRO 5850U

21st

Intel Core i3-14100

17th

Intel Core i5-14500

14th

Based on OpenBenchmarking.org data, the selected test / test configuration (LeelaChessZero 0.30 - Backend: BLAS) has an average run-time of 32 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 1.1%.

Notable Instruction Set Usage

Notable instruction set extensions supported by this test, based on an automatic analysis by the Phoronix Test Suite / OpenBenchmarking.org analytics engine.

Instruction Set

Support

Instructions Detected

SSE 4.2 (SSE4_2)

Used by default on supported hardware.
Found on Intel processors since at least 2010.
Found on AMD processors since Bulldozer (2011).

POPCNT

Advanced Vector Extensions (AVX)

Used by default on supported hardware.
Found on Intel processors since Sandy Bridge (2011).
Found on AMD processors since Bulldozer (2011).

VZEROUPPER VBROADCASTSS VEXTRACTF128 VPERMILPS VINSERTF128 VPERM2F128

Advanced Vector Extensions 2 (AVX2)

Used by default on supported hardware.
Found on Intel processors since Haswell (2013).
Found on AMD processors since Excavator (2016).

VPBROADCASTQ VINSERTI128 VEXTRACTI128 VPBROADCASTW VPBROADCASTD VPSLLVQ VPERMPS VPERM2I128 VPERMQ VPERMD

Advanced Vector Extensions 512 (AVX512)

Used by default on supported hardware.

(ZMM REGISTER USE)

FMA (FMA)

Used by default on supported hardware.
Found on Intel processors since Haswell (2013).
Found on AMD processors since Bulldozer (2011).

VFMADD132SD VFMADD231SD VFMADD213SD VFNMADD132SD VFMADD132SS VFNMADD132SS VFMSUB132SS VFMADD213SS VFMADD231SS VFNMSUB231SS VFNMADD213SS VFNMSUB132SS VFMSUB231SS VFNMADD213SD VFMADD132PS VFMADD231PS VFMADD213PS VFNMADD231SS

The test / benchmark does honor compiler flag changes.

Last automated analysis: 23 August 2024

This test profile binary relies on the shared libraries libopenblas.so.0, libOpenCL.so.1, libz.so.1, libm.so.6, libc.so.6, libgfortran.so.5, libquadmath.so.0.

Tested CPU Architectures

This benchmark has been successfully tested on the below mentioned architectures. The CPU architectures listed is where successful OpenBenchmarking.org result uploads occurred, namely for helping to determine if a given test is compatible with various alternative CPU architectures.

CPU Architecture

Kernel Identifier

Verified On

Intel / AMD x86 64-bit

x86_64

(Many Processors)

ARMv8 64-bit

aarch64

ARMv8 Cortex-A72 4-Core, ARMv8 Cortex-A76 4-Core, ARMv8 Neoverse-N1 128-Core, Rockchip ARMv8 Cortex-A76 4-Core, rk1-mainline-emmc, rk1-mainline-nvme, rk1-rok-emmc

5600G-Vega56-Chess 3 Systems - 7 Benchmark Results	AMD Ryzen 5 5600G - MSI B450M-A PRO MAX II - AMD Renoir Arch rolling - 6.9.8-zen1-1-zen - Sway 1.9
TR7970X_Friday 1 System - 389 Benchmark Results	AMD Ryzen Threadripper 7970X 32-Cores - ASRock TRX50 WS - AMD Device 14a4 Debian 12 - 6.1.0-22-amd64 - GNOME Shell 43.9
5600G-Vega56-Chess 1 System - 7 Benchmark Results	AMD Ryzen 5 5600G - MSI B450M-A PRO MAX II - AMD Renoir Arch rolling - 6.9.8-zen1-1-zen - Sway 1.9
Infinite-Premium-machine-learning 2024-06-14-14-49 1 System - 3 Benchmark Results	Intel Xeon W-3235 - Blade ShadowM - 2 x 16384 MB 2400MHz Blade V8BJQ2WFBLVEGY-Y6C Microsoft Windows 10 Home Build 19045 - 10.0.19045.4529 - 546.29
11800h 1 System - 1 Benchmark Result	Intel Core i7-11800H - Intel LAPKC71F - 2 x 16384 MB 2933MHz WAR4S3200D22161C Microsoft Windows 10 LTSC Build 19044 - 10.0.19044.1288 - 496.04
CATGRANDFATHER 1 System - 5 Benchmark Results	Intel Core i7-11700K - Notebook X170KM-G - 2 x 16384MB 3067MHz SK Hynix HMAA2GS6CJR8N-XN Microsoft Windows 11 Build 22635 - 10.0.22635.3646 - 552.44
W11_23H2_x64_AMD64_AMD_3400G 1 System - 120 Benchmark Results	AMD Ryzen 5 3400G - HP 8643 - 2 x 16384 MB 2667MHz Unknown Microsoft Windows 11 Home Build 22631 - 10.0.22631.3672 - 31.0.21912.14
test1 1 System - 7 Benchmark Results	Intel Core i7-7700HQ - KBL Predator G3-571 Sienta_KLS - Intel Xeon E3-1200 v6 Pop 22.04 - 6.6.10-76060610-generic - GNOME Shell 42.5
8362-test 2 Systems - 3048 Benchmark Results
8362-test 1 System - 1858 Benchmark Results
8362-test 1 System - 1858 Benchmark Results
Power-Power-cpu-massive 2024-05-17-08-19 1 System - 97 Benchmark Results	AMD EPYC 7543P 32-Core - Blade ShadowM - 1 x 16384 MB 2400MHz Blade HBXJ6XKWQK7ML5-AWA Microsoft Windows 10 Famille Build 19045 - 10.0.19045.4412 - 546.29
Power-Power-cpu-massive 2024-05-16-17-26 1 System - 97 Benchmark Results	AMD EPYC 7543P 32-Core - Blade ShadowM - 1 x 16384 MB 2400MHz Blade HBXJ6XKWQK7ML5-AWA Microsoft Windows 10 Famille Build 19045 - 10.0.19045.4412 - 546.29
rok1 Featured Processor Comparison	rk1-rok-emmc - Rockchip ARMv8 Cortex-A76
rk1-mainline-nvme 1 System - 489 Benchmark Results	rk1-mainline-nvme - Turing Machines RK1 - 32GB Ubuntu 22.04 - 6.7.0 - 1.3.255

Intel Core Ultra 7 155H vs. AMD Ryzen 7 7840U Linux Benchmarks 2 Systems - 831 Benchmark Results	AMD Ryzen 7 7840U - Framework FRANMDCP07 - AMD Device 14e8 Ubuntu 23.10 - 6.7.0-060700rc5-generic - GNOME Shell 45.1
pi5-compilation 3 Systems - 415 Benchmark Results	ARMv8 Cortex-A76 - Raspberry Pi 5 Model B Rev 1.0 - 4096MB Debian 12 - 6.1.0-rpi7-rpi-2712 - GCC 12.2.0
2024 year 4 Systems - 100 Benchmark Results	AMD Ryzen Threadripper PRO 5965WX 24-Cores - ASUS Pro WS WRX80E-SAGE SE WIFI - AMD Starship Ubuntu 23.10 - 6.5.0-13-generic - GNOME Shell 45.0
New CPU Benchmarks 5 Systems - 587 Benchmark Results	Intel Core i5-14500 - ASUS PRIME Z790-P WIFI - Intel Raptor Lake-S PCH Ubuntu 23.10 - 6.7.3-060703-generic - GNOME Shell 45.2
fhos 3 Systems - 84 Benchmark Results	Intel Core i7-1165G7 - Dell 0GG9PT - Intel Tiger Lake-LP Ubuntu 23.10 - 6.5.0-10-generic - GNOME Shell 45.0
dfgg 2 Systems - 130 Benchmark Results	Intel Core i7-1065G7 - Dell 06CDVY - Intel Ice Lake-LP DRAM Ubuntu 23.04 - 6.2.0-36-generic - GNOME Shell 44.3
rok1 Featured Processor Comparison	Rockchip ARMv8 Cortex-A76 - Turing Machines RK1 - 32GB Ubuntu 22.04 - 5.10.160-rockchip - GCC 11.4.0
tgldec 2 Systems - 41 Benchmark Results	Intel Core i7-1185G7 - Dell 0DXP1F - Intel Tiger Lake-LP Ubuntu 22.04 - 6.2.0-36-generic - GNOME Shell 42.2
Linux Distros Emerald Rapids 4 Systems - 125 Benchmark Results	2 x INTEL XEON PLATINUM 8592+ - Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS - Intel Device 1bce Arch Linux - 6.7.6-arch1-2 - GCC 13.2.1 20230801
xeon jan 3 Systems - 69 Benchmark Results	Intel Xeon Silver 4216 - TYAN S7100AG2NR - Intel Sky Lake-E DMI3 Registers Debian 12 - 6.1.0-11-amd64 - X Server
cpu-bench 2 Systems - 390 Benchmark Results	ARMv8 Cortex-A76 - Mixtile Blade 3 v1.0.1 - 16GB Ubuntu 22.04 - 5.10.160-rockchip - GNOME Shell 42.9
rpyc jan 2 Systems - 262 Benchmark Results	AMD EPYC 7F32 8-Core - ASRockRack EPYCD8 - AMD Starship Debian 12 - 6.1.0-11-amd64 - X Server
xmas 3 Systems - 134 Benchmark Results	Intel Core i9-10980XE - ASRock X299 Steel Legend - Intel Sky Lake-E DMI3 Registers Ubuntu 22.04 - 6.2.0-36-generic - GNOME Shell 42.2
ddf 3 Systems - 137 Benchmark Results	AMD EPYC 8534PN 64-Core - AMD Cinnabar - AMD Device 14a4 Ubuntu 23.10 - 6.5.0-5-generic - GNOME Shell
rok1 Featured Processor Comparison	Rockchip ARMv8 Cortex-A76 - Turing Machines RK1 - 32GB Ubuntu 22.04 - 5.10.160-rockchip - GCC 11.4.0