LeelaChessZero

LeelaChessZero (lc0 / lczero) is a chess engine automated vian neural networks. This test profile can be used for OpenCL, CUDA + cuDNN, and BLAS (CPU-based) benchmarking.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark lczero.

Project Site

github.com

Test Created

12 January 2019

Last Updated

27 September 2020

Test Maintainer

Michael Larabel

Test Type

Processor

Average Install Time

1 Minute, 20 Seconds

Average Run Time

4 Minutes, 22 Seconds

Test Dependencies

C/C++ Compiler Toolchain + BLAS (Basic Linear Algebra Sub-Routine) + OpenCL + Meson Build System + Eigen + Zlib

Accolades

40k+ Downloads

Supported Platforms

* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
*** Test profile page view reporting began March 2021.
Data current as of 15 June 2021.

Revision History

pts/lczero-1.5.1 [View Source] Sun, 27 Sep 2020 17:41:46 GMT
Limit max CPU threads to 64 to workaround upstream issue with lc0 bailing out otherwise.

pts/lczero-1.5.0 [View Source] Sun, 06 Sep 2020 14:18:27 GMT
Update against latest upstream along with updated network, add eigen as possible external dependency.

pts/lczero-1.4.0 [View Source] Thu, 30 Apr 2020 09:06:47 GMT
Update against lc0 0.25, use new network as old one was removed.

pts/lczero-1.3.0 [View Source] Fri, 10 Jan 2020 20:28:53 GMT
Update against latest lc0 v0.23.2 upstream, other test improvements.

pts/lczero-1.2.1 [View Source] Thu, 03 Oct 2019 14:07:11 GMT
Add Windows support.

pts/lczero-1.2.0 [View Source] Thu, 26 Sep 2019 16:49:44 GMT
Update against lczero upstream

pts/lczero-1.1.1 [View Source] Wed, 16 Jan 2019 05:41:40 GMT
Add zlib to external dependency list.

pts/lczero-1.1.0 [View Source] Tue, 15 Jan 2019 10:11:47 GMT
Set threads option always for CPU testing.

pts/lczero-1.0.1 [View Source] Sun, 13 Jan 2019 14:22:54 GMT
Allow CUDA and BLAS benchmarking back-end support.

pts/lczero-1.0.0 [View Source] Sat, 12 Jan 2019 20:10:43 GMT
Initial commit of lc0 / lczero chess benchmark using neural networks with GPU compute.

Suites Using This Test

Chess Test Suite

Machine Learning

CPU Massive

HPC - High Performance Computing

NVIDIA GPU Compute

Performance Metrics

Analyze Test Configuration:

LeelaChessZero 0.26

Backend: Eigen

OpenBenchmarking.org metrics for this test profile configuration based on 665 public results since 6 September 2020 with the latest data as of 31 May 2021.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component

Percentile Rank

# Compatible Public Results

Nodes Per Second (Average)

2 x AMD EPYC 75F3 32-Core

100th

6274 ^{+/- 34}

2 x AMD EPYC 7763 64-Core

100th

4543 ^{+/- 153}

2 x AMD EPYC 7F72 24-Core

98th

4182 ^{+/- 268}

2 x AMD EPYC 7713 64-Core

97th

3927 ^{+/- 12}

2 x AMD EPYC 7F52 16-Core

96th

3649 ^{+/- 32}

AMD EPYC 7763 64-Core

95th

3543 ^{+/- 24}

AMD EPYC 7713 64-Core

94th

3107 ^{+/- 31}

AMD EPYC 75F3 32-Core

93rd

2888 ^{+/- 18}

2 x Intel Xeon Platinum 8280

92nd

2793 ^{+/- 373}

AMD EPYC 7742 64-Core

91st

2664 ^{+/- 12}

AMD EPYC 7662 64-Core

89th

2412 ^{+/- 10}

AMD EPYC 7642 48-Core

88th

2316 ^{+/- 10}

AMD EPYC 7F72 24-Core

86th

2120 ^{+/- 37}

AMD EPYC 7552 48-Core

85th

1931 ^{+/- 9}

2 x Intel Xeon Gold 5220R

84th

1873 ^{+/- 255}

AMD EPYC 7F52 16-Core

84th

1862 ^{+/- 189}

Intel Xeon Gold 6258R

84th

1861 ^{+/- 20}

Intel Xeon Platinum 8280

83rd

1815 ^{+/- 13}

2 x AMD EPYC 7262 8-Core

83rd

1786

AMD EPYC 7532 32-Core

82nd

1774 ^{+/- 11}

2 x AMD EPYC 7272 12-Core

80th

1683 ^{+/- 29}

AMD EPYC 7502P 32-Core

79th

1622 ^{+/- 111}

Ampere Altra ARMv8 Neoverse-N1 160-Core

79th

1622 ^{+/- 178}

AMD EPYC 7542 32-Core

79th

1621 ^{+/- 8}

2 x AMD EPYC 7601 32-Core

79th

1585 ^{+/- 12}

AMD EPYC 7402P 24-Core

77th

1523 ^{+/- 114}

Intel Xeon Gold 5220R

76th

1444

Mid-Tier

75th

< 1439

2 x AMD EPYC 7252 8-Core

75th

1408

AMD EPYC 7302P 16-Core

72nd

1245 ^{+/- 13}

AMD Ryzen Threadripper 3970X 32-Core

71st

1210 ^{+/- 19}

Intel Core i5-8400

69th

1149 ^{+/- 9}

AMD EPYC 7F32 8-Core

69th

1107 ^{+/- 6}

Intel Core i9-7960X

67th

1082 ^{+/- 6}

AMD EPYC 7282 16-Core

66th

1052 ^{+/- 2}

Intel Xeon E5-1680 v3

65th

1044 ^{+/- 5}

Intel Core i9-7980XE

65th

1032 ^{+/- 10}

Intel Core i5-10600K

64th

1001 ^{+/- 125}

Intel Core i7-11700K

63rd

993 ^{+/- 48}

AMD Ryzen Threadripper 3960X 24-Core

62nd

988 ^{+/- 13}

Intel Core i9-9900KS

61st

983 ^{+/- 9}

Intel Core i7-5960X

59th

951 ^{+/- 10}

Intel Core i5-11600K

59th

947

Intel Core i5-9400F

59th

947 ^{+/- 8}

AMD EPYC 7272 12-Core

58th

928 ^{+/- 7}

Intel Core i9-10980XE

56th

914 ^{+/- 16}

Intel Core i7-8700K

55th

909 ^{+/- 5}

Intel Core i3-8100

54th

900 ^{+/- 6}

Intel Xeon E5-2687W v3

54th

897 ^{+/- 17}

Intel Core i7-7700K

53rd

895 ^{+/- 16}

AMD Ryzen 5 5600X 6-Core

52nd

852

Median

50th

831

Intel Core i9-11900K

50th

823 ^{+/- 91}

Intel Xeon E3-1275 v6

48th

811 ^{+/- 6}

Intel Core i5-6500

47th

786 ^{+/- 26}

Intel Core i9-9900K

46th

766 ^{+/- 10}

Intel Core i7-9700TE

43rd

752 ^{+/- 18}

AMD Ryzen 7 5800X 8-Core

43rd

750

Intel Xeon E-2288G

43rd

747 ^{+/- 37}

AMD Ryzen 5 3600XT 6-Core

42nd

746 ^{+/- 23}

Intel Xeon E3-1245 v5

40th

712 ^{+/- 10}

Intel Core i7-9750H

40th

711 ^{+/- 69}

AMD EPYC 7601 32-Core

40th

694 ^{+/- 60}

Intel Xeon E3-1270 v5

39th

686 ^{+/- 4}

AMD Ryzen 3 3100 4-Core

39th

685 ^{+/- 41}

Intel Xeon E3-1235L v5

39th

684 ^{+/- 5}

Intel Xeon E3-1280 v5

39th

683 ^{+/- 3}

Intel Core i9-10885H

36th

650 ^{+/- 67}

AMD Ryzen 7 3700X 8-Core

35th

632 ^{+/- 9}

Intel Core i5-4670

35th

629 ^{+/- 13}

Intel Xeon E5-2609 v4

34th

628 ^{+/- 6}

AMD Ryzen 3 3300X 4-Core

33rd

620 ^{+/- 67}

AMD Ryzen 7 3800XT 8-Core

30th

596 ^{+/- 12}

Intel Xeon E3-1260L v5

29th

591 ^{+/- 2}

Intel Core i5-7600K

27th

543 ^{+/- 3}

Intel Core i9-10900K

26th

542 ^{+/- 44}

AMD Ryzen Threadripper 2970WX 24-Core

26th

534 ^{+/- 6}

Low-Tier

25th

< 531

AMD Ryzen 9 3900XT 12-Core

23rd

524 ^{+/- 4}

Intel Core i3-10100

22nd

521 ^{+/- 9}

AMD Ryzen 9 3900X 12-Core

22nd

519 ^{+/- 12}

Intel Core i7-6700HQ

19th

491 ^{+/- 5}

AMD Ryzen Threadripper 2990WX 32-Core

18th

471 ^{+/- 8}

AMD Ryzen 7 1800X Eight-Core

18th

449 ^{+/- 36}

AMD Ryzen 9 5950X 16-Core

16th

418 ^{+/- 55}

Intel Core i7-8550U

14th

404 ^{+/- 24}

AMD Ryzen 3 2200G

13th

399 ^{+/- 40}

Intel Core i7-1065G7

10th

388 ^{+/- 13}

Intel Core i7-8565U

10th

387 ^{+/- 16}

AMD Ryzen 7 2700X Eight-Core

10th

386 ^{+/- 9}

Intel Core i7-4558U

8th

300

Intel Core i7-5600U

7th

274 ^{+/- 31}

Intel Core i5-5300U

6th

260 ^{+/- 1}

Intel Core i7-3770K

6th

210 ^{+/- 2}

Intel Core i7-2700K

5th

205 ^{+/- 1}

AMD Ryzen 3 3200U

4th

143 ^{+/- 1}

AMD FX-8370 Eight-Core

3rd

138

AMD FX-8150 Eight-Core

2nd

108 ^{+/- 2}

Based on OpenBenchmarking.org data, the selected test / test configuration (LeelaChessZero 0.26 - Backend: Eigen) has an average run-time of 24 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 1.3%.

Does It Scale Well With Increasing Cores?

Yes, based on the automated analysis of the collected public benchmark data, this test / test settings does generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

WOICA0517 1 System - 17 Benchmark Results	Intel Pentium G4600 - FUJITSU D3433-S2 - Intel Xeon E3-1200 v6 Ubuntu 21.04 - 5.11.0-18-generic - GCC 10.3.0
cur_bm1 6 Systems - 7 Benchmark Results	AMD Ryzen 7 3700X 8-Core - ASUS ROG CROSSHAIR VIII IMPACT - AMD Starship Ubuntu 20.04 - 5.4.0-60-generic - KDE Plasma 5.18.5
cur_bm1 5 Systems - 7 Benchmark Results	AMD Ryzen 7 3700X 8-Core - ASUS ROG CROSSHAIR VIII IMPACT - AMD Starship Ubuntu 20.04 - 5.4.0-60-generic - KDE Plasma 5.18.5
vulkan20210606 1 System - 7 Benchmark Results	Intel Core i7-6700HQ - Acer Aspire VN7-792G - Intel Xeon E3-1200 v5 Pop 20.10 - 5.11.0-7614-generic - GNOME Shell 3.38.3
NVIDIA GPU Compute 1 System - 171 Benchmark Results	AMD Ryzen 9 5900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 21.04 - 5.11.0-17-generic - GNOME Shell 3.38.4
2021-05-31-0723 1 System - 3 Benchmark Results	2 x Intel Xeon E5-2630 0 - Supermicro X9DR3-F - Intel Xeon E5 Ubuntu 20.04 - 5.8.0-41-generic - X Server 1.20.9
Intel Core i5 11600K + Core i9 11900K Linux Performance 11 Systems - 454 Benchmark Results	AMD Ryzen 5 5600X 6-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 21.04 - 5.12.0-051200rc3daily20210315-generic - GNOME Shell 3.38.3
Windows 10 Threadripper 3990X 2 Systems - 109 Benchmark Results	AMD Eng Sample - Gigabyte TRX40 AORUS PRO WIFI - 4 x 32768 MB 3000MHz CMK64GX4M2D3000C16 Microsoft Windows 10 Pro Build 21382 - 10.0 - 27.20.21002.2004
Initial Intel Xeon Platinum 8380 2P Benchmarks 5 Systems - 259 Benchmark Results	2 x Intel Xeon Platinum 8380 - Intel M50CYP2SB2U - Intel Device 0998 Ubuntu 20.04 - 5.11.0-051100-generic - GNOME Shell 3.36.4
9900k may 2 Systems - 54 Benchmark Results	Intel Core i9-9900K - ASRock Z390M Pro4 - Intel Cannon Lake PCH Ubuntu 20.04 - 5.9.0-050900rc1daily20200819-generic - GNOME Shell 3.36.4
Windows 10 Tests 1 System - 124 Benchmark Results	AMD Ryzen 9 5900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - 2 x 8192 MB 3600MHz F4-3600C16-8GTRG Microsoft Windows 10 Pro Build 21370 - 10.0 - 466.27
ryzen3600x-chess 1 System - 6 Benchmark Results	AMD Ryzen 5 3600X 6-Core - ASUS TUF GAMING X570-PLUS - AMD Starship Arch Linux rolling - 5.11.16-arch1-1 - Xfce 4.16

Ubuntu 20.10 Kernels AMD Zen 3 6 Systems - 143 Benchmark Results	AMD Ryzen 9 5900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 20.10 - 5.10.7-xanmod1 - GNOME Shell 3.38.1
TR 3960X Okt 4 Systems - 7 Benchmark Results	AMD Ryzen Threadripper 3960X 24-Core - MSI Creator TRX40 - AMD Starship Ubuntu 20.04 - 5.9.0-rc5-14sep-patch - GNOME Shell 3.36.4
lczero Intel vs. AMD CPU Tests 14 Systems - 3 Benchmark Results	AMD Ryzen 7 3700X 8-Core - Gigabyte A320M-S2H-CF - AMD Starship Ubuntu 20.04 - 5.9.0-050900rc1daily20200817-generic - GNOME Shell 3.36.4
Intel Core i5 11600K + Core i9 11900K Linux Performance 8 Systems - 439 Benchmark Results	Intel Core i9-11900K - ASUS ROG MAXIMUS XIII HERO - Intel Tiger Lake-H Ubuntu 21.04 - 5.12.0-051200rc3daily20210315-generic - GNOME Shell 3.38.3
AMD EPYC 7F72 2P Linux 5.11 3 Systems - 376 Benchmark Results	2 x AMD EPYC 7F72 24-Core - Supermicro H11DSi-NT v2.00 - AMD Starship Ubuntu 20.10 - 5.11.0-051100rc4daily20210122-generic - GNOME Shell 3.38.1
Ryzen 3 2200G 2021 3 Systems - 191 Benchmark Results	AMD Ryzen 3 2200G - ASUS PRIME B350M-E - AMD Raven Ubuntu 20.10 - 5.8.0-38-generic - GNOME Shell 3.38.1
AMD EPYC 7003 Linux Benchmarks 26 Systems - 438 Benchmark Results	AMD Ryzen Threadripper PRO 3975WX 32-Cores - ASUS Pro WS WRX80E-SAGE SE WIFI - AMD Starship Fedora 33 - 5.11.10-200.fc33.x86_64 - GNOME Shell 3.38.4
Core i5 10600K October 3 Systems - 131 Benchmark Results	Intel Core i5-10600K - ASUS PRIME Z490M-PLUS - Intel Comet Lake PCH Ubuntu 20.04 - 5.4.0-45-generic - GNOME Shell 3.36.4
Ryzen 3 3300X Linux 5.9 Kernel Test Featured Kernel Comparison	AMD Ryzen 3 3300X 4-Core - MSI B350M GAMING PRO - AMD Starship Ubuntu 20.04 - 5.8.0-050800-generic - GNOME Shell 3.36.4
7700K Intel 2020 3 Systems - 202 Benchmark Results	Intel Core i7-7700K - MSI Z270-A PRO - Intel Xeon E3-1200 v6 Ubuntu 20.04 - 5.8.14-050814-generic - GNOME Shell 3.36.4
System76 Thelio Major 3990X Pop OS 2 Systems - 297 Benchmark Results	AMD Ryzen Threadripper 3990X 64-Core - System76 Thelio Major - AMD Starship Pop 20.04 - 5.4.0-7642-generic - GNOME Shell 3.36.4
AMD Ryzen 9 5950X Linux 5.11 Featured Kernel Comparison	AMD Ryzen 9 5950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 20.10 - 5.11.0-051100rc4daily20210121-generic - GNOME Shell 3.38.1

LeelaChessZero

Project Site

Test Created

Last Updated

Test Maintainer

Test Type

Average Install Time

Average Run Time

Test Dependencies

Accolades

Supported Platforms

Revision History

Suites Using This Test

Performance Metrics

LeelaChessZero 0.26

Backend: Eigen

Does It Scale Well With Increasing Cores?

Recent Test Results

Most Popular Test Results