Announcement from Leela discord.
Long time community member and developer @dje has created a new chess engine that uses Leela Chess Zero networks. It appears much stronger than lc0 (see the performance test below). The build process is currently being worked on so please be patient while the community helps to make executables available to all for further testing.
We are likely to make this the new official Leela Chess Zero project engine if all goes well so feel free to ask questions about it in #help or aid development in #dev-public.
Link to source code on GitHub: https://discord.com/channels/4254194825 ... 0299791370
Quick performance test: https://discord.com/channels/4254194825 ... 9669066784
Thanks to dje for this wonderful late Christmas gift! gift
FYI, new engine is approx 2.3x faster than Lco!
+100 elo breakthrough in new rewritten Lco engine ( Ceres)
Moderators: hgm, Rebel, chrisw
-
- Posts: 708
- Joined: Mon Jan 16, 2012 6:34 am
-
- Posts: 708
- Joined: Mon Jan 16, 2012 6:34 am
Re: +100 elo breakthrough in new rewritten Lco engine ( Ceres)
Match of LC0 vs. Ceres (a new MCTS engine leveraging the LC0 backend)
LC0 version: lc0-v0.26.3, backend=cuda-fp16
LC0 options: 703810 with nncache=5000000, deumux backend (2 GPUs)
Ceres version: 0.8
Ceres options: default (also with 703810)
Hardware: dual Intel 6142 CPU with 2 A100 GPU
Time control: 120s+0.5s
Book: TCEC19
Tablebases: Syzygy 5+6 man
Adjudication: tablebases or 4 consecutive play both 350cp
Software: Ceres integrated tournament manager
Comment: These first published results for Ceres require independent community verification.
Comment: The realized NPS ratio of Ceres vs LC0 was 2.3 in this test.
Comment: Ceres strength is massively exaggerated in this unrealistic combination of small nets and big hardware.
Comment: Ceres will be released under GPL3 on Github on Dec 31, 2020 (today).
# PLAYER : RATING ERROR POINTS PLAYED (%) CFS(%) W D L D(%)
1 Ceres1 : 0.0 ---- 67.5 102 66 100 33 69 0 68
2 LC0_0 : -128.6 38.4 34.5 102 34 --- 0 69 33 68
White advantage = 107.97 +/- 20.04
LC0 version: lc0-v0.26.3, backend=cuda-fp16
LC0 options: 703810 with nncache=5000000, deumux backend (2 GPUs)
Ceres version: 0.8
Ceres options: default (also with 703810)
Hardware: dual Intel 6142 CPU with 2 A100 GPU
Time control: 120s+0.5s
Book: TCEC19
Tablebases: Syzygy 5+6 man
Adjudication: tablebases or 4 consecutive play both 350cp
Software: Ceres integrated tournament manager
Comment: These first published results for Ceres require independent community verification.
Comment: The realized NPS ratio of Ceres vs LC0 was 2.3 in this test.
Comment: Ceres strength is massively exaggerated in this unrealistic combination of small nets and big hardware.
Comment: Ceres will be released under GPL3 on Github on Dec 31, 2020 (today).
# PLAYER : RATING ERROR POINTS PLAYED (%) CFS(%) W D L D(%)
1 Ceres1 : 0.0 ---- 67.5 102 66 100 33 69 0 68
2 LC0_0 : -128.6 38.4 34.5 102 34 --- 0 69 33 68
White advantage = 107.97 +/- 20.04
-
- Posts: 5228
- Joined: Thu Mar 09, 2006 9:40 am
- Full name: Vincent Lejeune
Re: +100 elo breakthrough in new rewritten Lco engine ( Ceres)
Very good news for the chess community. Let s wait for more test.
-
- Posts: 231
- Joined: Thu Mar 09, 2006 12:51 am
- Location: Australia
Re: +100 elo breakthrough in new rewritten Lco engine ( Ceres)
Very nice/interesting news! Please post on the normal Leela forum as more becomes clearer!
Andrew
Andrew
-
- Posts: 1342
- Joined: Wed Mar 08, 2006 9:41 pm
- Location: Morgantown, WV, USA
Re: +100 elo breakthrough in new rewritten Lco engine ( Ceres)
That's wonderful news, my main concern is that lc0 is relatively portable. Heck you can compile it on a Raspberry Pi.
When I looked at Ceres earlier it was VERY much Windows only.
Can it not exist as its own engine and let lc0 continue its efforts?
When I looked at Ceres earlier it was VERY much Windows only.
Can it not exist as its own engine and let lc0 continue its efforts?
-
- Posts: 12540
- Joined: Wed Mar 08, 2006 8:57 pm
- Location: Redmond, WA USA
Re: +100 elo breakthrough in new rewritten Lco engine ( Ceres)
I collected and built Ceres on my system (after installing git and .NET SDK 5.0.1).
Any help on configuration?
I am not sure I understand the questions it is asking me, like "path to LC0"
I thought this thing was a replacement for LC0.
Any help on configuration?
I am not sure I understand the questions it is asking me, like "path to LC0"
I thought this thing was a replacement for LC0.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
-
- Posts: 12540
- Joined: Wed Mar 08, 2006 8:57 pm
- Location: Redmond, WA USA
Re: +100 elo breakthrough in new rewritten Lco engine ( Ceres)
BTW, if you thought SF nnue versions were bloated with the embedded net, 500MB+ in the binary folder, and I did not even download a net yet.
Code: Select all
C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0>dir/s
Volume in drive C is Windows
Volume Serial Number is 9C44-3903
Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0
01/01/2021 01:40 AM <DIR> .
01/01/2021 01:40 AM <DIR> ..
01/01/2021 01:40 AM 24,520 Ceres.Base.deps.json
01/01/2021 01:40 AM 110,592 Ceres.Base.dll
01/01/2021 01:40 AM 56,728 Ceres.Base.pdb
01/01/2021 01:40 AM 83,479 Ceres.Chess.deps.json
01/01/2021 01:40 AM 550,400 Ceres.Chess.dll
01/01/2021 01:40 AM 152,364 Ceres.Chess.pdb
01/01/2021 01:40 AM 91,386 Ceres.deps.json
01/01/2021 01:40 AM 48,128 Ceres.dll
01/01/2021 01:40 AM 142,848 Ceres.exe
01/01/2021 01:40 AM 84,175 Ceres.Features.deps.json
01/01/2021 01:40 AM 73,728 Ceres.Features.dll
01/01/2021 01:40 AM 30,200 Ceres.Features.pdb
01/01/2021 01:40 AM 86,233 Ceres.MCTS.deps.json
01/01/2021 01:40 AM 178,688 Ceres.MCTS.dll
01/01/2021 01:40 AM 81,100 Ceres.MCTS.pdb
01/01/2021 01:40 AM 21,584 Ceres.pdb
01/01/2021 01:40 AM 214 Ceres.runtimeconfig.dev.json
01/01/2021 01:40 AM 300 Ceres.runtimeconfig.json
08/14/2020 03:35 PM 390,128 Google.Protobuf.dll
02/22/2015 02:00 PM 323,072 Google.ProtocolBuffers.dll
02/22/2015 02:00 PM 57,856 Google.ProtocolBuffers.Serialization.dll
11/11/2020 01:02 AM 160,768 HtmlAgilityPack.dll
12/11/2019 08:49 AM 420,352 LibGit2Sharp.dll
03/27/2020 04:46 AM 22,514,088 LINQPad.Runtime.dll
10/19/2020 05:48 PM 20,360 Microsoft.Extensions.Configuration.Abstractions.dll
10/19/2020 05:48 PM 28,040 Microsoft.Extensions.Configuration.Binder.dll
10/19/2020 05:49 PM 22,912 Microsoft.Extensions.Configuration.CommandLine.dll
10/19/2020 05:48 PM 30,600 Microsoft.Extensions.Configuration.dll
10/19/2020 05:49 PM 19,848 Microsoft.Extensions.Configuration.EnvironmentVariables.dll
10/19/2020 05:50 PM 25,480 Microsoft.Extensions.Configuration.FileExtensions.dll
10/19/2020 05:51 PM 24,960 Microsoft.Extensions.Configuration.Json.dll
10/19/2020 05:48 PM 44,416 Microsoft.Extensions.DependencyInjection.Abstractions.dll
10/19/2020 05:48 PM 74,120 Microsoft.Extensions.DependencyInjection.dll
10/19/2020 05:48 PM 16,776 Microsoft.Extensions.FileProviders.Abstractions.dll
10/19/2020 05:49 PM 35,720 Microsoft.Extensions.FileProviders.Physical.dll
10/19/2020 05:48 PM 39,304 Microsoft.Extensions.FileSystemGlobbing.dll
10/19/2020 05:48 PM 52,616 Microsoft.Extensions.Logging.Abstractions.dll
10/19/2020 05:50 PM 20,360 Microsoft.Extensions.Logging.Configuration.dll
10/19/2020 05:53 PM 49,544 Microsoft.Extensions.Logging.Console.dll
10/19/2020 05:49 PM 16,776 Microsoft.Extensions.Logging.Debug.dll
10/19/2020 05:53 PM 42,376 Microsoft.Extensions.Logging.dll
10/19/2020 05:53 PM 30,592 Microsoft.Extensions.Logging.EventSource.dll
10/19/2020 05:49 PM 18,816 Microsoft.Extensions.Options.ConfigurationExtensions.dll
10/19/2020 05:48 PM 54,664 Microsoft.Extensions.Options.dll
10/19/2020 05:48 PM 39,296 Microsoft.Extensions.Primitives.dll
10/12/2020 08:37 PM 106,376 Microsoft.ML.OnnxRuntime.dll
07/08/2020 06:26 AM 255,488 protobuf-net.Core.dll
07/08/2020 06:26 AM 255,488 protobuf-net.dll
01/01/2021 01:40 AM <DIR> ref
01/01/2021 01:40 AM <DIR> runtimes
07/26/2020 12:47 PM 539,136 SharpCompress.dll
11/15/2019 05:31 PM 2,318,920 System.Private.ServiceModel.dll
05/15/2018 12:29 PM 186,504 System.Security.Cryptography.Pkcs.dll
05/15/2018 12:29 PM 167,568 System.Security.Cryptography.Xml.dll
05/15/2018 12:29 PM 96,400 System.Security.Permissions.dll
11/15/2019 05:31 PM 23,624 System.ServiceModel.dll
11/15/2019 05:31 PM 21,576 System.ServiceModel.Primitives.dll
55 File(s) 30,361,587 bytes
Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\ref
01/01/2021 01:40 AM <DIR> .
01/01/2021 01:40 AM <DIR> ..
01/01/2021 01:40 AM 48,640 Ceres.Base.dll
01/01/2021 01:40 AM 201,728 Ceres.Chess.dll
01/01/2021 01:40 AM 12,288 Ceres.dll
01/01/2021 01:40 AM 18,432 Ceres.Features.dll
01/01/2021 01:40 AM 61,952 Ceres.MCTS.dll
5 File(s) 343,040 bytes
Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes
01/01/2021 01:40 AM <DIR> .
01/01/2021 01:40 AM <DIR> ..
01/01/2021 01:40 AM <DIR> alpine-x64
01/01/2021 01:40 AM <DIR> alpine.3.9-x64
01/01/2021 01:40 AM <DIR> debian-arm64
01/01/2021 01:40 AM <DIR> debian.9-x64
01/01/2021 01:40 AM <DIR> fedora-x64
01/01/2021 01:40 AM <DIR> linux-x64
01/01/2021 01:40 AM <DIR> osx
01/01/2021 01:40 AM <DIR> rhel-x64
01/01/2021 01:40 AM <DIR> ubuntu.16.04-arm64
01/01/2021 01:40 AM <DIR> ubuntu.18.04-x64
01/01/2021 01:40 AM <DIR> win
01/01/2021 01:40 AM <DIR> win-x64
01/01/2021 01:40 AM <DIR> win-x86
0 File(s) 0 bytes
Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\alpine-x64
01/01/2021 01:40 AM <DIR> .
01/01/2021 01:40 AM <DIR> ..
01/01/2021 01:40 AM <DIR> native
0 File(s) 0 bytes
Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\alpine-x64\native
01/01/2021 01:40 AM <DIR> .
01/01/2021 01:40 AM <DIR> ..
12/11/2019 07:38 AM 1,376,152 libgit2-106a5f2.so
1 File(s) 1,376,152 bytes
Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\alpine.3.9-x64
01/01/2021 01:40 AM <DIR> .
01/01/2021 01:40 AM <DIR> ..
01/01/2021 01:40 AM <DIR> native
0 File(s) 0 bytes
Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\alpine.3.9-x64\native
01/01/2021 01:40 AM <DIR> .
01/01/2021 01:40 AM <DIR> ..
12/11/2019 07:38 AM 1,332,656 libgit2-106a5f2.so
1 File(s) 1,332,656 bytes
Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\debian-arm64
01/01/2021 01:40 AM <DIR> .
01/01/2021 01:40 AM <DIR> ..
01/01/2021 01:40 AM <DIR> native
0 File(s) 0 bytes
Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\debian-arm64\native
01/01/2021 01:40 AM <DIR> .
01/01/2021 01:40 AM <DIR> ..
12/11/2019 07:38 AM 1,168,720 libgit2-106a5f2.so
1 File(s) 1,168,720 bytes
Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\debian.9-x64
01/01/2021 01:40 AM <DIR> .
01/01/2021 01:40 AM <DIR> ..
01/01/2021 01:40 AM <DIR> native
0 File(s) 0 bytes
Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\debian.9-x64\native
01/01/2021 01:40 AM <DIR> .
01/01/2021 01:40 AM <DIR> ..
12/11/2019 07:38 AM 1,353,824 libgit2-106a5f2.so
1 File(s) 1,353,824 bytes
Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\fedora-x64
01/01/2021 01:40 AM <DIR> .
01/01/2021 01:40 AM <DIR> ..
01/01/2021 01:40 AM <DIR> native
0 File(s) 0 bytes
Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\fedora-x64\native
01/01/2021 01:40 AM <DIR> .
01/01/2021 01:40 AM <DIR> ..
12/11/2019 07:38 AM 1,198,160 libgit2-106a5f2.so
1 File(s) 1,198,160 bytes
Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\linux-x64
01/01/2021 01:40 AM <DIR> .
01/01/2021 01:40 AM <DIR> ..
01/01/2021 01:40 AM <DIR> native
0 File(s) 0 bytes
Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\linux-x64\native
01/01/2021 01:40 AM <DIR> .
01/01/2021 01:40 AM <DIR> ..
12/11/2019 07:38 AM 1,351,713 libgit2-106a5f2.so
10/12/2020 03:03 PM 126,725,944 libonnxruntime.so
2 File(s) 128,077,657 bytes
Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\osx
01/01/2021 01:40 AM <DIR> .
01/01/2021 01:40 AM <DIR> ..
01/01/2021 01:40 AM <DIR> native
0 File(s) 0 bytes
Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\osx\native
01/01/2021 01:40 AM <DIR> .
01/01/2021 01:40 AM <DIR> ..
12/11/2019 07:38 AM 2,015,296 libgit2-106a5f2.dylib
1 File(s) 2,015,296 bytes
Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\rhel-x64
01/01/2021 01:40 AM <DIR> .
01/01/2021 01:40 AM <DIR> ..
01/01/2021 01:40 AM <DIR> native
0 File(s) 0 bytes
Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\rhel-x64\native
01/01/2021 01:40 AM <DIR> .
01/01/2021 01:40 AM <DIR> ..
12/11/2019 07:38 AM 1,283,600 libgit2-106a5f2.so
1 File(s) 1,283,600 bytes
Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\ubuntu.16.04-arm64
01/01/2021 01:40 AM <DIR> .
01/01/2021 01:40 AM <DIR> ..
01/01/2021 01:40 AM <DIR> native
0 File(s) 0 bytes
Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\ubuntu.16.04-arm64\native
01/01/2021 01:40 AM <DIR> .
01/01/2021 01:40 AM <DIR> ..
12/11/2019 07:38 AM 1,200,152 libgit2-106a5f2.so
1 File(s) 1,200,152 bytes
Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\ubuntu.18.04-x64
01/01/2021 01:40 AM <DIR> .
01/01/2021 01:40 AM <DIR> ..
01/01/2021 01:40 AM <DIR> native
0 File(s) 0 bytes
Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\ubuntu.18.04-x64\native
01/01/2021 01:40 AM <DIR> .
01/01/2021 01:40 AM <DIR> ..
12/11/2019 07:38 AM 1,394,448 libgit2-106a5f2.so
1 File(s) 1,394,448 bytes
Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\win
01/01/2021 01:40 AM <DIR> .
01/01/2021 01:40 AM <DIR> ..
01/01/2021 01:40 AM <DIR> lib
0 File(s) 0 bytes
Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\win\lib
01/01/2021 01:40 AM <DIR> .
01/01/2021 01:40 AM <DIR> ..
01/01/2021 01:40 AM <DIR> netcoreapp2.1
0 File(s) 0 bytes
Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\win\lib\netcoreapp2.1
01/01/2021 01:40 AM <DIR> .
01/01/2021 01:40 AM <DIR> ..
05/15/2018 12:29 PM 211,088 System.Security.Cryptography.Pkcs.dll
1 File(s) 211,088 bytes
Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\win-x64
01/01/2021 01:40 AM <DIR> .
01/01/2021 01:40 AM <DIR> ..
01/01/2021 01:40 AM <DIR> native
0 File(s) 0 bytes
Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\win-x64\native
01/01/2021 01:40 AM <DIR> .
01/01/2021 01:40 AM <DIR> ..
12/11/2019 07:38 AM 1,208,832 git2-106a5f2.dll
12/11/2019 07:38 AM 7,262,208 git2-106a5f2.pdb
10/12/2020 11:11 PM 160,691,592 onnxruntime.dll
10/12/2020 10:30 PM 2,478 onnxruntime.lib
10/12/2020 10:33 PM 187,215,872 onnxruntime.pdb
5 File(s) 356,380,982 bytes
Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\win-x86
01/01/2021 01:40 AM <DIR> .
01/01/2021 01:40 AM <DIR> ..
01/01/2021 01:40 AM <DIR> native
0 File(s) 0 bytes
Directory of C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0\runtimes\win-x86\native
01/01/2021 01:40 AM <DIR> .
01/01/2021 01:40 AM <DIR> ..
12/11/2019 07:38 AM 940,544 git2-106a5f2.dll
12/11/2019 07:38 AM 7,270,400 git2-106a5f2.pdb
2 File(s) 8,210,944 bytes
Total Files Listed:
79 File(s) 535,908,306 bytes
89 Dir(s) 598,914,244,608 bytes free
C:\Users\dannc\chess\Ceres-main\artifacts\release\net5.0>
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
-
- Posts: 215
- Joined: Sun Feb 24, 2008 2:08 am
Re: +100 elo breakthrough in new rewritten Lco engine ( Ceres)
Is there a link to github thanks.Nay Lin Tun wrote: ↑Fri Jan 01, 2021 5:34 am Announcement from Leela discord.
Long time community member and developer @dje has created a new chess engine that uses Leela Chess Zero networks. It appears much stronger than lc0 (see the performance test below). The build process is currently being worked on so please be patient while the community helps to make executables available to all for further testing.
We are likely to make this the new official Leela Chess Zero project engine if all goes well so feel free to ask questions about it in #help or aid development in #dev-public.
Link to source code on GitHub: https://discord.com/channels/4254194825 ... 0299791370
Quick performance test: https://discord.com/channels/4254194825 ... 9669066784
Thanks to dje for this wonderful late Christmas gift! gift
FYI, new engine is approx 2.3x faster than Lco!
-
- Posts: 291
- Joined: Wed May 08, 2013 6:49 am
-
- Posts: 253
- Joined: Mon Nov 16, 2020 12:13 pm
- Full name: Manuel Rivera
Re: +100 elo breakthrough in new rewritten Lco engine ( Ceres)
+1
Hope we'll get a Linux version soon.
Raspberry Pi4 bot : https://lichess.org/@/BetterAnalyze