Best Nets for Lc0 Page

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

User avatar
AdminX
Posts: 6339
Joined: Mon Mar 13, 2006 2:34 pm
Location: Acworth, GA

Best Nets for Lc0 Page

Post by AdminX »

"There is no single "best net" for Leela but there a few worth recommending for various purposes. The most important consideration in choosing a net is picking the right size for your hardware and time controls (TC). In general, if you have a weak GPU (or no GPU at all) and you want to only spend milliseconds per move, then you want a smaller net that evaluates positions more quickly, i.e. higher NPS (nodes per second). On the other hand, if you have an RTX card (or several) and you want to run an analysis on a single move for hours at a time, then the quality of the evaluation is more important than the speed and a larger (but slower) net is probably going to work best."

https://github.com/LeelaChessZero/lc0/w ... ts-for-Lc0
"Good decisions come from experience, and experience comes from bad decisions."
__________________________________________________________________
Ted Summers
User avatar
Ovyron
Posts: 4556
Joined: Tue Jul 03, 2007 4:30 am

Re: Best Nets for Lc0 Page

Post by Ovyron »

Anything better than 128x10.T17.6-swa-20000 for CPU Leela?

Any way to use GPU Leela in a GPU that doesn't support CUDA or OpenCL?
Hugo
Posts: 782
Joined: Tue Dec 01, 2009 11:10 am

Re: Best Nets for Lc0 Page

Post by Hugo »

Hi

I am searching a weightfile for a promising challenger against Stockfish.
Since 18 days, I started my tests again, 300 games, 5m+3s , ponder on.
4 matches already done, and I hope I do not loose my motivation and a lot of tests will follow.
https://docs.google.com/spreadsheets/d/ ... =609748570
I decided to use contempt=0 for Stockfish, for Leela its much harder to beat SF with contempt 0.

No challenger found yet ...

Code: Select all

   # PLAYER                          :  RATING  ERROR  POINTS  PLAYED   (%)  CFS(%)    W     D    L  D(%)
   1 Lc0 v0.22.0-leele11.1           :       0     14   150.0     300  50.0      50   16   268   16  89.3
   2 Stockfish 031219 64 BMI2-T13    :       0   ----   609.0    1200  50.8      62   91  1036   73  86.3
   3 Lc0 v0.22.0-sergio1207          :      -2     15   149.0     300  49.7      62   15   268   17  89.3
   4 Lc0 v0.22.0-T40.B4-160          :      -6     15   147.5     300  49.2      74   24   247   29  82.3
   5 Fat Fritz                       :     -13     15   144.5     300  48.2     ---   18   253   29  84.3
merry Christmas to all
C.K.
User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: Best Nets for Lc0 Page

Post by Laskos »

Hugo wrote: Tue Dec 24, 2019 11:08 am Hi

I am searching a weightfile for a promising challenger against Stockfish.
Since 18 days, I started my tests again, 300 games, 5m+3s , ponder on.
4 matches already done, and I hope I do not loose my motivation and a lot of tests will follow.
https://docs.google.com/spreadsheets/d/ ... =609748570
I decided to use contempt=0 for Stockfish, for Leela its much harder to beat SF with contempt 0.

No challenger found yet ...

Code: Select all

   # PLAYER                          :  RATING  ERROR  POINTS  PLAYED   (%)  CFS(%)    W     D    L  D(%)
   1 Lc0 v0.22.0-leele11.1           :       0     14   150.0     300  50.0      50   16   268   16  89.3
   2 Stockfish 031219 64 BMI2-T13    :       0   ----   609.0    1200  50.8      62   91  1036   73  86.3
   3 Lc0 v0.22.0-sergio1207          :      -2     15   149.0     300  49.7      62   15   268   17  89.3
   4 Lc0 v0.22.0-T40.B4-160          :      -6     15   147.5     300  49.2      74   24   247   29  82.3
   5 Fat Fritz                       :     -13     15   144.5     300  48.2     ---   18   253   29  84.3
merry Christmas to all
C.K.
I have a little issue. Being Ponder ON of an 8 core CPU with hyperthreading, the 13 threads of SF will slow down the 2 threads of Lc0. Windows distributes 13 threads on 16 hyperthreads that they all slow down individually compared to the 8 threads used on 8 cores. Lc0 with its 2 threads won't slow down SF significantly in Ponder ON mode. But LcO needs 2 full blown cores, not 2 crippled hyperthreads. My opinion is that you abandon Ponder ON.
Hugo
Posts: 782
Joined: Tue Dec 01, 2009 11:10 am

Re: Best Nets for Lc0 Page

Post by Hugo »

Hi

when the latest test is done, I will make a comparison with several constellations. For example let SF analyse endless with 13 T and compare Lc0 speed with 2 threads. same with Lc0 standalone.
Right now I could not see any difference in Lc0 with two cpu or two threads. But I did not look at it when other threads are bussy.

C.K.
Laskos wrote: Tue Dec 24, 2019 11:49 am I have a little issue. Being Ponder ON of an 8 core CPU with hyperthreading, the 13 threads of SF will slow down the 2 threads of Lc0. Windows distributes 13 threads on 16 hyperthreads that they all slow down individually compared to the 8 threads used on 8 cores. Lc0 with its 2 threads won't slow down SF significantly in Ponder ON mode. But LcO needs 2 full blown cores, not 2 crippled hyperthreads. My opinion is that you abandon Ponder ON.
User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: Best Nets for Lc0 Page

Post by Laskos »

Hugo wrote: Tue Dec 24, 2019 3:11 pm Hi

when the latest test is done, I will make a comparison with several constellations. For example let SF analyse endless with 13 T and compare Lc0 speed with 2 threads. same with Lc0 standalone.
Right now I could not see any difference in Lc0 with two cpu or two threads. But I did not look at it when other threads are bussy.

C.K.
Laskos wrote: Tue Dec 24, 2019 11:49 am I have a little issue. Being Ponder ON of an 8 core CPU with hyperthreading, the 13 threads of SF will slow down the 2 threads of Lc0. Windows distributes 13 threads on 16 hyperthreads that they all slow down individually compared to the 8 threads used on 8 cores. Lc0 with its 2 threads won't slow down SF significantly in Ponder ON mode. But LcO needs 2 full blown cores, not 2 crippled hyperthreads. My opinion is that you abandon Ponder ON.
Yes, the difference, if any, should be very small. I just prefer to keep 2 full cores for Lc0, but it's maybe I am being too pedantic.
dragontamer5788
Posts: 201
Joined: Thu Jun 06, 2019 8:05 pm
Full name: Percival Tiglao

Re: Best Nets for Lc0 Page

Post by dragontamer5788 »

Ovyron wrote: Tue Dec 24, 2019 6:56 am Anything better than 128x10.T17.6-swa-20000 for CPU Leela?

Any way to use GPU Leela in a GPU that doesn't support CUDA or OpenCL?
Early GPU-programs were purely written in "shader" form. A Pixel shader transformed data in a 2d-grid into another 2d-grid. Its probably possible to write a CNN interpreter in that form, but it'd be way more difficult than just using CUDA or OpenCL.
jjoshua2
Posts: 99
Joined: Sat Mar 10, 2018 6:16 am

Re: Best Nets for Lc0 Page

Post by jjoshua2 »

There is a sergio1572 and a LS up to 12.2 (It is recommended to use Leelenstein cuda/opencl binary and tournament search params instead of default, like used at ccc or Navs stream). You might also consider testing terminator 2-136 24block. Fat Fritz and regular T40 networks are definitely not the strongest now.
Hugo wrote: Tue Dec 24, 2019 11:08 am I am searching a weightfile for a promising challenger against Stockfish.
mwyoung
Posts: 2727
Joined: Wed May 12, 2010 10:00 pm

Re: Best Nets for Lc0 Page

Post by mwyoung »

Hugo wrote: Tue Dec 24, 2019 11:08 am Hi

I am searching a weightfile for a promising challenger against Stockfish.
Since 18 days, I started my tests again, 300 games, 5m+3s , ponder on.
4 matches already done, and I hope I do not loose my motivation and a lot of tests will follow.
https://docs.google.com/spreadsheets/d/ ... =609748570
I decided to use contempt=0 for Stockfish, for Leela its much harder to beat SF with contempt 0.

No challenger found yet ...

Code: Select all

   # PLAYER                          :  RATING  ERROR  POINTS  PLAYED   (%)  CFS(%)    W     D    L  D(%)
   1 Lc0 v0.22.0-leele11.1           :       0     14   150.0     300  50.0      50   16   268   16  89.3
   2 Stockfish 031219 64 BMI2-T13    :       0   ----   609.0    1200  50.8      62   91  1036   73  86.3
   3 Lc0 v0.22.0-sergio1207          :      -2     15   149.0     300  49.7      62   15   268   17  89.3
   4 Lc0 v0.22.0-T40.B4-160          :      -6     15   147.5     300  49.2      74   24   247   29  82.3
   5 Fat Fritz                       :     -13     15   144.5     300  48.2     ---   18   253   29  84.3
merry Christmas to all
C.K.
The latest Lc0 61xxxx nets are now matching or beating the latest SF on my hardware. Even at 5s per move.
"The worst thing that can happen to a forum is a running wild attacking moderator(HGM) who is not corrected by the community." - Ed Schröder
But my words like silent raindrops fell. And echoed in the wells of silence.
mwyoung
Posts: 2727
Joined: Wed May 12, 2010 10:00 pm

Re: Best Nets for Lc0 Page

Post by mwyoung »

Laskos wrote: Tue Dec 24, 2019 11:49 am
Hugo wrote: Tue Dec 24, 2019 11:08 am Hi

I am searching a weightfile for a promising challenger against Stockfish.
Since 18 days, I started my tests again, 300 games, 5m+3s , ponder on.
4 matches already done, and I hope I do not loose my motivation and a lot of tests will follow.
https://docs.google.com/spreadsheets/d/ ... =609748570
I decided to use contempt=0 for Stockfish, for Leela its much harder to beat SF with contempt 0.

No challenger found yet ...

Code: Select all

   # PLAYER                          :  RATING  ERROR  POINTS  PLAYED   (%)  CFS(%)    W     D    L  D(%)
   1 Lc0 v0.22.0-leele11.1           :       0     14   150.0     300  50.0      50   16   268   16  89.3
   2 Stockfish 031219 64 BMI2-T13    :       0   ----   609.0    1200  50.8      62   91  1036   73  86.3
   3 Lc0 v0.22.0-sergio1207          :      -2     15   149.0     300  49.7      62   15   268   17  89.3
   4 Lc0 v0.22.0-T40.B4-160          :      -6     15   147.5     300  49.2      74   24   247   29  82.3
   5 Fat Fritz                       :     -13     15   144.5     300  48.2     ---   18   253   29  84.3
merry Christmas to all
C.K.
I have a little issue. Being Ponder ON of an 8 core CPU with hyperthreading, the 13 threads of SF will slow down the 2 threads of Lc0. Windows distributes 13 threads on 16 hyperthreads that they all slow down individually compared to the 8 threads used on 8 cores. Lc0 with its 2 threads won't slow down SF significantly in Ponder ON mode. But LcO needs 2 full blown cores, not 2 crippled hyperthreads. My opinion is that you abandon Ponder ON.
Ponder on works with Lc0 just fine. For a AMD the best solution to not impact Lc0 is to give SF all 16 logical cores but run SF in a lower priority. And give Lc0 what it wants normally. The slow down for Lc0 will be zero, and SF will only be impacted by the exact percentage of utilization when Lc0 is run on the system by itself. In my case Lc0 uses about 4% of the CPUs. And the exact slowdown to SF with Ponder on playing Lc0 is 4%. This is meaningless with a 12% overclock to all cores. I have not tested this with a Intel CPU, but give it a try. Let the system do the core splitting.
"The worst thing that can happen to a forum is a running wild attacking moderator(HGM) who is not corrected by the community." - Ed Schröder
But my words like silent raindrops fell. And echoed in the wells of silence.