Re: Crazy good LTC Kiudee "mod" setting just by adjusting CPuct
Posted: Sun Feb 02, 2020 4:23 am
by Exa65536
Tuning via self-play, at least in the past, has tended to produce a race to the bottom of lower CPUCT. Since the opponent is nearly a clone (aside from search settings) they're very unlikely to make moves that aren't on the nets radar at all, and so it's more important to get higher depth on the high-policy possibilities than it is to explore the possible surprises.
So, if you're genuinely playing against another instance of leela, narrower search is likely to be better, but past some point that'll stop translating into better performance vs other opponents.
Re: Crazy good LTC Kiudee "mod" setting just by adjusting CPuct
pohl4711 wrote: ↑Sat Feb 01, 2020 12:26 pm
The first 45 games are played and at this point, it looks very promising.
Lc0 0.23.2kl t40-1541 (20x256) (kl= Kiudee with Laskos change CPuct=1.900) is at 62% vs. Stockfish 191210 (final result of Kiudee setting without Laskos CPuct-change was 57%), which would mean around +35 Elo more and a real destruction of Stockfish.
But 45 games does not mean a really reliable result - all can still change. We have to wait some days more, but the result is very good so far, so I let the test go on...
Thank you very much! I abandoned the tests against Stockfish, and am trying to tune several CPuct related parameters in self-games. Kiudee will come with a new, continued to longer TC global fit, but still not close to your TC and npm.
93 games played, now. "Only" 58.1% score, which is only +8 Elo better, than Kiudee-setting without CPuct-change to 1.900
Stay tuned!
Re: Crazy good LTC Kiudee "mod" setting just by adjusting CPuct
Posted: Sun Feb 02, 2020 2:41 pm
by mwyoung
So far Kiudee is not showing itself to be so perky in a real world test. But the games continue...
pohl4711 wrote: ↑Sat Feb 01, 2020 12:26 pm
The first 45 games are played and at this point, it looks very promising.
Lc0 0.23.2kl t40-1541 (20x256) (kl= Kiudee with Laskos change CPuct=1.900) is at 62% vs. Stockfish 191210 (final result of Kiudee setting without Laskos CPuct-change was 57%), which would mean around +35 Elo more and a real destruction of Stockfish.
But 45 games does not mean a really reliable result - all can still change. We have to wait some days more, but the result is very good so far, so I let the test go on...
Thank you very much! I abandoned the tests against Stockfish, and am trying to tune several CPuct related parameters in self-games. Kiudee will come with a new, continued to longer TC global fit, but still not close to your TC and npm.
93 games played, now. "Only" 58.1% score, which is only +8 Elo better, than Kiudee-setting without CPuct-change to 1.900
Stay tuned!
Thanks! Still, things can happen.
Re: Crazy good LTC Kiudee "mod" setting just by adjusting CPuct
Posted: Mon Feb 03, 2020 7:01 am
by Hugo
Hi all
i tried the kuidee-mod settings in a match:
SF11 12cpu, contempt=0 against Leelenstein 13.2 default, ponder on=-17Elo for LS_13.2def
pohl4711 wrote: ↑Sat Feb 01, 2020 12:26 pm
The first 45 games are played and at this point, it looks very promising.
Lc0 0.23.2kl t40-1541 (20x256) (kl= Kiudee with Laskos change CPuct=1.900) is at 62% vs. Stockfish 191210 (final result of Kiudee setting without Laskos CPuct-change was 57%), which would mean around +35 Elo more and a real destruction of Stockfish.
But 45 games does not mean a really reliable result - all can still change. We have to wait some days more, but the result is very good so far, so I let the test go on...
Thank you very much! I abandoned the tests against Stockfish, and am trying to tune several CPuct related parameters in self-games. Kiudee will come with a new, continued to longer TC global fit, but still not close to your TC and npm.
93 games played, now. "Only" 58.1% score, which is only +8 Elo better, than Kiudee-setting without CPuct-change to 1.900
Stay tuned!
Thanks! Still, things can happen.
Sorry to say, that the result is disappointing, right now. After 150 games of 300, the score is only 55%, which is 2% weaker, than kiudee. So, I will abort that testrun. And will test Leelenstein 13.2 with Kiudee right now.