Probably a "rapid" in human terminology, but to me it's more of a slow, most of the properties of engines are there, including most of the scaling. Increment of 30s is too pretty large.Nordlandia wrote: ↑Thu Jan 23, 2020 3:26 pm Question for Laskos: is 30m+30s considered fast slow or slow rapid?
I've seen few say that 30+30 is needed to be considered valid.
SF 11 vs T60 Lc0
Moderators: hgm, Rebel, chrisw
-
- Posts: 10948
- Joined: Wed Jul 26, 2006 10:21 pm
- Full name: Kai Laskos
Re: SF 11 vs T60 Lc0
-
- Posts: 1535
- Joined: Sun Oct 25, 2009 2:30 am
-
- Posts: 4556
- Joined: Tue Jul 03, 2007 4:30 am
Re: SF 11 vs T60 Lc0
Ooh, I wonder how would a "decreasing time control" do (it starts at 30 per second but decreases and becomes a 1 second increment by move 40 or so, so the engine is given the most time where it matters.)
-
- Posts: 3657
- Joined: Wed Nov 18, 2015 11:41 am
- Location: hungary
Re: SF 11 vs T60 Lc0
Especially if if you mean under "fair setting" no using opening book as it happened during A0 - Stockfish 8 and during the last match of CCC.Nay Lin Tun wrote: ↑Thu Jan 23, 2020 2:54 pm ...
Interesting fact.-- Alpha Zero beat Stockfish 8 after 44 million games training( in a controversal setting).
T60 beat SF after 46 million games training in a seemingly fair setting
...
-
- Posts: 708
- Joined: Mon Jan 16, 2012 6:34 am
Re: SF 11 vs T60 Lc0
Stockfish vs Leelenstein (as bonus)
SF won by 103 vs 97
https://ibb.co/FqrtZ1y
Lco vs Leelenstein (final match )
Lc0 won by 108 vs 92
https://ibb.co/1RyDrtM
SF won by 103 vs 97
https://ibb.co/FqrtZ1y
Lco vs Leelenstein (final match )
Lc0 won by 108 vs 92
https://ibb.co/1RyDrtM
-
- Posts: 1470
- Joined: Mon Apr 23, 2018 7:54 am
Re: SF 11 vs T60 Lc0
The issue is that SF tunings are robust and will be good in many settings.Laskos wrote: ↑Wed Jan 22, 2020 3:10 pmI do not agree that tuning Lc0 engine parameters is not important. Without fine-tuning, Stockfish would be at least 200 Elo points weaker. The devs should be doing it more intensely and carefully.dkappe wrote: ↑Wed Jan 22, 2020 5:58 am Of course the people that “know”, know that a big grid search for parameters at different time controls is expensive, long winded and not fun. That’s why these “special settings” only come along every once in a while, probably aren’t best or even good at most time controls, and are passed around like an illicit drug or secret handshake.
If Lc0 tunings depend on the exact time control and the exact network, etc., then there's an obvious problem.
-
- Posts: 10948
- Joined: Wed Jul 26, 2006 10:21 pm
- Full name: Kai Laskos
Re: SF 11 vs T60 Lc0
No, I don't agree. The three main runs T40, T59, and T60, and only 2 of them used on strong hardware, T40 and T60 as the strongest nets, all improve at a range from ultra-bullet to rapid TC significantly with Kiudee settings. I checked with T59 at 20k, 100k, 500k nodes per move, the improvement is very stable, only at 500k nodes per move seems slightly decreasing (buy still within error margins in matches of 500 games). When the longest, 500k nodes per move test finishes, I will write to Kiudee about the results (he was not sure what happens with more than 100k nodes per move). The settings depend slightly on time control and probably of training noise value.jp wrote: ↑Sat Jan 25, 2020 11:15 amThe issue is that SF tunings are robust and will be good in many settings.Laskos wrote: ↑Wed Jan 22, 2020 3:10 pmI do not agree that tuning Lc0 engine parameters is not important. Without fine-tuning, Stockfish would be at least 200 Elo points weaker. The devs should be doing it more intensely and carefully.dkappe wrote: ↑Wed Jan 22, 2020 5:58 am Of course the people that “know”, know that a big grid search for parameters at different time controls is expensive, long winded and not fun. That’s why these “special settings” only come along every once in a while, probably aren’t best or even good at most time controls, and are passed around like an illicit drug or secret handshake.
If Lc0 tunings depend on the exact time control and the exact network, etc., then there's an obvious problem.
The devs do have tot tune the parameters, and if the parameters are unstable under different conditions, they should change them to something more adequate to be tuned independently of conditions. Lc0 is a loosely tuned engine, and I guess additional improvement compared to Kiudee settings can be obtained. Also, compared to the sophisticated search of current top AB engines, Lc0 search is basic and probably can be drastically improved. Most of the computing effort seems to go to the training, overwhelmingly so, not on improving the engine, and that is a mistake. Yes, the devs can rely on the fact that GPU will probably improve faster than CPU, and thus still use rudimentary and untuned Lc0 engine with larger and larger nets on stronger and stronger GPUs to beat SF on big CPUs in competitions for years now, but really, is it improving the search of Lc0 a boring stuff for programmers? Or tuning Lc0 is so much worse than training nets?
-
- Posts: 3657
- Joined: Wed Nov 18, 2015 11:41 am
- Location: hungary
Re: SF 11 vs T60 Lc0
Really. For engine users it is more comfortable a Leela with fixed parameters than a Leela with such parameters what depend on TC and Net - even if the Default parameters would give weaker chess power with some Elo comparing to the optimal parameters. If the testers should use different Leela parameters for different TC and different Net it would be heavier the valuing of the test results also.jp wrote: ↑Sat Jan 25, 2020 11:15 amThe issue is that SF tunings are robust and will be good in many settings.Laskos wrote: ↑Wed Jan 22, 2020 3:10 pmI do not agree that tuning Lc0 engine parameters is not important. Without fine-tuning, Stockfish would be at least 200 Elo points weaker. The devs should be doing it more intensely and carefully.dkappe wrote: ↑Wed Jan 22, 2020 5:58 am Of course the people that “know”, know that a big grid search for parameters at different time controls is expensive, long winded and not fun. That’s why these “special settings” only come along every once in a while, probably aren’t best or even good at most time controls, and are passed around like an illicit drug or secret handshake.
If Lc0 tunings depend on the exact time control and the exact network, etc., then there's an obvious problem.