Re: LC0 finally?
Posted: Fri Jun 22, 2018 7:46 pm
Hasn’t the current network saturated? Why haven’t we moved to a larger net?
I did actually wonder if the reason was another restart was due, but thought this time it would be different.yanquis1972 wrote: ↑Fri Jun 22, 2018 8:39 pm am wondering the same thing, if it's still a test-run they may want to be absolutely sure of the limit.
ElswhereWerewolf wrote: ↑Fri Jun 22, 2018 10:58 pmI did actually wonder if the reason was another restart was due, but thought this time it would be different.yanquis1972 wrote: ↑Fri Jun 22, 2018 8:39 pm am wondering the same thing, if it's still a test-run they may want to be absolutely sure of the limit.
Ho hum. Maybe it’s called LC0 because it’s Elo keeps going back to zero
Id396 is a new net without input from broken games:
Net has been replaced with a new bootstrap net with 50 move rule normalization and learnable batch normalization beta bias. It will likely be weaker to start but will hopefully grow stronger quickly. Thanks to scs-ben!
scs-ben - 06/02/2018
192x15 network is being bootstrapped. Batch size is 512. Using games 7 million to current but excluding 10.5-14 million due to likely bad data. Batch normalization, 50 move rule plane normalization, test/train data separation are all included.
This seems to be exactly the case.It will likely be weaker to start but will hopefully grow stronger quickly. Thanks to scs-ben!
what about having correct rating graph by calculating the rating in the graph not based on self play but based on games against known opponents?
I wish I understood that second spreadsheet, looks so confusing to me. This one I can understand:yanquis1972 wrote: ↑Sun Jun 24, 2018 1:42 pm that's going on in the background & not-so-in-the-background...
http://lczero.org/?full_elo=1 click elo estimates
https://docs.google.com/spreadsheets/d/ ... li=1#gid=0