Page 2 of 3

Re: LC0 finally?

Posted: Fri Jun 22, 2018 7:46 pm
by Werewolf
Hasn’t the current network saturated? Why haven’t we moved to a larger net?

Re: LC0 finally?

Posted: Fri Jun 22, 2018 8:39 pm
by yanquis1972
am wondering the same thing, if it's still a test-run they may want to be absolutely sure of the limit.

Re: LC0 finally?

Posted: Fri Jun 22, 2018 10:58 pm
by Werewolf
yanquis1972 wrote: Fri Jun 22, 2018 8:39 pm am wondering the same thing, if it's still a test-run they may want to be absolutely sure of the limit.
I did actually wonder if the reason was another restart was due, but thought this time it would be different.

Ho hum. Maybe it’s called LC0 because it’s Elo keeps going back to zero :D

Re: LC0 finally?

Posted: Sat Jun 23, 2018 6:24 am
by Rebel
Werewolf wrote: Fri Jun 22, 2018 10:58 pm
yanquis1972 wrote: Fri Jun 22, 2018 8:39 pm am wondering the same thing, if it's still a test-run they may want to be absolutely sure of the limit.
I did actually wonder if the reason was another restart was due, but thought this time it would be different.

Ho hum. Maybe it’s called LC0 because it’s Elo keeps going back to zero :D
Elswhere
Id396 is a new net without input from broken games:

Net has been replaced with a new bootstrap net with 50 move rule normalization and learnable batch normalization beta bias. It will likely be weaker to start but will hopefully grow stronger quickly. Thanks to scs-ben!

scs-ben - 06/02/2018
192x15 network is being bootstrapped. Batch size is 512. Using games 7 million to current but excluding 10.5-14 million due to likely bad data. Batch normalization, 50 move rule plane normalization, test/train data separation are all included.

Re: LC0 finally?

Posted: Sun Jun 24, 2018 8:05 am
by Werewolf
It’s good they keep trying things, but this net doesn’t look that good, unless the numbers are skewed. Perhaps another restart?

Re: LC0 finally?

Posted: Sun Jun 24, 2018 11:04 am
by Rebel
Well, there was a bug, hence the restart.

As said -
It will likely be weaker to start but will hopefully grow stronger quickly. Thanks to scs-ben!
This seems to be exactly the case.

Patience, patience and hoping for no new bugs

Re: LC0 finally?

Posted: Sun Jun 24, 2018 12:56 pm
by Uri Blass
Rebel wrote: Sun Jun 24, 2018 11:04 am Well, there was a bug, hence the restart.

As said -
It will likely be weaker to start but will hopefully grow stronger quickly. Thanks to scs-ben!
This seems to be exactly the case.

Patience, patience and hoping for no new bugs
what about having correct rating graph by calculating the rating in the graph not based on self play but based on games against known opponents?

Re: LC0 finally?

Posted: Sun Jun 24, 2018 1:42 pm
by yanquis1972
that's going on in the background & not-so-in-the-background...

http://lczero.org/?full_elo=1 click elo estimates

https://docs.google.com/spreadsheets/d/ ... li=1#gid=0

Re: LC0 finally?

Posted: Sun Jun 24, 2018 5:41 pm
by Leto
yanquis1972 wrote: Sun Jun 24, 2018 1:42 pm that's going on in the background & not-so-in-the-background...

http://lczero.org/?full_elo=1 click elo estimates

https://docs.google.com/spreadsheets/d/ ... li=1#gid=0
I wish I understood that second spreadsheet, looks so confusing to me. This one I can understand:
https://docs.google.com/spreadsheets/d/ ... edit#gid=0

Re: LC0 finally?

Posted: Sun Jun 24, 2018 9:13 pm
by yanquis1972
true, i linked the second bc i know it's official, but that one's simpler.