LC0 finally?

[crem]

Some people claim that version 0604-experimental plays stronger than 0619 on the same net. That may theoretically happen both because algorithm differences (I changed some formulas to be able to save some memory and floats may be rounded differently sometimes) or maybe there is nps difference.

I wasn't able to find any differences in my tests though.

Maybe someone has time to do tests and confirm/refute that claim? That would be much appreciated!

[JJJ]

Leela seems close to make progress again.

[Werewolf]

Hasn’t the current network saturated? Why haven’t we moved to a larger net?

[yanquis1972]

am wondering the same thing, if it's still a test-run they may want to be absolutely sure of the limit.

[Werewolf]

am wondering the same thing, if it's still a test-run they may want to be absolutely sure of the limit.

I did actually wonder if the reason was another restart was due, but thought this time it would be different.

Ho hum. Maybe it’s called LC0 because it’s Elo keeps going back to zero

[Rebel]

am wondering the same thing, if it's still a test-run they may want to be absolutely sure of the limit.

I did actually wonder if the reason was another restart was due, but thought this time it would be different.

Ho hum. Maybe it’s called LC0 because it’s Elo keeps going back to zero

Elswhere

Id396 is a new net without input from broken games:

Net has been replaced with a new bootstrap net with 50 move rule normalization and learnable batch normalization beta bias. It will likely be weaker to start but will hopefully grow stronger quickly. Thanks to scs-ben!

scs-ben - 06/02/2018
192x15 network is being bootstrapped. Batch size is 512. Using games 7 million to current but excluding 10.5-14 million due to likely bad data. Batch normalization, 50 move rule plane normalization, test/train data separation are all included.

[Werewolf]

It’s good they keep trying things, but this net doesn’t look that good, unless the numbers are skewed. Perhaps another restart?

[Rebel]

Well, there was a bug, hence the restart.

As said -

It will likely be weaker to start but will hopefully grow stronger quickly. Thanks to scs-ben!

This seems to be exactly the case.

Patience, patience and hoping for no new bugs

[Uri Blass]

Well, there was a bug, hence the restart.

As said -

It will likely be weaker to start but will hopefully grow stronger quickly. Thanks to scs-ben!

This seems to be exactly the case.

Patience, patience and hoping for no new bugs

what about having correct rating graph by calculating the rating in the graph not based on self play but based on games against known opponents?

[yanquis1972]

that's going on in the background & not-so-in-the-background...

http://lczero.org/?full_elo=1 click elo estimates