100 Elo nosedive

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Dann Corbit
Posts: 12538
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

100 Elo nosedive

Post by Dann Corbit »

https://lczero.org/

I imagine someone will say it does not really mean that.
But that sure is what the graph looks like.

I wonder if someone made a naughty patch.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
User avatar
Leto
Posts: 2071
Joined: Thu May 04, 2006 3:40 am
Location: Dune

Re: 100 Elo nosedive

Post by Leto »

If you test the individual nets against a non-LCZ engine you'll probably notice no or little elo gain the past few days despite what the self elo says. Unless it starts gaining some real elo soon I think they might have to do the second LR drop. I'm no expert in NN nets but I imagine when you see a sharp increase in self-play elo all it probably means is that LCZ has found a winning opening against the older nets, and then when the self-play elo sharply decreases it probably means that a weakness has been found in the winning opening. I might be wrong though...
Dann Corbit
Posts: 12538
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: 100 Elo nosedive

Post by Dann Corbit »

That is an interesting theory. So they don't use opening books at all in testing?
Seems to me like it might be a good idea to force lots of oddball stuff like long and short castled sides, and things that might be puzzling like fianchetto bishops found in the Indian openings.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
User avatar
CMCanavessi
Posts: 1142
Joined: Thu Dec 28, 2017 4:06 pm
Location: Argentina

Re: 100 Elo nosedive

Post by CMCanavessi »

Temperature decay is the key. Temperature (aka "randomness") starts very high in self-play games and is decreased as the game evolves. That makes an opening book not necessary, as you will see a lot of variation in the beginning of the game.
Follow my tournament and some Leela gauntlets live at http://twitch.tv/ccls
ernest
Posts: 2041
Joined: Wed Mar 08, 2006 8:30 pm

Re: 100 Elo nosedive

Post by ernest »

Dann Corbit wrote: Wed Nov 14, 2018 11:15 pm https://lczero.org/

I imagine someone will say it does not really mean that.
But that sure is what the graph looks like.

I wonder if someone made a naughty patch.
Well, your graph just got updated ! :D :roll:

I wonder if anybody can say something sensible about this data...

Looks more and more Lc0 is a hoax... that works !!!
Dann Corbit
Posts: 12538
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: 100 Elo nosedive

Post by Dann Corbit »

Well, that hoax played pretty well in TCEC.
;-)
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
Leo
Posts: 1078
Joined: Fri Sep 16, 2016 6:55 pm
Location: USA/Minnesota
Full name: Leo Anger

Re: 100 Elo nosedive

Post by Leo »

LCO needs a little help. Maybe a pill.
images_edited-1.jpg
Advanced Micro Devices fan.
Dann Corbit
Posts: 12538
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: 100 Elo nosedive

Post by Dann Corbit »

He could never lift that pill out of there. He always had to get Polly the poodle to do it for him.
He should have just given her the ring.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
Leo
Posts: 1078
Joined: Fri Sep 16, 2016 6:55 pm
Location: USA/Minnesota
Full name: Leo Anger

Re: 100 Elo nosedive

Post by Leo »

Dann Corbit wrote: Fri Nov 16, 2018 3:25 am He could never lift that pill out of there. He always had to get Polly the poodle to do it for him.
He should have just given her the ring.
lol
Advanced Micro Devices fan.
ernest
Posts: 2041
Joined: Wed Mar 08, 2006 8:30 pm

Re: 100 Elo nosedive

Post by ernest »

Dann Corbit wrote: Fri Nov 16, 2018 2:03 am Well, that hoax played pretty well in TCEC.
That's what I said... it works !

Not sure anybody has a deep understanding about how it progresses... 8-)