this will be the merge of a lifetime : SF 80 Elo+

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

JohnS
Posts: 215
Joined: Sun Feb 24, 2008 2:08 am

Re: When to check NNUE box

Post by JohnS »

zullil wrote: Sat Aug 08, 2020 3:10 am
JohnS wrote: Sat Aug 08, 2020 2:37 am
cma6 wrote: Fri Aug 07, 2020 4:08 pm "The idea is to use NNUE only on quite balanced material positions."
This was based on the fact that SF-NNUE searches much more slowly than classic SF on most hardware. But if one has fast hardware, so that SF-NNUE runs fast enough, then why not always use SF-NNUE?
How is stockfish defining 'quite balanced material positions', thanks.
https://github.com/official-stockfish/S ... 5aac9e322f
Thanks, does NNUEThreshold = Value(500) mean 5 pawns, 0.5 pawns or something else.
Leo
Posts: 1080
Joined: Fri Sep 16, 2016 6:55 pm
Location: USA/Minnesota
Full name: Leo Anger

Re: this will be the merge of a lifetime : SF 80 Elo+

Post by Leo »

What does NNUE stand for?
Advanced Micro Devices fan.
Leo
Posts: 1080
Joined: Fri Sep 16, 2016 6:55 pm
Location: USA/Minnesota
Full name: Leo Anger

Re: this will be the merge of a lifetime : SF 80 Elo+

Post by Leo »

Ovyron wrote: Wed Aug 05, 2020 12:41 pm This is the breakthrough I've been predicting for years! It finally happened, and I'm just glad chess looks very healthy after it (draw rates have gone down! Some lines are proving to be playable again!)
Gian-Carlo Pascutto wrote: Tue Aug 04, 2020 8:01 pm There's still so much room for experimentation. And I suspect that trying and training new approaches is quite a bit faster on a 20M NNUE net compared to a Leela one...

Dream situation for computer chess.
I agree, a Stockfish 12 release could be premature. These are new unexplored terrains, the code is nowhere near being optimized, the nets are nowhere near properly tested, imagine if SF 12 is released and one month later there's another 50 elo jump, we want a SF 12 that lasts for long!

This makes Alpha Zero look like peanuts! Bring back Deep Mind!
A lot of people considered the way Alpha Zero defeated SF flawed including myself. The one thing Alpha Zero did was to spur the computer chess society to develop its own learning network. I have always thought it sort of a waste to use all the power and resources having engines play and when the game was over the engine learned nothing.
Advanced Micro Devices fan.
Leo
Posts: 1080
Joined: Fri Sep 16, 2016 6:55 pm
Location: USA/Minnesota
Full name: Leo Anger

Re: this will be the merge of a lifetime : SF 80 Elo+

Post by Leo »

Vinvin wrote: Thu Aug 06, 2020 4:22 pm
MikeB wrote: Thu Aug 06, 2020 2:32 pm . But just say there is a God, then atheist gets to spend his eternal years in hell and the rest of us are in the Glory of God for eternal time - what would a risk averse person do?
It's the well known : "Pascal's wager" https://en.wikipedia.org/wiki/Pascal%27s_wager

My variants are :
"If there are 1000 gods but you're not sure, what would a risk to believe in these 1000 gods ?"
"If there are 1 million gods but you're not sure, what would a risk to believe in these 1 million gods ?"
"If the real god is the Flying Spaghetti Monster, what would a risk to believe in the Flying Spaghetti Monster god ?"
God has always been a nonsense a will stay a nonsense forever.
You are spiritually dead. Psalm 14:1 The fool says in his heart, "There is no God."
Advanced Micro Devices fan.
h1a8
Posts: 508
Joined: Fri Jun 04, 2010 7:23 am

Re: this will be the merge of a lifetime : SF 80 Elo+

Post by h1a8 »

Vinvin wrote: Thu Aug 06, 2020 4:22 pm
MikeB wrote: Thu Aug 06, 2020 2:32 pm . But just say there is a God, then atheist gets to spend his eternal years in hell and the rest of us are in the Glory of God for eternal time - what would a risk averse person do?
It's the well known : "Pascal's wager" https://en.wikipedia.org/wiki/Pascal%27s_wager

My variants are :
"If there are 1000 gods but you're not sure, what would a risk to believe in these 1000 gods ?"
"If there are 1 million gods but you're not sure, what would a risk to believe in these 1 million gods ?"
"If the real god is the Flying Spaghetti Monster, what would a risk to believe in the Flying Spaghetti Monster god ?"
God has always been a nonsense a will stay a nonsense forever.
The only God where Hell is a possibility is the Christian God. Therefore, the pascal wager is all about either believing in that God vs believing in other God's/no God.

If there was another possible God that has Hell as an eternal punishment then chances are it is the Christian God that's is the true one (since one would have to make up a God for the sake of shaking the wager).
Sven
Posts: 4052
Joined: Thu May 15, 2008 9:57 pm
Location: Berlin, Germany
Full name: Sven Schüle

Re: When to check NNUE box

Post by Sven »

JohnS wrote: Sat Aug 08, 2020 3:26 am
zullil wrote: Sat Aug 08, 2020 3:10 am
JohnS wrote: Sat Aug 08, 2020 2:37 am
cma6 wrote: Fri Aug 07, 2020 4:08 pm "The idea is to use NNUE only on quite balanced material positions."
This was based on the fact that SF-NNUE searches much more slowly than classic SF on most hardware. But if one has fast hardware, so that SF-NNUE runs fast enough, then why not always use SF-NNUE?
How is stockfish defining 'quite balanced material positions', thanks.
https://github.com/official-stockfish/S ... 5aac9e322f
Thanks, does NNUEThreshold = Value(500) mean 5 pawns, 0.5 pawns or something else.
Actually 2.5 pawns, since the formula also uses a fixed score of 200 for pawns (usually 256 in SF).
Sven Schüle (engine author: Jumbo, KnockOut, Surprise)
zullil
Posts: 6442
Joined: Tue Jan 09, 2007 12:31 am
Location: PA USA
Full name: Louis Zulli

Re: When to check NNUE box

Post by zullil »

Sven wrote: Sat Aug 08, 2020 2:56 pm
JohnS wrote: Sat Aug 08, 2020 3:26 am
zullil wrote: Sat Aug 08, 2020 3:10 am
JohnS wrote: Sat Aug 08, 2020 2:37 am
cma6 wrote: Fri Aug 07, 2020 4:08 pm "The idea is to use NNUE only on quite balanced material positions."
This was based on the fact that SF-NNUE searches much more slowly than classic SF on most hardware. But if one has fast hardware, so that SF-NNUE runs fast enough, then why not always use SF-NNUE?
How is stockfish defining 'quite balanced material positions', thanks.
https://github.com/official-stockfish/S ... 5aac9e322f
Thanks, does NNUEThreshold = Value(500) mean 5 pawns, 0.5 pawns or something else.
Actually 2.5 pawns, since the formula also uses a fixed score of 200 for pawns (usually 256 in SF).
Yes, but things have already changed due to new patches. Wish someone would maintain a Stockfish+NNUEonly fork. :wink:
JohnS
Posts: 215
Joined: Sun Feb 24, 2008 2:08 am

Re: When to check NNUE box

Post by JohnS »

Sven wrote: Sat Aug 08, 2020 2:56 pm
JohnS wrote: Sat Aug 08, 2020 3:26 am
zullil wrote: Sat Aug 08, 2020 3:10 am
JohnS wrote: Sat Aug 08, 2020 2:37 am
cma6 wrote: Fri Aug 07, 2020 4:08 pm "The idea is to use NNUE only on quite balanced material positions."
This was based on the fact that SF-NNUE searches much more slowly than classic SF on most hardware. But if one has fast hardware, so that SF-NNUE runs fast enough, then why not always use SF-NNUE?
How is stockfish defining 'quite balanced material positions', thanks.
https://github.com/official-stockfish/S ... 5aac9e322f
Thanks, does NNUEThreshold = Value(500) mean 5 pawns, 0.5 pawns or something else.
Actually 2.5 pawns, since the formula also uses a fixed score of 200 for pawns (usually 256 in SF).
Thanks for clearing that up Sven.
User avatar
Ovyron
Posts: 4556
Joined: Tue Jul 03, 2007 4:30 am

Re: When to check NNUE box

Post by Ovyron »

zullil wrote: Sat Aug 08, 2020 3:11 pm Yes, but things have already changed due to new patches. Wish someone would maintain a Stockfish+NNUEonly fork. :wink:
An "Use Classical Evaluation" tick box is still a possibility, the... huh... *air quotes* problem *air quotes* is that there's currently a big storm of good patches to improve Stockfish dev (it's expected to win another +20 elo by monday :shock: ) that nobody knows how the code will look like, and it's possible the hybrid patch works completely differently very soon. So many ideas and the one with the most elo will prevail.

No, we don't have a gold rush anymore, it's an elo rush!

If one week from now Stockfish-dev will find the best moves in all positions where speed is required (using classical eval) and will find the best moves in all positions where great eval is required (using NNUE eval) then the lack of the box will make sense, because there'll not be any scenario where NNUE is better than hybrid.
zullil
Posts: 6442
Joined: Tue Jan 09, 2007 12:31 am
Location: PA USA
Full name: Louis Zulli

Re: When to check NNUE box

Post by zullil »

Ovyron wrote: Sat Aug 08, 2020 3:42 pm
zullil wrote: Sat Aug 08, 2020 3:11 pm Yes, but things have already changed due to new patches. Wish someone would maintain a Stockfish+NNUEonly fork. :wink:
An "Use Classical Evaluation" tick box is still a possibility, the... huh... *air quotes* problem *air quotes* is that there's currently a big storm of good patches to improve Stockfish dev (it's expected to win another +20 elo by monday :shock: ) that nobody knows how the code will look like, and it's possible the hybrid patch works completely differently very soon. So many ideas and the one with the most elo will prevail.

No, we don't have a gold rush anymore, it's an elo rush!

If one week from now Stockfish-dev will find the best moves in all positions where speed is required (using classical eval) and will find the best moves in all positions where great eval is required (using NNUE eval) then the lack of the box will make sense, because there'll not be any scenario where NNUE is better than hybrid.
I don't care about maximizing Stockfish's self-play Elo at fishtest time controls. I am interested in seeing what Stockfish with pure NNUE evaluation can do. Yes, I can modify source code before compiling so that "Use NNUE" means "Use NNUE only". But that's going to get old very quickly. :wink: