Are we sure that Stockfish NNUE is better than the Normal Stockfish ?

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Chessqueen
Posts: 5578
Joined: Wed Sep 05, 2018 2:16 am
Location: Moving
Full name: Jorge Picado

Are we sure that Stockfish NNUE is better than the Normal Stockfish ?

Post by Chessqueen »

Do NOT worry and be happy, we all live a short life :roll:
DrCliche
Posts: 65
Joined: Sun Aug 19, 2018 10:57 pm
Full name: Nickolas Reynolds

Re: Are we sure that Stockfish NNUE is better than the Normal Stockfish ?

Post by DrCliche »

Sure enough that three draws (lol) at TCEC shouldn't measurably change our extreme confidence, yes.
User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: Are we sure that Stockfish NNUE is better than the Normal Stockfish ?

Post by Laskos »

DrCliche wrote: Wed Sep 02, 2020 8:46 am Sure enough that three draws (lol) at TCEC shouldn't measurably change our extreme confidence, yes.
Just a different worldview and perceptions. I guess the priors of both of you have a similar mean but very different widths. Both of you expected SF NNUE to be stronger than SF Classic by a similar margin, say 124 Elo points, but with different emotional and mental attitude about your confidence in that.

I pictured the priors here:

Image

After these 3 TCEC draws, the posterior estimate of the difference between SF NNUE and SF Classic in his case dropped to 32 Elo points from a priori 124 Elo points, in your case dropped to 113 Elo points from the same 124 a priori Elo points. So he is legit in asking "Are we sure that Stockfish NNUE is better than the Normal Stockfish ?" and you are right in replying "Sure enough that three draws (lol) at TCEC shouldn't measurably change our extreme confidence, yes."

:twisted:
peter
Posts: 3185
Joined: Sat Feb 16, 2008 7:38 am
Full name: Peter Martan

Re: Are we sure that Stockfish NNUE is better than the Normal Stockfish ?

Post by peter »

Laskos wrote: Wed Sep 02, 2020 10:42 am
DrCliche wrote: Wed Sep 02, 2020 8:46 am Sure enough that three draws (lol) at TCEC shouldn't measurably change our extreme confidence, yes.
Just a different worldview and perceptions. I guess the priors of both of you have a similar mean but very different widths. Both of you expected SF NNUE to be stronger than SF Classic by a similar margin, say 124 Elo points, but with different emotional and mental attitude about your confidence in that.

I pictured the priors here:

Image

After these 3 TCEC draws, the posterior estimate of the difference between SF NNUE and SF Classic in his case dropped to 32 Elo points from a priori 124 Elo points, in your case dropped to 113 Elo points from the same 124 a priori Elo points. So he is legit in asking "Are we sure that Stockfish NNUE is better than the Normal Stockfish ?" and you are right in replying "Sure enough that three draws (lol) at TCEC shouldn't measurably change our extreme confidence, yes."

:twisted:
:D
46 games right now in this division with 3 games won, so 43 draws.
Peter.
User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: Are we sure that Stockfish NNUE is better than the Normal Stockfish ?

Post by Laskos »

peter wrote: Wed Sep 02, 2020 11:15 am
Laskos wrote: Wed Sep 02, 2020 10:42 am
DrCliche wrote: Wed Sep 02, 2020 8:46 am Sure enough that three draws (lol) at TCEC shouldn't measurably change our extreme confidence, yes.
Just a different worldview and perceptions. I guess the priors of both of you have a similar mean but very different widths. Both of you expected SF NNUE to be stronger than SF Classic by a similar margin, say 124 Elo points, but with different emotional and mental attitude about your confidence in that.

I pictured the priors here:

Image

After these 3 TCEC draws, the posterior estimate of the difference between SF NNUE and SF Classic in his case dropped to 32 Elo points from a priori 124 Elo points, in your case dropped to 113 Elo points from the same 124 a priori Elo points. So he is legit in asking "Are we sure that Stockfish NNUE is better than the Normal Stockfish ?" and you are right in replying "Sure enough that three draws (lol) at TCEC shouldn't measurably change our extreme confidence, yes."

:twisted:
:D
46 games right now in this division with 3 games won, so 43 draws.
Where is Jeroen? His openings usually avoided this drawfest. With TCEC if one goes with the usual openings the draw rates between top engines are above 90%.

6 more draws of SF NNUE, and DrCliche will start to listen to Chessqueen :lol:
peter
Posts: 3185
Joined: Sat Feb 16, 2008 7:38 am
Full name: Peter Martan

Re: Are we sure that Stockfish NNUE is better than the Normal Stockfish ?

Post by peter »

Laskos wrote: Wed Sep 02, 2020 12:14 pm Where is Jeroen? His openings usually avoided this drawfest.
As far as I just read at TCEC-Rules, Premier Division is played
with a randomized 8-move opening book by Nelson Hernandez
Jeroen's openings will come at Superfinal.
Last edited by peter on Wed Sep 02, 2020 1:03 pm, edited 1 time in total.
Peter.
Nay Lin Tun
Posts: 708
Joined: Mon Jan 16, 2012 6:34 am

Re: Are we sure that Stockfish NNUE is better than the Normal Stockfish ?

Post by Nay Lin Tun »

It is already 6 games, 6 draws for SFNNUE! :mrgreen: :twisted:
peter
Posts: 3185
Joined: Sat Feb 16, 2008 7:38 am
Full name: Peter Martan

Re: Are we sure that Stockfish NNUE is better than the Normal Stockfish ?

Post by peter »

Nay Lin Tun wrote: Wed Sep 02, 2020 1:03 pm It is already 6 games, 6 draws for SFNNUE! :mrgreen: :twisted:
Yet only one less win than LC0, Stoofvlees (which has lost one game on the other hand too) and Ethereal have each. So no really clear superperformance over the 6 draws neither from any of the other engines.
:wink:
Peter.
mwyoung
Posts: 2727
Joined: Wed May 12, 2010 10:00 pm

Re: Are we sure that Stockfish NNUE is better than the Normal Stockfish ?

Post by mwyoung »

Chessqueen wrote: Wed Sep 02, 2020 5:16 am https://tcec-chess.com/live.html
Where have we seen results like this before?
"The worst thing that can happen to a forum is a running wild attacking moderator(HGM) who is not corrected by the community." - Ed Schröder
But my words like silent raindrops fell. And echoed in the wells of silence.
peter
Posts: 3185
Joined: Sat Feb 16, 2008 7:38 am
Full name: Peter Martan

Re: Are we sure that Stockfish NNUE is better than the Normal Stockfish ?

Post by peter »

mwyoung wrote: Wed Sep 02, 2020 1:39 pm
Chessqueen wrote: Wed Sep 02, 2020 5:16 am https://tcec-chess.com/live.html
Where have we seen results like this before?
In this one Bonus
StockfishNNUE 20200704-StockFiNN-0.2 vs Top4
of latest season

https://tcec-chess.com/#div=nnueg&game=1&season=18

from 56 games hefty 4 ones were won.
Peter.