Are we sure that Stockfish NNUE is better than the Normal Stockfish ?
Moderators: hgm, Rebel, chrisw
-
- Posts: 5582
- Joined: Wed Sep 05, 2018 2:16 am
- Location: Moving
- Full name: Jorge Picado
Are we sure that Stockfish NNUE is better than the Normal Stockfish ?
Do NOT worry and be happy, we all live a short life
-
- Posts: 65
- Joined: Sun Aug 19, 2018 10:57 pm
- Full name: Nickolas Reynolds
Re: Are we sure that Stockfish NNUE is better than the Normal Stockfish ?
Sure enough that three draws (lol) at TCEC shouldn't measurably change our extreme confidence, yes.
-
- Posts: 10948
- Joined: Wed Jul 26, 2006 10:21 pm
- Full name: Kai Laskos
Re: Are we sure that Stockfish NNUE is better than the Normal Stockfish ?
Just a different worldview and perceptions. I guess the priors of both of you have a similar mean but very different widths. Both of you expected SF NNUE to be stronger than SF Classic by a similar margin, say 124 Elo points, but with different emotional and mental attitude about your confidence in that.
I pictured the priors here:
After these 3 TCEC draws, the posterior estimate of the difference between SF NNUE and SF Classic in his case dropped to 32 Elo points from a priori 124 Elo points, in your case dropped to 113 Elo points from the same 124 a priori Elo points. So he is legit in asking "Are we sure that Stockfish NNUE is better than the Normal Stockfish ?" and you are right in replying "Sure enough that three draws (lol) at TCEC shouldn't measurably change our extreme confidence, yes."
-
- Posts: 3186
- Joined: Sat Feb 16, 2008 7:38 am
- Full name: Peter Martan
Re: Are we sure that Stockfish NNUE is better than the Normal Stockfish ?
Laskos wrote: ↑Wed Sep 02, 2020 10:42 amJust a different worldview and perceptions. I guess the priors of both of you have a similar mean but very different widths. Both of you expected SF NNUE to be stronger than SF Classic by a similar margin, say 124 Elo points, but with different emotional and mental attitude about your confidence in that.
I pictured the priors here:
After these 3 TCEC draws, the posterior estimate of the difference between SF NNUE and SF Classic in his case dropped to 32 Elo points from a priori 124 Elo points, in your case dropped to 113 Elo points from the same 124 a priori Elo points. So he is legit in asking "Are we sure that Stockfish NNUE is better than the Normal Stockfish ?" and you are right in replying "Sure enough that three draws (lol) at TCEC shouldn't measurably change our extreme confidence, yes."
46 games right now in this division with 3 games won, so 43 draws.
Peter.
-
- Posts: 10948
- Joined: Wed Jul 26, 2006 10:21 pm
- Full name: Kai Laskos
Re: Are we sure that Stockfish NNUE is better than the Normal Stockfish ?
Where is Jeroen? His openings usually avoided this drawfest. With TCEC if one goes with the usual openings the draw rates between top engines are above 90%.peter wrote: ↑Wed Sep 02, 2020 11:15 amLaskos wrote: ↑Wed Sep 02, 2020 10:42 amJust a different worldview and perceptions. I guess the priors of both of you have a similar mean but very different widths. Both of you expected SF NNUE to be stronger than SF Classic by a similar margin, say 124 Elo points, but with different emotional and mental attitude about your confidence in that.
I pictured the priors here:
After these 3 TCEC draws, the posterior estimate of the difference between SF NNUE and SF Classic in his case dropped to 32 Elo points from a priori 124 Elo points, in your case dropped to 113 Elo points from the same 124 a priori Elo points. So he is legit in asking "Are we sure that Stockfish NNUE is better than the Normal Stockfish ?" and you are right in replying "Sure enough that three draws (lol) at TCEC shouldn't measurably change our extreme confidence, yes."
46 games right now in this division with 3 games won, so 43 draws.
6 more draws of SF NNUE, and DrCliche will start to listen to Chessqueen
-
- Posts: 3186
- Joined: Sat Feb 16, 2008 7:38 am
- Full name: Peter Martan
Re: Are we sure that Stockfish NNUE is better than the Normal Stockfish ?
As far as I just read at TCEC-Rules, Premier Division is played
Jeroen's openings will come at Superfinal.with a randomized 8-move opening book by Nelson Hernandez
Last edited by peter on Wed Sep 02, 2020 1:03 pm, edited 1 time in total.
Peter.
-
- Posts: 708
- Joined: Mon Jan 16, 2012 6:34 am
Re: Are we sure that Stockfish NNUE is better than the Normal Stockfish ?
It is already 6 games, 6 draws for SFNNUE!
-
- Posts: 3186
- Joined: Sat Feb 16, 2008 7:38 am
- Full name: Peter Martan
Re: Are we sure that Stockfish NNUE is better than the Normal Stockfish ?
Yet only one less win than LC0, Stoofvlees (which has lost one game on the other hand too) and Ethereal have each. So no really clear superperformance over the 6 draws neither from any of the other engines.
Peter.
-
- Posts: 2727
- Joined: Wed May 12, 2010 10:00 pm
Re: Are we sure that Stockfish NNUE is better than the Normal Stockfish ?
Where have we seen results like this before?
"The worst thing that can happen to a forum is a running wild attacking moderator(HGM) who is not corrected by the community." - Ed Schröder
But my words like silent raindrops fell. And echoed in the wells of silence.
But my words like silent raindrops fell. And echoed in the wells of silence.
-
- Posts: 3186
- Joined: Sat Feb 16, 2008 7:38 am
- Full name: Peter Martan
Re: Are we sure that Stockfish NNUE is better than the Normal Stockfish ?
In this one Bonus
StockfishNNUE 20200704-StockFiNN-0.2 vs Top4
of latest season
https://tcec-chess.com/#div=nnueg&game=1&season=18
from 56 games hefty 4 ones were won.
Peter.