Stockfish NNue [download ]

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

User avatar
Rebel
Posts: 6991
Joined: Thu Aug 18, 2011 12:04 pm

Re: Stockfish NNue [download ]

Post by Rebel »

Ovyron wrote: Fri Jul 31, 2020 3:45 am
Rebel wrote: Thu Jul 30, 2020 8:22 pmthe latest well tested version is now ~95 elo stronger than Stockfish 11
Worth noting: this is at 40 moves in 20 seconds time control. At real world time controls like 5 +0 I don't think 70 elo has been broken yet (but... this is more than one year of progress still...)
And you likely missed that a couple of days ago I played 2000 games at CCRL Blitz (that's a lot more games than CCRL) and that the result was even better than the 40m/20s run.
90% of coding is debugging, the other 10% is writing bugs.
User avatar
Ovyron
Posts: 4556
Joined: Tue Jul 03, 2007 4:30 am

Re: Stockfish NNue [download ]

Post by Ovyron »

Rebel wrote: Fri Jul 31, 2020 3:21 pmAnd you likely missed that a couple of days ago I played 2000 games at CCRL Blitz (that's a lot more games than CCRL) and that the result was even better than the 40m/20s run.
Adam Hair has shown that such "n moves in n time" might be unreliable because the time used per move draws some weird curves and the engine is forced to adjust its time and use time where it doesn't matter, or not have enough time where it matters.

Here's a graph:

Image

The engine gets a lot more time at move 40 for no reason at all. I suggest you retest at some fixed time per game or fixed time with increment time controls.
Damir
Posts: 2801
Joined: Mon Feb 11, 2008 3:53 pm
Location: Denmark
Full name: Damir Desevac

Re: Stockfish NNue [download ]

Post by Damir »

cma6
Posts: 219
Joined: Thu May 29, 2014 5:58 pm

Re: Stockfish NNue [download ]

Post by cma6 »

Ovyron wrote: Fri Jul 31, 2020 3:21 pm
cma6 wrote: Fri Jul 31, 2020 3:16 pm Rebel, thank you for providing a great service to the chess engine community. To keep updated on the best SF NNUE version, is it sufficient to update to the latest (non-experimental network (.bin) from Sergio, or should one also update to your latest version of "sf-nnue-bmi2.exe"?
The latest Sergio net may not be the strongest one, let others test and upgrade once someone you trust reports that there's a new net that is the best.
Thanks, Ovyron, for the advice. May I ask who you follow for testing and reporting on the best of Sergio's nets?
MMarco
Posts: 195
Joined: Sun Apr 12, 2020 1:09 am
Full name: Marc-O Moisan-Plante

Re: Stockfish NNue [download ]

Post by MMarco »

M ANSARI wrote: Fri Jul 31, 2020 10:39 am How do can you test the speed of the compile to see which compile is fastest on your system? Is there a console command?
Try the bench command: https://github.com/mcostalba/Stockfish/ ... chmark.cpp

/// bench -> search default positions up to depth 13
/// bench 64 1 15 -> search default positions up to depth 15 (TT = 64MB)
/// bench 64 4 5000 current movetime -> search current position with 4 threads for 5 sec
/// bench 64 1 100000 default nodes -> search default positions for 100K nodes each
/// bench 16 1 5 default perft -> run a perft 5 on default positions
Paul Bedrey
Posts: 1146
Joined: Thu Mar 09, 2006 11:46 am
Location: Saratoga Springs New York

Re: Stockfish NNue [download ]

Post by Paul Bedrey »

I'm curious what the graph on Sergio's download page means. It's a rating of sorts.

Seems like there is a need of a thread devoted for posting user results.

I am running games by hand on two separate machines. Based on ponder move my impression is that NNue acts as a totally different engine from StockFish. I'm wondering what a similarity test would show.
Jouni
Posts: 3286
Joined: Wed Mar 08, 2006 8:15 pm

Re: Stockfish NNue [download ]

Post by Jouni »

I am curious: how does NNue score in Your speedy rating list and 40 000 positions?!
Jouni
h1a8
Posts: 508
Joined: Fri Jun 04, 2010 7:23 am

Re: Stockfish NNue [download ]

Post by h1a8 »

Rebel wrote: Fri Jul 31, 2020 3:21 pm
Ovyron wrote: Fri Jul 31, 2020 3:45 am
Rebel wrote: Thu Jul 30, 2020 8:22 pmthe latest well tested version is now ~95 elo stronger than Stockfish 11
Worth noting: this is at 40 moves in 20 seconds time control. At real world time controls like 5 +0 I don't think 70 elo has been broken yet (but... this is more than one year of progress still...)
And you likely missed that a couple of days ago I played 2000 games at CCRL Blitz (that's a lot more games than CCRL) and that the result was even better than the 40m/20s run.
Question
So will the engine be NEARLY the same strength regardless of the graphics card?

For example, I have a 2080ti with i7-9700.
Will the engine be NEARLY the same strength if I just had a 1650ti
with i7-9700?
User avatar
Ovyron
Posts: 4556
Joined: Tue Jul 03, 2007 4:30 am

Re: Stockfish NNue [download ]

Post by Ovyron »

h1a8 wrote: Fri Jul 31, 2020 6:12 pm Question
So will the engine be NEARLY the same strength regardless of the graphics card?

For example, I have a 2080ti with i7-9700.
Will the engine be NEARLY the same strength if I just had a 1650ti
with i7-9700?
The engine doesn't use a graphics card at all, so it's not a concern.
User avatar
Ovyron
Posts: 4556
Joined: Tue Jul 03, 2007 4:30 am

Re: Stockfish NNue [download ]

Post by Ovyron »

cma6 wrote: Fri Jul 31, 2020 3:46 pm Thanks, Ovyron, for the advice. May I ask who you follow for testing and reporting on the best of Sergio's nets?
I've been following the tests of people from this thread, though realistically you'd only want to download a net when it's clearly stronger than one you already have.