Stockfish 10 was released 29.11.2018

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Jouni
Posts: 3286
Joined: Wed Mar 08, 2006 8:15 pm

Stockfish 10 was released 29.11.2018

Post by Jouni »

After one year we have again +50 ELO gain! +46 single and +54 multicore in framework test. How much has Lc0 gained in last year :?: .
Jouni
Modern Times
Posts: 3546
Joined: Thu Jun 07, 2012 11:02 pm

Re: Stockfish 10 was released 29.11.2018

Post by Modern Times »

Yes we show a good increase at blitz:

http://ccrl.chessdom.com/ccrl/404/cgi/c ... +opponents


So is Stockfish 11 due for release soon ?
Jouni
Posts: 3286
Joined: Wed Mar 08, 2006 8:15 pm

Re: Stockfish 10 was released 29.11.2018

Post by Jouni »

NCM testing shows still only +30 ELO. Difficult to understand why. Because they test mp and use same book 8moves_v3.pgn! I think SF11 comes in 2020, when selftest has about +60 ELO gain.
Jouni
Jouni
Posts: 3286
Joined: Wed Mar 08, 2006 8:15 pm

Re: Stockfish 10 was released 29.11.2018

Post by Jouni »

Surprisingly now FishCooking forum has Preparing for Stockfish 11 thread :!: . Something under Christmas three?
Jouni
Modern Times
Posts: 3546
Joined: Thu Jun 07, 2012 11:02 pm

Re: Stockfish 10 was released 29.11.2018

Post by Modern Times »

Jouni wrote: Mon Dec 09, 2019 6:08 pm Surprisingly now FishCooking forum has Preparing for Stockfish 11 thread :!: . Something under Christmas three?
Great news if so :D
Zenmastur
Posts: 919
Joined: Sat May 31, 2014 8:28 am

Re: Stockfish 10 was released 29.11.2018

Post by Zenmastur »

Modern Times wrote: Mon Dec 09, 2019 7:37 pm
Jouni wrote: Mon Dec 09, 2019 6:08 pm Surprisingly now FishCooking forum has Preparing for Stockfish 11 thread :!: . Something under Christmas three?
Great news if so :D
IF you ask me SF has a problem. Enough of their recent simplifications seem to be regressions to cause a net regression. As long as they allow this to continue their progress will be dead slow. Just like it has been for the past several months. I think they need to reevaluate their simplification testing bounds.

Regards,

Zenmastur
Only 2 defining forces have ever offered to die for you.....Jesus Christ and the American Soldier. One died for your soul, the other for your freedom.
Modern Times
Posts: 3546
Joined: Thu Jun 07, 2012 11:02 pm

Re: Stockfish 10 was released 29.11.2018

Post by Modern Times »

I did have something weird with Stockfish recently. I chose the latest build at the time for 4040 testing, and after 100 games it was -30 Elo to Stockfish 10. Yes I know that is a tiny sample, but the chances of it recovering that 30 Elo and gaining a further +30-40 Elo over the next couple of hundred games looked remote. So I went back to the Oct 9th build that gave me such good results at blitz, and it is performing well. After I've finished that I'll take the latest build again and see how it goes, to see if the previous result a was just an aberration, or wait for SF11.
Zenmastur
Posts: 919
Joined: Sat May 31, 2014 8:28 am

Re: Stockfish 10 was released 29.11.2018

Post by Zenmastur »

Modern Times wrote: Mon Dec 09, 2019 8:06 pm I did have something weird with Stockfish recently. I chose the latest build at the time for 4040 testing, and after 100 games it was -30 Elo to Stockfish 10. Yes I know that is a tiny sample, but the chances of it recovering that 30 Elo and gaining a further +30-40 Elo over the next couple of hundred games looked remote. So I went back to the Oct 9th build that gave me such good results at blitz, and it is performing well. After I've finished that I'll take the latest build again and see how it goes, to see if the previous result a was just an aberration, or wait for SF11.
I'm not surprised. I used to always use the latest but so many are regressions it's better to wait. Unfortunately there are so many simplification regressions that they cancel out any progress made in the past several months.

Regards,

Zenmastur
Only 2 defining forces have ever offered to die for you.....Jesus Christ and the American Soldier. One died for your soul, the other for your freedom.
User avatar
MikeB
Posts: 4889
Joined: Thu Mar 09, 2006 6:34 am
Location: Pen Argyl, Pennsylvania

Re: Stockfish 10 was released 29.11.2018

Post by MikeB »

Zenmastur wrote: Mon Dec 09, 2019 8:10 pm
Modern Times wrote: Mon Dec 09, 2019 8:06 pm I did have something weird with Stockfish recently. I chose the latest build at the time for 4040 testing, and after 100 games it was -30 Elo to Stockfish 10. Yes I know that is a tiny sample, but the chances of it recovering that 30 Elo and gaining a further +30-40 Elo over the next couple of hundred games looked remote. So I went back to the Oct 9th build that gave me such good results at blitz, and it is performing well. After I've finished that I'll take the latest build again and see how it goes, to see if the previous result a was just an aberration, or wait for SF11.
I'm not surprised. I used to always use the latest but so many are regressions it's better to wait. Unfortunately there are so many simplification regressions that they cancel out any progress made in the past several months.

Regards,

Zenmastur
Code pruning is necessary as Stockfish constantly evolves, over time , some code is no longer provides the benefit it once did. It has been tried, tested and true for the last 10 years. The alternative is to do a complete rewrite every 3 or 4 years, which could be far worse. It can be frustrating at times, but the process works. Also consider the coders, they might put in a quite a few hours and a year or 18 months later, see there code get simplified away. It's part of the process. We're looking at 50 Elo gain since SF 10. Not too shabby.
Image
Uri Blass
Posts: 10282
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: Stockfish 10 was released 29.11.2018

Post by Uri Blass »

Zenmastur wrote: Mon Dec 09, 2019 8:10 pm
Modern Times wrote: Mon Dec 09, 2019 8:06 pm I did have something weird with Stockfish recently. I chose the latest build at the time for 4040 testing, and after 100 games it was -30 Elo to Stockfish 10. Yes I know that is a tiny sample, but the chances of it recovering that 30 Elo and gaining a further +30-40 Elo over the next couple of hundred games looked remote. So I went back to the Oct 9th build that gave me such good results at blitz, and it is performing well. After I've finished that I'll take the latest build again and see how it goes, to see if the previous result a was just an aberration, or wait for SF11.
I'm not surprised. I used to always use the latest but so many are regressions it's better to wait. Unfortunately there are so many simplification regressions that they cancel out any progress made in the past several months.

Regards,

Zenmastur
How do you know that there are many simplification regressions?
usually simplifications pass with more than 50%.

Can you release a significantly stronger stockfish if you delete the simplifications?
I would like to see a version of stockfish that show at least 5 elo improvement based on tests with 40000 games when to achieve this target you simply "delete" simplifications that of course mean adding code.