Stockfish 19.2.2017: any progress finally?

Jouni · Post by **Jouni** » Tue Feb 21, 2017 5:47 pm

STILL NO PROGRESS FROM SF8! I tested brainfish compile (faster than http://chess.ultimaiq.net/stockfish.html one) with 2*200 games vs. Houdini 5 and Komodo 10.
60s+0,6s games: -1 ELO to SF8.

Jouni · Post by **Jouni** » Thu Mar 02, 2017 2:38 pm

I repeated same test with 26.2.2017 version and same conditions. Result: -2 ELO to SF8. I am surprised, that Pohl tests shows same gain! I didn't use SALC book.

voyagerOne · Post by **voyagerOne** » Thu Mar 02, 2017 3:41 pm

You will see progress after the next couple of elo patches...

ernest · Post by **ernest** » Sat Mar 04, 2017 1:54 am

voyagerOne wrote:You will see progress after the next couple of elo patches...

At some moment you will be right !...

MikeB · Post by **MikeB** » Sun Mar 05, 2017 2:02 am

Jouni wrote:I repeated same test with 26.2.2017 version and same conditions. Result: -2 ELO to SF8. I am surprised, that Pohl tests shows same gain! I didn't use SALC book.

I do not see what you are seeing at all. My runs show a healthy 10 ELO gain. Ran it again this afternoon , just to be sure.

Code: Select all

1500 rounds and 1500 games completed...
time control&#58; 3000+50
Date&#58; 03/04/17 &#58; 18&#58;23&#58;35

1500 game&#40;s&#41; loaded
Rank Name                      Rating   &#916;     +    -     #     &#931;    &#931;%     W    L    D   W%    =%   OppR 
---------------------------------------------------------------------------------------------------------
   1 Stockfish 040317 64 POPC   3105   0.0    4    4  1500  771.5  51.4  263  220 1017  17.5  67.8  3095 
   2 Stockfish 8 64 POPCNT      3095   9.7    4    4  1500  728.5  48.6  220  263 1017  14.7  67.8  3105 
---------------------------------------------------------------------------------------------------------
ResultSet-EloRating>los &#40;likelihood of superiority&#41;
                          St St
Stockfish 040317 64 POPC     98
Stockfish 8 64 POPCNT      1

Several factors could be involved - is your machine overloaded at times, what type of opening book , how are they being compiled or your results of just 200 games could be an outlier - and so could mine, but I have run tens of thousands of games since SF 8 release and I'm confident ELO gains are being made. It is not straight line, they continually approve simplifications that are not totally ELO neutral. On the other hand, simplification patches is similar to pruning a tree and set the stage for the next round of ELO gaining patches. The SF team definitely has a well developed and proven collaborative process, certainly one that I cannot argue against.

Stockfish 19.2.2017: any progress finally?

Stockfish 19.2.2017: any progress finally?

Re: Stockfish 19.2.2017: any progress finally?

Re: Stockfish 19.2.2017: any progress finally?

Re: Stockfish 19.2.2017: any progress finally?

Re: Stockfish 19.2.2017: any progress finally?