SPCC: Testrun of Stockfish 161025 finished

Discussion of computer chess matches and engine tournaments.

Moderators: bob, hgm, Harvey Williamson

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Post Reply
pohl4711
Posts: 1162
Joined: Sat Sep 03, 2011 5:25 am
Location: Berlin, Germany
Contact:

SPCC: Testrun of Stockfish 161025 finished

Post by pohl4711 » Mon Oct 31, 2016 11:54 am

Testrun of Stockfish 161025 finished.



http://spcc.beepworld.de

(Perhaps you have to clear your browsercache or reload the website)

voyagerOne
Posts: 154
Joined: Tue May 17, 2011 6:12 pm

Re: SPCC: Testrun of Stockfish 161025 finished

Post by voyagerOne » Mon Oct 31, 2016 1:38 pm

Nice elo boost.

We are about to enter the 3400 territory.

Thanks for all your testing Stefan.

JJJ
Posts: 1294
Joined: Sat Apr 19, 2014 11:47 am

Re: SPCC: Testrun of Stockfish 161025 finished

Post by JJJ » Mon Oct 31, 2016 3:41 pm

Are you gonna test shredder 13 also ?

whereagles
Posts: 562
Joined: Thu Nov 13, 2014 11:03 am

Re: SPCC: Testrun of Stockfish 161025 finished

Post by whereagles » Mon Oct 31, 2016 3:41 pm

Who's black and white in your website banner, Stefan? :)

pohl4711
Posts: 1162
Joined: Sat Sep 03, 2011 5:25 am
Location: Berlin, Germany
Contact:

Re: SPCC: Testrun of Stockfish 161025 finished

Post by pohl4711 » Mon Oct 31, 2016 4:17 pm

JJJ wrote:Are you gonna test shredder 13 also ?
I doubt that. I have no ratinglist, I do Stockfish-testruns. To pay 100€ for an engine, which is at the Elo-Level of Houdini 4, Komodo 8, Stockfish 5 and which I could only use as opponent for Stockfish, is too much money IMHO.
And the new GUI has only minor changes to the older version.
So, this Shredder 13 release is too expensive (or was released 2 years too late (in 2014 Shredder 13 would have been a top-engine, but not in 2016)).

Stefan (SPCC)

Jouni
Posts: 2083
Joined: Wed Mar 08, 2006 7:15 pm

Re: SPCC: Testrun of Stockfish 161025 finished

Post by Jouni » Mon Oct 31, 2016 7:22 pm

Obviously again error bars cause this +10 ELO. No real ELO patch in 2 weeks actually. 7000 games not enough to detect minor boost?
Jouni

voyagerOne
Posts: 154
Joined: Tue May 17, 2011 6:12 pm

Re: SPCC: Testrun of Stockfish 161025 finished

Post by voyagerOne » Mon Oct 31, 2016 7:46 pm

Jouni wrote:Obviously again error bars cause this +10 ELO. No real ELO patch in 2 weeks actually. 7000 games not enough to detect minor boost?
Here are two new elo patches that was tested with the latest version.


Author: Stéphane Nicolet
Date: Tue Oct 25 06:57:29 2016 +0200
Timestamp: 1477371449

Endgame malus for having a king in a pawnless flank

Original idea by "ElbertoOne", while "FauziAkram" suggested to put a
small midgame penalty too.

STC:
LLR: 2.95 (-2.94,2.94) [0.00,5.00]
Total: 71808 W: 13038 L: 12610 D: 46160

LTC:
LLR: 2.95 (-2.94,2.94) [0.00,5.00]
Total: 150874 W: 19828 L: 19221 D: 111825


History Stat Comparison

Adjust LMR by comparing history stats
with opponent (prior ply).

STC:
LLR: 2.96 (-2.94,2.94) [0.00,5.00]
Total: 27754 W: 5066 L: 4824 D: 17864

LTC:
LLR: 2.95 (-2.94,2.94) [0.00,5.00]
Total: 216596 W: 28157 L: 27343 D: 161096

Bench: 5437729

Jouni
Posts: 2083
Joined: Wed Mar 08, 2006 7:15 pm

Re: SPCC: Testrun of Stockfish 161025 finished

Post by Jouni » Mon Oct 31, 2016 9:16 pm

But you need 150 000 - 216 000 games to verify :wink: .
Jouni

Post Reply