Stockfish Reverts 5 Recent Patches

Discussion of chess software programming and technical issues.

Moderators: bob, hgm, Harvey Williamson

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Post Reply
Michel
Posts: 2087
Joined: Sun Sep 28, 2008 11:50 pm

Re: Stockfish Reverts 5 Recent Patches

Post by Michel » Sun Feb 02, 2020 9:53 am

  • The validity of the pentanomial model can be verified by simulation.
    https://github.com/vdbergh/pentanomial
  • Concerning short tests: there are various things to consider, notably:
    • Fishtest Elo bounds are no longer BayesElo.
    • The stopping time distribution for an SPRT has long tails.
    • The great majority of patches submitted to Fishtest are at best neutral (the Elo prior was measured some time ago to be ~ N(-1,1)).
Ideas=science. Simplification=engineering.
Without ideas there is nothing to simplify.

Michel
Posts: 2087
Joined: Sun Sep 28, 2008 11:50 pm

Re: Stockfish Reverts 5 Recent Patches

Post by Michel » Sun Feb 02, 2020 10:28 pm

I wrote a simple multi-threaded C version of the pentanomial simulator.

https://github.com/vdbergh/simul

Everything in a single C file. As it is much much faster than the Python version one can see better how accurate the implementation is.
Ideas=science. Simplification=engineering.
Without ideas there is nothing to simplify.

Michel
Posts: 2087
Joined: Sun Sep 28, 2008 11:50 pm

Re: Stockfish Reverts 5 Recent Patches

Post by Michel » Mon Feb 03, 2020 11:04 am

Michel wrote:
Sun Feb 02, 2020 10:28 pm
I wrote a simple multi-threaded C version of the pentanomial simulator.

https://github.com/vdbergh/simul

Everything in a single C file. As it is much much faster than the Python version one can see better how accurate the implementation is.
Now with a decent README.md!
Ideas=science. Simplification=engineering.
Without ideas there is nothing to simplify.

Jouni
Posts: 2103
Joined: Wed Mar 08, 2006 7:15 pm

Re: Stockfish Reverts 5 Recent Patches

Post by Jouni » Mon Feb 03, 2020 7:27 pm

SF is so strong, that today all changes need almost astronomical number of games to pass. In good old days it was 100-200 games and engine was better :D .
Jouni

Post Reply