Statistically correct elo estimates from SPRT tests

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Michel
Posts: 2272
Joined: Mon Sep 29, 2008 1:50 am

Statistically correct elo estimates from SPRT tests

Post by Michel »

It is well known that naive elo estimates after a finished SPRT test (like e.g. those returned by cutechess-cli) are quite biased. The following web page computes statistically correct elo estimates for finished SPRT tests.

http://hardy.uhasselt.be/Toga/sprt_elo.html

It is ok to enter the test data while the test is running but the returned results should of course not be used as a basis to stop the test (I can explain this in more detail...)!

For people that like mathematics: the web page is based on the following script

http://hardy.uhasselt.be/Toga/sprt_elo.py

(I also have a C++ version in case people are interested).
Ideas=science. Simplification=engineering.
Without ideas there is nothing to simplify.
hagtorp
Posts: 48
Joined: Sat Nov 04, 2017 6:32 pm
Location: Kazakhstan

Re: Statistically correct elo estimates from SPRT tests

Post by hagtorp »

Can I see the version in c ++?
Michel
Posts: 2272
Joined: Mon Sep 29, 2008 1:50 am

Re: Statistically correct elo estimates from SPRT tests

Post by Michel »

Ideas=science. Simplification=engineering.
Without ideas there is nothing to simplify.
hagtorp
Posts: 48
Joined: Sat Nov 04, 2017 6:32 pm
Location: Kazakhstan

Re: Statistically correct elo estimates from SPRT tests

Post by hagtorp »

Thanks.
Michel
Posts: 2272
Joined: Mon Sep 29, 2008 1:50 am

Re: Statistically correct elo estimates from SPRT tests

Post by Michel »

Hi,

If you want to use the C++ code for something please download again. I have removed a few lines of dead code in brownian.cpp (they were already removed in the Python version). There is no effect on execution.
Ideas=science. Simplification=engineering.
Without ideas there is nothing to simplify.
Dann Corbit
Posts: 12538
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Statistically correct elo estimates from SPRT tests

Post by Dann Corbit »

That Brent root finder has been around for a long time. I remember playing with it 25 years ago.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.