an STS Tool retouched

[Matthias Gemuh]

an STS Tool retouched

1. The STS EPD files must be renamed to STS01.epd, STS02.epd, ... STS49.epd
2. Play a Testsuite tournament using ChessGUI.
3. Import Testsuite result file into STS_Tool.
4. Supply known Elo Ratings of at least 2 engines (see CCRL).
5. Calculate Elo estimates.
6. Generate Html.
7. If desired, delete all data by deleting STS_Tool.ini

Sample Testsuite result files are provided to allow an immediate test of the STS Tool.

http://www.chessgui.com/chess/STS_Tool.zip

Matthias.

[peter]

an STS Tool retouched

Matthias, that looks like a really great and grand idea to me.
Might be the missing link between positions' tests and rating lists.
Could be even the better objective measure of analyze strength of engines, that Larry Kaufman hopes for:
http://www.talkchess.com/forum/viewtopi ... 29&t=41612

[lkaufman]

I rather like the idea, but I am skeptical that it will produce significantly different results from the current rating lists. Also I don't like that it ignores the opening.

[peter]

I rather like the idea, but I am skeptical that it will produce significantly different results from the current rating lists. Also I don't like that it ignores the opening.

Well that would be worth a trial.
If you miss the opening, simply take just one more position to the many others, which also came from games played according to human masters' opening theory, maybe yet more important and of more interest to human masters than the openings engines produce:
add the one and only very starting position to the many other positons of interest and that's it, no?

Of course, you can add all the other 5 to 8 moves long opening positions, that are used now, too, if you want to be very very sure not to loose any of the Elo points you gathered in the usual way till now, still knowing these were a result of pure arbitrary selection of starting positions too, even if you played from broad short books.
The editing of these books is the selection (bias), not the random choice the GUI or the engine does later on out of the given pool.