Invariance with time control of rating schemes

Discussion of chess software programming and technical issues.

Moderators: hgm, Rebel, chrisw

User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: Invariance with time control of rating schemes

Post by Laskos »

BeyondCritics wrote:So what is the gist of that?
The highly important queston is: What is the best time control to test engine differences? Think of a developer with a machine or two, who wants to test the effect of some minor changes as efficiently as possible.
Can you give advice?
This is a bit of an art. If one has unlimited hardware resources and wants his engine perform best at LTC, then test at LTC. With limited resources, the management of them depends very much on many factors. Ask Daniel Jose (Andscacs), he is good at that, especially at scaling issues of some patches, probably better and more flexible than Stockfish Testing Framework. Or take example of the same Stockfish Framework, which is not bad, although a bit rigid.