P. Villanueva wrote:Thank for the tournament.
I´ve got a question. Wich values do you use as reference to calculate engines ELO?
IMHO, this is a very hot topic. I am following an old tradition in
computer chess testing by fixing Shredder 09.1 w32 (UCI) at 2750.
I'll try to outline what I'll be doing in my future tests. Before
inter-divisions fights begin, I should find a simple way for
reflecting engines ratings. As an enthuaistic tester, I need
to find solutions for all of these below and therefore an
automated process for each new engine would be great!
First of all: Execute a sample of test suites, 1, 2, 3 or more.
Nunn2, STS, WAC etc... comes to mind.
Secondly: Set up two or three tournaments each with eight
opponents, 16 games per tourn.
Thirdly: Determine the division of the engine.
Criteria : Which engines could compete, which not?
Like in the case of Plisk that uses all my precious memory : could not.
Fourth: Tournaments, double round robin or one blitz + one rapid
Fifth: Which engine goes upper? which going down? Some guidelines.
Well, I am tired.