IMHO, this is a very hot topic. I am following an old tradition inP. Villanueva wrote:Thank for the tournament.
I´ve got a question. Wich values do you use as reference to calculate engines ELO?
computer chess testing by fixing Shredder 09.1 w32 (UCI) at 2750.
I'll try to outline what I'll be doing in my future tests. Before
inter-divisions fights begin, I should find a simple way for
reflecting engines ratings. As an enthuaistic tester, I need
to find solutions for all of these below and therefore an
automated process for each new engine would be great!
Procedure:
First of all: Execute a sample of test suites, 1, 2, 3 or more.
Nunn2, STS, WAC etc... comes to mind.
Secondly: Set up two or three tournaments each with eight
opponents, 16 games per tourn.
Thirdly: Determine the division of the engine.
Criteria : Which engines could compete, which not?
Like in the case of Plisk that uses all my precious memory : could not.
Fourth: Tournaments, double round robin or one blitz + one rapid
Fifth: Which engine goes upper? which going down? Some guidelines.
Well, I am tired.
Best,