I would think a "bookless" engine tournament would be very interesting
I have already 3 type of tournaments,where all engines have been played: 1.Without opening books,no tablebases 2.With same neutlar (Perfect 12.33) book+tablebases 3.With own books+tablebases
govert wrote:So what's the alternative?
I guess you need a bunch of different starting positions, but how do you determine the lack of bias towards a particular engine?
Allowing each engine to play as both White and Black from a given starting position should help minimise that concern.
When both plays the same position it can't really be called bias especially if there are more than a handful positions. There are some test suites you can download. Nunn, Silver Suite (Albert Silver), and ECO Variations (mine).
Where can I find the ECO variations?
Would the full set of Nunn+Silver+ECO variations have a lot of overlap?
govert wrote:So what's the alternative?
I guess you need a bunch of different starting positions, but how do you determine the lack of bias towards a particular engine?
Allowing each engine to play as both White and Black from a given starting position should help minimise that concern.
When both plays the same position it can't really be called bias especially if there are more than a handful positions. There are some test suites you can download. Nunn, Silver Suite (Albert Silver), and ECO Variations (mine).
Where can I find the ECO variations?
Would the full set of Nunn+Silver+ECO variations have a lot of overlap?
I don't think there should be an overlap...you can read the description of each test set: