New testing idea

[Michael Sherwin]

Create a set of positions that are much better for one side and alternate the advantage between the white and black sides. Play each position only once so that the engine being tested plays either from the better side or worse side.

Various testing strategies can be devised from this setup.

1.) From the inferior side, play against weaker engines to see if they can be overcome and if the improvements help with this.

2.) From the inferior side, play against stronger engines to see if more points can be saved.

3.) From the stronger side, play against weaker engines to find holes in the eval.

4.) From the stronger side, play against stronger engines to uncover weakness in their evals.

etc.

The main point is that the bias of the positions will be known (noise still possible) and that the info from such test would be more useful.

JAI