testing of a different sort

[bob]

Had to abort the test a little early. The first set of data is normal crafty with no checks in q-search. Second set is identical version except for checks added.

Code: Select all

crafty-22.2R5
Rank Name                   Elo    +    - games score oppo. draws
   1 Glaurung 2.1       172    7    7  7534   77%   -44   17%
   2 Fruit 2.1           56    7    6  7534   64%   -44   23%
   3 opponent-21.7       12    6    6  7518   58%   -44   34%
   4 Glaurung 1.1 SMP    -1    7    7  7534   56%   -44   20%
   5 Crafty-22.2        -44    4    3 37646   43%     9   23%
   6 Arasan 10.0       -194    7    7  7526   30%   -44   19%

crafty-22.2R6
Rank Name                   Elo    +    - games score oppo. draws
   1 Glaurung 2.1       173    7    7  7782   78%   -47   17%
   2 Fruit 2.1           66    6    7  7782   65%   -47   22%
   3 opponent-21.7       13    6    6  7782   59%   -47   33%
   4 Glaurung 1.1 SMP    10    6    7  7782   58%   -47   20%
   5 Crafty-22.2        -47    4    4 38910   42%     9   22%
   6 Arasan 10.0       -214    7    7  7782   28%   -47   18%

Almost the same number of games for each, and a bunch of games at that, with final Elos very close (within error bar limits). This has the new glaurung 2.1 added, old 2.0e5 or whatever removed. Still the same hacked up evaluation (even more hacked up now) but the only difference between the two runs is the q-search checks.

Will run null R=3/3 and R=4/3 when we get the A/C up.

Again I will suggest getting the LOS numbers from BayesElo. Your intuitive understanding of the numbers may be very good, but the LOS numbers could refine that. At least try it for a few runs to see what you think.

Can you explain how to do this? If I add los to my list of automated commands I get a separate LOS matrix, yet I am seeing examples where the LOS matrix is appended to the elo lines. Is that manual editing or will it do it automatically or do I need to just write a script to "piece" the things together into one line??