Mac Engines rating tournament

[Ajedrecista]

Hello Julien:

Thanks Jesús, interesting results. Was this a Mac engines tournament as well? What were the engines in your tournament?

No! I have never used Mac (I am a Windows XP user). What I did is take the results of your tournament and feed my rating tool with them, just for comparison with EloSTAT ratings. So, 'Engine 01' is Fire-xTreme-2.2, 'Engine 02' is Hiarcs-12.1, ..., 'Engine 19' is Amundsen-0.80 and 'Engine 20' is Gaia-3.5.

I did not run any tournament. Sorry for the confusion.

Regards from Spain.

Ajedrecista.

[JuLieN]

Hello Julien:

Thanks Jesús, interesting results. Was this a Mac engines tournament as well? What were the engines in your tournament?

No! I have never used Mac (I am a Windows XP user). What I did is take the results of your tournament and feed my rating tool with them, just for comparison with EloSTAT ratings. So, 'Engine 01' is Fire-xTreme-2.2, 'Engine 02' is Hiarcs-12.1, ..., 'Engine 19' is Amundsen-0.80 and 'Engine 20' is Gaia-3.5.

I did not run any tournament. Sorry for the confusion.

Regards from Spain.

Ajedrecista.

Ok, then your rating tool seems to be very exact now!

[pedrox]

If you wonder where Danasah is, it crashed so I had to replace it with Rattatechess, first "different" engine of the League 2 tournament.

You have a debug file at which the engine failed?

You make several tournaments at the same time? (each tournament on a cpu)

[JuLieN]

If you wonder where Danasah is, it crashed so I had to replace it with Rattatechess, first "different" engine of the League 2 tournament.

You have a debug file at which the engine failed?

You make several tournaments at the same time? (each tournament on a cpu)

Hi Pedro. Sorry, I didn't get any debug file. cutechess only says things like "engine x disconnected"... and it just stops the tournament. Danasah played 76 games without problem, but "disconnected" in the next phase. So it's not "unstable", but once is enough to stop the tournament, sadly.

EDIT: yes, I play 8 games simultaneously. All single-threaded for this reason.

[pedrox]

If you wonder where Danasah is, it crashed so I had to replace it with Rattatechess, first "different" engine of the League 2 tournament.

You have a debug file at which the engine failed?

You make several tournaments at the same time? (each tournament on a cpu)

Hi Pedro. Sorry, I didn't get any debug file. cutechess only says things like "engine x disconnected"... and it just stops the tournament. Danasah played 76 games without problem, but "disconnected" in the next phase. So it's not "unstable", but once is enough to stop the tournament, sadly.

EDIT: yes, I play 8 games simultaneously. All single-threaded for this reason.

I've played hundreds of games with different versions of the engine and I see no crash (I not play games simultaneously, I have one computer only with 2 cpu)

Recently testing the engine for CEGT, it seems that Werner has had a crash I think just using the engine with several tournaments simultaneously.

Perhaps the problem is access to the bitbases simultaneously if you're using, then suggest doing the test of playing without them.

[JuLieN]

If you wonder where Danasah is, it crashed so I had to replace it with Rattatechess, first "different" engine of the League 2 tournament.

You have a debug file at which the engine failed?

You make several tournaments at the same time? (each tournament on a cpu)

Hi Pedro. Sorry, I didn't get any debug file. cutechess only says things like "engine x disconnected"... and it just stops the tournament. Danasah played 76 games without problem, but "disconnected" in the next phase. So it's not "unstable", but once is enough to stop the tournament, sadly.

EDIT: yes, I play 8 games simultaneously. All single-threaded for this reason.

I've played hundreds of games with different versions of the engine and I see no crash (I not play games simultaneously, I have one computer only with 2 cpu)

Recently testing the engine for CEGT, it seems that Werner has had a crash I think just using the engine with several tournaments simultaneously.

Perhaps the problem is access to the bitbases simultaneously if you're using, then suggest doing the test of playing without them.

No, I don't use bitbases. But with what you say there seems to be a pattern: Danasah maybe doesn't like to be run with many other engines running in the same time ?

[JuLieN]

Results of the final :

Code: Select all

Rank Name                        ELO   Games   Score   Draws
   1 Komodo-5.1                  251      76     81%     28%
   2 Stockfish-4                 237      76     80%     14%
   3 IvanHoe-999946f             179      76     74%     24%
   4 Critter-1.6a                173      76     73%     33%
   5 Robbolito-0085g3l           156      76     71%     34%
   6 Igorrit-0.086v2             134      76     68%     37%
   7 BlackMamba-1.4              119      76     66%     30%
   8 Protector-1.5.0              46      76     57%     34%
   9 Hiarcs-14WCSC                46      76     57%     37%
  10 TogaReturns-1.1               0      76     50%     34%
  11 Spark-1.0                    -5      76     49%     30%
  12 Texel-1.02                  -65      76     41%     24%
  13 MinkoChess-1.3              -84      76     38%     34%
  14 Gaviota-0.86               -104      76     36%     37%
  15 DeepShredder-11            -114      76     34%     24%
  16 Fruit-2.3.1                -129      76     32%     38%
  17 DiscoCheck-4.3             -179      76     26%     26%
  18 Crafty-23.6                -197      76     24%     20%
  19 Glaurung-2.2               -203      76     24%     21%
  20 EXchess-7.11b              -251      76     19%     25%

Link to the PGN (760 games)

Congratulations to Komodo 5.1, a convincing winner of this tournament!

BEfore I publish the ratings list I'll run a few rating gauntlets for engines like Fire xTreme or Gull.

[JuLieN]

Results of Fire 2.2 xTreme's gauntlet :

Code: Select all

Rank Name                        ELO   Games   Score   Draws
   1 Fire-xTreme-2.2             179     160     74%     31%
   2 BlackMamba-1.4              137       8     69%     38%
   3 Robbolito-0085g3l            89       8     62%     75%
   4 Critter-1.6a                 89       8     62%     50%
   5 Komodo-5.1                   44       8     56%     38%
   6 Stockfish-4                   0       8     50%     50%
   7 IvanHoe-999946f             -44       8     44%     62%
   8 Igorrit-0.086v2            -137       8     31%     62%
   9 TogaReturns-1.1            -191       8     25%     25%
  10 Protector-1.5.0            -191       8     25%     50%
  11 DeepShredder-11            -255       8     19%     38%
  12 Crafty-23.6                -255       8     19%     38%
  13 Spark-1.0                  -338       8     12%     25%
  14 MinkoChess-1.3             -338       8     12%      0%
  15 Hiarcs-14WCSC              -338       8     12%     25%
  16 Glaurung-2.2               -470       8      6%     12%
  17 Gaviota-0.86               -470       8      6%     12%
  18 Fruit-2.3.1                -470       8      6%     12%
  19 EXchess-7.11b              -470       8      6%     12%
  20 Texel-1.02                 -inf       8      0%      0%
  21 DiscoCheck-4.3             -inf       8      0%      0%

Link to the PGN (160 games)

Fire is REALLY strong! Well done Norman!!!

[JuLieN]

Results of Gull 1.2's gauntlet :

Code: Select all

Rank Name                        ELO   Games   Score   Draws
   1 Komodo-5.1                  338       8     88%     25%
   2 Igorrit-0.086v2             255       8     81%     38%
   3 Fire-xTreme-2.2             255       8     81%     38%
   4 IvanHoe-999946f             191       8     75%     25%
   5 Stockfish-4                 137       8     69%     62%
   6 Robbolito-0085g3l           137       8     69%     38%
   7 Critter-1.6a                 89       8     62%     50%
   8 Gull-1.2                     33     168     55%     30%
   9 TogaReturns-1.1               0       8     50%     25%
  10 MinkoChess-1.3                0       8     50%     25%
  11 Hiarcs-14WCSC                 0       8     50%     75%
  12 BlackMamba-1.4                0       8     50%     25%
  13 Texel-1.02                  -44       8     44%     38%
  14 Gaviota-0.86                -89       8     38%      0%
  15 Spark-1.0                  -137       8     31%     12%
  16 Protector-1.5.0            -191       8     25%     25%
  17 Crafty-23.6                -191       8     25%     25%
  18 Glaurung-2.2               -255       8     19%     12%
  19 DiscoCheck-4.3             -255       8     19%     38%
  20 EXchess-7.11b              -338       8     12%     25%
  21 DeepShredder-11            -338       8     12%     25%
  22 Fruit-2.3.1                -inf       8      0%      0%

Link to the PGN (168 games)

[JuLieN]

Results of Firenzina's 2.3.1's gauntlet :

Code: Select all

Rank Name                        ELO   Games   Score   Draws
   1 Firenzina-2.3.1             151     176     70%     36%
   2 Stockfish-4                 137       8     69%     62%
   3 Komodo-5.1                   89       8     62%     75%
   4 Critter-1.6a                 89       8     62%     50%
   5 TogaReturns-1.1              44       8     56%     12%
   6 Igorrit-0.086v2               0       8     50%     75%
   7 Fire-xTreme-2.2               0       8     50%     75%
   8 IvanHoe-999946f             -44       8     44%     62%
   9 BlackMamba-1.4              -44       8     44%     38%
  10 Hiarcs-14WCSC               -89       8     38%     50%
  11 Gull-1.2                    -89       8     38%     50%
  12 Robbolito-0085g3l          -191       8     25%     50%
  13 Protector-1.5.0            -191       8     25%     25%
  14 Spark-1.0                  -255       8     19%     38%
  15 Glaurung-2.2               -255       8     19%     38%
  16 Texel-1.02                 -338       8     12%     25%
  17 MinkoChess-1.3             -338       8     12%     25%
  18 EXchess-7.11b              -338       8     12%     25%
  19 Gaviota-0.86               -470       8      6%     12%
  20 Fruit-2.3.1                -470       8      6%     12%
  21 DiscoCheck-4.3             -inf       8      0%      0%
  22 DeepShredder-11            -inf       8      0%      0%
  23 Crafty-23.6                -inf       8      0%      0%

Link to the PGN (176 games)