Battle of the Forgotten

[Carlos777]

Nice concept Carlos.
http://www.kirill-kryukov.com/chess/dis ... =forgotten
Mine had a different concept.

Hi Graham,

I swear I did not see your tournament until now.
Sorry to name my tourney with the same as yours.

Yes, a different concept. I think it would be interesting to some people, at least it is a lot of fun for me.

Best,
Carlos

[Graham Banks]

Nice concept Carlos.
http://www.kirill-kryukov.com/chess/dis ... =forgotten
Mine had a different concept.

Hi Graham,

I swear I did not see your tournament until now.
Sorry to name my tourney with the same as yours.

Yes, a different concept. I think it would be interesting to some people, at least it is a lot of fun for me.

Best,
Carlos

Just shows that great minds think alike.

[swami]

Thank you.

Interesting information about engines in 1800-2000 range of the ratings scale.

Hi Swami,

Thanks. I just downloaded your spreadsheet with the results of the engines in your STS tests. Very interesting info. Can you make another one with all engines tested so far?

Best,
Carlos

Edit:
- Surprising results for Booot 4.15 (not in a good way )
- The version of Bison is 9.8 or 9.11 ?

I just checked the list, Bison is at 9.6a. Whoops didn't update. Perhaps I will run the suite again with Bison 9.8 and see what the scores turn out to be.

Yes, Booot is one of the very rare exceptions that doesn't correspond well when subjected to test suites testing. Just like Zappa and Smarthink 0.17a with poor time management in bullet.

[Carlos777]

Update:

Code: Select all

    Engine             Score   Ja Si KM Ro Si Cu Yo My Da Oz Ro RB Ch Tr Re Mi Sj Ad Ed Nu Al Br Cl AL Na Ar Ch Xa Ge Fr Fi Da Yo Ge Jo Sa Ne Ac Po Cp    S-B
01: Jabba 1.0          50.5/58 ·· 0= 10 00 11 11 11 11 11 11 11 11 =  11 1  =  1  1  11 11 1  0  1  1  =1 =  1  11 1  1  1  1  11 11 1  11 1  1  1  1   918.00
02: Simplex 0.0        44.5/52 1= ·· 1= == 01 11 01 01 =1 11 11 11    11 =  1  0  1  11 11 =           11 1  1  11 1  1     1  11 11 1  11 1  1  1      853.75
03: KMTChess 1.1       43.5/51 01 0= ·· 11 11 11 00 11 10 11 11 10    11    1  =  1  11 11 1  1     =  11 1     11    1     1  11 11 1  11    1  1  1   834.50
04: Roce 0.0390        43.5/51 11 == 00 ·· =0 10 1= 10 11 11 11 11    1=    1  1  1  11 11 1        1  11    1  11 1     1  1  11 11 1  11 1  1  1      794.25
05: Sissa 1.00         42.5/54 00 10 00 =1 ·· 11 1= =0 11 10 11 11 0  11 =  0  1     11 11 1  1  1  1  11 1  =  11 1  1     1  11 11 1  11       1  1   749.25
06: Cuckoo Chess 1.0   37.5/52 00 00 00 01 00 ·· 11 =1 11 01 10 11    11    1  =  0  11 11          1  11 =  1  11 1  1  1  0  11 11 1  11    1  1  1   594.50
07: Yoda 1.30          36.0/51 00 10 11 0= 0= 00 ·· 11 =0 =1 =1 11 0  11 =     0     11 10 1  1  0     11 1     11 1  1  1     11 11 1  11 1  1         630.75
08: Myrddin 0.81a2     34.0/50 00 10 00 01 =1 =0 00 ·· 11 =1 11 =0    11    0  0     11 11 0        1  11 1  1  11 0  1     1  11 11 1  11    1  1      572.00
09: Dabbaba 2.46       30.5/52 00 =0 01 00 00 00 =1 00 ·· 11 1= 10 1  11    =  0  0  11 01    1     1  11 0  0  11    =  1  0  11 11 1  11 1     1      471.50
10: Ozwald 0.43        25.5/48 00 00 00 00 01 10 =0 =0 00 ·· == 01    1= 0        0  11 11 0           =1    0  11 1     1  =  11 11 1  11 1  1         360.75
11: Rocinante 1.01     24.0/50 00 00 00 00 00 01 =0 00 0= == ·· 00    11 0        1  0= 11 1  0  0  0  11 0     11 =     1     11 11 1  11 1  1         308.25
12: RBrChess 2.16      22.5/51 00 00 01 00 00 00 00 =1 01 10 11 ·· 0  00    0  0  0  00 11    =  =  0  11 0     11 0  0        11 11 1  11 1  1         336.50
13: Chesley r317 ja    18.0/21 =           1     1     0        1  ·· 1     1  0     1  1     1  =  1     1           1        1  1  1  1        1  1   272.75
14: Trex 1.9           18.0/52 00 00 00 0= 00 00 00 00 00 0= 00 11 0  ·· 0     =  1  01 00    0  0  0  01 =     01 1     1     11 01 0  11 1  1  1      201.00
15: Reger 0.09         17.5/23 0  =        =     =        1  1        1  ·· 0     1  1     =           1     =  1  0     1  1  1  1     1  1  1  1      235.50
16: Micro-Max 4.8w     17.0/24 =  0  0  0  1  0     1  =        1  0     1  ·· 1     1        1  1  =  1  1     1     =  1           1  1        1      282.00
17: Sjakk 1.1.3        16.0/23 0  1  =  0  0  =  1  1  1        1  1  =     0  ··       1     =  0  1     1     1     1              1     1     1      310.50
18: Adamant 1.7        16.0/24 0  0  0  0     1        1  1  0  1     0  0        ·· 1     1           1     0  1  1     1  1  1  1        1  1     1   213.50
19: Eden 0.013         16.0/49 00 00 00 00 00 00 00 00 00 00 1= 11 0  10 0  0     0  ·· 01 0  0        01 0     11 0     0     1= 11    11 1  1         185.25
20: Numpty 0.5pr       15.5/48 00 00 00 00 00 00 01 00 10 00 00 00 0  11       0     10 ··    0  0  0  =0 0     10    =        11 11 =  11    1  1      181.50
21: Alibaba 1.17       14.5/23 0  =  0  0  0     0  1     1  0           =        0  1     ··          1     =  1  1     1  1  1  1     1  1  1         183.75
22: Brembo 0.62        14.0/22 1     0     0     0     0     1  =  0  1     0  =     1  1     ·· 1  1     =           =     1     1  1  1        1      206.00
23: Cleo 1             14.0/20 0           0     1           1  =  =  1     0  1        1     0  ·· 1     0           1        1  1  1  1        1  1   176.75
24: ALChess1.5b        12.5/24 0     =  0  0  0     0  0     1  1  0  1     =  0        1     0  0  ··    1     1     =        1  1  1  1        1      162.50
25: Nanook 0.17        12.5/48 =0 00 00 00 00 00 00 00 00 =0 00 00    10 0  0     0  10 =1 0           ··    0  11 =     1  0  == == 0  1=    1         151.50
26: ArabianKnight 0.88 12.0/23 =  0  0     0  =  0  0  1     1  1  0  =     0  0     1  1     =  1  0     ··          1              1  1        1      202.50
27: Chessrikus 1.466   11.5/19 0  0     0  =  0     0  1  1              =        1        =           1     ·· 1  1     0  1     1        1  1         160.25
28: Xadreco 5.7        10.5/52 00 00 00 00 00 00 00 00 00 00 00 00    10 0  0  0  0  00 01 0        0  00    0  ··    0  0  0  1= 11 0  11    1  1  1    68.25
29: Gedeone 1620       10.0/23 0  0     0  0  0  0  1     0  =  1     0  1        0  1     0           =     0     ··    =  =  1  1        1  1         134.00
30: Frittle 0.5        9.5/23  0  0  0     0  0  0  0  =        1  0        =  0        =     =  0  =     0     1     ··       1  1  1  1        1      102.75
31: Fimbulwinter 5.02  8.5/23  0        0     0  0     0  0  0        0  0  0     0  1     0           0     1  1  =     ·· 0  1  1     1  1  1          65.00
32: Damas9             8.0/20  0  0  0  0  0  1     0  1  =              0        0        0  0        1     0  1  =     1  ··             1  1         120.25
33: Youk 1.05          7.5/50  00 00 00 00 00 00 00 00 00 00 00 00 0  00 0        0  0= 00 0     0  0  ==       0= 0  0  0     ·· 10 1  =1 1  1          48.50
34: Geko 0.43          7.0/52  00 00 00 00 00 00 00 00 00 00 00 00 0  10 0        0  00 00 0  0  0  0  ==    0  00 0  0  0     01 ··    == 1  1  1       45.50
35: Joana_DC no book   6.0/28  0  0  0  0  0  0  0  0  0  0  0  0  0  1     0  0        =     0  0  0  1  0     1     0        0     ·· =     1  1       51.50
36: Sachy 0.2.01       4.5/52  00 00 00 00 00 00 00 00 00 00 00 00 0  00 0  0        00 00 0  0  0  0  0= 0     00    0  0     =0 == =  ·· =  =  1       21.50
37: Neg 0.3d           2.5/23  0  0     0        0     0  0  0  0     0  0     0  0  0     0                 0     0     0  0  0  0     =  ·· 1  1        2.75
38: Ace v0.1           0.5/27  0  0  0  0     0  0  0     0  0  0     0  0        0  0  0  0           0     0  0  0     0  0  0  0  0  =  0  ··          2.25
39: Pos-1.20           0.0/24  0  0  0  0  0  0     0  0           0  0  0  0  0        0     0  0  0     0     0     0           0  0  0  0     ··       0.00
39: Cpp1               0.0/8   0     0     0  0                    0              0              0              0                                   ··    0.00

734 of 1560 games played

Cheoss 0.649 was removed due losses on time (5 out of 14 games = 35.7%,) some times early in the game (apparently illegal moves. BTW, anybody know how to save the debug files automatically in Arena?)

Cpp1 replaced Cheoss.

Buggy engines still in the tournament (I will take a decision about them later)

- Joana DC by Juan Pablo Mendoza (when playing with white pieces does not accept opponent's short castle and loses by time. 4 losses on time out of 25 games.)
- Yoda 1.30 does not accept opponent's underpromotion to other piece different of a queen.

So far, these engines are disqualified of the tournament:

Not working under Arena: (if someone has an idea on how to make them work, please reply)

ChessV 0.94

Lose on time:

Alice 0.3.5
Blitzkibitz rev4
Cheoss 0.649
Hippocampe 0.4.2
Mainsworthy 64.01.7
NSVChess 0.14
Suff 0.3a

Illegal moves:

Dendron 0.42ja (castles under check)

Always ponder:

Apilchess 1.05-r1b ja
Braincrack alpha JA
CPW 050908ja
Plisk 0.12

Crash:

Chess0 v0.3.2

Do not support x+y time management:

Chad's Chess 0.15

[Richard Allbert]

Jabba better than expected.

Thanks a lot for the result, I'll post it on my blog

Regards

Richard

[Carlos777]

Jabba better than expected.

Thanks a lot for the result, I'll post it on my blog

Regards

Richard

Hi Richard,

Not at all, Jabba is a nice engine.

Jabba was one of the first programs I was testing (before the "real" tournament began). I opted for keeping it in the tournament, in spite of the strenght showed until then.

Here is a logo for Jabba: (thanks to David Dahlem)



I am thinking about testing Lime, but I am afraid it would be too strong for this field. What do you think?

Regards,
Carlos

PS:

More logos from David:

Cuckoo Chess


Stockfish 1.6s

[Sven]

Thank you.

Interesting information about engines in 1800-2000 range of the ratings scale.

In fact it is even slightly below that:

The conditions to participate are:

1. Engines should have an approx. ELO of 1700 or lower.

which by no means makes it less interesting, of course.

Sven

[Richard Allbert]

Yes, I think Lime is too strong for the list!

[swami]

Thank you.

Interesting information about engines in 1800-2000 range of the ratings scale.

In fact it is even slightly below that:

The conditions to participate are:

1. Engines should have an approx. ELO of 1700 or lower.

which by no means makes it less interesting, of course.

Sven

Yes, I hadn't read that until later.

I did see the top 2 Jabba and KMTChess in there and thought these engines were around 2000 and ones below them were probably around 1800. Hence my assumption 1800-2000.

[Carlos777]

Yes, I think Lime is too strong for the list!

Ok Richard, thanks.

Update

Current crosstable:

Code: Select all

    Engine             Score   Ja Si KM Ro Si Yo Cu My Da Ch Mi Re Sj Oz Ro Br Cl Ad RB Ar Ch Al AL Da Tr Ed Fr Nu Ge Na Xa Jo Fi Yo Ge Sa Ne Ac Po Cp    S-B
01: Jabba 1.0          50.5/58 ·· 0= 10 00 11 11 11 11 11 =  =  1  1  11 11 0  1  1  11 =  1  1  1  1  11 11 1  11 1  =1 11 1  1  11 11 11 1  1  1  1   1135.2
02: Simplex 0.0        49.5/57 1= ·· 1= == 01 01 11 01 =1 1  1  =  0  11 11 1  1  1  11 1  1  =     1  11 11 1  11 1  11 11 1  1  11 11 11 1  1  1  1   1112.7
03: KMTChess 1.1       49.0/57 01 0= ·· 11 11 00 11 11 10 =  1  1  =  11 11 1  1  1  10 1     1  =  1  11 11 1  11 1  11 11 1  1  11 11 11 1  1  1  1   1102.5
04: Roce 0.0390        47.5/57 11 == 00 ·· =0 1= 10 10 11 0  1  =  1  11 11 1  1  1  11 =  1  1  1  1  1= 11    11 1  11 11 1  1  11 11 11 1  1  1  1   1031.7
05: Sissa 1.00         46.5/58 00 10 00 =1 ·· 1= 11 =0 11 0  0  =  1  10 11 1  1  1  11 1  =  1  1  1  11 11 1  11 1  11 11 1  1  11 11 11 1  1  1  1   970.50
06: Yoda 1.30          40.5/57 00 10 11 0= 0= ·· 00 11 =0 0  0  =  0  =1 =1 1  0     11 1  1  1  =  1  11 11 1  10 1  11 11 1  1  11 11 11 1  1  1  1   815.75
07: Cuckoo Chess 1.0   40.5/58 00 00 00 01 00 11 ·· =1 11 0  1  0  =  01 10 0  1  0  11 =  1  1  1  0  11 11 1  11 1  11 11 1  1  11 11 11 1  1  1  1   777.00
08: Myrddin 0.81a2     39.0/57 00 10 00 01 =1 00 =0 ·· 11 =  0  0  0  =1 11    =  1  =0 1  1  0  1  1  11 11 1  11 0  11 11 1  1  11 11 11 1  1  1  1   762.00
09: Dabbaba 2.46       33.5/58 00 =0 01 00 00 =1 00 00 ·· 1  =  0  0  11 1= 1  0  0  10 0  0  0  1  0  11 11 =  01 1  11 11 1  1  11 11 11 1  1  1  1   593.50
10: Chesley r317 ja    31.0/38 =  0  =  1  1  1  1  =  0  ·· 1  0  0  1     1  =  0  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1   644.25
11: Micro-Max 4.8w     29.0/37 =  0  0  0  1  1  0  1  =  0  ·· 1  1     1  1  1  1  1  1  1  1  =  0  1  1  =  1  1  1  1  1  1  1  1  1  1     1  1   589.00
12: Reger 0.09         28.5/37 0  =  0  =  =  =  1  1  1  1  0  ·· 1  1  1  1  0  1     =  =  =  1  1  1  1  1     0  1  1  1  1  1  1  1  1  1  1  1   584.00
13: Sjakk 1.1.3        28.5/38 0  1  =  0  0  1  =  1  1  1  0  0  ·· 1  1  =  0  =  1  1  1  1  1  0  =  1  1  1  1     1  1  1  1  1  1  1  1  1  1   578.50
14: Ozwald 0.43        28.5/56 00 00 00 00 01 =0 10 =0 00 0     0  0  ·· == 1  =  0  01 =  0  0  0  =  1= 11 0  11 1  =1 11 1  1  11 11 11 1  1     1   471.50
15: Rocinante 1.01     27.0/57 00 00 00 00 00 =0 01 00 0=    0  0  0  == ·· 0  0  1  00 0  0  1  0  =  11 0= =  11 =  11 11 1  1  11 11 11 1  1  1  1   389.75
16: Brembo 0.62        26.0/38 1  0  0  0  0  0  1     0  0  0  0  =  0  1  ·· 1  1  =  =  1  1  1  1  1  1  =  1  1  1  1  1  1  1  1  1  1  1  1  1   453.25
17: Cleo 1             25.0/38 0  0  0  0  0  1  0  =  1  =  0  1  1  =  1  0  ·· 0  =  0  1  0  1  1  1     1  1  1  1  1  1  1  1  1  1  1  1  1  1   434.00
18: Adamant 1.7        25.0/38 0  0  0  0  0     1  0  1  1  0  0  =  1  0  0  1  ·· 1  1  0  1  =  1  0  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1   421.25
19: RBrChess 2.16      24.5/56 00 00 01 00 00 00 00 =1 01 0  0     0  10 11 =  =  0  ·· 0  0  0  0  0  00 00 0  11 0  11 11 1     11 11 11 1  1  1  1   397.00
20: ArabianKnight 0.88 23.5/38 =  0  0  =  0  0  =  0  1  0  0  =  0  =  1  =  1  0  1  ·· 1  1  0  =  =  1  1  1  1  1     1  =  1  1  1  1  1  1  1   416.00
21: Chessrikus 1.466   23.5/38 0  0     0  =  0  0  0  1  0  0  =  0  1  1  0  0  1  1  0  ·· =  1  1  1  1  1  1  1  1  1  1  0  1  1  1  1  1  1  1   386.00
22: Alibaba 1.17       23.0/38 0  =  0  0  0  0  0  1  1  0  0  =  0  1  0  0  1  0  1  0  =  ·· =  1     1  1  1  1  1  1  1  1  1  1  1  1  1  1  1   378.75
23: ALChess1.5b        23.0/38 0     =  0  0  =  0  0  0  0  =  0  0  1  1  0  0  =  1  1  0  =  ·· 1  1  1  =  1  1  1  1  1  1  1  1  1  1  1  1  1   364.25
24: Damas9             21.0/39 0  0  0  0  0  0  1  0  1  0  1  0  1  =  =  0  0  0  1  =  0  0  0  ·· 0  1  1  1  =  1  1  1  1  1  1  1  1  1  1  1   333.50
25: Trex 1.9           20.5/57 00 00 00 0= 00 00 00 00 00 0  0  0  =  0= 00 0  0  1  11 =  0     0  1  ·· 01 =  00 1  01 01 0  1  11 01 11 1  1  1  1   281.50
26: Eden 0.013         18.5/57 00 00 00 00 00 00 00 00 00 0  0  0  0  00 1= 0     0  11 0  0  0  0  0  10 ·· =  01 0  01 11 0  0  1= 11 11 1  1  1  1   220.25
27: Frittle 0.5        18.0/38 0  0  0     0  0  0  0  =  0  =  0  0  1  =  =  0  0  1  0  0  0  =  0  =  =  ·· =  1  1  1  1  1  1  1  1  1  1  1  1   241.50
28: Numpty 0.5pr       17.5/56 00 00 00 00 00 01 00 00 10 0  0     0  00 00 0  0  0  00 0  0  0  0  0  11 10 =  ·· 0  =0 10 =  1  11 11 11    1  1  1   225.25
29: Gedeone 1620       14.0/38 0  0  0  0  0  0  0  1  0  0  0  1  0  0  =  0  0  0  1  0  0  0  0  =  0  1  0  1  ·· =  1  0  =  1  1     1  1  1  1   200.25
30: Nanook 0.17        13.5/56 =0 00 00 00 00 00 00 00 00 0  0  0     =0 00 0  0  0  00 0  0  0  0  0  10 10 0  =1 =  ·· 11 0  1  == == 1= =  1     =   174.50
31: Xadreco 5.7        11.5/57 00 00 00 00 00 00 00 00 00 0  0  0  0  00 00 0  0  0  00    0  0  0  0  10 00 0  01 0  00 ·· 0  0  1= 11 11 1  1  1  1    85.25
32: Joana_DC           11.0/38 0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  1  1  0  =  1  1  1  ·· 1  0  1  =     1  1  1   111.50
33: Fimbulwinter 5.02  11.0/38 0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0     =  1  0  0  0  0  1  0  0  =  0  1  0  ·· 1  1  1  1  1  1  1   102.25
34: Youk 1.05          9.5/58  00 00 00 00 00 00 00 00 00 0  0  0  0  00 00 0  0  0  00 0  0  0  0  0  00 0= 0  00 0  == 0= 1  0  ·· 10 =1 1  1  1  1    62.75
35: Geko 0.43          7.0/57  00 00 00 00 00 00 00 00 00 0  0  0  0  00 00 0  0  0  00 0  0  0  0  0  10 00 0  00 0  == 00 0  0  01 ·· == 1  1  1       56.00
36: Sachy 0.2.01       5.5/57  00 00 00 00 00 00 00 00 00 0  0  0  0  00 00 0  0  0  00 0  0  0  0  0  00 00 0  00    0= 00 =  0  =0 == ·· =  =  1  1    29.25
37: Neg 0.3d           4.0/37  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0     0  =  0     0  0  0  =  ·· 1  1  1    13.50
38: Ace v0.1           1.5/38  0  0  0  0  0  0  0  0  0  0     0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  =  0  ·· =  =     4.00
39: Pos-1.20           1.5/37  0  0  0  0  0  0  0  0  0  0  0  0  0     0  0  0  0  0  0  0  0  0  0  0  0  0  0  0     0  0  0  0  0  0  0  =  ·· 1     1.75
40: Cpp1               1.0/38  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  =  0  0  0  0     0  0  =  0  ··    7.50

949 of 1560 games played

Buggy engines still in the tournament (I will take a decision about them later)

- Joana DC by Juan Pablo Mendoza (when playing with white pieces does not accept opponent's short castle and loses by time. 5 losses on time out of 38 games.)
- Yoda 1.30 does not accept opponent's underpromotion to other piece different of a queen. (as this happens ocasionally, Yoda won't appear in this list in the next update. Anyway, it seems Yoda is going to be removed at the end of the cycle being at the top10 right now.)

Regards,
Carlos

PS: I will travel in few hours, therefore I'll be far from my PC for some days. So, next update will be in 6 or 7 days.