Thank you.
Interesting information about engines in 1800-2000 range of the ratings scale.
Battle of the Forgotten
Moderators: hgm, Rebel, chrisw
-
- Posts: 1730
- Joined: Sun Dec 13, 2009 6:09 pm
Re: Battle of the Forgotten
Hi Swami,swami wrote:Thank you.
Interesting information about engines in 1800-2000 range of the ratings scale.
Thanks. I just downloaded your spreadsheet with the results of the engines in your STS tests. Very interesting info. Can you make another one with all engines tested so far?
Best,
Carlos
Edit:
- Surprising results for Booot 4.15 (not in a good way )
- The version of Bison is 9.8 or 9.11 ?
Last edited by Carlos777 on Sat Jan 16, 2010 6:42 am, edited 1 time in total.
-
- Posts: 41423
- Joined: Sun Feb 26, 2006 10:52 am
- Location: Auckland, NZ
Re: Battle of the Forgotten
Nice concept Carlos.
http://www.kirill-kryukov.com/chess/dis ... =forgotten
Mine had a different concept.
http://www.kirill-kryukov.com/chess/dis ... =forgotten
Mine had a different concept.
Last edited by Graham Banks on Sat Jan 16, 2010 6:41 am, edited 1 time in total.
gbanksnz at gmail.com
-
- Posts: 6640
- Joined: Thu Mar 09, 2006 4:21 am
Re: Battle of the Forgotten
Yes, I'm working on it. I hope to get around to finally testing engines in lower order, and add them to the list.Carlos777 wrote:Hi Swami,swami wrote:Thank you.
Interesting information about engines in 1800-2000 range of the ratings scale.
Thanks. I just downloaded your spreadsheet with the results of the engines in your STS tests. Very interesting info. Can you make another one with all engines tested so far?
Best,
Carlos
-
- Posts: 1730
- Joined: Sun Dec 13, 2009 6:09 pm
Re: Battle of the Forgotten
Hi Graham,Graham Banks wrote:Nice concept Carlos.
http://www.kirill-kryukov.com/chess/dis ... =forgotten
Mine had a different concept.
I swear I did not see your tournament until now.
Sorry to name my tourney with the same as yours.
Yes, a different concept. I think it would be interesting to some people, at least it is a lot of fun for me.
Best,
Carlos
-
- Posts: 41423
- Joined: Sun Feb 26, 2006 10:52 am
- Location: Auckland, NZ
Re: Battle of the Forgotten
Just shows that great minds think alike.Carlos777 wrote:Hi Graham,Graham Banks wrote:Nice concept Carlos.
http://www.kirill-kryukov.com/chess/dis ... =forgotten
Mine had a different concept.
I swear I did not see your tournament until now.
Sorry to name my tourney with the same as yours.
Yes, a different concept. I think it would be interesting to some people, at least it is a lot of fun for me.
Best,
Carlos
gbanksnz at gmail.com
-
- Posts: 6640
- Joined: Thu Mar 09, 2006 4:21 am
Re: Battle of the Forgotten
I just checked the list, Bison is at 9.6a. Whoops didn't update. Perhaps I will run the suite again with Bison 9.8 and see what the scores turn out to be.Carlos777 wrote:Hi Swami,swami wrote:Thank you.
Interesting information about engines in 1800-2000 range of the ratings scale.
Thanks. I just downloaded your spreadsheet with the results of the engines in your STS tests. Very interesting info. Can you make another one with all engines tested so far?
Best,
Carlos
Edit:
- Surprising results for Booot 4.15 (not in a good way )
- The version of Bison is 9.8 or 9.11 ?
Yes, Booot is one of the very rare exceptions that doesn't correspond well when subjected to test suites testing. Just like Zappa and Smarthink 0.17a with poor time management in bullet.
-
- Posts: 1730
- Joined: Sun Dec 13, 2009 6:09 pm
Re: Battle of the Forgotten
Update:
Cheoss 0.649 was removed due losses on time (5 out of 14 games = 35.7%,) some times early in the game (apparently illegal moves. BTW, anybody know how to save the debug files automatically in Arena?)
Cpp1 replaced Cheoss.
Buggy engines still in the tournament (I will take a decision about them later)
- Joana DC by Juan Pablo Mendoza (when playing with white pieces does not accept opponent's short castle and loses by time. 4 losses on time out of 25 games.)
- Yoda 1.30 does not accept opponent's underpromotion to other piece different of a queen.
So far, these engines are disqualified of the tournament:
Not working under Arena: (if someone has an idea on how to make them work, please reply)
ChessV 0.94
Lose on time:
Alice 0.3.5
Blitzkibitz rev4
Cheoss 0.649
Hippocampe 0.4.2
Mainsworthy 64.01.7
NSVChess 0.14
Suff 0.3a
Illegal moves:
Dendron 0.42ja (castles under check)
Always ponder:
Apilchess 1.05-r1b ja
Braincrack alpha JA
CPW 050908ja
Plisk 0.12
Crash:
Chess0 v0.3.2
Do not support x+y time management:
Chad's Chess 0.15
Code: Select all
Engine Score Ja Si KM Ro Si Cu Yo My Da Oz Ro RB Ch Tr Re Mi Sj Ad Ed Nu Al Br Cl AL Na Ar Ch Xa Ge Fr Fi Da Yo Ge Jo Sa Ne Ac Po Cp S-B
01: Jabba 1.0 50.5/58 ·· 0= 10 00 11 11 11 11 11 11 11 11 = 11 1 = 1 1 11 11 1 0 1 1 =1 = 1 11 1 1 1 1 11 11 1 11 1 1 1 1 918.00
02: Simplex 0.0 44.5/52 1= ·· 1= == 01 11 01 01 =1 11 11 11 11 = 1 0 1 11 11 = 11 1 1 11 1 1 1 11 11 1 11 1 1 1 853.75
03: KMTChess 1.1 43.5/51 01 0= ·· 11 11 11 00 11 10 11 11 10 11 1 = 1 11 11 1 1 = 11 1 11 1 1 11 11 1 11 1 1 1 834.50
04: Roce 0.0390 43.5/51 11 == 00 ·· =0 10 1= 10 11 11 11 11 1= 1 1 1 11 11 1 1 11 1 11 1 1 1 11 11 1 11 1 1 1 794.25
05: Sissa 1.00 42.5/54 00 10 00 =1 ·· 11 1= =0 11 10 11 11 0 11 = 0 1 11 11 1 1 1 1 11 1 = 11 1 1 1 11 11 1 11 1 1 749.25
06: Cuckoo Chess 1.0 37.5/52 00 00 00 01 00 ·· 11 =1 11 01 10 11 11 1 = 0 11 11 1 11 = 1 11 1 1 1 0 11 11 1 11 1 1 1 594.50
07: Yoda 1.30 36.0/51 00 10 11 0= 0= 00 ·· 11 =0 =1 =1 11 0 11 = 0 11 10 1 1 0 11 1 11 1 1 1 11 11 1 11 1 1 630.75
08: Myrddin 0.81a2 34.0/50 00 10 00 01 =1 =0 00 ·· 11 =1 11 =0 11 0 0 11 11 0 1 11 1 1 11 0 1 1 11 11 1 11 1 1 572.00
09: Dabbaba 2.46 30.5/52 00 =0 01 00 00 00 =1 00 ·· 11 1= 10 1 11 = 0 0 11 01 1 1 11 0 0 11 = 1 0 11 11 1 11 1 1 471.50
10: Ozwald 0.43 25.5/48 00 00 00 00 01 10 =0 =0 00 ·· == 01 1= 0 0 11 11 0 =1 0 11 1 1 = 11 11 1 11 1 1 360.75
11: Rocinante 1.01 24.0/50 00 00 00 00 00 01 =0 00 0= == ·· 00 11 0 1 0= 11 1 0 0 0 11 0 11 = 1 11 11 1 11 1 1 308.25
12: RBrChess 2.16 22.5/51 00 00 01 00 00 00 00 =1 01 10 11 ·· 0 00 0 0 0 00 11 = = 0 11 0 11 0 0 11 11 1 11 1 1 336.50
13: Chesley r317 ja 18.0/21 = 1 1 0 1 ·· 1 1 0 1 1 1 = 1 1 1 1 1 1 1 1 1 272.75
14: Trex 1.9 18.0/52 00 00 00 0= 00 00 00 00 00 0= 00 11 0 ·· 0 = 1 01 00 0 0 0 01 = 01 1 1 11 01 0 11 1 1 1 201.00
15: Reger 0.09 17.5/23 0 = = = 1 1 1 ·· 0 1 1 = 1 = 1 0 1 1 1 1 1 1 1 1 235.50
16: Micro-Max 4.8w 17.0/24 = 0 0 0 1 0 1 = 1 0 1 ·· 1 1 1 1 = 1 1 1 = 1 1 1 1 282.00
17: Sjakk 1.1.3 16.0/23 0 1 = 0 0 = 1 1 1 1 1 = 0 ·· 1 = 0 1 1 1 1 1 1 1 310.50
18: Adamant 1.7 16.0/24 0 0 0 0 1 1 1 0 1 0 0 ·· 1 1 1 0 1 1 1 1 1 1 1 1 1 213.50
19: Eden 0.013 16.0/49 00 00 00 00 00 00 00 00 00 00 1= 11 0 10 0 0 0 ·· 01 0 0 01 0 11 0 0 1= 11 11 1 1 185.25
20: Numpty 0.5pr 15.5/48 00 00 00 00 00 00 01 00 10 00 00 00 0 11 0 10 ·· 0 0 0 =0 0 10 = 11 11 = 11 1 1 181.50
21: Alibaba 1.17 14.5/23 0 = 0 0 0 0 1 1 0 = 0 1 ·· 1 = 1 1 1 1 1 1 1 1 1 183.75
22: Brembo 0.62 14.0/22 1 0 0 0 0 1 = 0 1 0 = 1 1 ·· 1 1 = = 1 1 1 1 1 206.00
23: Cleo 1 14.0/20 0 0 1 1 = = 1 0 1 1 0 ·· 1 0 1 1 1 1 1 1 1 176.75
24: ALChess1.5b 12.5/24 0 = 0 0 0 0 0 1 1 0 1 = 0 1 0 0 ·· 1 1 = 1 1 1 1 1 162.50
25: Nanook 0.17 12.5/48 =0 00 00 00 00 00 00 00 00 =0 00 00 10 0 0 0 10 =1 0 ·· 0 11 = 1 0 == == 0 1= 1 151.50
26: ArabianKnight 0.88 12.0/23 = 0 0 0 = 0 0 1 1 1 0 = 0 0 1 1 = 1 0 ·· 1 1 1 1 202.50
27: Chessrikus 1.466 11.5/19 0 0 0 = 0 0 1 1 = 1 = 1 ·· 1 1 0 1 1 1 1 160.25
28: Xadreco 5.7 10.5/52 00 00 00 00 00 00 00 00 00 00 00 00 10 0 0 0 0 00 01 0 0 00 0 ·· 0 0 0 1= 11 0 11 1 1 1 68.25
29: Gedeone 1620 10.0/23 0 0 0 0 0 0 1 0 = 1 0 1 0 1 0 = 0 ·· = = 1 1 1 1 134.00
30: Frittle 0.5 9.5/23 0 0 0 0 0 0 0 = 1 0 = 0 = = 0 = 0 1 ·· 1 1 1 1 1 102.75
31: Fimbulwinter 5.02 8.5/23 0 0 0 0 0 0 0 0 0 0 0 1 0 0 1 1 = ·· 0 1 1 1 1 1 65.00
32: Damas9 8.0/20 0 0 0 0 0 1 0 1 = 0 0 0 0 1 0 1 = 1 ·· 1 1 120.25
33: Youk 1.05 7.5/50 00 00 00 00 00 00 00 00 00 00 00 00 0 00 0 0 0= 00 0 0 0 == 0= 0 0 0 ·· 10 1 =1 1 1 48.50
34: Geko 0.43 7.0/52 00 00 00 00 00 00 00 00 00 00 00 00 0 10 0 0 00 00 0 0 0 0 == 0 00 0 0 0 01 ·· == 1 1 1 45.50
35: Joana_DC no book 6.0/28 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 = 0 0 0 1 0 1 0 0 ·· = 1 1 51.50
36: Sachy 0.2.01 4.5/52 00 00 00 00 00 00 00 00 00 00 00 00 0 00 0 0 00 00 0 0 0 0 0= 0 00 0 0 =0 == = ·· = = 1 21.50
37: Neg 0.3d 2.5/23 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 = ·· 1 1 2.75
38: Ace v0.1 0.5/27 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 = 0 ·· 2.25
39: Pos-1.20 0.0/24 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ·· 0.00
39: Cpp1 0.0/8 0 0 0 0 0 0 0 0 ·· 0.00
734 of 1560 games played
Cpp1 replaced Cheoss.
Buggy engines still in the tournament (I will take a decision about them later)
- Joana DC by Juan Pablo Mendoza (when playing with white pieces does not accept opponent's short castle and loses by time. 4 losses on time out of 25 games.)
- Yoda 1.30 does not accept opponent's underpromotion to other piece different of a queen.
So far, these engines are disqualified of the tournament:
Not working under Arena: (if someone has an idea on how to make them work, please reply)
ChessV 0.94
Lose on time:
Alice 0.3.5
Blitzkibitz rev4
Cheoss 0.649
Hippocampe 0.4.2
Mainsworthy 64.01.7
NSVChess 0.14
Suff 0.3a
Illegal moves:
Dendron 0.42ja (castles under check)
Always ponder:
Apilchess 1.05-r1b ja
Braincrack alpha JA
CPW 050908ja
Plisk 0.12
Crash:
Chess0 v0.3.2
Do not support x+y time management:
Chad's Chess 0.15
-
- Posts: 792
- Joined: Wed Jul 19, 2006 9:58 am
Re: Battle of the Forgotten
Jabba better than expected.
Thanks a lot for the result, I'll post it on my blog
Regards
Richard
-
- Posts: 1730
- Joined: Sun Dec 13, 2009 6:09 pm
Re: Battle of the Forgotten
Hi Richard,Richard Allbert wrote:
Jabba better than expected.
Thanks a lot for the result, I'll post it on my blog
Regards
Richard
Not at all, Jabba is a nice engine.
Jabba was one of the first programs I was testing (before the "real" tournament began). I opted for keeping it in the tournament, in spite of the strenght showed until then.
Here is a logo for Jabba: (thanks to David Dahlem)
I am thinking about testing Lime, but I am afraid it would be too strong for this field. What do you think?
Regards,
Carlos
PS:
More logos from David:
Cuckoo Chess
Stockfish 1.6s