Battle of the Forgotten

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

Carlos777
Posts: 1729
Joined: Sun Dec 13, 2009 6:09 pm

Re: Battle of the Forgotten

Post by Carlos777 »

Richard Allbert wrote:Yes, I think Lime is too strong for the list!
Ok Richard, thanks.

Update

Current crosstable:

Code: Select all

    Engine             Score   Ja Si KM Ro Si Yo Cu My Da Ch Mi Re Sj Oz Ro Br Cl Ad RB Ar Ch Al AL Da Tr Ed Fr Nu Ge Na Xa Jo Fi Yo Ge Sa Ne Ac Po Cp    S-B
01: Jabba 1.0          50.5/58 ·· 0= 10 00 11 11 11 11 11 =  =  1  1  11 11 0  1  1  11 =  1  1  1  1  11 11 1  11 1  =1 11 1  1  11 11 11 1  1  1  1   1135.2
02: Simplex 0.0        49.5/57 1= ·· 1= == 01 01 11 01 =1 1  1  =  0  11 11 1  1  1  11 1  1  =     1  11 11 1  11 1  11 11 1  1  11 11 11 1  1  1  1   1112.7
03: KMTChess 1.1       49.0/57 01 0= ·· 11 11 00 11 11 10 =  1  1  =  11 11 1  1  1  10 1     1  =  1  11 11 1  11 1  11 11 1  1  11 11 11 1  1  1  1   1102.5
04: Roce 0.0390        47.5/57 11 == 00 ·· =0 1= 10 10 11 0  1  =  1  11 11 1  1  1  11 =  1  1  1  1  1= 11    11 1  11 11 1  1  11 11 11 1  1  1  1   1031.7
05: Sissa 1.00         46.5/58 00 10 00 =1 ·· 1= 11 =0 11 0  0  =  1  10 11 1  1  1  11 1  =  1  1  1  11 11 1  11 1  11 11 1  1  11 11 11 1  1  1  1   970.50
06: Yoda 1.30          40.5/57 00 10 11 0= 0= ·· 00 11 =0 0  0  =  0  =1 =1 1  0     11 1  1  1  =  1  11 11 1  10 1  11 11 1  1  11 11 11 1  1  1  1   815.75
07: Cuckoo Chess 1.0   40.5/58 00 00 00 01 00 11 ·· =1 11 0  1  0  =  01 10 0  1  0  11 =  1  1  1  0  11 11 1  11 1  11 11 1  1  11 11 11 1  1  1  1   777.00
08: Myrddin 0.81a2     39.0/57 00 10 00 01 =1 00 =0 ·· 11 =  0  0  0  =1 11    =  1  =0 1  1  0  1  1  11 11 1  11 0  11 11 1  1  11 11 11 1  1  1  1   762.00
09: Dabbaba 2.46       33.5/58 00 =0 01 00 00 =1 00 00 ·· 1  =  0  0  11 1= 1  0  0  10 0  0  0  1  0  11 11 =  01 1  11 11 1  1  11 11 11 1  1  1  1   593.50
10: Chesley r317 ja    31.0/38 =  0  =  1  1  1  1  =  0  ·· 1  0  0  1     1  =  0  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1   644.25
11: Micro-Max 4.8w     29.0/37 =  0  0  0  1  1  0  1  =  0  ·· 1  1     1  1  1  1  1  1  1  1  =  0  1  1  =  1  1  1  1  1  1  1  1  1  1     1  1   589.00
12: Reger 0.09         28.5/37 0  =  0  =  =  =  1  1  1  1  0  ·· 1  1  1  1  0  1     =  =  =  1  1  1  1  1     0  1  1  1  1  1  1  1  1  1  1  1   584.00
13: Sjakk 1.1.3        28.5/38 0  1  =  0  0  1  =  1  1  1  0  0  ·· 1  1  =  0  =  1  1  1  1  1  0  =  1  1  1  1     1  1  1  1  1  1  1  1  1  1   578.50
14: Ozwald 0.43        28.5/56 00 00 00 00 01 =0 10 =0 00 0     0  0  ·· == 1  =  0  01 =  0  0  0  =  1= 11 0  11 1  =1 11 1  1  11 11 11 1  1     1   471.50
15: Rocinante 1.01     27.0/57 00 00 00 00 00 =0 01 00 0=    0  0  0  == ·· 0  0  1  00 0  0  1  0  =  11 0= =  11 =  11 11 1  1  11 11 11 1  1  1  1   389.75
16: Brembo 0.62        26.0/38 1  0  0  0  0  0  1     0  0  0  0  =  0  1  ·· 1  1  =  =  1  1  1  1  1  1  =  1  1  1  1  1  1  1  1  1  1  1  1  1   453.25
17: Cleo 1             25.0/38 0  0  0  0  0  1  0  =  1  =  0  1  1  =  1  0  ·· 0  =  0  1  0  1  1  1     1  1  1  1  1  1  1  1  1  1  1  1  1  1   434.00
18: Adamant 1.7        25.0/38 0  0  0  0  0     1  0  1  1  0  0  =  1  0  0  1  ·· 1  1  0  1  =  1  0  1  1  1  1  1  1  1  1  1  1  1  1  1  1  1   421.25
19: RBrChess 2.16      24.5/56 00 00 01 00 00 00 00 =1 01 0  0     0  10 11 =  =  0  ·· 0  0  0  0  0  00 00 0  11 0  11 11 1     11 11 11 1  1  1  1   397.00
20: ArabianKnight 0.88 23.5/38 =  0  0  =  0  0  =  0  1  0  0  =  0  =  1  =  1  0  1  ·· 1  1  0  =  =  1  1  1  1  1     1  =  1  1  1  1  1  1  1   416.00
21: Chessrikus 1.466   23.5/38 0  0     0  =  0  0  0  1  0  0  =  0  1  1  0  0  1  1  0  ·· =  1  1  1  1  1  1  1  1  1  1  0  1  1  1  1  1  1  1   386.00
22: Alibaba 1.17       23.0/38 0  =  0  0  0  0  0  1  1  0  0  =  0  1  0  0  1  0  1  0  =  ·· =  1     1  1  1  1  1  1  1  1  1  1  1  1  1  1  1   378.75
23: ALChess1.5b        23.0/38 0     =  0  0  =  0  0  0  0  =  0  0  1  1  0  0  =  1  1  0  =  ·· 1  1  1  =  1  1  1  1  1  1  1  1  1  1  1  1  1   364.25
24: Damas9             21.0/39 0  0  0  0  0  0  1  0  1  0  1  0  1  =  =  0  0  0  1  =  0  0  0  ·· 0  1  1  1  =  1  1  1  1  1  1  1  1  1  1  1   333.50
25: Trex 1.9           20.5/57 00 00 00 0= 00 00 00 00 00 0  0  0  =  0= 00 0  0  1  11 =  0     0  1  ·· 01 =  00 1  01 01 0  1  11 01 11 1  1  1  1   281.50
26: Eden 0.013         18.5/57 00 00 00 00 00 00 00 00 00 0  0  0  0  00 1= 0     0  11 0  0  0  0  0  10 ·· =  01 0  01 11 0  0  1= 11 11 1  1  1  1   220.25
27: Frittle 0.5        18.0/38 0  0  0     0  0  0  0  =  0  =  0  0  1  =  =  0  0  1  0  0  0  =  0  =  =  ·· =  1  1  1  1  1  1  1  1  1  1  1  1   241.50
28: Numpty 0.5pr       17.5/56 00 00 00 00 00 01 00 00 10 0  0     0  00 00 0  0  0  00 0  0  0  0  0  11 10 =  ·· 0  =0 10 =  1  11 11 11    1  1  1   225.25
29: Gedeone 1620       14.0/38 0  0  0  0  0  0  0  1  0  0  0  1  0  0  =  0  0  0  1  0  0  0  0  =  0  1  0  1  ·· =  1  0  =  1  1     1  1  1  1   200.25
30: Nanook 0.17        13.5/56 =0 00 00 00 00 00 00 00 00 0  0  0     =0 00 0  0  0  00 0  0  0  0  0  10 10 0  =1 =  ·· 11 0  1  == == 1= =  1     =   174.50
31: Xadreco 5.7        11.5/57 00 00 00 00 00 00 00 00 00 0  0  0  0  00 00 0  0  0  00    0  0  0  0  10 00 0  01 0  00 ·· 0  0  1= 11 11 1  1  1  1    85.25
32: Joana_DC           11.0/38 0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  1  1  0  =  1  1  1  ·· 1  0  1  =     1  1  1   111.50
33: Fimbulwinter 5.02  11.0/38 0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0     =  1  0  0  0  0  1  0  0  =  0  1  0  ·· 1  1  1  1  1  1  1   102.25
34: Youk 1.05          9.5/58  00 00 00 00 00 00 00 00 00 0  0  0  0  00 00 0  0  0  00 0  0  0  0  0  00 0= 0  00 0  == 0= 1  0  ·· 10 =1 1  1  1  1    62.75
35: Geko 0.43          7.0/57  00 00 00 00 00 00 00 00 00 0  0  0  0  00 00 0  0  0  00 0  0  0  0  0  10 00 0  00 0  == 00 0  0  01 ·· == 1  1  1       56.00
36: Sachy 0.2.01       5.5/57  00 00 00 00 00 00 00 00 00 0  0  0  0  00 00 0  0  0  00 0  0  0  0  0  00 00 0  00    0= 00 =  0  =0 == ·· =  =  1  1    29.25
37: Neg 0.3d           4.0/37  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0     0  =  0     0  0  0  =  ·· 1  1  1    13.50
38: Ace v0.1           1.5/38  0  0  0  0  0  0  0  0  0  0     0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  =  0  ·· =  =     4.00
39: Pos-1.20           1.5/37  0  0  0  0  0  0  0  0  0  0  0  0  0     0  0  0  0  0  0  0  0  0  0  0  0  0  0  0     0  0  0  0  0  0  0  =  ·· 1     1.75
40: Cpp1               1.0/38  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  =  0  0  0  0     0  0  =  0  ··    7.50

949 of 1560 games played
Buggy engines still in the tournament (I will take a decision about them later)

- Joana DC by Juan Pablo Mendoza (when playing with white pieces does not accept opponent's short castle and loses by time. 5 losses on time out of 38 games.)
- Yoda 1.30 does not accept opponent's underpromotion to other piece different of a queen. (as this happens ocasionally, Yoda won't appear in this list in the next update. Anyway, it seems Yoda is going to be removed at the end of the cycle being at the top10 right now.)

Regards,
Carlos

PS: I will travel in few hours, therefore I'll be far from my PC for some days. So, next update will be in 6 or 7 days.
Carlos777
Posts: 1729
Joined: Sun Dec 13, 2009 6:09 pm

Re: Battle of the Forgotten

Post by Carlos777 »

swami wrote: I did see the top 2 Jabba and KMTChess in there and thought these engines were around 2000 and ones below them were probably around 1800. Hence my assumption 1800-2000. :)
Hi Swami,

Yes, I did not know too much about these engines at the time. As they had already played many games, I decided to keep them. Less strong engines will compete in the next cycle (this is the goal of this peculiar tournament :wink:).

Best,
Carlos
User avatar
hgm
Posts: 27790
Joined: Fri Mar 10, 2006 10:06 am
Location: Amsterdam
Full name: H G Muller

Re: Battle of the Forgotten

Post by hgm »

Carlos777 wrote:Not working under Arena: (if someone has an idea on how to make them work, please reply)

ChessV 0.94
The engine command line for ChessV 0.94 has to be:

Code: Select all

ChessV_WinBoard "Orthodox Chess"
It seems that Arena cannot handle this (or people simply have not found out what they have to tell Arena to produce this command line when installing the engine).

Possible work-arounds are:

1) Put that command line in a batch file chessv.bat, and then install that batch file as an engine in Arena.

2) Make a ChessV .SGF file (saved-game file), say CHESS.SGF for the initial position of Orthodox Chess by saving from the stand-alone version of ChessV, or read the instructions that come with ChessV on how to make such a file for specifying variants, and follow those. Then install ChessV in Arena with the engine command:

Code: Select all

ChessV_WinBoard CHESS.SGF
so that you do not need the quotes around the argument that specifies the variant.

Even under WinBoard + PSWBTM I have to use the latter trick to make ChessV play Bird's Chess, as I have found no way yet to get the single quote in the variant name into the engine command line. With a bare WinBoard I can use /fcp={ChessV_WinBoard "Bird's Chess"}, but PSWBTM puts single quotes around the /fcp argument, and that is what makes WinBoard choke on it.
metax
Posts: 344
Joined: Wed Sep 23, 2009 5:56 pm
Location: Germany

Re: Battle of the Forgotten

Post by metax »

What is the approximate rating scale for '1700 or lower'?

In CCRL rating, I would estimate ChessMind at 1930-1950 Elo based on games against Surprise. But in other rating scales, the ratings are often lower.

However, based on games against humans, I would estimate ChessMind at 1700-1750 'human Elo'.

I think in the CCRL rating scale Jabba would have around 1980-2000 Elo or even more.
Adam Hair
Posts: 3226
Joined: Wed May 06, 2009 10:31 pm
Location: Fuquay-Varina, North Carolina

Re: Battle of the Forgotten

Post by Adam Hair »

This is great Carlos. I've been working on a rating list since August
and I am including engines of all strengths. Here is the bottom of my
list. I plan to include as many engines as I can make run on my computer
under Arena 2.01.

Code: Select all

77 Warrior_103                   -214   28   28   984   54%  -246   20% 
  78 Smash                         -248   27   27  1063   49%  -237   16% 
  79 SnailChess_4013               -252   29   29  1037   66%  -398   15% 
  80 Surprise_4.3b13               -254   28   28   970   49%  -244   16% 
  81 Clueless_14                   -278   28   28   984   46%  -241   11% 
  82 Embracer_112                  -309   28   28  1023   60%  -394   28% 
  83 Grizzly1401b                  -334   29   29  1023   57%  -395   13% 
  84 Elf130                        -403   29   29  1065   50%  -401   16% 
  85 TSCP181                       -430   28   28  1154   51%  -438   15% 
  86 Mizar3.0                      -453   30   30  1015   53%  -477   18% 
  87 DChess1_0_2                   -469   30   30  1018   51%  -475   16% 
  88 Storm_06                      -485   29   29  1034   49%  -473   17% 
  89 Beaches226                    -494   31   31   901   52%  -507   14% 
  90 PolarChess1.2                 -500   30   30   986   47%  -475   17% 
  91 Bace_045                      -513   29   29  1050   46%  -473   17% 
  92 MSCP_144_uci_ja               -517   31   31   981   51%  -553   18% 
  93 Needle_0531                   -563   31   31   872   53%  -618   23% 
  94 LarsenVB                      -638   32   32   877   45%  -616   15% 
  95 Pentagon_12                   -657   31   31   869   35%  -539   28% 
  96 StAndersen_v1.31_X64          -675   32   32   867   34%  -539   15% 
  97 TarraschToyEngineV0.906       -681   31   31   942   32%  -531   15% 
  98 Yawce016                      -687   34   34   770   45%  -660   10% 
  99 Nero_61                       -717   32   32   961   33%  -571   16% 
 100 Numpty_0.4pr                  -924   40   40   570   35%  -807   17% 
 101 Marquis16                     -951   45   45   536   50%  -953   16% 
 102 Xadreco_v5.7                 -1192   57   57   420   31%  -956   13% 
 103 Testina2_2                   -1259   64   64   241   34% -1096   31% 
 104 Pyotr-am_06                  -1376   63   63   387   12%  -947   18% 
The only engine in this group that gives me problems is Testina2.2. It
loses some on time and sometimes makes illegal moves.
Carlos777
Posts: 1729
Joined: Sun Dec 13, 2009 6:09 pm

Re: Battle of the Forgotten

Post by Carlos777 »

hgm wrote:
Carlos777 wrote:Not working under Arena: (if someone has an idea on how to make them work, please reply)

ChessV 0.94
The engine command line for ChessV 0.94 has to be:

Code: Select all

ChessV_WinBoard "Orthodox Chess"
Hi HGM,

I tried adding "Orthodox Chess" in the command parameters box without success, I will try your suggestions when I back home.

Thanks,
Carlos
User avatar
hgm
Posts: 27790
Joined: Fri Mar 10, 2006 10:06 am
Location: Amsterdam
Full name: H G Muller

Re: Battle of the Forgotten

Post by hgm »

Yes, people told me that Arena cannot handle quotes in the engine command line at all. But the sgf trick should work. I just tried it to play "Chess With Different Armies", because you could not even specify that from the command line without a new popup appearing to ask you which armies you want to pit against each other.

So what I did is just start a game of Chess with Different Armies by hand, select FIDE vs Color-bound Clobberers, and then immediately select "File -> Save Game". By giving the name of the save file as an arument, ChessV then plays that variant without problems under WinBoard + PSWBTM.
Carlos777
Posts: 1729
Joined: Sun Dec 13, 2009 6:09 pm

Re: Battle of the Forgotten

Post by Carlos777 »

metax wrote:What is the approximate rating scale for '1700 or lower'?
I know that it is kind of ambiguous. As few tests have been done with low ELO engines (UEL is one of the few testing low ELO UCI engines, Open War and WBEC have done it too), there is no certainty about what engines should be considered 1700 ELO or less. Anyway, when I thought about 1700 ELO, I was thinking about human ELO.
However, based on games against humans, I would estimate ChessMind at 1700-1750 'human Elo'.
In that case, I'd be glad to test ChessMind in the next cycle if you agree.
I think in the CCRL rating scale Jabba would have around 1980-2000 Elo or even more.
Yes, as I said before Jabba is probably too strong for this tournament. I did not know its strenght before testing.
Last edited by Carlos777 on Tue Jan 19, 2010 4:49 am, edited 1 time in total.
Carlos777
Posts: 1729
Joined: Sun Dec 13, 2009 6:09 pm

Re: Battle of the Forgotten

Post by Carlos777 »

Adam Hair wrote:This is great Carlos. I've been working on a rating list since August
and I am including engines of all strengths. Here is the bottom of my
list. I plan to include as many engines as I can make run on my computer
under Arena 2.01.

Code: Select all

77 Warrior_103                   -214   28   28   984   54%  -246   20% 
  78 Smash                         -248   27   27  1063   49%  -237   16% 
  79 SnailChess_4013               -252   29   29  1037   66%  -398   15% 
  80 Surprise_4.3b13               -254   28   28   970   49%  -244   16% 
  81 Clueless_14                   -278   28   28   984   46%  -241   11% 
  82 Embracer_112                  -309   28   28  1023   60%  -394   28% 
  83 Grizzly1401b                  -334   29   29  1023   57%  -395   13% 
  84 Elf130                        -403   29   29  1065   50%  -401   16% 
  85 TSCP181                       -430   28   28  1154   51%  -438   15% 
  86 Mizar3.0                      -453   30   30  1015   53%  -477   18% 
  87 DChess1_0_2                   -469   30   30  1018   51%  -475   16% 
  88 Storm_06                      -485   29   29  1034   49%  -473   17% 
  89 Beaches226                    -494   31   31   901   52%  -507   14% 
  90 PolarChess1.2                 -500   30   30   986   47%  -475   17% 
  91 Bace_045                      -513   29   29  1050   46%  -473   17% 
  92 MSCP_144_uci_ja               -517   31   31   981   51%  -553   18% 
  93 Needle_0531                   -563   31   31   872   53%  -618   23% 
  94 LarsenVB                      -638   32   32   877   45%  -616   15% 
  95 Pentagon_12                   -657   31   31   869   35%  -539   28% 
  96 StAndersen_v1.31_X64          -675   32   32   867   34%  -539   15% 
  97 TarraschToyEngineV0.906       -681   31   31   942   32%  -531   15% 
  98 Yawce016                      -687   34   34   770   45%  -660   10% 
  99 Nero_61                       -717   32   32   961   33%  -571   16% 
 100 Numpty_0.4pr                  -924   40   40   570   35%  -807   17% 
 101 Marquis16                     -951   45   45   536   50%  -953   16% 
 102 Xadreco_v5.7                 -1192   57   57   420   31%  -956   13% 
 103 Testina2_2                   -1259   64   64   241   34% -1096   31% 
 104 Pyotr-am_06                  -1376   63   63   387   12%  -947   18% 
The only engine in this group that gives me problems is Testina2.2. It
loses some on time and sometimes makes illegal moves.
Thanks Adam for this useful information, many of those engines will be tested in the next cycles.

OTOH, I am considering to increase the number of engines to be removed after the cycle ends to 20 (instead of 15) to speed things up. More engines would be tested in this way (new 20 engines.) If someone disagree, let me know your reason.

Regards,
Carlos
JVMerlino
Posts: 1357
Joined: Wed Mar 08, 2006 10:15 pm
Location: San Francisco, California

Re: Battle of the Forgotten

Post by JVMerlino »

Hi Carlos,

Thanks for including Myrddin in your tournament. The version you have chosen was rated 1600-1700, so it does fit your tournament's criteria. However, Myrddin is definitely still in development, and the latest version is about 250-300 points stronger than the version in your tournament.

Someday, Myrddin will indeed be forgotten. :D But hopefully not for a while yet. :wink:

Thanks again!
jm