Battle of the Forgotten

[hgm]

Yes, people told me that Arena cannot handle quotes in the engine command line at all. But the sgf trick should work. I just tried it to play "Chess With Different Armies", because you could not even specify that from the command line without a new popup appearing to ask you which armies you want to pit against each other.

So what I did is just start a game of Chess with Different Armies by hand, select FIDE vs Color-bound Clobberers, and then immediately select "File -> Save Game". By giving the name of the save file as an arument, ChessV then plays that variant without problems under WinBoard + PSWBTM.

[Carlos777]

What is the approximate rating scale for '1700 or lower'?

I know that it is kind of ambiguous. As few tests have been done with low ELO engines (UEL is one of the few testing low ELO UCI engines, Open War and WBEC have done it too), there is no certainty about what engines should be considered 1700 ELO or less. Anyway, when I thought about 1700 ELO, I was thinking about human ELO.

However, based on games against humans, I would estimate ChessMind at 1700-1750 'human Elo'.

In that case, I'd be glad to test ChessMind in the next cycle if you agree.

I think in the CCRL rating scale Jabba would have around 1980-2000 Elo or even more.

Yes, as I said before Jabba is probably too strong for this tournament. I did not know its strenght before testing.

[Carlos777]

This is great Carlos. I've been working on a rating list since August
and I am including engines of all strengths. Here is the bottom of my
list. I plan to include as many engines as I can make run on my computer
under Arena 2.01.

Code: Select all

77 Warrior_103                   -214   28   28   984   54%  -246   20% 
  78 Smash                         -248   27   27  1063   49%  -237   16% 
  79 SnailChess_4013               -252   29   29  1037   66%  -398   15% 
  80 Surprise_4.3b13               -254   28   28   970   49%  -244   16% 
  81 Clueless_14                   -278   28   28   984   46%  -241   11% 
  82 Embracer_112                  -309   28   28  1023   60%  -394   28% 
  83 Grizzly1401b                  -334   29   29  1023   57%  -395   13% 
  84 Elf130                        -403   29   29  1065   50%  -401   16% 
  85 TSCP181                       -430   28   28  1154   51%  -438   15% 
  86 Mizar3.0                      -453   30   30  1015   53%  -477   18% 
  87 DChess1_0_2                   -469   30   30  1018   51%  -475   16% 
  88 Storm_06                      -485   29   29  1034   49%  -473   17% 
  89 Beaches226                    -494   31   31   901   52%  -507   14% 
  90 PolarChess1.2                 -500   30   30   986   47%  -475   17% 
  91 Bace_045                      -513   29   29  1050   46%  -473   17% 
  92 MSCP_144_uci_ja               -517   31   31   981   51%  -553   18% 
  93 Needle_0531                   -563   31   31   872   53%  -618   23% 
  94 LarsenVB                      -638   32   32   877   45%  -616   15% 
  95 Pentagon_12                   -657   31   31   869   35%  -539   28% 
  96 StAndersen_v1.31_X64          -675   32   32   867   34%  -539   15% 
  97 TarraschToyEngineV0.906       -681   31   31   942   32%  -531   15% 
  98 Yawce016                      -687   34   34   770   45%  -660   10% 
  99 Nero_61                       -717   32   32   961   33%  -571   16% 
 100 Numpty_0.4pr                  -924   40   40   570   35%  -807   17% 
 101 Marquis16                     -951   45   45   536   50%  -953   16% 
 102 Xadreco_v5.7                 -1192   57   57   420   31%  -956   13% 
 103 Testina2_2                   -1259   64   64   241   34% -1096   31% 
 104 Pyotr-am_06                  -1376   63   63   387   12%  -947   18% 

The only engine in this group that gives me problems is Testina2.2. It
loses some on time and sometimes makes illegal moves.

Thanks Adam for this useful information, many of those engines will be tested in the next cycles.

OTOH, I am considering to increase the number of engines to be removed after the cycle ends to 20 (instead of 15) to speed things up. More engines would be tested in this way (new 20 engines.) If someone disagree, let me know your reason.

Regards,
Carlos

[JVMerlino]

Hi Carlos,

Thanks for including Myrddin in your tournament. The version you have chosen was rated 1600-1700, so it does fit your tournament's criteria. However, Myrddin is definitely still in development, and the latest version is about 250-300 points stronger than the version in your tournament.

Someday, Myrddin will indeed be forgotten. But hopefully not for a while yet.

Thanks again!
jm

[Carlos777]

Hi Carlos,

Thanks for including Myrddin in your tournament. The version you have chosen was rated 1600-1700, so it does fit your tournament's criteria. However, Myrddin is definitely still in development, and the latest version is about 250-300 points stronger than the version in your tournament.

Someday, Myrddin will indeed be forgotten. But hopefully not for a while yet.

Thanks again!
jm

Hi John,

You are welcome. As I wrote in the first post, Myrddin was one of the first engines that I started testing to find a suitable opponent for me. I used this old version on purpose, sorry. When I decided to run a tournament for testing more low ELO engines, I chose to keep it given that Myrddin 0.081a2 had already played many games.

Myrddin 0.82 would be too strong for this tournament and it looks like this "weaker" version is going to be in the top 10 at the end of the current cycle.

I don't think that Myrddin will be forgotten.

Regards,
Carlos

[JVMerlino]

Hi John,

You are welcome. As I wrote in the first post, Myrddin was one of the first engines that I started testing to find a suitable opponent for me. I used this old version on purpose, sorry. When I decided to run a tournament for testing more low ELO engines, I chose to keep it given that Myrddin 0.081a2 had already played many games.

Myrddin 0.82 would be too strong for this tournament and it looks like this "weaker" version is going to be in the top 10 at the end of the current cycle.

I don't think that Myrddin will be forgotten.

Regards,
Carlos

Thanks for the kind words. Yes, the most recent public release is about 300 ELO stronger than 0.81, so way too strong for this tournament. I've had a few people say that they enjoy playing it OTB, which is very nice to hear. It's also very stable (so far) according to various tournament directors like yourself.

Thanks again!

jm

[Roman Hartmann]

Thanks for including Roce in your tournament. And I'm glad to see it doesn't seem to perform too bad

Roman

[Carlos777]

Hi Roman,

Roce is a nice engine to play with and as you say is doing well in this tournament. I think Roce will finish at least in the top 10 if not in the top 5.

Regards,
Carlos

PS: I am thinking about testing a human like chess engine around 1600 - 1700 ELO (meaning that sometimes can make blunders in some positions like any 1600 ELO human could do). First thought was to use a 1600 ELO Delfi, but I have not tested it yet. I like to play against Fritz handicapped for example. Do anyone have experience with a "dumbed down" engine that can be included in this tournament? I think it would be interesting as a reference for rating.

[Carlos777]

Update

Code: Select all

    Engine             Score   Ja KM Si Ro Si Mi My Ch Yo Cu Re Sj Ad Br Da Al Ch Cl Ar Oz AL Da RB Ro Fr Ge Tr Ed Nu Na Jo Fi Xa Yo Ge Sa Ne Ac Po Cp    S-B
01: Jabba 1.0          67.0/78 ·· 10 0= 00 11 =0 11 =0 11 11 1= 11 1= 0= 11 11 11 11 =1 11 11 11 11 11 11 11 11 11 11 =1 11 11 11 11 11 11 11 11 11 11  1896.2
02: KMTChess 1.1       59.5/69 01 ·· 0= 11 11 1= 11 =1 00 11 1  =0 1  11 10 1  1  11 11 11 =1 1  10 11 11 1  11 11 11 11 11 1  11 11 11 11 1  1  11 11  1751.2
03: Simplex 0.0        59.0/69 1= 1= ·· == 01 10 01 11 01 11 =  00 11 1  =1 == 1  11 1  11 1  1  11 11 1  11 11 11 11 11 11 11 11 11 11 11 1  1  11 11  1704.5
04: Roce 0.0390        57.5/70 11 00 == ·· =0 10 10 01 1= 10 =1 1  10 1  11 10 1  11 =  11 1  1  11 11 1  11 1= 11 11 11 11 11 11 11 11 11 11 1  11 11  1595.7
05: Sissa 1.00         55.0/69 00 00 10 =1 ·· 01 =0 0  1= 11 =  1= 1  10 11 1  =0 1  11 10 11 11 11 11 11 1  11 11 11 11 11 1  11 11 11 11 1  1  11 11  1488.0
06: Micro-Max 4.8      48.5/60 =1 0= 01 01 10 ·· 10 0  1  01 1  11 1  11 == 1  11 1  1= 1  =1 01 11 1  =1 1  1  1  11 11 11 1  11 1  1  1  1  1  11 1   1464.2
07: Myrddin 0.81a2     48.5/69 00 00 10 01 =1 01 ·· =1 00 =0 0  00 1= 0  11 0  1  =1 11 =1 11 1  =0 11 11 0  11 11 11 11 11 1  11 11 11 11 1  1  11 11  1251.5
08: Chesley r317 ja    48.0/59 =1 =0 00 10 1  1  =0 ·· 1  11 01 0  01 1  0  11 1  =1 1  11 1  1  1  1  1  11 1  11 1  11 1  11 11 1  11 1  11 11 1  11  1326.5
09: Yoda 1.30          46.5/68 00 11 10 0= 0= 0  11 0  ·· 00 =0 0  0  11 =0 1  10 0  1= =1 =0 11 11 =1 1  1= 11 11 10 11 1  11 11 11 11 11 11 11 1  1   1197.0
10: Cuckoo Chess 1.0   46.5/69 00 00 00 01 00 10 =1 00 11 ·· 0  =0 00 0  11 1= 1  11 =  01 11 0  11 10 1= 1  11 11 11 11 11 1  11 11 11 11 1  1  11 11  1142.7
11: Reger 0.09         45.5/59 0= 0  =  =0 =  0  1  10 =1 1  ·· 1  10 1  1  =0 =  01 =  11 1  1  1  11 1  01 11 11 1  1= 1  11 1  11 11 11 11 11 1  11  1156.5
12: Sjakk 1.1.3        44.0/59 00 =1 11 0  0= 00 11 1  1  =1 0  ·· =  =1 10 1  11 0  1= 1  1= 00 11 1  11 1  =  1  11 1  11 1  11 1  1  11 1  1  11 1   1263.5
13: Adamant 1.7        43.0/59 0= 0  00 01 0  0  0= 10 1  11 01 =  ·· 0  1  11 0  11 1  11 =  1  1  01 1  11 0  11 1  11 1  11 11 1  11 1  11 11 1  11  1094.2
14: Brembo 0.62        41.5/59 1= 00 0  0  01 00 1  0  00 1  0  =0 1  ·· 01 1  11 1  =1 0  10 11 =1 11 =1 1  11 1  11 1  11 1  1  11 1  11 1  1  11 1   1087.0
15: Dabbaba 2.46       41.0/69 00 01 =0 00 00 == 00 1  =1 00 0  01 0  10 ·· 0  00 00 01 11 11 0  10 1= =1 1  11 11 01 11 11 1  11 11 11 11 1  1  11 11  951.00
16: Alibaba 1.17       39.0/59 00 0  == 01 0  0  1  00 0  0= =1 0  00 0  1  ·· =  10 0  11 =  1  1  01 1  11 1  11 1  11 1  11 11 11 11 1  11 11 1  11  885.00
17: Chessrikus 1.466   37.0/59 00 0  0  0  =1 00 0  0  01 0  =  00 1  00 11 =  ·· 0  01 1  10 10 1= 11 11 1  11 11 11 1  11 0  1  11 1  11 1  1  11 1   878.25
18: Cleo 1             37.0/59 00 00 00 00 0  0  =0 =0 1  00 10 1  00 0  11 01 1  ·· 0  =1 1  1  =  1  1  11 1  1  1  11 1  11 11 1  11 1  11 11 1  11  824.50
19: ArabianKnight 0.88 34.0/59 =0 00 0  =  00 0= 00 0  0= =  =  0= 0  =0 10 1  10 1  ·· =  01 =1 10 1  10 1  =1 1  11 1  11 =  1  11 1  11 1  1  11 1   803.50
20: Ozwald 0.43        33.5/69 00 00 00 00 01 0  =0 00 =0 10 00 0  00 1  00 00 0  =0 =  ·· 0  =  01 == 0  10 1= 11 11 =1 10 11 11 11 11 11 11 11 1  11  641.75
21: ALChess1.5b        33.0/59 00 =0 0  0  00 =0 00 0  =1 00 0  0= =  01 00 =  01 0  10 1  ·· 1= 10 1  =1 1  11 1  11 1  11 1  1  1  1  11 1  1  11 1   755.25
22: Damas9             33.0/59 00 0  0  0  00 10 0  0  00 1  0  11 0  00 1  0  01 0  =0 =  0= ·· 11 == 11 =  01 11 10 1  11 1  1  11 11 11 1  1  11 1   713.75
23: RBrChess 2.16      31.0/69 00 01 00 00 00 00 =1 0  00 00 0  00 0  =0 01 0  0= =  01 10 01 00 ·· 11 00 0  00 00 11 11 1  1  11 11 11 11 11 11 11 1   617.00
24: Rocinante 1.01     30.5/68 00 00 00 00 00 0  00 0  =0 01 00 0  10 00 0= 10 00 0  0  == 0  == 00 ·· =  =0 11 0= 11 11 1  11 11 11 11 11 11 11 1  1   561.50
25: Frittle 0.5        25.0/59 00 00 0  0  00 =0 00 0  0  0= 0  00 0  =0 =0 0  00 0  01 1  =0 00 11 =  ·· 1  =1 =  == 1  1= 1  1= 1  1  11 1  1  11 1   477.75
26: Gedeone 1620       25.0/59 00 0  00 00 0  0  1  00 0= 0  10 0  00 0  0  00 0  00 0  01 0  =  1  =1 0  ·· 0  10 1  == 0  =1 11 11 11 1  11 11 1  11  434.50
27: Trex 1.9           23.5/68 00 00 00 0= 00 0  00 0  00 00 00 =  1  00 00 0  00 0  =0 0= 00 10 11 00 =0 1  ·· 01 00 01 0  11 01 11 01 11 11 11 1  1   419.50
28: Eden 0.013         22.5/68 00 00 00 00 00 0  00 00 00 00 00 0  00 0  00 00 00 0  0  00 0  00 11 1= =  01 10 ·· 01 01 0  01 11 1= 11 11 11 11 1  1   329.50
29: Numpty 0.5pr       22.0/69 00 00 00 00 00 00 00 0  01 00 0  00 0  00 10 0  00 0  00 00 00 01 00 00 == 0  11 10 ·· =0 =0 1  10 11 11 11 1  11 11 1   341.00
30: Nanook 0.17        17.0/70 =0 00 00 00 00 00 00 00 00 00 0= 0  00 0  00 00 0  00 0  =0 0  0  00 00 0  == 10 10 =1 ·· 00 10 11 == == 1= == 1= =  =1  271.00
31: Joana_DC           17.0/60 00 00 00 00 00 00 00 0  0  00 0  00 0  00 00 0  00 0  00 01 00 00 0  0  0= 1  1  1  =1 11 ·· 1  1= 0  1  =  1  1  11 1   251.50
32: Fimbulwinter 5.02  17.0/59 00 0  00 00 0  0  0  00 00 0  00 0  00 0  0  00 1  00 =  00 0  0  0  00 0  =0 00 10 0  01 0  ·· 1  11 11 1  11 11 1  11  195.00
33: Xadreco 5.7        14.5/69 00 00 00 00 00 00 00 00 00 00 0  00 00 0  00 00 0  00 0  00 0  0  00 00 0= 00 10 00 01 00 0= 0  ·· 1= 11 11 1  1  11 11  136.75
34: Youk 1.05          11.5/68 00 00 00 00 00 0  00 0  00 00 00 0  0  00 00 00 00 0  00 00 0  00 00 00 0  00 00 0= 00 == 1  00 0= ·· 10 =1 11 11 1  1    96.75
35: Geko 0.43          10.0/68 00 00 00 00 00 0  00 00 00 00 00 0  00 0  00 00 0  00 0  00 0  00 00 00 0  00 10 00 00 == 0  00 00 01 ·· == 11 11 1  1    82.00
36: Sachy 0.2.01       8.5/69  00 00 00 00 00 0  00 0  00 00 00 00 0  00 00 0  00 0  00 00 00 00 00 00 00 0  00 00 00 0= =  0  00 =0 == ·· =1 =1 11 1    51.75
37: Neg 0.3d           6.0/60  00 0  0  00 0  0  0  00 00 0  00 0  00 0  0  00 0  00 0  00 0  0  00 00 0  00 00 00 0  == 0  00 0  00 00 =0 ·· 1= 1  11   30.75
38: Ace v0.1           3.0/60  00 0  0  0  0  0  0  00 00 0  00 0  00 0  0  00 0  00 0  00 0  0  00 00 0  00 00 00 00 0= 0  00 0  00 00 =0 0= ·· =  ==   18.25
39: Pos-1.20           2.0/60  00 00 00 00 00 00 00 0  0  00 0  00 0  00 00 0  00 0  00 0  00 00 00 0  00 0  0  0  00 =  00 0  00 0  0  00 0  =  ·· 1    11.50
40: Cpp1               1.5/59  00 00 00 00 00 0  00 00 0  00 00 0  00 0  00 00 0  00 0  00 0  0  0  0  0  00 0  0  0  =0 0  00 00 0  0  0  00 == 0  ··   11.50

1285 of 1560 games played

Buggy engines still in the tournament
- Joana DC (illegal moves/losses on time)
- Youk (some losses on time)
- Cpp1 (some losses on time)
- Numpty (some losses on time)

20 engines will be replaced by 20 new ones at the end of the cycle.

[Carlos777]

Code: Select all

ChessV_WinBoard "Orthodox Chess"

It seems that Arena cannot handle this (or people simply have not found out what they have to tell Arena to produce this command line when installing the engine).

Possible work-arounds are:

1) Put that command line in a batch file chessv.bat, and then install that batch file as an engine in Arena.

Thanks HG, your first solution worked fine.

Carlos.