UCI Engines Ligue updated

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

User avatar
Le Fou numerique
Posts: 859
Joined: Wed Apr 05, 2006 9:58 pm
Location: Elsass

UCI Engines Ligue updated

Post by Le Fou numerique »

Hi,

The Divisions in the UCI Engines Ligue are updated.

37.213 games rated, 184.772 played.

Code: Select all

Rank Name                   Ruel    +    -  games score oppo. draws 
   1 Spike 1.2 Turin        2708   17   16  1365   71%  2545   32% 
   2 Fruit 2.1              2643   12   12  2437   63%  2543   33% 
   3 Naum 2.0               2627   19   19   978   60%  2546   36% 
   4 Glaurung 1.2.1         2599   16   16  1323   54%  2559   30% 
   5 Pharaon 3.5.1          2592   18   18  1033   54%  2547   33% 
   6 Alaric 704             2586   43   42   230   70%  2413   22% 
   7 SlowChess Blitz WV2.1  2573   23   23   628   53%  2529   35% 
   8 Delfi 5.1              2567   29   29   436   62%  2451   28% 
   9 Ruffian 1.0.5          2564   10   10  3554   52%  2538   31% 
  10 List 5.12              2560   10   10  3389   52%  2537   32% 
  11 Aristarch 4.50         2536   11   11  3163   52%  2515   29% 
  12 Booot 4.13.1           2516   40   40   232   60%  2412   29% 
  13 SOS 5.1                2514   12   12  2496   49%  2511   29% 
  14 Movei 0.08.403         2508   24   24   607   56%  2453   27% 
  15 Zappa 1.1              2508   13   13  2170   49%  2508   29% 
  16 Colossus 2006f         2502   19   19  1013   50%  2493   28% 
  17 Ktulu 4.2              2497   11   11  2865   48%  2502   26% 
  18 AnMon 5.60             2482   17   16  1341   51%  2465   25% 
  19 Ufim 8.02              2478   21   21   830   52%  2455   28% 
  20 Twisted Logic 0.087x5  2475   51   50   154   62%  2363   22% 
  21 Tao 5.6                2467   15   15  1706   51%  2447   23% 
  22 Pepito v1.59           2456   13   13  2076   52%  2430   27% 
  23 Yace Paderborn         2455   13   13  2082   49%  2451   24% 
  24 Amyan 1.597            2429   16   16  1367   52%  2409   26% 
  25 Snitch 1.6.2           2399   22   22   745   51%  2379   27% 
  26 Nejmet 3.07            2392   14   14  1905   51%  2378   27% 
  27 Arasan 9.5             2386   25   25   569   52%  2359   24% 
  28 Gaia 3.5               2384   20   20   905   54%  2348   21% 
  29 Abrok 5.0              2377   14   13  2031   49%  2374   25% 
  30 Dragon 4.6             2372   14   14  1783   49%  2376   28% 
  31 Diablo 0.5.1           2363   23   23   666   51%  2346   29% 
  32 Sjeng 12.13            2357   15   15  1721   51%  2346   24% 
  33 Muse 0.899b            2350   16   16  1457   53%  2319   25% 
  34 Delphil 1.6c           2347   21   21   801   52%  2326   25% 
  35 Alfil 7.3              2346   31   31   376   52%  2327   27% 
  36 Hamsters 0.2           2340   32   32   362   52%  2321   25% 
  37 Queen 3.09             2336   18   17  1175   53%  2307   26% 
  38 Arion 1.7              2333   19   19  1003   51%  2320   27% 
  39 Hermann 1.9            2333   23   23   688   51%  2316   23% 
  40 Patzer 3.80            2331   22   22   741   51%  2314   22% 
  41 Homer 2.0              2313   33   33   339   53%  2277   24% 
  42 Aice 0.99.2            2309   22   22   750   49%  2304   23% 
  43 BBChess 1.1            2290   32   32   369   51%  2281   21% 
  44 Ayito 0.2.994          2261   17   17  1332   49%  2266   18% 
  45 GreKo 5.2.5            2252   29   29   450   48%  2262   22% 
  46 Tornado 1.0 Mainz      2247   25   25   610   48%  2260   23% 
  47 Anechka 0.08           2247   22   22   781   45%  2282   18% 
  48 Chispa 4.0.3           2245   16   17  1325   51%  2234   27% 
  49 LittleThought 1.00     2244   28   28   472   48%  2254   21% 
  50 Gibbon 2.32a           2237   44   45   200   43%  2293   19% 
  51 Rotor 0.1a             2232   31   31   396   48%  2241   19% 
  52 Pupsi 0.18             2216   32   32   370   47%  2239   21% 
  53 Atlas 2.20             2193   24   25   644   46%  2214   17% 
  54 AliChess 4.08          2154   45   46   208   35%  2285   17% 
  55 WJChess v1.64          2150   18   18  1209   47%  2168   19% 
  56 Madeleine 0.2          2140   18   18  1239   47%  2160   13% 
  57 Mediocre 0.311         2133   43   44   228   38%  2248   13% 
  58 Adam 3.1               2106   33   33   382   41%  2178   15% 
  59 Matheus 2.3            2093   20   20  1005   47%  2112   17% 
  60 Lime 62                2083   30   30   468   47%  2118   13% 
  61 Monarch 1.7            2082   29   29   487   45%  2127   13% 
  62 Feuerstein 0.4.5       2075   52   53   184   33%  2253    7% 
  63 FluxII 0.7             2069   55   57   166   28%  2280   13% 
  64 FireFly 2.2.0          2042   34   35   376   38%  2154   11% 
  65 BigLion 2.23w          2041   27   27   538   43%  2099   16% 
  66 DelphiMAX 2.9          2009   24   25   711   43%  2065   13% 
  67 Smash 1.0.3            1988   38   39   308   38%  2104   15% 
  68 FreeChess 2.17b        1959   49   49   224   39%  2079    9% 
  69 BiBiChess 0.5          1959   35   36   341   45%  2004   16% 
  70 RivalChess 1.18        1941   41   43   270   30%  2136   16% 
  71 Clueless 1.4           1917   54   56   190   27%  2180    9% 
  72 Alex 1.85              1875   72   80   146   13%  2298    7% 
  73 Heracles 0.4.8         1854   72   78   154   16%  2246    8% 
  74 Simontacchi v1.81a     1819   43   42   271   56%  1777    7% 
  75 AlChess 1.5b           1816   53   54   203   30%  2050   14% 
  76 Roce 0.0360            1816   58   61   178   17%  2187   16% 
  77 BikJump 1.2.1          1810   72   79   152   14%  2245    8% 
  78 Counter 0.1            1773   56   57   192   29%  2030   20% 
  79 Iq23 003               1747   50   50   189   39%  1885   22% 
  80 Pooky 2.7              1746   41   41   282   46%  1792   12% 
  81 Philemon C             1680   43   44   254   45%  1759   17% 
  82 Piranha 0.5            1669   37   37   367   47%  1719    6% 
  83 ApilChess 1.05r1b      1639   53   53   220   37%  1856   12% 
  84 Eden 0.0.11            1599   65   68   159   25%  1950    6% 
  85 T.rex 1.8.5            1461   43   45   302   24%  1736    7% 
  86 NSVChess 0.14          1254   67   76   216   11%  1811    2% 
  87 Ace 0.1                1032  145  178   166    2%  2109    0% 
Regards,
Patrick
Uri Blass
Posts: 10296
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: UCI Engines Ligue updated

Post by Uri Blass »

I believe that progress 10 10 10 is better than the default personality(progress1 progress2 progress3 are uci parameters in movei).

It can be good if you can test this personality in the uci league.

Uri
User avatar
Le Fou numerique
Posts: 859
Joined: Wed Apr 05, 2006 9:58 pm
Location: Elsass

Re: UCI Engines Ligue updated

Post by Le Fou numerique »

Uri Blass wrote:I believe that progress 10 10 10 is better than the default personality(progress1 progress2 progress3 are uci parameters in movei).

It can be good if you can test this personality in the uci league.

Uri
Hi Uri,

We use mostly the default parameter.

For each engine, there is one rating. So for Movei 0.08.403 there are 607 games rated.. If we use a other personality in one or two tournaments, the rating will not modify highly.

Regards,
Patrick
Uri Blass
Posts: 10296
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: UCI Engines Ligue updated

Post by Uri Blass »

Le Fou numerique wrote:
Uri Blass wrote:I believe that progress 10 10 10 is better than the default personality(progress1 progress2 progress3 are uci parameters in movei).

It can be good if you can test this personality in the uci league.

Uri
Hi Uri,

We use mostly the default parameter.

For each engine, there is one rating. So for Movei 0.08.403 there are 607 games rated.. If we use a other personality in one or two tournaments, the rating will not modify highly.

Regards,
Patrick
The point is that the default personality is probably not the best
but maybe I will wait for more evidence from objective testers like the CCRL before I suggest to test 10 10 10 instead of the default(I hope to see at least 20 elo improvement from the default version)

I wonder what you do if there is a new version.
I thought you may treat the personality progress 10 10 10 as a new version but maybe it is better to wait for some evidence by other testers that progress 10 10 10 is better than the default.

My tests suggest more than 20 elo improvement but maybe progress 10 10 10 was lucky in my tests(I played only 300 games)

results are:
Movei00_8_403 pr 10 10 10-fruit2.0 51-49(5 minutes/40 moves)
(default could never beat fruit2.0 in 100 game match and I played faster and slower time control than 5 minutes/40 moves).

Movei00_8_403 pr 10 10 10-default 53-47 at 20,000,000 nodes per move and 53.5-46.5 at 1,000,000 nodes per move.

Uri
User avatar
Le Fou numerique
Posts: 859
Joined: Wed Apr 05, 2006 9:58 pm
Location: Elsass

Re: UCI Engines Ligue updated

Post by Le Fou numerique »

Uri Blass wrote: The point is that the default personality is probably not the best
but maybe I will wait for more evidence from objective testers like the CCRL before I suggest to test 10 10 10 instead of the default(I hope to see at least 20 elo improvement from the default version)

I wonder what you do if there is a new version.
I thought you may treat the personality progress 10 10 10 as a new version but maybe it is better to wait for some evidence by other testers that progress 10 10 10 is better than the default.

My tests suggest more than 20 elo improvement but maybe progress 10 10 10 was lucky in my tests(I played only 300 games)

results are:
Movei00_8_403 pr 10 10 10-fruit2.0 51-49(5 minutes/40 moves)
(default could never beat fruit2.0 in 100 game match and I played faster and slower time control than 5 minutes/40 moves).

Movei00_8_403 pr 10 10 10-default 53-47 at 20,000,000 nodes per move and 53.5-46.5 at 1,000,000 nodes per move.

Uri
Hi Uri,

Here a tournament with pr 10 10 10.

The book is experimental.

Regards,
Patrick
Uri Blass
Posts: 10296
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: UCI Engines Ligue updated

Post by Uri Blass »

Thanks

If I understand correctly 6.5/14 is the only result when 6/14 in the tournament above is by the default personality.

Of course 14 games are not enough to say something but movei played against average of 2531 and I hope that the new personality can get rating above 2520.

1 Ruffian 1.0.5 2563
2 List 5.12 2559
3 Aristarch 4.50 2537
4 Booot 4.13.1 2529
5 SOS 5.1 2513
6 Zappa 1.1 2510
7 Colossus 2006f 2508
8 Movei 0.08.403 2500
pichy
Posts: 2564
Joined: Thu Mar 09, 2006 3:04 am

Re: UCI Engines Ligue updated

Post by pichy »

Uri Blass wrote:I believe that progress 10 10 10 is better than the default personality(progress1 progress2 progress3 are uci parameters in movei).

It can be good if you can test this personality in the uci league.

Uri
Here are some tests against Fruit 2.0 and Movei00_8_403 progress 10 10 10 and progress 11 11 11 are really an improvement to the standard settings.

This score was with progress 10 10 10

Engine Score Fr Mo S-B
1: Fruit20 15.0/30 =0=1001=100=00=1101=011=1=1010 212.75
2: Movei00_8_403 15.0/30 =1=0110=011=11=0010=100=0=0101 212.75

30 games played / Tournament finished
Name of the tournament: Arena tournament
Site/ Country: Jorge, United States
Level: Blitz 5/1
Hardware: AMD Athlon(tm) Processor 1202 MHz with 512MB Memory
Operating system: Microsoft Windows XP Professional Service Pack 2 (Build 2600)
PGN-File: C:\Program Files\Arena\Arena.pgn
Website:
E-Mail Address:


----------------------------------------------------------------------

This score versus the same opponent fruit 20 was with progress 11 11 11


Engine Score Mo Fr S-B
1: Movei00_8_403 20.5/40 00=111=11011001110=1=1101==100000==0==0= 399.75
2: Fruit20 19.5/40 11=000=00100110001=0=0010==011111==1==1= 399.75

40 games played / Tournament finished
Name of the tournament: Arena tournament
Site/ Country: Jorge, United States
Level: Blitz 5/1
Hardware: AMD Athlon(tm) Processor 1202 MHz with 512MB Memory
Operating system: Microsoft Windows XP Professional Service Pack 2 (Build 2600)
PGN-File: C:\Program Files\Arena\Arena.pgn
Website:
E-Mail Address: