CCRL 40/4 Free Single-CPU Comparison

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
Kirill Kryukov
Posts: 518
Joined: Sun Mar 19, 2006 4:12 am
Full name: Kirill Kryukov

CCRL 40/4 Free Single-CPU Comparison

Post by Kirill Kryukov »

Updated Free Single-CPU comparison in CCRL 40/4 blitz is available.

The goal of this project is to compare free single-CPU chess engines with large number of games. In this project each participating engine must play at least 30 games match with 16 nearest stronger engines and with 16 nearest weaker engines.

Rating list

Code: Select all

Rank                 Engine                   ELO   +    -   Score  AvOp  Games
    1 Rybka 1.0 Beta 64-bit                   2946  +17  -16  74.7% -180.6  1492
    2 Fruit 2.3                               2875  +20  -19  67.2% -121.7   959
    3 Glaurung 2.0.1 64-bit                   2838  +11  -11  52.3%  -16.7  2897
    4 Spike 1.2 Turin                         2825   +6   -6  46.0%  +27.2 11574
    5 Naum 2.0 32-bit                         2795   +8   -8  48.8%   +3.6  5964
    6 Bright 0.2c                             2786  +15  -15  45.3%  +35.0  1677
    7 Alaric 707                              2761  +11  -11  46.3%  +25.3  3136
    8 Scorpio 2.0 32-bit                      2747  +11  -11  50.5%   -2.4  3083
    9 Movei 00.8.438(10 10 10)                2731  +15  -15  48.7%   +9.5  1713
   10 E.T. Chess 13.01.08                     2729  +22  -22  51.0%   -4.4   695
   11 Pro Deo 1.2                             2720  +12  -12  42.9%  +52.9  2659
   12 Frenzee 3.0 64-bit                      2713  +14  -14  49.7%   +1.9  1764
   13 Slow Chess Blitz WV2.1                  2712   +8   -8  41.4%  +61.9  6337
   14 Delfi 5.2                               2710  +12  -12  41.6%  +60.9  2694
   15 Zappa 1.1 64-bit                        2709  +15  -15  47.1%  +20.7  1632
   16 WildCat 7                               2701   +9   -9  46.6%  +23.2  4503
   17 Pharaon 3.5.1                           2700  +11  -11  38.8%  +81.6  3515
   18 List 5.12                               2693  +11  -11  48.7%   +9.1  3086
   19 Colossus 2007c                          2683  +15  -15  46.8%  +23.2  1568
   20 SOS 5.1                                 2682  +12  -12  46.7%  +23.1  2729
   21 Ruffian 1.0.5                           2677  +12  -12  49.4%   +4.3  2478
   22 Pseudo 0.7c                             2675  +11  -11  50.1%   -4.1  3189
   23 Booot 4.13.1                            2669  +13  -13  51.5%  -10.9  1968
   24 Aristarch 4.50                          2667  +12  -11  45.8%  +31.2  2835
   25 Hamsters 0.6                            2659  +15  -15  51.0%   -7.0  1477
   26 Petir 4.999999                          2657  +15  -15  47.5%  +17.0  1476
   27 Jonny 2.83 32-bit                       2650  +13  -13  46.1%  +29.9  2076
   28 The Baron 1.8.1                         2648  +15  -15  48.8%   +8.8  1587
   29 Crafty 21.5 PS 64-bit                   2643  +14  -14  45.4%  +33.5  1711
   30 BugChess2 1.5.2                         2642  +15  -16  50.2%   -2.9  1440
31-32 Anaconda 2.0.1                          2639  +13  -13  50.7%   -4.2  2125
31-32 Fritz 5.32                              2639  +14  -14  52.5%  -20.1  1909
   33 Smarthink 0.17a                         2635  +14  -14  50.7%   -5.4  1690
   34 Thinker 4.7a                            2632  +12  -12  50.6%   -7.9  2567
   35 Ktulu 4.2                               2631  +16  -16  52.5%  -18.0  1405
   36 Ufim 8.02                               2619  +12  -11  51.4%  -12.3  2843
   37 AnMon 5.60                              2613  +13  -13  49.3%   +5.9  2084
   38 Trace 1.37a                             2612  +14  -14  47.7%  +17.0  1864
39-40 Little Goliath Evolution 3.12 (TB On)   2610  +16  -16  50.4%   -2.6  1343
39-40 Yace 0.99.87                            2610  +16  -16  50.8%   -6.2  1312
   41 Green Light Chess 3.00                  2577  +18  -18  47.8%  +13.5  1086
   42 Tao 5.6                                 2564  +18  -18  46.1%  +26.9  1079
   43 Amyan 1.597                             2561  +13  -13  46.0%  +27.5  2184
   44 Abrok 5.0                               2559  +17  -17  47.4%  +13.7  1180
   45 SpiderChess 070603                      2556  +14  -14  46.2%  +26.6  1936
   46 Arasan 10.0 64-bit                      2550  +19  -19  45.2%  +33.3   957
   47 Pepito 1.59 64-bit JA                   2546  +21  -21  46.4%  +23.0   768
   48 Kiwi 0.6d                               2518  +17  -17  45.7%  +29.7  1259
   49 Snitch 1.6.2 32-bit                     2516  +19  -19  42.8%  +50.4  1034
   50 Nejmet 3.07                             2514  +16  -16  44.0%  +42.4  1477
   51 Quark 2.35                              2513  +18  -18  42.5%  +54.7  1098
   52 Dragon 4.6                              2503  +16  -16  41.5%  +65.6  1454
   53 Comet B68                               2479  +19  -19  38.3%  +83.4  1045
   54 Sjeng 12.13                             2477  +21  -21  35.9% +100.1   832
Links
Recent news

Delfi 5.2 (by Fabio Cavicchio) substituted version 5.1 in the list. It does not look like a noticeable improvement: Comparison. Delfi 5.1 is higher rated at the moment. This is consistent with CCRL 40/40 results. I will still keep testing and listing the 5.2 version. It is currently 14-th strongest free single-CPU engine.

Petir 4.999999 (by Peter Alloysius) substituted version 4.39 in the list. It is rated slightly lower than Petir 4.39 at the moment: Comparison. This is consistent with CCRL 40/40 results to date. I will continue testing and listing the 4.999999 version, which is 26-th strongest free single-CPU engine.

Dragon 4.6 by Bruno Lucas was tested and entered the list as 52-nd strongest free single CPU engine! (Dragon 4.6 results so far)

E.T. Chess 13.01.08 by Eric Triki is currently under testing. (13.01.08 is a confusing way to say 2008-01-13). So far it looks like a great improvement of more than 100 ELO points over E.T. Chess 18.11.05. By the way, this is an update interval of about two years. I personally really like this update schedule. E.T. Chess 13.01.08 is currently 10-th strongest free single-CPU engine.

Future

Many listed engines have updated versions, and many more engines still need testing. These are near the top of my list of engines to test:
  • Colossus 2007d
  • Crafty 22.0 64-bit 1-CPU
  • Frenzee Feb08 64-bit 1-CPU
  • Booot 4.14.0
  • Thinker 5.1c
  • Wildcat 8
  • Arasan 10.3
  • Alfil 8.1.1
If you think some other free single-CPU engine can compete for the place in top 50, please tell me!

Note 1. Pro Deo 1.2 (latest public version) does not run on machine with 4 GB of RAM, that's why I can't test it and it has many gaps in the table.

Note 2. I am not interested in Strelka, Toga and Sloppy.

Thanks to all authors of original free chess engines! Also thanks to all testers contributing games to the comparison! (Check our "Thanks" page for details)

Best,
Kirill
User avatar
Ovyron
Posts: 4562
Joined: Tue Jul 03, 2007 4:30 am

Re: CCRL 40/4 Free Single-CPU Comparison

Post by Ovyron »

Kirill Kryukov wrote:Note 2. I am not interested in Strelka, Toga and Sloppy.
Why not Toga? It plays a more interesting and stronger chess that Fruit (IMHO) so it could well replace Fruit 2.3, at least until Fruit 2.3.5 is released.
Michael Sherwin
Posts: 3196
Joined: Fri May 26, 2006 3:00 am
Location: WY, USA
Full name: Michael Sherwin

Re: CCRL 40/4 Free Single-CPU Comparison

Post by Michael Sherwin »

Hi Kirill,

RomiChess P3k 64 bit seems to deserve a go.

Not ranked yet, but sporting a CCRL 40/4 rating of 2582 after about 60 games.

Romi scored 35.9% against E.T. Chess 13.01.08! :D
If you are on a sidewalk and the covid goes beep beep
Just step aside or you might have a bit of heat
Covid covid runs through the town all day
Can the people ever change their ways
Sherwin the covid's after you
Sherwin if it catches you you're through
Jouni
Posts: 3660
Joined: Wed Mar 08, 2006 8:15 pm
Full name: Jouni Uski

Re: CCRL 40/4 Free Single-CPU Comparison

Post by Jouni »

Toga is free, single and no clone.

CCRL 40/4: Toga II 1.4 beta5 2915

Jouni
User avatar
Ovyron
Posts: 4562
Joined: Tue Jul 03, 2007 4:30 am

Re: CCRL 40/4 Free Single-CPU Comparison

Post by Ovyron »

Jouni wrote:Toga is free, single and no clone.

CCRL 40/4: Toga II 1.4 beta5 2915

Jouni
I suggest Toga II 3.1.2SE, as the 1.4 Togas are more fruity like, I think.
User avatar
Kirill Kryukov
Posts: 518
Joined: Sun Mar 19, 2006 4:12 am
Full name: Kirill Kryukov

Re: CCRL 40/4 Free Single-CPU Comparison

Post by Kirill Kryukov »

Ovyron wrote:
Kirill Kryukov wrote:Note 2. I am not interested in Strelka, Toga and Sloppy.
Why not Toga? It plays a more interesting and stronger chess that Fruit (IMHO) so it could well replace Fruit 2.3, at least until Fruit 2.3.5 is released.
1. There are too many Toga versions and variants.
2. New versions keep coming out too frequently for such testing to have any lasting value.
User avatar
Kirill Kryukov
Posts: 518
Joined: Sun Mar 19, 2006 4:12 am
Full name: Kirill Kryukov

Re: CCRL 40/4 Free Single-CPU Comparison

Post by Kirill Kryukov »

Michael Sherwin wrote:Hi Kirill,

RomiChess P3k 64 bit seems to deserve a go.

Not ranked yet, but sporting a CCRL 40/4 rating of 2582 after about 60 games.

Romi scored 35.9% against E.T. Chess 13.01.08! :D
I'll add it to my testing queue. :-)