39 Free Single-CPU engines in CCRL 40/4

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
Graham Banks
Posts: 44540
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: 39 Free Single-CPU engines in CCRL 40/4

Post by Graham Banks »

playjunior wrote: Btw can I get the books with which you test in CCRL? I have downloaded some books for Arena, one of them seems reasonable to me(none of the engines "complained" about positions out of opening).
Hi Andranik,

the books we use are all publicly available.
For Arena, of the books I've tried, I've found that the HS-Book.abk is the best big book.
Xmas2640.abk is a good smaller book.
I'm currently trying Salvo's 8moves.abk and it seems to be a very good smaller book also.
There are others that I've yet to try, but will give a run also.
I'd be interested in your thoughts on the available Arena books.

Regards, Graham.
Last edited by Graham Banks on Thu Aug 23, 2007 10:08 am, edited 1 time in total.
User avatar
Dr.Wael Deeb
Posts: 9773
Joined: Wed Mar 08, 2006 8:44 pm
Location: Amman,Jordan

Re: 39 Free Single-CPU engines in CCRL 40/4

Post by Dr.Wael Deeb »

Graham Banks wrote:
playjunior wrote: Btw can I get the books with which you test in CCRL? I have downloaded some books for Arena, one of them seems reasonable to me(none of the engines "complained" about positions out of opening).
Hi Andranik,

the books we use are all publicly available.
For Arena, of the books I've tried, I've found that the HS-Book.bkt is the best big book.
Xmas2640.abk is a good smaller book.
I'm currently trying Salvo's 8moves.abk and it seems to be a very good smaller book also.
There are others that I've yet to try, but will give a run also.
I'd be interested in your thoughts on the available Arena books.

Regards, Graham.
So Harry's HS-Book.bkt works under the Arena GUI,impressive :lol:
_No one can hit as hard as life.But it ain’t about how hard you can hit.It’s about how hard you can get hit and keep moving forward.How much you can take and keep moving forward….
User avatar
Graham Banks
Posts: 44540
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: 39 Free Single-CPU engines in CCRL 40/4

Post by Graham Banks »

Dr.Wael Deeb wrote: So Harry's HS-Book.bkt works under the Arena GUI,impressive :lol:
You're too sharp-eyed Wael! :P

Corrected now. :wink:
User avatar
Kirill Kryukov
Posts: 518
Joined: Sun Mar 19, 2006 4:12 am
Full name: Kirill Kryukov

Re: 39 Free Single-CPU engines in CCRL 40/4

Post by Kirill Kryukov »

playjunior wrote:Thank you Kirill !
I thought that the version of Rybka with 2950 was the 64-bit one.
Yes, it is 64-bit one.
playjunior wrote:Btw can I get the books with which you test in CCRL? I have downloaded some books for Arena, one of them seems reasonable to me(none of the engines "complained" about positions out of opening). With this book I run tournaments on my Core2 Duo 2.16, 256 MB Hash, with engines like Toga, Fruit, Glaurung 1.2.1 SMP...
For example now it goes:

Engine Score Fr To Gl Ry S-B
1: Fruit-2-3-1 6.0/9 ··· === 11= 110 23.75
2: TogaII-1.3.1 5.0/9 === ··· 1=0 1== 20.75
3: Glaurung 1.2.1 SMP 4.5/9 00= 0=1 ··· 11= 16.75
4: Rybka v1.0 Beta.w32 2.5/9 001 0== 00= ··· 13.25

I cannot believe this engine is 100 points stronger than the nearest competitor :)
I use Harry Schnapp's books recently. One of them is distributed with Arena beta and others are available at his site. I don't remember the link now, but I'm sure someone at this forum will be able to post the link.

Best,
Kirill
playjunior
Posts: 338
Joined: Fri Jun 22, 2007 12:53 am

Re: 39 Free Single-CPU engines in CCRL 40/4

Post by playjunior »

The book I use is called:
f-quisinsky-v03__special.abk
maybe it's a bit "too agressive" book: when I run the tournament, Najdorf happens a bit too often.
Is there special Rybka book for Arena? I wonder how it will "behave" with its own book.
User avatar
Dr.Wael Deeb
Posts: 9773
Joined: Wed Mar 08, 2006 8:44 pm
Location: Amman,Jordan

Re: 39 Free Single-CPU engines in CCRL 40/4

Post by Dr.Wael Deeb »

playjunior wrote:The book I use is called:
f-quisinsky-v03__special.abk
maybe it's a bit "too agressive" book: when I run the tournament, Najdorf happens a bit too often.
Is there special Rybka book for Arena? I wonder how it will "behave" with its own book.
Hi,
Have a look here please,with this opening book for Rybka under the Arena GUI,Rybka is being tested by the SSDF 8-)

http://www.rybkachess.com/index.php?aus ... stallation

I have the Rybka_v3_0.abk under development,but it will be released next year when I finish all the tasks I've been planning....
_No one can hit as hard as life.But it ain’t about how hard you can hit.It’s about how hard you can get hit and keep moving forward.How much you can take and keep moving forward….
playjunior
Posts: 338
Joined: Fri Jun 22, 2007 12:53 am

Re: 39 Free Single-CPU engines in CCRL 40/4

Post by playjunior »

Dr.Wael Deeb wrote:
playjunior wrote:The book I use is called:
f-quisinsky-v03__special.abk
maybe it's a bit "too agressive" book: when I run the tournament, Najdorf happens a bit too often.
Is there special Rybka book for Arena? I wonder how it will "behave" with its own book.
Hi,
Have a look here please,with this opening book for Rybka under the Arena GUI,Rybka is being tested by the SSDF 8-)

http://www.rybkachess.com/index.php?aus ... stallation

I have the Rybka_v3_0.abk under development,but it will be released next year when I finish all the tasks I've been planning....
Thank you very much. I will finish this run of tournament and run others with "special" books when possible. IHMO its a bit unfair to force Rybka play Najdorf against others, as it is unfair to force Junior play symmetrical English :)
User avatar
Kirill Kryukov
Posts: 518
Joined: Sun Mar 19, 2006 4:12 am
Full name: Kirill Kryukov

Re: Update 2007-08-27

Post by Kirill Kryukov »

Update! The new CCRL 40/4 single-CPU list is available :-) (This is just my personal selection, which includes only best free single-CPU engines which were extensively tested versus other free engines. You can alter this selection as you like or make a completely different selection using our web-site):

Code: Select all

 Rank                 Engine                  ELO   +    -   Score  AvOp  Games
    1 Rybka 1.0 Beta 64-bit                  2950  +19  -19  76.2% -194.6  1152
    2 Fruit 2.3 5-men-egbb                   2875  +22  -22  67.2% -122.7   736
    3 Spike 1.2 Turin                        2827   +7   -7  46.3%  +25.7  7787
    4 Naum 2.0 32-bit                        2797   +9   -9  48.7%   +3.8  5470
    5 Alaric 707                             2774  +16  -16  53.5%  -25.2  1319
    6 Glaurung 1.2.1 32-bit                  2758   +9   -9  41.7%  +59.4  5493
    7 Scorpio 1.91 (5-men-egbb)              2733  +17  -17  50.3%   -4.2  1186
    8 Pro Deo 1.2                            2722  +12  -12  43.3%  +51.3  2563
    9 Delfi 5.1                              2716  +12  -12  50.6%   -4.4  2412
   10 Slow Chess Blitz WV2.1                 2712   +9   -9  41.8%  +60.1  4826
   11 Zappa 1.1 64-bit                       2710  +16  -17  46.6%  +24.3  1248
   12 Frenzee 3.0 64-bit                     2707  +16  -16  49.0%   +7.2  1349
   13 Pharaon 3.5.1                          2698  +12  -12  38.3%  +86.5  2728
   14 List 5.12                              2697  +12  -12  49.5%   +3.5  2696
   15 WildCat 7                              2693  +11  -11  46.7%  +24.5  2881
   16 SOS 5.1                                2680  +13  -13  46.7%  +23.3  2313
   17 Ruffian 1.0.5                          2676  +13  -13  49.8%   +0.2  2114
   18 Pseudo 0.7c                            2675  +12  -12  50.7%   -8.5  2805
   19 Aristarch 4.50                         2668  +12  -12  45.8%  +32.7  2567
20-21 Booot 4.13.1                           2667  +17  -17  50.4%   -3.4  1241
20-21 Colossus 2007c                         2667  +26  -26  40.9%  +61.2   480
   22 Petir 4.39                             2665  +14  -14  44.6%  +40.1  1818
   23 The Baron 1.8.1                        2652  +18  -18  47.7%  +17.0  1138
   24 Jonny 2.83 32-bit                      2647  +15  -15  44.4%  +42.9  1693
   25 Fritz 5.32                             2644  +17  -17  53.7%  -28.8  1205
26-27 Crafty 21.5 PS 64-bit                  2643  +16  -16  43.3%  +49.2  1360
26-27 Smarthink 0.17a                        2643  +17  -17  47.8%  +15.5  1117
   28 Anaconda 2.0.1                         2637  +15  -15  49.1%   +6.5  1523
   29 Movei 0.08.403                         2634  +17  -17  51.9%  -15.3  1273
   30 Thinker 4.7a                           2632  +14  -13  48.2%   +7.5  1992
   31 Ktulu 4.2                              2628  +21  -21  48.7%   +9.4   766
   32 AnMon 5.60                             2616  +16  -16  46.6%  +24.6  1488
   33 Little Goliath Evolution 3.12          2615  +14  -15  53.4%  -28.1  1754
   34 Ufim 8.02                              2613  +13  -13  49.9%   -2.8  2228
   35 Trace 1.37a                            2612  +17  -17  43.9%  +46.0  1268
   36 Yace 0.99.87                           2611  +21  -21  46.1%  +25.0   800
   37 E.T. Chess 18.11.05                    2602  +14  -14  54.4%  -38.9  1828
   38 Amyan 1.597                            2565  +16  -16  46.9%  +19.8  1490
   39 Tao 5.6                                2559  +37  -37  43.5%  +46.5   253
Changes compared to the previous one:

1. I decided to remove Strelka 1.8 as it is already represented by Rybka 1.0 on the same list. (Strelka and Rybka play almost identical chess as we have shown previously by our ponder hit statistics).

2. Instead Tao 5.6 joined at the bottom. It will play more games over the time and in turn it will serve as an opponent to other new engines.

3. Colossus 2007c substituted version 2007a. It seems like a good improvement and I'll test it more. Unfortunately I can't compare it with 2007b yet, because 2007b was tested with totally different opponents. I will think about investing some time into 2007b if it will remain higher than 2007c after another week or two (unless any new version is out).

As usual I am thinking which engine to include into testing after running more gap-filling games for current 39-engine table. Any suggestions would be welcome. :) Particularly, which do you think is the strongest free engine not listed in the list above?

As usual big thanks to all testers contributing to this comparison!

Best,
Kirill
Tony Thomas

Re: Update 2007-08-27

Post by Tony Thomas »

Is there a reason why Greenlight Chess is not used? I do not see it on the selection. Also a 64bit version of Arasan and the regular Francesca Mad ( I know about the book problem) could have (slim chance for Spiderchess as well, but I see that it is tested) made it to the top 40.
User avatar
Kirill Kryukov
Posts: 518
Joined: Sun Mar 19, 2006 4:12 am
Full name: Kirill Kryukov

Re: Update 2007-08-27

Post by Kirill Kryukov »

Tony Thomas wrote:Is there a reason why Greenlight Chess is not used? I do not see it on the selection.
No particular reason, other than lack of time and talent. :-)
Tony Thomas wrote:Also a 64bit version of Arasan and the regular Francesca Mad ( I know about the book problem) could have (slim chance for Spiderchess as well, but I see that it is tested) made it to the top 40.
Thanks for suggestions. OK, so far the suggested additions list:
  • Green Light Chess
  • Arasan 64-bit
  • Francesca Mad
  • Spiderchess
I'll have to look around at our and other lists to see which one of them to test first (and I also have a list of my own of engines I want to test). :-) Still these comments are very helpful!