CCRL update (21st April 2007)

[Graham Banks]

The April 21st update of the CCRL Rating Lists and Statistics is now available for viewing at:
http://www.computerchess.org.uk/ccrl/4040/

The links to the various rating lists can be found just beneath the default Best Versions list.
For example there is a 32-bit Single CPU list.

Our standard testing is at 40 moves in 40 minutes repeating while our current blitz testing is at both 40 moves in 4 minutes repeating and 40 moves in 12 minutes repeating, all adjusted to the AMD64 X2 4600+ (2.4GHz).

Our team of testers currently includes:
Graham Banks, Ray Banks, Sarah Bird, Shaun Brewer, Kirill Kryukov, Dom Leste, Tom Logan, Andreas Schwartmann, Joshua Shriver, Charles Smith, George Speight, Chris Taylor, Martin Thoresen, Chuck Wilson and Gabor Szots.

We remain on the lookout for a few more testers to help, so please contact one of us if you're interested.


40/40 Notes

936 games were added to our 40/40 database this week, making a total of 55,505 games.
A big thanks to all testers as usual.

Many engines on our list have few games and in many cases their ratings are likely to fluctuate (markedly for some) until a lot more games are played. Therefore no conclusions should be drawn about their strength yet.
To illustrate this point, when an engine has 200 games played, the error margin is still approximately +/-40 ELO, after 500 games +-25 ELO, after 1000 games +-17 ELO and even after 2000 games there is a +-13 ELO error margin!
This of course highlights the importance of looking at other rating lists that are also available in order to draw comparisons and get a more accurate overall picture.

We are not testing Rybka 2.3 at 40/40, preferring to wait for the bugfixed Rybka 2.3.2 to be released.


4CPU Engines
3105 - Rybka 2.2 64-bit 4CPU
3045 - Zap!Chess Zanzibar 64-bit 4CPU
2978 - Hiarcs 11.1 4CPU
2964 - Naum 2.1 64-bit 4CPU
2933 - Deep Shredder 10 64-bit 4CPU
2920 - Deep Junior 10 4CPU
2919 - Deep Fritz 10 4CPU
2860 - Glaurung 1.2.1 64-bit 4CPU


2CPU Engines
3080 - Rybka 2.1 64-bit 2CPU
3048 - Rybka 2.2 64-bit 2CPU
3030 - Zap!Chess Zanzibar 64-bit 2CPU
2939 - Hiarcs 11.1 2CPU
2928 - Deep Fritz 10 2CPU
2927 - LoopMP 12.32 2CPU
2915 - Naum 2.1 64-bit 2CPU
2912 - Loop 13.5 64-bit 2CPU
2899 - Deep Junior 10 2CPU
2887 - Deep Shredder 10 64-bit 2CPU
2814 - Glaurung 1.2.1 64-bit 2CPU
2734 - Pharaon 3.5.1 32-bit 2CPU


Single CPU Engines
3007 - Rybka 2.2 64-bit
2910 - Hiarcs 11.1
2907 - Zap!Chess Zanzibar 64-bit
2881 - Fritz 10
2874 - Shredder 10
2873 - Loop 13.5 32-bit (64-bit higher, but not enough games)
2861 - Toga II 1.2.1a (not testing Toga II 1.3x4 yet)
2850 - Spike 1.2 Turin
2845 - Naum 2.1 32-bit (64-bit not tested)
2840 - Fruit 2.2.1
2840 - Junior 10
2803 - Ktulu 8.0
2793 - Chess Tiger 2007 (not enough games for Chess Tiger 2007.1 yet)
2787 - Scorpio 1.84
2769 - Glaurung 1.2.1 Avalanche 64-bit
2765 - CM9000 Enforcer
2756 - SmarThink 1.00 32-bit (64-bit higher, but not enough games)
2756 - Scorpio 1.91
2742 - Slow Chess Blitz WV2.1


CCRL Amateur Championship (32-bit 1CPU):
4th Season Division 1 - After 18 of 30 rounds, Spike 1.2 Turin holds a narrow lead over the chasing pack that includes Frenzee 3.0, Slow Chess Blitz WV2.1, Pro Deo 1.2 and Scorpio 1.91.
Movei 0.08.403 and Pseudo 0.7c are struggling to avoid the drop.

4th Season Division 2 - about to start. he field announced in our public forum.

4th Season Division 3 - about to start. The field announced in our public forum.

4th Season Division 4 - will start after the higher divisions are completed.

3rd Season Division 5 - With 27 of the 30 rounds having been played, BBChess 1.10 has opened up a small lead over GreKo 5.2.5 and Adam 3.1. NanoSzachy 2.8 and NagaSkaki 4.00 are pushing hard to get in the top three.
Marvin 1.3.0 and Monarch 1.7 are struggling at the other end of the table.


We have a number of tournaments in progress and most of these can be followed in our public forum.


Blitz Notes

The 40/4 is updated separately to 40/40 with the latest update able to be viewed here:
http://computerchess.org.uk/ccrl/404/


Multi-CPU Engines (both 4CPU and 2CPU)
3079 - Rybka 2.3.1 64-bit 2CPU
3021 - Zap!Chess Zanzibar 64-bit 4CPU
2993 - Hiarcs 11.1 4CPU
2946 - Deep Shredder 10 64-bit 4CPU
2943 - Deep Fritz 10 4CPU
2937 - Naum 2.1 64-bit 4CPU
2924 - LoopMP 12.32 2CPU
2917 - Loop 13.5 64-bit 2CPU
2916 - Deep Junior 10 4CPU
2859 - Glaurung 1.2.1 32-bit 4CPU
2752 - Pharaon 3.5.1 2CPU
2735 - Deep Frenzee 3.0 64-bit 2CPU


Single CPU Engines
3025 - Rybka 2.2n 64-bit
2916 - Hiarcs 11.1
2910 - Loop 10.32f
2877 - Fritz 10
2872 - Toga II 1.3x4
2868 - Loop 13.5
2855 - Shredder 10
2853 - Naum 2.1 64-bit
2849 - Fruit 2.2.1
2843 - Junior 10
2827 - Spike 1.2 Turin
2823 - Chess Tiger 2007.1
2822 - Ktulu 8.0
2761 - CM10th Paralyse
2756 - Scorpio 1.91
2756 - Glaurung 1.2.1 32-bit (higher than 64-bit!)
2723 - Bright 0.1d
2723 - Delfi 5.1
2716 - Pro Deo 1.2
2713 - Slow Chess Blitz WV2.1
2709 - Alaric 704

Zap!Chess Zanzibar has too few games to be included yet.


FRC Notes

Ray tests only those engines that can play FRC through the Shredder Classic GUI.
For FRC the best list to look at is the pure list, and the ratings there are:

2921 - Hiarcs 11.1
2905 - Shredder 10
2893 - Loop 10.32f
2859 - Spike 1.2 Turin
2858 - Fruit 2.2.1
2811 - Naum 2.1
2781 - Glaurung 1.2.1
2673 - Pharaon 3.5.1
2619 - Ufim 8.02
2607 - Movei 0.08.383
2478 - Hermann 1.9
2390 - Aice 0.99.2
2363 - Hamsters 0.2
2362 - Ayito 0.2.994


Stats/Presentation Notes

The LOS stats to the right hand side of each rating list are "likelihood of superiority" stats. They tell you the likelihood in percentage terms of each engine being superior to the engine directly below them.

All games are also available for download through the link given at the top of this post. They can be downloaded by engine or by month.
ELO ratings are now saved in all game databases for those engines that have 150 games or more.

A list of games played this week per engine can be found in the update thread in the CCRL public forum, accessible through the link given at the top of this post.

[tiger]

Thanks a lot to the CCRL testers.

I have released Chess Tiger 2007.1 just 6 days ago and the CCRL list already has a quite accurate rating for it! You are doing an impressive job!


// Christophe