CCRL update (2nd June 2007)

[Graham Banks]

The June 2nd update of the CCRL Rating Lists and Statistics is now available for viewing at:
http://www.computerchess.org.uk/ccrl/4040/

The links to the various rating lists can be found just beneath the default Best Versions list.
For example there is a 32-bit Single CPU list.

Our standard testing is at 40 moves in 40 minutes repeating while our current blitz testing is at both 40 moves in 4 minutes repeating and 40 moves in 12 minutes repeating, all adjusted to the AMD64 X2 4600+ (2.4GHz).

Currently active testers in our team are:
Graham Banks, Ray Banks, Shaun Brewer, Kirill Kryukov, Dom Leste, Tom Logan, Andreas Schwartmann, Charles Smith, George Speight, Chris Taylor, Chuck Wilson, Gabor Szots and Martin Thoresen.

We remain on the lookout for more testers to help, so please contact one of us if you're interested.
You do not need to own any commercial engines as amateurs are also a big part of our testing.


40/40 Notes

986 games were added to our 40/40 database this week, making a total of 60,850 games.
A big thanks to all testers as usual.

Many engines on our list have few games and in many cases their ratings are likely to fluctuate (markedly for some) until a lot more games are played. Therefore no conclusions should be drawn about their strength yet.
To illustrate this point, when an engine has 200 games played, the error margin is still approximately +/-40 ELO, after 500 games +-25 ELO, after 1000 games +-17 ELO and even after 2000 games there is a +-13 ELO error margin!
This of course highlights the importance of looking at other rating lists that are also available in order to draw comparisons and get a more accurate overall picture.

We are not testing Rybka 2.3 at 40/40, preferring to wait for the bugfixed Rybka 2.3.2 to be released.
Glaurung 2 epsilon/2 and Strelka 1.0b still have too few games to be listed.


4CPU Engines
3105 - Rybka 2.2 64-bit 4CPU
3046 - Zap!Chess Zanzibar 64-bit 4CPU
2979 - Hiarcs 11.1 4CPU
2956 - Naum 2.1 64-bit 4CPU
2940 - Loop 13.6 64-bit 4CPU
2928 - Deep Shredder 10 64-bit 4CPU
2923 - Deep Fritz 10 4CPU
2923 - Deep Junior 10 4CPU
2861 - Glaurung 1.2.1 64-bit 4CPU


2CPU Engines
3074 - Rybka 2.1 64-bit 2CPU
3052 - Rybka 2.2 64-bit 2CPU
3031 - Zap!Chess Zanzibar 64-bit 2CPU (only 108 games)
2952 - Deep Fritz 10 2CPU (only 94 games)
2947 - Hiarcs 11.1 2CPU
2927 - LoopMP 12.32 2CPU
2921 - Naum 2.1 64-bit 2CPU
2919 - Loop 13.6 64-bit 2CPU
2899 - Deep Junior 10 2CPU
2896 - Deep Shredder 10 64-bit 2CPU
2819 - Glaurung 1.2.1 Avalanche 64-bit 2CPU
2817 - Glaurung 1.2.1 64-bit 2CPU
2795 - Scorpio 1.9 32-bit 2CPU (Scorpio 1.91 untested)
2744 - Deep Frenzee 3.0 64-bit 2CPU (only 56 games)
2735 - Pharaon 3.5.1 32-bit 2CPU


Single CPU Engines
2999 - Rybka 2.2 64-bit
2912 - Loop 13.6 32-bit (only 109 games and 64-bit untested)
2910 - Hiarcs 11.1
2905 - Zap!Chess Zanzibar 64-bit
2877 - Fritz 10
2872 - Shredder 10
2861 - Toga II 1.2.1a (not testing Toga II 1.3x4 yet due to egbb access bug)
2850 - Spike 1.2 Turin
2847 - Naum 2.1 32-bit (64-bit untested)
2846 - Junior 10
2843 - Deep Sjeng 2.5 1CPU (only 132 games)
2840 - Fruit 2.2.1
2832 - Junior 10.1
2802 - Ktulu 8.0
2797 - SmarThink 1.00 64-bit (only 85 games)
2795 - Chess Tiger 2007.1
2785 - Glaurung 1.2.1 Beren 64-bit
2783 - Scorpio 1.84
2768 - Glaurung 1.2.1 64-bit
2763 - CM9000 Enforcer
2762 - Alaric 704 (only 135 games)
2762 - CM10th Xperience
2757 - Scorpio 1.91
2744 - Delfi 5.1
2741 - Slow Chess Blitz WV2.1
2734 - CM10th Default
2731 - Ruffian 2.1.0
2725 - Pro Deo 1.2
2725 - WildCat 7
2723 - Gandalf 6
2707 - Pharaon 3.5.1
2703 - Petir 4.39


CCRL Amateur Championship (32-bit 1CPU):
4th Season Division 1 - Spike claimed the crown while Jonny, The Baron, Movei and Pseudo were relegated.

4th Season Division 2 - Alaric, Little Goliath and Ufim gained promotion while Post Modernist, Snitch, Gaia, Amateur and Matacz were relegated.

4th Season Division 3 - Patzer, AnMon and Djinn gained promotion while Hamsters, Tytan, Thor's Hammer, Arion and Typhoon were relegated.

4th Season Division 4 - Diablo, Aice and BugChess gained promotion while GreKo, AliChess, Deuterium, Ayito and BBChess were relegated.

4th Season Division 5 - will start once the Qualifier is completed.

Qualifier - after 8 of the 30 rounds, Joker, Buzz and Latista occupy the three promotion spots ahead of Prophet, Flux and Mediocre.


We have a number of tournaments in progress and most of these can be followed in our public forum.


Blitz Notes

The 40/4 is updated separately to 40/40 with the latest update able to be viewed here:
http://computerchess.org.uk/ccrl/404.live/

Multi-CPU Engines (both 4CPU and 2CPU)
3078 - Rybka 2.3.1 64-bit 2CPU
3021 - Zap!Chess Zanzibar 64-bit 4CPU
2993 - Hiarcs 11.1 4CPU
2945 - Deep Shredder 10 64-bit 4CPU
2943 - Deep Fritz 10 4CPU
2937 - Naum 2.1 64-bit 4CPU
2924 - LoopMP 12.32 2CPU
2916 - Deep Junior 10 4CPU
2904 - Loop 13.6 64-bit 2CPU
2859 - Glaurung 1.2.1 32-bit 4CPU
2753 - Pharaon 3.5.1 2CPU
2734 - Deep Frenzee 3.0 64-bit 2CPU
2723 - Scorpio 1.81 2CPU (Scorpio 1.91 2CPU untested)
2713 - Crafty 20.14 2CPU (Crafty 21.5 CPU untested)
2388 - Little Thought 0.98 64-bit 2CPU (later version untested)


Single CPU Engines
3025 - Rybka 2.2 64-bit
2993 - Rybka 2.3.1 32-bit
2916 - Hiarcs 11.1
2909 - Loop 10.32f
2871 - Toga II 1.3x4
2868 - Fritz 10
2865 - Loop 13.6 32-bit (only 116 games)
2855 - Shredder 10
2853 - Naum 2.1 64-bit
2850 - Fruit 2.2.1
2847 - Zap!Chess Zanzibar 32-bit (64-bit untested)
2842 - Strelka 1.0b
2841 - Junior 10
2828 - Junior 10.1
2827 - Spike 1.2 Turin
2826 - Chess Tiger 2007.1
2821 - Ktulu 8.0
2774 - Deep Sjeng 2.5 1CPU
2763 - Glaurung 2 epsilon/2 32-bit (64-bit untested)
2760 - CM10th Paralyse
2951 - Scorpio 1.9
2750 - Scorpio 1.91
2746 - SmarThink 1.00 32-bit (only 116 games, 64-bit untested)
2739 - Bright 0.1d
2720 - Delfi 5.1
2719 - Pro Deo 1.2
2817 - CM10th Default
2716 - Alaric 704
2712 - Slow Chess Blitz WV2.1
2702 - Gandalf 6
2701 - Pharaon 3.5.1
2700 - Frenzee 3.0 64-bit (only 69 games)
2698 - WildCat 7
2684 - Chiron 0.8.7


FRC Notes

Ray tests only those engines that can play FRC through the Shredder Classic GUI.
Deep Sjeng 2.5 1CPU has now been added to the rating list.
For FRC the best list to look at is the pure list, and the ratings there are:

2924 - Hiarcs 11.1
2909 - Shredder 10
2893 - Loop 10.32f
2858 - Spike 1.2 Turin
2856 - Fruit 2.2.1
2816 - Naum 2.1
2775 - Glaurung 1.2.1
2750 - Deep Sjeng 2.5 1CPU
2673 - Pharaon 3.5.1
2617 - Ufim 8.02
2604 - Movei 0.08.383
2470 - Hermann 1.9
2386 - Aice 0.99.2
2358 - Hamsters 0.2
2357 - Ayito 0.2.994


Stats/Presentation Notes

The LOS stats to the right hand side of each rating list are "likelihood of superiority" stats. They tell you the likelihood in percentage terms of each engine being superior to the engine directly below them.

All games are also available for download through the link given at the top of this post. They can be downloaded by engine or by month.
ELO ratings are now saved in all game databases for those engines that have 150 games or more.

A list of games played this week per engine can be found in the update thread in the CCRL public forum, accessible through the link given at the top of this post.