CEGT 40/20 update (May 06) - with early Strelka rating

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
Werner
Posts: 2947
Joined: Wed Mar 08, 2006 10:09 pm
Location: Germany
Full name: Werner Schüle

CEGT 40/20 update (May 06) - with early Strelka rating

Post by Werner »

Hi all :D,

Our newest rating list 40/20 is now online. All links at the end of the posting as usual.

The new DeepSjeng 2.5 2CPU has now 640 games and a rating of 2726 which is 60 points better than DeepSjeng 1.6! This is a remarkable performance but we do not think to get the announced +120 Elos. We also started to test the single version of DeepSjeng 2.5. The rating after only 196 games maybe too high. We will see next week what happens.

Brandnew is the beta engine Strelka 1.0 from Juri Osipov. After 162 games we have an early rating of 2759!! This is a really interesting engine with 50% results against Spike 1.2 Turin, Fruit and Toga. Next week we will have a more reliable rating.

The rating of Shredder 10.1 is now corrected after 300 more games. It´s very close to Shredder 10 and we will list it as 1 engine as Stefan told us he did no change search or evaluation.

ChessTiger2007.1 has now 977 games and the rating is 2 points behind the previous version. There was a good result against Toga1.2.1 and a very bad result against Shredder 10.1.

A quite similar situation we have with Loop 13.6 2CPU. The rating is now a bit better but 17 Elos behind Loop 13.5 and 22 behind Loop 12.32 2CPU.

A big thanks to all testers as usual.

Links:
All-Versions: http://www.husvankempen.de/nunn/40_40%2 ... liste.html
Best-Versions: http://www.husvankempen.de/nunn/40_40%2 ... liste.html
Blitz: http://www.husvankempen.de/nunn/blitz.htm (also with Best-Versions and All-Versions lists)
40/120: http://www.husvankempen.de/nunn/40_120_ ... liste.html
Replay-Zone: http://www.husvankempen.de/nunn/Replay/replay.htm
Elo comparison 40/120 and 40/20: http://www.husvankempen.de/nunn/Replay/ ... arison.htm
Testers with picture and Hardware: http://www.husvankempen.de/nunn/testers/testers.htm

Werner Schüle
CEGT-Team
Uri Blass
Posts: 10734
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: CEGT 40/20 update (May 06) - with early Strelka rating

Post by Uri Blass »

Werner wrote:Hi all :D,

Our newest rating list 40/20 is now online. All links at the end of the posting as usual.

The new DeepSjeng 2.5 2CPU has now 640 games and a rating of 2726 which is 60 points better than DeepSjeng 1.6! This is a remarkable performance but we do not think to get the announced +120 Elos. We also started to test the single version of DeepSjeng 2.5. The rating after only 196 games maybe too high. We will see next week what happens.
I do not know but based on comparison with other lists it is possible that there is some bug in the 2 cpu implementation in Deep Sjeng.

CCRL also has high rating for the 1 cpu.
It is possible that the announced +120 elo is based on testing the 1 cpu version and not based on testing the 2 cpu version.

I see no reason to think that the rating for the single version is too high
only because it is higher than the rating that you expect based on the rating of the 2 cpu version.

Uri
chessfurby
Posts: 49
Joined: Thu Apr 26, 2007 1:41 pm
Location: Germany, Bavaria

Re: CEGT 40/20 update (May 06) - with early Strelka rating

Post by chessfurby »

hi Uri, Wolfgang

Indeed in our testing the 1 cpu version was used and we think that it is approx 120 Elo points better than the previous verison.
I do not know if its an smp bug or something, i'm sure Gian-Carlo will look into it asap.

Cheers