CCRL 40/40, 40/4 and FRC lists updated (30th December 2017)

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

User avatar
Graham Banks
Posts: 41415
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

CCRL 40/40, 40/4 and FRC lists updated (30th December 2017)

Post by Graham Banks »

The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://computerchess.org.uk/ccrl/4040/ (40/40)
http://www.computerchess.org.uk/ccrl/404/ (40/4)
http://www.computerchess.org.uk/ccrl/404FRC/ (FRC 40/4)

Please note that the three lists are often updated separately to each other. The FRC list is only updated when a new engine or engine version is being/has been tested.

40/40 testing this week that I'm aware of will include (with live broadcast port for TLCV noted where applicable):

67th Amateur Series Division 6 Tournament (finishing Wednesday 16002)
67th Amateur Series Division 7 Tournament (continuing 16001)
67th Amateur Series Division 8 Tournament (starting Wednesday 16002)
Super Tournament XXIX 1CPU (finishing Monday 16053)
Threats Beneath The Surface Tournament (starting Monday 16053)
Ethereal 8.62 64-bit Gauntlet (continuing 16063)
Isa 2.0.61 64-bit Gauntlet (continuing 16064)
Gogobello 1.4 64-bit Gauntlet (finishing Monday 16065)
ChessBrainVB Gauntlet (starting Monday 16066)
tomitankChess 1.5 64-bit Gauntlet (finishing)
Tucano 7.00 64-bit Gauntlet (finishing)
Nemorino 4.0 64-bit Gauntlet (continuing)
Fizbo 2.0 64-bit Gauntlet (continuing)
Laser 1.5 64-bit Gauntlet (starting)
Fruit Reloaded 3.2.1 64-bit Gauntlet (starting)
The Baron 3.41 64-bit 4CPU Gauntlet (being run by Tirsa)
Arasan 20.3 64-bit 4CPU Gauntlet (being run by Charles)
Ethereal 8.62 64-bit 4CPU Gauntlet (continuing 16083)
Fizbo 2.0 64-bit 4CPU Gauntlet (starting Monday 16084)
Various 4CPU and 1CPU tournaments (being run by Sergio)

40/4 testing since the last update has included:

chess22k 1.6 64-bit
Gogobello 1.4 64-bit
Tucano 7.00 64-bit
Arasan 20.3 64-bit 4CPU
Nemorino 4.00 64-bit
Counter 2.1.0 64-bit
Senpai 2.0 64-bit 4CPU
Isa 2.0.61 64-bit
Wasp 2.6 64-bit
Fizbo 2 64-bit
Sting SF 9 64-bit 4CPU
Sayuri 2017.16.12 64-bit
Jumbo 0.5.27 64-bit
FireFly 2.7.2 64-bit
ChessBrainVB 3.60
Javalin 1.3.1 64-bit
Devel 1.8090
Fruit reloaded 3.2.1 64-bit

FRC testing either completed or in progress:

Tornado 8.0 64-bit [completed]
Arminius 2017-01-01 64-bit [in progress]
Nemorino 4.0 64-bit [in progress]
gbanksnz at gmail.com
kasinp
Posts: 251
Joined: Sat Dec 02, 2006 10:47 pm
Location: Toronto
Full name: Peter Kasinski

Re: CCRL 40/40, 40/4 and FRC lists updated (30th December 20

Post by kasinp »

Thank you Graham. Quick question: is there a reason why the 40/40 pure list still has Texel 1.06, while the newer has earned a higher rating (and has played more games)?

Happy New Year!
PK
User avatar
Graham Banks
Posts: 41415
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: CCRL 40/40, 40/4 and FRC lists updated (30th December 20

Post by Graham Banks »

kasinp wrote:Thank you Graham. Quick question: is there a reason why the 40/40 pure list still has Texel 1.06, while the newer has earned a higher rating (and has played more games)?

Happy New Year!
PK
I'll let Ray answer that one.
I never really look at the pure list.

Happy New Year to yourself also. :)
gbanksnz at gmail.com
Modern Times
Posts: 3546
Joined: Thu Jun 07, 2012 11:02 pm

Re: CCRL 40/40, 40/4 and FRC lists updated (30th December 20

Post by Modern Times »

kasinp wrote:Thank you Graham. Quick question: is there a reason why the 40/40 pure list still has Texel 1.06, while the newer has earned a higher rating (and has played more games)?

Happy New Year!
PK
With games played against common opponents Texel 1.06 is stronger than 1.07. That is the way the pure list works. That selection is automatic, we don't manually select which engine goes on the pure list. More games might well sort out the "problem". When a new version is close in strength to the old one, this can and does happen. ON the overall list the difference is +10 Elo.

When I was testing for these lists, the pure list was my only focus. To me it is the most important list.
User avatar
Ovyron
Posts: 4556
Joined: Tue Jul 03, 2007 4:30 am

Re: CCRL 40/40, 40/4 and FRC lists updated (30th December 20

Post by Ovyron »

Hello Ray.

I would like to know if it would be possible for me to program an engine, and then make it appear multiple times on the Pure List by changing its name in future versions.

The Rybka 4->Fritz 15->Fritz 16 case is curious. I think it would make more sense to have the Pure list show engines of different authors, even if they have the same name (so, instead of having Rybka twice as it was rebranded, you have all the Fritz engines on there that were by a different author, at least, Fritz 14 is the lastest version of its branch, nothing to do with Fritz 15, so it'd make more sense to have F14 and F15 in the pure list, and not Rybka and rebranded!Rybka.)
kasinp
Posts: 251
Joined: Sat Dec 02, 2006 10:47 pm
Location: Toronto
Full name: Peter Kasinski

Re: CCRL 40/40, 40/4 and FRC lists updated (30th December 20

Post by kasinp »

Modern Times wrote:
kasinp wrote:Thank you Graham. Quick question: is there a reason why the 40/40 pure list still has Texel 1.06, while the newer has earned a higher rating (and has played more games)?

Happy New Year!
PK
With games played against common opponents Texel 1.06 is stronger than 1.07. That is the way the pure list works. That selection is automatic, we don't manually select which engine goes on the pure list. More games might well sort out the "problem". When a new version is close in strength to the old one, this can and does happen. ON the overall list the difference is +10 Elo.

When I was testing for these lists, the pure list was my only focus. To me it is the most important list.
Thank you, makes sense now. Appreciate the response.
PK
Kohflote
Posts: 219
Joined: Wed Sep 19, 2007 11:07 am
Location: Singapore

Re: CCRL 40/40, 40/4 and FRC lists updated (30th December 20

Post by Kohflote »

Hi Ray,
Sorry, could you explain more on the pure list, please. Take Texel 1.06 & 1.07 as an example. There are common opponents but there are many other not common opponents too. E.g., how many common opponents will be considered to take the best version in the Pure list? What about not common opponents, are they taken into consideration?

Thank you and regards,
Koh, Kah Huat
Kohflote
Posts: 219
Joined: Wed Sep 19, 2007 11:07 am
Location: Singapore

Re: CCRL 40/40, 40/4 and FRC lists updated (30th December 20

Post by Kohflote »

Hi all,
No comment from Ray / CCRL on my question about the pure list?

Best regards,
Koh, Kah Huat
Modern Times
Posts: 3546
Joined: Thu Jun 07, 2012 11:02 pm

Re: CCRL 40/40, 40/4 and FRC lists updated (30th December 20

Post by Modern Times »

Only common opponents are taken into account when the calculations are made for which version appears on the pure list.
Modern Times
Posts: 3546
Joined: Thu Jun 07, 2012 11:02 pm

Re: CCRL 40/40, 40/4 and FRC lists updated (30th December 20

Post by Modern Times »

kasinp wrote:
Modern Times wrote:
kasinp wrote:Thank you Graham. Quick question: is there a reason why the 40/40 pure list still has Texel 1.06, while the newer has earned a higher rating (and has played more games)?

Happy New Year!
PK
With games played against common opponents Texel 1.06 is stronger than 1.07. That is the way the pure list works. That selection is automatic, we don't manually select which engine goes on the pure list. More games might well sort out the "problem". When a new version is close in strength to the old one, this can and does happen. ON the overall list the difference is +10 Elo.

When I was testing for these lists, the pure list was my only focus. To me it is the most important list.
Thank you, makes sense now. Appreciate the response.
PK
Some more Texel games have been played this week, introducing another common opponent, and I think now Texel 1.07 will be on the pure list in tomorrow's update. The answer is ususally in more games and making sure enough of them are against common opponents.

I'd much rather the processing was simply just to put the latest version on the pure list, whether it is stronger or not, but instead we have the rather complicated method at the moment. If enough games are played the answer is usually the same, but with 4040 getting enough games played isn't always easy.