CCRL 40/40, 40/4 and FRC lists updated (30th December 2017)

Discussion of computer chess matches and engine tournaments.

Moderators: bob, hgm, Harvey Williamson

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
User avatar
Graham Banks
Posts: 33143
Joined: Sun Feb 26, 2006 9:52 am
Location: Auckland, NZ

CCRL 40/40, 40/4 and FRC lists updated (30th December 2017)

Post by Graham Banks » Sun Dec 31, 2017 7:45 am

The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://computerchess.org.uk/ccrl/4040/ (40/40)
http://www.computerchess.org.uk/ccrl/404/ (40/4)
http://www.computerchess.org.uk/ccrl/404FRC/ (FRC 40/4)

Please note that the three lists are often updated separately to each other. The FRC list is only updated when a new engine or engine version is being/has been tested.

40/40 testing this week that I'm aware of will include (with live broadcast port for TLCV noted where applicable):

67th Amateur Series Division 6 Tournament (finishing Wednesday 16002)
67th Amateur Series Division 7 Tournament (continuing 16001)
67th Amateur Series Division 8 Tournament (starting Wednesday 16002)
Super Tournament XXIX 1CPU (finishing Monday 16053)
Threats Beneath The Surface Tournament (starting Monday 16053)
Ethereal 8.62 64-bit Gauntlet (continuing 16063)
Isa 2.0.61 64-bit Gauntlet (continuing 16064)
Gogobello 1.4 64-bit Gauntlet (finishing Monday 16065)
ChessBrainVB Gauntlet (starting Monday 16066)
tomitankChess 1.5 64-bit Gauntlet (finishing)
Tucano 7.00 64-bit Gauntlet (finishing)
Nemorino 4.0 64-bit Gauntlet (continuing)
Fizbo 2.0 64-bit Gauntlet (continuing)
Laser 1.5 64-bit Gauntlet (starting)
Fruit Reloaded 3.2.1 64-bit Gauntlet (starting)
The Baron 3.41 64-bit 4CPU Gauntlet (being run by Tirsa)
Arasan 20.3 64-bit 4CPU Gauntlet (being run by Charles)
Ethereal 8.62 64-bit 4CPU Gauntlet (continuing 16083)
Fizbo 2.0 64-bit 4CPU Gauntlet (starting Monday 16084)
Various 4CPU and 1CPU tournaments (being run by Sergio)

40/4 testing since the last update has included:

chess22k 1.6 64-bit
Gogobello 1.4 64-bit
Tucano 7.00 64-bit
Arasan 20.3 64-bit 4CPU
Nemorino 4.00 64-bit
Counter 2.1.0 64-bit
Senpai 2.0 64-bit 4CPU
Isa 2.0.61 64-bit
Wasp 2.6 64-bit
Fizbo 2 64-bit
Sting SF 9 64-bit 4CPU
Sayuri 2017.16.12 64-bit
Jumbo 0.5.27 64-bit
FireFly 2.7.2 64-bit
ChessBrainVB 3.60
Javalin 1.3.1 64-bit
Devel 1.8090
Fruit reloaded 3.2.1 64-bit

FRC testing either completed or in progress:

Tornado 8.0 64-bit [completed]
Arminius 2017-01-01 64-bit [in progress]
Nemorino 4.0 64-bit [in progress]
My email addresses:
gbanksnz at gmail.com
gbanksnz at yahoo.co.nz

kasinp
Posts: 189
Joined: Sat Dec 02, 2006 9:47 pm
Location: Toronto

Re: CCRL 40/40, 40/4 and FRC lists updated (30th December 20

Post by kasinp » Sun Dec 31, 2017 9:05 pm

Thank you Graham. Quick question: is there a reason why the 40/40 pure list still has Texel 1.06, while the newer has earned a higher rating (and has played more games)?

Happy New Year!
PK

User avatar
Graham Banks
Posts: 33143
Joined: Sun Feb 26, 2006 9:52 am
Location: Auckland, NZ

Re: CCRL 40/40, 40/4 and FRC lists updated (30th December 20

Post by Graham Banks » Sun Dec 31, 2017 9:10 pm

kasinp wrote:Thank you Graham. Quick question: is there a reason why the 40/40 pure list still has Texel 1.06, while the newer has earned a higher rating (and has played more games)?

Happy New Year!
PK
I'll let Ray answer that one.
I never really look at the pure list.

Happy New Year to yourself also. :)
My email addresses:
gbanksnz at gmail.com
gbanksnz at yahoo.co.nz

Modern Times
Posts: 2409
Joined: Thu Jun 07, 2012 9:02 pm

Re: CCRL 40/40, 40/4 and FRC lists updated (30th December 20

Post by Modern Times » Mon Jan 01, 2018 1:02 am

kasinp wrote:Thank you Graham. Quick question: is there a reason why the 40/40 pure list still has Texel 1.06, while the newer has earned a higher rating (and has played more games)?

Happy New Year!
PK
With games played against common opponents Texel 1.06 is stronger than 1.07. That is the way the pure list works. That selection is automatic, we don't manually select which engine goes on the pure list. More games might well sort out the "problem". When a new version is close in strength to the old one, this can and does happen. ON the overall list the difference is +10 Elo.

When I was testing for these lists, the pure list was my only focus. To me it is the most important list.
.

Opinions expressed here are my own, and not necessarily those of the CCRL Group.

User avatar
Ovyron
Posts: 2702
Joined: Tue Jul 03, 2007 2:30 am

Re: CCRL 40/40, 40/4 and FRC lists updated (30th December 20

Post by Ovyron » Mon Jan 01, 2018 1:25 am

Hello Ray.

I would like to know if it would be possible for me to program an engine, and then make it appear multiple times on the Pure List by changing its name in future versions.

The Rybka 4->Fritz 15->Fritz 16 case is curious. I think it would make more sense to have the Pure list show engines of different authors, even if they have the same name (so, instead of having Rybka twice as it was rebranded, you have all the Fritz engines on there that were by a different author, at least, Fritz 14 is the lastest version of its branch, nothing to do with Fritz 15, so it'd make more sense to have F14 and F15 in the pure list, and not Rybka and rebranded!Rybka.)

kasinp
Posts: 189
Joined: Sat Dec 02, 2006 9:47 pm
Location: Toronto

Re: CCRL 40/40, 40/4 and FRC lists updated (30th December 20

Post by kasinp » Mon Jan 01, 2018 12:14 pm

Modern Times wrote:
kasinp wrote:Thank you Graham. Quick question: is there a reason why the 40/40 pure list still has Texel 1.06, while the newer has earned a higher rating (and has played more games)?

Happy New Year!
PK
With games played against common opponents Texel 1.06 is stronger than 1.07. That is the way the pure list works. That selection is automatic, we don't manually select which engine goes on the pure list. More games might well sort out the "problem". When a new version is close in strength to the old one, this can and does happen. ON the overall list the difference is +10 Elo.

When I was testing for these lists, the pure list was my only focus. To me it is the most important list.
Thank you, makes sense now. Appreciate the response.
PK

Kohflote
Posts: 200
Joined: Wed Sep 19, 2007 9:07 am
Location: Singapore

Re: CCRL 40/40, 40/4 and FRC lists updated (30th December 20

Post by Kohflote » Tue Jan 02, 2018 12:11 am

Hi Ray,
Sorry, could you explain more on the pure list, please. Take Texel 1.06 & 1.07 as an example. There are common opponents but there are many other not common opponents too. E.g., how many common opponents will be considered to take the best version in the Pure list? What about not common opponents, are they taken into consideration?

Thank you and regards,
Koh, Kah Huat

Kohflote
Posts: 200
Joined: Wed Sep 19, 2007 9:07 am
Location: Singapore

Re: CCRL 40/40, 40/4 and FRC lists updated (30th December 20

Post by Kohflote » Wed Jan 03, 2018 9:34 pm

Hi all,
No comment from Ray / CCRL on my question about the pure list?

Best regards,
Koh, Kah Huat

Modern Times
Posts: 2409
Joined: Thu Jun 07, 2012 9:02 pm

Re: CCRL 40/40, 40/4 and FRC lists updated (30th December 20

Post by Modern Times » Wed Jan 03, 2018 10:17 pm

Only common opponents are taken into account when the calculations are made for which version appears on the pure list.
.

Opinions expressed here are my own, and not necessarily those of the CCRL Group.

Modern Times
Posts: 2409
Joined: Thu Jun 07, 2012 9:02 pm

Re: CCRL 40/40, 40/4 and FRC lists updated (30th December 20

Post by Modern Times » Fri Jan 05, 2018 6:09 am

kasinp wrote:
Modern Times wrote:
kasinp wrote:Thank you Graham. Quick question: is there a reason why the 40/40 pure list still has Texel 1.06, while the newer has earned a higher rating (and has played more games)?

Happy New Year!
PK
With games played against common opponents Texel 1.06 is stronger than 1.07. That is the way the pure list works. That selection is automatic, we don't manually select which engine goes on the pure list. More games might well sort out the "problem". When a new version is close in strength to the old one, this can and does happen. ON the overall list the difference is +10 Elo.

When I was testing for these lists, the pure list was my only focus. To me it is the most important list.
Thank you, makes sense now. Appreciate the response.
PK
Some more Texel games have been played this week, introducing another common opponent, and I think now Texel 1.07 will be on the pure list in tomorrow's update. The answer is ususally in more games and making sure enough of them are against common opponents.

I'd much rather the processing was simply just to put the latest version on the pure list, whether it is stronger or not, but instead we have the rather complicated method at the moment. If enough games are played the answer is usually the same, but with 4040 getting enough games played isn't always easy.
.

Opinions expressed here are my own, and not necessarily those of the CCRL Group.

Post Reply