CCRL 40/40, 40/4 and FRC lists updated (16th June 2018)

[Graham Banks]

The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://computerchess.org.uk/ccrl/4040/ (40/40)
http://www.computerchess.org.uk/ccrl/404/ (40/4)
http://www.computerchess.org.uk/ccrl/404FRC/ (FRC 40/4)

Please note that the three lists are often updated separately to each other. The FRC list is only updated when a new engine or engine version is being/has been tested.

40/40 testing this week that I'm aware of will include (with live broadcast port for TLCV noted where applicable):

69th Amateur Series Division 8 Tournament (finishing Thursday 16002)
69th Amateur Series Division 9 Tournament (continiung 16053)
Unworldly Presence Tournament (continuing 16001)
New Tournament (starting Thursday 16002)
Taltos rev118 64-bit Gauntlet (continuing 16063)
CT800 1.30 64-bit Gauntlet (continuing 16064)
Betsabe II 1.84 Gauntlet (continuing 16066)
Ethereal 10.0 64-bit Gauntlet (continuing 16091)
Counter 2.7 64-bit Gauntlet (continuing 16092)
RubiChess 0.9 64-bit Gauntlet (finishing Sunday 16093)
Hedgehog 1.82 64-bit Gauntlet (starting Sunday 16093)
Ares 1.005.2.1 64-bit Gauntlet (finishing Tuesday 16094)
Jumbo 0.6.35 64-bit Gauntlet (starting Tuesday 16094)
Komodo 12 MCTS 64-bit 4CPU Gauntlet (continuing 16083)
Fire 7.1 64-bit 4CPU Gauntlet (continuing 16084)
Komodo 12 MCTS 64-bit 4CPU Gauntlet (being run by Tirsa)
Fire 7.1 64-bit 4CPU Gauntlet (being run by Tirsa)
Vajolet2 2.5 64-bit 4CPU Gauntlet (being run by Charles)
Komodo 12 MCTS 64-bit 4CPU Matches (being run by Ray)
Various 4CPU and 1CPU tournaments (being run by Sergio)

40/4 testing since the last update report has included:

Ethereal 10.00 64-bit
Komodo 12.1.1 MCTS 64-bit
Leela Chess 0.10 64-bit w323
Betsabe II 1.84
Pirarucu 2.0.0 64-bit
Hedgehog 1.814 64-bit
Topple 0.0.3 64-bit
Dimitri 4.00
GreKo 2018.05 64-bit
Komodo 12.1.1 MCTS 64-bit 4CPU
Hoichess 0.22.0 64-bit
Various 4CPU and 1CPU tournaments (run by Sergio)

[lkaufman]

So the 40/40 4cpu rating for Komodo 12.1.1 MCTS is ahead of the 4 cpu ratings of Critter 1.6a and Gull 3, the final versions of those strong engines, is tied with Houdini 1.5a, the latest free version, is within ten elo of Nirvana2.4, Houdini 2, and Chiron 4, and is within 20 elo of Fritz 16, Fire 4, Komodo 5.1 (the first Komodo mp), and Stockfish 4, all also on four threads. It would be in 12th place on the one per author list if we allowed MCTS engines to be treated as not in the same family as normal ones. Our latest dev version would be no worse than 9th place now.

[Modern Times]

It would be in 12th place on the one per author list if we allowed MCTS engines to be treated as not in the same family as normal ones. Our latest dev version would be no worse than 9th place now.

That thought had in fact occurred to me briefly - whether Komodo MCTS should be the same family as standard Komodo or not - but I didn't understand enough about the differences to give it any further thought. I don't know if any other members of the group thought about it. The one per author bit isn't the determining factor, there are a few examples of authors having more than one engine. Arminius and Hermann spring to mind, as well as Joker and Micro-Max.

[Kohflote]

Dear all,

Is there any test for Ethereal 10.00 64-bit 4CPU for 40/40?

Thank you & regards,
Koh, Kah Huat

[tpoppins]

There's one currently underway. Should be complete in about a week.

[elcabesa]

Vajolet2 2.5 64-bit 4CPU Gauntlet (being run by Charles)

any news about this gauntlet? I saw it in the report since few weeks ago. I'd like to release a new Vajolet version but wanted to wait for this result before releasing it

[Graham Banks]

Vajolet2 2.5 64-bit 4CPU Gauntlet (being run by Charles)

any news about this gauntlet? I saw it in the report since few weeks ago. I'd like to release a new Vajolet version but wanted to wait for this result before releasing it

Hi,

not sure how Charles is progressing with this.
I'll run it myself once my current gauntlets finish if it's still not done.

Graham.

[elcabesa]

THe Vajolet 2.5 gauntlet seem to be done, I don't know who I should thanks.
so... a big thanks to all the CCRL boys

[lkaufman]

It would be in 12th place on the one per author list if we allowed MCTS engines to be treated as not in the same family as normal ones. Our latest dev version would be no worse than 9th place now.

That thought had in fact occurred to me briefly - whether Komodo MCTS should be the same family as standard Komodo or not - but I didn't understand enough about the differences to give it any further thought. I don't know if any other members of the group thought about it. The one per author bit isn't the determining factor, there are a few examples of authors having more than one engine. Arminius and Hermann spring to mind, as well as Joker and Micro-Max.

Perhaps a more relevant example is that Fritz 16 and Rybka 4 are treated as independent. I'm pretty sure that the difference between Komodo alpha-beta and Komodo MCTS is far greater than the difference between Fritz 16 and Rybka 4. In some ways the difference between Komodo alpha-beta and Komodo MCTS is greater than the differences among Stockfish, Komodo, Houdini, and Fire, although that is a matter of opinion. So I am requesting that Komodo MCTS be treated as independent in the same say as Fritz 16 and Rybka 4 are treated. Not only is the search totally different, but even the evals used are very far apart in general. If this is done, Komodo MCTS would be number 11 in the latest list, and our current dev. version would be at worst number 9 or possibly number 8.

[Modern Times]

Fritz has had different authors and teams over the years and the character of the various versions quite different in some cases. But it is a single brand and it is right that all Fritz are together in one family. Yes Fritz 16 is based on Rybka 4, but nevertheless it is "Fritz", the Fritz branding.

Rybka is a separate brand to Fritz so it is a family of its own. To me this is all clear-cut.

So the family grouping is broadly based on the name or brand, but of course declared derivatives are picked up as well, the Stockfish family being an example.

You do have a point about Komodo MCTS, but at the end of the day it is still Komodo. And same exe in fact although of course you could have released it separately but I don't think that is too relevant. Some engines have improved several hundred Elo over their lifetime. So they must be very different, but yet the name of the engine is the same and the same family name.

We will discuss Komodo MCTS further. There is some flexibility around things like this.