CCRL 40/15, 40/2 and FRC lists updated (6th February 2021)

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

User avatar
Graham Banks
Posts: 41472
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

CCRL 40/15, 40/2 and FRC lists updated (6th February 2021)

Post by Graham Banks »

The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://ccrl.chessdom.com/ccrl/4040 (40/15)
http://ccrl.chessdom.com/ccrl/404 (40/2)
http://ccrl.chessdom.com/ccrl/404FRC (FRC 40/2)

Please note that the three lists are often updated separately to each other. The FRC list is only updated when a new engine or engine version is being/has been tested.

The links to the various rating lists can be found just beneath the default Best Versions list (as in this screenshot). Specific 32-bit rating lists are denoted as such to the right of the default list in each category. The default lists contain the 64-bit engines.

Image

Our 40 moves in 15 minutes repeating and 40 moves in 2 minutes repeating are both adjusted to the Intel i7 4770k (3.5GHz) using the Stockfish 10 64-bit benchmark.

Be aware that in the early stages of testing, an engine's rating can often fluctuate a lot.
It is strongly advised to look at the many other rating lists available in order to get a more accurate overall picture of an engine's rating relative to others.

The inclusion or exclusion of engines in our lists should not be taken as our group making a statement about their legality or status. Where there is controversy, it is usually mentioned in the engine notes.

Thanks to all of our currently active testers (Graham, Ray, Gabor, Sergio and Volodymyr). Thanks also to Chessdom.com for hosting our website.

40/15 testing this week that I'm aware of will include (with live broadcast port for TLCV noted where applicable):

Thus Spoke The Raven Tournament (finishing Monday 16053)
New Tournament (starting Monday 16053)
84th Amateur Series Division 1 (continuing 16091)
84th Amateur Series Division 2 (finishing Wednesday 16001)
84th Amateur Series Division 3 (finishing Wednesday 16002)
84th Amateur Series Division 4 (starting Wednesday 16001)
84th Amateur Series Division 5 (starting Wednesday 16002)
Wasp 4.50 64-bit Gauntlet (starting today 16063)
Velvet 1.1.0 64-bit Gauntlet (finishing Wednesday 16064)
Arasan 22.2 64-bit Gauntlet (continuing 16065)
Stash 27.0 64-bit Gauntlet (finishing today 16066)
Marvin 5.0.0 64-bit Gauntlet (starting Wednesday 16066)
Pedone 3.0 64-bit Gauntlet (continuing 16092)
Minic 3.03 64-bit Gauntlet (continuing 16093)
SugaR AI 1.00 64-bit Gauntlet (finishing Wednesday 16094)
Rubichess 2.0 64-bit Gauntlet (starting Wednesday 16094)
Slowchess Blitz Classic 2.5 64-bit 4CPU Gauntlet (continuing 16083)
SugaR AI 1.00 64-bit 4CPU Gauntlet (continuing 16084)

40/2 testing since the last update report has included (thanks to Gabor and Sergio):

Tom Thumb 0.3 64-bit
Belofte 2.1.0 64-bit
Toga III 0.2 64-bit
SlowChess Blitz Classic 2.5 64-bit 8CPU
tomitankChess 5.0 64-bit
Nemorino 6.05 64-bit
Nawito 2012 64-bit

FRC 40/2 testing since the last update report has included (thanks to Ray):

Stockfish 2021-01-11 64-bit
gbanksnz at gmail.com
Modern Times
Posts: 3553
Joined: Thu Jun 07, 2012 11:02 pm

Re: CCRL 40/15, 40/2 and FRC lists updated (6th February 2021)

Post by Modern Times »

Graham Banks wrote: Sat Feb 06, 2021 10:47 pm
FRC 40/2 testing since the last update report has included:

Stockfish 2021-01-11 64-bit
The FRC website has not been updated yet, but Stockfish 2021-01-11 was +51 Elo to Stockfish 12, so leapfrogs Komodo Dragon to first place again.
mehmet123
Posts: 671
Joined: Sun Jan 26, 2020 10:38 pm
Location: Turkey
Full name: Mehmet Karaman

Re: CCRL 40/15, 40/2 and FRC lists updated (6th February 2021)

Post by mehmet123 »

Elo difference between Stockfish Dev 4 Cpu and Stockfish Dev 1 Cpu is only 12 elo.
Elo difference between Dragon by Komodo 4 Cpu and Dragon by Komodo 1 Cpu is only 10 elo:

Elo Differences Between 4 Cpu and 1 Cpu:

Stockfish 12: +39 elo
Komodo 14:+ 77 elo
Houdini 6: + 64 elo
Ethereal 12.75: + 73 elo
Nemorino 6.00:+ 62 elo
Slow Chess Blitz 2.4: + 56 elo
Igel 2.8.0: + 94 elo
Xiphos 0.6: +94 elo
Fire 7.1:+ 65 elo
RofChade 2.3: +71 elo
Modern Times
Posts: 3553
Joined: Thu Jun 07, 2012 11:02 pm

Re: CCRL 40/15, 40/2 and FRC lists updated (6th February 2021)

Post by Modern Times »

Yes, with NNUE engines the days of +100 Elo from 4 cores are long gone. Running them on four cores is in my opinion a complete waste of time. Bear in mind the very large error margins. Unless you can play thousands of games - which usually means a very short time control - that is always a factor.

Regards the Stockfish Dev numbers, they are bayselo numbers which the lists uses. I think Ordo has it as +28 Elo. Take your pick.
Modern Times
Posts: 3553
Joined: Thu Jun 07, 2012 11:02 pm

Re: CCRL 40/15, 40/2 and FRC lists updated (6th February 2021)

Post by Modern Times »

Very likely also that the 1CPU and 4CPU engines are not well connected enough via 1CPU vs 4CPU games, which could be a factor in not showing representative comparative ratings.