CCRL 40/15, 40/2 and FRC lists updated (6th March 2021)

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

User avatar
Graham Banks
Posts: 41454
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

CCRL 40/15, 40/2 and FRC lists updated (6th March 2021)

Post by Graham Banks »

The latest CCRL Rating Lists and Statistics are available for viewing from the following links:
http://ccrl.chessdom.com/ccrl/4040 (40/15)
http://ccrl.chessdom.com/ccrl/404 (40/2)
http://ccrl.chessdom.com/ccrl/404FRC (FRC 40/2)

Please note that the three lists are often updated separately to each other. The FRC list is only updated when a new engine or engine version is being/has been tested.

The links to the various rating lists can be found just beneath the default Best Versions list (as in this screenshot). Specific 32-bit rating lists are denoted as such to the right of the default list in each category. The default lists contain the 64-bit engines.

Image

Our 40 moves in 15 minutes repeating and 40 moves in 2 minutes repeating are both adjusted to the Intel i7 4770k (3.5GHz) using the Stockfish 10 64-bit benchmark.

Be aware that in the early stages of testing, an engine's rating can often fluctuate a lot.
It is strongly advised to look at the many other rating lists available in order to get a more accurate overall picture of an engine's rating relative to others.

The inclusion or exclusion of engines in our lists should not be taken as our group making a statement about their legality or status. Where there is controversy, it is usually mentioned in the engine notes.

Thanks to all of our currently active testers (Graham, Ray, Gabor and Sergio). Thanks also to Chessdom.com for hosting our website.

40/15 testing this week that I'm aware of will include (with live broadcast port for TLCV noted where applicable):

84th Amateur Series Division 6 (continuing 16002)
84th Amateur Series Division 7 (continuing 16001)
84th Amateur Series Division 8 (continuing 16053)
FoxSEE 5.3 64-bit Gauntlet (starting today 16063)
Marvin 5.0.0 64-bit Gauntlet (finishing today 16064)
Toga III 0.2 64-bit Gauntlet (continuing 16065)
Francesca MAD 0.30a 64-bit Gauntlet (continuing 16066)
Rubichess 2.0 64-bit Gauntlet (finishing Thursday 16091)
Halogen 10 64-bit Gauntlet (starting Thursday 16091)
Counter 3.7 64-bit Gauntlet (finishing Tuesday 16092)
Fire 8 64-bit Gauntlet (finishing Tuesday 16092)
Nemorino 6.05 64-bit Gauntlet (finishing Wednesday 16093)
Lozza 2.0 64-bit Gauntlet (starting Wednesday 16093)
Slowchess Blitz Classic 2.5 64-bit Gauntlet (continuing 16094)
Vajolet2 2.28 64-bit 4CPU Gauntlet (continuing 16083)
RubiChess 2.0 64-bit 4CPU Gauntlet (continuing 16084)

40/2 testing since the last update report has included (thanks to Gabor and Sergio):

Velvet 1.2.0 64-bit
Stash 28.0 64-bit
SebLague Chess-AI 0.1
Lozza 2.0 64-bit
Quapla 0.1.1 64-bit
Fire 8 64-bit 8CPU
Monchester 1.0 64-bit
Stockfish 13 64-bit
KnightX 2.61 64-bit
gbanksnz at gmail.com
Chessqueen
Posts: 5588
Joined: Wed Sep 05, 2018 2:16 am
Location: Moving
Full name: Jorge Picado

Re: CCRL 40/15, 40/2 and FRC lists updated (6th March 2021)

Post by Chessqueen »

Just have a simple question, you do NOT test LC0, Alliestein, and Stoofvless in FRC because you do NOT have their FRC Nets whereas TCEC have them for those Engines :?: https://tcec-chess.com/live.html
Who is 17 years old GM Gukesh 2nd at the Candidate in Toronto?
https://indianexpress.com/article/sport ... t-9281394/
Modern Times
Posts: 3550
Joined: Thu Jun 07, 2012 11:02 pm

Re: CCRL 40/15, 40/2 and FRC lists updated (6th March 2021)

Post by Modern Times »

Chessqueen wrote: Wed Mar 10, 2021 11:59 pm Just have a simple question, you do NOT test LC0, Alliestein, and Stoofvless in FRC because you do NOT have their FRC Nets whereas TCEC have them for those Engines :?: https://tcec-chess.com/live.html
A simple answer - because testing GPU engines is a total pain in the arse. No concurrency, even if you had a machine with dozens of cores you can run only one match. Not to mention the thousands of different nets available, which do you choose ? Not to mention choosing the "right" GPU. And yes, given all of that, no incentive to buy a Net. We certainly did run a few thousand FRC games with Lc0 and Allie, and they were on the list for a while. But we then made the decision to discontinue. Same with 40/15, we did test for a little while there too. Even harder there with the longer time control. There was no point leaving old versions there so they were removed. Below is an FRC screenshot before they were removed.

The standard blitz list is our only list with GPU engines. Not saying they won't return to the other lists, but it is unlikely.

http://ccrl.chessdom.com/public/FRC_Lc0.PNG
Chessqueen
Posts: 5588
Joined: Wed Sep 05, 2018 2:16 am
Location: Moving
Full name: Jorge Picado

Re: CCRL 40/15, 40/2 and FRC lists updated (6th March 2021)

Post by Chessqueen »

Modern Times wrote: Thu Mar 11, 2021 2:00 am
Chessqueen wrote: Wed Mar 10, 2021 11:59 pm Just have a simple question, you do NOT test LC0, Alliestein, and Stoofvless in FRC because you do NOT have their FRC Nets whereas TCEC have them for those Engines :?: https://tcec-chess.com/live.html
A simple answer - because testing GPU engines is a total pain in the arse. No concurrency, even if you had a machine with dozens of cores you can run only one match. Not to mention the thousands of different nets available, which do you choose ? Not to mention choosing the "right" GPU. And yes, given all of that, no incentive to buy a Net. We certainly did run a few thousand FRC games with Lc0 and Allie, and they were on the list for a while. But we then made the decision to discontinue. Same with 40/15, we did test for a little while there too. Even harder there with the longer time control. There was no point leaving old versions there so they were removed. Below is an FRC screenshot before they were removed.

The standard blitz list is our only list with GPU engines. Not saying they won't return to the other lists, but it is unlikely.

http://ccrl.chessdom.com/public/FRC_Lc0.PNG
So probably your site CCRL could be the first to test the 10 best engines on your CCRL List, but playing with Kramnik's No Castling Chess :?: It should be very easy under most GUI by simply turning off the castling for both sides especially under Arena :roll: ? We could learn easy by observing the top 10 engines, which are the best Openings with White and with Black Pieces playing with NO Castling rule.
Who is 17 years old GM Gukesh 2nd at the Candidate in Toronto?
https://indianexpress.com/article/sport ... t-9281394/
Modern Times
Posts: 3550
Joined: Thu Jun 07, 2012 11:02 pm

Re: CCRL 40/15, 40/2 and FRC lists updated (6th March 2021)

Post by Modern Times »

Chessqueen wrote: Thu Mar 11, 2021 5:28 pm So probably your site CCRL could be the first to test the 10 best engines on your CCRL List, but playing with Kramnik's No Castling Chess :?: It should be very easy under most GUI by simply turning off the castling for both sides especially under Arena :roll: ? We could learn easy by observing the top 10 engines, which are the best Openings with White and with Black Pieces playing with NO Castling rule.
I haven't really heard of that, what is the point of it ?

Saw this, will have a read
https://chessbase.in/news/No-Castling-C ... in%20chess.

Personally I don't use Arena, only Cutchess GUI.
Chessqueen
Posts: 5588
Joined: Wed Sep 05, 2018 2:16 am
Location: Moving
Full name: Jorge Picado

Re: CCRL 40/15, 40/2 and FRC lists updated (6th March 2021)

Post by Chessqueen »

Modern Times wrote: Thu Mar 11, 2021 6:04 pm
Chessqueen wrote: Thu Mar 11, 2021 5:28 pm So probably your site CCRL could be the first to test the 10 best engines on your CCRL List, but playing with Kramnik's No Castling Chess :?: It should be very easy under most GUI by simply turning off the castling for both sides especially under Arena :roll: ? We could learn easy by observing the top 10 engines, which are the best Openings with White and with Black Pieces playing with NO Castling rule.
I haven't really heard of that, what is the point of it ?

Saw this, will have a read
https://chessbase.in/news/No-Castling-C ... in%20chess.

Personally I don't use Arena, only Cutchess GUI.
I checked on Cutechess GUI it also has the same capability of turning off castling for both sides
Who is 17 years old GM Gukesh 2nd at the Candidate in Toronto?
https://indianexpress.com/article/sport ... t-9281394/
Chessqueen
Posts: 5588
Joined: Wed Sep 05, 2018 2:16 am
Location: Moving
Full name: Jorge Picado

Re: CCRL 40/15, 40/2 and FRC lists updated (6th March 2021)

Post by Chessqueen »

Chessqueen wrote: Thu Mar 11, 2021 6:49 pm
Modern Times wrote: Thu Mar 11, 2021 6:04 pm
Chessqueen wrote: Thu Mar 11, 2021 5:28 pm So probably your site CCRL could be the first to test the 10 best engines on your CCRL List, but playing with Kramnik's No Castling Chess :?: It should be very easy under most GUI by simply turning off the castling for both sides especially under Arena :roll: ? We could learn easy by observing the top 10 engines, which are the best Openings with White and with Black Pieces playing with NO Castling rule.
I haven't really heard of that, what is the point of it ?

Saw this, will have a read
https://chessbase.in/news/No-Castling-C ... in%20chess.

Personally I don't use Arena, only Cutchess GUI.
I checked on Cutechess GUI it also has the same capability of turning off castling for both sides
I just experimented under Cutechess 1.0 and wanted to know how Komodo 13.3 vs Komodo 13.3 would play a Non Castling game, well here it is :roll:


Event: No-Castling-Chess
White: Komodo-13.3-64bits
Black: Komodo-13.3-64bits
DATE: 3/11/2021
Result: 1/2-1/2

1. d4 +0.46/19 16s d5 +0.04/18 12s
2. Nf3 +0.41/19 4.0s e6 -0.06/18 6.2s
3. c4 +0.45/19 12s a6 -0.17/21 34s
4. cxd5 +0.37/19 8.5s exd5 0.014s
5. Nc3 +0.40/20 11s Nf6 -0.11/22 19s
6. Bf4 +0.43/19 14s Bd6 0.013s
7. Bxd6 +0.43/22 25s Qxd6 +0.05/21 5.6s
8. e3 +0.24/20 1.4s Kf8 +0.02/20 4.1s
9. Bd3 +0.18/19 1.2s g6 +0.23/20 11s
10. Kf1 +0.11/22 7.2s Kg7 +0.30/20 5.8s
11. Rc1 +0.09/20 3.6s b6 +0.33/20 7.9s
12. h3 -0.19/20 16s Re8 +0.35/21 8.1s
13. g4 +0.03/19 7.8s h6 +0.44/23 4.1s
14. Ne5 -0.12/20 5.5s c5 +0.11/20 20s
15. h4 0.004s Rxe5 +0.30/21 10s
16. dxe5 0.020s Qxe5 +0.15/19 7.8s
17. Rg1 -0.19/22 5.6s Be6 +0.11/21 19s
18. Qf3 -0.47/21 24s Nc6 0.005s
19. Be2 -0.38/22 26s Rd8 +0.54/22 25s
20. Rd1 0.006s b5 +0.35/22 24s
21. g5 -0.30/22 17s hxg5 0.005s
22. hxg5 -0.53/21 8.9s Nh5 0.010s
23. Qg2 -0.27/20 7.2s Rd6 +0.20/21 11s
24. Bxh5 0.015s gxh5 +0.08/20 6.2s
25. Ne2 +0.10/20 2.7s d4 0.00/18 1.0s
26. Qg3 0.00/21 4.7s Qxg3 0.00/21 8.8s
27. Nxg3 0.007s Kg6 0.00/21 2.8s
28. f3 +0.13/23 7.8s h4 0.013s
29. Ne4 0.00/20 4.0s Rd5 0.012s
30. exd4 +0.14/24 16s Nxd4 -0.07/19 3.1s
31. Kf2 -0.02/20 0.22s Rf5 0.00/21 4.3s
32. Rd3 +0.16/22 1.1s Bd5 0.00/24 9.5s
33. Rg4 +0.12/20 4.2s Bxe4 -0.18/21 0.78s
34. Rxe4 +0.17/22 5.1s Kh5 -0.40/22 4.4s
35. b4 0.015s Ne6 -0.40/21 4.7s
36. Rd6 +0.90/22 17s Nf4 0.019s
37. bxc5 +0.71/20 3.7s Kxg5 0.27s
38. Rdd4 +0.84/20 5.2s Ne6 0.020s
39. Rg4+ +0.80/19 4.8s Kf6 -0.65/22 0.46s
40. Rd2 +0.75/17 0.51s h3 -0.68/24 6.9s
41. c6 +0.77/26 19s Rc5 0.024s
42. Rh4 +0.75/27 15s Rxc6 0.013s
43. Rxh3 +0.81/26 14s Rc3 0.012s
44. Rh4 +0.73/25 9.0s Ra3 -0.86/25 3.3s
45. Rb4 +0.73/26 6.1s Kg5 -0.71/27 20s
46. Rb3 0.022s Ra4 -0.70/26 17s
47. Rd5+ +0.78/26 1.5s f5 -0.69/26 9.6s
48. a3 0.012s Rc4 -0.78/27 22s
49. Ke3 0.006s Rc1 -0.76/25 20s
50. Rd6 +0.79/24 9.1s Ra1 0.010s
51. Rc6 +0.86/24 10s Re1+ -0.91/26 6.1s
52. Kd2 +1.01/26 7.0s Re5 -0.64/24 0.095s
53. Rxa6 +0.93/26 9.3s Nc5 0.002s
54. Rxb5 +0.88/26 9.6s Ne4+ 0.004s
55. fxe4 +0.70/25 7.3s Rxb5 0.007s
56. exf5 +0.56/25 6.2s Kxf5 -0.37/27 1.7s
57. Kc3 +0.55/27 11s Re5 0.003s
58. Rd6 +0.47/27 6.3s Re6 -0.31/27 1.8s
59. Rd5+ +0.38/26 9.2s Kf6 -0.53/29 1.4s
60. Kb4 +0.28/24 3.9s Re8 -0.02/30 28s
61. Rd4 0.002s Ke7 -0.02/28 7.3s
62. Kc5 0.005s Rd8 -0.02/29 7.5s
63. Rh4 0.006s Kd7 -0.02/29 7.2s
64. Kb6 0.003s Kc8 -0.02/28 6.2s
65. a4 +0.04/30 7.4s Kb8 0.00/31 6.7s
66. Rh6 +0.03/33 2.0s Re8 0.00/38 5.0s
67. Rf6 0.00/30 6.7s Ka8 0.00/39 1.0s
68. Ka6 0.00/38 6.8s Rb8 0.00/39 7.3s
69. Rf5 0.010s Re8 0.00/46 8.0s
70. Kb6 0.00/34 7.2s Re6+ 0.00/38 8.5s
71. Kb5 0.007s Kb7 0.00/33 7.5s
72. Rh5 0.00/33 7.7s Ka7 0.00/34 7.7s
73. Rh7+ 0.00/34 1.3s Ka8 0.00/36 8.4s
74. Kc5 0.00/35 1.5s Re4 0.00/32 8.6s
75. a5 0.00/38 11s Re5+ 0.00/37 7.9s
76. Kb4 0.00/36 4.2s Re4+ 0.00/38 9.6s
77. Kc3 0.00/36 1.7s Rf4 0.00/34 8.9s
78. Rh6 0.00/36 14s Kb7 0.00/36 8.4s
79. Re6 0.00/33 15s Ka7 0.00/32 9.7s
80. Kb3 0.00/38 16s Rf3+ 0.00/39 11s
81. Kc2 0.00/32 14s Rf5 0.00/32 12s
82. Re7+ 0.00/31 11s Ka6 0.00/34 12s
83. Kd3 0.004s Rxa5 0.00/36 12s
84. Kc4 0.005s Ra4+ 0.00/33 10s
85. Kb3 0.003s Rf4 0.00/36 9.4s
86. Re6+ 0.00/32 9.9s Ka7 0.006s
87. Re7+ 0.00/32 10s Ka6 0.005s
88. Re6+ 0.00/33 10s Ka7 0.011s
89. Re7+ 0.00/33 9.4s Kb6 0.003s
90. Re6+ 0.00/34 8.8s Kc5 0.00/32 0.40s
91. Re5+ 0.00/28 7.7s Kd4 0.00/27 8.0s
92. Re6 0.006s Rf3+ 0.00/28 8.0s
93. Kb2 0.009s Kd5 0.00/29 9.4s
94. Re2 0.00/27 8.5s Kc4 0.00/27 7.2s
95. Rc2+ 0.00/31 0.54s Kb4 0.00/26 8.9s
96. Re2 0.003s Rb3+ 0.00/31 7.1s
97. Kc2 0.00/32 8.6s Rc3+ 0.005s
98. Kd2 0.00/30 8.5s Kb3 0.00/24 7.4s
99. Re3 0.00/34 7.8s Rxe3 0.00/48 7.1s
100. Kxe3
0.00/59 0.91s, Draw by insufficient mating material
Who is 17 years old GM Gukesh 2nd at the Candidate in Toronto?
https://indianexpress.com/article/sport ... t-9281394/
Modern Times
Posts: 3550
Joined: Thu Jun 07, 2012 11:02 pm

Re: CCRL 40/15, 40/2 and FRC lists updated (6th March 2021)

Post by Modern Times »

I don't see anywhere in CuteChess GUI where you turn off castling, but this is an engine feature surely - if the engine wants to castle, then it will, nothing you can do to stop it. How can a GUI tell an engine not to castle ? You still use an opening book, or not ? Books may contain castling moves. I still see no point in this.
bastiball
Posts: 5222
Joined: Tue Oct 20, 2020 4:18 am
Full name: Basti Dangca

Re: CCRL 40/15, 40/2 and FRC lists updated (6th March 2021)

Post by bastiball »

Modern Times wrote: Fri Mar 12, 2021 3:15 am I don't see anywhere in CuteChess GUI where you turn off castling, but this is an engine feature surely - if the engine wants to castle, then it will, nothing you can do to stop it. How can a GUI tell an engine not to castle ? You still use an opening book, or not ? Books may contain castling moves. I still see no point in this.
Here, I use PGN to not castling.
[pgn]1. Nf3 Nf6 2. Nc3 Nc6 3. Rg1 Rg8 4. Rb1 Rb8 5. Rh1 Rh8 6. Ra1 Ra8 7. Ng1
Ng8 8. Nb1 Nb8 *[/pgn]
Basti Dangca
CCRL testing group
Modern Times
Posts: 3550
Joined: Thu Jun 07, 2012 11:02 pm

Re: CCRL 40/15, 40/2 and FRC lists updated (6th March 2021)

Post by Modern Times »

So you need a special openings pgn with a sequence of moves that precludes subsequent castling ? Again, what is the point of this ?