OKE - one year after
Posted: Sun Sep 06, 2020 6:08 pm
June 2019
OKE is a research project how well nowadays (mostly top) chess engines play the early opening, the first 6 moves in particular. Since the arrival of the first serious rating list in 1979 -- the SSDF -- engines competed with opening books allowed, later in 2006 when CEGT and CCRL took over the role as leading rating lists that changed. Books were not allowed and engines were tested on pure engine strength. Yet engines for the most part were given the first 6-8-10-12 moves in advance to avoid doubles.
On this page we will show the early opening hasn't received the attention it deserved likely caused by the fact engines weren't challenged in this area. We will see engines rated hundreds elo points lower surpassing the stronger ones, in some extreme cases more than 500 elo points.
The message is that there is a lot room for improvement and we will offer a simple platform for engine programmers to improve in this area. The base is the program MEA from engine author Ferninand Mosca which allows engines to analyze all positions in an EPD file which contains a bonus for moves. Examples:
http://rebel13.nl/rebel13/oke.html
September 2020 - Update
1. We can see that the NNUE aproach did Stockfish 12 etremely good.
2. Lc0 running on a RTX 1060 6Gb remains best.
3. Rodent keeps doing well between the Giants
Next engines to test
Amoeba 3.1, Asymptote 0.8, Combusken 1.3, Counter 3.5, Defenchess 2.2, Demolito_2020_05_14, FabChess 1.15, Ice 4.0, Igel 2.60, Komodo 11, rofChade 2.3, RubiChess 1.8, Schooner 2.2, Vajolet 2.8, Wasp 4.00, Weiss 1.1, Winter 0.8, Xiphos 0.6
OKE is a research project how well nowadays (mostly top) chess engines play the early opening, the first 6 moves in particular. Since the arrival of the first serious rating list in 1979 -- the SSDF -- engines competed with opening books allowed, later in 2006 when CEGT and CCRL took over the role as leading rating lists that changed. Books were not allowed and engines were tested on pure engine strength. Yet engines for the most part were given the first 6-8-10-12 moves in advance to avoid doubles.
On this page we will show the early opening hasn't received the attention it deserved likely caused by the fact engines weren't challenged in this area. We will see engines rated hundreds elo points lower surpassing the stronger ones, in some extreme cases more than 500 elo points.
The message is that there is a lot room for improvement and we will offer a simple platform for engine programmers to improve in this area. The base is the program MEA from engine author Ferninand Mosca which allows engines to analyze all positions in an EPD file which contains a bonus for moves. Examples:
http://rebel13.nl/rebel13/oke.html
September 2020 - Update
1. We can see that the NNUE aproach did Stockfish 12 etremely good.
2. Lc0 running on a RTX 1060 6Gb remains best.
3. Rodent keeps doing well between the Giants
Next engines to test
Amoeba 3.1, Asymptote 0.8, Combusken 1.3, Counter 3.5, Defenchess 2.2, Demolito_2020_05_14, FabChess 1.15, Ice 4.0, Igel 2.60, Komodo 11, rofChade 2.3, RubiChess 1.8, Schooner 2.2, Vajolet 2.8, Wasp 4.00, Weiss 1.1, Winter 0.8, Xiphos 0.6