Komodo 14 released.

Discussion of anything and everything relating to chess playing software and machines.

Moderators: bob, hgm, Harvey Williamson

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Krzysztof Grzelak
Posts: 884
Joined: Tue Jul 15, 2014 10:47 am

Re: Komodo 14 released.

Post by Krzysztof Grzelak » Thu May 14, 2020 11:18 am

I have the same message as Modern Times.

Krzysztof Grzelak
Posts: 884
Joined: Tue Jul 15, 2014 10:47 am

Re: Komodo 14 released.

Post by Krzysztof Grzelak » Thu May 14, 2020 11:19 am

Thanks to Komodo programmers for the new version of the program.

User avatar
Nordlandia
Posts: 2631
Joined: Fri Sep 25, 2015 7:38 pm
Location: Sortland, Norway

Re: Komodo 14 released.

Post by Nordlandia » Thu May 14, 2020 11:31 am

Couple of questions:

With armageddon enabled, Is it intentional that evaluation should not be going downhill if the outcome will be draw. For example if the game turns out be draw even with armageddon enabled, Komodo may or may not display losing evaluation.

Should i leave contempt at defaut against Houdini 6 or maybe increase it, considering the relative age of ~ 2.5 years since last release.

lkaufman
Posts: 4228
Joined: Sun Jan 10, 2010 5:15 am
Location: Maryland USA
Contact:

Re: Komodo 14 released.

Post by lkaufman » Thu May 14, 2020 4:56 pm

Nordlandia wrote:
Thu May 14, 2020 11:31 am
Couple of questions:

With armageddon enabled, Is it intentional that evaluation should not be going downhill if the outcome will be draw. For example if the game turns out be draw even with armageddon enabled, Komodo may or may not display losing evaluation.

Should i leave contempt at defaut against Houdini 6 or maybe increase it, considering the relative age of ~ 2.5 years since last release.
If Komodo sees a definite draw when it is set to Must Win, it should show a -20 pawn score. But a drawish endgame will still show a fairly normal score if the draw isn't clear. Default Contempt is optimized for slightly weaker opponent, so it is probably ideal for Houdini 6. Higher Contempt values will score better against engines rated a couple hundred elo below Komodo.
Komodo rules!

Modern Times
Posts: 2557
Joined: Thu Jun 07, 2012 9:02 pm

Re: Komodo 14 released.

Post by Modern Times » Thu May 14, 2020 10:23 pm

lkaufman wrote:
Tue May 12, 2020 10:17 pm
Total gains from Komodo 13 (or 13.01) are about 50 elo in MCTS mode and 40 elo in standard mode.
Yes I have +48 Elo so far for MCTS, or +56 Elo if you use Ordo, on the FRC blitz list. Testing still ongoing.
.

Opinions expressed here are my own, and not necessarily those of the CCRL Group.

lkaufman
Posts: 4228
Joined: Sun Jan 10, 2010 5:15 am
Location: Maryland USA
Contact:

Re: Komodo 14 released.

Post by lkaufman » Fri May 15, 2020 1:48 am

Modern Times wrote:
Thu May 14, 2020 10:23 pm
lkaufman wrote:
Tue May 12, 2020 10:17 pm
Total gains from Komodo 13 (or 13.01) are about 50 elo in MCTS mode and 40 elo in standard mode.
Yes I have +48 Elo so far for MCTS, or +56 Elo if you use Ordo, on the FRC blitz list. Testing still ongoing.
We use Ordo for all our testing and estimates, as it corresponds to the way ratings are done in human chess. So our estimated gains should be fairly accurate for CEGT and FastGM, but a bit higher than we would expect CCRL to show on average. Ironically, although BayesElo is not the way human ratings are calculated, when used on engine ratings it is actually a better estimator of human rating differences, because it compensates (partly) for the tendency of engine rating differences to expand. So the choice comes down to whether you want the rating system to correspond to human chess or the actual rating differences!
Komodo rules!

Wolfgang
Posts: 351
Joined: Fri May 12, 2006 11:08 pm

Re: Komodo 14 released.

Post by Wolfgang » Fri May 15, 2020 8:41 am

Testrun for CEGT 5'+3" with Ponder is running, but rather disappointing so far. 400 games only, but -26 to 13.3 is not what I expected... :(
Let's wait and see

https://cegt.forumieren.com/t1297-testing-komodo-14-0
Best
Wolfgang
CEGT-Team

Modern Times
Posts: 2557
Joined: Thu Jun 07, 2012 9:02 pm

Re: Komodo 14 released.

Post by Modern Times » Fri May 15, 2020 1:07 pm

lkaufman wrote:
Fri May 15, 2020 1:48 am
Modern Times wrote:
Thu May 14, 2020 10:23 pm
lkaufman wrote:
Tue May 12, 2020 10:17 pm
Total gains from Komodo 13 (or 13.01) are about 50 elo in MCTS mode and 40 elo in standard mode.
Yes I have +48 Elo so far for MCTS, or +56 Elo if you use Ordo, on the FRC blitz list. Testing still ongoing.
We use Ordo for all our testing and estimates, as it corresponds to the way ratings are done in human chess. So our estimated gains should be fairly accurate for CEGT and FastGM, but a bit higher than we would expect CCRL to show on average. Ironically, although BayesElo is not the way human ratings are calculated, when used on engine ratings it is actually a better estimator of human rating differences, because it compensates (partly) for the tendency of engine rating differences to expand. So the choice comes down to whether you want the rating system to correspond to human chess or the actual rating differences!
It is at 1,500 games now on the website. It has lost 5 Elo since the last post, but it still meets your +50 Elo Ordo estimate.
.

Opinions expressed here are my own, and not necessarily those of the CCRL Group.

ChiefPushesWood
Posts: 62
Joined: Thu Nov 08, 2018 5:30 pm
Full name: Chief PushesWood

Re: Komodo 14 released.

Post by ChiefPushesWood » Fri May 15, 2020 1:53 pm

Wolfgang wrote:
Fri May 15, 2020 8:41 am
Testrun for CEGT 5'+3" with Ponder is running, but rather disappointing so far. 400 games only, but -26 to 13.3 is not what I expected... :(
Let's wait and see

https://cegt.forumieren.com/t1297-testing-komodo-14-0
Well thats not good.

Chief

User avatar
Leto
Posts: 2034
Joined: Thu May 04, 2006 1:40 am
Location: Dune

Re: Komodo 14 released.

Post by Leto » Fri May 15, 2020 3:25 pm

Wolfgang wrote:
Fri May 15, 2020 8:41 am
Testrun for CEGT 5'+3" with Ponder is running, but rather disappointing so far. 400 games only, but -26 to 13.3 is not what I expected... :(
Let's wait and see

https://cegt.forumieren.com/t1297-testing-komodo-14-0
The 3375 performance result against Stockfish 11 makes sense, in comparison Komodo 13.3 (3370) only managed a 3320 performance against Stockfish 11. The performance against the weaker opposition such as Boot 6.4 (rated almost 200 elo below K13.3), Ginkgo 2.18 (rated 200 elo below K13.3), and Slowchess Classic 2.1 (rated 226 elo below K13.3) can be due to contempt issues. I imagine once the matches against the top end of the competitors are completed the rating will rise to expected levels.

Post Reply