Komodo TCEC is doing really well so far against Stockfish
Moderators: hgm, Rebel, chrisw
-
- Posts: 1346
- Joined: Sat Apr 19, 2014 1:47 pm
Komodo TCEC is doing really well so far against Stockfish
All in the title. I m a little bit surprised here. I didn't expect Komodo doing so good, sample is yet small, but still, usually the lead of Stockfish is slighty more. So , is Komodo making good progress lately after all ?
-
- Posts: 60
- Joined: Thu Jan 04, 2018 7:09 pm
Re: Komodo TCEC is doing really well so far against Stockfish
There's an update from Larry from 2 weeks ago - http://talkchess.com/forum3/viewtopic.p ... 26#p776469
I've also read in the TCEC chat that new compiles of Komodo are even fast still, and there's some other improvements that I'm not technical enough to understand. I think it's good that Komodo is improving. Houdini 6.03 is now a benchmark engine, having been in used in 4 consecutive seasons of TCEC, and having lost badly to SF in Season 11 and in CCC Rapid Rumble Final as well. It doesn't look like Houdini will be updated any time soon. Without Komodo, the only thing that might pose a threat to SF is Lc0. Everything else is much too weak.
I've also read in the TCEC chat that new compiles of Komodo are even fast still, and there's some other improvements that I'm not technical enough to understand. I think it's good that Komodo is improving. Houdini 6.03 is now a benchmark engine, having been in used in 4 consecutive seasons of TCEC, and having lost badly to SF in Season 11 and in CCC Rapid Rumble Final as well. It doesn't look like Houdini will be updated any time soon. Without Komodo, the only thing that might pose a threat to SF is Lc0. Everything else is much too weak.
-
- Posts: 1480
- Joined: Thu Mar 09, 2006 5:33 am
Re: Komodo TCEC is doing really well so far against Stockfish
It has certainly helped much that the startup performance problem has been fixed. But also, the intermediate result lets us predict a 12-2 or 12-3 by wins, only. Anyway, one thing is clear: This Komodo cannot be steamrolled!
Regards, Mike
-
- Posts: 4574
- Joined: Sun Mar 12, 2006 2:40 am
- Full name:
Re: Komodo TCEC is doing really well so far against Stockfish
It seems to me that Houdini in a direct confrontation will get beaten on speed. Even on TCEC where pure speed should not matter it will get beaten because of a poorer branching factor. Komodo is a much tougher opponent. It is a huge oversimplification, but it has better knowledge.
Debugging is twice as hard as writing the code in the first
place. Therefore, if you write the code as cleverly as possible, you
are, by definition, not smart enough to debug it.
-- Brian W. Kernighan
place. Therefore, if you write the code as cleverly as possible, you
are, by definition, not smart enough to debug it.
-- Brian W. Kernighan
-
- Posts: 261
- Joined: Sun Nov 13, 2016 10:37 am
Re: Komodo TCEC is doing really well so far against Stockfish
The strength of engine doesn't depend on the branching factor, but depends on the quality of cuts and extensions on averageEelco de Groot wrote: ↑Mon Oct 29, 2018 4:36 pm It seems to me that Houdini in a direct confrontation will get beaten on speed. Even on TCEC where pure speed should not matter it will get beaten because of a poorer branching factor. Komodo is a much tougher opponent. It is a huge oversimplification, but it has better knowledge.
Zevra 2 is my chess engine. Binary, source and description here: https://github.com/sovaz1997/Zevra2
Zevra v2.5 is last version of Zevra: https://github.com/sovaz1997/Zevra2/releases
Zevra v2.5 is last version of Zevra: https://github.com/sovaz1997/Zevra2/releases
-
- Posts: 710
- Joined: Sat Dec 06, 2014 1:53 pm
Re: Komodo TCEC is doing really well so far against Stockfish
there is no such thing as branching factor at least for last decade, because there is no such thing anymore as depth.
Despite "depth" variable is still reported as part of UCI protocol, it is meaningless. It has no meaning even within the same engine
-
- Posts: 10948
- Joined: Wed Jul 26, 2006 10:21 pm
- Full name: Kai Laskos
Re: Komodo TCEC is doing really well so far against Stockfish
I think it can still be called "iteration". Also, despite sparse exploring due to reductions and pruning, the approximate Elo value of a "ply" stayed almost the same as with almost pure AB engines of 1980s. So, in grand-picture, the meaningless "depth" of 30 of SF now can broadly be directly compared to meaningful depth of 7 of Mephisto.
SF, Komodo et al. are that strong, they have excellent tree reduction techniques (aside much better or faster eval too).
-
- Posts: 710
- Joined: Sat Dec 06, 2014 1:53 pm
Re: Komodo TCEC is doing really well so far against Stockfish
Komodo, Houdini and Stockfish report very different Depth variable, but it doesn't mean that their search tree cones are very different in shape/length/width/branching.
-
- Posts: 10948
- Joined: Wed Jul 26, 2006 10:21 pm
- Full name: Kai Laskos
Re: Komodo TCEC is doing really well so far against Stockfish
It can be indirectly checked. Say by long forced lines or by Elo value of a ply. Sure, it would be just a guess, as different reductions and extensions can behave differently, and the overall shape of the tree can be obscured. Still, I remember doing some experiments several years ago, and both SF and Komodo showed approximately the same share of deepening and widening of the tree (about half deepening and half widening). I mean on single core, SMP distorts the shape of the tree again.
-
- Posts: 710
- Joined: Sat Dec 06, 2014 1:53 pm
Re: Komodo TCEC is doing really well so far against Stockfish
During TCEC Season 12 - Superfinal, Komodo reported 5-10 less plies, even if total nodes searched and TB hits were higher
This doesn't mean that:
- Komodo has wider branching factor
- Komodo is weaker
- Komodo has less search depth
- Komodo search tree is different from SF in shape, length, width, branching
Whatever metrics is chosen for UCI variable "Depth" - it's meaningless and comparable to nothing, even between versions of the same engine it's incomparable and irrelevant.
This doesn't mean that:
- Komodo has wider branching factor
- Komodo is weaker
- Komodo has less search depth
- Komodo search tree is different from SF in shape, length, width, branching
Whatever metrics is chosen for UCI variable "Depth" - it's meaningless and comparable to nothing, even between versions of the same engine it's incomparable and irrelevant.