I'm running matches on three Windows 7/8 Intel computers with a total of 40 cores between Komodo 7a (released this morning) and Houdini 4, single core games. Most of the games are at 5' + 3" except the games on the quad are at 2' + 1". Five man Syzygy for both, ponder off, book derived from TWIC high-level games, variable length.
Results after 1552 games are a virtual tie; Komodo is just 7 games ahead. Since it is clear that Komodo scales better with more time than Houdini, I think it is fair to say that we have finally surpassed Houdini in strength at most reasonable time controls, at least on Intel machines. Now there remains only Stockfish to surpass, a tall order to be sure.
Komodo 7a vs. Houdini 4
Moderators: hgm, Rebel, chrisw
-
- Posts: 5960
- Joined: Sun Jan 10, 2010 6:15 am
- Location: Maryland USA
-
- Posts: 1187
- Joined: Wed Jan 06, 2010 3:11 pm
Re: Komodo 7a vs. Houdini 4
Really fair to say ?lkaufman wrote:I'm running matches on three Windows 7/8 Intel computers with a total of 40 cores between Komodo 7a (released this morning) and Houdini 4, single core games. Most of the games are at 5' + 3" except the games on the quad are at 2' + 1". Five man Syzygy for both, ponder off, book derived from TWIC high-level games, variable length.
Results after 1552 games are a virtual tie; Komodo is just 7 games ahead. Since it is clear that Komodo scales better with more time than Houdini, I think it is fair to say that we have finally surpassed Houdini in strength at most reasonable time controls, at least on Intel machines. Now there remains only Stockfish to surpass, a tall order to be sure.
http://www.clemens-keck.de/livegames/
1) Komodo 1223.00 64-bit Sy5
Hash tables: 2048 MB
Book: mega-6mvs.ctg
2) Houdini 4 Pro x64 Sy5
Hash tables: 2048 MB
Book: mega-6mvs.ctg
conditions:
- 50 game match 60min +15sec
- engines 6cpu ponder ON, 2GB hashtables
- both engines use 5men syzygy bases
- 6mvs book, random play
Houdini 4 Pro x64 Sy5 - Komodo 1223.00 64-bit Sy5 ended in a 27,5 - 22,5 victory for Houdini 4
-
- Posts: 3546
- Joined: Thu Jun 07, 2012 11:02 pm
Re: Komodo 7a vs. Houdini 4
Yes indeed, but at least you have the source code to study, that is what open source is for. Not easy of course !lkaufman wrote: Now there remains only Stockfish to surpass, a tall order to be sure.
-
- Posts: 669
- Joined: Mon Nov 04, 2013 10:19 pm
Re: Komodo 7a vs. Houdini 4
I think it is a Komodo problem, not an advantage - Komodo scales worse than Houdini at STC.lkaufman wrote:Since it is clear that Komodo scales better with more time than Houdini
I'm really glad to hear this, but Houdini 4 released six months ago - who knows how strong Houdini 5 will be?lkaufman wrote:I think it is fair to say that we have finally surpassed Houdini in strength at most reasonable time controls, at least on Intel machines
-
- Posts: 5960
- Joined: Sun Jan 10, 2010 6:15 am
- Location: Maryland USA
Re: Komodo 7a vs. Houdini 4
Regarding scaling, since Stockfish also scales better than Houdini it looks more like a Houdini problem. Anyway, that doesn't matter, the point is that whatever Komodo's results at short time control are vs. Houdini they should be better at long time control. This was borne out by the current TCEC semifinal, where Komodo finished a full four points ahead of Houdini.majortom wrote:I think it is a Komodo problem, not an advantage - Komodo scales worse than Houdini at STC.lkaufman wrote:Since it is clear that Komodo scales better with more time than Houdini
I'm really glad to hear this, but Houdini 4 released six months ago - who knows how strong Houdini 5 will be?lkaufman wrote:I think it is fair to say that we have finally surpassed Houdini in strength at most reasonable time controls, at least on Intel machines
Regarding Houdini, who knows if there will even be a Houdini 5?
-
- Posts: 669
- Joined: Mon Nov 04, 2013 10:19 pm
Re: Komodo 7a vs. Houdini 4
Agree. But I hope Robert will not give up so easily - competition is good for progress.lkaufman wrote:Regarding Houdini, who knows if there will even be a Houdini 5?
-
- Posts: 669
- Joined: Mon Nov 04, 2013 10:19 pm
Re: Komodo 7a vs. Houdini 4
Not agree. I'm sure that SF has more ELO above the H4 at LTC than at STC.lkaufman wrote:Regarding scaling, since Stockfish also scales better than Houdini it looks more like a Houdini problem.
-
- Posts: 5960
- Joined: Sun Jan 10, 2010 6:15 am
- Location: Maryland USA
Re: Komodo 7a vs. Houdini 4
That means you do agree with me. I said SF scales better than Houdini, meaning with more time, just like Komodo does.majortom wrote:Not agree. I'm sure that SF has more ELO above the H4 at LTC than at STC.lkaufman wrote:Regarding scaling, since Stockfish also scales better than Houdini it looks more like a Houdini problem.
-
- Posts: 1187
- Joined: Wed Jan 06, 2010 3:11 pm
Re: Komodo 7a vs. Houdini 4
..This was borne out (?!).. in 16 gameslkaufman wrote:Regarding scaling, since Stockfish also scales better than Houdini it looks more like a Houdini problem. Anyway, that doesn't matter, the point is that whatever Komodo's results at short time control are vs. Houdini they should be better at long time control. This was borne out by the current TCEC semifinal, where Komodo finished a full four points ahead of Houdini.majortom wrote:I think it is a Komodo problem, not an advantage - Komodo scales worse than Houdini at STC.lkaufman wrote:Since it is clear that Komodo scales better with more time than Houdini
I'm really glad to hear this, but Houdini 4 released six months ago - who knows how strong Houdini 5 will be?lkaufman wrote:I think it is fair to say that we have finally surpassed Houdini in strength at most reasonable time controls, at least on Intel machines
Regarding Houdini, who knows if there will even be a Houdini 5?
with Komodo dev at drawscore=0, while Houdini with default contempt
While you don't react on the formentioned 50 LTC games in Clemens Keck match 27,5 - 22,5 for Houdini 4
-
- Posts: 5960
- Joined: Sun Jan 10, 2010 6:15 am
- Location: Maryland USA
Re: Komodo 7a vs. Houdini 4
The TCEC semifinal was 48 rounds, not 16. Komodo scored 4 points more than Houdini after 48 round robin games each.beram wrote:..This was borne out (?!).. in 16 gameslkaufman wrote:Regarding scaling, since Stockfish also scales better than Houdini it looks more like a Houdini problem. Anyway, that doesn't matter, the point is that whatever Komodo's results at short time control are vs. Houdini they should be better at long time control. This was borne out by the current TCEC semifinal, where Komodo finished a full four points ahead of Houdini.majortom wrote:I think it is a Komodo problem, not an advantage - Komodo scales worse than Houdini at STC.lkaufman wrote:Since it is clear that Komodo scales better with more time than Houdini
I'm really glad to hear this, but Houdini 4 released six months ago - who knows how strong Houdini 5 will be?lkaufman wrote:I think it is fair to say that we have finally surpassed Houdini in strength at most reasonable time controls, at least on Intel machines
Regarding Houdini, who knows if there will even be a Houdini 5?
with Komodo dev at drawscore=0, while Houdini with default contempt
While you don't react on the formentioned 50 LTC games in Clemens Keck match 27,5 - 22,5 for Houdini 4
Regarding Clemens match, first of all Komodo 7 is version 1227, four improvements later than the one he ran, and furthermore, he doesn't use color reversal of openings, which greatly increases the luck factor.