Return Match for Komodo

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

Jesse Gersenson
Posts: 593
Joined: Sat Aug 20, 2011 9:43 am

Re: Return Match for Komodo

Post by Jesse Gersenson »

Lyudmil Tsvetkov wrote:You gave Komodo a looot of time. :)
At 1"+50ms komodo was too strong so we lowered it to 1"+30ms.
The point is, I used contempt and should not have used contempt. Larry wrote me, "Contempt is not needed if yiou are playing normal chess with a large enough time handicap (or depth) to be about even."

It is not clear how much time the engine was getting. There were 2-4ms of network delay to connect to the Pentium III and more latency from the machine running the GUI, and more delay for the old machine to start.
User avatar
George
Posts: 682
Joined: Mon Oct 14, 2013 1:44 am

Re: Return Match for Komodo

Post by George »

Lyudmil Tsvetkov wrote:
Jesse Gersenson wrote:I ran an informal match between Komodo 32-bit on a Pentium III (1.13 GHz notebook, 16mb hash, no tables bases or opening book) against a talented junior, rated 2100 two weeks ago.

We played several handicap matches with the human getting 5'+3" and the engine getting either 5'+3 (with a handicap) or game in 1" (without handicap). Odds included rook odds, rook and move, depth 2, queen for knight.

In the even material games, 5'+3" vs 1"+30ms, the kid was able to score draws if contempt was set incorrectly -- it should have been set to contempt = 0 but I'd set it to contempt = 260.
You gave Komodo a looot of time. :)
What do you think the outcome would be if you give Nakamura 2' + 2'' for Komodo vs 5' + 3' out of 10 games?
lkaufman
Posts: 5960
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA

Re: Return Match for Komodo

Post by lkaufman »

Lyudmil Tsvetkov wrote:This afternoon I tried to play a couple of games against Komodo with only time handicap. Unfortunately, as I seemingly am not in a good form at all, I fared rather poor.

Conditions: latest Komodo 10.1, kindly provided by Komodo team, strictly keeping TC, engine output hidden, 4 cores with hyperthreading off.

At 2' + 2" for both I managed roughly 1-2 draws from 10 games, throwing away plentiful winning positions with seconds to go.

At 2' + 2'' for Komodo vs 5' + 3'' for me, roughly double TC, still no wins, 3 or 4 draws from 10 games.

At 2' + 2'' vs 10'+ 10'', 5-fold time handicap, I already scored a single win, and drew 3 or 4 out of 10 games.

Do not have time for trying longer TC, but obviously with more time humans start to fare better.

I think I can do much better than that, but today was a slump day for me. And looking constantly at the clock drives me crazy. That makes a big difference: I am missing moves, that otherwise, if not under pressure, would not have missed.

Below my single win, it is a pity that I threw away much more spectacular positions, where I am certain Komodo was already showing +500-600cps advantage.

[pgn][Event "Blitz 2m+2s"]
[Site "Microsoft"]
[Date "2016.08.08"]
[Round "?"]
[White "Lyudmil Tsvetkov, owner"]
[Black "Komodo 10.1 64-bit"]
[Result "1-0"]
[ECO "A46"]
[Annotator "owner"]
[PlyCount "65"]
[EventDate "2016.??.??"]
[TimeControl "120+2"]

{512MB, OWNER-PC} 1. d4 {0} Nf6 {-0.77/20 7} 2. Nf3 {2} e6 {-0.84/18 3} 3. Bg5
{3} c5 {-0.94/19 3} 4. c3 {2} Nc6 {-0.88/21 8} 5. e3 {2} h6 {-0.82/20 8} 6.
Bxf6 {3} Qxf6 {-0.82/20 6} 7. Bd3 {1} d5 {-1.04/20 4} 8. O-O {2} Bd7 {-0.95/21
9} 9. Nbd2 {2} cxd4 {-0.91/21 10} 10. exd4 {2} Bd6 {-0.86/22 10} 11. Re1 {10}
O-O {-0.91/21 4} 12. Qe2 {2} Qd8 {-0.83/21 4} 13. Ne5 {2} Nxe5 {-0.83/21 4} 14.
dxe5 {1} Bc7 {-0.82/21 5} 15. Nf3 {4} Rc8 {-0.85/21 5} 16. Rad1 {3} Ba4 {-0.80/
23 18} 17. Rd2 {4} a6 {-0.73/23 12} 18. Bb1 {2} Bb5 {-0.81/22 6} 19. Qd1 {2} g6
{-0.77/19 4} 20. h4 {8} h5 {-0.68/21 4} 21. Rd4 {24} Bb6 {-0.62/18 2} 22. Rf4 {
6} Bc5 {-0.50/21 11} 23. Qd2 {20} Be7 {-0.50/21 6} 24. g3 {162} Bc6 {-0.50/21 4
} 25. Nd4 {98} Bd7 {-0.49/25 3} 26. Re3 {25} Qb6 {-0.49/19 4} 27. Ref3 {20} Qc7
{-0.48/21 5} 28. Qe3 {176} Qc5 {0.59/16 4} 29. Rf6 {55} Bxf6 {5.63/22 2} 30.
Rxf6 {13} Qe7 {10.19/22 7} 31. Qh6 {43} Rc4 {10.50/22 0} 32. Bxg6 {54} fxg6 {
10.71/23 0} 33. Rxg6+ {4} 1-0

[/pgn]
The search depths you show in the opening seem pretty low for a quadcore machine playing 2' + 2"; they are a couple ply less than my laptop gets. How many nodes per second does it show in infinite mode in the opening position?
Komodo rules!
Lyudmil Tsvetkov
Posts: 6052
Joined: Tue Jun 12, 2012 12:41 pm

Re: Return Match for Komodo

Post by Lyudmil Tsvetkov »

lkaufman wrote:
Lyudmil Tsvetkov wrote:This afternoon I tried to play a couple of games against Komodo with only time handicap. Unfortunately, as I seemingly am not in a good form at all, I fared rather poor.

Conditions: latest Komodo 10.1, kindly provided by Komodo team, strictly keeping TC, engine output hidden, 4 cores with hyperthreading off.

At 2' + 2" for both I managed roughly 1-2 draws from 10 games, throwing away plentiful winning positions with seconds to go.

At 2' + 2'' for Komodo vs 5' + 3'' for me, roughly double TC, still no wins, 3 or 4 draws from 10 games.

At 2' + 2'' vs 10'+ 10'', 5-fold time handicap, I already scored a single win, and drew 3 or 4 out of 10 games.

Do not have time for trying longer TC, but obviously with more time humans start to fare better.

I think I can do much better than that, but today was a slump day for me. And looking constantly at the clock drives me crazy. That makes a big difference: I am missing moves, that otherwise, if not under pressure, would not have missed.

Below my single win, it is a pity that I threw away much more spectacular positions, where I am certain Komodo was already showing +500-600cps advantage.

[pgn][Event "Blitz 2m+2s"]
[Site "Microsoft"]
[Date "2016.08.08"]
[Round "?"]
[White "Lyudmil Tsvetkov, owner"]
[Black "Komodo 10.1 64-bit"]
[Result "1-0"]
[ECO "A46"]
[Annotator "owner"]
[PlyCount "65"]
[EventDate "2016.??.??"]
[TimeControl "120+2"]

{512MB, OWNER-PC} 1. d4 {0} Nf6 {-0.77/20 7} 2. Nf3 {2} e6 {-0.84/18 3} 3. Bg5
{3} c5 {-0.94/19 3} 4. c3 {2} Nc6 {-0.88/21 8} 5. e3 {2} h6 {-0.82/20 8} 6.
Bxf6 {3} Qxf6 {-0.82/20 6} 7. Bd3 {1} d5 {-1.04/20 4} 8. O-O {2} Bd7 {-0.95/21
9} 9. Nbd2 {2} cxd4 {-0.91/21 10} 10. exd4 {2} Bd6 {-0.86/22 10} 11. Re1 {10}
O-O {-0.91/21 4} 12. Qe2 {2} Qd8 {-0.83/21 4} 13. Ne5 {2} Nxe5 {-0.83/21 4} 14.
dxe5 {1} Bc7 {-0.82/21 5} 15. Nf3 {4} Rc8 {-0.85/21 5} 16. Rad1 {3} Ba4 {-0.80/
23 18} 17. Rd2 {4} a6 {-0.73/23 12} 18. Bb1 {2} Bb5 {-0.81/22 6} 19. Qd1 {2} g6
{-0.77/19 4} 20. h4 {8} h5 {-0.68/21 4} 21. Rd4 {24} Bb6 {-0.62/18 2} 22. Rf4 {
6} Bc5 {-0.50/21 11} 23. Qd2 {20} Be7 {-0.50/21 6} 24. g3 {162} Bc6 {-0.50/21 4
} 25. Nd4 {98} Bd7 {-0.49/25 3} 26. Re3 {25} Qb6 {-0.49/19 4} 27. Ref3 {20} Qc7
{-0.48/21 5} 28. Qe3 {176} Qc5 {0.59/16 4} 29. Rf6 {55} Bxf6 {5.63/22 2} 30.
Rxf6 {13} Qe7 {10.19/22 7} 31. Qh6 {43} Rc4 {10.50/22 0} 32. Bxg6 {54} fxg6 {
10.71/23 0} 33. Rxg6+ {4} 1-0

[/pgn]
The search depths you show in the opening seem pretty low for a quadcore machine playing 2' + 2"; they are a couple ply less than my laptop gets. How many nodes per second does it show in infinite mode in the opening position?
It's a dell xps laptop from 5 years ago.

Between 2233 and 2244 knps in the first 15 sec., reaching 2250 at the 1 minute mark.

Ponder is set to off, as at one point it suddenly became clear to me that getting 5-fold advantage with ponder on is not a very wise way to proceed.

Still considering 1.e4 e5 as best line of play. :)
lkaufman
Posts: 5960
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA

Re: Return Match for Komodo

Post by lkaufman »

Lyudmil Tsvetkov wrote:
lkaufman wrote:
Lyudmil Tsvetkov wrote:This afternoon I tried to play a couple of games against Komodo with only time handicap. Unfortunately, as I seemingly am not in a good form at all, I fared rather poor.

Conditions: latest Komodo 10.1, kindly provided by Komodo team, strictly keeping TC, engine output hidden, 4 cores with hyperthreading off.

At 2' + 2" for both I managed roughly 1-2 draws from 10 games, throwing away plentiful winning positions with seconds to go.

At 2' + 2'' for Komodo vs 5' + 3'' for me, roughly double TC, still no wins, 3 or 4 draws from 10 games.

At 2' + 2'' vs 10'+ 10'', 5-fold time handicap, I already scored a single win, and drew 3 or 4 out of 10 games.

Do not have time for trying longer TC, but obviously with more time humans start to fare better.

I think I can do much better than that, but today was a slump day for me. And looking constantly at the clock drives me crazy. That makes a big difference: I am missing moves, that otherwise, if not under pressure, would not have missed.

Below my single win, it is a pity that I threw away much more spectacular positions, where I am certain Komodo was already showing +500-600cps advantage.

[pgn][Event "Blitz 2m+2s"]
[Site "Microsoft"]
[Date "2016.08.08"]
[Round "?"]
[White "Lyudmil Tsvetkov, owner"]
[Black "Komodo 10.1 64-bit"]
[Result "1-0"]
[ECO "A46"]
[Annotator "owner"]
[PlyCount "65"]
[EventDate "2016.??.??"]
[TimeControl "120+2"]

{512MB, OWNER-PC} 1. d4 {0} Nf6 {-0.77/20 7} 2. Nf3 {2} e6 {-0.84/18 3} 3. Bg5
{3} c5 {-0.94/19 3} 4. c3 {2} Nc6 {-0.88/21 8} 5. e3 {2} h6 {-0.82/20 8} 6.
Bxf6 {3} Qxf6 {-0.82/20 6} 7. Bd3 {1} d5 {-1.04/20 4} 8. O-O {2} Bd7 {-0.95/21
9} 9. Nbd2 {2} cxd4 {-0.91/21 10} 10. exd4 {2} Bd6 {-0.86/22 10} 11. Re1 {10}
O-O {-0.91/21 4} 12. Qe2 {2} Qd8 {-0.83/21 4} 13. Ne5 {2} Nxe5 {-0.83/21 4} 14.
dxe5 {1} Bc7 {-0.82/21 5} 15. Nf3 {4} Rc8 {-0.85/21 5} 16. Rad1 {3} Ba4 {-0.80/
23 18} 17. Rd2 {4} a6 {-0.73/23 12} 18. Bb1 {2} Bb5 {-0.81/22 6} 19. Qd1 {2} g6
{-0.77/19 4} 20. h4 {8} h5 {-0.68/21 4} 21. Rd4 {24} Bb6 {-0.62/18 2} 22. Rf4 {
6} Bc5 {-0.50/21 11} 23. Qd2 {20} Be7 {-0.50/21 6} 24. g3 {162} Bc6 {-0.50/21 4
} 25. Nd4 {98} Bd7 {-0.49/25 3} 26. Re3 {25} Qb6 {-0.49/19 4} 27. Ref3 {20} Qc7
{-0.48/21 5} 28. Qe3 {176} Qc5 {0.59/16 4} 29. Rf6 {55} Bxf6 {5.63/22 2} 30.
Rxf6 {13} Qe7 {10.19/22 7} 31. Qh6 {43} Rc4 {10.50/22 0} 32. Bxg6 {54} fxg6 {
10.71/23 0} 33. Rxg6+ {4} 1-0

[/pgn]
The search depths you show in the opening seem pretty low for a quadcore machine playing 2' + 2"; they are a couple ply less than my laptop gets. How many nodes per second does it show in infinite mode in the opening position?
It's a dell xps laptop from 5 years ago.

Between 2233 and 2244 knps in the first 15 sec., reaching 2250 at the 1 minute mark.

Ponder is set to off, as at one point it suddenly became clear to me that getting 5-fold advantage with ponder on is not a very wise way to proceed.

Still considering 1.e4 e5 as best line of play. :)
Ok, my I7 laptop which is nearly 2 years old gets about 4100 knps, so that's another handicap. Still, even with five to one time odds, no ponder, White every game, no opening book, and slow hardware you did well to get some points with equal material. Maybe it's not too hard to make draws with White under these conditions if you pick the right openings, I haven't really researched this question.
Komodo rules!
User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: Return Match for Komodo

Post by Laskos »

lkaufman wrote:[

Ok, my I7 laptop which is nearly 2 years old gets about 4100 knps, so that's another handicap. Still, even with five to one time odds, no ponder, White every game, no opening book, and slow hardware you did well to get some points with equal material. Maybe it's not too hard to make draws with White under these conditions if you pick the right openings, I haven't really researched this question.
Larry, come on.
At 2' + 2'' vs 10'+ 10'', 5-fold time handicap, I already scored a single win, and drew 3 or 4 out of 10 games.
In those conditions, it's a 2800-2900 human performance.
Maharadja
Posts: 78
Joined: Thu Dec 24, 2009 1:22 pm

Re: Return Match for Komodo

Post by Maharadja »

Lyudmil Tsvetkov wrote:This afternoon I tried to play a couple of games against Komodo with only time handicap. Unfortunately, as I seemingly am not in a good form at all, I fared rather poor.

Conditions: latest Komodo 10.1, kindly provided by Komodo team, strictly keeping TC, engine output hidden, 4 cores with hyperthreading off.

At 2' + 2" for both I managed roughly 1-2 draws from 10 games, throwing away plentiful winning positions with seconds to go.

At 2' + 2'' for Komodo vs 5' + 3'' for me, roughly double TC, still no wins, 3 or 4 draws from 10 games.

At 2' + 2'' vs 10'+ 10'', 5-fold time handicap, I already scored a single win, and drew 3 or 4 out of 10 games.

Do not have time for trying longer TC, but obviously with more time humans start to fare better.

I think I can do much better than that, but today was a slump day for me. And looking constantly at the clock drives me crazy. That makes a big difference: I am missing moves, that otherwise, if not under pressure, would not have missed.

Below my single win, it is a pity that I threw away much more spectacular positions, where I am certain Komodo was already showing +500-600cps advantage.
I don't believe you and I don't understand why some take you serious.
lkaufman
Posts: 5960
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA

Re: Return Match for Komodo

Post by lkaufman »

Laskos wrote:
lkaufman wrote:[

Ok, my I7 laptop which is nearly 2 years old gets about 4100 knps, so that's another handicap. Still, even with five to one time odds, no ponder, White every game, no opening book, and slow hardware you did well to get some points with equal material. Maybe it's not too hard to make draws with White under these conditions if you pick the right openings, I haven't really researched this question.
Larry, come on.
At 2' + 2'' vs 10'+ 10'', 5-fold time handicap, I already scored a single win, and drew 3 or 4 out of 10 games.
In those conditions, it's a 2800-2900 human performance.
Well, just by math, you are right, and this should be impossible. However we already know from the games posted by the player using the handle "father" that with enough trial and error, you can find openings that will result in a sufficiently locked position to get draws sometimes. In the present case, I'm inclined to believe that he has tried out enough openings to find the ones that Komodo (without a book and little time) will permit to reach closed positions, where it is easy enough to draw. Maybe I'm gullible, but I tend to believe people until I have a strong enough reason not to do so. If I ever have the time, I may try to find out myself whether I can find openings that allow me to close the position enough to make draws against a bookless Komodo playing Black.
Komodo rules!
APassionForCriminalJustic
Posts: 417
Joined: Sat May 24, 2014 9:16 am

Re: Return Match for Komodo

Post by APassionForCriminalJustic »

Lyudmil Tsvetkov wrote:
lkaufman wrote:
Lyudmil Tsvetkov wrote:This afternoon I tried to play a couple of games against Komodo with only time handicap. Unfortunately, as I seemingly am not in a good form at all, I fared rather poor.

Conditions: latest Komodo 10.1, kindly provided by Komodo team, strictly keeping TC, engine output hidden, 4 cores with hyperthreading off.

At 2' + 2" for both I managed roughly 1-2 draws from 10 games, throwing away plentiful winning positions with seconds to go.

At 2' + 2'' for Komodo vs 5' + 3'' for me, roughly double TC, still no wins, 3 or 4 draws from 10 games.

At 2' + 2'' vs 10'+ 10'', 5-fold time handicap, I already scored a single win, and drew 3 or 4 out of 10 games.

Do not have time for trying longer TC, but obviously with more time humans start to fare better.

I think I can do much better than that, but today was a slump day for me. And looking constantly at the clock drives me crazy. That makes a big difference: I am missing moves, that otherwise, if not under pressure, would not have missed.

Below my single win, it is a pity that I threw away much more spectacular positions, where I am certain Komodo was already showing +500-600cps advantage.

[pgn][Event "Blitz 2m+2s"]
[Site "Microsoft"]
[Date "2016.08.08"]
[Round "?"]
[White "Lyudmil Tsvetkov, owner"]
[Black "Komodo 10.1 64-bit"]
[Result "1-0"]
[ECO "A46"]
[Annotator "owner"]
[PlyCount "65"]
[EventDate "2016.??.??"]
[TimeControl "120+2"]

{512MB, OWNER-PC} 1. d4 {0} Nf6 {-0.77/20 7} 2. Nf3 {2} e6 {-0.84/18 3} 3. Bg5
{3} c5 {-0.94/19 3} 4. c3 {2} Nc6 {-0.88/21 8} 5. e3 {2} h6 {-0.82/20 8} 6.
Bxf6 {3} Qxf6 {-0.82/20 6} 7. Bd3 {1} d5 {-1.04/20 4} 8. O-O {2} Bd7 {-0.95/21
9} 9. Nbd2 {2} cxd4 {-0.91/21 10} 10. exd4 {2} Bd6 {-0.86/22 10} 11. Re1 {10}
O-O {-0.91/21 4} 12. Qe2 {2} Qd8 {-0.83/21 4} 13. Ne5 {2} Nxe5 {-0.83/21 4} 14.
dxe5 {1} Bc7 {-0.82/21 5} 15. Nf3 {4} Rc8 {-0.85/21 5} 16. Rad1 {3} Ba4 {-0.80/
23 18} 17. Rd2 {4} a6 {-0.73/23 12} 18. Bb1 {2} Bb5 {-0.81/22 6} 19. Qd1 {2} g6
{-0.77/19 4} 20. h4 {8} h5 {-0.68/21 4} 21. Rd4 {24} Bb6 {-0.62/18 2} 22. Rf4 {
6} Bc5 {-0.50/21 11} 23. Qd2 {20} Be7 {-0.50/21 6} 24. g3 {162} Bc6 {-0.50/21 4
} 25. Nd4 {98} Bd7 {-0.49/25 3} 26. Re3 {25} Qb6 {-0.49/19 4} 27. Ref3 {20} Qc7
{-0.48/21 5} 28. Qe3 {176} Qc5 {0.59/16 4} 29. Rf6 {55} Bxf6 {5.63/22 2} 30.
Rxf6 {13} Qe7 {10.19/22 7} 31. Qh6 {43} Rc4 {10.50/22 0} 32. Bxg6 {54} fxg6 {
10.71/23 0} 33. Rxg6+ {4} 1-0

[/pgn]
The search depths you show in the opening seem pretty low for a quadcore machine playing 2' + 2"; they are a couple ply less than my laptop gets. How many nodes per second does it show in infinite mode in the opening position?
It's a dell xps laptop from 5 years ago.

Between 2233 and 2244 knps in the first 15 sec., reaching 2250 at the 1 minute mark.

Ponder is set to off, as at one point it suddenly became clear to me that getting 5-fold advantage with ponder on is not a very wise way to proceed.

Still considering 1.e4 e5 as best line of play. :)
Komodo would spank you around like a little boy getting disciplined. Quit making stuff up. I don't care if you are a renowned computer chess specialist; are you sure that you are not ARB in disguise? Your claims certainly aren't that different from his. Why don't you take on Komodo 10.1 on my hardware? It's only 36 cores and 72 threads. Haha. I'll give you 60 minutes versus Komodo with one minute. I would be willing to bet that the only result that you MIGHT get here and there is a draw. Every claim men like these make always CONTROL their conditions. Let's take that control away.

There is very simple logic to be understood here. If super grandmasters cannot beat today's engines on cell phones (or even draw), literally, then you certainly aren't going to do anything remotely great here either. Openings mean nothing. Closed positions will lead to a draw AT BEST if you are lucky enough - and by lucky I mean LUCKY. Claiming that you can win is a joke. The days of 'Man versus Machine' are long dead - so clearly there is something that you are doing that is not adding up.
User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: Return Match for Komodo

Post by Laskos »

lkaufman wrote:
Laskos wrote:
lkaufman wrote:[

Ok, my I7 laptop which is nearly 2 years old gets about 4100 knps, so that's another handicap. Still, even with five to one time odds, no ponder, White every game, no opening book, and slow hardware you did well to get some points with equal material. Maybe it's not too hard to make draws with White under these conditions if you pick the right openings, I haven't really researched this question.
Larry, come on.
At 2' + 2'' vs 10'+ 10'', 5-fold time handicap, I already scored a single win, and drew 3 or 4 out of 10 games.
In those conditions, it's a 2800-2900 human performance.
Well, just by math, you are right, and this should be impossible. However we already know from the games posted by the player using the handle "father" that with enough trial and error, you can find openings that will result in a sufficiently locked position to get draws sometimes. In the present case, I'm inclined to believe that he has tried out enough openings to find the ones that Komodo (without a book and little time) will permit to reach closed positions, where it is easy enough to draw. Maybe I'm gullible, but I tend to believe people until I have a strong enough reason not to do so. If I ever have the time, I may try to find out myself whether I can find openings that allow me to close the position enough to make draws against a bookless Komodo playing Black.
"Father"'s draw rate is below 5% IIRC, and he often posts won games on time (lag) from lost, but pretty locked positions, which resolve with 50 move rule or Contempt. I don't remember any single clear win of him in all these years. He still overperforms his rating, but by 200-300 ELO points, not 800. And the win claim... I would be surprised to see even Carlsen or Nakamura in these conditions getting a single win in a short match.