Komodo blunder

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Peter Berger
Posts: 653
Joined: Thu Mar 09, 2006 2:56 pm

Re: Komodo blunder

Post by Peter Berger »

bob wrote: BTW I don't know of any version of Crafty that will resign without playing a move. It won't resign until it has played at least 5 moves unless you manually alter the resign count value...
Bob, really :) - you should be* well* aware of the fact that I *do* know about intended behaviour of Crafty and its parameters. Please have a look at the log below - Crafty will resign before it makes its first move in this position.

playing a computer!
resign after 5 consecutive moves with score < -6.
accept draw offers
noise level set to 15.00 seconds.


Crafty v24.1 (2 cpus)

White(1): setboard 1nnnknn1/3ppp2/2n2n2/8/8/8/3PPP2/1Q1QK1Q1 w - - 0 1

+---+---+---+---+---+---+---+---+
8 | |<N>|<N>|<N>|<K>|<N>|<N>| . |
+---+---+---+---+---+---+---+---+
7 | . | | . |<P>|<P>|<P>| . | |
+---+---+---+---+---+---+---+---+
6 | | . |<N>| . | |<N>| | . |
+---+---+---+---+---+---+---+---+
5 | . | | . | | . | | . | |
+---+---+---+---+---+---+---+---+
4 | | . | | . | | . | | . |
+---+---+---+---+---+---+---+---+
3 | . | | . | | . | | . | |
+---+---+---+---+---+---+---+---+
2 | | . | |-P-|-P-|-P-| | . |
+---+---+---+---+---+---+---+---+
1 | . |-Q-| . |-Q-|-K-| |-Q-| |
+---+---+---+---+---+---+---+---+
a b c d e f g h

White(1): qa4
time used: 24.40
time limit 2:18 (13:50)
depth time score variation (1)
starting thread 1 <done>
18 16.21/2:29 10.24 1. ... Nd6 2. f4 Nh6 3. Qh1 Nhf5 4. Qh8
Ne6 5. e3 Nd5 6. Qaa2 Nf6 7. Qa8 Ng4 8.
Qd1 Nf6 9. Qb3 Nc7 10. Qa1
18-> 16.41/2:14 10.24 1. ... Nd6 2. f4 Nh6 3. Qh1 Nhf5 4. Qh8
Ne6 5. e3 Nd5 6. Qaa2 Nf6 7. Qa8 Ng4 8.
Qd1 Nf6 9. Qb3 Nc7 10. Qa1 (s=2)
19 17.05/2:14 10.24 1. ... Nd6 2. f4 Nh6 3. Qh1 Nhf5 4. Qh8
Ne6 5. e3 Nd5 6. Qaa2 Nf6 7. Qa8 Ng4 8.
Qd1 Nc7 9. Qaa1 Nf6 10. Qda4 Ncd5
19-> 17.19/2:00 10.24 1. ... Nd6 2. f4 Nh6 3. Qh1 Nhf5 4. Qh8
Ne6 5. e3 Nd5 6. Qaa2 Nf6 7. Qa8 Ng4 8.
Qd1 Nc7 9. Qaa1 Nf6 10. Qda4 Ncd5
20 19.69/2:00 10.33 1. ... Nd6 2. f4 Nh6 3. d3 Nfe6 4. Qh1
Nhg8 5. e3 Nc5 6. Qa3 Nde6 7. Qh8 Nca6
8. Ke2 Ncb4 9. Kf3 N8c6 10. Qaa1 Nac7 11.
d4
20-> 21.86/1:47 10.33 1. ... Nd6 2. f4 Nh6 3. d3 Nfe6 4. Qh1
Nhg8 5. e3 Nc5 6. Qa3 Nde6 7. Qh8 Nca6
8. Ke2 Ncb4 9. Kf3 N8c6 10. Qaa1 Nac7 11.
d4
21 23.46/1:47 10.35 1. ... Nd6 2. f4 Nh6 3. d3 Nfe6 4. Qh1
Nhg8 5. e3 Nc5 6. Qa3 Nde6 7. Qh8 Nca6
8. Qc3 Ncb4 9. d4 N8c6 10. f5 Nde4 11.
Qcc1 N6g5
21-> 24.96/1:36 10.35 1. ... Nd6 2. f4 Nh6 3. d3 Nfe6 4. Qh1
Nhg8 5. e3 Nc5 6. Qa3 Nde6 7. Qh8 Nca6
8. Qc3 Ncb4 9. d4 N8c6 10. f5 Nde4 11.
Qcc1 N6g5
22 29.79/1:36 10.29 1. ... Nd6 2. f4 Nh6 3. d3 Nfe6 4. Qh1
Nhg8 5. e3 Nc5 6. Qa3 Nde6 7. Qh8 Nca6
8. Qd1 Nab4 9. d4 Nbd5 10. Qda4 Nde4 11.
f5 N6g5 12. Q4b3 Nf3+ 13. Ke2
22-> 30.75/1:27 10.29 1. ... Nd6 2. f4 Nh6 3. d3 Nfe6 4. Qh1
Nhg8 5. e3 Nc5 6. Qa3 Nde6 7. Qh8 Nca6
8. Qd1 Nab4 9. d4 Nbd5 10. Qda4 Nde4 11.
f5 N6g5 12. Q4b3 Nf3+ 13. Ke2
23 1:17/1:27 10.25 1. ... Nd6 2. Qh1 Ng6 3. d3 Ne6 4. Qa8
Kf8 5. Kd2 Nge5 6. Qhf1 Nf4 7. Qb3 Ne6
8. f4 Neg4 9. Qbb1 Nd5 10. Qf3 N8f6 11.
Qh3 Ke8 12. Qh8+ Nf8 13. Qa4
23-> 1:18/1:23 10.25 1. ... Nd6 2. Qh1 Ng6 3. d3 Ne6 4. Qa8
Kf8 5. Kd2 Nge5 6. Qhf1 Nf4 7. Qb3 Ne6
8. f4 Neg4 9. Qbb1 Nd5 10. Qf3 N8f6 11.
Qh3 Ke8 12. Qh8+ Nf8 13. Qa4
time=1:23(100%) n=398965214(399.0M) fh1=90% 50move=1 nps=4.8M
ext=6.1M pruned=156.6M qchks=11.6M predicted=0
LMReductions: 1/14.9M 2/8.1M 3/3.5M 4/282.0K 5/4.7K
null searches (R): 3/12.8M 4/810.6K 5/15.2K 6/170
splits=1.2K aborts=231 data=0% probes=0 hits=0
terminating SMP processes.
LearnBook() updating book database
1-0 {Black resigns}
Black(1): Nd6
time used: 1:23

+---+---+---+---+---+---+---+---+
8 | |<N>| |<N>|<K>|<N>|<N>| . |
+---+---+---+---+---+---+---+---+
7 | . | | . |<P>|<P>|<P>| . | |
+---+---+---+---+---+---+---+---+
6 | | . |<N>|<N>| |<N>| | . |
+---+---+---+---+---+---+---+---+
5 | . | | . | | . | | . | |
+---+---+---+---+---+---+---+---+
4 |-Q-| . | | . | | . | | . |
+---+---+---+---+---+---+---+---+
3 | . | | . | | . | | . | |
+---+---+---+---+---+---+---+---+
2 | | . | |-P-|-P-|-P-| | . |
+---+---+---+---+---+---+---+---+
1 | . |-Q-| . | |-K-| |-Q-| |
+---+---+---+---+---+---+---+---+
a b c d e f g h

White(2): quit
bob wrote:This has been pretty interesting. Crafty has lost every game as white and won every game as black, against multiple opponents. .
Here's the actual game that made me describe Crafty's performance in this position as awful. It doesn't confirm your observation.

[Event "60/10 Fischer time control, 2 CPU each, ponder=off"]
[Site "Peter's comp test position"]
[Date "2015.09.17"]
[Round "?"]
[White "Stockfish 150915"]
[Black "Crafty 24.1"]
[Result "1-0"]
[FEN "1nnnknn1/3ppp2/2n2n2/8/8/8/3PPP2/1Q1QK1Q1 w - -"]
[SetUp "1"]

1. Qa4 Nd6 2. d4 N6b7 3. d5 Nca5 4. Qg3 Na6 5. Qab5 Nac5 6. Qb8
Nxd5 7. Qxc5 Nc6 8. Q8xb7 Nxb7 9. Qxb7 f5 10. Qxd5 e6 11. Qg2
Nd8 12. Qb2 Ne7 13. Qh8 e5 14. Qa8 d5 15. Qxe5 Ng6 16. Qd6 Kf8
17. Qaxd8+ Kf7 18. Q8b6 Kg8 19. Qf6 f4 20. Qbe6+ Kh7 21. Qef7+
Kh6 22. Q7xe7 d4 23. Qg5# 1-0

Peter
bob
Posts: 20943
Joined: Mon Feb 27, 2006 7:30 pm
Location: Birmingham, AL

Re: Komodo blunder

Post by bob »

Peter Berger wrote:
bob wrote: BTW I don't know of any version of Crafty that will resign without playing a move. It won't resign until it has played at least 5 moves unless you manually alter the resign count value...
Bob, really :) - you should be* well* aware of the fact that I *do* know about intended behaviour of Crafty and its parameters. Please have a look at the log below - Crafty will resign before it makes its first move in this position.

playing a computer!
resign after 5 consecutive moves with score < -6.
accept draw offers
noise level set to 15.00 seconds.


Crafty v24.1 (2 cpus)

White(1): setboard 1nnnknn1/3ppp2/2n2n2/8/8/8/3PPP2/1Q1QK1Q1 w - - 0 1

+---+---+---+---+---+---+---+---+
8 | |<N>|<N>|<N>|<K>|<N>|<N>| . |
+---+---+---+---+---+---+---+---+
7 | . | | . |<P>|<P>|<P>| . | |
+---+---+---+---+---+---+---+---+
6 | | . |<N>| . | |<N>| | . |
+---+---+---+---+---+---+---+---+
5 | . | | . | | . | | . | |
+---+---+---+---+---+---+---+---+
4 | | . | | . | | . | | . |
+---+---+---+---+---+---+---+---+
3 | . | | . | | . | | . | |
+---+---+---+---+---+---+---+---+
2 | | . | |-P-|-P-|-P-| | . |
+---+---+---+---+---+---+---+---+
1 | . |-Q-| . |-Q-|-K-| |-Q-| |
+---+---+---+---+---+---+---+---+
a b c d e f g h

White(1): qa4
time used: 24.40
time limit 2:18 (13:50)
depth time score variation (1)
starting thread 1 <done>
18 16.21/2:29 10.24 1. ... Nd6 2. f4 Nh6 3. Qh1 Nhf5 4. Qh8
Ne6 5. e3 Nd5 6. Qaa2 Nf6 7. Qa8 Ng4 8.
Qd1 Nf6 9. Qb3 Nc7 10. Qa1
18-> 16.41/2:14 10.24 1. ... Nd6 2. f4 Nh6 3. Qh1 Nhf5 4. Qh8
Ne6 5. e3 Nd5 6. Qaa2 Nf6 7. Qa8 Ng4 8.
Qd1 Nf6 9. Qb3 Nc7 10. Qa1 (s=2)
19 17.05/2:14 10.24 1. ... Nd6 2. f4 Nh6 3. Qh1 Nhf5 4. Qh8
Ne6 5. e3 Nd5 6. Qaa2 Nf6 7. Qa8 Ng4 8.
Qd1 Nc7 9. Qaa1 Nf6 10. Qda4 Ncd5
19-> 17.19/2:00 10.24 1. ... Nd6 2. f4 Nh6 3. Qh1 Nhf5 4. Qh8
Ne6 5. e3 Nd5 6. Qaa2 Nf6 7. Qa8 Ng4 8.
Qd1 Nc7 9. Qaa1 Nf6 10. Qda4 Ncd5
20 19.69/2:00 10.33 1. ... Nd6 2. f4 Nh6 3. d3 Nfe6 4. Qh1
Nhg8 5. e3 Nc5 6. Qa3 Nde6 7. Qh8 Nca6
8. Ke2 Ncb4 9. Kf3 N8c6 10. Qaa1 Nac7 11.
d4
20-> 21.86/1:47 10.33 1. ... Nd6 2. f4 Nh6 3. d3 Nfe6 4. Qh1
Nhg8 5. e3 Nc5 6. Qa3 Nde6 7. Qh8 Nca6
8. Ke2 Ncb4 9. Kf3 N8c6 10. Qaa1 Nac7 11.
d4
21 23.46/1:47 10.35 1. ... Nd6 2. f4 Nh6 3. d3 Nfe6 4. Qh1
Nhg8 5. e3 Nc5 6. Qa3 Nde6 7. Qh8 Nca6
8. Qc3 Ncb4 9. d4 N8c6 10. f5 Nde4 11.
Qcc1 N6g5
21-> 24.96/1:36 10.35 1. ... Nd6 2. f4 Nh6 3. d3 Nfe6 4. Qh1
Nhg8 5. e3 Nc5 6. Qa3 Nde6 7. Qh8 Nca6
8. Qc3 Ncb4 9. d4 N8c6 10. f5 Nde4 11.
Qcc1 N6g5
22 29.79/1:36 10.29 1. ... Nd6 2. f4 Nh6 3. d3 Nfe6 4. Qh1
Nhg8 5. e3 Nc5 6. Qa3 Nde6 7. Qh8 Nca6
8. Qd1 Nab4 9. d4 Nbd5 10. Qda4 Nde4 11.
f5 N6g5 12. Q4b3 Nf3+ 13. Ke2
22-> 30.75/1:27 10.29 1. ... Nd6 2. f4 Nh6 3. d3 Nfe6 4. Qh1
Nhg8 5. e3 Nc5 6. Qa3 Nde6 7. Qh8 Nca6
8. Qd1 Nab4 9. d4 Nbd5 10. Qda4 Nde4 11.
f5 N6g5 12. Q4b3 Nf3+ 13. Ke2
23 1:17/1:27 10.25 1. ... Nd6 2. Qh1 Ng6 3. d3 Ne6 4. Qa8
Kf8 5. Kd2 Nge5 6. Qhf1 Nf4 7. Qb3 Ne6
8. f4 Neg4 9. Qbb1 Nd5 10. Qf3 N8f6 11.
Qh3 Ke8 12. Qh8+ Nf8 13. Qa4
23-> 1:18/1:23 10.25 1. ... Nd6 2. Qh1 Ng6 3. d3 Ne6 4. Qa8
Kf8 5. Kd2 Nge5 6. Qhf1 Nf4 7. Qb3 Ne6
8. f4 Neg4 9. Qbb1 Nd5 10. Qf3 N8f6 11.
Qh3 Ke8 12. Qh8+ Nf8 13. Qa4
time=1:23(100%) n=398965214(399.0M) fh1=90% 50move=1 nps=4.8M
ext=6.1M pruned=156.6M qchks=11.6M predicted=0
LMReductions: 1/14.9M 2/8.1M 3/3.5M 4/282.0K 5/4.7K
null searches (R): 3/12.8M 4/810.6K 5/15.2K 6/170
splits=1.2K aborts=231 data=0% probes=0 hits=0
terminating SMP processes.
LearnBook() updating book database
1-0 {Black resigns}
Black(1): Nd6
time used: 1:23

+---+---+---+---+---+---+---+---+
8 | |<N>| |<N>|<K>|<N>|<N>| . |
+---+---+---+---+---+---+---+---+
7 | . | | . |<P>|<P>|<P>| . | |
+---+---+---+---+---+---+---+---+
6 | | . |<N>|<N>| |<N>| | . |
+---+---+---+---+---+---+---+---+
5 | . | | . | | . | | . | |
+---+---+---+---+---+---+---+---+
4 |-Q-| . | | . | | . | | . |
+---+---+---+---+---+---+---+---+
3 | . | | . | | . | | . | |
+---+---+---+---+---+---+---+---+
2 | | . | |-P-|-P-|-P-| | . |
+---+---+---+---+---+---+---+---+
1 | . |-Q-| . | |-K-| |-Q-| |
+---+---+---+---+---+---+---+---+
a b c d e f g h

White(2): quit
bob wrote:This has been pretty interesting. Crafty has lost every game as white and won every game as black, against multiple opponents. .
Here's the actual game that made me describe Crafty's performance in this position as awful. It doesn't confirm your observation.

[Event "60/10 Fischer time control, 2 CPU each, ponder=off"]
[Site "Peter's comp test position"]
[Date "2015.09.17"]
[Round "?"]
[White "Stockfish 150915"]
[Black "Crafty 24.1"]
[Result "1-0"]
[FEN "1nnnknn1/3ppp2/2n2n2/8/8/8/3PPP2/1Q1QK1Q1 w - -"]
[SetUp "1"]

1. Qa4 Nd6 2. d4 N6b7 3. d5 Nca5 4. Qg3 Na6 5. Qab5 Nac5 6. Qb8
Nxd5 7. Qxc5 Nc6 8. Q8xb7 Nxb7 9. Qxb7 f5 10. Qxd5 e6 11. Qg2
Nd8 12. Qb2 Ne7 13. Qh8 e5 14. Qa8 d5 15. Qxe5 Ng6 16. Qd6 Kf8
17. Qaxd8+ Kf7 18. Q8b6 Kg8 19. Qf6 f4 20. Qbe6+ Kh7 21. Qef7+
Kh6 22. Q7xe7 d4 23. Qg5# 1-0

Peter
I'm not aware of fixing any resign bugs at all in 25.0, for me it definitely resigned, but only after playing 5 moves. I disabled resignations and it played just fine. I can post a few of the games when I get home, I think I had xboard save the PGN. I played against scorpio which was happy to play either side. I could only play black against stockfish as it will instantly resign as black. Didn't lose a single game, which is what I would expect. I think I played at 60 moves in 1 minute + 0.5sec increment...

Lots of differences in 25.0 to be sure, but I don't see how any of the changes would affect how it plays here particularly. What is "60/10"??? 60 = moves, but 10=minutes or seconds???

I can set stockfish to play any time control, although I did use one CPU last night to keep it simple.
Peter Berger
Posts: 653
Joined: Thu Mar 09, 2006 2:56 pm

Re: Komodo blunder

Post by Peter Berger »

bob wrote: What is "60/10"??? 60 = moves, but 10=minutes or seconds???
Time control was game in 1 hour aka 60 minutes with 10 seconds increment per move.

Peter
bob
Posts: 20943
Joined: Mon Feb 27, 2006 7:30 pm
Location: Birmingham, AL

Re: Komodo blunder

Post by bob »

Peter Berger wrote:
bob wrote: What is "60/10"??? 60 = moves, but 10=minutes or seconds???
Time control was game in 1 hour aka 60 minutes with 10 seconds increment per move.

Peter
I'm giving that a run, although why you would waste that much time for such a whacked-up position is beyond me. :)

We do have a difference right off the bat, in that ALL I get out of SF6 is d4 as white...
bob
Posts: 20943
Joined: Mon Feb 27, 2006 7:30 pm
Location: Birmingham, AL

Re: Komodo blunder

Post by bob »

Here is the result of the first game. 60 mins + 10 secs. One note. Run on my 4-processor iMac. I didn't notice early on that Stockfish was running on 4 cores. Crafty was explicitly told to use one. I noticed this when I looked at the engine output and Crafty was only a little faster than SF in terms of NPS. No pondering. Xboard captured the usual score and stuff. Game ended with the same result I saw EVERY game end with last night, black winning. I didn't play any games with SF as black as I did not see how to stop it from resigning and didn't want to look thru the code... It apparently uses the same idea as Crafty, resigning after 5 moves with score < something. It's scores are HUGE, however...



[Event "Computer Chess Game"]
[Site "scrappy.attlocal.net"]
[Date "2015.09.17"]
[Round "1"]
[White "Stockfish 6 64"]
[Black "crafty"]
[Result "0-1"]
[TimeControl "3600+10"]
[FEN "1nnnknn1/3ppp2/2n2n2/8/8/8/3PPP2/1Q1QK1Q1 w - - 0 1"]
[SetUp "1"]

{--------------
. n n n k n n .
. . . p p p . .
. . n . . n . .
. . . . . . . .
. . . . . . . .
. . . . . . . .
. . . P P P . .
. Q . Q K . Q .
white to play
--------------}
1. d4 {+229.00/23} d5 {+10.68/24 1:42} 2. Qh2 {+186.00/23 4:34} Nd6
{+10.65/23 1:44} 3. Qa4 {+170.00/21 2:22} Nbd7 {+10.41/25 1:25} 4. Qbc2
{+160.00/21 2:22} Nb6 {+9.80/25 1:23} 5. Qcxc6+ {+148.00/23 2:06} Nxc6
{+6.36/26 1:21} 6. Qxc6+ {+121.00/24 1:23} Nf6d7 {+6.36/25 1:20} 7. e3
{+102.00/24 2:54} Ng6 {+6.21/25 1:24} 8. Qh3 {+93.00/23 4:14} Nf6
{+6.25/25 1:54} 9. f3 {+96.00/24 3:02} Ndc4 {+6.11/24 1:14} 10. Ke2
{+100.00/23 1:47} e5 {+5.89/24 1:12} 11. Qh2 {+88.00/21 1:21} exd4
{+5.40/23 1:11} 12. exd4 {+58.00/24 1:19} Nh5 {+5.22/23 1:45} 13. Kf2
{+62.00/24 1:13} Nhf4 {+5.05/22 1:08} 14. Qh6 {+52.00/23 49} Ne6
{+4.41/22 1:19} 15. Qxg6 {+81.00/27 1:31} fxg6 {+1.48/26 1:05} 16. Qxe6+
{+60.00/32 49} Kd8 {+1.48/25 1:03} 17. Ke2 {+55.00/32 37} Na4
{+1.44/25 1:18} 18. f4 {+31.00/28 1:49} Kc7 {+1.37/24 1:01} 19. Kf2
{+20.00/30 1:53} Nc3 {+1.28/22 59} 20. Kf3 {+20.00/32 34} Nd6 {+0.84/25 58}
21. Qxg6 {+0.00/32 48} Ncb5 {+0.84/26 1:22} 22. Ke3 {+21.00/31 52} Nb8
{+0.84/26 56} 23. f5 {+11.00/34 6:18} Nc6 {+0.23/23 1:12} 24. f6
{+11.00/32 51} Nbxd4 {+0.23/21 53} 25. Qg2 {+0.00/28 51} Nc4+ {+0.22/25 52}
26. Kd3 {+0.00/31 28} Kd6 {+0.19/21 59} 27. Qg3+ {+0.00/31 40} N4e5+
{-1.12/21 50} 28. Kd2 {+0.00/35 28} Ke6 {-1.12/21 49} 29. Qg8+
{+0.00/35 28} Nf7 {-1.16/21 48} 30. Qe8+ {+0.00/34 28} Kxf6 {-1.20/22 47}
31. Kc3 {-56.00/35 5:01} Nfe5 {-1.36/21 46} 32. Qf8+ {-97.00/27 1:02} Ke6
{-1.25/20 45} 33. Qf1 {-97.00/32 21}
{White resigns} 0-1
Peter Berger
Posts: 653
Joined: Thu Mar 09, 2006 2:56 pm

Re: Komodo blunder

Post by Peter Berger »

This is pretty interesting. I played another game with changed colours and same settings in the meantime:

[Event "?"]
[Site "?"]
[Date "2015.09.18"]
[Round "?"]
[White "Crafty 24.1"]
[WhiteElo ""]
[Black "unknown"]
[BlackElo ""]
[Result "0-1"]
[FEN "1nnnknn1/3ppp2/2n2n2/8/8/8/3PPP2/1Q1QK1Q1 w - -"]
[SetUp "1"]

1. e4 e5 2. f4 d6 3. f5 Nbd7 4. Qh1 Nc5 5. d3 N8d7 6. Qd2 Nc8e7
7. Qh8 d5 8. exd5 Nd4 9. Kf1 Nexd5 10. Qba2 Nxf5 11. Qa8 Ke7
12. Qda2 Nde6 13. Qhh2 Ned4 14. Qhb2 Ngh6 15. Qab1 Nfe3+ 16. Kg1
Nhf5 17. Q2a2 Nf3+ 18. Kf2 N5d4 19. Q8xd5 Nfxd5 20. Qa3 0-1


Crafty 24.1 is absolutely hopeless against Stockfish 150915 with either colour ( really obvious) , so either the changes in Crafty since or in Stockfish make a very major difference. I haven't looked at your games yet in detail chesswise - but it seems the oddball position produces interesting results, doesn't it?
Dirt
Posts: 2851
Joined: Wed Mar 08, 2006 10:01 pm
Location: Irvine, CA, USA

Re: Komodo blunder

Post by Dirt »

bob wrote:I didn't play any games with SF as black as I did not see how to stop it from resigning and didn't want to look thru the code.
If you're using polyglot you set resign = false. You probably are not using polyglot, though.
Deasil is the right way to go.
bob
Posts: 20943
Joined: Mon Feb 27, 2006 7:30 pm
Location: Birmingham, AL

Re: Komodo blunder

Post by bob »

Here are six games, three with early resignations by SF, other three with Crafty winning with the knights.

Don't see this "Crafty plays this horribly" going on. All of these are with SF using 4 cores, Crafty using only one, as a further handicap...

[Event "Computer Chess Game"]
[Site "scrappy.attlocal.net"]
[Date "2015.09.17"]
[Round "1"]
[White "Stockfish 6 64"]
[Black "crafty"]
[Result "0-1"]
[TimeControl "3600+10"]
[FEN "1nnnknn1/3ppp2/2n2n2/8/8/8/3PPP2/1Q1QK1Q1 w - - 0 1"]
[SetUp "1"]

{--------------
. n n n k n n .
. . . p p p . .
. . n . . n . .
. . . . . . . .
. . . . . . . .
. . . . . . . .
. . . P P P . .
. Q . Q K . Q .
white to play
--------------}
1. d4 {+229.00/23} d5 {+10.68/24 1:42} 2. Qh2 {+186.00/23 4:34} Nd6
{+10.65/23 1:44} 3. Qa4 {+170.00/21 2:22} Nbd7 {+10.41/25 1:25} 4. Qbc2
{+160.00/21 2:22} Nb6 {+9.80/25 1:23} 5. Qcxc6+ {+148.00/23 2:06} Nxc6
{+6.36/26 1:21} 6. Qxc6+ {+121.00/24 1:23} Nf6d7 {+6.36/25 1:20} 7. e3
{+102.00/24 2:54} Ng6 {+6.21/25 1:24} 8. Qh3 {+93.00/23 4:14} Nf6
{+6.25/25 1:54} 9. f3 {+96.00/24 3:02} Ndc4 {+6.11/24 1:14} 10. Ke2
{+100.00/23 1:47} e5 {+5.89/24 1:12} 11. Qh2 {+88.00/21 1:21} exd4
{+5.40/23 1:11} 12. exd4 {+58.00/24 1:19} Nh5 {+5.22/23 1:45} 13. Kf2
{+62.00/24 1:13} Nhf4 {+5.05/22 1:08} 14. Qh6 {+52.00/23 49} Ne6
{+4.41/22 1:19} 15. Qxg6 {+81.00/27 1:31} fxg6 {+1.48/26 1:05} 16. Qxe6+
{+60.00/32 49} Kd8 {+1.48/25 1:03} 17. Ke2 {+55.00/32 37} Na4
{+1.44/25 1:18} 18. f4 {+31.00/28 1:49} Kc7 {+1.37/24 1:01} 19. Kf2
{+20.00/30 1:53} Nc3 {+1.28/22 59} 20. Kf3 {+20.00/32 34} Nd6 {+0.84/25 58}
21. Qxg6 {+0.00/32 48} Ncb5 {+0.84/26 1:22} 22. Ke3 {+21.00/31 52} Nb8
{+0.84/26 56} 23. f5 {+11.00/34 6:18} Nc6 {+0.23/23 1:12} 24. f6
{+11.00/32 51} Nbxd4 {+0.23/21 53} 25. Qg2 {+0.00/28 51} Nc4+ {+0.22/25 52}
26. Kd3 {+0.00/31 28} Kd6 {+0.19/21 59} 27. Qg3+ {+0.00/31 40} N4e5+
{-1.12/21 50} 28. Kd2 {+0.00/35 28} Ke6 {-1.12/21 49} 29. Qg8+
{+0.00/35 28} Nf7 {-1.16/21 48} 30. Qe8+ {+0.00/34 28} Kxf6 {-1.20/22 47}
31. Kc3 {-56.00/35 5:01} Nfe5 {-1.36/21 46} 32. Qf8+ {-97.00/27 1:02} Ke6
{-1.25/20 45} 33. Qf1 {-97.00/32 21}
{White resigns} 0-1

[Event "Computer Chess Game"]
[Site "scrappy.attlocal.net"]
[Date "2015.09.17"]
[Round "2"]
[White "Crafty-25.0"]
[Black "Stockfish 6 64"]
[Result "1-0"]
[TimeControl "3600+10"]
[FEN "1nnnknn1/3ppp2/2n2n2/8/8/8/3PPP2/1Q1QK1Q1 w - - 0 1"]
[SetUp "1"]

{--------------
. n n n k n n .
. . . p p p . .
. . n . . n . .
. . . . . . . .
. . . . . . . .
. . . . . . . .
. . . P P P . .
. Q . Q K . Q .
white to play
--------------}
1. Qa4 {+10.71/25} Na6 {-202.00/22 1:25} 2. Qxa6 {+13.78/26 1:41} Nd6
{-192.00/23 2:54} 3. f3 {+13.78/24 1:22} Nh6 {-198.00/23 1:18}
{Black resigns} 1-0

[Event "Computer Chess Game"]
[Site "scrappy.attlocal.net"]
[Date "2015.09.17"]
[Round "3"]
[White "Stockfish 6 64"]
[Black "Crafty-25.0"]
[Result "0-1"]
[TimeControl "3600+10"]
[FEN "1nnnknn1/3ppp2/2n2n2/8/8/8/3PPP2/1Q1QK1Q1 w - - 0 1"]
[SetUp "1"]

{--------------
. n n n k n n .
. . . p p p . .
. . n . . n . .
. . . . . . . .
. . . . . . . .
. . . . . . . .
. . . P P P . .
. Q . Q K . Q .
white to play
--------------}
1. d4 {+204.00/22} d5 {+10.67/24 1:33} 2. Qa4 {+206.00/21 1:52} Nbd7
{+10.40/24 2:37} 3. Qa8 {+191.00/22 5:56} N8a7 {+7.51/26 1:41} 4. Qbb7
{+212.00/21 2:09} Ndb8 {+6.73/27 1:50} 5. Qb2 {+231.00/21 5:35} Nfe6
{+6.51/29 1:19} 6. e3 {+228.00/19 1:08} Na6 {+6.29/31 1:23} 7. Qg3
{+194.00/19 1:38} Nac7 {+2.23/26 1:16} 8. Qb3 {+155.00/19 1:19} Nxa8
{-1.88/23 1:52} 9. f4 {+56.00/21 1:54} Nh6 {-2.68/21 1:17} 10. Qh4
{+16.00/21 2:46} Nhg4 {-3.51/21 1:35} 11. f5 {-27.00/21 1:24} Nec7
{-5.16/21 1:43} 12. e4 {-6.00/21 1:06} dxe4 {-5.70/19 1:36} 13. Qxg4
{-126.00/22 2:16}
{White resigns} 0-1

[Event "Computer Chess Game"]
[Site "scrappy.attlocal.net"]
[Date "2015.09.17"]
[Round "4"]
[White "Crafty-25.0"]
[Black "Stockfish 6 64"]
[Result "1-0"]
[TimeControl "3600+10"]
[FEN "1nnnknn1/3ppp2/2n2n2/8/8/8/3PPP2/1Q1QK1Q1 w - - 0 1"]
[SetUp "1"]

{--------------
. n n n k n n .
. . . p p p . .
. . n . . n . .
. . . . . . . .
. . . . . . . .
. . . . . . . .
. . . P P P . .
. Q . Q K . Q .
white to play
--------------}
1. d4 {+10.71/24} d5 {-189.00/22 2:14} 2. e3 {+10.67/23 1:42} Nd6
{-192.00/20 1:19} 3. Qf3 {+10.56/22 6:18} Nbd7 {-145.00/21 1:48}
{Black resigns} 1-0

[Event "Computer Chess Game"]
[Site "scrappy.attlocal.net"]
[Date "2015.09.17"]
[Round "5"]
[White "Stockfish 6 64"]
[Black "Crafty-25.0"]
[Result "0-1"]
[TimeControl "3600+10"]
[FEN "1nnnknn1/3ppp2/2n2n2/8/8/8/3PPP2/1Q1QK1Q1 w - - 0 1"]
[SetUp "1"]

{--------------
. n n n k n n .
. . . p p p . .
. . n . . n . .
. . . . . . . .
. . . . . . . .
. . . . . . . .
. . . P P P . .
. Q . Q K . Q .
white to play
--------------}
1. d4 {+221.00/22} d5 {+10.71/25 1:33} 2. Qg7 {+185.00/22 1:41} Ng6
{+8.81/28 2:45} 3. Qa4 {+246.00/22 1:15} Nbd7 {+6.43/26 1:24} 4. Qa8
{+227.00/22 3:07} Ndb6 {+3.27/28 2:03} 5. Qa6 {+185.00/20 2:35} Ne6
{+3.27/28 1:19} 6. Qbb5 {+140.00/20 3:06} Nxg7 {+2.11/22 1:18} 7. e3
{+69.00/21 4:12} Kf8 {+1.76/25 1:16} 8. Qxc6 {+56.00/22 3:33} Nf5
{+1.57/24 1:15} 9. Qf1 {+31.00/23 3:53} e6 {+1.30/24 1:18} 10. f3
{-40.00/23 2:22} Ng8e7 {-0.39/21 1:11} 11. Qc7 {-61.00/24 49} Nc4
{-0.41/21 1:45} 12. e4 {-63.00/25 1:30}
{White resigns} 0-1

[Event "Computer Chess Game"]
[Site "scrappy.attlocal.net"]
[Date "2015.09.17"]
[Round "6"]
[White "Crafty-25.0"]
[Black "Stockfish 6 64"]
[Result "1-0"]
[TimeControl "3600+10"]
[FEN "1nnnknn1/3ppp2/2n2n2/8/8/8/3PPP2/1Q1QK1Q1 w - - 0 1"]
[SetUp "1"]

{--------------
. n n n k n n .
. . . p p p . .
. . n . . n . .
. . . . . . . .
. . . . . . . .
. . . . . . . .
. . . P P P . .
. Q . Q K . Q .
white to play
--------------}
1. Qa4 {+10.73/25} Na6 {-186.00/24 9:19} 2. Qxa6 {+13.70/23 1:40} Nd6
{-197.00/24 3:17} 3. f3 {+13.65/23 2:43} Ng6 {-190.00/21 1:41}
{Black resigns} 1-0

Crafty is winning the current game, again with black, but I am not going to continue this any further... Not very interesting.
bob
Posts: 20943
Joined: Mon Feb 27, 2006 7:30 pm
Location: Birmingham, AL

Re: Komodo blunder

Post by bob »

Dirt wrote:
bob wrote:I didn't play any games with SF as black as I did not see how to stop it from resigning and didn't want to look thru the code.
If you're using polyglot you set resign = false. You probably are not using polyglot, though.
Actually I am, but I use it via xboard. I can probably fake that somehow...
bob
Posts: 20943
Joined: Mon Feb 27, 2006 7:30 pm
Location: Birmingham, AL

Re: Komodo blunder

Post by bob »

Peter Berger wrote:This is pretty interesting. I played another game with changed colours and same settings in the meantime:

[Event "?"]
[Site "?"]
[Date "2015.09.18"]
[Round "?"]
[White "Crafty 24.1"]
[WhiteElo ""]
[Black "unknown"]
[BlackElo ""]
[Result "0-1"]
[FEN "1nnnknn1/3ppp2/2n2n2/8/8/8/3PPP2/1Q1QK1Q1 w - -"]
[SetUp "1"]

1. e4 e5 2. f4 d6 3. f5 Nbd7 4. Qh1 Nc5 5. d3 N8d7 6. Qd2 Nc8e7
7. Qh8 d5 8. exd5 Nd4 9. Kf1 Nexd5 10. Qba2 Nxf5 11. Qa8 Ke7
12. Qda2 Nde6 13. Qhh2 Ned4 14. Qhb2 Ngh6 15. Qab1 Nfe3+ 16. Kg1
Nhf5 17. Q2a2 Nf3+ 18. Kf2 N5d4 19. Q8xd5 Nfxd5 20. Qa3 0-1


Crafty 24.1 is absolutely hopeless against Stockfish 150915 with either colour ( really obvious) , so either the changes in Crafty since or in Stockfish make a very major difference. I haven't looked at your games yet in detail chesswise - but it seems the oddball position produces interesting results, doesn't it?
It really should be hopeless playing white. I have yet to see any of the programs I have produce a win with white or a draw with either side. Black has won every last game. But I have only played a couple of hundred...

I probably should try 24.1 just to see if there is a difference...

The new version is about +75 Elo stronger using one core, significantly more with multiple cores. But these were all played with 1 core for Crafty so the SMP stuff is irrelevant. If you are seeing losses with black, this wold seem to be a bit more than a +75 Elo improvement could address...

More after a few 24.1 games...