During my testrun of Komodo TCEC 64bit for my LS-ratinglist a serious castling-bug appeared:
When Komodo plays black and the first move of the opponent is 0-0 (and the movecounter is 1 (in the LittleBlitzerGUI the first move has always the movenumber 1)), than Komodo TCEC crashes.
Same under the FritzGUI (I have Fritz 13 GUI):
Take the PGN-game below or just copy the FEN in the FritzGUI, then load Komodo TCEC 64bit and then play 0-0 manually for white - and Komodo TCEC crashes...
Because of that, I could not finish the LS-testrun of Komodo TCEC (I had more than 40 crash-games). Have to wait for a bugfix...
[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Round "?"]
[White "Houdini 4 x64"]
[Black "Komodo TCEC x64"]
[Result "1-0"]
[SetUp "1"]
[FEN "r1b2rk1/pp1nqppp/2pbpn2/3p4/2PP4/2NBPN2/PPQB1PPP/R3K2R w KQ - 0 1"]
[PlyCount "1"]
1. O-O 1-0
Komodo TCEC: Serious castling bug !
Moderators: hgm, Rebel, chrisw
-
- Posts: 2438
- Joined: Sat Sep 03, 2011 7:25 am
- Location: Berlin, Germany
- Full name: Stefan Pohl
-
- Posts: 454
- Joined: Tue Jan 15, 2013 4:33 pm
- Location: Ritz-Carlton, NYC
- Full name: Bobby Johnson
Re: Komodo TCEC: Serious castling bug !
ouch, not good, but such is life with engines
SIM, PhD, MBA, PE
-
- Posts: 157
- Joined: Tue Apr 30, 2013 1:29 am
Re: Komodo TCEC: Serious castling bug !
See my thread about the same problem:
http://www.talkchess.com/forum/viewtopic.php?t=50335
I had this in analysis in Tarrasch GUI but not in Arena. It seems that maybe Komodo has some problems with processing what some GUIs send to it.
I've found two positiosn where it just refuses to see possibility of 1.0-0 (even though it keeps going in inf analysis mode just doesn't consider the move at all).
This really looks like critical bug to me (Tarrasch GUI handles all other engines just right).
http://www.talkchess.com/forum/viewtopic.php?t=50335
I had this in analysis in Tarrasch GUI but not in Arena. It seems that maybe Komodo has some problems with processing what some GUIs send to it.
I've found two positiosn where it just refuses to see possibility of 1.0-0 (even though it keeps going in inf analysis mode just doesn't consider the move at all).
This really looks like critical bug to me (Tarrasch GUI handles all other engines just right).
-
- Posts: 2438
- Joined: Sat Sep 03, 2011 7:25 am
- Location: Berlin, Germany
- Full name: Stefan Pohl
Re: Komodo TCEC: Serious castling bug !
Meanwhile Ingo B. told me in the german CSS-forum, that this happens in the Shredder classic GUI, too. So Komodo TCEC crashes becuase of that bug in the LittleblitzerGUI, the FritzGUI and the Shredder Classic GUI...
I hope, that there will be a quick bugfix by the Komodoteam.
Stefan
I hope, that there will be a quick bugfix by the Komodoteam.
Stefan
-
- Posts: 5960
- Joined: Sun Jan 10, 2010 6:15 am
- Location: Maryland USA
Re: Komodo TCEC: Serious castling bug !
Thanks for pointing this out. We will give it high priority. Perhaps this might explain some poor test results; maybe those testers used books where the first move was castling more than testers who got good results. I take it that this problem was not present in Komodo 6, or you would have told us before this. That should help.pohl4711 wrote:During my testrun of Komodo TCEC 64bit for my LS-ratinglist a serious castling-bug appeared:
When Komodo plays black and the first move of the opponent is 0-0 (and the movecounter is 1 (in the LittleBlitzerGUI the first move has always the movenumber 1)), than Komodo TCEC crashes.
Same under the FritzGUI (I have Fritz 13 GUI):
Take the PGN-game below or just copy the FEN in the FritzGUI, then load Komodo TCEC 64bit and then play 0-0 manually for white - and Komodo TCEC crashes...
Because of that, I could not finish the LS-testrun of Komodo TCEC (I had more than 40 crash-games). Have to wait for a bugfix...
[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Round "?"]
[White "Houdini 4 x64"]
[Black "Komodo TCEC x64"]
[Result "1-0"]
[SetUp "1"]
[FEN "r1b2rk1/pp1nqppp/2pbpn2/3p4/2PP4/2NBPN2/PPQB1PPP/R3K2R w KQ - 0 1"]
[PlyCount "1"]
1. O-O 1-0
-
- Posts: 2438
- Joined: Sat Sep 03, 2011 7:25 am
- Location: Berlin, Germany
- Full name: Stefan Pohl
Re: Komodo TCEC: Serious castling bug !
No, Komodo 6 doesnt have this bug, otherwise it would have crashed in its LS-testrun, but that 10000 games were all OK (no timelosses, illegal moves).lkaufman wrote:Thanks for pointing this out. We will give it high priority. Perhaps this might explain some poor test results; maybe those testers used books where the first move was castling more than testers who got good results. I take it that this problem was not present in Komodo 6, or you would have told us before this. That should help.pohl4711 wrote:During my testrun of Komodo TCEC 64bit for my LS-ratinglist a serious castling-bug appeared:
When Komodo plays black and the first move of the opponent is 0-0 (and the movecounter is 1 (in the LittleBlitzerGUI the first move has always the movenumber 1)), than Komodo TCEC crashes.
Same under the FritzGUI (I have Fritz 13 GUI):
Take the PGN-game below or just copy the FEN in the FritzGUI, then load Komodo TCEC 64bit and then play 0-0 manually for white - and Komodo TCEC crashes...
Because of that, I could not finish the LS-testrun of Komodo TCEC (I had more than 40 crash-games). Have to wait for a bugfix...
[Event "?"]
[Site "?"]
[Date "????.??.??"]
[Round "?"]
[White "Houdini 4 x64"]
[Black "Komodo TCEC x64"]
[Result "1-0"]
[SetUp "1"]
[FEN "r1b2rk1/pp1nqppp/2pbpn2/3p4/2PP4/2NBPN2/PPQB1PPP/R3K2R w KQ - 0 1"]
[PlyCount "1"]
1. O-O 1-0
Stefan
-
- Posts: 1539
- Joined: Thu Mar 09, 2006 2:02 pm
Re: Komodo TCEC: Serious castling bug !
It happens with FEN and I asked for the PGN to that position. Do you have one?pohl4711 wrote:Meanwhile Ingo B. told me in the german CSS-forum, that this happens in the Shredder classic GUI, too. So Komodo TCEC crashes becuase of that bug in the LittleblitzerGUI, the FritzGUI and the Shredder Classic GUI...
I hope, that there will be a quick bugfix by the Komodoteam.
Stefan
Besides that and thinking about it I would not call it "serious" as it did not happen in thousands of games for me using a PGN Database with a correct numbering after that with the classic GUI.
So, do you have a PGN to that point. I will try that and (without really knowing) have the gut feeling it might work then.
Nonetheless it is a minor bug with the FEN for sure.
Bye
Ingo
-
- Posts: 2438
- Joined: Sat Sep 03, 2011 7:25 am
- Location: Berlin, Germany
- Full name: Stefan Pohl
Re: Komodo TCEC: Serious castling bug !
In the PGN of that opening position the movecounter is 8, not 1. And with movecounter>1, the bug doesnt happen...So no need to test that. The problem is, that the LittleBlitzerGUI deletes all the moves of the PGN and uses only the FEN of the final positon (after the 8 moves) and sets the movecounter to 1.IWB wrote:So, do you have a PGN to that point. I will try that and (without really knowing) have the gut feeling it might work then.pohl4711 wrote:Meanwhile Ingo B. told me in the german CSS-forum, that this happens in the Shredder classic GUI, too. So Komodo TCEC crashes becuase of that bug in the LittleblitzerGUI, the FritzGUI and the Shredder Classic GUI...
I hope, that there will be a quick bugfix by the Komodoteam.
Stefan
Ingo
Stefan
-
- Posts: 157
- Joined: Tue Apr 30, 2013 1:29 am
Re: Komodo TCEC: Serious castling bug !
I don't know which position he had but here are two where Komodo TCEC doesn't see castling in Tarrasch (so I guess it crashes in other GUIs when attempting to play):It happens with FEN and I asked for the PGN to that position. Do you have one?
1)
1.d4 Nf6 2.Nf3 g6 3.c4 Bg7 4.Nc3 d5 5.cxd5 Nxd5 6.e4 Nxc3 7.bxc3 c5 8.Be3 Qa5 9.Nd2 O-O 10.Be2 cxd4 11.cxd4 f5 12.exf5 gxf5 13.Rc1 Be6 here
Komodo doesn't see 14.0-0 (it saw it the move before)
2)
1.d4 Nf6 2.c4 e5 3.dxe5 Ng4 4.e3 Nxe5 5.f4 Bb4+ 6.Bd2 Bxd2+ 7.Qxd2 Ng6 8.Bd3 O-O 9.Nf3 Re8
Here Komodo doesn't see 10.0-0 (but agrees it's the best move once made and also sees it before Re8 is played)
Maybe it happened in a way that Komodo didn't play 0-0 when it should or failed to consider it as a reply.Besides that and thinking about it I would not call it "serious" as it did not happen in thousands of games for me using a PGN Database with a correct numbering after that with the classic GUI.
-
- Posts: 1539
- Joined: Thu Mar 09, 2006 2:02 pm
Re: Komodo TCEC: Serious castling bug !
OK, so to conclude.pohl4711 wrote:
In the PGN of that opening position the movecounter is 8, not 1. And with movecounter>1, the bug doesnt happen...So no need to test that. The problem is, that the LittleBlitzerGUI deletes all the moves of the PGN and uses only the FEN of the final positon (after the 8 moves) and sets the movecounter to 1.
1. When K-TCEC gets a FEN your opponent starts with a castling move THEN K-TCEC crashes.
2. Your Test crashes because the GUI gives FEN even if it has the positions as PGN.
Even if I consider part one as a problem I would not call it serious - but it should be fixed.
Nonetheless is your problem definately a combination with a little problem of the GUI as well.
In my test I might not have that problem as the GUI of my choise (and all CB GUIs) give the full movelist to the engine in a game(according to UCI specification). It is not that FEN is not UCI specification but it is for sure not as UCI should be used for a game.
Bye
Ingo