Someone lit a fire under the Stockfish team

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

User avatar
Guenther
Posts: 4605
Joined: Wed Oct 01, 2008 6:33 am
Location: Regensburg, Germany
Full name: Guenther Simon

Re: Someone lit a fire under the Stockfish team

Post by Guenther »

zullil wrote: [D] rk6/p1r3p1/P3B1Kp/1p2B3/8/8/8/8 w - - 0 1

The very latest SF-dev (1 thread):

Code: Select all

info depth 70 seldepth 80 multipv 1 score cp -29 nodes 269400017121 nps 5896122 hashfull 999 tbhits 0 time 45691046 pv e6d5 b8c8 d5a8 c7c4 e5g7 b5b4 g6h6 c8c7 a8d5 c4c5 d5e4 c5a5 g7d4 a5a6 h6g5 a6a3 g5f4 c7d6 e4f3 a7a5 f4e4 a5a4 f3d1 b4b3 e4d3 b3b2 d3c2 b2b1q c2b1 a3d3 d1a4 d3d4 a4b3 d4d2 b1c1 d2f2 b3c2 d6c5 c1d1 c5d4 c2b1 f2g2 b1f5 d4c3 d1e1 g2b2 f5g4 c3d4 g4f5 d4e3 e1d1 b2e2 f5b1 e2d2 d1c1 d2h2 c1d1 e3d4 b1g6 d4c3 g6f5 c3b2 f5d3 b2b3 d3f5 b3c3 f5g6 c3d4 g6e8 d4e3 e8g6 h2f2 g6b1 f2g2 b1f5 g2d2 d1e1 d2a2 e1d1 a2f2
But I'm confident that Bd7 will emerge!

Thanks to Bernhard Bauer for sharing this position.
Thanks to you and Bernhard for bringing up this position.
Actually it's quite easy for Humans. With feeding the first 2 plies programs find it it fast too.

The reason I replied here is that Andscacs 0.93 crashes here in analysis mode before I can make the last move for mating!
This is the no-popcount version. As I have never tried mate riddles before with Andscacs it might be not related to this position,
but to making the last mating move. Can anyone confirm this behaviour?
(could be a design decision)

Guenther
https://rwbc-chess.de

trollwatch:
Chessqueen + chessica + AlexChess + Eduard + Sylwy
zullil
Posts: 6442
Joined: Tue Jan 09, 2007 12:31 am
Location: PA USA
Full name: Louis Zulli

Re: Someone lit a fire under the Stockfish team

Post by zullil »

tpoppins wrote: Back to the present. Has Stockfish emerged with 24.Qxe5 yet? Clean hash, no source mods, no MultiPV? I bet it's still 24.Qa3 0.00, three years and +200 Elo later. How many more years are you prepared to wait, Louis? :)
Hang on, let me check my SPARC workstation. It has been searching Gusev-Auerbach since 2002. Of course, Glaurung, not Stockfish.

Humans are incredible creatures. Once in a while, they find moves that engines cannot. Yet. :D
tpoppins
Posts: 919
Joined: Tue Nov 24, 2015 9:11 pm
Location: upstate

Re: Someone lit a fire under the Stockfish team

Post by tpoppins »

Ha, nice one!

Just to put things in perspective, you and Dann will always be among my favorite posters, regardless of any difference of opinion on SF or any other engine.
zullil
Posts: 6442
Joined: Tue Jan 09, 2007 12:31 am
Location: PA USA
Full name: Louis Zulli

Re: Someone lit a fire under the Stockfish team

Post by zullil »

tpoppins wrote:Ha, nice one!

Just to put things in perspective, you and Dann will always be among my favorite posters, regardless of any difference of opinion on SF or any other engine.
Thanks, very kind of you to say.
Dann Corbit
Posts: 12537
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Someone lit a fire under the Stockfish team

Post by Dann Corbit »

zullil wrote:
tpoppins wrote:Ha, nice one!

Just to put things in perspective, you and Dann will always be among my favorite posters, regardless of any difference of opinion on SF or any other engine.
Thanks, very kind of you to say.
I consider both of you as very interesting and valuable contributors.
I do not think that my opinion is better than that of anyone else.

I do not think SF to be infallible on quiet positions. But I do think that on average it is better than any of the alternatives that are available to me.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
zullil
Posts: 6442
Joined: Tue Jan 09, 2007 12:31 am
Location: PA USA
Full name: Louis Zulli

Re: Someone lit a fire under the Stockfish team

Post by zullil »

zullil wrote:
tpoppins wrote:
In the past two years there have been numerous posts about an alarming number of positions SF evaluates as 0.00. Someone even coined the term "Drawfish". I personally have seen hundreds of such positions on Let's Check, ranging from quiet to turbo-charged. There is a current thread discussing another such case and SF's "tunnel vision".
About "tunnel vision", I think I largely agree with Dann. Given enough time/depth, Stockfish will almost always find a winning move if one exists. Though sometimes the wait can be excruciating. :wink:
[D] rk6/p1r3p1/P3B1Kp/1p2B3/8/8/8/8 w - - 0 1

The very latest SF-dev (1 thread):

Code: Select all

info depth 70 seldepth 80 multipv 1 score cp -29 nodes 269400017121 nps 5896122 hashfull 999 tbhits 0 time 45691046 pv e6d5 b8c8 d5a8 c7c4 e5g7 b5b4 g6h6 c8c7 a8d5 c4c5 d5e4 c5a5 g7d4 a5a6 h6g5 a6a3 g5f4 c7d6 e4f3 a7a5 f4e4 a5a4 f3d1 b4b3 e4d3 b3b2 d3c2 b2b1q c2b1 a3d3 d1a4 d3d4 a4b3 d4d2 b1c1 d2f2 b3c2 d6c5 c1d1 c5d4 c2b1 f2g2 b1f5 d4c3 d1e1 g2b2 f5g4 c3d4 g4f5 d4e3 e1d1 b2e2 f5b1 e2d2 d1c1 d2h2 c1d1 e3d4 b1g6 d4c3 g6f5 c3b2 f5d3 b2b3 d3f5 b3c3 f5g6 c3d4 g6e8 d4e3 e8g6 h2f2 g6b1 f2g2 b1f5 g2d2 d1e1 d2a2 e1d1 a2f2
But I'm confident that Bd7 will emerge!

Thanks to Bernhard Bauer for sharing this position.

Code: Select all

info depth 76 seldepth 88 multipv 1 score mate 5 nodes 1810956908759 nps 6781644 hashfull 999 tbhits 0 time 267038006 pv e6d7 b5b4 g6f7 h6h5 f7e7 b4b3 e7d8 b3b2 e5c7
1.8 trillion nodes to find mate-in-5!
Dann Corbit
Posts: 12537
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Someone lit a fire under the Stockfish team

Post by Dann Corbit »

zullil wrote:
zullil wrote:
tpoppins wrote:
In the past two years there have been numerous posts about an alarming number of positions SF evaluates as 0.00. Someone even coined the term "Drawfish". I personally have seen hundreds of such positions on Let's Check, ranging from quiet to turbo-charged. There is a current thread discussing another such case and SF's "tunnel vision".
About "tunnel vision", I think I largely agree with Dann. Given enough time/depth, Stockfish will almost always find a winning move if one exists. Though sometimes the wait can be excruciating. :wink:
[D] rk6/p1r3p1/P3B1Kp/1p2B3/8/8/8/8 w - - 0 1

The very latest SF-dev (1 thread):

Code: Select all

info depth 70 seldepth 80 multipv 1 score cp -29 nodes 269400017121 nps 5896122 hashfull 999 tbhits 0 time 45691046 pv e6d5 b8c8 d5a8 c7c4 e5g7 b5b4 g6h6 c8c7 a8d5 c4c5 d5e4 c5a5 g7d4 a5a6 h6g5 a6a3 g5f4 c7d6 e4f3 a7a5 f4e4 a5a4 f3d1 b4b3 e4d3 b3b2 d3c2 b2b1q c2b1 a3d3 d1a4 d3d4 a4b3 d4d2 b1c1 d2f2 b3c2 d6c5 c1d1 c5d4 c2b1 f2g2 b1f5 d4c3 d1e1 g2b2 f5g4 c3d4 g4f5 d4e3 e1d1 b2e2 f5b1 e2d2 d1c1 d2h2 c1d1 e3d4 b1g6 d4c3 g6f5 c3b2 f5d3 b2b3 d3f5 b3c3 f5g6 c3d4 g6e8 d4e3 e8g6 h2f2 g6b1 f2g2 b1f5 g2d2 d1e1 d2a2 e1d1 a2f2
But I'm confident that Bd7 will emerge!

Thanks to Bernhard Bauer for sharing this position.

Code: Select all

info depth 76 seldepth 88 multipv 1 score mate 5 nodes 1810956908759 nps 6781644 hashfull 999 tbhits 0 time 267038006 pv e6d7 b5b4 g6f7 h6h5 f7e7 b4b3 e7d8 b3b2 e5c7
1.8 trillion nodes to find mate-in-5!
And half a day in time.
I guess it is the price for sophisticated pruning.
Sacrifices can fool it so that the correct move choices are very hard to find. But there is no technique that simply abandons the search. They only reduce it. But that can make it take a very long time to solve some problems, like this one.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
syzygy
Posts: 5557
Joined: Tue Feb 28, 2012 11:56 pm

Re: Someone lit a fire under the Stockfish team

Post by syzygy »

Cripplefish (SF without pruning and reductions) needs 173813 nodes:

Code: Select all

info depth 1 seldepth 2 multipv 1 score cp -401 nodes 32 nps 16000 tbhits 0 time 2 pv e6d5
info depth 2 seldepth 2 multipv 1 score cp -47 nodes 139 nps 69500 tbhits 0 time 2 pv e6d5 b5b4 e5c7 b8c7 d5a8
info depth 3 seldepth 4 multipv 1 score cp -47 nodes 764 nps 382000 tbhits 0 time 2 pv e6d5 b5b4 e5c7 b8c7
info depth 4 seldepth 5 multipv 1 score cp -40 nodes 2277 nps 1138500 tbhits 0 time 2 pv e6d5 b5b4 d5a8 b4b3 e5c7 b8c7 g6g7
info depth 5 seldepth 6 multipv 1 score cp -8 nodes 8830 nps 2943333 tbhits 0 time 3 pv e6d5 b5b4 d5a8 b8a8 e5c7
info depth 6 seldepth 6 multipv 1 score cp -8 nodes 22014 nps 4402800 tbhits 0 time 5 pv e6d5 b5b4 d5a8 b8a8 e5c7 b4b3 g6g7
info depth 7 seldepth 7 multipv 1 score cp -8 nodes 69602 nps 6327454 tbhits 0 time 11 pv e6d5 b5b4 d5a8 b8a8 e5c7 b4b3 g6g7
info depth 8 seldepth 8 multipv 1 score mate 5 nodes 173813 nps 6685115 tbhits 0 time 26 pv e6d7 b5b4 g6f7 b4b3 f7e7 b3b2 e7d8 b2b1q
Uri Blass
Posts: 10268
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: Someone lit a fire under the Stockfish team

Post by Uri Blass »

Dann Corbit wrote:
zullil wrote:
zullil wrote:
tpoppins wrote:
In the past two years there have been numerous posts about an alarming number of positions SF evaluates as 0.00. Someone even coined the term "Drawfish". I personally have seen hundreds of such positions on Let's Check, ranging from quiet to turbo-charged. There is a current thread discussing another such case and SF's "tunnel vision".
About "tunnel vision", I think I largely agree with Dann. Given enough time/depth, Stockfish will almost always find a winning move if one exists. Though sometimes the wait can be excruciating. :wink:
[D] rk6/p1r3p1/P3B1Kp/1p2B3/8/8/8/8 w - - 0 1

The very latest SF-dev (1 thread):

Code: Select all

info depth 70 seldepth 80 multipv 1 score cp -29 nodes 269400017121 nps 5896122 hashfull 999 tbhits 0 time 45691046 pv e6d5 b8c8 d5a8 c7c4 e5g7 b5b4 g6h6 c8c7 a8d5 c4c5 d5e4 c5a5 g7d4 a5a6 h6g5 a6a3 g5f4 c7d6 e4f3 a7a5 f4e4 a5a4 f3d1 b4b3 e4d3 b3b2 d3c2 b2b1q c2b1 a3d3 d1a4 d3d4 a4b3 d4d2 b1c1 d2f2 b3c2 d6c5 c1d1 c5d4 c2b1 f2g2 b1f5 d4c3 d1e1 g2b2 f5g4 c3d4 g4f5 d4e3 e1d1 b2e2 f5b1 e2d2 d1c1 d2h2 c1d1 e3d4 b1g6 d4c3 g6f5 c3b2 f5d3 b2b3 d3f5 b3c3 f5g6 c3d4 g6e8 d4e3 e8g6 h2f2 g6b1 f2g2 b1f5 g2d2 d1e1 d2a2 e1d1 a2f2
But I'm confident that Bd7 will emerge!

Thanks to Bernhard Bauer for sharing this position.

Code: Select all

info depth 76 seldepth 88 multipv 1 score mate 5 nodes 1810956908759 nps 6781644 hashfull 999 tbhits 0 time 267038006 pv e6d7 b5b4 g6f7 h6h5 f7e7 b4b3 e7d8 b3b2 e5c7
1.8 trillion nodes to find mate-in-5!
And half a day in time.
I guess it is the price for sophisticated pruning.
Sacrifices can fool it so that the correct move choices are very hard to find. But there is no technique that simply abandons the search. They only reduce it. But that can make it take a very long time to solve some problems, like this one.
It is simple to fix it without a significant change in playing strength.

Simply do not use null move pruning when the number of the legal moves of the opponent is small and calculate number of legal moves for the opponent only when remaining depth is at least 10 so it is not too expensive.
Dann Corbit
Posts: 12537
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Someone lit a fire under the Stockfish team

Post by Dann Corbit »

Uri Blass wrote:
Dann Corbit wrote:
zullil wrote:
zullil wrote:
tpoppins wrote:
In the past two years there have been numerous posts about an alarming number of positions SF evaluates as 0.00. Someone even coined the term "Drawfish". I personally have seen hundreds of such positions on Let's Check, ranging from quiet to turbo-charged. There is a current thread discussing another such case and SF's "tunnel vision".
About "tunnel vision", I think I largely agree with Dann. Given enough time/depth, Stockfish will almost always find a winning move if one exists. Though sometimes the wait can be excruciating. :wink:
[D] rk6/p1r3p1/P3B1Kp/1p2B3/8/8/8/8 w - - 0 1

The very latest SF-dev (1 thread):

Code: Select all

info depth 70 seldepth 80 multipv 1 score cp -29 nodes 269400017121 nps 5896122 hashfull 999 tbhits 0 time 45691046 pv e6d5 b8c8 d5a8 c7c4 e5g7 b5b4 g6h6 c8c7 a8d5 c4c5 d5e4 c5a5 g7d4 a5a6 h6g5 a6a3 g5f4 c7d6 e4f3 a7a5 f4e4 a5a4 f3d1 b4b3 e4d3 b3b2 d3c2 b2b1q c2b1 a3d3 d1a4 d3d4 a4b3 d4d2 b1c1 d2f2 b3c2 d6c5 c1d1 c5d4 c2b1 f2g2 b1f5 d4c3 d1e1 g2b2 f5g4 c3d4 g4f5 d4e3 e1d1 b2e2 f5b1 e2d2 d1c1 d2h2 c1d1 e3d4 b1g6 d4c3 g6f5 c3b2 f5d3 b2b3 d3f5 b3c3 f5g6 c3d4 g6e8 d4e3 e8g6 h2f2 g6b1 f2g2 b1f5 g2d2 d1e1 d2a2 e1d1 a2f2
But I'm confident that Bd7 will emerge!

Thanks to Bernhard Bauer for sharing this position.

Code: Select all

info depth 76 seldepth 88 multipv 1 score mate 5 nodes 1810956908759 nps 6781644 hashfull 999 tbhits 0 time 267038006 pv e6d7 b5b4 g6f7 h6h5 f7e7 b4b3 e7d8 b3b2 e5c7
1.8 trillion nodes to find mate-in-5!
And half a day in time.
I guess it is the price for sophisticated pruning.
Sacrifices can fool it so that the correct move choices are very hard to find. But there is no technique that simply abandons the search. They only reduce it. But that can make it take a very long time to solve some problems, like this one.
It is simple to fix it without a significant change in playing strength.

Simply do not use null move pruning when the number of the legal moves of the opponent is small and calculate number of legal moves for the opponent only when remaining depth is at least 10 so it is not too expensive.
Instead of a special calculation for the legal move count, why not detect it on the fly?
At every ply in the search, we must have a move count number.
So, for either side, if the legal moves is at a certain number, disable null move pruning forward from there.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.