Would it be _VERY_ easy to reproduce the STS series, but with the best moves replaced, by those found, after only, say, 0.01 second analysis ?
I wonder, if tuning a much weaker engine, to find those same moves in similar time, would improve the engine?
Thoughts? Has this been tried before?
Thanks.
Q for Dann and Swami
Moderators: hgm, Rebel, chrisw
-
- Posts: 166
- Joined: Wed Mar 08, 2006 9:49 pm
- Location: S. New Jersey, USA
-
- Posts: 12541
- Joined: Wed Mar 08, 2006 8:57 pm
- Location: Redmond, WA USA
Re: Q for Dann and Swami
Different engines would find different answers. (E.g. Rybka's 0.01 second aswers would not agree with Stockfish nor Zappa, etc.).opraus wrote:Would it be _VERY_ easy to reproduce the STS series, but with the best moves replaced, by those found, after only, say, 0.01 second analysis ?
I wonder, if tuning a much weaker engine, to find those same moves in similar time, would improve the engine?
Thoughts? Has this been tried before?
Thanks.
I don't think it is feasible.
-
- Posts: 166
- Joined: Wed Mar 08, 2006 9:49 pm
- Location: S. New Jersey, USA
Re: Q for Dann and Swami
Hi Dann,
Thanks for responding.
I am thinking it does not matter if they agree.
It seems (to me at least) that if I tune my engine to 'like' the same moves as Rybka, Zappa, Stockfish, it is likely to return similar moves at deeper searches. Seeing that the deeper searches are informed by the shallow ones.
None of the moves have to be 'right' - In fact, it seems one could use a random set of positions where we had no idea what the best move was.
I am just interest to see if my engines 'thinks like' theirs does.
Returning the same move as any one of them would be better than returning an all-together different move most of the time.
These hyper fast searches CANNOT be just noise, as I said earlier, the deeper search is informed by these shallow ones. Right?
...
Thanks for responding.
I am thinking it does not matter if they agree.
It seems (to me at least) that if I tune my engine to 'like' the same moves as Rybka, Zappa, Stockfish, it is likely to return similar moves at deeper searches. Seeing that the deeper searches are informed by the shallow ones.
None of the moves have to be 'right' - In fact, it seems one could use a random set of positions where we had no idea what the best move was.
I am just interest to see if my engines 'thinks like' theirs does.
Returning the same move as any one of them would be better than returning an all-together different move most of the time.
These hyper fast searches CANNOT be just noise, as I said earlier, the deeper search is informed by these shallow ones. Right?
...
-
- Posts: 12541
- Joined: Wed Mar 08, 2006 8:57 pm
- Location: Redmond, WA USA
Re: Q for Dann and Swami
The main problem is that these positions are not tactical but strategic in nature. Whether solved by search or eval, there is a right asnwer to these positions. A shallow search will definitely give a different answer: an inferior one. So which inferior answer do we choose?opraus wrote:Hi Dann,
Thanks for responding.
I am thinking it does not matter if they agree.
It seems (to me at least) that if I tune my engine to 'like' the same moves as Rybka, Zappa, Stockfish, it is likely to return similar moves at deeper searches. Seeing that the deeper searches are informed by the shallow ones.
None of the moves have to be 'right' - In fact, it seems one could use a random set of positions where we had no idea what the best move was.
I am just interest to see if my engines 'thinks like' theirs does.
Returning the same move as any one of them would be better than returning an all-together different move most of the time.
These hyper fast searches CANNOT be just noise, as I said earlier, the deeper search is informed by these shallow ones. Right?
...
-
- Posts: 166
- Joined: Wed Mar 08, 2006 9:49 pm
- Location: S. New Jersey, USA
Re: Q for Dann and Swami
The better ones that Rybka, Zappa, and Stockfish come up with, rather than the really stupid one that Xpdnt comes up with.Dann Corbit wrote: So which inferior answer do we choose?
Thank you (and Swami), BTW for STS. They are very helpful indeed.
-
- Posts: 12541
- Joined: Wed Mar 08, 2006 8:57 pm
- Location: Redmond, WA USA
Re: Q for Dann and Swami
The alternatives are already listed and ranked. Are you looking for other answers besides these?opraus wrote:The better ones that Rybka, Zappa, and Stockfish come up with, rather than the really stupid one that Xpdnt comes up with.Dann Corbit wrote: So which inferior answer do we choose?
Thank you (and Swami), BTW for STS. They are very helpful indeed.
-
- Posts: 90
- Joined: Sun Nov 02, 2008 4:43 pm
- Location: Barcelona
Re: Q for Dann and Swami
An opposed approach, may be better for this purpose.
Rather than challenging the engine with dificult test position.
use a simple test suite, which will test key elements of the engine.
Once I constructed a test suite as follow:
I walked the file twic663.pgn to get all position reached.
on these set I discarded each position where fruit does not
give the same answer for depth=3 and depth=6
Then I ran the test at 10" with fruit, crafty, rybka 1.0,
spike 1.2 and other engines I do not remember now.
The final set of 6690 positions where these engines agree
was very useful to detect errors in quiesce, misevaluation etc.
at least for my weak engine.
This approach but with shorter time control will do your business.
if somebody is interested you can find twic663.epd at http://sites.google.com/site/barajandotrebejos/
regards,Antonio.
Rather than challenging the engine with dificult test position.
use a simple test suite, which will test key elements of the engine.
Once I constructed a test suite as follow:
I walked the file twic663.pgn to get all position reached.
on these set I discarded each position where fruit does not
give the same answer for depth=3 and depth=6
Then I ran the test at 10" with fruit, crafty, rybka 1.0,
spike 1.2 and other engines I do not remember now.
The final set of 6690 positions where these engines agree
was very useful to detect errors in quiesce, misevaluation etc.
at least for my weak engine.
This approach but with shorter time control will do your business.
if somebody is interested you can find twic663.epd at http://sites.google.com/site/barajandotrebejos/
regards,Antonio.
-
- Posts: 216
- Joined: Thu Mar 09, 2006 9:54 pm
Re: Q for Dann and Swami
Thanks for the link. Is there any easy way to convert the format of the bm to algebraic notation? (like Kc4 instead of Kd3-c4)Antonio Torrecillas wrote:An opposed approach, may be better for this purpose.
Rather than challenging the engine with dificult test position.
use a simple test suite, which will test key elements of the engine.
Once I constructed a test suite as follow:
I walked the file twic663.pgn to get all position reached.
on these set I discarded each position where fruit does not
give the same answer for depth=3 and depth=6
Then I ran the test at 10" with fruit, crafty, rybka 1.0,
spike 1.2 and other engines I do not remember now.
The final set of 6690 positions where these engines agree
was very useful to detect errors in quiesce, misevaluation etc.
at least for my weak engine.
This approach but with shorter time control will do your business.
if somebody is interested you can find twic663.epd at http://sites.google.com/site/barajandotrebejos/
regards,Antonio.
-
- Posts: 12541
- Joined: Wed Mar 08, 2006 8:57 pm
- Location: Redmond, WA USA
Re: Q for Dann and Swami
I made a translation of it.Mark wrote:Thanks for the link. Is there any easy way to convert the format of the bm to algebraic notation? (like Kc4 instead of Kd3-c4)Antonio Torrecillas wrote:An opposed approach, may be better for this purpose.
Rather than challenging the engine with dificult test position.
use a simple test suite, which will test key elements of the engine.
Once I constructed a test suite as follow:
I walked the file twic663.pgn to get all position reached.
on these set I discarded each position where fruit does not
give the same answer for depth=3 and depth=6
Then I ran the test at 10" with fruit, crafty, rybka 1.0,
spike 1.2 and other engines I do not remember now.
The final set of 6690 positions where these engines agree
was very useful to detect errors in quiesce, misevaluation etc.
at least for my weak engine.
This approach but with shorter time control will do your business.
if somebody is interested you can find twic663.epd at http://sites.google.com/site/barajandotrebejos/
regards,Antonio.
Here it is:
http://cap.connx.com/chess-engines/new- ... 3a.epd.bz2
-
- Posts: 166
- Joined: Wed Mar 08, 2006 9:49 pm
- Location: S. New Jersey, USA
Re: Q for Dann and Swami
Thanks Antonio,
This may indeed be a better solution.
What percentage did your engine agree with these?
thanks!
This may indeed be a better solution.
What percentage did your engine agree with these?
thanks!