Page 1 of 1

Neuronet plus conventional approach combined?

Posted: Fri Sep 02, 2016 10:03 pm
by Ras
A question that I've been thinking about for a while:

Neuronets alone suffer from tactical problems because these networks are designed to answer minimum changes in the input with minimum changes in the output. Chess is a game where displacing one piece by one square can make a decisive difference, so that doesn't always blend well.

But what about an engine that does a conventional tree search with a minimum eval just to filter all tactically sound moves and feeds them to a neuronet for the final selection?

Are there engines that implement this approach? Or is the whole idea nonsense?

Re: Neuronet plus conventional approach combined?

Posted: Fri Sep 02, 2016 10:18 pm
by matthewlai
Ras wrote:A question that I've been thinking about for a while:

Neuronets alone suffer from tactical problems because these networks are designed to answer minimum changes in the input with minimum changes in the output. Chess is a game where displacing one piece by one square can make a decisive difference, so that doesn't always blend well.

But what about an engine that does a conventional tree search with a minimum eval just to filter all tactically sound moves and feeds them to a neuronet for the final selection?

Are there engines that implement this approach? Or is the whole idea nonsense?
Giraffe uses a conventional search with a neural net evaluation function. Using a fast search to sort out tactics is another approach that I have spent quite some time thinking about, but haven't had a chance to implement.

Re: Neuronet plus conventional approach combined?

Posted: Sat Sep 03, 2016 12:01 am
by Ras
Thanks, that's an answer from the chess-neuro-expert No. 1.

I mean, computers are better than humans with their current tactics approach, but strategically, human masters are still better. Only that humans fail tactically before their strategies might come to fruitition.

What is your take, are neuronets possibly suited better to the diffuse strategic long-term aspects of the game? Could they implement this in case they don't have to worry about tactical shots?

Re: Neuronet plus conventional approach combined?

Posted: Sat Sep 03, 2016 12:34 am
by thomasahle
Spawkfish is an engine that tries to predict moves only with neural nets, and does reasonably well at that. If it could be made fast enough, using it for move ordering and heavy LMR would probably make a quite strong engine.

Re: Neuronet plus conventional approach combined?

Posted: Sat Sep 03, 2016 1:07 am
by matthewlai
Ras wrote:Thanks, that's an answer from the chess-neuro-expert No. 1.

I mean, computers are better than humans with their current tactics approach, but strategically, human masters are still better. Only that humans fail tactically before their strategies might come to fruitition.

What is your take, are neuronets possibly suited better to the diffuse strategic long-term aspects of the game? Could they implement this in case they don't have to worry about tactical shots?
It's an interesting idea. Neural nets are certainly better at positional stuff than what we have at the moment, but they are a bit too slow to compete tactically.

There are some practical issues with using 2 evaluation functions in the same search tree, so that will still require some thinking. I have some ideas on how to do it, but nothing I am really confident in yet.

Re: Neuronet plus conventional approach combined?

Posted: Sat Sep 03, 2016 1:12 am
by matthewlai
thomasahle wrote:Spawkfish is an engine that tries to predict moves only with neural nets, and does reasonably well at that. If it could be made fast enough, using it for move ordering and heavy LMR would probably make a quite strong engine.
Giraffe already does that. It's called the "move evaluator" net in Giraffe. It didn't help as much as I had hoped, but it did help a bit.

Re: Neuronet plus conventional approach combined?

Posted: Mon Sep 05, 2016 12:26 am
by thomasahle
matthewlai wrote:
thomasahle wrote:Spawkfish is an engine that tries to predict moves only with neural nets, and does reasonably well at that. If it could be made fast enough, using it for move ordering and heavy LMR would probably make a quite strong engine.
Giraffe already does that. It's called the "move evaluator" net in Giraffe. It didn't help as much as I had hoped, but it did help a bit.
Cool! How strong would you estimate the move evaluator is on its own, with no search?

Re: Neuronet plus conventional approach combined?

Posted: Mon Sep 05, 2016 12:49 am
by matthewlai
thomasahle wrote:
matthewlai wrote:
thomasahle wrote:Spawkfish is an engine that tries to predict moves only with neural nets, and does reasonably well at that. If it could be made fast enough, using it for move ordering and heavy LMR would probably make a quite strong engine.
Giraffe already does that. It's called the "move evaluator" net in Giraffe. It didn't help as much as I had hoped, but it did help a bit.
Cool! How strong would you estimate the move evaluator is on its own, with no search?
Depends on what features you give it. If you give it SEE scores maybe 2000 level. If you don't, it will probably make many tactical mistakes.

Re: Neuronet plus conventional approach combined?

Posted: Mon Sep 05, 2016 3:30 pm
by thomasahle
matthewlai wrote:Depends on what features you give it. If you give it SEE scores maybe 2000 level. If you don't, it will probably make many tactical mistakes.
Sounds like something that would be fun to play against. If I run giraffe and tell it to search depth 0, will that simulate the policy network reasonably well?

Re: Neuronet plus conventional approach combined?

Posted: Mon Sep 05, 2016 3:51 pm
by matthewlai
thomasahle wrote:
matthewlai wrote:Depends on what features you give it. If you give it SEE scores maybe 2000 level. If you don't, it will probably make many tactical mistakes.
Sounds like something that would be fun to play against. If I run giraffe and tell it to search depth 0, will that simulate the policy network reasonably well?
That wouldn't work unfortunately. It would still do a QSearch. The move evaluator network is also only trained on quiet moves.