Neural networks for chess position evaluation- request

Discussion of chess software programming and technical issues.

Moderators: Harvey Williamson, Dann Corbit, hgm

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
brianr
Posts: 453
Joined: Thu Mar 09, 2006 2:01 pm

Re: Neural networks for chess position evaluation- request

Post by brianr » Thu Nov 23, 2017 2:50 pm

Don't you already have Zeta running most of the engine in the gpu?

But, It has been estimated that AGZ would take about 1,700 years of "typical" cpu/gpu time. Google burned about $25M.

There is a distributed effort for Go making quite good progress
https://github.com/gcp/leela-zero

GCP's prior work on "plain" Leela both in terms of playing and portability is most impressive.

smatovic
Posts: 1610
Joined: Wed Mar 10, 2010 9:18 pm
Location: Hamburg, Germany
Full name: Srdja Matovic
Contact:

Re: Neural networks for chess position evaluation- request

Post by smatovic » Thu Nov 23, 2017 3:15 pm

Don't you already have Zeta running most of the engine in the gpu?
Yes, but in this design it was not intended to query a NN during search....
maybe i have to ponder on this a bit.
But, It has been estimated that AGZ would take about 1,700 years of "typical" cpu/gpu time. Google burned about $25M.
Ups :-)

I just had the numbers of Giraffe in my mind, 3 days to one week for training on 12 core resp. 4 core machine.
There is a distributed effort for Go making quite good progress
Hmm,
maybe the chess community needs an commercial sponsor for the compute cycles for such an NN project.

--
Srdja

smatovic
Posts: 1610
Joined: Wed Mar 10, 2010 9:18 pm
Location: Hamburg, Germany
Full name: Srdja Matovic
Contact:

Re: Neural networks for chess position evaluation- request

Post by smatovic » Sun Apr 29, 2018 2:55 pm

Quote:
Don't you already have Zeta running most of the engine in the gpu?
Yes, but in this design it was not intended to query a NN during search....
maybe i have to ponder on this a bit.
So far i have implemented parallel search and a dummy NN in Zeta,
but it turns out that plain GPU assist approach like LC0,
seems the way to go.

My parallel search scales bad above 32 workers,
so it would be more efficient to do the search on CPU,
and use the GPU for neural network evaluation only,
that would utilize both of them better.

--
Srdja

fierz
Posts: 65
Joined: Mon Mar 07, 2016 3:41 pm
Location: Zürich, Switzerland
Contact:

Re: Neural networks for chess position evaluation- request

Post by fierz » Mon Apr 30, 2018 7:30 pm

Rémi Coulom wrote:I took a longer look at what you did. Max pooling is used for image recognition, but makes little sense for chess. You'll need several layers of convolutions before reducing the resolution. I would simply stack a dozen 3x3 convolutions, and then directly go to a couple scalar layers, without any max pooling.
How do you arrive at this conclusion? Is there any rule of thumb how to design the NN architecture? What would you do in 8x8 american checkers?

Post Reply