Page 1 of 3

A0 subtlety

Posted: Mon Feb 11, 2019 5:17 pm
by jackd
Was a set of input planes representing a position at time (t - T + 1) oriented for the side to move at time t or time (t - T + 1)?

Re: A0 subtlety

Posted: Mon Feb 11, 2019 6:08 pm
by Daniel Shawul
jackd wrote: Mon Feb 11, 2019 5:17 pm Was a set of input planes representing a position at time (t - T + 1) oriented for the side to move at time t or time (t - T + 1)?
All the history input planes are oriented for the current side to move, i.e. at time t.

Re: A0 subtlety

Posted: Thu Feb 14, 2019 4:28 pm
by chrisw
Daniel Shawul wrote: Mon Feb 11, 2019 6:08 pm
jackd wrote: Mon Feb 11, 2019 5:17 pm Was a set of input planes representing a position at time (t - T + 1) oriented for the side to move at time t or time (t - T + 1)?
All the history input planes are oriented for the current side to move, i.e. at time t.
Would it matter if they weren’t?
(That’s a serious question btw)

Re: A0 subtlety

Posted: Thu Feb 14, 2019 5:14 pm
by Daniel Shawul
chrisw wrote: Thu Feb 14, 2019 4:28 pm
Daniel Shawul wrote: Mon Feb 11, 2019 6:08 pm
jackd wrote: Mon Feb 11, 2019 5:17 pm Was a set of input planes representing a position at time (t - T + 1) oriented for the side to move at time t or time (t - T + 1)?
All the history input planes are oriented for the current side to move, i.e. at time t.
Would it matter if they weren’t?
(That’s a serious question btw)
I suppose not but it would make it a little bit harder because the network has to learn to flip the board
every step in the history. I do not think history planes matter much anyway to begin with.

Re: A0 subtlety

Posted: Thu Feb 14, 2019 6:44 pm
by chrisw
Daniel Shawul wrote: Thu Feb 14, 2019 5:14 pm
chrisw wrote: Thu Feb 14, 2019 4:28 pm
Daniel Shawul wrote: Mon Feb 11, 2019 6:08 pm
jackd wrote: Mon Feb 11, 2019 5:17 pm Was a set of input planes representing a position at time (t - T + 1) oriented for the side to move at time t or time (t - T + 1)?
All the history input planes are oriented for the current side to move, i.e. at time t.
Would it matter if they weren’t?
(That’s a serious question btw)
I suppose not but it would make it a little bit harder because the network has to learn to flip the board
every step in the history. I do not think history planes matter much anyway to begin with.
I thought it would depend on how the convolution filters were tracking the data (in what order). Does it track 3x3 across each 8x8 map of chessboard cells, and then combine those outputs - so I suppose it must be best to combine a1 to a1 region and so on, rather than a1 to a8. Difficult to wrap head around.

Re: A0 subtlety

Posted: Thu Feb 14, 2019 11:55 pm
by AlvaroBegue
chrisw wrote: Thu Feb 14, 2019 6:44 pm
Daniel Shawul wrote: Thu Feb 14, 2019 5:14 pm
chrisw wrote: Thu Feb 14, 2019 4:28 pm
Daniel Shawul wrote: Mon Feb 11, 2019 6:08 pm
jackd wrote: Mon Feb 11, 2019 5:17 pm Was a set of input planes representing a position at time (t - T + 1) oriented for the side to move at time t or time (t - T + 1)?
All the history input planes are oriented for the current side to move, i.e. at time t.
Would it matter if they weren’t?
(That’s a serious question btw)
I suppose not but it would make it a little bit harder because the network has to learn to flip the board
every step in the history. I do not think history planes matter much anyway to begin with.
I thought it would depend on how the convolution filters were tracking the data (in what order). Does it track 3x3 across each 8x8 map of chessboard cells, and then combine those outputs - so I suppose it must be best to combine a1 to a1 region and so on, rather than a1 to a8. Difficult to wrap head around.
I agree with this. However, it's very likely that the history inputs are mostly irrelevant, as Daniel Shawul mentioned.

Re: A0 subtlety

Posted: Fri Feb 15, 2019 12:34 am
by chrisw
AlvaroBegue wrote: Thu Feb 14, 2019 11:55 pm
chrisw wrote: Thu Feb 14, 2019 6:44 pm
Daniel Shawul wrote: Thu Feb 14, 2019 5:14 pm
chrisw wrote: Thu Feb 14, 2019 4:28 pm
Daniel Shawul wrote: Mon Feb 11, 2019 6:08 pm
jackd wrote: Mon Feb 11, 2019 5:17 pm Was a set of input planes representing a position at time (t - T + 1) oriented for the side to move at time t or time (t - T + 1)?
All the history input planes are oriented for the current side to move, i.e. at time t.
Would it matter if they weren’t?
(That’s a serious question btw)
I suppose not but it would make it a little bit harder because the network has to learn to flip the board
every step in the history. I do not think history planes matter much anyway to begin with.
I thought it would depend on how the convolution filters were tracking the data (in what order). Does it track 3x3 across each 8x8 map of chessboard cells, and then combine those outputs - so I suppose it must be best to combine a1 to a1 region and so on, rather than a1 to a8. Difficult to wrap head around.
I agree with this. However, it's very likely that the history inputs are mostly irrelevant, as Daniel Shawul mentioned.
well, for me, it is clear that they, or some form of equivalence, are vital. Attempts at explanations have met with uniform blank looks or raised eyebrows, so I’ll just stick with this view, and we’ll see. It won’t be the first time.

Re: A0 subtlety

Posted: Fri Feb 15, 2019 9:06 pm
by jackd
If the input is always oriented for the side to move, then should the policy output also be mirrored for black? Like if the best move was g8f6 the policy output would b1c3?

Re: A0 subtlety

Posted: Fri Feb 15, 2019 9:58 pm
by Daniel Shawul
jackd wrote: Fri Feb 15, 2019 9:06 pm If the input is always oriented for the side to move, then should the policy output also be mirrored for black? Like if the best move was g8f6 the policy output would b1c3?
I always evaluate for white to move, so the board has to be flipped horizontally when it is black to move and ofcourse all moves are flipped as well
So g8f6 becomes g1f3 (not b1c3). Btw this has nothing to do with your original question of history planes.

@chrisw Good point on the a1->a8 mapping. Indeed the innder dot product over the volume (channels) will be messed up if the history planes are not aligned properly.

Re: A0 subtlety

Posted: Fri Feb 15, 2019 10:34 pm
by jackd
@Daniel Shawul

How strong is your policy network on it's own?