A0 subtlety
Moderators: hgm, Rebel, chrisw
-
- Posts: 25
- Joined: Mon Dec 10, 2018 2:45 pm
- Full name: jack d.
A0 subtlety
Was a set of input planes representing a position at time (t - T + 1) oriented for the side to move at time t or time (t - T + 1)?
-
- Posts: 4185
- Joined: Tue Mar 14, 2006 11:34 am
- Location: Ethiopia
Re: A0 subtlety
All the history input planes are oriented for the current side to move, i.e. at time t.
-
- Posts: 4319
- Joined: Tue Apr 03, 2012 4:28 pm
Re: A0 subtlety
Would it matter if they weren’t?Daniel Shawul wrote: ↑Mon Feb 11, 2019 6:08 pmAll the history input planes are oriented for the current side to move, i.e. at time t.
(That’s a serious question btw)
-
- Posts: 4185
- Joined: Tue Mar 14, 2006 11:34 am
- Location: Ethiopia
Re: A0 subtlety
I suppose not but it would make it a little bit harder because the network has to learn to flip the boardchrisw wrote: ↑Thu Feb 14, 2019 4:28 pmWould it matter if they weren’t?Daniel Shawul wrote: ↑Mon Feb 11, 2019 6:08 pmAll the history input planes are oriented for the current side to move, i.e. at time t.
(That’s a serious question btw)
every step in the history. I do not think history planes matter much anyway to begin with.
-
- Posts: 4319
- Joined: Tue Apr 03, 2012 4:28 pm
Re: A0 subtlety
I thought it would depend on how the convolution filters were tracking the data (in what order). Does it track 3x3 across each 8x8 map of chessboard cells, and then combine those outputs - so I suppose it must be best to combine a1 to a1 region and so on, rather than a1 to a8. Difficult to wrap head around.Daniel Shawul wrote: ↑Thu Feb 14, 2019 5:14 pmI suppose not but it would make it a little bit harder because the network has to learn to flip the boardchrisw wrote: ↑Thu Feb 14, 2019 4:28 pmWould it matter if they weren’t?Daniel Shawul wrote: ↑Mon Feb 11, 2019 6:08 pmAll the history input planes are oriented for the current side to move, i.e. at time t.
(That’s a serious question btw)
every step in the history. I do not think history planes matter much anyway to begin with.
-
- Posts: 931
- Joined: Tue Mar 09, 2010 3:46 pm
- Location: New York
- Full name: Álvaro Begué (RuyDos)
Re: A0 subtlety
I agree with this. However, it's very likely that the history inputs are mostly irrelevant, as Daniel Shawul mentioned.chrisw wrote: ↑Thu Feb 14, 2019 6:44 pmI thought it would depend on how the convolution filters were tracking the data (in what order). Does it track 3x3 across each 8x8 map of chessboard cells, and then combine those outputs - so I suppose it must be best to combine a1 to a1 region and so on, rather than a1 to a8. Difficult to wrap head around.Daniel Shawul wrote: ↑Thu Feb 14, 2019 5:14 pmI suppose not but it would make it a little bit harder because the network has to learn to flip the boardchrisw wrote: ↑Thu Feb 14, 2019 4:28 pmWould it matter if they weren’t?Daniel Shawul wrote: ↑Mon Feb 11, 2019 6:08 pmAll the history input planes are oriented for the current side to move, i.e. at time t.
(That’s a serious question btw)
every step in the history. I do not think history planes matter much anyway to begin with.
-
- Posts: 4319
- Joined: Tue Apr 03, 2012 4:28 pm
Re: A0 subtlety
well, for me, it is clear that they, or some form of equivalence, are vital. Attempts at explanations have met with uniform blank looks or raised eyebrows, so I’ll just stick with this view, and we’ll see. It won’t be the first time.AlvaroBegue wrote: ↑Thu Feb 14, 2019 11:55 pmI agree with this. However, it's very likely that the history inputs are mostly irrelevant, as Daniel Shawul mentioned.chrisw wrote: ↑Thu Feb 14, 2019 6:44 pmI thought it would depend on how the convolution filters were tracking the data (in what order). Does it track 3x3 across each 8x8 map of chessboard cells, and then combine those outputs - so I suppose it must be best to combine a1 to a1 region and so on, rather than a1 to a8. Difficult to wrap head around.Daniel Shawul wrote: ↑Thu Feb 14, 2019 5:14 pmI suppose not but it would make it a little bit harder because the network has to learn to flip the boardchrisw wrote: ↑Thu Feb 14, 2019 4:28 pmWould it matter if they weren’t?Daniel Shawul wrote: ↑Mon Feb 11, 2019 6:08 pmAll the history input planes are oriented for the current side to move, i.e. at time t.
(That’s a serious question btw)
every step in the history. I do not think history planes matter much anyway to begin with.
-
- Posts: 25
- Joined: Mon Dec 10, 2018 2:45 pm
- Full name: jack d.
Re: A0 subtlety
If the input is always oriented for the side to move, then should the policy output also be mirrored for black? Like if the best move was g8f6 the policy output would b1c3?
-
- Posts: 4185
- Joined: Tue Mar 14, 2006 11:34 am
- Location: Ethiopia
Re: A0 subtlety
I always evaluate for white to move, so the board has to be flipped horizontally when it is black to move and ofcourse all moves are flipped as well
So g8f6 becomes g1f3 (not b1c3). Btw this has nothing to do with your original question of history planes.
@chrisw Good point on the a1->a8 mapping. Indeed the innder dot product over the volume (channels) will be messed up if the history planes are not aligned properly.
-
- Posts: 25
- Joined: Mon Dec 10, 2018 2:45 pm
- Full name: jack d.
Re: A0 subtlety
@Daniel Shawul
How strong is your policy network on it's own?
How strong is your policy network on it's own?