Transformers plays chess

[Sery]

Here is the new article (in Russian) named "The chess and a question about mindness of large language models" and the website where one can play with NN which was trained with text representation of games only.

Best regards,
Sergey Meus

[j.t.]

Interesting article, thanks!

[smatovic]

Thx, interesting.

As far as I got it, the Transformers language model is trained by PGN data and has to predict the next move as string in line, hence it is unknown what kind of internal representation it has of the chess board? Would be interesting if there is any way for an descriptive approach, describe the board state, so the NN has an internal representation, and maybe then can come up with some kind of chess playing logic, or alike.

--
Srdja

[Sery]

As far as I got it, the Transformers language model is trained by PGN data and has to predict the next move as string in line, hence it is unknown what kind of internal representation it has of the chess board?

Correct.

Would be interesting if there is any way for an descriptive approach, describe the board state, so the NN has an internal representation, and maybe then can come up with some kind of chess playing logic, or alike.

A similar idea came up several times in the comments to the article. I was hoping the author would answer on it, but she said nothing. As far as I understand the goal was to investigate how good the transformer can play after learning on a good dataset,

Regards,

[Andrew]

I was hoping this would be about the robots!

Oh well, maybe a successor to Battlechess (had this on the Amiga all those years ago...)

Andrew