Can computer vision be a cheaper alternative to smart chess boards?

[erdemdem]

I've been experimenting with an idea: instead of buying an expensive smart chess board, could a phone running computer vision provide a similar experience?

To test this, I built ChessGaze, which uses a phone mounted on a tripod to watch a real chess board. In the video, I'm playing the white pieces while the app controls the black pieces using Stockfish (set to around 700 Elo for this demo). After each of my moves, the app recognizes the new board position, calculates its response, highlights the move on the screen, and announces it aloud. I simply move the black pieces on the physical board as instructed.

The video is unedited—the pace is limited by how quickly I think and move the pieces, not by the computer vision or engine.

After the game, I exported the PGN directly to Lichess for analysis.

Game demo:
https://www.youtube.com/shorts/J85a5TdbFQ0

PGN export to Lichess:
https://www.youtube.com/shorts/ZbU10dX1IvA


App is completely free and available for IOS&Android download links can be found at
https://www.chessgaze.com/

My next goal is to explore whether the same computer vision technology can be useful for tournament organizers, for example by implementing a VAR-like review system for disputed positions and move verification.

I'm curious what the community thinks. Could computer vision eventually become a practical, low-cost alternative to dedicated smart chess boards for casual play, training, or even tournament assistance?

[peter]

Looks fine, thanks!
Can the app get maybe used by a PC and a webcam too?
Best

[erdemdem]

Thanks a lot.

I hope you can check the app out it means a lot to me. I am collecting and annotating my own matches for last 2 years.

Unfortunately desktop version does not exists. It is a cool idea though I can implement it in the future.

Currently my priority list:

- Respond the problems reported by users ASAP.
- Implement detecting CheckMate-StateMate to end the games automatically.
- Implement a VAR(Video Assistant Referee) by sending the short clips of the actual moves happened in the game.

Especially for the VAR I need to know what tournament organizers need for. I am trying to reach out my own chess federation(Denmark) I hope they will respond to me.

Best
Erdem