Anti-cheating
Moderators: hgm, Rebel, chrisw
-
- Posts: 45
- Joined: Mon Jan 04, 2021 4:12 pm
- Full name: Ted Wong
Anti-cheating
I'm looking for people who can help with anti-cheat detection or fraud detection in chess. The aim is to find out who has cheated in chess with an engine, while constructing a robust statistical framework to control the false positive rate like chess.com/lichess has achieved. It's going to be a paid job. Anyone interested or knowing someone who has expert knowledge on it, please DM me. Thanks
-
- Posts: 2283
- Joined: Sat Jun 02, 2012 2:13 am
-
- Posts: 11589
- Joined: Thu Mar 09, 2006 12:57 am
- Location: Birmingham UK
Re: Anti-cheating
This is "friendly discussion" rather than "expert help", but isn't detection of cheating mainly down to absence of shallow tactical errors?
Writing is the antidote to confusion.
It's not "how smart you are", it's "how are you smart".
Your brain doesn't work the way you want, so train it!
It's not "how smart you are", it's "how are you smart".
Your brain doesn't work the way you want, so train it!
-
- Posts: 511
- Joined: Sun Apr 26, 2020 11:40 pm
- Full name: Brian D. Smith
Re: Anti-cheating
From what I have read it is more than that. And think about it - slower time controls produce few (if any) 'shallow tactical errors' in a game or over the span of several and would provide the cheater with a pretty easy means of avoiding detection.
-
- Posts: 4367
- Joined: Fri Mar 10, 2006 5:23 am
- Location: http://www.arasanchess.org
Re: Anti-cheating
Really, the performance history tells you everything. On the chess servers, anyone who's winning regularly against computer opposition is cheating. Arasan some time ago played a series of games against a 2500+ GM and the GM lost all of them. Of course most players are lower-rated and will have even less chance. So just look at the rating and the win/loss record.
-
- Posts: 45
- Joined: Mon Jan 04, 2021 4:12 pm
- Full name: Ted Wong
Re: Anti-cheating
To me, anti-cheating is more than just checking engine similarity to played moves. It's what we call "fraud detection", very common in insurance and many other fields. Fraud detection takes many input features, engine similarity is simply just one of those features. Other features can be:
* Performance history
* Ability to not to blunder
* Correlations to the top N-th PV moves
* Ability to play well in high complex positions and its correlation with time-management
* etc etc.
We'd then form a statistical model such as frequentist and Bayesian from the features. If we use frequentist, the model would then tell us the probability of someone is cheating, assuming a null hypothesis no cheating occurred. We'd then control the false positive rates with something q-values.
Anti-cheating is much more than just computer engines PV scores.
* Performance history
* Ability to not to blunder
* Correlations to the top N-th PV moves
* Ability to play well in high complex positions and its correlation with time-management
* etc etc.
We'd then form a statistical model such as frequentist and Bayesian from the features. If we use frequentist, the model would then tell us the probability of someone is cheating, assuming a null hypothesis no cheating occurred. We'd then control the false positive rates with something q-values.
Anti-cheating is much more than just computer engines PV scores.
Last edited by scchess on Sun Sep 12, 2021 1:50 am, edited 2 times in total.
-
- Posts: 45
- Joined: Mon Jan 04, 2021 4:12 pm
- Full name: Ted Wong
Re: Anti-cheating
True, but what about players who cheat from FIDE 1000 to FIDE 1500?jdart wrote: ↑Sat Sep 11, 2021 7:27 pm Really, the performance history tells you everything. On the chess servers, anyone who's winning regularly against computer opposition is cheating. Arasan some time ago played a series of games against a 2500+ GM and the GM lost all of them. Of course most players are lower-rated and will have even less chance. So just look at the rating and the win/loss record.
-
- Posts: 45
- Joined: Mon Jan 04, 2021 4:12 pm
- Full name: Ted Wong
-
- Posts: 45
- Joined: Mon Jan 04, 2021 4:12 pm
- Full name: Ted Wong
Re: Anti-cheating
What I imagine, anti-cheating works like the dashboard we can all get from your own "Chess Insights" on lichess. Try it yourself. You will see lot's of statistics from your own games such as centipawn loss bucket. Lichess would of course know everybody's centipawn loss bucket. They could then aggregate all the statistics to form an average for each rating group.
From the number of games you play, it should be possible to form a statistical confidence how likely you are really in the rating group.
Now, if for any reason suddenly, your "centipawn loss bucket" outperforms most of the people in your rating group especially during a lichess tournamenet, they would know you cheat even you may not actually win the games (i.e. loss on time). Your WDL remains but they know you cheat.
From the number of games you play, it should be possible to form a statistical confidence how likely you are really in the rating group.
Now, if for any reason suddenly, your "centipawn loss bucket" outperforms most of the people in your rating group especially during a lichess tournamenet, they would know you cheat even you may not actually win the games (i.e. loss on time). Your WDL remains but they know you cheat.
-
- Posts: 1
- Joined: Wed Dec 20, 2017 4:24 am
Re: Anti-cheating
I think the interesting idea is to train a neural network to detect engine/human games. After you train it on a large enough dataset, it will be relatively easy to check statistics for false positives for such a network.