Search found 2029 matches

by Michel
Wed Oct 16, 2019 7:01 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Understanding and Pushing the Limits of the Elo Rating Algorithm
Replies: 7
Views: 569

Re: Understanding and Pushing the Limits of the Elo Rating Algorithm

Let me try again: Paired comparison with ties You should probably contact them so that they can at least refer to your work. But I think there is essentially nothing in the paper. As you say k-elo seems to Davidson. The only thing that could be considered slightly original is that they identify the...
by Michel
Sun Sep 01, 2019 9:06 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: New Tool for Tuning with Skopt
Replies: 60
Views: 7417

Re: New Tool for Tuning with Skopt

Jorg, have you tried one of the other base estimators supported by skopt/tune? They might be faster. You can "RF", "ET" or "GBRT". I'll think of other ways to speed up for many games. Maybe something like running more than 2 games for every choice of parameters. But even inverting a 2000x2000 matri...
by Michel
Sat Aug 31, 2019 1:21 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: New Tool for Tuning with Skopt
Replies: 60
Views: 7417

Re: New Tool for Tuning with Skopt

Hello, It's a nice project, but i had issues: - ahash from log file should not consider number of games and even concurrency, that way would be easy to run a 200 game session run using 100 games from previous run. - Let me use options that are not seen as UCI options, i don't wanna to expose all po...
by Michel
Mon Aug 19, 2019 9:42 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: best way to determine elos of a group
Replies: 51
Views: 9357

Re: best way to determine elos of a group

The joinntdist was still running after 10 minutes before i had to stop it. I will try again later to see what kind of error bounds it produces compared to the full hessian inverse method which seem to be the better approach so far IMO. Well near its maximum the posterior is multivariate Gaussian bu...
by Michel
Wed Aug 07, 2019 8:13 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: best way to determine elos of a group
Replies: 51
Views: 9357

Re: best way to determine elos of a group

Ofcourse we can't totally remove elo inflation unless we do full round-robin tournaments. Just a tiny bit of nitpicking, since I think we basically agree. Elo inflation is not caused by the type of tournament. Elo inflation happens if the structure of the tournament is not fixed beforehand but depe...
by Michel
Tue Aug 06, 2019 3:35 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: best way to determine elos of a group
Replies: 51
Views: 9357

Re: best way to determine elos of a group

Things are going pretty smoothly now after adding "gating" to the training. Networks that failed to equal or beat previous version are not used for generating new games. In just 18k games, it gained 900 elo gradually and is surely learning piece values. It currently knows to capture when it has the...
by Michel
Sun Aug 04, 2019 9:11 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: best way to determine elos of a group
Replies: 51
Views: 9357

Re: best way to determine elos of a group

To add: The effort in the first, "naive" case, is 5000 games. In the second, uniformly spaced --- 8000 games. In the third, k^2 spaced --- 8000 games again. The effort with hundreds of nets will be only slightly, say 10% larger than the "naive" case, and the effort goes to "firm up" the anchors. Mo...
by Michel
Sat Aug 03, 2019 8:06 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: best way to determine elos of a group
Replies: 51
Views: 9357

Re: best way to determine elos of a group

What I propose will be much better than just serially testing successive IDs. But how close is it to the optimal use of resources, I don't know. It depends on particularities of the task to be accomplished. Hope Michel comes with something meaningful. Well if the goal is _really_ to determine for e...
by Michel
Fri Aug 02, 2019 7:37 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: best way to determine elos of a group
Replies: 51
Views: 9357

Re: best way to determine elos of a group

Of course for each new engine we can determine the prior engine ID-i it would be best to play against to get the lowest possible variance for the absolute elo (absolute elo=elo difference with ID-0). It is a trade off between the variance of ID-i and the elo difference of the new engine (which can b...