ChessUSA.com TalkChess.com
Hosted by Your Move Chess & Games
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

Advantage for White; Bayeselo (to Rémi Coulom)
Post new topic    TalkChess.com Forum Index -> Computer Chess Club: Programming and Technical Discussions Flat
View previous topic :: View next topic  
Author Message
H.G.Muller



Joined: 10 Mar 2006
Posts: 12765
Location: Amsterdam

PostPost subject: Re: Advantage for White; Bayeselo (to Rémi Coulom)    Posted: Sun Mar 04, 2012 10:44 am Reply to topic Reply with quote

Thanks, Edmund! This is really interesting and important data. For one, it shows that the Sonas observation, that a linear model gives a better fit than Gaussian or Logistic, holds for computer games as well.

A second point is that the draw probability vs Elo-difference looks like a parabola, i.e. it seems indeed proportional to the product score(deltaE)*(1-score(deltaE)). This indeed justifies the analysis of BayesElo, where a single draw is equivalent to one win + one loss (i.e. counts as 2 games).

Some remarks: it seems the horizontal resolution of your graphs is higher than needed, considering the vertical spread of the data points. It would be better to increase the bin size by at least a factor 4 (or apply some other form of smoothing); this would reduce the vertical spread by a factor 2, without visibly increasing horizontal uncertainty.

Perhaps you should use extra large Elo bins in the tails, where there you have only 2 or 3 data points per bin now, so that the percentages quantize to 50% or 33%, not contributing anything to visible estimation of how the curve looks. (Perhaps you should just combine bins until they have a certain minimum number of games, keeping track of average Elo (difference) as well as average score / drawRate.

I get the impression that the draw vs. average Elo graph would be better fitted by a line with a break in it around 2950, first sloping up, and then saturating at about 42%.

One would have to guard for systematic errors: the points at the high end of the average Elo scale are likely to be due to games with low Elo difference between the participants. And from the Elo difference graph we can see that the draw rate goes up if the Elo difference is small. So part of the increase of the draw rate could be due to that. So I think it would be useful to also calculate the variance of Elo difference as a function of average Elo. If there is significant variation of that across the scale, the contribution of variance to suppression of draws (as known from the second graph) could be used to correct the observed draw rate for sampling bias.
Back to top
View user's profile Send private message Visit poster's website
Display posts from previous:   
Subject Author Date/Time
Advantage for White; Bayeselo (to Rémi Coulom) Edmund Moshammer Sat Mar 03, 2012 11:22 pm
      Re: Advantage for White; Bayeselo (to Rémi Coulom) H.G.Muller Sun Mar 04, 2012 6:56 am
            Re: Advantage for White; Bayeselo (to Rémi Coulom) Edmund Moshammer Sun Mar 04, 2012 8:49 am
                  Re: Advantage for White; Bayeselo (to Rémi Coulom) H.G.Muller Sun Mar 04, 2012 10:44 am
                        Re: Advantage for White; Bayeselo (to Rémi Coulom) Lucas Braesch Sun Mar 04, 2012 11:06 am
                              Re: Advantage for White; Bayeselo (to Rémi Coulom) H.G.Muller Sun Mar 04, 2012 11:29 am
                        Re: Advantage for White; Bayeselo (to Rémi Coulom) Edmund Moshammer Sun Mar 04, 2012 2:42 pm
                              Re: Advantage for White; Bayeselo (to Rémi Coulom) Edmund Moshammer Sun Mar 04, 2012 2:52 pm
                              Re: Advantage for White; Bayeselo (to Rémi Coulom) H.G.Muller Sun Mar 04, 2012 3:26 pm
                                    Re: Advantage for White; Bayeselo (to Rémi Coulom) Edmund Moshammer Sun Mar 04, 2012 4:13 pm
                                          Re: Advantage for White; Bayeselo (to Rémi Coulom) H.G.Muller Sun Mar 04, 2012 4:33 pm
                                                Re: Advantage for White; Bayeselo (to Rémi Coulom) Edmund Moshammer Sun Mar 04, 2012 5:18 pm
                                    Re: Advantage for White; Bayeselo (to Rémi Coulom) Adam Hair Sat Jun 30, 2012 11:00 pm
                                          Re: Advantage for White; Bayeselo (to Rémi Coulom) Adam Hair Mon Jul 02, 2012 1:25 pm
                              Re: Advantage for White; Bayeselo (to Rémi Coulom) Adam Hair Sun Jul 01, 2012 3:48 am
                                    Re: Advantage for White; Bayeselo (to Rémi Coulom) Adam Hair Sun Jul 01, 2012 8:47 pm
                                          Re: Advantage for White; Bayeselo (to Rémi Coulom) Edmund Moshammer Sun Jul 01, 2012 9:55 pm
                                                Re: Advantage for White; Bayeselo (to Rémi Coulom) Adam Hair Mon Jul 02, 2012 12:37 am
                                                      Re: Advantage for White; Bayeselo (to Rémi Coulom) Adam Hair Mon Jul 02, 2012 1:27 pm
                        Re: Advantage for White; Bayeselo (to Rémi Coulom) Marco Costalba Sun Jul 01, 2012 7:17 am
      Re: Advantage for White; Bayeselo (to Rémi Coulom) Lucas Braesch Sun Mar 04, 2012 8:53 am
      Re: Advantage for White; Bayeselo (to Rémi Coulom) Daniel Shawul Sun Mar 04, 2012 12:01 pm
      Re: Advantage for White; Bayeselo (to Rémi Coulom) Rémi Coulom Sun Mar 04, 2012 1:29 pm
            Re: Advantage for White; Bayeselo (to Rémi Coulom) H.G.Muller Sun Mar 04, 2012 2:20 pm
                  Re: Advantage for White; Bayeselo (to Rémi Coulom) Rémi Coulom Sun Mar 04, 2012 3:52 pm
                        Re: Advantage for White; Bayeselo (to Rémi Coulom) H.G.Muller Sun Mar 04, 2012 4:12 pm
                              Re: Advantage for White; Bayeselo (to Rémi Coulom) Rémi Coulom Sun Mar 04, 2012 5:13 pm
                                    Re: Advantage for White; Bayeselo (to Rémi Coulom) H.G.Muller Sun Mar 04, 2012 5:27 pm
                                          Re: Advantage for White; Bayeselo (to Rémi Coulom) Rémi Coulom Sun Mar 04, 2012 5:32 pm
      Re: Advantage for White; Bayeselo (to Rémi Coulom) Daniel Shawul Wed Sep 12, 2012 12:18 am
Post new topic    TalkChess.com Forum Index -> Computer Chess Club: Programming and Technical Discussions

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum




Powered by phpBB © 2001, 2005 phpBB Group
Enhanced with Moby Threads