| View previous topic :: View next topic |
| Author |
Message |
Ted Wong
Joined: 01 Nov 2010
Posts: 236
|
 Posted: Tue Jun 05, 2012 12:31 pm Post subject: Best tool for estimating engine rating? |
  |
|
I want to run tournaments for estimating engine ratings. I have some reference engines with known ratings, I would like to estimate the performance for all other engines participated in the tournament (based on the reference engine). What would be the best tool for doing it?
For example, if my reference engine is 2000. And if my engine scores 50%, I expect the tool will give 2000 performance for my engine. |
|
| Back to top |
|
 |
H.G.Muller
Joined: 10 Mar 2006
Posts: 12763
Location: Amsterdam
|
| Posted: Tue Jun 05, 2012 12:34 pm Post subject: Re: Best tool for estimating engine rating? |
|
|
| BayesElo? |
|
| Back to top |
|
|
Ted Wong
Joined: 01 Nov 2010
Posts: 236
|
| Posted: Tue Jun 05, 2012 12:47 pm Post subject: Re: Best tool for estimating engine rating? |
|
|
| Nothing else for just running a match and reports the results? Rather than feeding the pgn games to the command tool? |
|
| Back to top |
|
|
Ricardo Barreira
Joined: 27 Apr 2010
Posts: 821
|
| Posted: Tue Jun 05, 2012 12:51 pm Post subject: Re: Best tool for estimating engine rating? |
|
|
| Why don't you make a simple script that runs the tournament and then runs bayeselo with the resulting pgn? |
|
| Back to top |
|
|
Ted Wong
Joined: 01 Nov 2010
Posts: 236
|
| Posted: Tue Jun 05, 2012 12:54 pm Post subject: Re: Best tool for estimating engine rating? |
|
|
| Well, I have been using Arena. I don't know how to batch it and send the pgn games to bayeselo. |
|
| Back to top |
|
|
Adam Hair
Joined: 06 May 2009
Posts: 1638
Location: Fuquay-Varina, North Carolina
|
| Posted: Tue Jun 05, 2012 1:07 pm Post subject: Re: Best tool for estimating engine rating? |
|
|
| kinderchocolate wrote: |
I want to run tournaments for estimating engine ratings. I have some reference engines with known ratings, I would like to estimate the performance for all other engines participated in the tournament (based on the reference engine). What would be the best tool for doing it?
For example, if my reference engine is 2000. And if my engine scores 50%, I expect the tool will give 2000 performance for my engine. |
EloStat 1.3
Bayeselo
Ordo
All three should rate your engine at 2000 given the stated condition. Overall, I suspect Bayeselo is the most accurate if the additional options are used. But, Miguel Ballicora's program Ordo is also very good. I use Bayeselo simply out of habit and familiarity.
_________________
Adam's Computer Chess Pages |
|
| Back to top |
|
|
Adam Hair
Joined: 06 May 2009
Posts: 1638
Location: Fuquay-Varina, North Carolina
|
| Posted: Tue Jun 05, 2012 1:11 pm Post subject: Re: Best tool for estimating engine rating? |
|
|
| kinderchocolate wrote: |
| Well, I have been using Arena. I don't know how to batch it and send the pgn games to bayeselo. |
EloStat is built into Arena. Open the pgn with Arena and click on the EloStat button at the bottom of the database window (the window that appears when you open a pgn with Arena).
_________________
Adam's Computer Chess Pages |
|
| Back to top |
|
|
Thomas Petzke
Joined: 03 Mar 2011
Posts: 263
Location: Germany
|
| Posted: Tue Jun 05, 2012 4:07 pm Post subject: Re: Best tool for estimating engine rating? |
|
|
If you intend to run a large number of games cutechess is probably better than Arena and it gives you an ELO indication right away.
| Quote: |
Score of iCE 0.3 v2716 vs iCE 0.3 v2708: 166 - 173 - 175 [0.49] 514
Started game 515 of 600 (iCE 0.3 v2716 vs iCE 0.3 v2708)
Finished game 515 (iCE 0.3 v2716 vs iCE 0.3 v2708): * {No result}
Score of iCE 0.3 v2716 vs iCE 0.3 v2708: 166 - 173 - 175 [0.49] 514
ELO difference: -5
Finished match |
For a better estimate I use bayeselo as it also shows the error bar and stacks the new results with the previous results I had so far.
Thomas... |
|
| Back to top |
|
|
Gabriel LEPERLIER
Joined: 04 Feb 2012
Posts: 936
|
| Posted: Tue Jun 05, 2012 7:09 pm Post subject: Re: Best tool for estimating engine rating? |
|
|
Hello,
Is there a way to have an elo rating just with the results without PGN ? (I you lost some PGN for exemple)  |
|
| Back to top |
|
|
Robert Hyatt
Joined: 27 Feb 2006
Posts: 15816
Location: Birmingham, AL
|
| Posted: Tue Jun 05, 2012 7:34 pm Post subject: Re: Best tool for estimating engine rating? |
|
|
| gleperlier wrote: |
Hello,
Is there a way to have an elo rating just with the results without PGN ? (I you lost some PGN for exemple) |
If you have a file with the results, it is simple enough to write a program that will spit out some bogus PGN (no moves are required) that BayesElo will cheerfully read and process.
If you mean a tournament crosstable, might be a bit trickier to write, but still, if you know the outcome, producing PGN that matches that outcome is not hard at all... |
|
| Back to top |
|
|
|
FAQ
Search
Memberlist
Usergroups
Register
Profile
Log in to check your private messages
Log in
