| View previous topic :: View next topic |
| Author |
Message |
Ingo Bauer
Joined: 09 Mar 2006 Posts: 1087 Location: Hamburg
|
Post subject: Re: CEGT - rating lists March 11th 2012 Posted: Sun Mar 18, 2012 2:11 pm |
|
|
| ThatsIt wrote: |
Even if you always use one and the same testset you
will never get the same result(s).
|
Not the same, but playing many games nearly the same (with my 2000+ games for sure much less than 5%).
| ThatsIt wrote: |
Do the following:
play a match Engine A vs Engine B with your testset.
After that reboot the machine and do exactly the same again.
I predict:
a.) you will not get the same result (+- 5%)
|
Hmm, it was around 5% with 100 games, my guess (not checked) is that I am below 5% with 150 now.
| ThatsIt wrote: |
b.) you will not get the same games (probably more than 10%-15% different games ?)
|
Actually I guess that I will get MUCH higher rates of different games!
But that is not the point. If you want a structured testing you have to have conditions which are repeatable (as good as possible, we all have to compromise sometimes but openings are not nessesary and do not belong to that compromise). If the engines decide to do something different, fine. If you "make" it different, that is a wrong concept of testing!
Bye
Ingo _________________ http://www.inwoba.de Latest IPON Rating List |
|
| Back to top |
|
 |
|
| Subject |
Author |
Date/Time |
CEGT - rating lists March 11th 2012 |
Werner Schüle |
Sun Mar 11, 2012 11:32 am |
Re: CEGT - rating lists March 11th 2012 |
Ingo Bauer |
Sun Mar 11, 2012 4:56 pm |
Re: CEGT - rating lists March 11th 2012 |
Werner Schüle |
Sun Mar 11, 2012 4:59 pm |
Re: CEGT - rating lists March 11th 2012 |
Gerhard Sonnabend |
Mon Mar 12, 2012 8:22 am |
Re: CEGT - rating lists March 11th 2012 |
Ingo Bauer |
Mon Mar 12, 2012 9:26 am |
Re: CEGT - rating lists March 11th 2012 |
Gerhard Sonnabend |
Mon Mar 12, 2012 10:38 am |
Re: CEGT - rating lists March 11th 2012 |
Ingo Bauer |
Mon Mar 12, 2012 11:04 am |
Re: CEGT - rating lists March 11th 2012 |
Gerhard Sonnabend |
Mon Mar 12, 2012 6:43 pm |
Re: CEGT - rating lists March 11th 2012 |
Ernest Bonnem |
Mon Mar 12, 2012 7:20 pm |
Re: CEGT - rating lists March 11th 2012 |
Gerhard Sonnabend |
Mon Mar 12, 2012 7:28 pm |
Re: CEGT - rating lists March 11th 2012 |
Ingo Bauer |
Sun Mar 18, 2012 2:01 pm |
Re: CEGT - rating lists March 11th 2012 |
Ingo Bauer |
Sun Mar 18, 2012 2:11 pm |
Re: CEGT - rating lists March 11th 2012 |
Gerhard Sonnabend |
Sun Mar 18, 2012 4:53 pm |
Re: CEGT - rating lists March 11th 2012 |
Ingo Bauer |
Sun Mar 18, 2012 5:36 pm |
Re: CEGT - rating lists March 11th 2012 |
Wolfgang Battig |
Mon Mar 12, 2012 2:41 pm |
Re: CEGT - rating lists March 11th 2012 |
George Speight |
Mon Mar 12, 2012 9:27 am |
Re: CEGT - rating lists March 11th 2012 |
Gerhard Sonnabend |
Mon Mar 12, 2012 7:16 pm |
Re: CEGT - rating lists March 11th 2012 |
Miguel A. Ballicora |
Sun Mar 11, 2012 5:17 pm |
Re: CEGT - rating lists March 11th 2012 |
Norm Pollock |
Sun Mar 18, 2012 3:28 pm |
|
You cannot post new topics in this forum You cannot reply to topics in this forum You cannot edit your posts in this forum You cannot delete your posts in this forum You cannot vote in polls in this forum
|
|