ChessUSA.com TalkChess.com
Hosted by Your Move Chess & Games
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

CEGT - rating lists March 11th 2012
Post new topic    TalkChess.com Forum Index -> Computer Chess Club: Tournaments and Matches Flat
View previous topic :: View next topic  
Author Message
Ingo Bauer



Joined: 09 Mar 2006
Posts: 1087
Location: Hamburg

PostPost subject: Re: CEGT - rating lists March 11th 2012    Posted: Sun Mar 18, 2012 2:11 pm Reply to topic Reply with quote

ThatsIt wrote:


Even if you always use one and the same testset you
will never get the same result(s).


Not the same, but playing many games nearly the same (with my 2000+ games for sure much less than 5%).

ThatsIt wrote:

Do the following:
play a match Engine A vs Engine B with your testset.
After that reboot the machine and do exactly the same again.
I predict:
a.) you will not get the same result (+- 5%)


Hmm, it was around 5% with 100 games, my guess (not checked) is that I am below 5% with 150 now.

ThatsIt wrote:

b.) you will not get the same games (probably more than 10%-15% different games ?)


Actually I guess that I will get MUCH higher rates of different games!

But that is not the point. If you want a structured testing you have to have conditions which are repeatable (as good as possible, we all have to compromise sometimes but openings are not nessesary and do not belong to that compromise). If the engines decide to do something different, fine. If you "make" it different, that is a wrong concept of testing!

Bye
Ingo
_________________
http://www.inwoba.de Latest IPON Rating List
Back to top
View user's profile Send private message Visit poster's website
Display posts from previous:   
Subject Author Date/Time
CEGT - rating lists March 11th 2012 Werner Schüle Sun Mar 11, 2012 11:32 am
      Re: CEGT - rating lists March 11th 2012 Ingo Bauer Sun Mar 11, 2012 4:56 pm
            Re: CEGT - rating lists March 11th 2012 Werner Schüle Sun Mar 11, 2012 4:59 pm
            Re: CEGT - rating lists March 11th 2012 Gerhard Sonnabend Mon Mar 12, 2012 8:22 am
                  Re: CEGT - rating lists March 11th 2012 Ingo Bauer Mon Mar 12, 2012 9:26 am
                        Re: CEGT - rating lists March 11th 2012 Gerhard Sonnabend Mon Mar 12, 2012 10:38 am
                              Re: CEGT - rating lists March 11th 2012 Ingo Bauer Mon Mar 12, 2012 11:04 am
                                    Re: CEGT - rating lists March 11th 2012 Gerhard Sonnabend Mon Mar 12, 2012 6:43 pm
                                          Re: CEGT - rating lists March 11th 2012 Ernest Bonnem Mon Mar 12, 2012 7:20 pm
                                                Re: CEGT - rating lists March 11th 2012 Gerhard Sonnabend Mon Mar 12, 2012 7:28 pm
                                                      Re: CEGT - rating lists March 11th 2012 Ingo Bauer Sun Mar 18, 2012 2:01 pm
                                          Re: CEGT - rating lists March 11th 2012 Ingo Bauer Sun Mar 18, 2012 2:11 pm
                                                Re: CEGT - rating lists March 11th 2012 Gerhard Sonnabend Sun Mar 18, 2012 4:53 pm
                                                      Re: CEGT - rating lists March 11th 2012 Ingo Bauer Sun Mar 18, 2012 5:36 pm
                        Re: CEGT - rating lists March 11th 2012 Wolfgang Battig Mon Mar 12, 2012 2:41 pm
                  Re: CEGT - rating lists March 11th 2012 George Speight Mon Mar 12, 2012 9:27 am
                        Re: CEGT - rating lists March 11th 2012 Gerhard Sonnabend Mon Mar 12, 2012 7:16 pm
      Re: CEGT - rating lists March 11th 2012 Miguel A. Ballicora Sun Mar 11, 2012 5:17 pm
      Re: CEGT - rating lists March 11th 2012 Norm Pollock Sun Mar 18, 2012 3:28 pm
Post new topic    TalkChess.com Forum Index -> Computer Chess Club: Tournaments and Matches

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum




Powered by phpBB © 2001, 2005 phpBB Group
Enhanced with Moby Threads