ChessUSA.com TalkChess.com
Hosted by Your Move Chess & Games
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

Critter 1.4a x64 SSE4 vs Houdini 2.0c Pro x64 match results
Post new topic    TalkChess.com Forum Index -> Computer Chess Club: Tournaments and Matches Flat
View previous topic :: View next topic  
Author Message
Robert Houdart



Joined: 15 Mar 2010
Posts: 1250
PostPost subject: Re: Critter 1.4a x64 SSE4 vs Houdini 2.0c Pro x64 match resu    Posted: Sun Mar 18, 2012 1:49 am Reply to topic Reply with quote
marijan wrote:
Hi, Robert! I see you are using term " variability and error margins in chess engine testing" Question for You: If I make test with reversible starting positions ( and I always do that ); are those " variability and error margins in chess engine testing" the same if I dont use reversible starting positions?


Regards!

I assume that with "reversible starting positions" you mean that the engines play each starting position twice, with white and black.

It's a complex matter. With reversed openings you increase the accuracy of the result, but you also increase the variance of the result.
The "accuracy" is increased because any bias for white or black is eliminated. By playing more and more games you will ultimately converge to the "correct" result.
The "variance" is larger because the 2 games from the same starting position will not be completely independent. This means that you'll need to play more games to reduce the uncertainty margins.

Robert
Back to top
View user's profile Send private message Visit poster's website
Display posts from previous:   
Subject Author Date/Time
Critter 1.4a x64 SSE4 vs Houdini 2.0c Pro x64 match results Brent M Fri Mar 16, 2012 2:50 pm
      Re: Critter 1.4a x64 SSE4 vs Houdini 2.0c Pro x64 match resu Robert Houdart Fri Mar 16, 2012 3:15 pm
            Re: Critter 1.4a x64 SSE4 vs Houdini 2.0c Pro x64 match resu Brent M Fri Mar 16, 2012 3:23 pm
                  Re: Critter 1.4a x64 SSE4 vs Houdini 2.0c Pro x64 match resu Robert Houdart Fri Mar 16, 2012 4:08 pm
                        Re: Critter 1.4a x64 SSE4 vs Houdini 2.0c Pro x64 match resu Adam Hair Sat Mar 17, 2012 1:02 pm
                              Re: Critter 1.4a x64 SSE4 vs Houdini 2.0c Pro x64 match resu Robert Houdart Sat Mar 17, 2012 2:27 pm
                                    Re: Critter 1.4a x64 SSE4 vs Houdini 2.0c Pro x64 match resu Marijan Stipancic jr Sat Mar 17, 2012 3:37 pm
                                          Re: Critter 1.4a x64 SSE4 vs Houdini 2.0c Pro x64 match resu Robert Houdart Sun Mar 18, 2012 1:49 am
                                                Re: Critter 1.4a x64 SSE4 vs Houdini 2.0c Pro x64 match resu Marijan Stipancic jr Sun Mar 18, 2012 2:19 am
                                                Re: Critter 1.4a x64 SSE4 vs Houdini 2.0c Pro x64 match resu Bram Mourik Sun Mar 18, 2012 11:03 am
                                                      Re: Critter 1.4a x64 SSE4 vs Houdini 2.0c Pro x64 match resu Robert Houdart Sun Mar 18, 2012 12:38 pm
                                    Re: Critter 1.4a x64 SSE4 vs Houdini 2.0c Pro x64 match resu Adam Hair Sat Mar 17, 2012 4:25 pm
                                          Re: Critter 1.4a x64 SSE4 vs Houdini 2.0c Pro x64 match resu Robert Houdart Sat Mar 17, 2012 7:32 pm
                                                Re: Critter 1.4a x64 SSE4 vs Houdini 2.0c Pro x64 match resu Adam Hair Sat Mar 17, 2012 9:43 pm
                                                      Re: Critter 1.4a x64 SSE4 vs Houdini 2.0c Pro x64 match resu Robert Houdart Sat Mar 17, 2012 10:43 pm
                                                            Re: Critter 1.4a x64 SSE4 vs Houdini 2.0c Pro x64 match resu Adam Hair Sun Mar 18, 2012 12:26 am
                        Re: Critter 1.4a x64 SSE4 vs Houdini 2.0c Pro x64 match resu Brent M Mon Mar 19, 2012 12:33 am
                              Re: Critter 1.4a x64 SSE4 vs Houdini 2.0c Pro x64 match resu Robert Houdart Mon Mar 19, 2012 11:38 am
                                    Re: Critter 1.4a x64 SSE4 vs Houdini 2.0c Pro x64 match resu Brent M Mon Mar 19, 2012 12:24 pm
                                          Re: Critter 1.4a x64 SSE4 vs Houdini 2.0c Pro x64 match resu Richard Vida Mon Mar 19, 2012 12:57 pm
                                                Re: Critter 1.4a x64 SSE4 vs Houdini 2.0c Pro x64 match resu Brent M Mon Mar 19, 2012 1:03 pm
                                                Critter 1.4a x64 SSE4 vs Houdini 2.0c Pro x64 match resu pal larkin Wed Mar 21, 2012 3:07 am
            Re: Critter 1.4a x64 SSE4 vs Houdini 2.0c Pro x64 match resu Richard Allbert Sun Mar 18, 2012 1:25 pm
                  Re: Critter 1.4a x64 SSE4 vs Houdini 2.0c Pro x64 match resu Robert Houdart Sun Mar 18, 2012 2:03 pm
                        Re: Critter 1.4a x64 SSE4 vs Houdini 2.0c Pro x64 match resu Richard Allbert Sun Mar 18, 2012 3:35 pm
                  Re: Critter 1.4a x64 SSE4 vs Houdini 2.0c Pro x64 match resu Dr.Wael Deeb Sun Mar 18, 2012 5:59 pm
Post new topic    TalkChess.com Forum Index -> Computer Chess Club: Tournaments and Matches

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum




Powered by phpBB © 2001, 2005 phpBB Group
Enhanced with Moby Threads