ChessUSA.com TalkChess.com
Hosted by Your Move Chess & Games
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

open source battle IvanHoe v Stockfish at long time-control
Post new topic    TalkChess.com Forum Index -> Computer Chess Club: Tournaments and Matches Flat
View previous topic :: View next topic  
Author Message
Don Dailey



Joined: 29 Apr 2008
Posts: 4497
PostPost subject: Re: open source battle IvanHoe v Stockfish at long time-cont    Posted: Sun May 06, 2012 1:05 am Reply to topic Reply with quote
PawnStormZ wrote:
Don wrote:
Jouni wrote:
I have feeling 200 games was overkill. In first 100 games SF won 52-48 and last 100 it won 50,5-49,5. Did it give any new information to us, I doubt..


I expected Stockfish to win this match because it was longer time control. A faster match Ivanhoe would have won and a really fast match Ivanhoe would have won big.

 
                   You know Don, lately I have been wondering what, if anything, these "tests" actually tell us.
 
                   I had become interested in all the Ivanhoe versions and wanted to see which was the strongest.  I ran a tourney of 2800 30-second +1sec games among 8 of the versions that I had.  I took the top 4 and then re-ran (15 sec games) and got 2 to "test" further (B52aF and B46fC if anyone cares).

                   I decided to try and play with the many parameter settings to see if I could make the engine stronger.  I made a copy of B52aF and started changing settings and playing matches against a default version of the same engine.  These were 400 game matches at 5 seconds +0.25.

                   Most of the changes resulted in a close loss: 5 or 6 games. Then I found one that won by 18 games.  I thought I was "on to something" and made further changes which fell back to losing.  I wanted to get back to my "winner" and try something else but something told me to first try the exact same changes that won, to see if they won by a similar margin a second time.
 
                   Let me say that all the matches were run using exactly the same conditions, and the openings were even played in the same order.  Guess what?  NO improvement by my modifyed version the 2nd time; it even lost by 4 or 5 games!  I know you "statistics guys" are probably laughing at me, but I was truly surprised (and disappointed by what this means for test results).
 
                   So, if a 400 game match could end so differently using the exact same conditions, then my 200 game match between Stockfish and IvanHoe which ended only +5 for SF probably does not mean anything at all!  If the same match were run again, it might end up with Ivan winning by 8.  Some of the changes that I made to Ivan which "failed" may just as well have shown as "better" if the matches were re-run, so what did I "learn"?
 
                   Does anyone have any "facts" on how many games are really needed to get "meaningful" results?  I know Bob Hyatt runs 30,000 games to test things but even if the game lasted only 1 minute that would take 3 weeks of 24\7 to test just one change (lacking a cluster here  Smile ).  Some changes (like split-depth?) probably need longer games to see the full effect.
 
                   Is there even any point in publishing results from 400 or 500 game matches, let alone the 20 or 50 game ones that are common here; does it give us any "information" at all?    Sad
 


Running matches to determine which program is strongest when they are pretty close really takes a lot of games, 500 is something like 2 orders of magnitude too few. You need 50,000 games if there is something like 5 ELO or less.

I shake my head when I see 10 or even 100 games matches reported here. If a program is 50 or 100 ELO stronger, you don't need many games to prove that of course.

But that is why programs like elostat and bayeselo report error margins. In simple terms this tries to give you a sense of how confident you can be in the results. Typically the error margin is based on a confidence of 95% - in order words if bayeselo reports -15 +15 for the error margins and reports an ELO rating of 2850, it means that with 95% confidence the "true" rating is in the range 2850-15, 2850+15 or 2835 to 2865. Another way to see this is that there is still a 5% change the rating is more than 15 points different than the reported rating - it might be at least 15 ELO weaker or 15 stronger.

To complicate this further you have to realize that each program in the test has an error margin too so it's actually worse than that! Since both programs have a 5% chance of being off by 15 ELO there is MORE than a 5% chance that the DIFFERENCE is greater than 15 ELO.

What makes people tend to not believe the error margins is the fact that it's more likely to be off a little than a lot - which fools people into thinking they don't need big samples. So even though the error margin might be +/- 30 ELO there is a pretty good chance it's off by less than 10 ELO in any given test. So when these low sample tests return a more or less correct result people tend to think that this error margin business is just a lot of nonsense, but they are making a big mistake. It's sort of like thinking that Russian Roulette is safe because you played twice and nothing bad happened.

This makes improving a program very difficult because it take tens of thousands of games to resolve a small improvement. That is why we have to test at very fast levels, we really have no choice unless we want to take a week or two to thoroughly test each change. Fortunately most fast tests correlate well to long time controls, if that were not the case you would not see such rapid progress in chess programs. If these tests did not correlate well we would be forced to test at long time controls and progress would slow to a crawl.
_________________
The Optimist thinks this is the best of all possible worlds, the Pessimist fears it is true.
Back to top
View user's profile Send private message Send e-mail
Display posts from previous:   
Subject Author Date/Time
open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Jan 24, 2012 5:45 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Jan 24, 2012 5:47 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Jan 24, 2012 5:48 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Jan 24, 2012 5:49 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Jan 24, 2012 5:50 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Jan 24, 2012 5:50 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Jan 24, 2012 5:51 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Jan 24, 2012 5:52 am
            open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Jan 24, 2012 6:00 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Wed Jan 25, 2012 12:28 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Wed Jan 25, 2012 12:29 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Wed Jan 25, 2012 12:30 am
            open source battle IvanHoe v Stockfish at long time-control pal larkin Wed Jan 25, 2012 12:34 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Jan 26, 2012 6:24 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Jan 26, 2012 6:25 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Jan 26, 2012 6:26 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Jan 26, 2012 6:27 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Jan 26, 2012 6:28 am
            open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Jan 26, 2012 6:31 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Fri Jan 27, 2012 1:05 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Fri Jan 27, 2012 1:06 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Fri Jan 27, 2012 1:08 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Fri Jan 27, 2012 1:09 am
            open source battle IvanHoe v Stockfish at long time-control pal larkin Fri Jan 27, 2012 1:14 am
                  Re: open source battle IvanHoe v Stockfish at long time-cont George Speight Fri Jan 27, 2012 3:45 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Jan 28, 2012 4:13 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Jan 28, 2012 4:15 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Jan 28, 2012 4:16 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Jan 28, 2012 4:17 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Jan 28, 2012 4:18 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Jan 28, 2012 4:19 pm
            open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Jan 28, 2012 4:23 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Jan 29, 2012 6:36 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Jan 29, 2012 6:37 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Jan 29, 2012 6:39 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Jan 29, 2012 6:40 pm
            open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Jan 29, 2012 6:44 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Jan 31, 2012 4:56 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Jan 31, 2012 4:57 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Jan 31, 2012 5:00 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Jan 31, 2012 5:01 am
            open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Jan 31, 2012 5:11 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Wed Feb 01, 2012 1:31 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Wed Feb 01, 2012 1:32 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Wed Feb 01, 2012 1:33 am
            open source battle IvanHoe v Stockfish at long time-control pal larkin Wed Feb 01, 2012 1:37 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Feb 02, 2012 5:38 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Feb 02, 2012 5:41 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Feb 02, 2012 5:42 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Feb 02, 2012 5:43 am
            open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Feb 02, 2012 5:50 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Fri Feb 03, 2012 5:02 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Fri Feb 03, 2012 5:05 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Fri Feb 03, 2012 5:08 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Fri Feb 03, 2012 5:12 am
            open source battle IvanHoe v Stockfish at long time-control pal larkin Fri Feb 03, 2012 5:21 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Feb 04, 2012 7:03 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Feb 04, 2012 7:05 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Feb 04, 2012 7:08 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Feb 04, 2012 7:10 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Feb 04, 2012 7:11 pm
            open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Feb 04, 2012 7:15 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Mon Feb 06, 2012 4:20 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Mon Feb 06, 2012 4:21 am
            open source battle IvanHoe v Stockfish at long time-control pal larkin Mon Feb 06, 2012 4:29 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Wed Feb 08, 2012 3:08 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Wed Feb 08, 2012 3:09 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Wed Feb 08, 2012 3:10 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Wed Feb 08, 2012 3:11 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Wed Feb 08, 2012 3:13 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Wed Feb 08, 2012 3:14 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Wed Feb 08, 2012 3:15 am
            open source battle IvanHoe v Stockfish at long time-control pal larkin Wed Feb 08, 2012 3:19 am
                  open source battle IvanHoe v Stockfish at long time-control pal larkin Fri Feb 10, 2012 1:13 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Feb 11, 2012 6:29 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Feb 11, 2012 6:30 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Feb 11, 2012 6:32 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Feb 11, 2012 6:33 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Feb 11, 2012 6:35 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Feb 11, 2012 6:36 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Feb 11, 2012 6:37 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Feb 11, 2012 6:38 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Feb 11, 2012 6:40 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Feb 11, 2012 6:42 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Feb 11, 2012 6:44 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Feb 11, 2012 6:46 pm
            open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Feb 11, 2012 6:50 pm
                  open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Feb 11, 2012 6:57 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Mon Feb 13, 2012 6:19 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Mon Feb 13, 2012 6:20 am
            open source battle IvanHoe v Stockfish at long time-control pal larkin Mon Feb 13, 2012 6:24 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Feb 14, 2012 4:50 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Feb 14, 2012 4:52 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Feb 14, 2012 4:53 am
            open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Feb 14, 2012 4:57 am
            Re: open source battle IvanHoe v Stockfish at long time-cont Bram Mourik Tue Feb 14, 2012 6:50 pm
                  Re: open source battle IvanHoe v Stockfish at long time-cont Dr.Wael Deeb Tue Feb 14, 2012 6:58 pm
                        Re: open source battle IvanHoe v Stockfish at long time-cont Bram Mourik Wed Feb 15, 2012 5:09 pm
                              Re: open source battle IvanHoe v Stockfish at long time-cont Dr.Wael Deeb Wed Feb 15, 2012 7:00 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Feb 16, 2012 12:49 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Feb 16, 2012 12:50 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Feb 16, 2012 12:51 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Feb 16, 2012 12:52 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Feb 16, 2012 12:54 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Feb 16, 2012 12:55 am
            open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Feb 16, 2012 12:59 am
                  open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Feb 16, 2012 1:08 am
                        Re: open source battle IvanHoe v Stockfish at long time-cont Bram Mourik Fri Feb 17, 2012 8:36 pm
                              open source battle IvanHoe v Stockfish at long time-cont pal larkin Sat Feb 18, 2012 9:37 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Fri Feb 17, 2012 5:33 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Fri Feb 17, 2012 5:34 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Fri Feb 17, 2012 5:35 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Fri Feb 17, 2012 5:36 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Fri Feb 17, 2012 5:44 am
            open source battle IvanHoe v Stockfish at long time-control pal larkin Fri Feb 17, 2012 5:47 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Feb 19, 2012 4:49 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Feb 19, 2012 4:50 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Feb 19, 2012 4:51 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Feb 19, 2012 4:52 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Feb 19, 2012 4:53 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Feb 19, 2012 4:54 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Feb 19, 2012 4:55 am
            open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Feb 19, 2012 4:59 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Mon Feb 20, 2012 5:38 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Mon Feb 20, 2012 5:39 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Mon Feb 20, 2012 5:41 pm
            open source battle IvanHoe v Stockfish at long time-control pal larkin Mon Feb 20, 2012 6:17 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Feb 23, 2012 1:00 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Feb 23, 2012 1:01 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Feb 23, 2012 1:03 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Feb 23, 2012 1:04 am
            open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Feb 23, 2012 1:09 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Feb 26, 2012 3:06 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Feb 26, 2012 3:07 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Feb 26, 2012 3:08 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Feb 26, 2012 3:09 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Feb 26, 2012 3:10 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Feb 26, 2012 3:16 am
            open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Feb 26, 2012 3:46 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Feb 26, 2012 10:10 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Feb 26, 2012 10:11 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Feb 26, 2012 10:12 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Feb 26, 2012 10:13 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Feb 26, 2012 10:14 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Feb 26, 2012 10:15 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Feb 26, 2012 10:16 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Feb 26, 2012 10:17 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Feb 26, 2012 10:18 pm
            open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Feb 26, 2012 10:22 pm
                  open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Feb 26, 2012 10:26 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Feb 28, 2012 4:44 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Feb 28, 2012 4:45 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Feb 28, 2012 4:56 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Feb 28, 2012 4:57 am
            open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Feb 28, 2012 5:04 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Wed Feb 29, 2012 5:01 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Wed Feb 29, 2012 5:02 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Wed Feb 29, 2012 5:03 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Wed Feb 29, 2012 5:04 am
            open source battle IvanHoe v Stockfish at long time-control pal larkin Wed Feb 29, 2012 5:06 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Mar 01, 2012 4:41 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Mar 01, 2012 4:41 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Mar 01, 2012 4:42 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Mar 01, 2012 4:43 am
            open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Mar 01, 2012 4:46 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Mar 03, 2012 6:32 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Mar 03, 2012 6:34 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Mar 03, 2012 6:35 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Mar 03, 2012 6:36 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Mar 03, 2012 7:16 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Mar 03, 2012 7:17 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Mar 03, 2012 7:18 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Mar 03, 2012 7:20 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Mar 03, 2012 7:21 pm
            open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Mar 03, 2012 7:25 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Mar 06, 2012 2:18 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Mar 06, 2012 2:21 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Mar 06, 2012 2:22 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Mar 06, 2012 2:24 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Mar 06, 2012 2:28 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Mar 06, 2012 2:29 am
            open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Mar 06, 2012 2:33 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Wed Mar 07, 2012 6:00 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Wed Mar 07, 2012 6:01 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Wed Mar 07, 2012 6:02 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Wed Mar 07, 2012 6:03 am
            open source battle IvanHoe v Stockfish at long time-control pal larkin Wed Mar 07, 2012 6:07 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Mar 08, 2012 5:06 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Mar 08, 2012 5:07 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Mar 08, 2012 5:08 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Mar 08, 2012 5:09 am
            open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Mar 08, 2012 5:12 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Fri Mar 09, 2012 6:30 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Fri Mar 09, 2012 6:31 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Fri Mar 09, 2012 6:32 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Fri Mar 09, 2012 6:33 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Fri Mar 09, 2012 6:34 am
            open source battle IvanHoe v Stockfish at long time-control pal larkin Fri Mar 09, 2012 6:37 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Mar 11, 2012 11:49 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Mar 11, 2012 11:50 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Mar 11, 2012 11:51 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Mar 11, 2012 11:52 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Mar 11, 2012 11:53 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Mar 11, 2012 11:54 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Mar 11, 2012 11:55 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Mar 11, 2012 11:56 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sun Mar 11, 2012 11:57 pm
            open source battle IvanHoe v Stockfish at long time-control pal larkin Mon Mar 12, 2012 12:01 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Mar 13, 2012 4:10 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Mar 13, 2012 4:11 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Mar 13, 2012 4:12 am
            open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Mar 13, 2012 4:15 am
                  Re: open source battle IvanHoe v Stockfish at long time-cont Jouni Uski Tue Mar 13, 2012 2:04 pm
                        open source battle IvanHoe v Stockfish at long time-cont pal larkin Tue Mar 13, 2012 5:38 pm
                              Re: open source battle IvanHoe v Stockfish at long time-cont gerold daniels Wed Mar 14, 2012 3:17 am
                                    open source battle IvanHoe v Stockfish at long time-cont pal larkin Wed Mar 14, 2012 6:23 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Wed Mar 14, 2012 6:24 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Wed Mar 14, 2012 6:25 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Wed Mar 14, 2012 6:26 am
            open source battle IvanHoe v Stockfish at long time-control pal larkin Wed Mar 14, 2012 6:29 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Mar 15, 2012 3:54 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Mar 15, 2012 3:55 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Mar 15, 2012 3:55 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Mar 15, 2012 3:57 am
            open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Mar 15, 2012 3:59 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Fri Mar 16, 2012 4:58 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Fri Mar 16, 2012 4:59 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Fri Mar 16, 2012 5:00 am
            open source battle IvanHoe v Stockfish at long time-control pal larkin Fri Mar 16, 2012 5:02 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Mar 17, 2012 4:08 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Mar 17, 2012 4:09 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Mar 17, 2012 4:10 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Mar 17, 2012 4:12 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Mar 17, 2012 4:14 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Mar 17, 2012 4:15 pm
            open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Mar 17, 2012 4:18 pm
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Mar 20, 2012 3:46 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Mar 20, 2012 3:47 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Mar 20, 2012 3:50 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Mar 20, 2012 3:52 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Mar 20, 2012 3:55 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Mar 20, 2012 3:56 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Mar 20, 2012 3:57 am
            open source battle IvanHoe v Stockfish at long time-control pal larkin Tue Mar 20, 2012 4:00 am
                  Re: open source battle IvanHoe v Stockfish at long time-cont Bram Mourik Tue Mar 20, 2012 7:39 pm
                        open source battle IvanHoe v Stockfish at long time-cont pal larkin Wed Mar 21, 2012 2:38 am
                        open source battle IvanHoe v Stockfish at long time-cont pal larkin Wed Mar 21, 2012 3:36 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Mar 22, 2012 12:07 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Mar 22, 2012 12:09 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Mar 22, 2012 12:10 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Mar 22, 2012 12:11 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Mar 22, 2012 12:12 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Mar 22, 2012 12:13 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Mar 22, 2012 12:15 am
            open source battle IvanHoe v Stockfish at long time-control pal larkin Thu Mar 22, 2012 12:19 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Mar 24, 2012 12:17 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Mar 24, 2012 12:18 am
      open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Mar 24, 2012 12:19 am
            open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Mar 24, 2012 12:33 am
                  Re: open source battle IvanHoe v Stockfish at long time-cont George Speight Sat Mar 24, 2012 3:03 am
                        open source battle IvanHoe v Stockfish at long time-cont pal larkin Sat Mar 24, 2012 4:36 pm
                              Re: open source battle IvanHoe v Stockfish at long time-cont George Speight Sun Mar 25, 2012 3:27 am
                                    open source battle IvanHoe v Stockfish at long time-cont pal larkin Wed Mar 28, 2012 2:11 am
                  Re: open source battle IvanHoe v Stockfish at long time-cont Jouni Uski Sat Mar 24, 2012 9:04 am
                        open source battle IvanHoe v Stockfish at long time-cont pal larkin Sat Mar 24, 2012 4:41 pm
                        Re: open source battle IvanHoe v Stockfish at long time-cont Don Dailey Fri May 04, 2012 3:54 pm
                              Re: open source battle IvanHoe v Stockfish at long time-cont Bram Mourik Sat May 05, 2012 8:43 am
                                    Re: open source battle IvanHoe v Stockfish at long time-cont Uri Blass Sat May 05, 2012 5:11 pm
                                          Re: open source battle IvanHoe v Stockfish at long time-cont Bram Mourik Sat May 05, 2012 5:29 pm
                              open source battle IvanHoe v Stockfish at long time-cont pal larkin Sun May 06, 2012 12:29 am
                                    Re: open source battle IvanHoe v Stockfish at long time-cont Don Dailey Sun May 06, 2012 1:05 am
                                          Re: open source battle IvanHoe v Stockfish at long time-cont Jesús Muñoz Sun May 06, 2012 4:45 pm
                                    Re: open source battle IvanHoe v Stockfish at long time-cont Ernest Bonnem Sun May 06, 2012 3:35 pm
                                          open source battle IvanHoe v Stockfish at long time-cont pal larkin Sun May 06, 2012 6:54 pm
                  Re: open source battle IvanHoe v Stockfish at long time-cont gerold daniels Sat Mar 24, 2012 12:54 pm
                        open source battle IvanHoe v Stockfish at long time-cont pal larkin Sat Mar 24, 2012 4:55 pm
                              Re: open source battle IvanHoe v Stockfish at long time-cont gerold daniels Sat Mar 24, 2012 11:51 pm
                  open source battle IvanHoe v Stockfish at long time-control pal larkin Sat Mar 24, 2012 6:20 pm
                        Re: open source battle IvanHoe v Stockfish at long time-cont Matthias Gemuh Sat Mar 24, 2012 7:05 pm
                              Re: open source battle IvanHoe v Stockfish at long time-cont Gabriel LEPERLIER Sat Mar 24, 2012 11:16 pm
                              open source battle IvanHoe v Stockfish at long time-cont pal larkin Wed Mar 28, 2012 2:06 am
                        Re: open source battle IvanHoe v Stockfish at long time-cont Ignacio Garcia Thu May 03, 2012 1:51 am
                  Re: open source battle IvanHoe v Stockfish at long time-cont Ylich Carlos Tue Mar 27, 2012 7:56 pm
                        open source battle IvanHoe v Stockfish at long time-cont pal larkin Wed Mar 28, 2012 2:13 am
Post new topic    TalkChess.com Forum Index -> Computer Chess Club: Tournaments and Matches

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum




Powered by phpBB © 2001, 2005 phpBB Group
Enhanced with Moby Threads