ChessUSA.com TalkChess.com
Hosted by Your Move Chess & Games
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

Number 1 engine on long time controls
Post new topic    TalkChess.com Forum Index -> Computer Chess Club: General Topics Flat
View previous topic :: View next topic  
Author Message
Don Dailey



Joined: 29 Apr 2008
Posts: 4493
PostPost subject: Re: Number 1 engine on long time controls    Posted: Thu Mar 01, 2012 1:34 pm Reply to topic Reply with quote
diep wrote:
Small question: how many years did your slow laptop take to play 2000 games at those time controls?


To go through level 08 I figure it will take at least 4 months. However I changed things a bit with my new study because it's really a waste of CPU resources to play 00 vs 08, so now I am not allowing games between players more than 2 levels different. So 05 can play 04 and 03 but not 02. I had to restart the test of course.

Quote:


if 00 == 6 1 then level 05 == 192 minutes and some increment?

6 00
12 01
24 02
48 03
96 04
192 05

Better use a big cluster with hundreds of cores for the testing if you want to finish playing 2000 games like that within a few weeks.


Don wrote:
Kingghidorah wrote:
If you were asking about SP version then I would pick Komodo at those time controls on modern i7 or AMD hardware. Also, I would pick Houdini 1.5 over Houdini 2.0 at long time controls.


DOn why do u say that about 1.5 over 2.0, optimized better for longer time controls?


If you look at the lists you will notice that at the shorter time controls Houdini 2.0 is a big improvement, but at the longer time controls you see Houdini 1.5 catching up.

Anyone that pays attention can easily see that every program has different scaling characteristics. The Ippo clones clearly are dominant at fast time controls but stockfish starts to catch up at longer time controls. Our own internal testing makes this completely obvious - depending on the levels some program are sure to be stronger or weaker than others and it's consistent.

Here is an interesting study I'm doing, which shows Komodo scaling relative to Houdini 1.5:

Code:

                                                                                                           
Level where 00 is 6 + 0.1 and each successive level is double.                                             
                                                                                                           
                     Komodo                                                                               
            HOUDINI   gains                                                                               
            -------  ------                                                                               
 Level 00 -  +143.3                                                                                       
 Leval 01 -   +97.0   +46.3                                                                               
 Leval 02 -   +74.6   +22.4                                                                               
 Level 03 -   +52.8   +21.8                                                                               
 Level 04 -   +39.5   +13.3                                                                               
 Level 05 -   +27.0   +12.5                                                                               



This is a long running test on a slow laptop. Komodo gains several ELO relatively to Houdini for each successful doubling. There is still significant error in 2000 games (each level is 2000 games) so it's hard to be precise, but after 3 more doubling's Komodo will be winning against Houdini 1.5 if it picks up 10 more ELO each time. But the amount it gains per doubling appears to drop a bit with each doubling too so it's really difficult to predict the level at which Komodo is superior.

This is a development version of Komodo which is a little bit stronger than our release version.
[/quote]
_________________
The Optimist thinks this is the best of all possible worlds, the Pessimist fears it is true.
Back to top
View user's profile Send private message Send e-mail
Display posts from previous:   
Subject Author Date/Time
Number 1 engine on long time controls Teodoriu Catalin Fri Feb 24, 2012 7:17 pm
      Re: NUMBER 1 ENGINE ON LONG TIME CONTROLS Uri Blass Fri Feb 24, 2012 7:52 pm
            Re: NUMBER 1 ENGINE ON LONG TIME CONTROLS Teodoriu Catalin Sat Feb 25, 2012 8:02 am
      Re: Number 1 engine on long time controls Don Dailey Fri Feb 24, 2012 10:01 pm
            Re: Number 1 engine on long time controls Lonnie Cook Fri Feb 24, 2012 10:21 pm
                  Re: Number 1 engine on long time controls Don Dailey Fri Feb 24, 2012 11:16 pm
                        Re: Number 1 engine on long time controls Robert Houdart Fri Feb 24, 2012 11:40 pm
                              Re: Number 1 engine on long time controls Don Dailey Fri Feb 24, 2012 11:51 pm
                                    Re: Number 1 engine on long time controls Robert Houdart Sat Feb 25, 2012 12:13 am
                                          Re: Number 1 engine on long time controls Ignacio Garcia Sat Feb 25, 2012 12:29 am
                                          Re: Number 1 engine on long time controls Don Dailey Sat Feb 25, 2012 12:30 am
                                                Re: Number 1 engine on long time controls Tom Giampietro Sat Feb 25, 2012 1:05 am
                                                      Re: Number 1 engine on long time controls Don Dailey Sat Feb 25, 2012 1:40 am
                                                            Re: Number 1 engine on long time controls Robert Houdart Sat Feb 25, 2012 1:52 am
                                                                  Re: Number 1 engine on long time controls Peter Skinner Sat Feb 25, 2012 5:54 am
                                                            Re: Number 1 engine on long time controls Carl Bicknell Sat Feb 25, 2012 8:57 am
                                                                  Re: Number 1 engine on long time controls Ben-Hur Carlos Langoni Sat Feb 25, 2012 10:22 pm
                                                                        Re: Number 1 engine on long time controls Carl Bicknell Sun Feb 26, 2012 8:00 am
                                                                              Re: Number 1 engine on long time controls Ben-Hur Carlos Langoni Sun Feb 26, 2012 1:04 pm
                                                      Re: Number 1 engine on long time controls George Speight Sat Feb 25, 2012 9:37 am
                                                Re: Number 1 engine on long time controls Uri Blass Sun Feb 26, 2012 10:43 am
                                                      Re: Number 1 engine on long time controls Sedat Canbaz Sun Feb 26, 2012 11:54 am
                                                            Re: Number 1 engine on long time controls Ben-Hur Carlos Langoni Sun Feb 26, 2012 1:17 pm
                                                                  Re: Number 1 engine on long time controls Sedat Canbaz Sun Feb 26, 2012 2:05 pm
                                                                        Re: Number 1 engine on long time controls Sedat Canbaz Sun Feb 26, 2012 2:57 pm
                                                      Re: Number 1 engine on long time controls Don Dailey Sun Feb 26, 2012 1:57 pm
                                                            Re: Number 1 engine on long time controls Uri Blass Sun Feb 26, 2012 2:33 pm
                                                            Re: Number 1 engine on long time controls Ignacio Garcia Sun Feb 26, 2012 3:41 pm
                                                                  Re: Number 1 engine on long time controls Don Dailey Sun Feb 26, 2012 4:51 pm
                                                                        Re: Number 1 engine on long time controls Ignacio Garcia Sun Feb 26, 2012 5:34 pm
                                                                              Re: Number 1 engine on long time controls Ricardo Barreira Sun Feb 26, 2012 7:54 pm
                                                                        Re: Number 1 engine on long time controls Uri Blass Sun Feb 26, 2012 10:53 pm
                                                                              Re: Number 1 engine on long time controls Don Dailey Mon Feb 27, 2012 1:35 pm
                                                                                    Re: Number 1 engine on long time controls Jouni Uski Mon Feb 27, 2012 4:18 pm
                                                                                          Re: Number 1 engine on long time controls Robert Houdart Mon Feb 27, 2012 6:26 pm
                                                                                          Re: Number 1 engine on long time controls Don Dailey Mon Feb 27, 2012 6:50 pm
                                                                                          Re: Number 1 engine on long time controls Larry Kaufman Mon Feb 27, 2012 6:56 pm
                                                                                    Re: Number 1 engine on long time controls Milos Stanisavljevic Mon Feb 27, 2012 5:04 pm
                                                                                          Re: Number 1 engine on long time controls Milos Stanisavljevic Mon Feb 27, 2012 5:22 pm
                                                                                          Re: Number 1 engine on long time controls Larry Kaufman Mon Feb 27, 2012 6:31 pm
                                                                                          Re: Number 1 engine on long time controls Don Dailey Mon Feb 27, 2012 6:48 pm
                                                                              Re: Number 1 engine on long time controls Milos Stanisavljevic Mon Feb 27, 2012 4:52 pm
                                                                                    Re: Number 1 engine on long time controls Larry Kaufman Mon Feb 27, 2012 5:11 pm
                                                                                          Re: Number 1 engine on long time controls Milos Stanisavljevic Mon Feb 27, 2012 5:19 pm
                                                                                    Re: Number 1 engine on long time controls Don Dailey Mon Feb 27, 2012 5:35 pm
                                                                                          Re: Number 1 engine on long time controls Ignacio Garcia Mon Feb 27, 2012 5:58 pm
                                                                                          Re: Number 1 engine on long time controls Don Dailey Mon Feb 27, 2012 6:38 pm
                                                                                          Re: Number 1 engine on long time controls Ignacio Garcia Tue Feb 28, 2012 2:40 pm
                                                                                          Re: Number 1 engine on long time controls. Jesús Muñoz Tue Feb 28, 2012 3:06 pm
                                                                                          Re: Number 1 engine on long time controls Don Dailey Tue Feb 28, 2012 9:06 pm
                                                                                          Re: Number 1 engine on long time controls Ignacio Garcia Wed Feb 29, 2012 11:22 am
                                                                                    Re: Number 1 engine on long time controls. Jesús Muñoz Mon Feb 27, 2012 6:50 pm
                                                                                          Re: Number 1 engine on long time controls. Don Dailey Tue Feb 28, 2012 12:30 am
                                                                                          Re: Number 1 engine on long time controls. Jesús Muñoz Tue Feb 28, 2012 11:31 am
                                                                                          Re: Number 1 engine on long time controls. Don Dailey Tue Feb 28, 2012 11:57 am
                                                                                          Re: Number 1 engine on long time controls. Don Dailey Tue Feb 28, 2012 12:06 pm
                                                                                          Re: Number 1 engine on long time controls. Jouni Uski Tue Feb 28, 2012 2:10 pm
                                                                                          Re: Number 1 engine on long time controls. Don Dailey Tue Feb 28, 2012 8:31 pm
                                                                                          Re: Number 1 engine on long time controls. Bigler Tue Feb 28, 2012 4:52 pm
                                                                                          Re: Number 1 engine on long time controls. Larry Kaufman Tue Feb 28, 2012 4:58 pm
                                                                                          Re: Number 1 engine on long time controls. Bigler Tue Feb 28, 2012 5:03 pm
                                                                                          Re: Number 1 engine on long time controls. Larry Kaufman Tue Feb 28, 2012 5:46 pm
                                                                                          Re: Number 1 engine on long time controls. Terry McCracken Wed Feb 29, 2012 5:37 am
                                                                                          Re: Number 1 engine on long time controls. Carl Bicknell Wed Feb 29, 2012 9:19 am
                                                                                          Re: Number 1 engine on long time controls. Terry McCracken Wed Feb 29, 2012 5:49 pm
                                                                                          Re: Number 1 engine on long time controls. Dr.Wael Deeb Wed Feb 29, 2012 5:59 pm
                                                                                          Re: Number 1 engine on long time controls. Terry McCracken Thu Mar 01, 2012 4:52 am
                                                                                          Re: Number 1 engine on long time controls. Uri Blass Tue Feb 28, 2012 6:05 pm
                        Re: Number 1 engine on long time controls Bram Mourik Tue Feb 28, 2012 9:01 pm
                              Re: Number 1 engine on long time controls Don Dailey Tue Feb 28, 2012 9:30 pm
                                    Re: Number 1 engine on long time controls Dr.Wael Deeb Tue Feb 28, 2012 9:37 pm
                                    Re: Number 1 engine on long time controls Bram Mourik Wed Feb 29, 2012 5:58 pm
                                          Re: Number 1 engine on long time controls Don Dailey Wed Feb 29, 2012 6:25 pm
                                                Re: Number 1 engine on long time controls om prakash Thu Mar 01, 2012 7:00 am
                                          Re: Number 1 engine on long time controls enrico fagiuoli Wed Feb 29, 2012 8:43 pm
                        Re: Number 1 engine on long time controls Leon Coleman Wed Feb 29, 2012 5:23 am
                              Re: Number 1 engine on long time controls Don Dailey Wed Feb 29, 2012 12:47 pm
                        Re: Number 1 engine on long time controls Vincent Diepeveen Thu Mar 01, 2012 11:44 am
                              Re: Number 1 engine on long time controls Uri Blass Thu Mar 01, 2012 1:30 pm
                              Re: Number 1 engine on long time controls Don Dailey Thu Mar 01, 2012 1:34 pm
                                    Re: Number 1 engine on long time controls enrico fagiuoli Thu Mar 01, 2012 2:57 pm
                                          Re: Number 1 engine on long time controls Don Dailey Thu Mar 01, 2012 9:48 pm
                                                Re: Number 1 engine on long time controls enrico fagiuoli Fri Mar 02, 2012 11:09 am
                                                Re: Number 1 engine on long time controls Vincent Diepeveen Fri Mar 02, 2012 12:20 pm
                                                      Re: Number 1 engine on long time controls Don Dailey Fri Mar 02, 2012 12:26 pm
                                                            Re: Number 1 engine on long time controls Vincent Diepeveen Fri Mar 02, 2012 12:51 pm
                                                                  Re: Number 1 engine on long time controls Dr.Wael Deeb Fri Mar 02, 2012 12:55 pm
                                                                        Re: Number 1 engine on long time controls Don Dailey Fri Mar 02, 2012 1:49 pm
                                                                              Re: Number 1 engine on long time controls Dr.Wael Deeb Fri Mar 02, 2012 3:10 pm
                                                                                    Re: Number 1 engine on long time controls Don Dailey Fri Mar 02, 2012 3:30 pm
                                                                                          Re: Number 1 engine on long time controls Dr.Wael Deeb Fri Mar 02, 2012 3:43 pm
                                                                                          Re: Number 1 engine on long time controls Uri Blass Fri Mar 02, 2012 8:14 pm
                                                                                          Re: Number 1 engine on long time controls Dr.Wael Deeb Fri Mar 02, 2012 8:31 pm
                                                                                          Re: Number 1 engine on long time controls Uri Blass Fri Mar 02, 2012 8:45 pm
                                                                                          Re: Number 1 engine on long time controls Larry Kaufman Fri Mar 02, 2012 8:58 pm
                                                                                          Re: Number 1 engine on long time controls Dr.Wael Deeb Fri Mar 02, 2012 9:26 pm
                                                                                          Re: Number 1 engine on long time controls Dr.Wael Deeb Fri Mar 02, 2012 9:23 pm
                                                                                          Re: Number 1 engine on long time controls Carl Bicknell Fri Mar 02, 2012 5:41 pm
                                                                                          Re: Number 1 engine on long time controls Larry Kaufman Fri Mar 02, 2012 6:59 pm
                                                                                          Re: Number 1 engine on long time controls Dr.Wael Deeb Fri Mar 02, 2012 7:10 pm
                                                                                          Re: Number 1 engine on long time controls Carl Bicknell Sat Mar 03, 2012 3:49 pm
                                                                                          Re: Number 1 engine on long time controls Dr.Wael Deeb Sun Mar 04, 2012 8:36 am
                                                                  Re: Number 1 engine on long time controls Robert Flesher Fri Mar 02, 2012 9:28 pm
                                                                        Re: Number 1 engine on long time controls Dr.Wael Deeb Fri Mar 02, 2012 9:55 pm
                  Re: Number 1 engine on long time controls Jon Dart Sat Feb 25, 2012 9:09 pm
                        Re: Number 1 engine on long time controls Andrew R. Case Sat Feb 25, 2012 9:14 pm
      Re: Number 1 engine on long time controls Gabor Szots Thu Mar 01, 2012 2:19 pm
            Re: Number 1 engine on long time controls Larry Kaufman Thu Mar 01, 2012 3:21 pm
                  Re: Number 1 engine on long time controls om prakash Thu Mar 01, 2012 4:16 pm
                        Re: Number 1 engine on long time controls Larry Kaufman Thu Mar 01, 2012 4:51 pm
                              Re: Number 1 engine on long time controls om prakash Thu Mar 01, 2012 4:54 pm
                  Re: Number 1 engine on long time controls George Speight Sun Mar 04, 2012 9:42 am
                        Re: Number 1 engine on long time controls Jouni Uski Sun Mar 04, 2012 11:35 am
                              Re: Number 1 engine on long time controls Maurizio Maglio Sun Mar 04, 2012 11:41 am
            Re: Number 1 engine on long time controls Don Dailey Fri Mar 02, 2012 1:34 pm
Post new topic    TalkChess.com Forum Index -> Computer Chess Club: General Topics

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum




Powered by phpBB © 2001, 2005 phpBB Group
Enhanced with Moby Threads