TalkChess.com :: View topic - Komodo 5 release now available!

TalkChess.com
Hosted by Your Move Chess & Games

FAQ

Memberlist

Usergroups

Profile

Komodo 5 release now available!

TalkChess.com Forum Index -> Computer Chess Club: General Topics

View previous topic :: View next topic

Author

Message

Don Dailey

Joined: 29 Apr 2008
Posts: 4502

Post subject: Re: Komodo 5 release now available! Posted: Sat Jul 21, 2012 12:29 am

MM wrote:

Don wrote:

MM wrote:

If i am wrong i will apologize with Don and larry but i think this version has (if) a very little improvement compared to Komodo 4, i would say around 10 elo.

If it is so it is a very sad day for all computer chess lovers and the triumph of Robert Houdart.

Best Regards

We have MANY tester who have verified that Komodo 5 is much stronger than Komodo 4. This is based on thousands of games - and our own testing is showing over 30 ELO at 2+2 on very fast hardware - roughly equivalent to the IPON time control.

So I trust our 30,000 game sample much more than the 700 game sample - although I admit this is disappointing so far.

4448.00 and 4452.00 are very close to Komodo 5 -hardly any differences and Komodo 5 is just a better compiled version of these.

So let's wait and see what happens.

Code:

Rank Name Elo + - games score oppo. draws
1 Komodo 5 64bit 3042.1 10.8 10.8 3097 56.8% 2995.2 43.8%
2 Komodo 4452.00 64 bit 3031.2 5.8 5.8 10793 55.2% 2995.4 44.4%
3 Komodo 4448.00 64 bit 3030.9 12.7 12.7 2251 56.5% 2985.8 43.4%
4 Houdini 1.5a x64 3025.9 7.3 7.3 6935 50.0% 3025.9 41.2%
5 Komodo 4445.00 64 bit 3024.3 10.4 10.4 3392 54.8% 2991.5 43.8%
6 Komodo 4 SSE4 3006.4 10.5 10.5 3381 52.1% 2991.7 40.2%
7 Critter 1.4 64-bit SSE4 3000.0 6.4 6.4 8696 46.3% 3025.4 45.2%
8 Stockfish 2.2.2 JA 2960.8 6.5 6.5 8677 40.5% 3026.7 44.0%

Hi, i am sorry, my prediction of ''around 10 elo'' of improvement is probably wrong althought now i would wait to see cegt and ccrl. If i read correctly the result of ipon chess it is about 23 elo.

But there are some things that don't convince me.

1. I expected much more than +23 after almost a year from Komodo 4.

You must be using fuzzy math. We release Komodo 4 in late Dec early Jan. It's a little more than 6 months.

Quote:

2. The results of tests of Komodo's team seem to show a much bigger improvement, especially against some engines (e.g. Stockfish, but in this case, at ipon chess, the gap is much smaller).
3. Some sites report bad results of Komodo 5 against Houdini 2 and against Houdini 1.5.

http://www.chess2u.com/t6106-komodo-5-tests

http://www.chess2u.com/t6105-komodo-5-vs-houdini-20c-1500-games

Believe me, i am in total good faith but i don't understand these results against Houdini when the internal tests of Komodo's team showed clearly another rating list.

Has someone an explaination for that?

I think we simply need to see a lot of results under a lot of different conditions before drawing any conclusions. Larry and I should know better as we see this all the time with our testing, really good or really bad results after a few hundred games then a complete change. It's call statistical noise, sample error, whatever.

So let's just want before drawing any conclusions. Take a lesson from what happened on IPON, a terrible start that finished better. The IPON sample size is really way too low too as it's about 10 ELO in either direction for any 2 programs you are comparing. Houdini could be over or under rated and so could Komodo. Based on our results I would guess (and it's only a guess) that Houdini is slightly over-rated and Komodo is slightly under-rated. But that is pure speculation without the samples.

Quote:

And, most important, if Houdini continues to be clearly the number one and probably will enlarge the gap in september with Houdini 3, what is the plan of Komodo.

We want to be number one but it seems others are more obsessed with it that we are. We feel that if we keep improving Komodo it will end up there - either sooner or later. We cannot promise that because we don't know.

I'm pretty sure there are some exciting improvements ahead, especially with code improvements which I have never put a huge amount of attention into. Komodo has the slowest nodes per second of any program in it's class and when I focus my attention on that there is a good chance it will be a pretty major thing. We also have a long list of ideas that we will be pursuing and some of them will pay off for us.

Quote:

Peronally i would have considered ''good'' an improvement of Komodo of, at least, 40 elo. So i am bit disappointed, for now.

Don't forget that when you have a program as strong as Komodo you don't just add 40 ELO like it was nothing. It's only been 6 months and there is only reasonable data from one list now and our distributed testing (on other peoples machines) show about 40 ELO with FAR more games than IPON. We will likely do much better on other lists - we shall see.

Quote:

Thank you.

Best Regards

_________________
The Optimist thinks this is the best of all possible worlds, the Pessimist fears it is true.

Display posts from previous:

Subject	Author	Date/Time
Komodo 5 release now available!	Don Dailey	Thu Jul 19, 2012 2:47 pm
Re: Komodo 5 release now available!	jose mº velasco	Thu Jul 19, 2012 3:06 pm
Re: Komodo 5 release now available!	Jesús Muñoz	Thu Jul 19, 2012 3:10 pm
Re: Komodo 5 release now available!	Don Dailey	Thu Jul 19, 2012 3:20 pm
Re: Komodo 5 release now available!	Bram Visser	Thu Jul 19, 2012 3:34 pm
Re: Komodo 5 release now available!	Richard Allbert	Thu Jul 19, 2012 4:26 pm
Re: Komodo 5 release now available!	Don Dailey	Thu Jul 19, 2012 4:28 pm
Re: Komodo 5 release now available!	Richard Allbert	Thu Jul 19, 2012 4:36 pm
Re: Komodo 5 release now available!	Carl Bicknell	Thu Jul 19, 2012 4:38 pm
Re: Komodo 5 release now available!	Michael Rezaeian	Thu Jul 19, 2012 4:57 pm
Re: Komodo 5 release now available!	fernando	Thu Jul 19, 2012 5:22 pm
Re: Komodo 5 release now available!	Graham Banks	Thu Jul 19, 2012 6:47 pm
Re: Komodo 5 release now available!	Larry Kaufman	Thu Jul 19, 2012 6:59 pm
Re: Komodo 5 release now available!	Gabriel LEPERLIER	Thu Jul 19, 2012 7:18 pm
Re: Komodo 5 release now available!	Uri Blass	Fri Jul 20, 2012 1:33 pm
Re: Komodo 5 release now available!	Don Dailey	Fri Jul 20, 2012 2:09 pm
Re: Komodo 5 release now available!	Carl Langan	Thu Jul 19, 2012 8:28 pm
Re: Komodo 5 release now available!	Sean Evans	Thu Jul 19, 2012 8:50 pm
Re: Komodo 5 release now available!	Don Dailey	Thu Jul 19, 2012 9:08 pm
Re: Komodo 5 release now available!	Mel Cooper	Thu Jul 19, 2012 8:54 pm
Re: Komodo 5 release now available!	Larry Kaufman	Thu Jul 19, 2012 9:00 pm
Re: Komodo 5 release now available!	Don Dailey	Thu Jul 19, 2012 9:04 pm
Re: Komodo 5 release now available!	Mel Cooper	Thu Jul 19, 2012 10:21 pm
Re: Komodo 5 release now available!	Maurizio Maglio	Thu Jul 19, 2012 11:16 pm
Re: Komodo 5 release now available!	Don Dailey	Thu Jul 19, 2012 9:11 pm
Re: Komodo 5 release now available!	Gabriel LEPERLIER	Thu Jul 19, 2012 9:15 pm
Re: Komodo 5 release now available!	Tom Giampietro	Thu Jul 19, 2012 10:07 pm
Re: Komodo 5 release now available!	Maurizio Maglio	Thu Jul 19, 2012 11:02 pm
Re: Komodo 5 release now available!	Maurizio Maglio	Thu Jul 19, 2012 11:12 pm
Re: Komodo 5 release now available!	Don Dailey	Thu Jul 19, 2012 11:16 pm
Re: Komodo 5 release now available!	Maurizio Maglio	Thu Jul 19, 2012 11:32 pm
Re: Komodo 5 release now available!	Maurizio Maglio	Thu Jul 19, 2012 11:36 pm
Re: Komodo 5 release now available!	Maurizio Maglio	Thu Jul 19, 2012 11:46 pm
Re: Komodo 5 release now available!	Don Dailey	Thu Jul 19, 2012 11:57 pm
Re: Komodo 5 release now available!	Stefan Pohl	Fri Jul 20, 2012 4:06 am
Re: Komodo 5 release now available!	Ed Schroder	Fri Jul 20, 2012 5:51 am
Re: Komodo 5 release now available!	Maurizio Maglio	Fri Jul 20, 2012 7:17 am
Re: Komodo 5 release now available!	Maurizio Maglio	Sat Jul 21, 2012 12:05 am
Re: Komodo 5 release now available!	Don Dailey	Sat Jul 21, 2012 12:29 am
Re: Komodo 5 release now available!	Carl Langan	Sat Jul 21, 2012 1:00 am
Re: Komodo 5 release now available!	Kai Laskos	Sat Jul 21, 2012 1:43 am
Re: Komodo 5 release now available!	Carl Langan	Sat Jul 21, 2012 1:47 am
Re: Komodo 5 release now available!	Maurizio Maglio	Sat Jul 21, 2012 8:31 am
Re: Komodo 5 release now available!	Richard Allbert	Sat Jul 21, 2012 12:43 pm
Re: Komodo 5 release now available!	Larry Kaufman	Fri Jul 20, 2012 12:39 am
Re: Komodo 5 release now available!	Maurizio Maglio	Fri Jul 20, 2012 7:19 am
Re: Komodo 5 release now available!	Mel Cooper	Fri Jul 20, 2012 7:45 am
Re: Komodo 5 release now available!	Maurizio Maglio	Fri Jul 20, 2012 7:55 am
Re: Komodo 5 release now available!	Larry Kaufman	Fri Jul 20, 2012 2:37 pm
Re: Komodo 5 release now available!	Maurizio Maglio	Fri Jul 20, 2012 7:59 am
Re: Komodo 5 release now available!	Carl Langan	Fri Jul 20, 2012 5:13 am
Re: Komodo 5 release now available!	Andreas Wutzke	Fri Jul 20, 2012 5:40 am
Re: Komodo 5 release now available!	Maurizio Maglio	Fri Jul 20, 2012 7:24 am
Re: Komodo 5 release now available!	Mike Scheidl	Fri Jul 20, 2012 12:20 am
Re: Komodo 5 release now available!	Ron Langeveld	Fri Jul 20, 2012 12:33 am
Re: Komodo 5 release now available!	Don Dailey	Fri Jul 20, 2012 12:39 am
Re: Komodo 5 release now available!	Larry Kaufman	Fri Jul 20, 2012 2:44 pm
Re: Komodo 5 release now available!	Graham Banks	Fri Jul 20, 2012 6:04 pm
Re: Komodo 5 release now available!	Larry Kaufman	Fri Jul 20, 2012 11:46 pm
Re: Komodo 5 release now available!	Bigler	Sat Jul 21, 2012 12:49 am
Re: Komodo 5 release now available!	Carl Langan	Sat Jul 21, 2012 1:05 am
Re: Komodo 5 release now available!	Tom Giampietro	Fri Jul 20, 2012 2:33 am
Re: Komodo 5 release now available!	Don Dailey	Fri Jul 20, 2012 2:44 am
Re: Komodo 5 release now available!	Tom Giampietro	Fri Jul 20, 2012 2:55 am
Re: Komodo 5 release now available!	Timo Klaustermeyer	Fri Jul 20, 2012 9:05 am
Re: Komodo 5 release now available!	Gabriel LEPERLIER	Fri Jul 20, 2012 9:08 am
Re: Komodo 5 release now available!	Jesse Gersenson	Fri Jul 20, 2012 10:21 am
Re: Komodo 5 release now available!	Dimitri Yasenko	Fri Jul 20, 2012 12:01 pm
Re: Komodo 5 release now available!	Tom Glenn	Fri Jul 20, 2012 12:14 pm
Re: Komodo 5 release now available!	Larry Kaufman	Fri Jul 20, 2012 2:50 pm
Re: Komodo 5 release now available!	George Speight	Fri Jul 20, 2012 4:28 pm
Re: Komodo 5 release now available!	Larry Kaufman	Fri Jul 20, 2012 5:25 pm
Re: Komodo 5 release now available!	George Speight	Fri Jul 20, 2012 6:08 pm
Re: Komodo 5 release now available!	Larry Kaufman	Fri Jul 20, 2012 9:54 pm
Re: Komodo 5 release now available!	George Speight	Fri Jul 20, 2012 10:16 pm
Re: Komodo 5 release now available!	Mel Cooper	Fri Jul 20, 2012 9:35 pm
Re: Komodo 5 release now available!	Don Dailey	Fri Jul 20, 2012 9:44 pm
Re: Komodo 5 release now available!	Don Dailey	Fri Jul 20, 2012 10:32 pm
Re: Komodo 5 release now available!	Timo Klaustermeyer	Sat Jul 21, 2012 10:34 am
Re: Komodo 5 release now available!	Tom Glenn	Fri Jul 20, 2012 6:05 pm
Re: Komodo 5 release now available!	Tom Glenn	Fri Jul 20, 2012 10:00 pm
Re: Komodo 5 release now available!	Larry Kaufman	Sat Jul 21, 2012 3:37 am
Re: Komodo 5 release now available!	Tom Glenn	Sat Jul 21, 2012 1:57 pm
Re: Komodo 5 release now available!	Sean Evans	Sat Jul 21, 2012 2:03 pm
Re: Komodo 5 release now available!	Robert Flesher	Sat Jul 21, 2012 2:52 pm
Re: Komodo 5 release now available!	Larry Kaufman	Sat Jul 21, 2012 2:32 pm
Re: Komodo 5 release now available!	Tom Glenn	Sat Jul 21, 2012 3:59 pm
Re: Komodo 5 release now available!	Sedat Canbaz	Sat Jul 21, 2012 7:49 pm
Re: Komodo 5 release now available!	Tom Glenn	Sun Jul 22, 2012 12:41 pm
Re: Komodo 5 release now available!	Don Dailey	Sun Jul 22, 2012 1:49 pm
Re: Komodo 5 release now available!	Maurizio Maglio	Sun Jul 22, 2012 1:55 pm
Re: Komodo 5 release now available!	jose mº velasco	Sun Jul 22, 2012 1:58 pm
Re: Komodo 5 release now available!	Tom Glenn	Sun Jul 22, 2012 3:07 pm
Re: Komodo 5 release now available!	Krzych Cybulsky	Sun Jul 22, 2012 5:21 pm
Re: Komodo 5 release now available!	Larry Kaufman	Sun Jul 22, 2012 7:09 pm
Re: Komodo 5 release now available!	Mike Libanan	Sun Jul 22, 2012 8:37 pm
Re: Komodo 5 release now available!	Adam Hair	Sat Jul 21, 2012 4:40 pm
Re: Komodo 5 release now available!	Larry Kaufman	Sun Jul 22, 2012 3:42 am
Re: Komodo 5 release now available!	Graham Banks	Sun Jul 22, 2012 3:55 am
Re: Komodo 5 release now available!	Don Dailey	Sun Jul 22, 2012 3:58 am
Re: Komodo 5 release now available!	Graham Banks	Sun Jul 22, 2012 4:03 am
Re: Komodo 5 release now available!	Larry Kaufman	Sun Jul 22, 2012 4:09 am
Re: Komodo 5 release now available!	Graham Banks	Sun Jul 22, 2012 4:19 am
Re: Komodo 5 release now available!	Maurizio Maglio	Sun Jul 22, 2012 8:05 am
Re: Komodo 5 release now available!	Dr. Peter Martan	Sun Jul 22, 2012 10:33 am
Re: Komodo 5 release now available!	Maurizio Maglio	Sun Jul 22, 2012 11:04 am
Re: Komodo 5 release now available!	Dr. Peter Martan	Sun Jul 22, 2012 11:26 am
Re: Komodo 5 release now available!	Don Dailey	Sun Jul 22, 2012 12:04 pm
Re: Komodo 5 release now available!	Uri Blass	Sun Jul 22, 2012 12:40 pm
Re: Komodo 5 release now available!	Don Dailey	Sun Jul 22, 2012 1:47 pm
Re: Komodo 5 release now available!	Uri Blass	Sun Jul 22, 2012 5:30 pm
Re: Komodo 5 release now available!	George Speight	Sun Jul 22, 2012 9:29 pm
Re: Komodo 5 release now available!	Larry Kaufman	Sun Jul 22, 2012 10:47 pm
Re: Komodo 5 release now available!	George Speight	Mon Jul 23, 2012 2:15 am
Re: Komodo 5 release now available!	Larry Kaufman	Mon Jul 23, 2012 5:06 am
Re: Komodo 5 release now available!	George Speight	Mon Jul 23, 2012 5:45 am
Re: Komodo 5 release now available!	Uri Blass	Mon Jul 23, 2012 6:48 am
Re: Komodo 5 release now available!	Don Dailey	Mon Jul 23, 2012 11:30 am
Re: Komodo 5 release now available!	Uri Blass	Mon Jul 23, 2012 12:07 pm
Re: Komodo 5 release now available!	Don Dailey	Mon Jul 23, 2012 12:45 pm
Re: Komodo 5 release now available!	Uri Blass	Mon Jul 23, 2012 2:04 pm
Re: Komodo 5 release now available!	Don Dailey	Mon Jul 23, 2012 2:31 pm
Re: Komodo 5 release now available!	Larry Kaufman	Mon Jul 23, 2012 2:36 pm
Re: Komodo 5 release now available!	Dan Honeycutt	Mon Jul 23, 2012 1:26 pm
Re: Komodo 5 release now available!	Dr. Peter Martan	Sun Jul 22, 2012 12:58 pm
Re: Komodo 5 release now available!	Richard Vida	Sun Jul 22, 2012 4:59 pm
Re: Komodo 5 release now available!	Don Dailey	Sun Jul 22, 2012 5:25 pm
Re: Komodo 5 release now available!	Kai Laskos	Sun Jul 22, 2012 5:26 pm
Re: Komodo 5 release now available!	Larry Kaufman	Sun Jul 22, 2012 6:00 pm
Re: Komodo 5 release now available!	Robert Houdart	Mon Jul 30, 2012 10:43 am
Re: Komodo 5 release now available!	Rolf	Mon Jul 30, 2012 11:15 am
Re: Komodo 5 release now available!	Dr.Wael Deeb	Mon Jul 30, 2012 11:39 am
A little off-topic, sorry...	Jesús Muñoz	Mon Jul 30, 2012 11:31 am
Re: A little off-topic, sorry...	Robert Houdart	Mon Jul 30, 2012 11:45 am
Re: A little off-topic, sorry...	Robert Houdart	Mon Jul 30, 2012 3:46 pm
Re: A little off-topic, sorry...	Maurizio Maglio	Mon Jul 30, 2012 7:15 pm
Re: A little off-topic, sorry...	Robert Houdart	Mon Jul 30, 2012 8:07 pm
Re: A little off-topic, sorry...	Bram Mourik	Mon Jul 30, 2012 9:25 pm
Re: Komodo 5 release now available!	Carl Langan	Sat Jul 21, 2012 4:54 pm
Re: Komodo 5 release now available!	Michael Hoffmann	Fri Jul 20, 2012 12:16 pm
Re: Komodo 5 release now available!	Dan Honeycutt	Fri Jul 20, 2012 1:08 pm
Re: Komodo 5 release now available!	Gabriel LEPERLIER	Fri Jul 20, 2012 1:11 pm
Re: Komodo 5 release now available!	Larry Kaufman	Fri Jul 20, 2012 2:49 pm
Re: Komodo 5 release now available!	Thorsten Czub	Fri Jul 20, 2012 5:58 pm
Re: Komodo 5 release now available!	George Speight	Sat Jul 21, 2012 4:59 am
Re: Komodo 5 release now available!	Don Dailey	Fri Jul 20, 2012 4:36 pm
Re: Komodo 5 release now available!	Krzych Cybulsky	Fri Jul 20, 2012 6:01 pm
Re: Komodo 5 release now available!	Krzych Cybulsky	Fri Jul 20, 2012 6:07 pm
Re: Komodo 5 release now available!	Don Dailey	Fri Jul 20, 2012 6:19 pm
Re: Komodo 5 release now available!	Krzych Cybulsky	Fri Jul 20, 2012 6:29 pm
Re: Komodo 5 release now available!	Don Dailey	Fri Jul 20, 2012 6:38 pm
Re: Komodo 5 release now available!	George Speight	Sat Jul 21, 2012 5:25 am
Re: Komodo 5 release now available!	Don Dailey	Fri Jul 20, 2012 6:12 pm
Re: Komodo 5 release now available!	George Speight	Sat Jul 21, 2012 5:20 am
Re: Komodo 5 release now available!	Uri Blass	Sat Jul 21, 2012 8:36 am
Re: Komodo 5 release now available!	Maurizio Maglio	Sat Jul 21, 2012 8:41 am
Re: Komodo 5 release now available!	George Speight	Sat Jul 21, 2012 11:02 pm
Re: Komodo 5 release now available!	Krzych Cybulsky	Sat Jul 21, 2012 5:40 pm

TalkChess.com Forum Index -> Computer Chess Club: General Topics

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum