Komodo 5 release now available!

[lkaufman]

Isn't it possible the AMD platform used by IPON needs a different Komodo 5 compile ? I may be mistaken but wasn't this an issue with earlier versions as well ?

At the moment, IPON is showing +23 elo while our own testing network is showing +36 (at a somewhat faster time control). Ingo indicated that our AMD compile could be about 10% slower than it "should" be, which would be another ten elo. So there is no mystery anymore. The only question is whether the AMD problem justifies a new compile.

[lkaufman]

Whats the point of Komodo 5 release??Its worst than Houdini.Whats the big deal here?

It remains to be seen if it is stronger or weaker than Houdini at the longer time controls. Also, our results are clearly better on Intel than on AMD machines, we may need to make a new compile for AMD.

[lkaufman]

K5 doing well in my tests so far.

@ 1+1 , 198 games so far , K5 is ahead of Houdini 2.0c :

+69 , -46 , =83


running 300 games

Tom

I'll bet you have an Intel machine. Am I right? The present compile may well be stronger than H2 on Intel, weaker on AMD.

[geots]

K5 doing well in my tests so far.

@ 1+1 , 198 games so far , K5 is ahead of Houdini 2.0c :

+69 , -46 , =83


running 300 games

Tom

I'll bet you have an Intel machine. Am I right? The present compile may well be stronger than H2 on Intel, weaker on AMD.

Larry, I think there may be a chance that K5 has caught Houdini 2.0c. But 1+1 is going to tell you absolutely nothing you can hang a hat on. But I am aware with you being 1000 times smarter than me with this stuff, you already know that.

My main machine is the same as Don's- I believe. Intel i5-2320 CPU @3.00GHz with 4 true cores and no hyperthreading. I am starting 2 matches at the same time right now:

Match 1- Houdini 2.0c v Komodo 5 w/100 games at 5m+3s

Match 2- When I tested for CCRL, we all benchmarked our computers to get them as close as possible. So if I was running this match for them at 40/40, the machine is fast enough that after benchmarking it, I would run 40/40 at 40/21. So this 2nd match will be:

Houdini 2.0c v Komodo 5 w/50 games at 40/21

Nothing written in stone with the results, but it's a darn good start at both blitz and slightly higher than intermediate controls.

**I think you will understand that it is important for me to hear from either you or Don that it is ok to publish/post regular updates from both in "Tournaments and Matches" section here. At least hearing that is important to me. NOT THAT YOU WOULD WANT ME TO HIDE BAD RESULTS- if there were any- but you might prefer FOR OTHER REASONS that I just post final results. I would feel better if it made a difference that I was told.


Best,

george

PS: It's going to be a hell of a lot closer in both than most think.

[Don]

The evidence is collecting that Komodo 5 is optimized for Intel and does not run well on AMD. We are still checking into this but it's difficult since I do not have access to an AMD machine. It's probably a simple matter of recompiling in a more generic way.

I have built a distributed tester, where a small team of testers can contribute CPU resources to us and I can break out the results in any way I choose. If you look at the Komodo 5 rating on Intel vs AMD you will see quite a difference - but the error margins still make this ambiguous. But we have other evidences too. I am currently in the process of having my testers time various binaries on different platforms to get to the bottom of this, if there is an issue.

Code: Select all

chipset: INTEL

Rank Name        Elo      +      -    games   score   oppo.   draws 
   1 komodo5   3048.7    9.2    9.2    4303   56.9%  3000.7   43.2% 
   2 k4452.00  3033.6    6.5    6.5    8480   54.7%  3001.6   44.0% 
   3 k4448     3033.3   14.5   14.5    1721   56.4%  2989.1   43.9% 
   4 hou15     3029.3    7.0    7.0    7509   49.6%  3031.8   41.2% 
   5 k4445     3026.8   11.9   11.9    2532   54.5%  2996.3   44.6% 
   6 komodo4   3014.6   12.0   12.0    2574   52.6%  2996.3   39.7% 
   7 c14       3000.0    7.3    7.3    6653   45.5%  3030.5   45.8% 
   8 k4447     2981.5   84.5   84.5      46   48.9%  2979.8   54.3% 
   9 sf222     2963.1    7.4    7.4    6654   40.1%  3031.8   43.7% 

------------------------------------------------
chipset: AMD

Rank Name        Elo      +      -    games   score   oppo.   draws 
   1 hou15     3026.9   50.3   50.3     151   54.6%  2991.6   35.1% 
   2 komodo5   3026.2   18.0   18.0    1130   57.0%  2976.2   41.6% 
   3 k4452.00  3024.5   12.4   12.4    2313   57.2%  2975.1   45.6% 
   4 k4448     3022.4   26.2   26.2     530   56.7%  2974.4   42.1% 
   5 k4445     3016.1   20.7   20.7     859   55.5%  2977.8   41.6% 
   6 c14       3000.0   11.2   11.2    2890   47.8%  3016.1   43.0% 
   7 k4447     2983.7  138.4  138.4      17   52.9%  2964.5   47.1% 
   8 komodo4   2980.4   21.3   21.3     806   50.4%  2977.5   42.1% 
   9 sf222     2949.7   11.2   11.2    2848   40.3%  3016.7   44.2% 

------------------------------------------------

[lkaufman]

K5 doing well in my tests so far.

@ 1+1 , 198 games so far , K5 is ahead of Houdini 2.0c :

+69 , -46 , =83


running 300 games

Tom

I'll bet you have an Intel machine. Am I right? The present compile may well be stronger than H2 on Intel, weaker on AMD.

Larry, I think there may be a chance that K5 has caught Houdini 2.0c. But 1+1 is going to tell you absolutely nothing you can hang a hat on. But I am aware with you being 1000 times smarter than me with this stuff, you already know that.

My main machine is the same as Don's- I believe. Intel i5-2320 CPU @3.00GHz with 4 true cores and no hyperthreading. I am starting 2 matches at the same time right now:

Match 1- Houdini 2.0c v Komodo 5 w/100 games at 5m+3s

Match 2- When I tested for CCRL, we all benchmarked our computers to get them as close as possible. So if I was running this match for them at 40/40, the machine is fast enough that after benchmarking it, I would run 40/40 at 40/21. So this 2nd match will be:

Houdini 2.0c v Komodo 5 w/50 games at 40/21

Nothing written in stone with the results, but it's a darn good start at both blitz and slightly higher than intermediate controls.

**I think you will understand that it is important for me to hear from either you or Don that it is ok to publish/post regular updates from both in "Tournaments and Matches" section here. At least hearing that is important to me. NOT THAT YOU WOULD WANT ME TO HIDE BAD RESULTS- if there were any- but you might prefer FOR OTHER REASONS that I just post final results. I would feel better if it made a difference that I was told.


Best,

george

PS: It's going to be a hell of a lot closer in both than most think.

Since this is a public release and not a private beta version, you don't need our permission to post results. But any I'm fine with it, especially as you have an Intel machine -- any results for AMD machines might turn out to be moot if we issue a new compile to address the AMD problem.
I would add that the 1'+ 1" results can confirm the AMD problem, if someone else runs a similar test on an AMD machine. In general, we do recommend that private testers use the same number of minutes for base time as seconds for increment, though of course other time limits are also quite valid, except for very short sudden death time controls (like 1' or less) where time forfeits and near-forfeits play a huge role.

[mclane]

Whats the point of Komodo 5 release??Its worst than Houdini.Whats the big deal here?

whats this for a stupid question.
programmers publish and sell their engines no matter how strong other engines are.
junior was sold. vitruvius is sold. chiron is sold. hiarcs or shredder will be sold. and komodo also. what has this to do with houdini ?

[Hood]

Hello.

I can not catch up in which way it is fullfiling the promise to get Komodo 4.1 SP for free by K v4.0 buyers?

1. There is not 4.1 V.

2. It looks that v.4.0 buyers have to pay next time and buy version 5!



Rgds Hood

[Graham Banks]

Isn't it possible the AMD platform used by IPON needs a different Komodo 5 compile ? I may be mistaken but wasn't this an issue with earlier versions as well ?

At the moment, IPON is showing +23 elo while our own testing network is showing +36 (at a somewhat faster time control). Ingo indicated that our AMD compile could be about 10% slower than it "should" be, which would be another ten elo. So there is no mystery anymore. The only question is whether the AMD problem justifies a new compile.

From talking to Ray, who is testing Komodo 5 on an AMD Phenom II for CCRL 40/40, he seems to think that a different compile would be pretty pointless.
It is leading Critter, Houdini, Stockfish and Rybka, so there can't be too much wrong with it.
A 5 Elo gain would be lost in the error margins anyway.

[WuShock]

WuShock wrote:
K5 doing well in my tests so far.

@ 1+1 , 198 games so far , K5 is ahead of Houdini 2.0c :

+69 , -46 , =83


running 300 games

Tom


I'll bet you have an Intel machine. Am I right?

Old i7 / 940 .........

Update when done , even the last 70 games.......