I would not trust the "speed" to tell you anything. Komodo is slower than many of the programs that it can beat and the speed varies from version to version depending on a many factors that we tinker with such as extensions, LMR or other pruning.Laskos wrote:I am using an AMD without SSE42. Here Kom 3 is ~2.4% slower than Kom 2.03 JA, both 64 bit Win 7. Time control is 1.5s + 0.05s, maybe useless, but often useful to me. Here is the self-testing between two Komodo brothersDon wrote:
I'm looking on the clemens site and the Ipon site. It's showing 44 ELO on the Clemens 5 inute + 3 second test after about 900 games.
On the IPON list it's showing 21 ELO after 900 games. So it appears that 20 ELO is going to be approximately correct.
Note that these are played on different platforms which can affect things some and of course the error margins are very high.
It seems, in my testing, the version 3 is not likely to be more than 14 Elo points stronger than 2.03, but don't trust my testing at these time controls, it's just for fun .Code: Select all
Program Score % Elo + - Draws 1 Komodo64 3 : 1103.5/2200 50.2 3001 12 12 32.6 % 2 Komodo64 2.03 JA : 1096.5/2200 49.8 2999 12 12 32.6 %
Kai
In a previous post I mentioned that we have found fast time controls are too unreliable for determining what the true improvement is. We have experimented with game in 1 second + 0.01 for example. It's good for getting huge samples quickly but it's not very reliable - it shows huge improvements where there are none and regressions when there are improvements.
A program is not fully exercised until it is getting out well past 9 or 10 ply. There are even some evaluation issues that don't register at small ply - and some pruning ideas based on sub-searches (even stuff like IID and singular extensions) need a few ply to start working smoothly and consistently.
Another factor in your test - what is the move overhead set to? At those time controls you are taking a big hit - so check komodo 2.03 and komodo 3 and set them to be the same - I suggest just setting it to 1.
Don