Komodo Sub

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Paloma
Posts: 1167
Joined: Thu Dec 25, 2008 9:07 pm
Full name: Herbert L

Re: Komodo Sub

Post by Paloma »

kk wrote:Hi Herbert,
Your example very much illustrates one of the points I had experienced.
I am aware that for every ply that is completed something like an exponential increase in time is required to complete the next ply....however, i can leave the processing overnight and see no update in reporting of analysis where the score for the side to move is high.
....
Yes and aggravating is that the number of nodes does not change (still 5871 kN/s), although TaskM shows 50% load for Komodo.
It hangs in an endless loop?
Power wastage.
User avatar
MikeB
Posts: 4889
Joined: Thu Mar 09, 2006 6:34 am
Location: Pen Argyl, Pennsylvania

Re: Komodo Sub

Post by MikeB »

Paloma wrote:Here komodo has a similar behavior.
depth 31 in 1:00
depth 32 in 2:40
...
depth 35 in 8:06
...
depth 38 in 28:13
depth 39 in 40:12 and still standing on this depth for 10 hours.

eval +8.66
no more progress so far

Task manager shows 50% utilization
Komodo 11.2.2, i7 6700 @4.0GHz, 2T, 8GB Hash

[d] 1r3rk1/5p1p/pp1p1p1Q/2q2P2/2P1p1b1/P1PB1R2/6PP/1R5K w - - 0 6

Analysis by Komodo 11.2.2 64-bit:

6.Bxe4 Rfe8 7.Bd5 Bxf3 8.gxf3 Re5 9.Rg1+ Qxg1+ 10.Kxg1 Rxf5 11.f4 Re8 12.Qh3 Re1+ 13.Kg2 Re2+ 14.Kf3 Ree5
Weiß steht klar auf Gewinn: +- (6.56 ++) Tiefe: 32 00:02:40 848MN, tb=591671
...
6.Bxe4 Qe5 7.Re3 Bxf5 8.Bxf5 Qxf5 9.Rg3+ Qg6 10.Rxg6+ fxg6 11.Qf4 Rb7 12.Qd4 Re8 13.Kg1 Rbe7 14.Qxf6 Re6
Weiß steht klar auf Gewinn: +- (8.49 ++) Tiefe: 38 00:28:13 9587MN, tb=3581086
6.Bxe4 Qe5 7.Re3 Bxf5 8.Bxf5 Qxf5 9.Rg3+ Qg6 10.Rxg6+ fxg6 11.Qf4 Rb7 12.Qd4 Re8 13.Kg1 Rbe7 14.Qxf6 Re6
Weiß steht klar auf Gewinn: +- (8.72) Tiefe: 38 00:34:20 11653MN, tb=3921838
6.Bxe4 Qe5 7.Re3 Bxf5 8.Bxf5 Qxf5 9.Rg3+ Qg6 10.Rxg6+ fxg6 11.Qf4 Rb7 12.Qd4 Re8 13.Kg1 Rbe7 14.Qxf6 Re6
Weiß steht klar auf Gewinn: +- (8.66 --) Tiefe: 39 00:40:12 13699MN, tb=4522611
Th problem is probably it's trying to switch to Rg3 and it's taking a long time to resolve. But Rg3 is clearly the better move:

Code: Select all

dep	score	nodes	time	(not shown:  tbhits	knps	seldep)
 33	+11.78 	3.01G	1:44.71	Rg3 Qxf5 Be2 Kh8 Bxg4 Qg5 Qh3 Rg8 Bf5 h5 Rxg5 Rxg5 Bxe4 Re8 Bd5 Re7 Qc8+ Kg7 Qxa6 Rge5 Rg1 f5 Qxb6 Rd7 Qb5 Ree7 Qb4 Re5 Qb6 Ree7 Bc6 Rc7 Qd4+ Re5 Qxd6 Rce7 Bd5 f6 Rf1 Re8 Kg1 Kg6 Qc7 R8e7 Qc5 Re8 Qd6 Kg7 Qc7+ R8e7 Qb8 
kk
Posts: 21
Joined: Wed Nov 23, 2016 8:23 am
Location: UK

Re: Komodo Sub

Post by kk »

I have noticed another quirk in longer analysis sessions in that the nodes per second does tend to reduce. This happens to both Komodo and Houdini and I wonder whether it may be tied up with hash reaching 100%. I don't always clear hash between analysis of different positions, but I do find by closing and restarting the program this gives a boost to the nps. Not quite sure why this happens but is prevalent with both Komodo and to a lesseer extent Houdini.

I'm under the impression that in endgames the nodes per second is much higher and this is due to fewer pieces on the board but also perhaps to fewer program instructions at this stage of the game for each node reached? Don't know if I am right on this but those are my thoughts to date.
leavenfish
Posts: 282
Joined: Mon Sep 02, 2013 8:23 am

Re: Komodo Sub

Post by leavenfish »

kk wrote:I have noticed another quirk in longer analysis sessions in that the nodes per second does tend to reduce. This happens to both Komodo and Houdini and I wonder whether it may be tied up with hash reaching 100%. I don't always clear hash between analysis of different positions, but I do find by closing and restarting the program this gives a boost to the nps. Not quite sure why this happens but is prevalent with both Komodo and to a lesseer extent Houdini.
Given that (from what I understand) most people who purchase Komodo do so for analysis....seems like this should be top on Team K to look into!
mjlef
Posts: 1494
Joined: Thu Mar 30, 2006 2:08 pm

Re: Komodo Sub

Post by mjlef »

kk wrote:I have noticed another quirk in longer analysis sessions in that the nodes per second does tend to reduce. This happens to both Komodo and Houdini and I wonder whether it may be tied up with hash reaching 100%. I don't always clear hash between analysis of different positions, but I do find by closing and restarting the program this gives a boost to the nps. Not quite sure why this happens but is prevalent with both Komodo and to a lesseer extent Houdini.

I'm under the impression that in endgames the nodes per second is much higher and this is due to fewer pieces on the board but also perhaps to fewer program instructions at this stage of the game for each node reached? Don't know if I am right on this but those are my thoughts to date.
The second first: yes, the fewer the pieces on the board, the quicker Komodo (and probably most programs) get. There is less to do both in move generation and in board evaluation.

I cannot think of any reason restarting Komodo might make it quicker. One idea is modern operating systems, when they allocate big batches of memory for things like hash table, often are unable to make the memory blocks contiguous. Mapping is used to make it appear that it is one block of memory, but this is slower than a real block of memory all in out place. One reason Large pages is faster. After running a while, then closing and restarting a program might help in this regard. Just a speculation. Do you see the same thing when you Clear Hash? I can look into this.
kk
Posts: 21
Joined: Wed Nov 23, 2016 8:23 am
Location: UK

Re: Komodo Sub

Post by kk »

I mainly use Hiarcs Explorer for its fuss free simple user interface. It also appears to run engines a tad faster (perhaps slightly less overhead) than the chessbase interface.
I haven't been successful in finding a clear hash command in hiarcs explorer so i normally Switch engines then switch back to the engine I want to use and that often results in a 'refresh' of speed. This is only relevant after a long think time, perhaps overnight, equating to 10 to 15 hours. I may run several analyses on different positions throughout a week then suddenly find a slow down after a longer think and that is when I would try an attempt to reset things.
I have a sneaking feeling that sometimes after an overly long think time the CPU is running hotter; I always use the maximum threads i can get away with which doesn't show a speed reduction in the short term and doesn't lock the m/c up so it won't let me do anything else without an annoying delay.
I suspect temperature plays an important part in the op. system deciding at what speed the chip will run. The speed of the chip may well be controlling the possible nps, my guess here.

If temp. is a part of the problem (I only use laptops) then stopping and reloading thg program gives the system a short break and a temperature drop then on restart I would imagine a higher clock rate on the chip is restored which would show a higher nps. If so this is clearly not the fault of the program to control.

Incidentally as described in an earlier post if Komodo goes into what appears to me a long think whilst showing a high winning score for the side to move this may also occur when a score of zero is shown and a repeating position is calculated. Komodo also appears to go into non active mode when it has found a mate, so I'm not sure if it is looking for a shorter mate or has had enough and sits there.

Very occasionally I have revisited the analysis in the morning and found a messsge box telling me the program has stopped, for what reason i know not. I am running on High Sierra and the latest updates in Windows 10. Reloading the engine corrects the error.

The only other thing i would mention is that I think Komodo could do a little better at finding mates. It consistently finds mates later than Houdini 6.0.3 but does always eventually come up with a similar display even though it may be between 10 and 20 minutes later, to give a common example.

I must say move correlation between Komodo and Houdini on the same positions is high. Following a longer analysis period Komodo, Houdini and Stockfish are often showing the same candidate move and rather amazingly very close position evaluations scores too!

There are so many variables to control when doing testing between programs (hardware, threads, hash size, opening book type, time of reflection, etc) i find it very difficult to come up with a clear winner between Stockfish (latest dev version), Houdini 6.0.3 anf Komode 11.2.2!