There is still a multithread penalty. That is why we limit threads to 12, since our testing indicates that beyond 12 adding more threads actually hurts slightly. We could have set a much higher limit, but we felt that would be dishonest. I expect we'll find a way to use more than 12 threads before too long.
Komodo 12.1
Moderators: hgm, Rebel, chrisw
-
- Posts: 5960
- Joined: Sun Jan 10, 2010 6:15 am
- Location: Maryland USA
Re: Komodo 12.1
Komodo rules!
-
- Posts: 1494
- Joined: Thu Mar 30, 2006 2:08 pm
Re: Komodo 12.1
MP never scales perfectly since more cores are fighting for access to memy, and memory speeds have not increased much compared to processor speeds. A perfect MCTS search is not possible in NO so very processors need to widen the tree more so they do not try to expand the same nodes. But overall scaling is pretty good.lkaufman wrote: ↑Mon Jun 04, 2018 6:14 pmThere is still a multithread penalty. That is why we limit threads to 12, since our testing indicates that beyond 12 adding more threads actually hurts slightly. We could have set a much higher limit, but we felt that would be dishonest. I expect we'll find a way to use more than 12 threads before too long.
-
- Posts: 1494
- Joined: Thu Mar 30, 2006 2:08 pm
Re: Komodo 12.1
Although we have concentrated on MCTS search the last several weeks, I promise we will work on regular search mode too. Regular search and evil improvements benefits both regular and MCTS search since we currently use shorts searches and Komodo's eval to estimate win probabilities.lkaufman wrote: ↑Mon Jun 04, 2018 5:25 pmschack wrote: ↑Mon Jun 04, 2018 3:33 pm From Larry's post, it seems like the idea is to shift developmental emphasis from traditional search to MCTS. This worries me slightly. Standard Komodo is immensely strong, and runs well on laptops, slower hardware, etc. MCTS may not. I'd really hope that work continues on the standard engine, and with the new linkup with chess.com, perhaps now Komodo can have access to Fishtest-esque hardware needed to chase down new ideas and test them.
MCTS runs fine on my laptop. Anyway we'll continue to try new ideas in standard Komodo, but MCTS ideas get priority over just tweaking parameter values in standard Komodo.
-
- Posts: 1796
- Joined: Thu Sep 18, 2008 10:24 pm
Re: Komodo 12.1
Does it scale better than Lazy SMP?mjlef wrote: ↑Mon Jun 04, 2018 6:42 pmMP never scales perfectly since more cores are fighting for access to memy, and memory speeds have not increased much compared to processor speeds. A perfect MCTS search is not possible in NO so very processors need to widen the tree more so they do not try to expand the same nodes. But overall scaling is pretty good.lkaufman wrote: ↑Mon Jun 04, 2018 6:14 pmThere is still a multithread penalty. That is why we limit threads to 12, since our testing indicates that beyond 12 adding more threads actually hurts slightly. We could have set a much higher limit, but we felt that would be dishonest. I expect we'll find a way to use more than 12 threads before too long.
-
- Posts: 5960
- Joined: Sun Jan 10, 2010 6:15 am
- Location: Maryland USA
Re: Komodo 12.1
Maybe a bit better up to 12 cores. Apparently not beyond that.Werewolf wrote: ↑Mon Jun 04, 2018 7:50 pmDoes it scale better than Lazy SMP?mjlef wrote: ↑Mon Jun 04, 2018 6:42 pmMP never scales perfectly since more cores are fighting for access to memy, and memory speeds have not increased much compared to processor speeds. A perfect MCTS search is not possible in NO so very processors need to widen the tree more so they do not try to expand the same nodes. But overall scaling is pretty good.lkaufman wrote: ↑Mon Jun 04, 2018 6:14 pm
There is still a multithread penalty. That is why we limit threads to 12, since our testing indicates that beyond 12 adding more threads actually hurts slightly. We could have set a much higher limit, but we felt that would be dishonest. I expect we'll find a way to use more than 12 threads before too long.
Komodo rules!
-
- Posts: 1796
- Joined: Thu Sep 18, 2008 10:24 pm
Re: Komodo 12.1
Oh. I thought one of the great hopes of this approach was its potential on massive hardware. If it doesn’t scale better than alpha beta >12 cores...the old way will always win as 12 cores will be increasingly common over the next few years.lkaufman wrote: ↑Mon Jun 04, 2018 9:22 pmMaybe a bit better up to 12 cores. Apparently not beyond that.Werewolf wrote: ↑Mon Jun 04, 2018 7:50 pmDoes it scale better than Lazy SMP?mjlef wrote: ↑Mon Jun 04, 2018 6:42 pm
MP never scales perfectly since more cores are fighting for access to memy, and memory speeds have not increased much compared to processor speeds. A perfect MCTS search is not possible in NO so very processors need to widen the tree more so they do not try to expand the same nodes. But overall scaling is pretty good.
-
- Posts: 1494
- Joined: Thu Mar 30, 2006 2:08 pm
Re: Komodo 12.1
mjlef wrote: ↑Mon Jun 04, 2018 6:48 pmAlthough we have concentrated on MCTS search the last several weeks, I promise we will work on regular search mode too. Regular search and eval improvements benefits both regular and MCTS search since we currently use shorts searches and Komodo's eval to estimate win probabilities.lkaufman wrote: ↑Mon Jun 04, 2018 5:25 pmschack wrote: ↑Mon Jun 04, 2018 3:33 pm From Larry's post, it seems like the idea is to shift developmental emphasis from traditional search to MCTS. This worries me slightly. Standard Komodo is immensely strong, and runs well on laptops, slower hardware, etc. MCTS may not. I'd really hope that work continues on the standard engine, and with the new linkup with chess.com, perhaps now Komodo can have access to Fishtest-esque hardware needed to chase down new ideas and test them.
MCTS runs fine on my laptop. Anyway we'll continue to try new ideas in standard Komodo, but MCTS ideas get priority over just tweaking parameter values in standard Komodo.
-
- Posts: 1494
- Joined: Thu Mar 30, 2006 2:08 pm
Re: Komodo 12.1
am pretty sure we can improve it on more cores. Testing with a lot of cores is hard because it takes a lot of time and we only have limited machines, especially above 24 cores.
-
- Posts: 140
- Joined: Tue Jan 05, 2010 8:02 pm
Re: Komodo 12.1
Just a few posts back Larry did write "I expect we'll find a way to use more than 12 threads before too long."
I suggest you don't develop an accidental blindspot to free info by developers (in general) that tend to be reluctant with info on future versions. You may have misread it, but from where I am sitting I applaud the Komodo team for listening to customers and providing a significant enhancement within a couple of weeks. If you are one of the few Komodo customers with a core count that far exceeds the 12 core boundary for now than posts like this won't get any pity from me
![Wink ;)](./images/smilies/icon_wink.gif)
Ron