Houdini 6 Pro and large pages

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Lion
Posts: 531
Joined: Fri Mar 31, 2006 1:26 pm
Location: Switzerland

Houdini 6 Pro and large pages

Post by Lion »

Hello

How do I know if Houdini 6 Pro uses my large pages?

rgds
User avatar
Houdini
Posts: 1471
Joined: Tue Mar 16, 2010 12:00 am

Re: Houdini 6 Pro and large pages

Post by Houdini »

Houdini will send the message "info string XXX Large Page Hash".

You can also see it in the Task Manager, the Large Page memory is only visible as a Virtual Memory allocation (if I recall correctly).

Finally, you can try the "lp" command (after double-clicking on "Houdini 6.exe"). Houdini will try to create large page memory blocks of increasing size and shows a summary of the results.
Lion
Posts: 531
Joined: Fri Mar 31, 2006 1:26 pm
Location: Switzerland

Re: Houdini 6 Pro and large pages

Post by Lion »

Thanks.
But is there a option to tick in the engine menu?
User avatar
Houdini
Posts: 1471
Joined: Tue Mar 16, 2010 12:00 am

Re: Houdini 6 Pro and large pages

Post by Houdini »

No, if Large Pages are available in Windows, Houdini 6 Pro will try to use them.
Werewolf
Posts: 1796
Joined: Thu Sep 18, 2008 10:24 pm

Re: Houdini 6 Pro and large pages

Post by Werewolf »

Not trying to hijack the thread, but is that also true of NUMA? So if H6 Pro is on a single CPU machine, there's no need to turn off NUMA? Is it automatic in its setting etc?
User avatar
Houdini
Posts: 1471
Joined: Tue Mar 16, 2010 12:00 am

Re: Houdini 6 Pro and large pages

Post by Houdini »

Correct, there is no need to turn off NUMA if you're running on a system with only a single NUMA node.
The NUMA support will only make a difference if Houdini detects at least 2 NUMA nodes (as reported by the appropriate Windows function).
CheckersGuy
Posts: 273
Joined: Wed Aug 24, 2016 9:49 pm

Re: Houdini 6 Pro and large pages

Post by CheckersGuy »

Houdini wrote:Correct, there is no need to turn off NUMA if you're running on a system with only a single NUMA node.
The NUMA support will only make a difference if Houdini detects at least 2 NUMA nodes (as reported by the appropriate Windows function).
How much stronger is Houdini with Numa and LP ?
Dann Corbit
Posts: 12540
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Houdini 6 Pro and large pages

Post by Dann Corbit »

CheckersGuy wrote:
Houdini wrote:Correct, there is no need to turn off NUMA if you're running on a system with only a single NUMA node.
The NUMA support will only make a difference if Houdini detects at least 2 NUMA nodes (as reported by the appropriate Windows function).
How much stronger is Houdini with Numa and LP ?
These sorts of things won't have simple answers.

I have a very old machine with NUMA, which won't be manged by the OS as well as new machines with NUMA.

Programs definitely need to be NUMA aware (see Ipman's tests).

LP makes things a few percent faster but it's not a big win. On the other hand, faster is faster. So why not?
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
User avatar
Houdini
Posts: 1471
Joined: Tue Mar 16, 2010 12:00 am

Re: Houdini 6 Pro and large pages

Post by Houdini »

CheckersGuy wrote:
Houdini wrote:Correct, there is no need to turn off NUMA if you're running on a system with only a single NUMA node.
The NUMA support will only make a difference if Houdini detects at least 2 NUMA nodes (as reported by the appropriate Windows function).
How much stronger is Houdini with Numa and LP ?
It highly depends on the hardware, and in case of Large Pages, on the hash size used. Bigger hashes will benefit more from Large Pages.

You can find some real performance data for two systems (40-core dual Intel Xeon v4 and 24-core dual AMD Opteron 6174) in the User's Manual, see here: http://www.cruxis.com/chess/manual/houd ... ersion.htm
CheckersGuy
Posts: 273
Joined: Wed Aug 24, 2016 9:49 pm

Re: Houdini 6 Pro and large pages

Post by CheckersGuy »

Houdini wrote:
CheckersGuy wrote:
Houdini wrote:Correct, there is no need to turn off NUMA if you're running on a system with only a single NUMA node.
The NUMA support will only make a difference if Houdini detects at least 2 NUMA nodes (as reported by the appropriate Windows function).
How much stronger is Houdini with Numa and LP ?
It highly depends on the hardware, and in case of Large Pages, on the hash size used. Bigger hashes will benefit more from Large Pages.

You can find some real performance data for two systems (40-core dual Intel Xeon v4 and 24-core dual AMD Opteron 6174) in the User's Manual, see here: http://www.cruxis.com/chess/manual/houd ... ersion.htm
The 40-thread benchmark with numa is pretty impressive. Didn´t expect such a big difference.