Compiling Stockfish dev for Large Pages

[schack]

Hi - does anyone know how to compile the dev versions of Stockfish (using mingw / gcc) for large pages? I'm trying to do this for Ryzen chips, but on a Haswell computer, if this matters.

Thanks.

[tpoppins]

See my reply in the "How to add LP to CorChess?" thread from April for the answer.

[schack]

Ah, I suspect we have hit the limit of my capabilities. Patching that many files for each compile is perhaps a step too far for this non-programmer.

Thank you for the pointer, though. Now I know what I need to work up to!

[tpoppins]

Never think it. With an SVN client like TortoiseSVN it's all nearly automatic. Check Out the source, apply the patch; do Update after a new commit (TSVN can monitor the repo for you, too), the changes from the patch will be incorporated automatically.

Every few months there may be changes to the master branch sufficiently big to break automatic merging on some files. In such cases these files will be highlighted in red in the Update dialog box. Then yeah, you'd have to patch manually. That shouldn't take more than a few minutes, even for a non-programmer.

Here is a complete patch for the current (rev 4868 20170922) master. See the thread linked above for the extra features and the three extra files required for compilation.

Here is a POPCNT compile, with the above-mentioned extra files and the patch in the src subdir. POPCNT is best for Ryzen, BMI will be significantly slower.

[syzygy]

Or just get a Stockfish variant/clone with LP support.

[Milos]

Or just get a Stockfish variant/clone with LP support.

Yea, just use Brainfish, it's the fastest compile with added support for LP and NUMA, plus the book, what more you can ask for?

[Eelco de Groot]

A book that you can't tune or add moves and lines to is terribly boring, IMO. There is editing software but it will probly be released in 2020 when it has solved chess If they think they are going to make money with that... No offence it is their hobby and it generates publicity for other products perhaps.

Brainfish as far as I know does not have Large Pages and special NUMA but you are a user of Brainfish so you should know. I have not seen anyone writing that though. Ronald's CFish does have NUMA and LP and so does asmFish. There is now an asmFish that uses the Cerebellum, in a slightly imperfect way but Thomas Zipproth has written pull request for version that test for moveloops and transpositions I think, or something of that nature. See Stefan Pohl's reporting.

[syzygy]

Brainfish as far as I know does not have Large Pages and special NUMA but you are a user of Brainfish so you should know. I have not seen anyone writing that though.

Brainfish does have LP: http://www.zipproth.de/#Brainfish_exe

"Large Pages" default = false

Activates Large Pages support for the Hashtable with faster access. May work only for some time after a windows restart because of memory fragmentation. The standard memory allocation fallback is activated automatically. Additional user rights like starting in Administrator mode may be necessary.

And Brainfish's misc.cpp includes fragments of NUMA code from Texel, so it seems safe to say it also supports NUMA.

[Eelco de Groot]

Thanks Ronald, I did not know, They are moving away further from Stockfish although they can still say it plays the same moves. It is logical to move to asmFish next. Can an assembler program still be considered GPL? I suppose so if it is possible to create it from some source? It is becoming harder to check clones though. Although, the functionality of a program is maybe shown better in the final assembler and it is not so easy to tinker with assembler. To make something really better. So that is some form of protection.

[Nordlandia]

Sugar support Large Pages.

I managed to get large page working on one laptop but not on my primary desktop computer.

I did everything in Houdini manual.

Code: Select all

To enable this feature in Windows, you need to modify the Group Policy for your
account:
1. Run: gpedit.msc (or search for "Group Policy").
2.Under "Computer Configuration", "Windows Settings", "Security Settings", "Local
Policies" click on "User Rights Assignment".
3. In the right pane double-click the option "Lock Pages in Memory".
4.Click on "Add User or Group" and add your account or "Everyone".
5. You may have to logoff or reboot for the change to take effect.

For some strange reasons it won't be activated.