Polyglot 2.0.3 memory limit
Moderators: hgm, Rebel, chrisw
-
- Posts: 1535
- Joined: Sun Oct 25, 2009 2:30 am
Polyglot 2.0.3 memory limit
When trying to make a big book, I get the "my_realloc(): realloc(): Not enough space" message, and the program stops. The last successful allocation of memory was 640 MB, which seems like quite a low usage, for an 8 GB 64bit system.
-
- Posts: 1564
- Joined: Thu Jul 16, 2009 10:47 am
- Location: Almere, The Netherlands
Re: Polyglot 2.0.3 memory limit
The problem is that it is a 32 bit build and it can never allocate more than 2 GB.Ozymandias wrote:When trying to make a big book, I get the "my_realloc(): realloc(): Not enough space" message, and the program stops. The last successful allocation of memory was 640 MB, which seems like quite a low usage, for an 8 GB 64bit system.
640 MB seems ok, I have no idea how big the next step is it tries.
I also stumbled on this a few times.
It should not be too difficult to make a 64 bit executable for it, but I never felt the need to spend time on it.
Maybe HGM can provide us with a 64 bit version.
-
- Posts: 1535
- Joined: Sun Oct 25, 2009 2:30 am
Re: Polyglot 2.0.3 memory limit
A meager 1280 MB is all it needs to fail, far from the 2GB limit. BTW, wasn't 4GB the limit for 32bit?Joost Buijs wrote:I have no idea how big the next step is it tries.
-
- Posts: 1564
- Joined: Thu Jul 16, 2009 10:47 am
- Location: Almere, The Netherlands
Re: Polyglot 2.0.3 memory limit
Yes, with 32 bit you would expect to have an address space of 4 GB.Ozymandias wrote:A meager 1280 MB is all it needs to fail, far from the 2GB limit. BTW, wasn't 4GB the limit for 32bit?Joost Buijs wrote:I have no idea how big the next step is it tries.
When you run under WOW64 it seems to depend upon whether the IMAGE_FILE_LARGE_ADDRESS_AWARE flag is set in the image header of the executable.
When this flag is not set you can only allocate 2 GB.
I have no idea how polyglot is compiled, only HGM knows.
-
- Posts: 1564
- Joined: Thu Jul 16, 2009 10:47 am
- Location: Almere, The Netherlands
Re: Polyglot 2.0.3 memory limit
Just for fun I downloaded the 2.0.3 source from git to build a 64 bit version.
Compiling it went very smoothly, right now my engine is playing with it on fics.
I haven't test the book functions, reading books seem ok though.
When you are interested I can put the 64 bit executable on dropbox.
Compiling it went very smoothly, right now my engine is playing with it on fics.
I haven't test the book functions, reading books seem ok though.
When you are interested I can put the 64 bit executable on dropbox.
-
- Posts: 27809
- Joined: Fri Mar 10, 2006 10:06 am
- Location: Amsterdam
- Full name: H G Muller
Re: Polyglot 2.0.3 memory limit
The address space of a 32-bit program is 4GB, but that doesn't mean it is all available for allocation. I don't think I was ever able to allocate more than 1GB.
I don't have a 64-bit compiler for windows, so the Polyglot I include with WinBoard is 32 bit. It is included with WinBoard for use as an adapter to run UCI engines. Not for the purpose of making books.
I don't have a 64-bit compiler for windows, so the Polyglot I include with WinBoard is 32 bit. It is included with WinBoard for use as an adapter to run UCI engines. Not for the purpose of making books.
-
- Posts: 1535
- Joined: Sun Oct 25, 2009 2:30 am
Re: Polyglot 2.0.3 memory limit
I'm already interestedJoost Buijs wrote:When you are interested I can put the 64 bit executable on dropbox.
-
- Posts: 1535
- Joined: Sun Oct 25, 2009 2:30 am
Re: Polyglot 2.0.3 memory limit
So, for book making, it isn't different than version 1.4, would that be correct?hgm wrote:the Polyglot I include with WinBoard is 32 bit. It is included with WinBoard for use as an adapter to run UCI engines. Not for the purpose of making books.
-
- Posts: 27809
- Joined: Fri Mar 10, 2006 10:06 am
- Location: Amsterdam
- Full name: H G Muller
Re: Polyglot 2.0.3 memory limit
Correct.
-
- Posts: 1564
- Joined: Thu Jul 16, 2009 10:47 am
- Location: Almere, The Netherlands
Re: Polyglot 2.0.3 memory limit
Ok, this is the link:Ozymandias wrote:I'm already interestedJoost Buijs wrote:When you are interested I can put the 64 bit executable on dropbox.
https://www.dropbox.com/s/3ap93gwgp5whn ... t.rar?dl=0
I hope this version is able to allocate more memory, if not I have to take a look at the source to see what is actually happening.