pgn-extract filesize limitations

Discussion of chess software programming and technical issues.

Moderators: hgm, Rebel, chrisw

User avatar
jshriver
Posts: 1342
Joined: Wed Mar 08, 2006 9:41 pm
Location: Morgantown, WV, USA

pgn-extract filesize limitations

Post by jshriver »

Anyone know if there is a pgn filesize limitation in pgn-extract? Tried to open a 90gig pgn database I have and it keeps crashing

"Unable to open the PGN file: fics1199_0410.pgn"

-Josh
Dann Corbit
Posts: 12545
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: pgn-extract filesize limitations

Post by Dann Corbit »

jshriver wrote:Anyone know if there is a pgn filesize limitation in pgn-extract? Tried to open a 90gig pgn database I have and it keeps crashing

"Unable to open the PGN file: fics1199_0410.pgn"

-Josh
Try this one:
http://cap.connx.com/chess-engines/new- ... co-16-7.7z

It is compiled 64 bit and I have opened files that have tens of GB.
User avatar
jshriver
Posts: 1342
Joined: Wed Mar 08, 2006 9:41 pm
Location: Morgantown, WV, USA

Re: pgn-extract filesize limitations

Post by jshriver »

Thanks, unfortunately I'm not on a 64bit machine nor windows.

However I did find a workaround for the file size limitation. It can accept data via stdin so for a 90 gig file I just had to

cat huge.pgn | pgn-extract (whatever options)

Worked like a charm.
-Josh