bayeselo games limit ?

[bob]

I can use elostat to process the same pgn so i dont think that is the problem. But you are right 10k is not the limit. For another pgn it did well upto 43k and failed These random problem happen for big files so I will try breaking them down..

There is simply something wrong with your PGN. Whether you have an EOF character (windows) or what I don't know, but a single test run on my cluster is 30K games, and I have run over 100 tests in one PGN batch, giving me 3M games, and BayesElo has no problem at all with that.

[Daniel Shawul]

You are right, it looks like EOF issue. The pgn which is produced by cutechess-cli can be processed by Arena,windboard, Scid and others I tried with no problem. Bayeselo is the only one that didnt work which seems very strict on this issue. Once I pass it through Scid and saved it to another file, it processed all 64k games... I will see if I can make cutechess-cli produce the correct type of file because I want to measure elo while the games are going on, not post-process.

[Dann Corbit]

Is there a limit on the max number of games?. I am doing very fast games and the games pgn builds up quite quickly and it seems bayeselo can't handle more than 10000 games. Is that so ? Also is there a way to make it work by giving it only the number of wins/losses/draws ?

Thanks

I ran 9 million games once, IIRC.

It takes a very long time to process.

[Don]

You are right, it looks like EOF issue. The pgn which is produced by cutechess-cli can be processed by Arena,windboard, Scid and others I tried with no problem. Bayeselo is the only one that didnt work which seems very strict on this issue. Once I pass it through Scid and saved it to another file, it processed all 64k games... I will see if I can make cutechess-cli produce the correct type of file because I want to measure elo while the games are going on, not post-process.

Or pass it to pgn-extract - an awesome utility for processing PGN files.

[Rémi Coulom]

There is no limit in bayeselo. Parsing probably stopped because of something wrong in the PGN. If you send it to me, I can take a look.

Rémi

[Daniel Shawul]

Pgn sent.
I am using mutiple instances (processes) of cutechess-cli which write their games to the same PGN file.
At fast time controls this sometimes looses a couple of games and probably screws the format too ..

[jwes]

Pgn sent.
I am using mutiple instances (processes) of cutechess-cli which write their games to the same PGN file.
At fast time controls this sometimes looses a couple of games and probably screws the format too ..

This seems like a bad idea in general. Can't you write to different files and have a script that concatenates them?

[FrancoisK]

I currently use it for millions of games, but they are divided into several pgns. (up to 512000 games per PGN if i am not mistaken).
Never found any limit so far, but it is slow of course as it has to parse PGNs (between half an hour and one hour to read all pgns). I would also be very interested if it could take result grids as input instead of full pgns.

It only takes about 30 seconds to parse a million games on our cluster "head" node during my testing...

Well i guess it means my hard disk is getting really really old and fragmented (and my computer very slow). Have you also extended pgn info (in the winboard sense) ? I have.

[Rémi Coulom]

Pgn sent.

Not received. Spam filtering @univ-lille3.fr is a bit too aggressive sometimes. Please try my gmail address (Remi.Coulom@...)

Rémi

[Rémi Coulom]

At fast time controls this sometimes looses a couple of games and probably screws the format too ..

This looks like a very likely source of the problem.

Rémi