Page 1 of 1

Cutechess-cli 0.5.0 released for all target platforms

Posted: Tue Dec 27, 2011 7:55 pm
by ilari
Finally got back home and got a chance to compile the latest Cutechess-cli for Windows 32-bit and Mac OSX 64-bit (yes, the Mac version finally makes a comeback!). The Linux versions were released earlier, but I may as well repeat what was said in the other thread:

What's new:
* Bugfix: repetitions are not played directly from opening books
* Negative numbers are not interpreted as parameter names
* New "restart" mode: by setting the restart mode the user can control whether or not an engine is restarted between games.
* Bugfix: set the UCI_Opponent option with correct syntax
* "infinite" is no longer combined with "depth" or "nodes" in UCI "go" command. Now the "go" command should be compatible with all UCI engines.
* Support for XBoard's "nps" command. The implementation was designed to work in combination with an infinite time control (which won't be sent to the engine). Using other time controls is not recommended. Also, the engine must support the "nps" command.
* The "cmd=" engine option accepts relative file paths
* Round-Robin tournaments with two or more engines.

Obviously the biggest feature is tournament support. To make it possible/sensible some options were
changed:

* The "-fcp" and "-scp" options were removed. The new "-engine" option
should be used instead - one "-engine" block for each participant.

* The "-both" option was renamed to "-each".

* The "-ratinginterval <n>" option can be used to display a rating list after every <n> games. By default the ratings are only displayed when the tournament finishes. It uses a simple algorithm that's not as good as BayesELO, but it's better than nothing.

* The "-games" option sets the number of games per encounter to <n>. It doesn't affect the number of tournament rounds.

* The "-rounds <n>" option sets the multiplier for the number of rounds to play to <n>.

* The glue script for CLOP was modified to work with the new option names. The script is included in the compressed package.

As always, the packages are available here:
Linux 32-bit
Linux 64-bit
Windows 32-bit
Mac OSX 64-bit

Source code here:
http://repo.or.cz/w/sloppygui.git

Re: Cutechess-cli 0.5.0 released for all target platforms

Posted: Tue Dec 27, 2011 9:19 pm
by Engin
very good news, thx ;)

Re: Cutechess-cli 0.5.0 released for all target platforms

Posted: Fri Jan 06, 2012 12:39 am
by Engin

Re: Cutechess-cli 0.5.0 released for all target platforms

Posted: Fri Jan 06, 2012 2:02 am
by mcostalba
ilari wrote: * The "-ratinginterval <n>" option can be used to display a rating list after every <n> games. By default the ratings are only displayed when the tournament finishes. It uses a simple algorithm that's not as good as BayesELO, but it's better than nothing.
Thanks Ilari, it is always a great news when a new version of cutechess-cli si available, although normally I pull directly from the repo.

As perhaps you know in these days I was having trouble with time issues in Stockfish and I found very handy the output of your competitor LittleBlitzer that shows the reasons for every lose (mate, out of time, adjudicated) or draw (repetition, stale, 50 rule, no material to mate) together with current score, so that after every game I am able to immediately see what happened so far in particular I have been very interested to game lost due to out of time. I think this information can be very helpful for the engine developers so what about to add ? :-)

Thanks
Marco

Re: Cutechess-cli 0.5.0 released for all target platforms

Posted: Fri Jan 06, 2012 2:53 am
by zullil
mcostalba wrote:
ilari wrote: * The "-ratinginterval <n>" option can be used to display a rating list after every <n> games. By default the ratings are only displayed when the tournament finishes. It uses a simple algorithm that's not as good as BayesELO, but it's better than nothing.
Thanks Ilari, it is always a great news when a new version of cutechess-cli si available, although normally I pull directly from the repo.

As perhaps you know in these days I was having trouble with time issues in Stockfish and I found very handy the output of your competitor LittleBlitzer that shows the reasons for every lose (mate, out of time, adjudicated) or draw (repetition, stale, 50 rule, no material to mate) together with current score, so that after every game I am able to immediately see what happened so far in particular I have been very interested to game lost due to out of time. I think this information can be very helpful for the engine developers so what about to add ? :-)

Thanks
Marco
Hi Marco,

I just used the latest cutechess-cli for a number of 100 game matches, and after each game the console showed the result: White mates, Black mates, draw by stalemate, insufficient material, etc, as well as the current score. So I'm confused by your post.

Re: Cutechess-cli 0.5.0 released for all target platforms

Posted: Fri Jan 06, 2012 3:26 am
by Engin
he means you should add if a game is losed on time too!

i want also more informations about results what happens on the games, not only white mate, black mate, draw by....

that is why i like to use littleblitzer more then cutechess cli

Re: Cutechess-cli 0.5.0 released for all target platforms

Posted: Fri Jan 06, 2012 3:37 am
by zullil
Here's a small sample:

Code: Select all

Started game 1 of 100 &#40;Stockfish-2.2 vs Critter-1.4&#41;
Finished game 1 &#40;Stockfish-2.2 vs Critter-1.4&#41;&#58; 0-1 &#123;Black mates&#125;
Score of Stockfish-2.2 vs Critter-1.4&#58; 0 - 1 - 0  &#91;0.00&#93; 1
Started game 2 of 100 &#40;Critter-1.4 vs Stockfish-2.2&#41;
Finished game 2 &#40;Critter-1.4 vs Stockfish-2.2&#41;&#58; 0-1 &#123;Black mates&#125;
Score of Stockfish-2.2 vs Critter-1.4&#58; 1 - 1 - 0  &#91;0.50&#93; 2
Started game 3 of 100 &#40;Stockfish-2.2 vs Critter-1.4&#41;
Finished game 3 &#40;Stockfish-2.2 vs Critter-1.4&#41;&#58; 0-1 &#123;Black mates&#125;
Score of Stockfish-2.2 vs Critter-1.4&#58; 1 - 2 - 0  &#91;0.33&#93; 3
Started game 4 of 100 &#40;Critter-1.4 vs Stockfish-2.2&#41;
Finished game 4 &#40;Critter-1.4 vs Stockfish-2.2&#41;&#58; 1-0 &#123;White mates&#125;
Score of Stockfish-2.2 vs Critter-1.4&#58; 1 - 3 - 0  &#91;0.25&#93; 4
Started game 5 of 100 &#40;Stockfish-2.2 vs Critter-1.4&#41;
Finished game 5 &#40;Stockfish-2.2 vs Critter-1.4&#41;&#58; 0-1 &#123;Black mates&#125;
Score of Stockfish-2.2 vs Critter-1.4&#58; 1 - 4 - 0  &#91;0.20&#93; 5
Started game 6 of 100 &#40;Critter-1.4 vs Stockfish-2.2&#41;
Finished game 6 &#40;Critter-1.4 vs Stockfish-2.2&#41;&#58; 1/2-1/2 &#123;Draw by insufficient mating material&#125;
Score of Stockfish-2.2 vs Critter-1.4&#58; 1 - 4 - 1  &#91;0.25&#93; 6
Started game 7 of 100 &#40;Stockfish-2.2 vs Critter-1.4&#41;
Finished game 7 &#40;Stockfish-2.2 vs Critter-1.4&#41;&#58; 0-1 &#123;Black mates&#125;
Score of Stockfish-2.2 vs Critter-1.4&#58; 1 - 5 - 1  &#91;0.21&#93; 7
Started game 8 of 100 &#40;Critter-1.4 vs Stockfish-2.2&#41;
Finished game 8 &#40;Critter-1.4 vs Stockfish-2.2&#41;&#58; 1/2-1/2 &#123;Draw by 3-fold repetition&#125;
Score of Stockfish-2.2 vs Critter-1.4&#58; 1 - 5 - 2  &#91;0.25&#93; 8
Started game 9 of 100 &#40;Stockfish-2.2 vs Critter-1.4&#41;
Finished game 9 &#40;Stockfish-2.2 vs Critter-1.4&#41;&#58; 1-0 &#123;White mates&#125;
Score of Stockfish-2.2 vs Critter-1.4&#58; 2 - 5 - 2  &#91;0.33&#93; 9
Started game 10 of 100 &#40;Critter-1.4 vs Stockfish-2.2&#41;
Finished game 10 &#40;Critter-1.4 vs Stockfish-2.2&#41;&#58; 1-0 &#123;White mates&#125;
Score of Stockfish-2.2 vs Critter-1.4&#58; 2 - 6 - 2  &#91;0.30&#93; 10

Re: Cutechess-cli 0.5.0 released for all target platforms

Posted: Fri Jan 06, 2012 10:10 am
by mcostalba
zullil wrote:Here's a small sample:

Code: Select all

Score of Stockfish-2.2 vs Critter-1.4&#58; 2 - 6 - 2  &#91;0.30&#93; 10
What I think would be useful is something like:

Code: Select all

Score of Stockfish-2.2 vs Critter-1.4&#58; 2 - 6 - 2  &#91;0.30&#93; 10 &#40;m=1,t=1&#41;, &#40;m=2,t=0&#41;
See LittleBlitzer for some reference: it is better than my explanations.

Re: Cutechess-cli 0.5.0 released for all target platforms

Posted: Fri Jan 06, 2012 11:25 am
by ilari
mcostalba wrote:
zullil wrote:Here's a small sample:

Code: Select all

Score of Stockfish-2.2 vs Critter-1.4&#58; 2 - 6 - 2  &#91;0.30&#93; 10
What I think would be useful is something like:

Code: Select all

Score of Stockfish-2.2 vs Critter-1.4&#58; 2 - 6 - 2  &#91;0.30&#93; 10 &#40;m=1,t=1&#41;, &#40;m=2,t=0&#41;
See LittleBlitzer for some reference: it is better than my explanations.
Ah, okay, I was a bit confused as well. I can add statistics like that, sure.
Engin wrote:he means you should add if a game is losed on time too!
Cutechess-cli does display a "X loses on time" when a player's flag falls.
Engin wrote:i want also more informations about results what happens on the games, not only white mate, black mate, draw by....
I guess I'll have to try LittleBlitzer myself...