Cutechess-cli 0.5.0 released for all target platforms

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

User avatar
ilari
Posts: 750
Joined: Mon Mar 27, 2006 7:45 pm
Location: Finland

Cutechess-cli 0.5.0 released for all target platforms

Post by ilari »

Finally got back home and got a chance to compile the latest Cutechess-cli for Windows 32-bit and Mac OSX 64-bit (yes, the Mac version finally makes a comeback!). The Linux versions were released earlier, but I may as well repeat what was said in the other thread:

What's new:
* Bugfix: repetitions are not played directly from opening books
* Negative numbers are not interpreted as parameter names
* New "restart" mode: by setting the restart mode the user can control whether or not an engine is restarted between games.
* Bugfix: set the UCI_Opponent option with correct syntax
* "infinite" is no longer combined with "depth" or "nodes" in UCI "go" command. Now the "go" command should be compatible with all UCI engines.
* Support for XBoard's "nps" command. The implementation was designed to work in combination with an infinite time control (which won't be sent to the engine). Using other time controls is not recommended. Also, the engine must support the "nps" command.
* The "cmd=" engine option accepts relative file paths
* Round-Robin tournaments with two or more engines.

Obviously the biggest feature is tournament support. To make it possible/sensible some options were
changed:

* The "-fcp" and "-scp" options were removed. The new "-engine" option
should be used instead - one "-engine" block for each participant.

* The "-both" option was renamed to "-each".

* The "-ratinginterval <n>" option can be used to display a rating list after every <n> games. By default the ratings are only displayed when the tournament finishes. It uses a simple algorithm that's not as good as BayesELO, but it's better than nothing.

* The "-games" option sets the number of games per encounter to <n>. It doesn't affect the number of tournament rounds.

* The "-rounds <n>" option sets the multiplier for the number of rounds to play to <n>.

* The glue script for CLOP was modified to work with the new option names. The script is included in the compressed package.

As always, the packages are available here:
Linux 32-bit
Linux 64-bit
Windows 32-bit
Mac OSX 64-bit

Source code here:
http://repo.or.cz/w/sloppygui.git
Engin
Posts: 918
Joined: Mon Jan 05, 2009 7:40 pm
Location: Germany
Full name: Engin Üstün

Re: Cutechess-cli 0.5.0 released for all target platforms

Post by Engin »

very good news, thx ;)
Engin
Posts: 918
Joined: Mon Jan 05, 2009 7:40 pm
Location: Germany
Full name: Engin Üstün

Re: Cutechess-cli 0.5.0 released for all target platforms

Post by Engin »

mcostalba
Posts: 2684
Joined: Sat Jun 14, 2008 9:17 pm

Re: Cutechess-cli 0.5.0 released for all target platforms

Post by mcostalba »

ilari wrote: * The "-ratinginterval <n>" option can be used to display a rating list after every <n> games. By default the ratings are only displayed when the tournament finishes. It uses a simple algorithm that's not as good as BayesELO, but it's better than nothing.
Thanks Ilari, it is always a great news when a new version of cutechess-cli si available, although normally I pull directly from the repo.

As perhaps you know in these days I was having trouble with time issues in Stockfish and I found very handy the output of your competitor LittleBlitzer that shows the reasons for every lose (mate, out of time, adjudicated) or draw (repetition, stale, 50 rule, no material to mate) together with current score, so that after every game I am able to immediately see what happened so far in particular I have been very interested to game lost due to out of time. I think this information can be very helpful for the engine developers so what about to add ? :-)

Thanks
Marco
zullil
Posts: 6442
Joined: Tue Jan 09, 2007 12:31 am
Location: PA USA
Full name: Louis Zulli

Re: Cutechess-cli 0.5.0 released for all target platforms

Post by zullil »

mcostalba wrote:
ilari wrote: * The "-ratinginterval <n>" option can be used to display a rating list after every <n> games. By default the ratings are only displayed when the tournament finishes. It uses a simple algorithm that's not as good as BayesELO, but it's better than nothing.
Thanks Ilari, it is always a great news when a new version of cutechess-cli si available, although normally I pull directly from the repo.

As perhaps you know in these days I was having trouble with time issues in Stockfish and I found very handy the output of your competitor LittleBlitzer that shows the reasons for every lose (mate, out of time, adjudicated) or draw (repetition, stale, 50 rule, no material to mate) together with current score, so that after every game I am able to immediately see what happened so far in particular I have been very interested to game lost due to out of time. I think this information can be very helpful for the engine developers so what about to add ? :-)

Thanks
Marco
Hi Marco,

I just used the latest cutechess-cli for a number of 100 game matches, and after each game the console showed the result: White mates, Black mates, draw by stalemate, insufficient material, etc, as well as the current score. So I'm confused by your post.
Engin
Posts: 918
Joined: Mon Jan 05, 2009 7:40 pm
Location: Germany
Full name: Engin Üstün

Re: Cutechess-cli 0.5.0 released for all target platforms

Post by Engin »

he means you should add if a game is losed on time too!

i want also more informations about results what happens on the games, not only white mate, black mate, draw by....

that is why i like to use littleblitzer more then cutechess cli
zullil
Posts: 6442
Joined: Tue Jan 09, 2007 12:31 am
Location: PA USA
Full name: Louis Zulli

Re: Cutechess-cli 0.5.0 released for all target platforms

Post by zullil »

Here's a small sample:

Code: Select all

Started game 1 of 100 &#40;Stockfish-2.2 vs Critter-1.4&#41;
Finished game 1 &#40;Stockfish-2.2 vs Critter-1.4&#41;&#58; 0-1 &#123;Black mates&#125;
Score of Stockfish-2.2 vs Critter-1.4&#58; 0 - 1 - 0  &#91;0.00&#93; 1
Started game 2 of 100 &#40;Critter-1.4 vs Stockfish-2.2&#41;
Finished game 2 &#40;Critter-1.4 vs Stockfish-2.2&#41;&#58; 0-1 &#123;Black mates&#125;
Score of Stockfish-2.2 vs Critter-1.4&#58; 1 - 1 - 0  &#91;0.50&#93; 2
Started game 3 of 100 &#40;Stockfish-2.2 vs Critter-1.4&#41;
Finished game 3 &#40;Stockfish-2.2 vs Critter-1.4&#41;&#58; 0-1 &#123;Black mates&#125;
Score of Stockfish-2.2 vs Critter-1.4&#58; 1 - 2 - 0  &#91;0.33&#93; 3
Started game 4 of 100 &#40;Critter-1.4 vs Stockfish-2.2&#41;
Finished game 4 &#40;Critter-1.4 vs Stockfish-2.2&#41;&#58; 1-0 &#123;White mates&#125;
Score of Stockfish-2.2 vs Critter-1.4&#58; 1 - 3 - 0  &#91;0.25&#93; 4
Started game 5 of 100 &#40;Stockfish-2.2 vs Critter-1.4&#41;
Finished game 5 &#40;Stockfish-2.2 vs Critter-1.4&#41;&#58; 0-1 &#123;Black mates&#125;
Score of Stockfish-2.2 vs Critter-1.4&#58; 1 - 4 - 0  &#91;0.20&#93; 5
Started game 6 of 100 &#40;Critter-1.4 vs Stockfish-2.2&#41;
Finished game 6 &#40;Critter-1.4 vs Stockfish-2.2&#41;&#58; 1/2-1/2 &#123;Draw by insufficient mating material&#125;
Score of Stockfish-2.2 vs Critter-1.4&#58; 1 - 4 - 1  &#91;0.25&#93; 6
Started game 7 of 100 &#40;Stockfish-2.2 vs Critter-1.4&#41;
Finished game 7 &#40;Stockfish-2.2 vs Critter-1.4&#41;&#58; 0-1 &#123;Black mates&#125;
Score of Stockfish-2.2 vs Critter-1.4&#58; 1 - 5 - 1  &#91;0.21&#93; 7
Started game 8 of 100 &#40;Critter-1.4 vs Stockfish-2.2&#41;
Finished game 8 &#40;Critter-1.4 vs Stockfish-2.2&#41;&#58; 1/2-1/2 &#123;Draw by 3-fold repetition&#125;
Score of Stockfish-2.2 vs Critter-1.4&#58; 1 - 5 - 2  &#91;0.25&#93; 8
Started game 9 of 100 &#40;Stockfish-2.2 vs Critter-1.4&#41;
Finished game 9 &#40;Stockfish-2.2 vs Critter-1.4&#41;&#58; 1-0 &#123;White mates&#125;
Score of Stockfish-2.2 vs Critter-1.4&#58; 2 - 5 - 2  &#91;0.33&#93; 9
Started game 10 of 100 &#40;Critter-1.4 vs Stockfish-2.2&#41;
Finished game 10 &#40;Critter-1.4 vs Stockfish-2.2&#41;&#58; 1-0 &#123;White mates&#125;
Score of Stockfish-2.2 vs Critter-1.4&#58; 2 - 6 - 2  &#91;0.30&#93; 10
mcostalba
Posts: 2684
Joined: Sat Jun 14, 2008 9:17 pm

Re: Cutechess-cli 0.5.0 released for all target platforms

Post by mcostalba »

zullil wrote:Here's a small sample:

Code: Select all

Score of Stockfish-2.2 vs Critter-1.4&#58; 2 - 6 - 2  &#91;0.30&#93; 10
What I think would be useful is something like:

Code: Select all

Score of Stockfish-2.2 vs Critter-1.4&#58; 2 - 6 - 2  &#91;0.30&#93; 10 &#40;m=1,t=1&#41;, &#40;m=2,t=0&#41;
See LittleBlitzer for some reference: it is better than my explanations.
User avatar
ilari
Posts: 750
Joined: Mon Mar 27, 2006 7:45 pm
Location: Finland

Re: Cutechess-cli 0.5.0 released for all target platforms

Post by ilari »

mcostalba wrote:
zullil wrote:Here's a small sample:

Code: Select all

Score of Stockfish-2.2 vs Critter-1.4&#58; 2 - 6 - 2  &#91;0.30&#93; 10
What I think would be useful is something like:

Code: Select all

Score of Stockfish-2.2 vs Critter-1.4&#58; 2 - 6 - 2  &#91;0.30&#93; 10 &#40;m=1,t=1&#41;, &#40;m=2,t=0&#41;
See LittleBlitzer for some reference: it is better than my explanations.
Ah, okay, I was a bit confused as well. I can add statistics like that, sure.
Engin wrote:he means you should add if a game is losed on time too!
Cutechess-cli does display a "X loses on time" when a player's flag falls.
Engin wrote:i want also more informations about results what happens on the games, not only white mate, black mate, draw by....
I guess I'll have to try LittleBlitzer myself...