Need Program For Comparing Hacked vs. Official Crafty

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Harvey Williamson, bob

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Post Reply
jack512
Posts: 19
Joined: Sat Nov 14, 2015 3:29 pm

Need Program For Comparing Hacked vs. Official Crafty

Post by jack512 » Mon Aug 08, 2016 1:32 pm

What is a good program for comparing two versions of Crafty (hacked vs. official)? I am running on Ubuntu Linux.

Also, what is considered a good comparison run? Obviously there is a tradeoff between short time control, which allows more games, vs. a longer time control representing tournament conditions. All I have is my 2 core 2.4GHz PC with 4GB memory.

bob
Posts: 20390
Joined: Mon Feb 27, 2006 6:30 pm
Location: Birmingham, AL

Re: Need Program For Comparing Hacked vs. Official Crafty

Post by bob » Mon Aug 08, 2016 5:32 pm

jack512 wrote:What is a good program for comparing two versions of Crafty (hacked vs. official)? I am running on Ubuntu Linux.

Also, what is considered a good comparison run? Obviously there is a tradeoff between short time control, which allows more games, vs. a longer time control representing tournament conditions. All I have is my 2 core 2.4GHz PC with 4GB memory.
Do you mean compare by playing games? xboard is the easiest option using match mode.

Time control depends on what you "hacked". I like Larry K's ratio of inc = 1/60th of base time. So 1min + 1 sec, or 30sec + .5sec, etc...

jack512
Posts: 19
Joined: Sat Nov 14, 2015 3:29 pm

Re: Need Program For Comparing Hacked vs. Official Crafty

Post by jack512 » Mon Aug 08, 2016 6:42 pm

Yes, compare by playing games is what I meant. Thx, I will get xboard.

My hack is to use a different opening book, and play this against the opening book that comes with Crafty. Out of OB, each side uses the official Crafty engine.

I'm not sure what you mean by inc. If I set time control with the Crafty command "time 90/30/sd/60;" like club play, I'm afraid it might take forever to do enough games to be statistically significant. On the other hand setting it too quick might not be realistic.
Thx, Jack Fishburn

jack512
Posts: 19
Joined: Sat Nov 14, 2015 3:29 pm

Re: Need Program For Comparing Hacked vs. Official Crafty

Post by jack512 » Mon Aug 08, 2016 6:53 pm

oops I meant "time 30/90/sd/60" (30 moves in 90 minutes then 60 minutes for rest of game)

Robert Pope
Posts: 498
Joined: Sat Mar 25, 2006 7:27 pm

Re: Need Program For Comparing Hacked vs. Official Crafty

Post by Robert Pope » Mon Aug 08, 2016 7:30 pm

jack512 wrote: My hack is to use a different opening book, and play this against the opening book that comes with Crafty. Out of OB, each side uses the official Crafty engine.

I'm not sure what you mean by inc. If I set time control with the Crafty command "time 90/30/sd/60;" like club play, I'm afraid it might take forever to do enough games to be statistically significant. On the other hand setting it too quick might not be realistic.
Thx, Jack Fishburn
Since you aren't changing the engine itself, you should be able to get by with a very fast time control. Like game in 5 seconds, not anything near club play or blitz.

bob
Posts: 20390
Joined: Mon Feb 27, 2006 6:30 pm
Location: Birmingham, AL

Re: Need Program For Comparing Hacked vs. Official Crafty

Post by bob » Mon Aug 08, 2016 9:40 pm

jack512 wrote:Yes, compare by playing games is what I meant. Thx, I will get xboard.

My hack is to use a different opening book, and play this against the opening book that comes with Crafty. Out of OB, each side uses the official Crafty engine.

I'm not sure what you mean by inc. If I set time control with the Crafty command "time 90/30/sd/60;" like club play, I'm afraid it might take forever to do enough games to be statistically significant. On the other hand setting it too quick might not be realistic.
Thx, Jack Fishburn
You can give xboard most any time control. You might try something like:

-mps 60 -tc 0:10 -inc 0.3

that gives 60 moves every 10 seconds with a 0.3 second increment...

User avatar
hgm
Posts: 23363
Joined: Fri Mar 10, 2006 9:06 am
Location: Amsterdam
Full name: H G Muller
Contact:

Re: Need Program For Comparing Hacked vs. Official Crafty

Post by hgm » Tue Aug 09, 2016 6:51 am

jack512 wrote:oops I meant "time 30/90/sd/60" (30 moves in 90 minutes then 60 minutes for rest of game)
Note that this is not a possible time control for WB engines. The only supported TC are N moves / M minutes repeating ('classical'), or M minutes base time + I seconds per move ('incremental' or 'sudden death').

XBoard's internal TC handling is already capable of doing multi-session time controls, but there just isn't a way to tell that to the engines.

User avatar
Evert
Posts: 2923
Joined: Fri Jan 21, 2011 11:42 pm
Location: NL
Contact:

Re: Need Program For Comparing Hacked vs. Official Crafty

Post by Evert » Tue Aug 09, 2016 4:42 pm

jack512 wrote: My hack is to use a different opening book, and play this against the opening book that comes with Crafty. Out of OB, each side uses the official Crafty engine.
I'd just like to point out that using a different opening book does not constitute "hacking" of a chess engine. You're just comparing the relative quality of the opening books.

jack512
Posts: 19
Joined: Sat Nov 14, 2015 3:29 pm

Re: Need Program For Comparing Hacked vs. Official Crafty

Post by jack512 » Tue Aug 30, 2016 6:10 pm

In the xboard I downloaded to Ubuntu Linux, the manpage says -inc disables -mps:

"-inc or -timeIncrement seconds. If this option is specified, `movesPerSession' is ignored. Instead, after each player's move, `timeIncrement' seconds are added to his clock."

I will try -tc 0:10 -inc 0.3

Post Reply