Testing tool!

Discussion of chess software programming and technical issues.

Moderator: Ras

Edsel Apostol
Posts: 803
Joined: Mon Jul 17, 2006 5:53 am
Full name: Edsel Apostol

Testing tool!

Post by Edsel Apostol »

Does anyone know of a tool, a commandline tool, that serves as a tournament manager for UCI engines? I want to test my engine without using a GUI. I don't want to watch the games, I just want to know the results. It would also make testing on very fast time control possible as the lag from a GUI would be minimized.
trojanfoe

Re: Testing tool!

Post by trojanfoe »

I have been thinking about this myself and I think the best option is to write your own, driven by some script or other. This 'UCI Test Harness' can then load up whatever engines you desire and set options/positions and store the results to log file, while you sleep/work/get on with the rest of your life. Such a tool might already exist, but I would doubt it.

Cheers,
Andy
User avatar
Denis P. Mendoza
Posts: 415
Joined: Fri Dec 15, 2006 9:46 pm
Location: Philippines

Re: Testing tool!

Post by Denis P. Mendoza »

Edsel Apostol wrote:Does anyone know of a tool, a commandline tool, that serves as a tournament manager for UCI engines? I want to test my engine without using a GUI. I don't want to watch the games, I just want to know the results. It would also make testing on very fast time control possible as the lag from a GUI would be minimized.
Ed,

The least I could say is use 'Autoit' based on Lyapko's technique or use the ultrafast approach of Marc Lacrosse here :
http://chessbazaar.mylivepage.com/file/ ... _utilities

But we still use the GUI! I'm still thinking of another way pal!

Denis
bob
Posts: 20943
Joined: Mon Feb 27, 2006 7:30 pm
Location: Birmingham, AL

Re: Testing tool!

Post by bob »

Denis P. Mendoza wrote:
Edsel Apostol wrote:Does anyone know of a tool, a commandline tool, that serves as a tournament manager for UCI engines? I want to test my engine without using a GUI. I don't want to watch the games, I just want to know the results. It would also make testing on very fast time control possible as the lag from a GUI would be minimized.
Ed,

The least I could say is use 'Autoit' based on Lyapko's technique or use the ultrafast approach of Marc Lacrosse here :
http://chessbazaar.mylivepage.com/file/ ... _utilities

But we still use the GUI! I'm still thinking of another way pal!

Denis
I could, at some point, release what I use. But I wrote it specifically for unix and not windows. And it is not a full tournament pairing and referee combined into one, it just plays the games and records the PGN results. But you have to tell it which two opponents to use, which starting position from the epd file to use, etc. But it will play the games with no GUI, which is why I wrote it as well, as on the cluster, playing 256 games results in 256 chess boards that have to be displayed somewhere, and that is overhead in the extreme.
Edsel Apostol
Posts: 803
Joined: Mon Jul 17, 2006 5:53 am
Full name: Edsel Apostol

Re: Testing tool!

Post by Edsel Apostol »

Thanks Kuya,

I will try to look at it. I can't seem to download the file as of the moment.
Edsel Apostol
Posts: 803
Joined: Mon Jul 17, 2006 5:53 am
Full name: Edsel Apostol

Re: Testing tool!

Post by Edsel Apostol »

Hi Bob,

Maybe you could release it as an open source. I'm wiling to port it myself to windows and add some features or maybe I could write my own and make your work as a basis for ideas.

As of now, I'm thinking of writing my own and maybe make it open source but I don't have experience yet with connecting two programs. I don't have yet the knowledge how two programs communicate with each other just like what the GUI and the engine is doing.
Edsel Apostol
Posts: 803
Joined: Mon Jul 17, 2006 5:53 am
Full name: Edsel Apostol

Re: Testing tool!

Post by Edsel Apostol »

Maybe someone has already this. It would save a lot of work and other programmers would benefit from it too.