Testing tool!
Moderator: Ras
-
- Posts: 803
- Joined: Mon Jul 17, 2006 5:53 am
- Full name: Edsel Apostol
Testing tool!
Does anyone know of a tool, a commandline tool, that serves as a tournament manager for UCI engines? I want to test my engine without using a GUI. I don't want to watch the games, I just want to know the results. It would also make testing on very fast time control possible as the lag from a GUI would be minimized.
Edsel Apostol
https://github.com/ed-apostol/InvictusChess
https://github.com/ed-apostol/InvictusChess
Re: Testing tool!
I have been thinking about this myself and I think the best option is to write your own, driven by some script or other. This 'UCI Test Harness' can then load up whatever engines you desire and set options/positions and store the results to log file, while you sleep/work/get on with the rest of your life. Such a tool might already exist, but I would doubt it.
Cheers,
Andy
Cheers,
Andy
-
- Posts: 415
- Joined: Fri Dec 15, 2006 9:46 pm
- Location: Philippines
Re: Testing tool!
Ed,Edsel Apostol wrote:Does anyone know of a tool, a commandline tool, that serves as a tournament manager for UCI engines? I want to test my engine without using a GUI. I don't want to watch the games, I just want to know the results. It would also make testing on very fast time control possible as the lag from a GUI would be minimized.
The least I could say is use 'Autoit' based on Lyapko's technique or use the ultrafast approach of Marc Lacrosse here :
http://chessbazaar.mylivepage.com/file/ ... _utilities
But we still use the GUI! I'm still thinking of another way pal!
Denis
e-mail: computer.chess@hotmail.com
-
- Posts: 20943
- Joined: Mon Feb 27, 2006 7:30 pm
- Location: Birmingham, AL
Re: Testing tool!
I could, at some point, release what I use. But I wrote it specifically for unix and not windows. And it is not a full tournament pairing and referee combined into one, it just plays the games and records the PGN results. But you have to tell it which two opponents to use, which starting position from the epd file to use, etc. But it will play the games with no GUI, which is why I wrote it as well, as on the cluster, playing 256 games results in 256 chess boards that have to be displayed somewhere, and that is overhead in the extreme.Denis P. Mendoza wrote:Ed,Edsel Apostol wrote:Does anyone know of a tool, a commandline tool, that serves as a tournament manager for UCI engines? I want to test my engine without using a GUI. I don't want to watch the games, I just want to know the results. It would also make testing on very fast time control possible as the lag from a GUI would be minimized.
The least I could say is use 'Autoit' based on Lyapko's technique or use the ultrafast approach of Marc Lacrosse here :
http://chessbazaar.mylivepage.com/file/ ... _utilities
But we still use the GUI! I'm still thinking of another way pal!
Denis
-
- Posts: 803
- Joined: Mon Jul 17, 2006 5:53 am
- Full name: Edsel Apostol
Re: Testing tool!
Thanks Kuya,
I will try to look at it. I can't seem to download the file as of the moment.
I will try to look at it. I can't seem to download the file as of the moment.
Edsel Apostol
https://github.com/ed-apostol/InvictusChess
https://github.com/ed-apostol/InvictusChess
-
- Posts: 803
- Joined: Mon Jul 17, 2006 5:53 am
- Full name: Edsel Apostol
Re: Testing tool!
Hi Bob,
Maybe you could release it as an open source. I'm wiling to port it myself to windows and add some features or maybe I could write my own and make your work as a basis for ideas.
As of now, I'm thinking of writing my own and maybe make it open source but I don't have experience yet with connecting two programs. I don't have yet the knowledge how two programs communicate with each other just like what the GUI and the engine is doing.
Maybe you could release it as an open source. I'm wiling to port it myself to windows and add some features or maybe I could write my own and make your work as a basis for ideas.
As of now, I'm thinking of writing my own and maybe make it open source but I don't have experience yet with connecting two programs. I don't have yet the knowledge how two programs communicate with each other just like what the GUI and the engine is doing.
Edsel Apostol
https://github.com/ed-apostol/InvictusChess
https://github.com/ed-apostol/InvictusChess
-
- Posts: 803
- Joined: Mon Jul 17, 2006 5:53 am
- Full name: Edsel Apostol
Re: Testing tool!
Maybe someone has already this. It would save a lot of work and other programmers would benefit from it too.
Edsel Apostol
https://github.com/ed-apostol/InvictusChess
https://github.com/ed-apostol/InvictusChess