That looks really nice. How do you supply test binaries? It seems you use branches in git so I assume it just fetches the branches and rebuilds on client?AndrewGrant wrote: ↑Mon Oct 01, 2018 12:51 am My instance is running here http://chess.grantnet.us/index/ , if you want to get an idea of the work flow.
You would be able to connect any of your machines, and the results will be collected together.
Time controls will be scaled per CPU, IE in the case that one machine is faster or something of the sort.
In case its not clear, I wrote OpenBench
Basic automated testing
Moderators: hgm, Rebel, chrisw
-
- Posts: 2554
- Joined: Fri Nov 26, 2010 2:00 pm
- Location: Czech Republic
- Full name: Martin Sedlak
Re: Basic automated testing
Martin Sedlak
-
- Posts: 1752
- Joined: Tue Apr 19, 2016 6:08 am
- Location: U.S.A
- Full name: Andrew Grant
Re: Basic automated testing
Correct. OpenBench assumes that gcc/g++ and make are on the system path. It will pull down a zip file from github -- no actual git comments are taking place.mar wrote: ↑Mon Oct 01, 2018 3:37 pmThat looks really nice. How do you supply test binaries? It seems you use branches in git so I assume it just fetches the branches and rebuilds on client?AndrewGrant wrote: ↑Mon Oct 01, 2018 12:51 am My instance is running here http://chess.grantnet.us/index/ , if you want to get an idea of the work flow.
You would be able to connect any of your machines, and the results will be collected together.
Time controls will be scaled per CPU, IE in the case that one machine is faster or something of the sort.
In case its not clear, I wrote OpenBench
#WeAreAllDraude #JusticeForDraude #RememberDraude #LeptirBigUltra
"Those who can't do, clone instead" - Eduard ( A real life friend, not this forum's Eduard )
"Those who can't do, clone instead" - Eduard ( A real life friend, not this forum's Eduard )
-
- Posts: 1752
- Joined: Tue Apr 19, 2016 6:08 am
- Location: U.S.A
- Full name: Andrew Grant
Re: Basic automated testing
Thanks. The same can be said for Andscacscdani wrote: ↑Mon Oct 01, 2018 5:53 amI knew you have it, but I find is good time to congratulate you for your nice and interesting work!AndrewGrant wrote: ↑Mon Oct 01, 2018 12:51 amMy instance is running here http://chess.grantnet.us/index/ , if you want to get an idea of the work flow.mar wrote: ↑Sun Sep 30, 2018 10:40 pmInteresting, what does this OpenBench do exactly? It seems like a wrapper on top of cutechess-cli with some client-server functionality.
If it allows me say to test on say two quads at the same time + gather the results then this would cut my testing time in half,
which sounds really interesting.
You would be able to connect any of your machines, and the results will be collected together.
Time controls will be scaled per CPU, IE in the case that one machine is faster or something of the sort.
In case its not clear, I wrote OpenBench
#WeAreAllDraude #JusticeForDraude #RememberDraude #LeptirBigUltra
"Those who can't do, clone instead" - Eduard ( A real life friend, not this forum's Eduard )
"Those who can't do, clone instead" - Eduard ( A real life friend, not this forum's Eduard )
-
- Posts: 4366
- Joined: Fri Mar 10, 2006 5:23 am
- Location: http://www.arasanchess.org
Re: Basic automated testing
They are pretty simple. They distribute a compiled binary to a set of directories on a set of networked machines. Then they run a bunch of parallel matches on each machine. Then they gather all the completed games into a big game file and run BayesELO on it.What do your cutechess-cli scripts do? This might be what I am looking for (OpenBench looks too advanced for my current needs)
Unfortunately I have not bothered to make them very portable or reusable, so they have some hardcoded machine names, paths, etc.
--Jon