Beta for Stockfish distributed testing

[gladius]

If you have at least 4 spare cores, preferably running Linux (but not required) Stockfish would love to get your help! We are testing changes with thousands of games, and the more cpu power, the faster Stockfish will improve . If you are interested, please e-mail me at glinscott@gmail.com.

The current queue of tests for Stockfish is up at http://54.235.120.254:6543/tests. Please note, operations like start run, delete run, etc. are restricted.

Technical details:
Over the past few weeks, we've put together a distributed testing framework. It is written in Python, has a web interface backed by MongoDb for storing results. Clients get tasks from a REST API, and use cutechess-cli to run the actual games. Source is up on github here: https://github.com/glinscott/fishtest.

Thanks,
Gary

[Daniel Shawul]

Is that like SETI, the search for extraterestrial ELO Sorry i couldn't resist.
Great work!

[Aaron Becker]

This looks really great; I'd like to use it in my testing for Daydreamer. If you like, I'd be happy to contribute any modifications back upstream. Thanks for making this publicly available.

[ThomasJMiller]

Very interesting project Gary! So this is what you were talking about some days ago @TCEC. I hope we'll soon have a stronger Stockfish!

[lucasart]

If you have at least 4 spare cores, preferably running Linux (but not required) Stockfish would love to get your help! We are testing changes with thousands of games, and the more cpu power, the faster Stockfish will improve . If you are interested, please e-mail me at glinscott@gmail.com.

The current queue of tests for Stockfish is up at http://54.235.120.254:6543/tests. Please note, operations like start run, delete run, etc. are restricted.

Technical details:
Over the past few weeks, we've put together a distributed testing framework. It is written in Python, has a web interface backed by MongoDb for storing results. Clients get tasks from a REST API, and use cutechess-cli to run the actual games. Source is up on github here: https://github.com/glinscott/fishtest.

Thanks,
Gary

Great work. You've really industrialized the process

I'll gladly contribute to the testing.

[gladius]

This looks really great; I'd like to use it in my testing for Daydreamer. If you like, I'd be happy to contribute any modifications back upstream. Thanks for making this publicly available.

Great! Yes, would love to have more folks working on it .

[gladius]

If you have at least 4 spare cores, preferably running Linux (but not required) Stockfish would love to get your help! We are testing changes with thousands of games, and the more cpu power, the faster Stockfish will improve . If you are interested, please e-mail me at glinscott@gmail.com.

The current queue of tests for Stockfish is up at http://54.235.120.254:6543/tests. Please note, operations like start run, delete run, etc. are restricted.

Technical details:
Over the past few weeks, we've put together a distributed testing framework. It is written in Python, has a web interface backed by MongoDb for storing results. Clients get tasks from a REST API, and use cutechess-cli to run the actual games. Source is up on github here: https://github.com/glinscott/fishtest.

Thanks,
Gary

Great work. You've really industrialized the process

I'll gladly contribute to the testing.

Awesome, thanks Lucas! I will need to send over a username/password if you want to run the worker, or run tests.

It's really nice to be able to submit a test and forget about it until the results pop up .

[IGarcia]

Has to be 4 cores, mandatory?

I have a core 2 (2 cores) under linux

Ignacio.

[Vinvin]

I've 2 cores (+2 with HT) too, is that good for SF testing ?

[gladius]

Has to be 4 cores, mandatory?

I have a core 2 (2 cores) under linux

Ignacio.

For the beta, at least 4 cores, yes. The goal is to find the bugs/problems in the system, so a smaller number of higher core machines is easier.

Thanks though . I will definitely post when we are scaling things up some more.