Page 1 of 2

Test sets results on opening, tactical, ending

Posted: Sat Apr 06, 2019 5:54 am
by Ferdy
Compiled some test results on some engines, will update this from time to time.

You can filter and sort.
Filter engine.

Image


Filter category, top 10.

Image


Site link:
https://fsmosca.github.io/chess-tests/

Github project:
https://github.com/fsmosca/chess-tests
EPD links are in "Test sets" section

Re: Test sets results on opening, tactical, ending

Posted: Sat Apr 06, 2019 6:09 am
by MikeGL
Thanks for the update.

Would be interesting to see Lc0 results on these tactical tests, including those deep strategic suites.

Re: Test sets results on opening, tactical, ending

Posted: Sat Apr 06, 2019 6:18 am
by Ferdy
MikeGL wrote: Sat Apr 06, 2019 6:09 am Thanks for the update.

Would be interesting to see Lc0 results on these tactical tests, including those deep strategic suites.
For Lc0, I don't have a decent gpu, perhaps I can try the blas backend but this would discourage the Lc0 fans :) so better not to include it. What do you mean by deep strategic suites?

Re: Test sets results on opening, tactical, ending

Posted: Sat Apr 06, 2019 6:28 am
by Ferdy
Added Vajolet2 2.7.0, RuyDos 1.1.9, Pedone 1.9 and Xiphos 0.5 for ending.
https://fsmosca.github.io/chess-tests/

Re: Test sets results on opening, tactical, ending

Posted: Sat Apr 06, 2019 6:53 am
by MikeGL
Ferdy wrote: Sat Apr 06, 2019 6:18 am
MikeGL wrote: Sat Apr 06, 2019 6:09 am Thanks for the update.

Would be interesting to see Lc0 results on these tactical tests, including those deep strategic suites.
For Lc0, I don't have a decent gpu, perhaps I can try the blas backend but this would discourage the Lc0 fans :) so better not to include it. What do you mean by deep strategic suites?
Sorry, I mean results of Lc0 on positional test suites.

Re: Test sets results on opening, tactical, ending

Posted: Sat Apr 06, 2019 11:50 am
by Guenther
Ferdy wrote: Sat Apr 06, 2019 6:28 am Added Vajolet2 2.7.0, RuyDos 1.1.9, Pedone 1.9 and Xiphos 0.5 for ending.
https://fsmosca.github.io/chess-tests/
Thanks, this looks quite interesting.

Re: Test sets results on opening, tactical, ending

Posted: Sun Apr 07, 2019 1:09 am
by Dann Corbit
i guess you don't have houdini, Houdini smokes tests

Re: Test sets results on opening, tactical, ending

Posted: Sun Apr 07, 2019 3:00 am
by jdart
I think arasan20 is mostly a tactical test suite but it has some endgame positions.

--Jon

Re: Test sets results on opening, tactical, ending

Posted: Sun Apr 07, 2019 3:13 am
by Ferdy
Dann Corbit wrote: Sun Apr 07, 2019 1:09 am i guess you don't have houdini, Houdini smokes tests
I don't have latest versions of Houdini. I bought H4 before. Will try to find it, as I am testing UCI_Elo 1400 of some engines too.

Re: Test sets results on opening, tactical, ending

Posted: Sun Apr 07, 2019 3:19 am
by Ferdy
jdart wrote: Sun Apr 07, 2019 3:00 am I think arasan20 is mostly a tactical test suite but it has some endgame positions.

--Jon
Thanks for the info. I will not revise the set and re-test, but just revise the description.

Somehow I need to add middle phase test positions.