Test sets results on opening, tactical, ending

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Ferdy
Posts: 4833
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Test sets results on opening, tactical, ending

Post by Ferdy »

Compiled some test results on some engines, will update this from time to time.

You can filter and sort.
Filter engine.

Image


Filter category, top 10.

Image


Site link:
https://fsmosca.github.io/chess-tests/

Github project:
https://github.com/fsmosca/chess-tests
EPD links are in "Test sets" section
MikeGL
Posts: 1010
Joined: Thu Sep 01, 2011 2:49 pm

Re: Test sets results on opening, tactical, ending

Post by MikeGL »

Thanks for the update.

Would be interesting to see Lc0 results on these tactical tests, including those deep strategic suites.
I told my wife that a husband is like a fine wine; he gets better with age. The next day, she locked me in the cellar.
Ferdy
Posts: 4833
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: Test sets results on opening, tactical, ending

Post by Ferdy »

MikeGL wrote: Sat Apr 06, 2019 6:09 am Thanks for the update.

Would be interesting to see Lc0 results on these tactical tests, including those deep strategic suites.
For Lc0, I don't have a decent gpu, perhaps I can try the blas backend but this would discourage the Lc0 fans :) so better not to include it. What do you mean by deep strategic suites?
Ferdy
Posts: 4833
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: Test sets results on opening, tactical, ending

Post by Ferdy »

Added Vajolet2 2.7.0, RuyDos 1.1.9, Pedone 1.9 and Xiphos 0.5 for ending.
https://fsmosca.github.io/chess-tests/
MikeGL
Posts: 1010
Joined: Thu Sep 01, 2011 2:49 pm

Re: Test sets results on opening, tactical, ending

Post by MikeGL »

Ferdy wrote: Sat Apr 06, 2019 6:18 am
MikeGL wrote: Sat Apr 06, 2019 6:09 am Thanks for the update.

Would be interesting to see Lc0 results on these tactical tests, including those deep strategic suites.
For Lc0, I don't have a decent gpu, perhaps I can try the blas backend but this would discourage the Lc0 fans :) so better not to include it. What do you mean by deep strategic suites?
Sorry, I mean results of Lc0 on positional test suites.
I told my wife that a husband is like a fine wine; he gets better with age. The next day, she locked me in the cellar.
User avatar
Guenther
Posts: 4605
Joined: Wed Oct 01, 2008 6:33 am
Location: Regensburg, Germany
Full name: Guenther Simon

Re: Test sets results on opening, tactical, ending

Post by Guenther »

Ferdy wrote: Sat Apr 06, 2019 6:28 am Added Vajolet2 2.7.0, RuyDos 1.1.9, Pedone 1.9 and Xiphos 0.5 for ending.
https://fsmosca.github.io/chess-tests/
Thanks, this looks quite interesting.
https://rwbc-chess.de

trollwatch:
Chessqueen + chessica + AlexChess + Eduard + Sylwy
Dann Corbit
Posts: 12538
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Test sets results on opening, tactical, ending

Post by Dann Corbit »

i guess you don't have houdini, Houdini smokes tests
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
jdart
Posts: 4366
Joined: Fri Mar 10, 2006 5:23 am
Location: http://www.arasanchess.org

Re: Test sets results on opening, tactical, ending

Post by jdart »

I think arasan20 is mostly a tactical test suite but it has some endgame positions.

--Jon
Ferdy
Posts: 4833
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: Test sets results on opening, tactical, ending

Post by Ferdy »

Dann Corbit wrote: Sun Apr 07, 2019 1:09 am i guess you don't have houdini, Houdini smokes tests
I don't have latest versions of Houdini. I bought H4 before. Will try to find it, as I am testing UCI_Elo 1400 of some engines too.
Ferdy
Posts: 4833
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: Test sets results on opening, tactical, ending

Post by Ferdy »

jdart wrote: Sun Apr 07, 2019 3:00 am I think arasan20 is mostly a tactical test suite but it has some endgame positions.

--Jon
Thanks for the info. I will not revise the set and re-test, but just revise the description.

Somehow I need to add middle phase test positions.