Test suites

Discussion of chess software programming and technical issues.

Moderators: hgm, Rebel, chrisw

User avatar
Fabio Gobbato
Posts: 217
Joined: Fri Apr 11, 2014 10:45 am
Full name: Fabio Gobbato

Test suites

Post by Fabio Gobbato »

Where can I find good quality test suites with more than 1000 positions?
I have already tried STS.

Thank you
Dann Corbit
Posts: 12541
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Test suites

Post by Dann Corbit »

What kind of positions are you looking for.
I have a few million test positions, but they have many different purposes.
There are tactical suites
There are endgame suites
There are middle game suites
There are collections of ludicrously hard problems
There are collections of easy tactical problems
There are zugzwang tests
There are opening collections
There are... Whatever else you might be looking for.

So can you narrow down the purpose?
User avatar
Fabio Gobbato
Posts: 217
Joined: Fri Apr 11, 2014 10:45 am
Full name: Fabio Gobbato

Re: Test suites

Post by Fabio Gobbato »

I want to use test suites as a fast and rough test for my engine.
I think that tactical, middle game and endgame suites are suitable.
Dann Corbit
Posts: 12541
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Test suites

Post by Dann Corbit »

from this book:
http://www.amazon.com/Encyclopedia-Ches ... B000UNPDTA
There is a middle game test assembled (about 880 problems). There was one problem where the side to move was checkmated no matter what move was made, and I removed that one. Lots of answers were wrong, so I changed them to the right answers. There are two files inside this archive:
https://www.dropbox.com/s/3b9jtcd5hmpce ... me.7z?dl=0

File:
midgame-analyzed.epd
has the positions along with annotations, analysis and the original solutions.
The original solutions are in field c3 of the Epd record.
The file midgame.epd has the Epd records with the correct move added as bm.

Sample annotated entry:
rnb3kr/ppp2ppp/1b6/3q4/3pN3/Q4N2/PPP2KPP/R1B1R3 w - - acd 9; acs 0; bm Nf6+; c0 "Richardson vs Eugene Delmar, New York, 1887"; c2 "Source: wtharvey.com"; c3 "Nf6+"; c4 "Ne4f6+ (got a !? but game-theor optimal) (Krogius_EofCM) #1431 white_wins"; ce 32760; dm 4; id "ECM.493"; pm Nf6+; pv Nf6+ gxf6 Qf8+ Kxf8 Bh6+ Kg8 Re8#;

Sample entry with bm only:
rnb3kr/ppp2ppp/1b6/3q4/3pN3/Q4N2/PPP2KPP/R1B1R3 w - - bm Nf6+;
jdart
Posts: 4367
Joined: Fri Mar 10, 2006 5:23 am
Location: http://www.arasanchess.org

Re: Test suites

Post by jdart »

ECM is pretty good as Dann notes.

See also http://arasanchess.org/testsuite.shtml. (These are mostly harder than ECM).

--Jon
Dann Corbit
Posts: 12541
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Test suites

Post by Dann Corbit »

Midgame set, similar to above, largely from Holmes set (but hundreds of lost positions removed):
https://www.dropbox.com/s/m4anae41nwhmv8j/mid.7z?dl=0

Note:
This is an endgame set, not midgame.
D Sceviour
Posts: 570
Joined: Mon Jul 20, 2015 5:06 pm

Re: Test suites

Post by D Sceviour »

Fabio Gobbato wrote:I want to use test suites as a fast and rough test for my engine.
I think that tactical, middle game and endgame suites are suitable.
Another one to look for is the Encyclopedia of Chess Endings. Someone has assembled all the epd files, but their current whereabouts is unknown. The only one I have is ECE3.fen
Dann Corbit
Posts: 12541
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Test suites

Post by Dann Corbit »

D Sceviour wrote:
Fabio Gobbato wrote:I want to use test suites as a fast and rough test for my engine.
I think that tactical, middle game and endgame suites are suitable.
Another one to look for is the Encyclopedia of Chess Endings. Someone has assembled all the epd files, but their current whereabouts is unknown. The only one I have is ECE3.fen
Ece3.epd:
https://www.dropbox.com/s/rwrbtrenrurg6d0/ece3.7z?dl=0
Lots of mistakes in it.
D Sceviour
Posts: 570
Joined: Mon Jul 20, 2015 5:06 pm

Re: Test suites

Post by D Sceviour »

Dann Corbit wrote:Ece3.epd:
https://www.dropbox.com/s/rwrbtrenrurg6d0/ece3.7z?dl=0
Lots of mistakes in it.
Thank you Dann! :)
However, I already have this one. A link to the entire ECE is needed.
User avatar
sje
Posts: 4675
Joined: Mon Mar 13, 2006 7:43 pm

Re: Test suites

Post by sje »