Test position rating list

[Engin]

Hello,
instead of rating list from played games (CCRL, CEGT and others) i am searching for a rating list from most popular knowing EPD test positions like (WAC, BT2630, BT2830, ECMGCP, LTC, LTC2, EET, IQ4) to compare my engine agains other engines.

i mean a rating list from all engines that not in ELO but in points like this:

Nr. Name points positions seconds per move
1. Stockfish 6 999 1000 10
2. Komod 8 998 1000 10
3. Houdini 4 900 1000 10
4. Critter 1.6a 899 1000 10
..
..
50 Tornado 500 1000 10

i not having the time to test all engines and also not all EPD positions to test, because thats a huge amount of work due to the rating list from games too.

[Engin]

i found out that Arena 3.5 having a good function for that for automatic analyse positions.

[Vinvin]

A lot of test positions are wrong ; or too easy for current software/hardware ; or needs specific knowledge not useful for most of regular games ...

Hello,
instead of rating list from played games (CCRL, CEGT and others) i am searching for a rating list from most popular knowing EPD test positions like (WAC, BT2630, BT2830, ECMGCP, LTC, LTC2, EET, IQ4) to compare my engine agains other engines.

i mean a rating list from all engines that not in ELO but in points like this:

Nr. Name points positions seconds per move
1. Stockfish 6 999 1000 10
2. Komod 8 998 1000 10
3. Houdini 4 900 1000 10
4. Critter 1.6a 899 1000 10
..
..
50 Tornado 500 1000 10

i not having the time to test all engines and also not all EPD positions to test, because thats a huge amount of work due to the rating list from games too.

[Engin]

it doesnt matter how easy or hard it is, for weaker engines are even easiers positions hard, of course for top engines easy.

yes the WAC.epd is very easy, but are there all positions easy ?

most of us are using engines for analyse not for playing against them !

so it is very important to have a engine that can solve and find good moves quickly.

what is about BT2830 or STS ? i dont think that is very easy positions.

[Engin]

may we can put some set of positions from very weak to very hard positions to one EPD file that can all engines try to solve.

[Vinvin]

I got my new computer in October 2014 (an i7-6 cores@4ghz).
To make my set "Hard talkchess 2015" see here : http://www.talkchess.com/forum/viewtopi ... 413#605413
I retested a lot of old positions to find those who still good for now.
Here the list of sets I let run (may be there are more but didn't hold all the archives), around 8500 positions :

Code: Select all

AH-endgames-250.epd
AH-tactics-250.epd
BWTC.EPD
Bratko-Kopec.epd
CCR.EPD
Dvoretsky .epd
ECM-SEL.EPD
EGTB syzygy.epd
EXNER.EPD
FABER.EPD
KAUFMAN.EPD
MTP-50.epd
Peter Schreiner.epd
RICHTER.EPD
Rybka3.epd
SHEP.EPD
SUNE.EPD
WM-Test.epd
YAZGAC.EPD
arasan.epd
bs2830.epd
bt2630.epd
bundle hossa 60 sec.epd
eet.epd
gem13ed.epd
hard CCC 2006.epd
hard-tsavdaris.epd
kiwi eg.epd
lctII.epd
nightmare2.epd
nolot.epd
pet2.epd
positional.epd
quick.epd
veryhard.epd
wac.epd
wm_express.epd
zpts.epd

100-brillante-2012.pgn
100x - Der brillante Schachzug.pgn
595 Things that Your Program Can't think of.pgn
ALBILLO.PGN
Bk.pgn
Eigenmann_Endgame_Test.pgn
JoshuaLee481Pos.pgn
MGV77-2012.pgn
Nightmare-2012.pgn
Rybka-Forum-hard-2012.pgn
The 110 Greatest Moves ever played.pgn
USKI.PGN
YATS Yet Another Test System.pgn
aemis.pgn
aemis2.pgn
btm.pgn
clashposi.pgn
gem13ed.pgn
maxeuwe.pgn
relot.pgn
testend.pgn
the nightmare_game.pgn
tony.pgn
verydiff.pgn

Conclusion :
(% numbers are from my not so accurate memory)
1) a lot of positions (around 30%) have wrong solutions.
2) a lot of positions (around 60%) are found in less than 5 seconds.

it doesnt matter how easy or hard it is, for weaker engines are even easiers positions hard, of course for top engines easy.

yes the WAC.epd is very easy, but are there all positions easy ?

most of us are using engines for analyse not for playing against them !

so it is very important to have a engine that can solve and find good moves quickly.

what is about BT2830 or STS ? i dont think that is very easy positions.

[jdart]

Search the forum for "STS": you will find quite a few engine results for that test suite.

I have a test suite available here: http://arasanchess.org/testsuite.shtml with results from my own engine.

(But as others have noted here test suite results correlate only roughly with engine results in actual matches).

[Dann Corbit]

I would like a copy of:
gem13ed.pgn
maxeuwe.pgn

if possible. I seem to be missing those from my collection.

[Vinvin]

Done !
I sent a mail to the "connx" address, I hope it's OK ...

I would like a copy of:
gem13ed.pgn
maxeuwe.pgn

if possible. I seem to be missing those from my collection.

[Engin]

yes John we know your testsuite from Arasan for a long time, but what i want
that some more engines make the same test to compare all with together.