My hard test suite 2008

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Vinvin
Posts: 5228
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

My hard test suite 2008

Post by Vinvin »

I'm finalizing my hard test suite, previous version was from 2006. I removed some easy and not clear positions and add some.

Here are the positions with main lines and some variations :
http://home.scarlet.be/vincentlejeune/h ... -beta1.pgn

Still to do : renumber, add position category, add some lines.

If you have comments, please post them here !

Vincent
jdart
Posts: 4368
Joined: Fri Mar 10, 2006 5:23 am
Location: http://www.arasanchess.org

Re: My hard test suite 2008

Post by jdart »

EPD format would be nice.

#58 seems to be just an eval test - which is probably useful but it's hard to run automatically and get a pass/fail.

I usually only trust "best move" positions if I've run the position at very long time controls and have gotten the best move to score significantly better (+0.5 pawn at least better) than the next alternative.


--Jon
jdart
Posts: 4368
Joined: Fri Mar 10, 2006 5:23 am
Location: http://www.arasanchess.org

Re: My hard test suite 2008

Post by jdart »

#51 is Anand-Kamsky, PCA-Wch Candidates final (round 3) 1995. #79 (nolot #3) is from Smagin-Sahovic, Biel MTO op 1990. Should probably identify the source of these. But I am not clear where many of the others came from.



--Jon
Vinvin
Posts: 5228
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: My hard test suite 2008

Post by Vinvin »

Thanks, Jon !

Names added 8-)
Vinvin
Posts: 5228
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: My hard test suite 2008

Post by Vinvin »

jdart wrote:EPD format would be nice.
It's easy to make GPN from EPD, but I didn't find easy way to do the opposite :(
jdart wrote:#58 seems to be just an eval test
--Jon
Yes, position 52 is like this too. What would you propose with this 2 positions ?
User avatar
George Tsavdaris
Posts: 1627
Joined: Thu Mar 09, 2006 12:35 pm

Re: My hard test suite 2008

Post by George Tsavdaris »

Vinvin wrote:
jdart wrote:EPD format would be nice.
It's easy to make GPN from EPD, but I didn't find easy way to do the opposite :(
There is PGN2EPD from http://remi.coulom.free.fr/

It's easy to use but it creates from the 84 games of the PGN all EPD positions from the PGN. That means all the moves from it so you will have to delete most, but this is easy with EPD2diag.
After his son's birth they've asked him:
"Is it a boy or girl?"
YES! He replied.....
jdart
Posts: 4368
Joined: Fri Mar 10, 2006 5:23 am
Location: http://www.arasanchess.org

Re: My hard test suite 2008

Post by jdart »

I'd drop the eval tests - possibly if you have the game you can make them into an "avoid move" test where an earlier move avoids the bad position.

Re converting PGN to EPD: simple to do in this case (I'd use a Perl script, myself) since your PGN already has the FEN string in a tag.

--Jon
User avatar
George Tsavdaris
Posts: 1627
Joined: Thu Mar 09, 2006 12:35 pm

Re: My hard test suite 2008

Post by George Tsavdaris »

Vinvin wrote:I'm finalizing my hard test suite, previous version was from 2006. I removed some easy and not clear positions and add some.

If you have comments, please post them here !
In position number 50 you have this:
[D]8/2pp1p2/1p6/1kPP4/5Pp1/8/6PP/5K2 w - - 0 1
And you give:
1.c6!! dxc6 2.d6!! cxd6 3.h4 gxh3 4.gxh3
[D]8/5p2/1ppp4/1k6/5P2/7P/8/5K2 b - - 0 4
And now you give:
4...Kc5 5. h4 Kd5 6. h5 Ke6 7. h6 Kf6 8.f5 b5 9. Ke2 b4 10. Kd3 d5 11. Kc2 d4 12. Kc1 c5 13. Kc2 c4 14. Kc1 b3 15. Kb2 1-0

But what about instead of 4...Kc5??, black to play: 4...Ka4!!
[D]8/5p2/1ppp4/8/k4P2/7P/8/5K2 w - - 0 5

I have on this:

[Event "?"]
[Site "?"]
[Date "2007.07.14"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[Annotator "George"]
[SetUp "1"]
[FEN "8/5p2/1ppp4/1k6/5P2/7P/8/5K2 b - - 0 1"]
[PlyCount "17"]

1... Ka4 $3 (1... Ka5 $2 {draw} 2. h4 b5 3. h5 b4 4. Ke2 Ka4 5. h6 b3 6. Kd2
Ka3 7. h7 b2 8. h8=Q b1=Q 9. Qa8+ Kb2 10. Qxc6 Qg6 11. Qb5+) (1... Kc5 $4 {lose
} 2. h4 Kd5 3. h5 Ke6 4. h6 Kf6 5. f5 b5 6. Ke2 d5 7. Kd3 b4 8. Kc2 d4 9. Kc1
c5 10. Kc2 c4 11. Kc1 d3 12. Kd2 b3 13. Kc3) 2. h4 b5 3. h5 b4 4. h6 b3 5. h7
b2 6. h8=Q b1=Q+ 7. Kf2 Qc2+ 8. Kg3 Kb5 9. Qb8+ Kc4 *
After his son's birth they've asked him:
"Is it a boy or girl?"
YES! He replied.....
User avatar
Eelco de Groot
Posts: 4574
Joined: Sun Mar 12, 2006 2:40 am
Full name:   

Re: My hard test suite 2008

Post by Eelco de Groot »

Thanks for the testset Vincent!

I tried the first testposition from Kasparov - Topalov, Wijk aan Zee 1999, for Ancalagon very difficult but this was one of the better runs. The score for 1. Re6 is typically too high but there is a slight advantage too after this move, after 1. Re6 Naum 3.1 says eventually (at 50% of processor capacity):

[D]b2r3r/5p1p/p2qRnp1/1p1P4/kP1Q4/P4PPB/2P4P/1K6 b - -

Engine: Naum 3.1 (64 MB)
by Aleksandar Naumov

17/37 0:47 0.00 1...fxe6 2.Qe3 Qxb4+ 3.axb4 Kxb4
4.Qd4+ Ka5 5.Qa1+ Kb6 6.Qd4+ Kc7
7.Qe5+ Kb7 8.Qxf6 exd5 9.Be6 Rde8 (24.593.987) 516

18/43 1:23 0.00 1...fxe6 2.Qe3 Qxb4+ 3.axb4 Kxb4
4.Qd4+ Ka5 5.Qa1+ Kb6 6.Qd4+ Kc7
7.Qe5+ Kb7 8.Qxf6 exd5 9.Be6 a5
10.Bxd5+ (43.289.179) 519

19/43 2:31 0.00 1...fxe6 2.Qe3 Qxb4+ 3.axb4 Kxb4
4.Qd4+ Ka5 5.Qa1+ Kb6 6.Qd4+ Kc7
7.Qe5+ Kb7 8.Qxf6 exd5 9.Be6 a5
10.Bxd5+ Kc7 (78.841.280) 518

20/44 4:52 0.00 1...fxe6 2.Qe3 Qxb4+ 3.axb4 Kxb4
4.Qd4+ Ka5 5.Qa1+ Kb6 6.Qd4+ Kc7
7.Qe5+ Kb7 8.Qxf6 exd5 9.Be6 a5
10.Bxd5+ Kc7 11.Qe5+ (151.115.551) 517

21/49 11:17 -0.48 1...fxe6 2.Qe3 Qxb4+ 3.axb4 Kxb4
4.Qd4+ Ka5 5.d6 Nd5 6.Bxe6 Rhe8
7.Bf7 Bb7 8.Qc5 Rf8 9.Bxd5 Bxd5
10.Qxd5 Kb6 11.f4 Rd7 (345.737.007) 510

22/48 21:05 -0.41 1...fxe6 2.Qe3 Qxb4+ 3.axb4 Kxb4
4.Qd4+ Ka5 5.d6 Nd5 6.Bxe6 Rhe8
7.Bf7 Bc6 8.Bxe8 Rxe8 9.d7 Rd8
10.Qc5 Bb7 11.c4 Nc3+ 12.Kc2 (645.164.055) 509

23/47 38:07 -0.46 1...fxe6 2.Qe3 Qxb4+ 3.axb4 Kxb4
4.Qd4+ Ka5 5.d6 Nd5 6.Bxe6 Rhe8
7.Bf7 Bc6 8.Bxe8 Rxe8 9.d7 Rd8
10.Qc5 Bb7 11.c4 Nc3+ 12.Kc2 Rxd7 (1.159.987.376) 507

24/48 69:35 -0.39 1...fxe6 2.Qe3 Qxb4+ 3.axb4 Kxb4
4.Qd4+ Ka5 5.d6 Nd5 6.Bxe6 Rhe8
7.Bf7 Bc6 8.Bxe8 Rxe8 9.d7 Rd8
10.Qc5 Bb7 11.c4 Nc3+ 12.Kc2 Rxd7
13.Kxc3 (2.126.581.631) 509

25/49 129:40 -0.57 1...fxe6 2.Qe3 Qxb4+ 3.axb4 Kxb4
4.Qd4+ Ka5 5.d6 Nd5 6.Bxe6 Rhe8
7.Bf7 Rf8 8.Bxd5 Bxd5 9.Qxd5 Kb6
10.d7 Kc7 11.Qc5+ Kxd7 12.Qa7+ Ke6
13.Qxa6+ Kf7 (3.979.285.815) 511 TB:8

26/53 204:03 -0.55 1...fxe6 2.Qe3 Qxb4+ 3.axb4 Kxb4
4.Qd4+ Ka5 5.d6 Nd5 6.Bxe6 Rhe8
7.Bf7 Rf8 8.Bxd5 Bxd5 9.Qxd5 Kb6
10.Qd4+ Kc6 11.Qg7 Kxd6 12.Qxh7 Rg8
13.Qb7 Ra8 14.h4 (6.308.872.060) 515 TB:22

27/51 296:28 -0.53 1...fxe6 2.Qe3 Qxb4+ 3.axb4 Kxb4
4.Qd4+ Ka5 5.d6 Nd5 6.Bxe6 Rhe8
7.Bf7 Rf8 8.Bxd5 Bxd5 9.Qxd5 Kb6
10.Qd4+ Kc6 11.Qg7 Kxd6 12.Qxh7 Rg8
13.Qb7 Ra8 14.Qb6+ Kd5 (9.911.844.562) 557 TB:71

best move: f7xe6 time: 406:12.156 min n/s: 557.204 nodes: 11.692.479.692 TB: 71

Deep analysis of the testposition, Ra7 is found soon but unfortunately just a quickly rejected, because the score is very low for the move and too high for 1.Re6 if Re6 is actually a draw, I don't know that it is.

b2r3r/4Rp1p/p2q1np1/1p1P4/kP1Q4/P4PPB/2P4P/1K6 w - -

Engine: Ancalagon 1.08 Testversion (Athlon 2009 MHz, 256 MB)
by Tord Romstad

14.01 0:07 -4.92 1.Qe3 Qxd5 2.Rxf7 Qxf3 3.Qxf3 Bxf3
4.Rxf6 Bb7 5.Kb2 a5 6.Rb6 Bc8 7.Bxc8 Rxc8
8.h3 Ra8 9.bxa5 Kxa5 (3.043.739) 427

15.01 0:13 -4.58 1.Qe3 Qxd5 2.Rxf7 Qxf3 3.Qxf3 Bxf3
4.Rxf6 Bb7 5.Kb2 a5 6.Rb6 Bc8 7.c4 Bxh3
8.c5 Rd2+ 9.Kc3 axb4+ 10.axb4 Rxh2 (5.929.544) 440

15.03 0:37 -3.49 1.Ra7 Nxd5 2.Bd7 Rc8 3.c4 Kb3 4.c5 Qf6
5.Qxf6 Nxf6 6.Bxc8 Re8 7.Kc1 Kc3
8.Be6 Rxe6 9.Kb1 Bxf3 10.Rxf7 (16.405.242) 433

16.01 0:53 -3.00 1.Ra7 Nxd5 2.Bd7 Rc8 3.Rxa8 Rxc2
4.Rxa6+ Qxa6 5.Kxc2 Qb6 6.Bxb5+ Kxb5
7.Qxd5+ Ka6 8.Qc4+ Qb5 9.Kb3 Qxc4+
10.Kxc4 Rc8+ 11.Kb3 Re8 12.a4 Re3+
13.Kc4 Rxf3 (23.541.983) 436


16.03 1:03 0.00 1.Qc3 Qxd5 2.Be6 fxe6 3.Qc7 Qd1+
4.Kb2 Qd4+ 5.Kb1 Qg1+ 6.Kb2 Qd4+ (28.141.651) 440

16.23 1:38 +3.50 1.Re6 fxe6 2.Qe3 Qxb4+ 3.axb4 Kxb4
4.Qd4+ Ka5 5.Qc3+ Kb6 6.dxe6 Nd5
7.Qd4+ Kc6 8.f4 a5 9.e7 Nxe7 10.Qf6+ Kc5
11.Qxe7+ Kb6 12.Qe3+ Ka6 13.Qe6+ Ka7
14.Bg4 (42.704.193) 434

17.01 2:14 +1.68 1.Re6 fxe6 2.Qe3 Qxb4+ 3.axb4 Kxb4
4.Qd4+ Ka5 5.Qc3+ Kb6 6.dxe6 Nd5
7.Qd4+ Kc6 8.f4 a5 9.Qd3 Nb4 10.Qe2 Rhe8
11.c3 Nd3 12.e7 Kc7 13.exd8Q+ Rxd8 (57.905.813) 431

18.01 3:28 +1.47 1.Re6 fxe6 2.Qe3 Qxb4+ 3.axb4 Kxb4
4.Qd4+ Ka5 5.d6 Nd5 6.c4 bxc4 7.Bxe6 Nb4
8.d7 Bxf3 9.Qe5+ Ka4 10.Qa1+ Kb5
11.Qxh8 Rxh8 12.Kb2 Kb6 13.Kc3 (89.522.082) 429

19.01 6:26 +2.47 1.Re6 fxe6 2.Qe3 Qxb4+ 3.axb4 Kxb4
4.Qd4+ Ka5 5.d6 Nd5 6.c4 bxc4 7.Bxe6 Nb4
8.d7 Bc6 9.Qxc4 Bxd7 10.Qc7+ Ka4
11.Bxd7+ Kb3 12.Qd6 Rxd7 13.Qxd7 Kc4 (168.155.586) 435

20.01 15:33 +2.00 1.Re6 fxe6 2.Qe3 Qxb4+ 3.axb4 Kxb4
4.Qd4+ Ka5 5.d6 Nd5 6.c4 bxc4 7.Bxe6 Rb8+
8.Kc1 Nb4 9.Qc5+ Rb5 10.Qc7+ Ka4
11.Qxc4 Rd8 12.d7 Bd5 13.Qc7 Na2+
14.Kc2 (406.803.161) 435

20.05 40:14 +6.84 1.Ra7 Bb7 2.Rxb7 Qxd5 3.Rb6 a5 4.Ra6 Ra8
5.Qe3 Rxa6 6.Kb2 axb4 7.axb4 Qa2+
8.Kxa2 Kxb4+ 9.Kb2 Rc6 10.Bf1 Ka5
11.Qa7+ Ra6 12.Qc5 Rb8 (1.016.508.264) 421

21.01 56:01 +8.23 1.Ra7 Bb7 2.Rxb7 Qxd5 3.Rb6 a5 4.Ra6 Ra8
5.Qe3 Rxa6 6.Kb2 axb4 7.axb4 Qa2+
8.Kxa2 Kxb4+ 9.Kb2 Rc6 10.Bf1 Ka5
11.Qa7+ Ra6 12.Qc5 Rb8 13.Qc3+ Kb6
14.Qxf6+ (1.403.213.621) 417

22.01 93:19 +8.23 1.Ra7 Bb7 2.Rxb7 Qxd5 3.Rb6 a5 4.Ra6 Ra8
5.Qe3 Rxa6 6.Kb2 axb4 7.axb4 Qa2+
8.Kxa2 Kxb4+ 9.Kb2 Rc6 10.Bf1 Ka5
11.Qa7+ Ra6 12.Qc5 Rb8 13.Qc3+ Kb6
14.Qxf6+ (2.337.091.426) 417

23.01 217:05 +8.23 1.Ra7 Bb7 2.Rxb7 Qxd5 3.Rb6 a5 4.Ra6 Ra8
5.Qe3 Rxa6 6.Kb2 axb4 7.axb4 Qa2+
8.Kxa2 Kxb4+ 9.Kb2 Rc6 10.Bf1 Ka5
11.Qa7+ Ra6 12.Qc5 Rb8 13.Qc3+ Kb6
14.Qxf6+ (5.519.887.377) 423

24.01 704:03 +9.09 1.Ra7 Bb7 2.Rxb7 Qxd5 3.Rb6 a5 4.Ra6 Ra8
5.Qe3 Rxa6 6.Kb2 axb4 7.axb4 Qa2+
8.Kxa2 Kxb4+ 9.Kb2 Rc6 10.Qa7 Nd5
11.Bf1 Rc3 12.Qd4+ Rc4 13.Qxd5 Rhc8
14.c3+ (17.988.214.777) 425


best move: Re7-a7 time: 720:54.782 min n/s: 425.865 nodes: 18.420.720.000

16 plies are needed to reach 0.00 so that makes it difficult to see any advantage ahead.

Eelco
Marc MP

Re: My hard test suite 2008

Post by Marc MP »

jdart wrote:#51 is Anand-Kamsky, PCA-Wch Candidates final (round 3) 1995. #79 (nolot #3) is from Smagin-Sahovic, Biel MTO op 1990. Should probably identify the source of these. But I am not clear where many of the others came from.



--Jon
Hi Vincent,

Thank you for the suite, they are always time consuming to gather and verify.
For the record, game 49 (King's Attack) is Marcozy-Tartakower (1922): http://www.chessgames.com/perl/chessgame?gid=1003826