Nightmare II (Test-Set)

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Glarean
Posts: 262
Joined: Sun Oct 05, 2008 1:04 pm
Location: Switzerland
Full name: Walter Eigenmann

Nightmare II (Test-Set)

Post by Glarean »

In 2005 I published a collection of test positions for chess engines, called «Nightmare».
It was a set of 30 very difficult puzzles. Today, more than ten years later, the modern engines are much stronger.
So I created a new collection with 30 new hard positions. I found them in books, in chess forums, in studies databases a.o. (You can download all 30 positions as a EPD-File for your own experiments; with a fairly fast CPU, you should try 60 seconds per puzzle/engine ).

Have fun with «Nightmare II»:
https://glarean-magazin.ch/2016/08/25/c ... eigenmann/

Walter

.
Top
Dann Corbit
Posts: 12538
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Nightmare II (Test-Set)

Post by Dann Corbit »

Thank you.

I have greatly enjoyed your excellent test sets over the years.
They are always challenging and high quality.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
Top
Vinvin
Posts: 5228
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: Nightmare II (Test-Set)

Post by Vinvin »

I recognize some positions from my hard set ;-)

I ran SF-MF on 6*4GHz, 5 min per position : 11/30 !

Code: Select all

Analyzing engine: Stockfish_160815_x64_modern_matefinder
   Use seconds per move      : 300 Seconds per move
   Analysis Lines            : Minimum search depth=12
   Activate abort analysis   : True. Minimal analysis depth 24. Abort, if the correct move is held 3 additional ply
  1) Qe2-h5             Qe2-h5  * 98 Seconds
  2) c7-c8N             c7-c8N  * 257 Seconds
  3) Ne2-f4             Be3-c5   
  4) Ng4xh6             Ng4xh6  * 34 Seconds
  5) Rb2xb7             Rb2xb7  * 6 Seconds
  6) Qc6xd6             Qc6xd6  * 190 Seconds
  7) .. Qh5-f5          g4xh3    
  8) h2-h4              Ba4-b3   
  9) a5-a6              g6-g7    
 10) Nf7-d6             Nf7-h6   
 11) .. Rh6xh2          Rh6xh2  * 123 Seconds
 12) Qc7-d8             Rb6-f6   
 13) .. Rd6-f6          Rd6-d7   
 14) Qe2xe8             Bd4xf6   
 15) f3-f4              Ke8-d7   
 16) Ng5-e6             Ng5-e6  * 188 Seconds
 17) Nf4-d3             h4xg5    
 18) Bd4-f6             Bd4-f6  * 222 Seconds
 19) Ne7-g6             Ne7-g6  * 65 Seconds
 20) .. Kg8-g7          e4xd3    
 21) .. Rb8xb3          Ra6-a8   
 22) f5-f6              Kg1-h1   
 23) Nc7-a8             Rc2-f2   
 24) a7-a8Q             a7-a8Q  * 184 Seconds
 25) g2-g4              c2-c4    
 26) .. e4-e3           e4-e3   * 58 Seconds
 27) h2-h4              e7xf8Q   
 28) f2-f4              Na8-c7   
 29) Ka4-a3             Ng1-f3   
 30) Rd1-g1             Rf3-h3   
11 of 30 matching moves
25/08/16 16:26:38, Total time: 02:14:23 Rated time: 1:58:45 = 7125 Seconds
Top
Ferdy
Posts: 4833
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: Nightmare II (Test-Set)

Post by Ferdy »

Very difficult tests indeed. But the weakest engine with rating of 1450 has solved 2 positions.

Code: Select all

                                  Engine  Hash(mb)  Thre Time(s)/pos    TotalTime  Positions  Correct     %  TestFile  
                                     Sf7       128     1       5.000  00h:02m:30s         30        0   0.0  Nightmare 2 - (W.Eigenmann).epd
                          D2016.1.35.366       128     1       5.000  00h:02m:30s         30        0   0.0  Nightmare 2 - (W.Eigenmann).epd
              D2016.1.35.366.Offense.300       128     1       5.000  00h:02m:30s         30        0   0.0  Nightmare 2 - (W.Eigenmann).epd
                             CDrill 1450         4     1       5.000  00h:02m:00s         30        2   6.7  Nightmare 2 - (W.Eigenmann).epd
Details for CDrill.

Code: Select all

Engine: CDrill 1450
Hash: 4, Threads: 1, Time: 5.0s/pos

Test file: Nightmare 2 - (W.Eigenmann).epd, TotalPos 30
AnalyzedPos : 30, Correct: 2 (6.67%)

Total time as reported by engine    : 00h:02m:00s:282ms
Expected time based on time/pos     : 00h:02m:30s:000ms
Engine start/quit wall time elapsed : 00h:02m:00s:290ms

   Pos  Correct  EngineBM  ScoreCP    Mate    EPD
     1        0      Bxc5       -4       -    r4rk1/1bq1bppp/p1npp3/2nB1NP1/1p2P3/2N1B3/PPP1QP1P/2KR2R1 w - - bm Qh5; id "Nightmare II-01 - Koenigsangriff";
     2        0       Kg2      +95       -    5nr1/2Pp2pk/3Pp1p1/4P1P1/6P1/5K2/8/7n w - - bm c8=N; id "Nightmare II-02 - Springerumwandlung";
     3        0       Ba7     -159       -    1rb2r1k/3p1pp1/p3p2p/1p2P3/4q3/1N2B1R1/PPP1N1P1/2KR1B2 w - - bm Nf4; id "Nightmare II-03 - Initiative";
     4        0       Bd2      -96       -    r2qrb1k/3n2p1/p2p3p/1p1b4/Pnp1N1N1/5R1P/1P3PP1/1BBQR1K1 w - - bm Nxh6; id "Nightmare II-04 - Springeropfer";
     5        0       Kh4     -338       -    6k1/bpR5/8/7K/8/3p4/1Rb2rpB/8 w - - bm Rbxb7; id "Nightmare II-05 - Endspiel T&T&L vs T&L&L&B";
     6        1     Qxd6+     +130       -    8/4kpp1/1pQq3p/p7/P7/3P2P1/2P2P1P/6K1 w - - bm Qxd6+; id "Nightmare II-06 - Endspiel D vs D";
     7        0      gxh3     -227       -    6r1/6r1/2p1k1pp/p1pbP2q/Pp1p1PpP/1P1P2NR/1KPQ3R/8 b - - bm Qf5; id "Nightmare II-07 - Festung";
     8        0        h3      -88       -    2r1k1r1/3q4/p1nBpp1p/8/B5p1/4RbK1/PP1Q1P1P/2R5 w - - bm h4; id "Nightmare II-08 - Offene Linie";
     9        0      gxh7     -395       -    7k/1p5p/2qpn1PP/Pp1p4/8/3B2p1/3B1pP1/R4K2 w - - bm a6; id "Nightmare II-09 - Patt";
    10        0      Rf3+     -251       -    2b1r3/r2ppN2/8/1p1p1k2/pP1P4/2P3R1/PP3PP1/2K5 w - - bm Nd6+; id "Nightmare II-10 - Endspiel T&S&B vs T&T&L";
    11        0      gxh2     +298       -    r5k1/p1pb2bp/3p3r/P1pPp1p1/2B1Pq2/1R2QPp1/1P4PP/5RBK b - - bm Rxh2+; id "Nightmare II-11 - Koenigsangriff";
    12        0      Qxd7     +113       -    4K2k/1pQp3p/1R4p1/1P4P1/8/3P3P/1q3r2/8 w - - bm Qd8; id "Nightmare II-12 - Endspiel D&T vs D&T";
    13        0       Be3     -169       -    2k2Br1/p6b/Pq1r4/1p2p1b1/1Ppp2p1/Q1P3N1/5RPP/R3N1K1 b - - bm Rf6; id "Nightmare II-13 - Koenigsangriff";
    14        0       Be3      -96       -    r1bqr1k1/3n1ppp/p2p1b2/3N1PP1/1p1B1P2/1P6/1PP1Q2P/2KR2R1 w - - bm Qxe8+; id "Nightmare II-14 - Damenopfer";
    15        0       Kd7     +226       -    4K1k1/8/1p5p/1Pp3b1/8/1P3P2/P1B2P2/8 w - - bm f4; id "Nightmare II-15 - Endspiel L vs L";
    16        0      Nh7+      -36       -    2r2k2/8/8/3Rp1N1/2P3K1/8/2p4B/8 w - - bm Ne6+; id "Nightmare II-16 - Endspiel T&L&S vs T&B";
    17        0      hxg5      +98       -    8/4nk2/1p3p2/1r1p2pp/1P1R1N1P/6P1/3KPP2/8 w - - bm Nd3; id "Nightmare II-17 - Endspiel T&S vs T&S";
    18        0       Ne2      -51       -    r1b2rk1/2q1bppp/p2pp3/2n3PQ/1p1BP3/1BN5/PPP2P1P/2KR2R1 w - - bm Bf6; id "Nightmare II-18 - Koenigsangriff";
    19        0       Re4      +50       -    5B2/1p1nNp2/8/1P2R3/3p3q/8/p1K1P1Q1/k3b3 w - - bm Ng6; id "Nightmare II-19 - Springeropfer";
    20        0      exd3      +29       -    r3r1k1/pp1q1p2/2p2npb/PPPp4/3Pp3/2NNPpP1/1R1B1P1K/3Q3R b - - bm Kg7; id "Nightmare II-20 - Starke Felder";
    21        0       Ra7     +204       -    1r6/4k3/r2p2p1/2pR1p1p/2P1pP1P/pPK1P1P1/P7/1B6 b - - bm Rxb3+; id "Nightmare II-21 - Endspiel T vs T";
    22        0       Qg4     -210       -    r1q2rk1/ppp1bp2/6p1/3pNPn1/7p/2PP3P/P6B/1R1Q1RK1 w - - bm f6; id "Nightmare II-22 - Bauernopfer";
    23        0       Ne8      +85       -    1k6/bPN2pp1/Pp2p3/p1p5/2pn4/3P4/PPR5/1K6 w - - bm Na8; id "Nightmare II-23 - Zugzwang";
    24        0       Nb6      +63       -    7q/P3RP2/2p2n2/8/N7/p7/2B5/k1K2b2 w - - bm a8=Q; id "Nightmare II-24 - Endspiel T&L&S vs D&L&S";
    25        0       O-O      -53       -    r1q2k2/pppb3r/2n1pBp1/3pPp1p/3P1Q1P/P2B4/2P2PP1/R3K2R w KQ - bm g4; id "Nightmare II-25 - Linienoeffnen";
    26        0       Qh6     +118       -    r5k1/6b1/2Nq4/2pP1p2/p1P1pPr1/Pp6/3R2PQ/1K3R2 b - - bm e3; id "Nightmare II-26 - Raeumung";
    27        0       Rd6      -56       -    r3kb1r/4Pp2/pn3P2/1pp3B1/2p5/2N3P1/PP3P1P/3RKB1b w kq - bm h4; id "Nightmare II-27 - Initiative";
    28        1       f4+     +344       -    N7/8/2KQ2rp/6k1/3p3p/2p4P/4PP2/5N2 w - - bm f4+; id "Nightmare II-28 - Endspiel D&S vs T&B";
    29        0       Nc7     +138       -    Nn6/8/6r1/8/K7/1P6/1R6/3k2N1 w - - bm Ka3; id "Nightmare II-29 - Endspiel T&S&S vs T&S";
    30        0      Rxf4      -90       -    r3rnk1/1bq1bpp1/pp2p3/3pP2Q/P4p2/1NNB1R2/1PP4P/2KR4 w - - bm Rg1; id "Nightmare II-30 - Koenigsangriff";
Top
Dann Corbit
Posts: 12538
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Nightmare II (Test-Set)

Post by Dann Corbit »

These are the ones from the set that I have never seen before:
r2qrb1k/3n2p1/p2p3p/1p1b4/Pnp1N1N1/5R1P/1P3PP1/1BBQR1K1 w - -
r1q2k2/pppb3r/2n1pBp1/3pPp1p/3P1Q1P/P2B4/2P2PP1/R3K2R w KQ -
Nn6/8/6r1/8/K7/1P6/1R6/3k2N1 w - -
7k/1p5p/2qpn1PP/Pp1p4/8/3B2p1/3B1pP1/R4K2 w - -
5B2/1p1nNp2/8/1P2R3/3p3q/8/p1K1P1Q1/k3b3 w - -
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
Top
Glarean
Posts: 262
Joined: Sun Oct 05, 2008 1:04 pm
Location: Switzerland
Full name: Walter Eigenmann

Re: Nightmare II (Test-Set)

Post by Glarean »

Hm... Can your CDrill really keeps the 2 solutions for 5-10 minutes??

Walter
Ferdy wrote:Very difficult tests indeed. But the weakest engine with rating of 1450 has solved 2 positions.

Code: Select all

                                  Engine  Hash(mb)  Thre Time(s)/pos    TotalTime  Positions  Correct     %  TestFile  
                                     Sf7       128     1       5.000  00h:02m:30s         30        0   0.0  Nightmare 2 - (W.Eigenmann).epd
                          D2016.1.35.366       128     1       5.000  00h:02m:30s         30        0   0.0  Nightmare 2 - (W.Eigenmann).epd
              D2016.1.35.366.Offense.300       128     1       5.000  00h:02m:30s         30        0   0.0  Nightmare 2 - (W.Eigenmann).epd
                             CDrill 1450         4     1       5.000  00h:02m:00s         30        2   6.7  Nightmare 2 - (W.Eigenmann).epd
Details for CDrill.

Code: Select all

Engine: CDrill 1450
Hash: 4, Threads: 1, Time: 5.0s/pos

Test file: Nightmare 2 - (W.Eigenmann).epd, TotalPos 30
AnalyzedPos : 30, Correct: 2 (6.67%)

Total time as reported by engine    : 00h:02m:00s:282ms
Expected time based on time/pos     : 00h:02m:30s:000ms
Engine start/quit wall time elapsed : 00h:02m:00s:290ms

   Pos  Correct  EngineBM  ScoreCP    Mate    EPD
     1        0      Bxc5       -4       -    r4rk1/1bq1bppp/p1npp3/2nB1NP1/1p2P3/2N1B3/PPP1QP1P/2KR2R1 w - - bm Qh5; id "Nightmare II-01 - Koenigsangriff";
     2        0       Kg2      +95       -    5nr1/2Pp2pk/3Pp1p1/4P1P1/6P1/5K2/8/7n w - - bm c8=N; id "Nightmare II-02 - Springerumwandlung";
     3        0       Ba7     -159       -    1rb2r1k/3p1pp1/p3p2p/1p2P3/4q3/1N2B1R1/PPP1N1P1/2KR1B2 w - - bm Nf4; id "Nightmare II-03 - Initiative";
     4        0       Bd2      -96       -    r2qrb1k/3n2p1/p2p3p/1p1b4/Pnp1N1N1/5R1P/1P3PP1/1BBQR1K1 w - - bm Nxh6; id "Nightmare II-04 - Springeropfer";
     5        0       Kh4     -338       -    6k1/bpR5/8/7K/8/3p4/1Rb2rpB/8 w - - bm Rbxb7; id "Nightmare II-05 - Endspiel T&T&L vs T&L&L&B";
     6        1     Qxd6+     +130       -    8/4kpp1/1pQq3p/p7/P7/3P2P1/2P2P1P/6K1 w - - bm Qxd6+; id "Nightmare II-06 - Endspiel D vs D";
     7        0      gxh3     -227       -    6r1/6r1/2p1k1pp/p1pbP2q/Pp1p1PpP/1P1P2NR/1KPQ3R/8 b - - bm Qf5; id "Nightmare II-07 - Festung";
     8        0        h3      -88       -    2r1k1r1/3q4/p1nBpp1p/8/B5p1/4RbK1/PP1Q1P1P/2R5 w - - bm h4; id "Nightmare II-08 - Offene Linie";
     9        0      gxh7     -395       -    7k/1p5p/2qpn1PP/Pp1p4/8/3B2p1/3B1pP1/R4K2 w - - bm a6; id "Nightmare II-09 - Patt";
    10        0      Rf3+     -251       -    2b1r3/r2ppN2/8/1p1p1k2/pP1P4/2P3R1/PP3PP1/2K5 w - - bm Nd6+; id "Nightmare II-10 - Endspiel T&S&B vs T&T&L";
    11        0      gxh2     +298       -    r5k1/p1pb2bp/3p3r/P1pPp1p1/2B1Pq2/1R2QPp1/1P4PP/5RBK b - - bm Rxh2+; id "Nightmare II-11 - Koenigsangriff";
    12        0      Qxd7     +113       -    4K2k/1pQp3p/1R4p1/1P4P1/8/3P3P/1q3r2/8 w - - bm Qd8; id "Nightmare II-12 - Endspiel D&T vs D&T";
    13        0       Be3     -169       -    2k2Br1/p6b/Pq1r4/1p2p1b1/1Ppp2p1/Q1P3N1/5RPP/R3N1K1 b - - bm Rf6; id "Nightmare II-13 - Koenigsangriff";
    14        0       Be3      -96       -    r1bqr1k1/3n1ppp/p2p1b2/3N1PP1/1p1B1P2/1P6/1PP1Q2P/2KR2R1 w - - bm Qxe8+; id "Nightmare II-14 - Damenopfer";
    15        0       Kd7     +226       -    4K1k1/8/1p5p/1Pp3b1/8/1P3P2/P1B2P2/8 w - - bm f4; id "Nightmare II-15 - Endspiel L vs L";
    16        0      Nh7+      -36       -    2r2k2/8/8/3Rp1N1/2P3K1/8/2p4B/8 w - - bm Ne6+; id "Nightmare II-16 - Endspiel T&L&S vs T&B";
    17        0      hxg5      +98       -    8/4nk2/1p3p2/1r1p2pp/1P1R1N1P/6P1/3KPP2/8 w - - bm Nd3; id "Nightmare II-17 - Endspiel T&S vs T&S";
    18        0       Ne2      -51       -    r1b2rk1/2q1bppp/p2pp3/2n3PQ/1p1BP3/1BN5/PPP2P1P/2KR2R1 w - - bm Bf6; id "Nightmare II-18 - Koenigsangriff";
    19        0       Re4      +50       -    5B2/1p1nNp2/8/1P2R3/3p3q/8/p1K1P1Q1/k3b3 w - - bm Ng6; id "Nightmare II-19 - Springeropfer";
    20        0      exd3      +29       -    r3r1k1/pp1q1p2/2p2npb/PPPp4/3Pp3/2NNPpP1/1R1B1P1K/3Q3R b - - bm Kg7; id "Nightmare II-20 - Starke Felder";
    21        0       Ra7     +204       -    1r6/4k3/r2p2p1/2pR1p1p/2P1pP1P/pPK1P1P1/P7/1B6 b - - bm Rxb3+; id "Nightmare II-21 - Endspiel T vs T";
    22        0       Qg4     -210       -    r1q2rk1/ppp1bp2/6p1/3pNPn1/7p/2PP3P/P6B/1R1Q1RK1 w - - bm f6; id "Nightmare II-22 - Bauernopfer";
    23        0       Ne8      +85       -    1k6/bPN2pp1/Pp2p3/p1p5/2pn4/3P4/PPR5/1K6 w - - bm Na8; id "Nightmare II-23 - Zugzwang";
    24        0       Nb6      +63       -    7q/P3RP2/2p2n2/8/N7/p7/2B5/k1K2b2 w - - bm a8=Q; id "Nightmare II-24 - Endspiel T&L&S vs D&L&S";
    25        0       O-O      -53       -    r1q2k2/pppb3r/2n1pBp1/3pPp1p/3P1Q1P/P2B4/2P2PP1/R3K2R w KQ - bm g4; id "Nightmare II-25 - Linienoeffnen";
    26        0       Qh6     +118       -    r5k1/6b1/2Nq4/2pP1p2/p1P1pPr1/Pp6/3R2PQ/1K3R2 b - - bm e3; id "Nightmare II-26 - Raeumung";
    27        0       Rd6      -56       -    r3kb1r/4Pp2/pn3P2/1pp3B1/2p5/2N3P1/PP3P1P/3RKB1b w kq - bm h4; id "Nightmare II-27 - Initiative";
    28        1       f4+     +344       -    N7/8/2KQ2rp/6k1/3p3p/2p4P/4PP2/5N2 w - - bm f4+; id "Nightmare II-28 - Endspiel D&S vs T&B";
    29        0       Nc7     +138       -    Nn6/8/6r1/8/K7/1P6/1R6/3k2N1 w - - bm Ka3; id "Nightmare II-29 - Endspiel T&S&S vs T&S";
    30        0      Rxf4      -90       -    r3rnk1/1bq1bpp1/pp2p3/3pP2Q/P4p2/1NNB1R2/1PP4P/2KR4 w - - bm Rg1; id "Nightmare II-30 - Koenigsangriff";
Top
rabbits23
Posts: 144
Joined: Fri Sep 12, 2014 4:57 am
Location: Randwick Australia

Re: Nightmare II (Test-Set)

Post by rabbits23 »

Dann Have you seen these ones?
http://chessstar.com/others/downloads/B ... fgaben.pdf
The introduction is in German (I think) but no worries;scroll down to page 4 and you are provided with 50 chess / check mate puzzles culminating with one
at the end-mate in 224.Answers are included. I can't remember where I got these puzzles from - someone from Talkchess might have provided them but I thought I'd post them anyway since you seem to enjoy chess riddles so much.
Regards Allan
Top
Dann Corbit
Posts: 12538
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Nightmare II (Test-Set)

Post by Dann Corbit »

Ottó Titusz Bláthy is probably the world's most famous chess composer.
I have all of his problems.

This grotesque link:
http://www.yacpdb.org/#search/ODg4ODg4O ... LzEvMA==/1

Will give 126 of them to you in Olive format from the YACPDB server


This link:
http://pdb.dieschwalbe.de/index.jsp
will give you 190 Blathy problems
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
Top
Ferdy
Posts: 4833
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: Nightmare II (Test-Set)

Post by Ferdy »

Glarean wrote:Hm... Can your CDrill really keeps the 2 solutions for 5-10 minutes??
That CDrill version is limited to only 20K nodes, which is reached in only around 30ms. No pruning, no reduction, does not use transposition table cutoffs, mainly powered by evaluation function. But I will try to let think for more than 20K nodes and see what happens.
Top
rabbits23
Posts: 144
Joined: Fri Sep 12, 2014 4:57 am
Location: Randwick Australia

Re: Nightmare II (Test-Set)

Post by rabbits23 »

Good one. Thanks Dann
Allan
Top

Return to “Computer Chess Club: General Topics”