Arasan test suite update - beta version

[Jouni]

Houdini 5 tactical is really peerless. 4 cores and 120 s. Set from homepage:

Code: Select all

--------------------------------------------------------------------------------

Analysis of C:\EPD\beta20.epd   
Analyzing engine: Houdini 5
29.4.2017 14:23:05 Level: 120 Seconds
   Source                    : List of EPD/PGN files
      C:\EPD\beta20.epd
   Colours                   : White moves=True, Black moves=True
   Direction                 : forward
   Games (PGN)               : From 1 to 999999
   Moves                     : From 1 to 250
   Positions (EPD)           : All positions
   Use Engine(s)             : List
      Houdini 5
   Use seconds per move      : 120 Seconds per move
   Analysis Lines            : Minimum search depth=10
   Activate abort analysis   : True. Minimal analysis depth 10. Abort, if the correct move is held 5 additional ply
  1) g2-g4              g2-g4   * 1 Second
  2) Rf1xf7             Rf1xf7  * 50 Seconds
  3) .. Be7xc5          Be7xc5  * 1 Second
  4) Bd3xh7             Bd3xh7  * 17 Seconds
  5) Qe2-h5             Qe2-h5  * 0 Seconds
  6) Re1xe7             Re1xe7  * 6 Seconds
  7) Qd1-a4             Qd1-a4  * 2 Seconds
  8) e5-e6              e5-e6   * 1 Second
  9) Bd3-c4             Bd3-c4  * 10 Seconds
 10) g2-g4              g2-g4   * 4 Seconds
 11) .. Be8-g6          Be8-g6  * 1 Second
 12) Bg5-d8             Bg5-d8  * 0 Seconds
 13) .. Rf6-f3          Rf6-f3  * 0 Seconds
 14) Ng3-f5             Ng3-f5  * 2 Seconds
 15) .. Nf6xg4          Nf6xg4  * 2 Seconds
 16) Rd2-e2             Rd2-e2  * 80 Seconds
 17) Ng4xh6, e4-e5      e4-e5   * 3 Seconds
 18) Be3xh6, Ra1xa2     Be3xh6  * 1 Second
 19) h4-h5              h4-h5   * 0 Seconds
 20) Be3-h6             Be3-h6  * 29 Seconds
 21) Nd5xf6             Nd5xf6  * 2 Seconds
 22) Bf1-g2             Bf1-g2  * 0 Seconds
 23) Qd2-f4             Qd2-f4  * 2 Seconds
 24) Ng5xh7             Ng5xh7  * 11 Seconds
 25) Qe3-d4             Qe3-d4  * 0 Seconds
 26) Rd3-g3             Rd3-g3  * 4 Seconds
 27) f4-f5              f4-f5   * 11 Seconds
 28) g4-g5              f5-f6    
 29) .. Be3-d4          Be3-d4  * 0 Seconds
 30) Qe5-h8             Qe5-h8  * 0 Seconds
 31) Rb1xb7             Rb1xb7  * 0 Seconds
 32) Nd4-c6             Bf4-e3   
 33) Na4xb6             Na4xb6  * 0 Seconds
 34) Qg5-h6             Qg5-h6  * 4 Seconds
 35) b2-b3              b2-b3   * 0 Seconds
 36) e4-e5              e4-e5   * 0 Seconds
 37) Bh4xg5, Ra1-c1     Nd5-e3   
 38) Bg5-f6             Bg5-f6  * 5 Seconds
 39) .. Ra8-a2          Ra8-a2  * 8 Seconds
 40) .. e4-e3           e4-e3   * 0 Seconds
 41) f5-f6              f5-f6   * 32 Seconds
 42) Bd3xh7             Bd3xh7  * 111 Seconds
 43) Rf5-e5             Rf5-e5  * 0 Seconds
 44) f5-f6              f5-f6   * 8 Seconds
 45) g3-g4              g3-g4   * 0 Seconds
 46) Qf3xf7             Qf3xf7  * 7 Seconds
 47) Ne4xf6, Ra1-d1     Ne4xf6  * 1 Second
 48) Bc1xh6, Ra1-d2     Bc1xh6  * 0 Seconds
 49) .. Bc8xg4          Bc8xg4  * 0 Seconds
 50) .. Nf5xg3(?)       Rh8-d8  * 0 Seconds
 51) Nb3-d4             Nb3-d4  * 0 Seconds
 52) .. Ne8-c7          Ne8-c7  * 26 Seconds
 53) a5-a6              a5-a6   * 7 Seconds
 54) Ka3-b2             Ka3-b2  * 1 Second
 55) g5-g6              g5-g6   * 2 Seconds
 56) Nd4-f5             Nd4-f5  * 75 Seconds
 57) .. Re2xg2          Re2xg2  * 0 Seconds
 58) g3-g4              g3-g4   * 0 Seconds
 59) g2-g3              g2-g3   * 2 Seconds
 60) Nf4xd5             Nf4xd5  * 0 Seconds
 61) Rh5xg5             Rh5xg5  * 80 Seconds
 62) .. Nf5xd4          Nf5xd4  * 6 Seconds
 63) .. Rf8-h8          Rf8-h8  * 0 Seconds
 64) f4-f5              f4-f5   * 2 Seconds
 65) Rc6-c8             Rc6-c8  * 0 Seconds
 66) Bd4-c5             Bd4-c5  * 2 Seconds
 67) Bd3-b5             Bd3-b5  * 0 Seconds
 68) Re1xe7             Re1xe7  * 0 Seconds
 69) Nd5-f6             Nd5-f6  * 0 Seconds
 70) Rf1-f3             Rf1-f3  * 4 Seconds
 71) c4-c5              c4-c5   * 4 Seconds
 72) Nf3-g5             Nf3-g5  * 0 Seconds
 73) Nd4-f5             Nd4-f5  * 0 Seconds
 74) f4-f5              f4-f5   * 18 Seconds
 75) Rg5xg7             Rg5xg7  * 3 Seconds
 76) .. Rb8-c8          Rb8-c8  * 1 Second
 77) Bb1xh7             Bb1xh7  * 1 Second
 78) e4-e5              e4-e5   * 0 Seconds
 79) .. g5-g4           g5-g4   * 1 Second
 80) .. Re8xe4          Re8xe4  * 39 Seconds
 81) .. Nf6-g4          Nf6-g4  * 0 Seconds
 82) Rg3xg7             Rg3xg7  * 2 Seconds
 83) .. h6-h5           h6-h5   * 0 Seconds
 84) Qd1xg4             Qd1xg4  * 0 Seconds
 85) Qd3-g6             Qd3-g6  * 2 Seconds
 86) Bg5xh6             Bg5xh6  * 0 Seconds
 87) g3-g4              g3-g4   * 34 Seconds
 88) Rb6xe6, Ra1-h2     Rb6xe6  * 1 Second
 89) Bc4xf7             Bc4xf7  * 0 Seconds
 90) .. Bc5xd4          Bc5xd4  * 2 Seconds
 91) Rf3-f6             Rf3-f6  * 28 Seconds
 92) Ng5xh7             Ng5xh7  * 9 Seconds
 93) Rd4xd5             Rd4xd5  * 0 Seconds
 94) Nc3xd5             Nc3xd5  * 0 Seconds
 95) a2-a3              a2-a3   * 0 Seconds
 96) Bd3xh7             Bd3xh7  * 3 Seconds
 97) Bd3xh7             Bd3xh7  * 0 Seconds
 98) .. Rg6xg3, Ra1xb2  Rg6xg3  * 1 Second
 99) g4-g5              g4-g5   * 54 Seconds
100) Qg4-h5             Qg4-h5  * 41 Seconds
101) .. Nc6-e5          Nc6-e5  * 1 Second
102) c2-c4              c2-c4   * 1 Second
103) Bf4-h6             Bf4-h6  * 21 Seconds
104) .. Nf6-g4          Nf6-g4  * 8 Seconds
105) b2-b4              b2-b4   * 1 Second
106) Qf2-g3             Qf2-g3  * 4 Seconds
107) Qh5xg4             Qh5xg4  * 0 Seconds
108) Qd1-f1, Ra1xa2     Qd1-f1  * 0 Seconds
109) .. Ba4xb3          Ba4xb3  * 0 Seconds
110) Nf3xe5             Nf3xe5  * 1 Second
111) Ne5xf7             Ne5xf7  * 0 Seconds
112) Nf3-g5             Nf3-g5  * 0 Seconds
113) Be2xh5             Be2xh5  * 0 Seconds
114) .. g6-g5, d5-d4    d5-d4   * 0 Seconds
115) .. d4-d3           d4-d3   * 3 Seconds
116) Nf4-d3             Nf4-d3  * 17 Seconds
117) .. Bb7-d5, ...     Bb7-d5  * 0 Seconds
118) Rf3-h3             Rf3-h3  * 0 Seconds
119) Ng3-h5             Ng3-h5  * 0 Seconds
120) b2-b4              b2-b4   * 14 Seconds
121) .. h5-h4           h5-h4   * 0 Seconds
122) .. Re3xf3          Re3xf3  * 5 Seconds
123) Rf1-c1             Rf1-c1  * 2 Seconds
124) Re1-e5             Re1-e5  * 23 Seconds
125) .. Rc8-b8          Rc8-b8  * 0 Seconds
126) Nd4xe6             Nd4xe6  * 5 Seconds
127) Rf4xf5             Rf4xf5  * 0 Seconds
128) c5-c6              c5-c6   * 0 Seconds
129) Qc4xc8             Qc4xc8  * 4 Seconds
130) Re2-f2             Re2-f2  * 3 Seconds
131) d5-d6              d5-d6   * 1 Second
132) Qf3-f6             Be3xc5   
133) Nf3-g5             Nf3-g5  * 9 Seconds
134) Rf1xf6             Rf1xf6  * 3 Seconds
135) .. a4xb3           a4xb3   * 6 Seconds
136) Ng5xe6             Ng5xe6  * 28 Seconds
137) .. Qg5xg3          Qg5xg3  * 53 Seconds
138) Nc3-d5             Nc3-d5  * 3 Seconds
139) Kg3-f3             Kg3-f3  * 3 Seconds
140) .. Na4xb2          Na4xb2  * 0 Seconds
141) .. Qd5xg2(?)       Qd5-c6  * 0 Seconds
142) Rf1-f3             Rf1-f3  * 0 Seconds
143) Nd4-f5             Nd4-f5  * 1 Second
144) Ke2-d3             Ke2-d3  * 0 Seconds
145) Nf5-e3             g3-g4    
146) Bd3xh7             Bd3xh7  * 16 Seconds
147) e4-e5              e4-e5   * 2 Seconds
148) Rf1xf6, Ra1-d2     Rf1xf6  * 32 Seconds
149) .. Kg8-h7          Kg8-h7  * 0 Seconds
150) Rf3xf6             Rf3xf6  * 0 Seconds
151) e5-e6              e5-e6   * 35 Seconds
152) Rh2-h8             Rh2-f2   
153) Rf1xf5             Rf1xf5  * 0 Seconds
154) g4-g5              Kf2-e2   
155) Rg1xg7             Rg1xg7  * 97 Seconds
156) Nc5-e4             Nc5-e4  * 11 Seconds
157) Bd3xh7             Bd3xh7  * 3 Seconds
158) .. Bd7-h3          Bd7-h3  * 109 Seconds
159) Bd3xh7             Nd4xc6   
160) .. d5-d4           d5-d4   * 102 Seconds
161) Ng5xf7             Ng5xf7  * 45 Seconds
162) .. Ne4-g3          Ne4-g3  * 2 Seconds
163) g4-g5              g4-g5   * 0 Seconds
164) Bd3xf5             Bd3xf5  * 2 Seconds
165) Bd3xh7             Bd3xh7  * 1 Second
166) Nf3-g5             Nf3-g5  * 0 Seconds
167) .. Kh5-h4          Kh5-h4  * 7 Seconds
168) .. f6-f5           f6-f5   * 0 Seconds
169) .. b4-b3           b4-b3   * 1 Second
170) Bd3xg6             Bd3xg6  * 36 Seconds
171) Qe6-d6, Qe6-e8     Qe6-d6  * 4 Seconds
172) Rd1xd5             Rd1xd5  * 0 Seconds
173) Bb4xe7             Bb4xe7  * 7 Seconds
174) Bd5-c4             Bd5-c4  * 11 Seconds
175) f5-f6              f5-f6   * 11 Seconds
176) .. f7-f5           f7-f5   * 0 Seconds
177) Rg1xg4             h2-h3    
178) Be5-f6             Be5-f6  * 0 Seconds
179) Kg1-f2, ...        Ba2-b3   
180) Bc1-g5             Bc1-g5  * 0 Seconds
181) Nf5-g3             Nf5-g3  * 2 Seconds
182) Qe3-h6             Qe3-h6  * 0 Seconds
183) e4-e5              e4-e5   * 0 Seconds
184) Ne4-g5             Ne4-g5  * 30 Seconds
185) Nd4-c6             Nd4-c6  * 0 Seconds
186) Nf3-e5             Nf3-e5  * 3 Seconds
187) Re6xd6             Re6xd6  * 0 Seconds
188) h5-h6              h5-h6   * 17 Seconds
189) f3-f4              f3-f4   * 99 Seconds
190) e5-e6              Ra1-e1   
191) b3-b4              b3-b4   * 0 Seconds
192) Rf1xf7             Rf1xf7  * 0 Seconds
193) .. Rh8xh3          Rh8xh3  * 0 Seconds
194) Rh8-h5, Rh8-h3     Rh8-h3  * 0 Seconds
195) a4-a5              a4-a5   * 0 Seconds
196) e5-e6              e5-e6   * 0 Seconds
197) f4-f5              f4-f5   * 0 Seconds
198) .. Qc5-b4, Qa1xa2  Qc5-b4  * 2 Seconds
199) Nd2-b3             Nd2-b3  * 8 Seconds
200) g2-g4              g2-g4   * 15 Seconds

189 of 200 matching moves
Rated time: 51:57 = 3117 Seconds

[Vinvin]

Houdini 5 tactical is really peerless. 4 cores and 120 s.

Try Houdini 4 tactical

[Ferdy]

For your move ordering spy, I analyzed the set a bit.
The "move ordering controversies" can be found here:
http://rybkaforum.net/cgi-bin/rybkaforu ... pid=572997

I am not sure which answers are right.

Some of them are only searched to 30 plies.

Thanks I got the file.

[jdart]

Final version here:

https://www.arasanchess.org/arasan20.epd

I have made one final change, to replace position #140 with this one, which was a nice brilliancy played against my program. It is not very difficult for Stockfish but other engines may find it challenging.

[D] r1bq2k1/1pp2ppp/3prn2/p3n3/2P5/PQN1PP2/1P1PB2P/R1B2R1K b - - bm Nfg4; id "arasan20.140"; c0 "Arasan-zerowin, FICS 2017";

--Jon

[Dann Corbit]

Your suggested move is field c3 in those Epd records.

[peter]

Thanks a lot, Jon.

Did let latest asmFish run with 30"/position+ 1extra ply on 24threads of a 12x2,67GHz Intel- CPU with 2048Mb hash, solved 187 out of 200

[Vinvin]

Final version here:

https://www.arasanchess.org/arasan20.epd
...

--Jon

Thanks for your work, Jon !

[Ferdy]

Your suggested move is field c3 in those Epd records.

Thanks for the hint.

[MikeB]

Final version here:

https://www.arasanchess.org/arasan20.epd

I have made one final change, to replace position #140 with this one, which was a nice brilliancy played against my program. It is not very difficult for Stockfish but other engines may find it challenging.

[D] r1bq2k1/1pp2ppp/3prn2/p3n3/2P5/PQN1PP2/1P1PB2P/R1B2R1K b - - bm Nfg4; id "arasan20.140"; c0 "Arasan-zerowin, FICS 2017";

--Jon

81/200 at 1 sec per move using 18 threads

Code: Select all

engine_name = 'McBrain_2017_v22'
hash_size = 256
multi_pv_value = 1
search_time = 1
cores = 18

4rrk1/1bq1pp2/p2p1n1Q/1pn2p1p/4P3/P1N2P2/BPP3PP/2KRR3 w - - bm g4;

bestmove e4f5
depth 21 seldepth 43 multipv 1 score cp 170 nodes 24680332 nps 24606512 hashfull 623 tbhits 0 time 1003 pv e4f5 d6d5 a2d5 e8d8 h6g6 g8h8 d5f7 c7f4 c1b1 d8d1 e1d1 f4e3 h2h4 b7a8 d1d6 f6h7 f5f6 e7f6 g6h5 e3e5 f7g6 e5h5 g6h5 a8b7 b2b4 c5a4 c3a4 b5a4 c2c4 f8g8
-- not solved
solved 81 out of 200

[MikeB]

Final version here:

https://www.arasanchess.org/arasan20.epd

I have made one final change, to replace position #140 with this one, which was a nice brilliancy played against my program. It is not very difficult for Stockfish but other engines may find it challenging.

[D] r1bq2k1/1pp2ppp/3prn2/p3n3/2P5/PQN1PP2/1P1PB2P/R1B2R1K b - - bm Nfg4; id "arasan20.140"; c0 "Arasan-zerowin, FICS 2017";

--Jon

81/200 at 1 sec per move using 18 threads

Code: Select all

engine_name = 'McBrain_2017_v22'
hash_size = 256
multi_pv_value = 1
search_time = 1
cores = 18

4rrk1/1bq1pp2/p2p1n1Q/1pn2p1p/4P3/P1N2P2/BPP3PP/2KRR3 w - - bm g4;

bestmove e4f5
depth 21 seldepth 43 multipv 1 score cp 170 nodes 24680332 nps 24606512 hashfull 623 tbhits 0 time 1003 pv e4f5 d6d5 a2d5 e8d8 h6g6 g8h8 d5f7 c7f4 c1b1 d8d1 e1d1 f4e3 h2h4 b7a8 d1d6 f6h7 f5f6 e7f6 g6h5 e3e5 f7g6 e5h5 g6h5 a8b7 b2b4 c5a4 c3a4 b5a4 c2c4 f8g8
-- not solved
solved 81 out of 200

124/200 at 5 sec per move using 18 threads

Code: Select all

engine_name = 'McBrain_2017_v22'
hash_size = 1024
multi_pv_value = 1
search_time = 5
cores = 18

bestmove g2g4
depth 25 seldepth 56 multipv 1 score cp 222 nodes 115058845 nps 22993374 hashfull 730 tbhits 0 time 5004 pv g2g4
++ solved
solved 124 out of 200