Test position for 2500-ish engines

Discussion of chess software programming and technical issues.

Moderators: hgm, Rebel, chrisw

amanjpro
Posts: 883
Joined: Sat Mar 13, 2021 1:47 am
Full name: Amanj Sherwany

Re: Test position for 2500-ish engines

Post by amanjpro »

j.t. wrote: Sun Sep 12, 2021 2:55 pm
amanjpro wrote: Sun Sep 12, 2021 5:24 am Your time is not reported correctly, no? the times are only "incremental" not total time
Yes, it's incremental. I find it more useful this way (same with number of nodes). I am not sure, though, if that's "incorrect". The UCI specification isn't that detailed in this regard.
But this makes for miscalculated nps maybe?
User avatar
j.t.
Posts: 239
Joined: Wed Jun 16, 2021 2:08 am
Location: Berlin
Full name: Jost Triller

Re: Test position for 2500-ish engines

Post by j.t. »

amanjpro wrote: Sun Sep 12, 2021 3:46 pm
j.t. wrote: Sun Sep 12, 2021 2:55 pm
amanjpro wrote: Sun Sep 12, 2021 5:24 am Your time is not reported correctly, no? the times are only "incremental" not total time
Yes, it's incremental. I find it more useful this way (same with number of nodes). I am not sure, though, if that's "incorrect". The UCI specification isn't that detailed in this regard.
But this makes for miscalculated nps maybe?
If one would use the time only per iteration but count the nodes over all iteration, then probably yes, but I also count nodes per iteration (so not the total number of nodes over all depth iterations), so everything should be fine.
User avatar
emadsen
Posts: 434
Joined: Thu Apr 26, 2012 1:51 am
Location: Oak Park, IL, USA
Full name: Erik Madsen

Re: Test position for 2500-ish engines

Post by emadsen »

JVMerlino wrote: Sun Sep 12, 2021 7:14 am Turns out b3 still loses. It seems only f3, Qb7+ and Qa8+ hold the draw.
MadChess needs 2.8 seconds to avoid Qxa6, 7.4 seconds to find f3.

Code: Select all

❯ .\MadChess.Engine.exe
position fen 8/Q7/p3p3/1p1kP3/2qr4/6P1/PP1p1P2/3R2K1 w - - 0 45
go infinite
info depth 1 seldepth 6 time 56 nodes 676 score cp -47 nps 12004 pv b2b3
info depth 2 seldepth 8 time 61 nodes 1665 score cp -122 nps 27127 pv b2b3 c4e2
info depth 3 seldepth 10 time 64 nodes 5615 score cp -123 nps 88140 pv f2f4 c4a2 a7b7
info depth 4 seldepth 10 time 66 nodes 10704 score cp -106 nps 163381 pv a7a6 d5e5 a6b7 c4a2
info depth 5 seldepth 12 time 68 nodes 18302 score cp -99 nps 268251 pv a7a6 d5e5 a6b7 c4a2 f2f4
info depth 6 seldepth 12 time 76 nodes 43191 score cp -99 nps 569354 pv a7a6 d5e5 a6b7 c4a2 f2f4 e5f5
info depth 7 seldepth 14 time 82 nodes 63665 score cp -55 nps 776416 pv a7a6 d5e5 a6b7 d4d3 b7h7 e5d5 h7b7
info depth 8 seldepth 16 time 103 nodes 132974 score cp -74 nps 1287477 pv a7a6 d5e5 a6b7 c4e2 b7g7 e5e4 g7h7 e4d5
info depth 9 seldepth 16 time 122 nodes 194182 score cp -59 nps 1591206 pv a7a6 d5e5 a6b7 c4e2 b7g7 e5e4 g7h7 e4d5 h7c2
info depth 10 seldepth 16 time 153 nodes 299938 score cp -66 nps 1962826 pv a7a6 d5e5 a6b7 c4e2 b7g7 e5e4 g7h7 e4d5 h7d7 d5c4
info depth 11 seldepth 18 time 249 nodes 598610 score cp 0 nps 2407717 pv a7a6 d5e5 a6b7 c4e2 b7g7 e5e4 g7h7 e4d5 h7d7 d5e5 d7g7
info depth 12 seldepth 21 time 349 nodes 998132 score cp -36 nps 2859437 pv a7a6 d5e5 a6b7 c4e2 b7g7 e5d5 g7d7 d5c5 b2b4 c5c4 d7c6 c4b4
info depth 13 seldepth 21 time 639 nodes 2151049 score cp 0 nps 3363653 pv a7a6 d5e5 a6b7 c4e2 b7g7 e5d5 g7d7 d5c5 d7c7 c5d5 c7d7 c4b4 c6c2
info depth 14 seldepth 22 time 767 nodes 2677877 score cp 0 nps 3491506 pv a7a6 d5e5 a6b7 c4e2 b7g7 e5d5 g7d7 d5c5 d7c7 c5d5 c7d7 e2d1
info depth 15 seldepth 24 time 2812 nodes 10897679 score cp -120 nps 3875045 pv b2b3 c4c1 a7a8 d5e5 f2f4 e5f5 a8f3 f5f6 f3h5 f6e7 g1f2 e7d7 f2g2 c1c6 g2h3
info depth 16 seldepth 24 time 3644 nodes 14334519 score cp -123 nps 3933938 pv b2b3 c4c1 a7a8 d5e5 f2f4 e5f5 a8f3 f5f6 f3h5 f6e7 g1g2 c1c6 g2h2 c6d5 h5h7 e7d6
info depth 17 seldepth 26 time 7438 nodes 29930876 score cp -34 nps 4023959 pv f2f3 d5e5 g1f2 d4d3 a7b8 e5d5 b8b7 d5c5 b7c7 c5b4 c7c4 b5c4 f2e2 b4c5 d1d2 c5d4 e2e1
info depth 18 seldepth 28 time 13317 nodes 54183378 score cp -11 nps 4068743 pv f2f3 b5b4 g1f2 c4a2 a7d7 d5e5 d7g7 e5d5 g7g5 d5c6 d1d2 a2d5 d2c2 d4c4 c2c4 d5c4 g5g7 c4c2
Edit: I should note, though, the solve times are not reproducible. MadChess does not have a deterministic search. At engine startup, it assigns random values to Zobrist keys. This can affect cache (transposition table) lookups.
My C# chess engine: https://www.madchess.net
User avatar
Steve Maughan
Posts: 1221
Joined: Wed Mar 08, 2006 8:28 pm
Location: Florida, USA

Re: Test position for 2500-ish engines

Post by Steve Maughan »

Terrible!! Maverick 1.5 on a 3 GHz i7 doesn't find it after 10 minutes :(

[d]8/Q7/p3p3/1p1kP3/2qr4/6P1/PP1p1P2/3R2K1 w - -

Engine: Maverick 1.5 x64 (512 MB) by Steve Maughan

18/57 4:10 0.00 1.Qxa6 Kxe5 2.Qb7 Qe2 3.Qg7+ Ke4
4.Qh7+ Kd5 5.Qd7+ Kc5 6.Qc7+ Kd5
7.Qd7+ (911.537.655) 3639

19/65 10:26 0.00 1.Qxa6 Kxe5 2.Qb7 Qe2 3.Qg7+ Kd5
4.Qd7+ Kc5 5.Qc7+ Kd5 6.Qd7+ (2.282.497.801) 3641
http://www.chessprogramming.net - Maverick Chess Engine
op12no2
Posts: 489
Joined: Tue Feb 04, 2014 12:25 pm
Full name: Colin Jenkins

Re: Test position for 2500-ish engines

Post by op12no2 »

Lozza needs to depth 20 and 85 seconds on one core of an i7 @3.2G to find f3.

Code: Select all

113.29 21/41 (0cp) f3 Kxe5 Qb8 Kf5 Qf8 Kg6 Kf2 Rd3
84.49 20/34 (0cp) f3 Kxe5 Qb8
16.19 19/34 (0cp) Qxa6 Qe2 Qb7 Kxe5 Qg7 Ke4 Qh7 Kd5 Qd7 Ke5 Qg7 Ke4 Qh7 Kd5 Qd7 Ke5 Qg7 Ke4 Qh7
9.77 18/31 (0cp) Qxa6 Qe2 Qb7 Kxe5 Qg7 Ke4 Qh7 Kd5 Qd7 Ke5 Qg7 Ke4 Qh7 Kd5 Qd7 Ke5 Qg7 Ke4
6.01 17/30 (0cp) Qxa6 Qe2 Qb7 Kxe5 Qg7 Ke4 Qh7 Kd5 Qd7 Ke5 Qg7 Ke4 Qh7 Kd5 Qd7 Ke5 Qg7
3.83 16/26 (0cp) Qxa6 Qe2 Qb7 Kxe5 Qg7 Ke4 Qh7 Kd5 Qd7 Ke5 Qg7 Ke4 Qh7 Kd5 Qd7 Ke5
2.66 15/26 (0cp) Qxa6 Qe2 Qb7 Kxe5 Qg7
1.99 14/26 (0cp) Qxa6 Qe2 Qb7 Kxe5 Qg7 Kd5 Qd7 Ke5 Qg7 Kd5 Qd7 Ke5 Qg7 Kd5
1.35 13/24 (0cp) Qxa6 Qe2 Qb7 Kxe5 Qg7 Kd5 Qd7 Ke5 Qg7 Kd5 Qd7 Ke5 Qg7
1.05 12/24 (0cp) Qxa6 Qe2 Qb7 Kxe5 Qg7 Kd5 Qd7 Ke5 Qg7 Kd5 Qd7 Ke5
0.87 11/22 (0cp) Qxa6 Qe2 Qb7 Kxe5 Qg7 Kd5 Qd7 Ke5 Qg7 Kd5 Qd7
0.71 10/22 (0cp) Qxa6 Qe2 Qb7 Kxe5 Qg7 Kd5 Qd7 Ke5 Qg7 Kd5
0.55 9/21 (0cp) Qxa6 Qe2 Qb7 Kxe5 Qg7 Kd5 Qd7 Ke5 Qg7
0.43 8/19 (0cp) Qxa6 Qe2 Qb7 Kxe5 Qg7 Kd5 Qd7 Ke5
0.24 7/16 (17cp) Qxa6 Kxe5 Qa8 Qd5 Qh8 Ke4 Qh4
0.18 6/15 (22cp) Qxa6 Kxe5 Qa8 Qd5 Qb8 Kf5
0.12 5/12 (25cp) Qxa6 Kxe5 Qa8 Qc5 Qh8
0.06 4/10 (-15cp) Qxa6 Kxe5 Qa8 Qd3
0.04 3/8 (-26cp) Qxa6 Kxe5 f4
0.01 2/6 (-3cp) Qg7 Qxa2
0.01 1/6 (-3cp) Qg7
0.01 1/6 (-8cp) Qxa6
0.01 1/6 (-432cp) Rxd2
0 1/4 (-602cp) Qxd4