How to scale stockfish NNUE score?

Discussion of chess software programming and technical issues.

Moderators: hgm, Rebel, chrisw

User avatar
hgm
Posts: 27791
Joined: Fri Mar 10, 2006 10:06 am
Location: Amsterdam
Full name: H G Muller

Re: How to scale stockfish NNUE score?

Post by hgm »

maksimKorzh wrote: Sat Oct 17, 2020 7:15 pmI am always getting excited when you're trying to implement engines for games other but chess. I'm just wondering what motivates you?
I mean usually people developing one engine for years and it's difficult to master chess programming at a decent level...
But you're trying many other games! This is incredible, so what motivates you? Thanks in advance.
I am driven mainly by curiosity, I like doing creative work, and it is gratifying to create things that others are eager to use. That sort of disqualifies orthodox Chess, for which there are already thousands of engines. Except for a handful of testers no one is interested in having yet another one. So I try to focus on games where nothing, or nothing decent exists yet. Or where it is truly unknown what is a good way to do it.

I find Paco Shako a very intriguing game in this respect; no one really knows how to play that. I am very curious what would be a good strategy for it. This NNUE method seems ideally suited for it, and material does not seem to be an important term in that game (it is impossible to lose any...), and King Safety is everything. And as I happen to have a lot of Janggi games handy, this seems a good opportunity to get some hands-on experience with this interesting NNUE technique. For Janggi there seems to hardly exist anything, and millions of potential users.
User avatar
maksimKorzh
Posts: 771
Joined: Sat Sep 08, 2018 5:37 pm
Location: Ukraine
Full name: Maksim Korzh

Re: How to scale stockfish NNUE score?

Post by maksimKorzh »

hgm wrote: Sat Oct 17, 2020 9:23 pm
maksimKorzh wrote: Sat Oct 17, 2020 7:15 pmI am always getting excited when you're trying to implement engines for games other but chess. I'm just wondering what motivates you?
I mean usually people developing one engine for years and it's difficult to master chess programming at a decent level...
But you're trying many other games! This is incredible, so what motivates you? Thanks in advance.
I am driven mainly by curiosity, I like doing creative work, and it is gratifying to create things that others are eager to use. That sort of disqualifies orthodox Chess, for which there are already thousands of engines. Except for a handful of testers no one is interested in having yet another one. So I try to focus on games where nothing, or nothing decent exists yet. Or where it is truly unknown what is a good way to do it.

I find Paco Shako a very intriguing game in this respect; no one really knows how to play that. I am very curious what would be a good strategy for it. This NNUE method seems ideally suited for it, and material does not seem to be an important term in that game (it is impossible to lose any...), and King Safety is everything. And as I happen to have a lot of Janggi games handy, this seems a good opportunity to get some hands-on experience with this interesting NNUE technique. For Janggi there seems to hardly exist anything, and millions of potential users.
Thanks for explanations. Very interesting! It would be even more interesting if you were making microMax like tutorials - I've learned so much from that tutorial! Your answers here are for good programmers (not for me) but your tutorials are great!
User avatar
maksimKorzh
Posts: 771
Joined: Sat Sep 08, 2018 5:37 pm
Location: Ukraine
Full name: Maksim Korzh

Re: How to scale stockfish NNUE score?

Post by maksimKorzh »

I'm facing some very weird behavior of Stockfish NNUE in my engine:
IT'S VERY POOR IN PLAYING ENDGAMES

e.g. my old noob's handcrafted eval mated with king queen and knight vs king EASILY while NNUE version manages to draw with 50 move rule.
I didn't touch search.

How on earth is tha possible???
[pgn]
[Event "Computer chess game"]
[Site "maksim-Inspiron-3582"]
[Date "2020.10.20"]
[Round "?"]
[White "BBC_1.3_sf_nnue_64bit_linux"]
[Black "Vice 1.0"]
[Result "0-1"]
[BlackElo "2000"]
[ECO "D21"]
[Opening "QGA"]
[Time "22:28:01"]
[Variation "Ericson Variation"]
[WhiteElo "2000"]
[TimeControl "120+1"]
[Termination "time forfeit"]
[PlyCount "284"]
[WhiteType "program"]
[BlackType "program"]

1. d4 {(d2-d4 Ng8-f6 c2-c4 e7-e6 Nb1-c3 d7-d5 Ng1-f3) -0.00/7 5} d5 {(d7-d5
Nb1-c3 Bc8-f5 Bc1-f4 Ng8-f6 e2-e3 Nb8-c6 Bf1-d3) -0.20/8 4} 2. c4 {(c2-c4
e7-e6 Ng1-f3 Ng8-f6 Nb1-c3 Nb8-d7 e2-e3) -0.00/7 4} dxc4 {(d5xc4 e2-e4
b7-b5 Nb1-c3 Bc8-d7 Bc1-e3 Ng8-f6 Ng1-f3) +0.23/8 4} 3. Nf3 {(Ng1-f3 Ng8-f6
e2-e3 c7-c5 Bf1xc4 e7-e6) +0.51/6 4} b5 {(b7-b5 Bc1-f4 Bc8-d7 Nb1-c3 e7-e6
e2-e4 Bf8-d6) +0.43/7 4} 4. a4 {(a2-a4 e7-e6 a4xb5 Bc8-b7 e2-e4 Ng8-f6
Nb1-c3) -0.00/7 4} c6 {(c7-c6 a4xb5 c6xb5 Nb1-c3 Bc8-d7 e2-e4 Ng8-f6
Bc1-f4) +0.38/8 4} 5. axb5 {(a4xb5 c6xb5 Nb1-c3 Bc8-d7 e2-e4 a7-a6 d4-d5)
-0.00/7 4} cxb5 {(c6xb5 Nb1-c3 Bc8-d7 e2-e4 Ng8-f6 e4-e5 Nf6-g4 Bc1-f4)
+0.48/8 4} 6. Nc3 {(Nb1-c3 Bc8-d7 e2-e4 e7-e6 d4-d5 Bf8-b4) +1.31/6 4} Bd7
{(Bc8-d7 Nf3-e5 Ng8-f6 Bc1-d2 Nb8-c6 Ne5xd7) +0.48/8 4} 7. e4 {(e2-e4 e7-e6
d4-d5 Ng8-f6 d5xe6 f7xe6) +1.33/6 4} e6 {(e7-e6 Nf3-e5 Bf8-b4 Bf1-e2 Ng8-f6
Bc1-g5 h7-h6 Ne5xd7) +0.50/8 4} 8. d5 {(d4-d5 Bf8-b4 Bf1-e2 e6xd5 O-O)
+1.16/5 4} b4 {(b5-b4 d5xe6 f7xe6 Nc3-a4 Qd8-c7 Bc1-e3 Ng8-f6) +0.70/7 4}
9. Na4 {(Nc3-a4 Qd8-c7 Qd1-d4 e6xd5 Na4-b6) +2.52/5 4} Qc7 {(Qd8-c7 Qd1-d4
Qc7-a5 Bf1xc4 Bd7xa4 Bc4-b3 e6xd5) +0.37/7 4} 10. Qd4 {(Bc1-e3 Nb8-a6 d5xe6
Bd7xe6) +2.59/4 4} Bxa4 {(Bd7xa4 Ra1xa4 c4-c3 d5xe6 f7xe6 Bf1-b5+ Nb8-d7)
+0.25/7 3} 11. Rxa4 {(Ra1xa4 Ng8-f6 d5xe6 a7-a5 Qd4xc4) +5.41/5 3} Nf6
{(Ng8-f6 d5xe6 f7xe6 Bf1xc4 Nb8-c6 Qd4-d3 Ra8-d8) -0.30/7 3} 12. dxe6
{(d5xe6 f7xe6 Qd4xc4 Qc7xc4 Bf1xc4) +5.62/5 4} fxe6 {(f7xe6 Bf1xc4 Qc7-c6
Ra4-a5 Qc6xe4+ Qd4xe4 Nf6xe4) -0.35/7 3} 13. Qxc4 {(Qd4xc4 Qc7xc4 Bf1xc4
a7-a5 Bc4-b5+) +5.65/5 3} Qxc4 {(Qc7xc4 Bf1xc4 Nf6xe4 Bc1-e3 Bf8-c5 Be3xc5
Ne4xc5 Ra4xb4) -0.30/8 3} 14. Bxc4 {(Bf1xc4 Nf6xe4 O-O Bf8-c5 Bc4xe6 a7-a5
Bc1-f4) +4.71/7 3} Nxe4 {(Nf6xe4 Bc1-e3 Ne4-c5 Bc4-b5+ Nb8-d7 Ra4-a5
Ke8-d8) -0.25/7 3} 15. O-O {(O-O Bf8-c5 Bc4xe6 a7-a5 Bc1-f4 Ne4xf2) +4.71/6
3} Bc5 {(Bf8-c5 Bc4xe6 Bc5xf2+ Rf1xf2 Ne4xf2 Be6-d5 Nb8-c6) -0.45/7 3} 16.
Bxe6 {(Bc4xe6 a7-a5 Be6-c4 Ne4xf2 Rf1xf2) +4.48/5 3} Bxf2+ {(Bc5xf2+ Rf1xf2
Ne4xf2 Kg1xf2 Nb8-c6 Bc1-e3 a7-a5 Be6-d5) -0.65/8 3} 17. Rxf2 {(Rf1xf2
Ne4xf2 Kg1xf2 a7-a5 Bc1-e3 Rh8-f8 Be6-b3) +10.15/6 3} Nxf2 {(Ne4xf2 Kg1xf2
a7-a5 Be6-d5 Ra8-a6 Bc1-f4 Nb8-d7 Kf2-g1) -0.90/8 3} 18. Kxf2 {(Kg1xf2
a7-a5 Bc1-e3 Rh8-f8 Be6-b3 Nb8-c6) +10.06/6 3} a5 {(a7-a5 Be6-d5 Ra8-a6
Bc1-e3 Nb8-d7 h2-h3 Rh8-f8 Bd5-b7 Ra6-d6) -1.05/9 3} 19. Be3 {(Bc1-e3
Rh8-f8 Kf2-g3 Nb8-c6 Be6-c4 O-O-O) +9.47/6 3} Nd7 {(Nb8-d7 Be6-d5 Ra8-a6
Bd5-b7 Ra6-d6 Ra4xa5 O-O) -1.30/8 3} 20. Kg3 {(Kf2-g3 Ra8-a6 Be6-c4 Ra6-g6+
Kg3-f2 Rg6-f6 Kf2-e2) +10.11/6 3} Nf6 {(Nd7-f6 Be3-d4 Ra8-a6 Be6-c4 Ra6-a8
Kg3-f2 Ra8-c8 Nf3-e5) -0.40/8 3} 21. h4 {(h2-h4 Ke8-e7 Be6-c4 Rh8-c8 b2-b3)
+10.29/5 3} Ke7 {(Ke8-e7 Be6-f5) -0.15/7 3} 22. Bc4 {(Be6-c4 Rh8-c8 Bc4-b3
Ra8-a6 Be3-d4 Ra6-d6) +9.28/6 2} Rhc8 {(Rh8-c8 Bc4-d3 Rc8-d8 Be3-c5+ Ke7-e8
Bd3-b5+ Ke8-f7) -0.10/7 2} 23. Bd3 {(Bc4-d3 Ke7-f8 Be3-b6 Nf6-h5+ Kg3-g4
g7-g6) +8.15/5 2} Kf8 {(Ke7-f8 Be3-d4 Rc8-c7 Kg3-f2 Nf6-g4+ Kf2-e2 Rc7-e7+)
-0.25/7 2} 24. Bb6 {(Be3-b6 Nf6-d7 Bb6-d4 Nd7-c5 Bd4xc5+ Rc8xc5 Bd3xh7)
-0.00/6 2} Nd7 {(Nf6-d7 Bb6-d4 Kf8-g8 Bd3-e4 Ra8-a6 Nf3-g5 Ra6-d6 Be4xh7+
Kg8-h8) -0.70/9 2} 25. Bd4 {(Bb6-d4 Nd7-c5 Bd4xc5+ Rc8xc5 Bd3xh7 Ra8-d8
b2-b3 Rd8-d5) +5.16/7 2} Nc5 {(Nd7-c5 Bd4xc5+ Rc8xc5 Bd3xh7 Ra8-e8 Nf3-d4
Rc5-d5 Bh7-g6 Re8-e7) -0.95/9 2} 26. Bxc5+ {(Bd4xc5+ Rc8xc5 Bd3xh7 Ra8-c8
b2-b3 Rc8-d8 Bh7-g6 Rd8-d6) +6.45/7 2} Rxc5 {(Rc8xc5 Bd3xh7 Ra8-e8 Ra4-a1
Rc5-d5 Ra1-f1 Re8-e3 Kg3-f4 Re3-e2) -1.15/9 2} 27. Bxh7 {(Bd3xh7 Ra8-d8
Bh7-e4 b4-b3 Be4-g6 Rd8-d5 Ra4-f4+) +6.34/7 2} Re8 {(Ra8-e8 Ra4-a1 Rc5-d5
Ra1-f1 Re8-e3 Bh7-e4 Rd5-e5 Be4-c6 Kf8-g8 Kg3-f4) -1.10/10 2} 28. h5
{(h4-h5 Re8-e2 b2-b3 Re2-b2 Nf3-d4 Rc5xh5) -0.00/6 2} Re2 {(Re8-e2 Nf3-d4
Re2-e7 Bh7-g6 Rc5-d5 Nd4-c6 Re7-e2 Kg3-f3 Re2xb2) -0.80/9 2} 29. Nd4
{(b2-b3 Re2-b2 Kg3-f4 Rb2xg2 Bh7-g6 Kf8-e7) +2.62/6 2} Re7 {(Re2-e7 Bh7-g6
Rc5-d5 Nd4-c6 Re7-e3+ Kg3-f4 Re3-e2 Ra4xa5 Rd5xa5) -0.85/9 2} 30. Bg6
{(Bh7-g6 Re7-e5 Nd4-f3 Re5-e7 b2-b3) +7.41/5 2} Rd5 {(Rc5-d5 Nd4-c6 Re7-e2
Nc6xa5 Rd5-g5+) -0.75/9 2} 31. Nc6 {(Nd4-c6 Re7-e2 Kg3-h3 Re2xb2 Nc6xa5
Rd5-d2 g2-g3) +6.78/7 2} Re3+ {(Re7-e3+ Kg3-f4 Re3-e2 Bg6-e4 Rd5-d6 Ra4xa5
Rd6-f6+ Ra5-f5 Rf6xf5+) -1.00/9 2} 32. Kf4 {(Kg3-f4 Re3-e2 g2-g4 Re2xb2
Nc6xa5 b4-b3) +6.75/5 2} Re2 {(Re3-e2 Nc6xa5 Rd5-d4+ Kf4-f3 Re2xb2 Bg6-e4
Kf8-f7 Na5-c6 Rd4-d2) -1.00/9 2} 33. g4 {(g2-g4 b4-b3 Bg6-e4 Rd5-c5 Nc6xa5
Re2xb2) +6.01/6 2} Rxb2 {(Re2xb2 Bg6-e4 Rd5-d2 Ra4xa5 b4-b3 Kf4-e5 Rb2-a2
Ra5-a7) -0.70/8 2} 34. Nxa5 {(Nc6xa5 b4-b3 Kf4-g3 Rd5-c5 Ra4-f4+ Kf8-e7
Rf4-f7+ Ke7-d6 Rf7-a7) +6.24/7 2} b3 {(b4-b3 Na5-c6 Rb2-a2 Ra4-b4 Ra2-f2+
Kf4-e3 Rf2-b2) -0.60/7 2} 35. Nc6 {(Kf4-g3 Rd5-c5 Ra4-f4+ Kf8-e7 Rf4-f7+
Ke7-d6 Rf7-a7) +6.24/5 2} Ra2 {(Rb2-a2 Ra4-b4 Ra2-a8 Rb4xb3 Rd5-d6 Bg6-e4
Rd6-d2 Rb3-b7 Ra8-a2) -2.20/9 2} 36. Rb4 {(Ra4-b4 Ra2-a8 Rb4xb3 Ra8-a4+
Bg6-e4 Rd5-c5 Rb3-b8+ Kf8-f7 Rb8-b6) +12.72/7 2} Ra8 {(Ra2-a8 Rb4xb3 Rd5-d6
Bg6-e4 Ra8-e8 Nc6-e5) -2.40/9 2} 37. Be4 {(Bg6-e4 Rd5-d6 Rb4xb3 Ra8-e8
Rb3-b6 Rd6-f6+) +12.25/6 2} Rd2 {(Rd5-d2 Rb4xb3 Ra8-e8 Rb3-b7 Rd2-e2 Nc6-e5
Re2-f2+ Ne5-f3 Rf2-e2) -2.35/9 2} 38. Rxb3 {(Rb4xb3 Ra8-a4 Rb3-b8+ Kf8-f7
Nc6-e5+ Kf7-e7 Ne5-f3 Rd2-a2) +13.54/6 2} Re8 {(Ra8-e8 Rb3-b7 Rd2-f2+
Kf4-e3 Rf2-g2 Ke3-f3) -2.40/8 2} 39. Bg6 {(Be4-g6 Re8-a8 Kf4-g5 Rd2-d5+
Kg5-h4 Ra8-a1 Rb3-f3+) +16.00/6 2} Rc8 {(Re8-c8) -2.45/8 2} 40. Rb6
{(Rb3-b6 Rd2-d6 Bg6-e4 Rc8-a8 g4-g5 Ra8-a4) +16.03/6 2} Rf2+ {(Rd2-f2+
Kf4-e3 Rf2-f1 Bg6-f5 Rc8-e8+ Ke3-d4 Rf1-d1+ Bf5-d3) -2.30/8 2} 41. Kg5
{(Kf4-g5 Rc8-a8 Bg6-e4 Rf2-f1 Be4-d3 Rf1-g1 Bd3-f5) +15.90/6 2} Rf6
{(Rf2-f6 Bg6-e4 Rc8-e8 Be4-f5 Rf6-d6 Kg5-f4 Rd6-d2 Rb6-b7 Rd2-f2+) -2.15/9
2} 42. Be4 {(Bg6-e4 Rf6-e6 Be4-d5 Re6-h6 Rb6-a6 Rh6xh5+ Kg5xh5 Rc8xc6)
+14.41/7 1} Re6 {(Rf6-e6 Kg5-f4 Rc8-e8 Be4-d3 Re6-d6 Bd3-g6 Rd6-f6+)
-2.20/9 1} 43. Bd5 {(Be4-d5 Re6-d6 Bd5-g2 Rd6-h6 Bg2-f3 Rh6xh5+ g4xh5
Rc8xc6) +13.61/7 1} Rd6 {(Re6-d6 Bd5-f3 Rd6-f6) -2.15/9 1} 44. Bf3 {(Bd5-f3
Rc8-e8 Rb6-b5 Rd6-f6 Nc6-d4 Rf6-a6 Bf3-d5) +13.71/7 1} Rf6 {(Rd6-f6 Bf3-h1
Rf6-f1 Bh1-e4 Rc8-e8 Be4-f5 Rf1-c1 Nc6-d4 Kf8-e7) -2.15/9 1} 45. Bg2
{(Bf3-g2 Rc8-e8 Bg2-d5 Rf6-d6 Rb6-b5 Rd6-f6 Rb5-b4) +13.06/7 1} Rf2
{(Rf6-f2 Bg2-e4 Rc8-e8 Be4-f5 Re8-e2 Rb6-b8+ Re2-e8) -2.15/9 1} 46. Be4
{(Bg2-e4 Rf2-f6 Rb6-a6 Rf6-e6 Be4-d5 Re6-d6 Bd5-e4) +16.65/7 1} Rf6
{(Rf2-f6 Nc6-e5 Rf6xb6 Ne5-d7+ Kf8-e7 Nd7xb6 Rc8-b8 Nb6-c4 Ke7-e6 Kg5-f4)
-2.15/10 1} 47. Ra6 {(Rb6-a6 Rc8-e8 Be4-f5 Re8-e5 Ra6-b6 Re5-c5) +16.46/6
1} Re8 {(Rc8-e8 Be4-f5 Rf6-d6 Kg5-f4 Rd6-d2 Nc6-e5 Rd2-f2+ Ne5-f3 Re8-e2)
-2.15/9 1} 48. Bf5 {(Be4-f5 Re8-e5 Ra6-a8+ Re5-e8 Nc6-b8 Rf6xf5+ g4xf5
Re8xb8 Ra8xb8+) -0.00/7 1} Rd6 {(Rf6-d6 Kg5-f4 Rd6-d2 Bf5-g6 Re8-c8 Bg6-e4
Rd2-e2 Nc6-d4 Re2-d2) -2.25/9 1} 49. Kf4 {(Kg5-f4 Re8-e1 Ra6-b6 Rd6-d5
Rb6-b8+ Re1-e8 Rb8xe8+ Kf8xe8 Nc6-e5) -0.00/7 1} Rd2 {(Rd6-d2 Ra6-a7 Re8-e2
Bf5-e4 Rd2-a2 Ra7-c7 Ra2-a4 Rc7-c8+ Kf8-f7) -2.35/9 1} 50. Bg6 {(Bf5-g6
Re8-c8 Nc6-e5 Rd2-d4+ Bg6-e4 Rc8-d8 Kf4-f3 Rd4-d6) -0.00/7 1} Rc8 {(Re8-c8
Bg6-e4 Rc8-c7) -2.40/9 1} 51. Ne5 {(Nc6-e5 Rd2-d8 Ra6-b6 Rc8-a8 Kf4-g5
Ra8-a4) +16.29/6 1} Rcd8 {(Rc8-d8 Ra6-a7 Rd2-f2+ Kf4-e3 Rd8-d2 Bg6-d3
Rd2-a2) -2.30/7 1} 52. Bf5 {(Bg6-f5 Rd2-d4+ Kf4-g3 Rd4-d6 Ra6-a7 Rd6-d5
Ne5-f3) -0.00/6 1} Re2 {(Rd2-e2 Ne5-g6+ Kf8-g8 Ra6-a7 Rd8-d4+ Kf4-f3
Rd4-d2) -2.30/7 1} 53. Ng6+ {(Ne5-g6+ Kf8-g8 Kf4-g5 Re2-e1 Ra6-a7 Kg8-h7)
+19.13/5 1} Kg8 {(Kf8-g8 Ra6-a7 Rd8-e8 Bf5-d3 Re2-f2+ Kf4-g3 Rf2-d2)
-2.40/7 1} 54. Kg5 {(Kf4-g5 Re2-e8 Ra6-a7 Rd8-d4 Bf5-d7 Re8-e4 Bd7-f5)
-0.00/7 1} Rb8 {(Rd8-b8 Ng6-f4 Re2-e5 Ra6-a7 Rb8-e8 Kg5-g6 Re5-e7 Bf5-d7)
-2.40/8 1} 55. Ra7 {(Ra6-a7 Re2-e3 Kg5-f4 Rb8-b4+ Kf4xe3 Rb4xg4 Ra7-a8+)
+18.73/6 1} Re3 {(Re2-e3 h5-h6 g7xh6+ Kg5xh6 Re3-h3+ Kh6-g5 Rb8-e8) -2.50/7
1} 56. Rc7 {(Ng6-e7+ Kg8-f8 Ne7-c6 Rb8-b6 Nc6-d4 Re3-e7) +17.70/5 1} Rd8
{(Rb8-d8 Bf5-c2 Rd8-e8 Kg5-f4 Re3-e2 Bc2-b3+ Kg8-h7) -2.45/7 1} 57. Rc6
{(Rc7-c6 Re3-e1 Rc6-a6 Rd8-d4 Ra6-a7 Kg8-h7) +17.04/6 1} Ree8 {(Re3-e8
Rc6-e6 Kg8-f7 Ng6-e5+ Kf7-f8 Kg5-f4 Re8xe6) -2.40/7 1} 58. Kh4 {(Kg5-h4
Rd8-d4 Rc6-a6 Kg8-h7 Ng6-e5+ Kh7-h8 Ne5-f3) +17.00/6 1} Re2 {(Re8-e2 Rc6-c7
Re2-b2 Kh4-g3 Rd8-e8 g4-g5) -2.30/8 1} 59. Ra6 {(Rc6-a6 Re2-e8 Kh4-g5
Rd8-d4 Ra6-a7 Kg8-h7 Ng6-f4+) -0.00/7 1} Rde8 {(Rd8-e8 Ra6-a7 Re2-f2 Kh4-g3
Rf2-b2 Kg3-f3 Re8-e2 g4-g5) -2.30/8 1} 60. Ra7 {(Ra6-a7 Re2-e1 Kh4-g5
Re1-f1 Bf5-d7) +18.17/5 1} R2e3 {(Re2-e3 g4-g5 Re3-e1 Bf5-d3 Re1-d1 Ng6-f4
Rd1-d2 Kh4-g3) -2.35/8 1} 61. Ra4 {(Ra7-a4 Re8-b8 Kh4-g5 Re3-e1 Ra4-a5
Kg8-h7) +16.83/6 1} Rc3 {(Re3-c3 Bf5-e6+ Kg8-h7 Kh4-g5 Rc3-c7 Ng6-f4 Rc7-e7
Ra4-e4) -2.30/8 1} 62. Ra5 {(Ra4-a5 Kg8-h7 Ra5-a6 Rc3-c5 Ng6-f4+ Rc5xf5
g4xf5) +17.53/6 1} Rf3 {(Rc3-f3 Bf5-d7 Re8-b8 Ng6-e5 Rf3-f2 Bd7-e6+ Kg8-h7
Be6-f5+) -2.30/8 1} 63. Kg5 {(Kh4-g5 Rf3-b3 Ra5-a7 Kg8-h7 Ng6-f4+) +17.46/5
1} Rfe3 {(Rf3-e3 Kg5-f4 Re3-e2 Ra5-a7 Re8-d8 Kf4-g3 Rd8-d2 Ra7-a8+) -2.40/8
1} 64. Ra6 {(Ra5-a6 Re8-b8 Kg5-h4 Re3-e8 Bf5-e6+ Kg8-h7 g4-g5) +18.34/6 1}
Re1 {(Re3-e1 Ra6-a7 Re8-d8 h5-h6 g7xh6+ Kg5xh6 Re1-h1+ Kh6-g5 Rh1-e1)
-2.45/9 1} 65. Ra7 {(Ra6-a7 Re1-f1 Ng6-f4 Re8-e5 Ra7-a8+ Kg8-f7 Ra8-a7+)
+17.48/6 1} Rd8 {(Re8-d8 h5-h6 g7xh6+ Kg5xh6 Re1-h1+ Kh6-g5 Rh1-e1 Kg5-f4)
-2.45/8 1} 66. Ne7+ {(Ng6-e7+ Kg8-h8 Ne7-c6 Rd8-e8 Bf5-g6 Re8-c8 Nc6-e7)
-0.00/6 1} Kf8 {(Kg8-f8 Ne7-c8 Re1-c1 Nc8-b6 Rc1-e1 Nb6-d7+ Kf8-f7 Bf5-g6+
Kf7-g8) -2.45/9 1} 67. Nc6 {(Ne7-c6 Rd8-d5 Ra7-a6 Rd5-c5 Ra6-a8+ Re1-e8
Nc6-d8 Re8-e5) +15.50/7 1} Rd5 {(Rd8-d5 Kg5-f4 Rd5-d2 Bf5-e4 Rd2-f2+ Kf4-e5
Rf2-g2 Ra7-a1 Re1-e2) -2.35/9 1} 68. Ra8+ {(Ra7-a8+ Re1-e8 Ra8-a4 Rd5-c5
Nc6-d4 Re8-e4 Ra4-a8+ Re4-e8 Ra8-a6) -0.00/7 1} Kf7 {(Kf8-f7 Ra8-c8 Re1-e2
Rc8-c7+ Kf7-f8 Kg5-f4 Rd5-d1 Bf5-e4) -2.35/8 1} 69. Ra4 {(Ra8-a4 Re1-g1
Ra4-a7+ Kf7-f8 Ra7-a8+ Kf8-f7 Kg5-f4 Rd5xf5+) +14.11/6 1} Ke8 {(Kf7-e8
Kg5-f4 Rd5-d6 Nc6-d4 Rd6-d8 Bf5-g6+ Ke8-e7) -2.30/7 1} 70. Nb4 {(Nc6-b4
Rd5-b5 Nb4-d3 Re1-e7 Kg5-f4 Ke8-f8) -0.00/6 1} Rd8 {(Rd5-d8 Bf5-g6+ Ke8-f8
Nb4-c6 Rd8-c8 Ra4-f4+ Kf8-g8 Rf4-e4) -2.30/8 1} 71. Nd3 {(Ra4-a6 Ke8-f8
Nb4-c6 Rd8-d6 Ra6-a8+) +17.89/5 1} Re2 {(Re1-e2 Nd3-f4 Re2-e7 Nf4-e6 Rd8-b8
Ra4-e4 Ke8-f7 Kg5-f4) -2.40/8 1} 72. Nf4 {(Nd3-f4 Re2-e5 Nf4-e6 Re5xf5+
g4xf5 Ke8-f7 Ra4-a7+ Rd8-d7 Ra7-a8) +22.06/7 1} Re7 {(Re2-e7 Nf4-e6 Rd8-b8)
-3.55/8 1} 73. Ng6 {(Nf4-g6 Re7-c7 Ra4-e4+ Ke8-f7 Bf5-e6+ Kf7-e8 Re4-e1
Rd8-d4) +23.38/6 1} Re2 {(Re7-e2 Ra4-a7 Rd8-d2 Ra7xg7 Ke8-d8 h5-h6 Re2-e8
h6-h7 Rd2-h2 h7-h8Q) -4.75/10 1} 74. Ra7 {(Ra4-a7 Rd8-d5 Ra7xg7 Re2-e6
Ng6-f4 Ke8-f8 Rg7-a7) +27.59/7 1} Rdd2 {(Rd8-d2 Ra7xg7 Ke8-d8 h5-h6)
-4.85/9 1} 75. Rxg7 {(Ra7xg7 Rd2-d5 Rg7-h7 Re2-f2 h5-h6 Rf2-f1 Rh7-h8+)
+28.50/7 1} Kd8 {(Ke8-d8 h5-h6 Rd2-d5 h6-h7 Re2-h2 h7-h8R+ Rh2xh8 Ng6xh8
Rd5-d2 Rg7-f7) -7.85/10 1} 76. h6 {(h5-h6 Rd2-d5 h6-h7 Rd5xf5+ g4xf5
Re2-g2+ Kg5-f6 Rg2xg6+ Kf6xg6 Kd8-e8) +29.11/7 1} Rb2 {(Rd2-b2 h6-h7 Re2-h2
h7-h8Q+ Rh2xh8 Rg7-d7+ Kd8-e8 Ng6xh8 Rb2-f2) -7.85/9 1} 77. h7 {(h6-h7
Rb2-b7 h7-h8R+ Re2-e8 Rg7xb7 Re8-g8 Rb7-d7+) +31.53/6 1} Rh2 {(Re2-h2
Ng6-h4 Rh2xh4 Kg5xh4 Rb2-h2+ Kh4-g3 Rh2-h1 Rg7-g8+ Kd8-c7) -10.10/9 1} 78.
Rg8+ {(Rg7-g8+ Kd8-c7 Rg8-c8+ Kc7-b6 h7-h8R Rh2xh8 Ng6xh8 Kb6-a7) +29.81/6
1} Kc7 {(Kd8-c7 Ng6-h4 Rh2xh4 Kg5xh4 Rb2-h2+ Kh4-g3 Rh2xh7 Bf5xh7 Kc7-d6)
-9.95/9 1} 79. h8=R {(h7-h8R Rh2xh8 Ng6xh8 Rb2-b5 Rg8-g7+ Kc7-b6 Rg7-g6+)
+29.79/6 1} Rxh8 {(Rh2xh8 Rg8xh8 Kc7-c6 Rh8-d8 Kc6-c5 Kg5-f4 Rb2-h2 g4-g5
Rh2-f2+) -7.90/9 1} 80. Nxh8 {(Ng6xh8 Rb2-b8 Rg8-g7+ Kc7-b6 Rg7-g6+ Kb6-a7
Nh8-f7 Rb8-b5) +29.39/6 1} Rf2 {(Rb2-f2 Rg8-g7+ Kc7-d6 Rg7-d7+ Kd6-c6
Bf5-e6 Rf2-h2 Nh8-g6) -7.85/8 1} 81. Be4 {(Bf5-e4 Rf2-e2 Rg8-g7+ Kc7-d8
Be4-f5 Re2-e8 Nh8-g6) +29.91/6 1} Kd6 {(Kc7-d6 Nh8-g6 Kd6-c5 Rg8-d8 Kc5-b5
Rd8-d7 Kb5-b6 Ng6-e5 Kb6-c5 Be4-d3) -7.90/10 1} 82. Ra8 {(Rg8-a8 Kd6-c5
Ra8-b8 Rf2-f1 Kg5-h5 Rf1-f7) +30.53/6 1} Ke5 {(Kd6-e5 Be4-f5 Ke5-d6 Ra8-d8+
Kd6-c7 Rd8-d7+ Kc7-c6 Bf5-e6) -7.75/8 1} 83. Bb7 {(Be4-b7 Ke5-d6 Nh8-g6
Rf2-f1 Bb7-e4 Kd6-c7) +30.17/6 1} Kd6 {(Ke5-d6 Nh8-g6 Kd6-c5 Ra8-c8+ Kc5-d4
Rc8-d8+ Kd4-e3 Ng6-e5 Rf2-e2) -7.75/9 1} 84. Ra6+ {(Ra8-a6+ Kd6-c7 Bb7-d5
Rf2-f8 Nh8-g6 Rf8-d8) +30.10/5 1} Kc5 {(Kd6-c5 Ra6-c6+ Kc5-d4 Rc6-c7 Rf2-a2
Rc7-d7+ Kd4-e3 Bb7-d5 Ra2-f2) -7.70/9 1} 85. Ng6 {(Nh8-g6 Rf2-f7 Bb7-e4
Kc5-d4 Ra6-e6 Kd4-c3) +29.76/6 1} Rb2 {(Rf2-b2 Ra6-c6+ Kc5-d4 Rc6-d6+
Kd4-e3 Rd6-d7 Rb2-d2 Rd7xd2 Ke3xd2) -7.80/9 1} 86. Bf3 {(Bb7-f3 Rb2-b6
Ra6xb6 Kc5xb6 Kg5-h5 Kb6-c5) +29.24/6 1} Kd4 {(Kc5-d4 Ra6-d6+ Kd4-c3 Bf3-e4
Rb2-f2 Rd6-d3+ Kc3-b4 Rd3-d7 Kb4-b5) -7.95/9 1} 87. Kh6 {(Kg5-h6 Rb2-b3
Bf3-g2 Rb3-b6) +29.83/4 1} Rh2+ {(Rb2-h2+ Kh6-g7 Kd4-e3 Ra6-a3+ Ke3-d4
g4-g5 Rh2-c2 Ra3-a4+) -7.65/8 1} 88. Kg7 {(Kh6-g7 Rh2-h3 Ra6-d6+ Kd4-e3
Bf3-d5 Rh3-g3 Rd6-e6+) +27.42/5 1} Ke3 {(Kd4-e3 Ra6-a3+ Ke3-d4 g4-g5 Rh2-c2
Ra3-a4+ Kd4-e3 Ng6-e5) -7.75/8 1} 89. Ra3+ {(Ra6-a3+ Ke3-d2 Bf3-a8 Kd2-c2
Ng6-e5 Kc2-b1) +29.83/5 1} Kd4 {(Ke3-d4 g4-g5 Rh2-b2 Ra3-a4+ Kd4-e3 Ng6-e5
Rb2-b5 Ra4-e4+ Ke3-f2) -8.05/9 1} 90. Ra8 {(Ra3-a8 Rh2-h3 Ra8-d8+ Kd4-c3
Bf3-d1) +28.51/4 1} Ke3 {(Kd4-e3 Ng6-e5 Rh2-h3 Bf3-c6 Ke3-d4 Ne5-f3+ Kd4-c5
Bc6-e4) -7.70/8 1} 91. Bd5 {(Bf3-d5 Rh2-g2 Ra8-e8+ Ke3-f2 Bd5xg2 Kf2xg2)
+29.85/5 1} Kd4 {(Ke3-d4 Ra8-d8 Rh2-f2 g4-g5 Rf2-b2 Rd8-d7 Rb2-h2 Kg7-f6
Rh2-b2) -7.90/9 1} 92. Rd8 {(Ng6-e7 Rh2-e2 Ra8-a4+ Kd4-c5 g4-g5 Re2xe7+)
+28.24/5 1} Rf2 {(Rh2-f2 g4-g5 Rf2-b2 Rd8-d7 Rb2-h2 Kg7-f6 Rh2-f2+ Kf6-e6)
-7.90/8 1} 93. Nh8 {(Ng6-h8 Kd4-c5 Bd5-g8 Rf2-g2 Rd8-c8+ Kc5-b5 Rc8-b8+)
-0.00/6 1} Kc5 {(Kd4-c5 Bd5-e6 Kc5-b6 g4-g5 Rf2-e2 Kg7-f6 Re2-f2+ Kf6-e5
Rf2-e2+ Ke5-f5) -8.00/10 1} 94. Ba8 {(Bd5-a8 Rf2-f4 Rd8-c8+ Kc5-d4 g4-g5
Rf4-g4 Rc8-d8+) -0.00/6 1} Kb6 {(Kc5-b6 g4-g5 Kb6-c7 Rd8-d3 Kc7-b6 g5-g6
Kb6-c5 Rd3-d7 Rf2-b2 Kg7-f6) -8.10/10 1} 95. g5 {(g4-g5 Kb6-c7 Rd8-d1
Rf2-g2 Ba8xg2 Kc7-b8) +30.07/6 1} Kc7 {(Kb6-c7 Rd8-d4 Kc7-b6 g5-g6 Kb6-c5
Rd4-d7 Rf2-a2 Ba8-e4) -8.10/11 1} 96. Re8 {(Rd8-e8 Rf2-h2 Ba8-e4 Rh2xh8
Re8xh8 Kc7-b6) +29.48/6 1} Kd7 {(Kc7-d7 Re8-f8 Rf2-h2 g5-g6 Kd7-e6 Rf8-f6+
Ke6-e5 Nh8-f7+ Ke5-d4 Rf6-d6+) -8.00/10 1} 97. Rg8 {(Re8-g8 Rf2-h2 Rg8-b8
Kd7-c7 Rb8-b7+ Kc7-c8 Rb7-a7) +29.95/6 1} Ke6 {(Kd7-e6 g5-g6) -8.05/10 1}
98. Rb8 {(Rg8-b8 Rf2-f5 Kg7-h6 Rf5-a5 Rb8-b6+ Ke6-e7 Rb6-b7+) +29.70/6 1}
Ra2 {(Rf2-a2 g5-g6 Ra2-f2 Rb8-e8+ Ke6-d7 Re8-f8 Rf2-h2 Ba8-e4 Kd7-d6)
-8.10/9 1} 99. Be4 {(Ba8-e4 Ra2-a7+ Kg7-g8 Ra7-a8 Be4xa8 Ke6-d7) +30.01/5
1} Ke5 {(Ke6-e5 Be4-b1 Ra2-f2 Nh8-f7+ Ke5-e6 g5-g6 Rf2-d2 Bb1-e4) -7.90/8
1} 100. Bh7 {(Be4-h7 Ke5-f4 Rb8-b5 Ra2-a7+ Kg7-h6 Ra7xh7+ Kh6xh7 Kf4-g3)
-0.00/6 1} Kd6 {(Ke5-d6 Rb8-b7 Ra2-f2 g5-g6 Rf2-d2 Kg7-f8 Kd6-c6 Rb7-e7)
-7.90/8 1} 101. Rd8+ {(Rb8-d8+ Kd6-e7 Rd8-d4 Ra2-g2 g5-g6 Rg2-g3 Rd4-e4+)
-0.00/6 1} Kc7 {(Kd6-c7 Rd8-d4 Kc7-b6 Kg7-f6 Ra2-a8 Rd4-d6+ Kb6-c5 Nh8-f7)
-7.95/8 1} 102. Rf8 {(Rd8-f8 Ra2-g2 g5-g6 Kc7-d7 Rf8-f6 Kd7-e7 Rf6-f7+)
-0.00/7 1} Kd6 {(Kc7-d6 g5-g6 Kd6-e5 Nh8-f7+ Ke5-d5 Rf8-d8+ Kd5-e6 Rd8-e8+
Ke6-d5) -8.00/9 1} 103. Rf6+ {(Rf8-f6+ Kd6-e5 Nh8-f7+ Ke5-d5 Rf6-d6+ Kd5-c5
Kg7-h6 Ra2-a6) +30.96/5 1} Kc5 {(Kd6-c5 g5-g6 Kc5-d4 Rf6-f7 Ra2-b2 Kg7-f6
Rb2-f2+ Kf6-e6) -7.90/8 1} 104. Rf5+ {(Rf6-f5+ Kc5-d6 Nh8-f7+ Kd6-d7 Kg7-h8
Ra2-a5) +30.79/4 1} Kd4 {(Kc5-d4 g5-g6 Ra2-h2 Rf5-f7 Kd4-e5 Kg7-g8 Rh2-b2
g6-g7 Rb2-b8+) -7.90/9 1} 105. Rf4+ {(Rf5-f4+ Kd4-c5 Bh7-e4 Ra2-h2 Rf4-f5+
Kc5-d4 Be4-c6 Rh2xh8) +29.64/6 1} Ke5 {(Kd4-e5 Nh8-g6+ Ke5-d6 Kg7-f6 Ra2-e2
Rf4-d4+ Kd6-c5 Rd4-d7 Kc5-c6) -7.95/9 1} 106. Ng6+ {(Nh8-g6+ Ke5-d6 Rf4-f6+
Kd6-c5 Ng6-h8 Ra2-a7+ Nh8-f7 Ra7xf7+ Kg7xf7 Kc5-b5) -0.00/6 1} Kd6 {(Ke5-d6
Kg7-f6 Ra2-e2 Rf4-d4+ Kd6-c5 Rd4-d7 Re2-f2+ Kf6-e6 Rf2-g2) -8.00/9 1} 107.
Rf6+ {(Rf4-f6+ Kd6-d5 Ng6-e7+ Kd5-d4 Bh7-b1 Ra2-a7) +31.11/4 1} Kc5
{(Kd6-c5 Bh7-g8 Ra2-b2 Rf6-f5+ Kc5-d4 Rf5-f4+ Kd4-c5 Kg7-f6) -7.85/8 1}
108. Rf5+ {(Rf6-f5+ Kc5-b6 Ng6-f8 Ra2-a7+ Kg7-f6 Ra7xh7 Nf8xh7 Kb6-a7)
+29.17/6 1} Kd4 {(Kc5-d4 Rf5-f4+ Kd4-e3 Rf4-f7 Ra2-b2 Rf7-e7+ Ke3-d4
Re7-d7+) -7.90/8 1} 109. Rf4+ {(Rf5-f4+ Kd4-c5 Ng6-h8 Ra2-a7+ Nh8-f7
Ra7xf7+ Kg7xf7 Kc5-b5) +29.43/5 1} Ke3 {(Kd4-e3 Rf4-f7 Ra2-g2 Rf7-e7+
Ke3-d4 Re7-d7+ Kd4-e3 Kg7-f6 Rg2-f2+) -7.90/9 1} 110. Rf6 {(Rf4-f6 Ra2-g2
Kg7-h6 Ke3-d2 Kh6-h5 Rg2xg5+) +26.75/6 1} Rg2 {(Ra2-g2 Rf6-f5 Ke3-e4 Ng6-h4
Rg2-g4 Rf5-f7+ Ke4-d5 Nh4-f3 Rg4-g2) -7.85/9 1} 111. Re6+ {(Rf6-e6+ Ke3-f2
Kg7-f6 Rg2-g3 Re6-e5 Rg3xg5) +24.93/5 1} Kd4 {(Ke3-d4 Re6-d6+ Kd4-c5
Rd6-d5+ Kc5xd5 Ng6-f4+ Kd5-e5 Nf4xg2) -7.85/8 1} 112. Kf6 {(Kg7-f6 Rg2-f2+
Ng6-f4 Rf2xf4+ Kf6-g6 Rf4-e4 Re6-f6 Kd4-e5) +23.95/6 1} Rf2+ {(Rg2-f2+
Kf6-e7 Rf2-f5 Ng6-h4 Rf5-f4 Nh4-f5+ Kd4-d5 Nf5-e3+) -7.85/8 1} 113. Ke7
{(Kf6-e7 Rf2-f5 Re6-d6+ Kd4-c3 Ng6-f8 Rf5xg5 Bh7-e4 Rg5-b5) +19.31/6 1} Kc3
{(Kd4-c3 Re6-c6+ Kc3-d4 Rc6-d6+ Kd4-c3 Ke7-e6 Rf2-g2 Ke6-f6) -7.90/8 1}
114. Nh8 {(Re6-c6+ Kc3-b2 Ng6-f8 Rf2-g2 Bh7-f5 Rg2xg5) +26.24/5 1} Kd4
{(Kc3-d4 g5-g6 Rf2-g2 Re6-d6+ Kd4-c5 Rd6-d7 Rg2-e2+ Ke7-f6 Re2-f2+ Kf6-e5)
-8.10/10 1} 115. g6 {(Re6-d6+ Kd4-e3 Rd6-d3+ Ke3-f4 Ke7-f6 Kf4-g4+ Kf6-g6
Rf2-f6+) +27.77/5 1} Rg2 {(Rf2-g2 Re6-d6+ Kd4-c4 Bh7-g8+ Kc4-c5 Rd6-d5+
Kc5-b4 Rd5-d4+ Kb4-c5) -8.25/9 1} 116. Nf7 {(Nh8-f7 Kd4-c5 Ke7-f6 Rg2-f2+
Kf6-g5 Rf2-g2+ Kg5-h6 Rg2-g5 Nf7-d8) +27.11/7 1} Kc3 {(Kd4-c3 Nf7-e5 Kc3-d4
Ke7-d6 Kd4-c3 Kd6-d5 Rg2-d2+ Kd5-c5) -8.35/8 1} 117. Kf6 {(Ke7-f6 Rg2-g1
Re6-c6+ Kc3-b4 Nf7-g5 Rg1xg5) +27.39/5 1} Rf2+ {(Rg2-f2+ Kf6-e5 Rf2-e2+
Ke5-d5 Re2-d2+ Kd5-c5 Rd2-g2 Re6-e3+ Kc3-d2) -8.35/9 1} 118. Kg7 {(Kf6-g5
Rf2-g2+ Kg5-h6 Rg2-h2+ Kh6-g7 Rh2xh7+ Kg7-f6 Rh7-h1 Nf7-d6) +24.65/5 1} Kd4
{(Kc3-d4 Re6-d6+ Kd4-c5 Kg7-f8 Rf2-a2 g6-g7 Ra2-a8+ Kf8-e7) -8.35/8 1} 119.
Ra6 {(Re6-a6 Rf2-g2 Nf7-h8 Kd4-e3 Ra6-a3+) +29.87/5 1} Ke3 {(Kd4-e3 Kg7-g8
Rf2-b2 Ra6-e6+ Ke3-d4 Re6-d6+ Kd4-c5 Rd6-d8) -8.20/8 1} 120. Ra3+ {(Ra6-a3+
Ke3-d4 Nf7-h8 Rf2-g2 Ra3-a8 Rg2-g5 Ra8-d8+) +29.76/6 1} Kd4 {(Ke3-d4 Kg7-h8
Kd4-c5 g6-g7 Rf2-g2 Ra3-d3 Kc5-b6 Nf7-d6 Kb6-c5) -12.10/9 1} 121. Nh8
{(Nf7-h8 Rf2-g2 Ra3-a5 Rg2-g3 Ra5-a4+) +29.65/5 1} Rb2 {(Rf2-b2 Ra3-a7
Kd4-e5 Nh8-f7+ Ke5-d5 Ra7-d7+ Kd5-e6 Rd7-d1) -7.95/8 1} 122. Ra7 {(Ra3-a7
Rb2-b8 Ra7-d7+ Kd4-c5 Nh8-f7 Rb8-b3) +29.99/5 1} Ke5 {(Kd4-e5 Kg7-f7
Rb2-f2+ Kf7-g8 Ke5-d4 g6-g7 Kd4-e5 Ra7-e7+) -8.30/8 1} 123. Ra5+ {(Ra7-a5+
Ke5-f4 Ra5-a4+ Rb2-b4 Ra4xb4+ Kf4-e5 Rb4-b5+ Ke5-f4 Rb5-b1) +30.36/5 1} Kd4
{(Ke5-d4 Kg7-f7 Rb2-f2+ Kf7-e6 Rf2-g2 Ra5-a4+ Kd4-c5 Ke6-e5) -8.20/8 1}
124. Ra4+ {(Ra5-a4+ Rb2-b4 Ra4xb4+ Kd4-c5 Rb4-b1 Kc5-d4) +30.47/4 1} Kd5
{(Kd4-d5 Bh7-g8+ Kd5-c5 Ra4-c4+ Kc5-b5 Kg7-f6 Rb2-f2+ Kf6-e7) -8.15/8 1}
125. Bg8+ {(Bh7-g8+ Kd5-e5 Nh8-f7+ Ke5-e6 Ra4-a6+ Ke6-f5 Nf7-h8) +31.68/4
1} Kc5 {(Kd5-c5 Ra4-c4+ Kc5-b5 Kg7-f6 Rb2-f2+ Kf6-e7 Rf2-e2+) -8.15/7 1}
126. Rc4+ {(Ra4-c4+ Kc5-b5 Rc4-c1 Rb2-h2 Rc1-b1+ Kb5-c5 Nh8-f7 Rh2-h7+)
-0.00/6 1} Kb5 {(Kc5-b5 Bg8-e6 Rb2-f2 Nh8-f7 Kb5-b6 Nf7-e5 Kb6-b7 Be6-d5+)
-8.25/8 1} 127. Rg4 {(Rc4-g4 Rb2-h2 Nh8-f7 Rh2-g2 Rg4xg2 Kb5-c5) +29.96/6
1} Kc5 {(Kb5-c5 Bg8-e6 Rb2-f2 Rg4-e4 Kc5-c6 Kg7-g8 Rf2-b2 g6-g7 Kc6-c5)
-8.30/9 1} 128. Rg5+ {(Rg4-g5+ Kc5-d6 Rg5-d5+ Kd6-c7 Rd5-c5+ Kc7-d6 Rc5-c1
Rb2-g2 Rc1-d1+) +30.52/6 1} Kc6 {(Kc5-c6 Kg7-f6 Rb2-f2+ Kf6-e5 Rf2-e2+
Ke5-f4 Re2-b2 g6-g7) -8.45/8 1} 129. Bd5+ {(Bg8-d5+ Kc6-d6 Bd5-f7 Rb2-b8
Rg5-d5+ Kd6-c7 Rd5-d2 Rb8xh8) +30.09/6 1} Kd6 {(Kc6-d6 Nh8-f7+ Kd6-c5
Kg7-f6 Kc5-d4 g6-g7 Rb2-b8) -8.70/7 1} 130. Nf7+ {(Nh8-f7+ Kd6-e7 Rg5-e5+
Ke7-d7 Bd5-e6+ Kd7-e7 Nf7-h8) +31.64/4 1} Kc5 {(Kd6-c5 Kg7-f6 Rb2-f2+
Bd5-f3+ Kc5-b6 g6-g7 Rf2xf3+ Rg5-f5) -8.85/8 1} 131. Ba8+ {(Bd5-a8+ Kc5-d4
Rg5-g4+ Kd4-e3 Rg4-g3+ Ke3-f4 Rg3-g1) +30.68/4 0} Kd4 {(Kc5-d4 Rg5-d5+
Kd4-e3 Rd5-d7 Rb2-f2 Nf7-e5 Rf2-a2 Ba8-d5) -8.30/8 1} 132. Rg4+ {(Rg5-g4+
Kd4-e3 Rg4-g3+ Ke3-d4 Nf7-h8 Rb2-b8 Ba8-c6) +29.86/5 1} Kc3 {(Kd4-c3 Nf7-e5
Rb2-a2 Rg4-c4+ Kc3-d2 Ba8-d5) -8.30/7 1} 133. Bd5 {(Ba8-d5 Rb2-h2 Rg4-c4+
Kc3-d2 Bd5-a8 Kd2-e1) +29.87/5 1} Rb5 {(Rb2-b5 Kg7-f6 Rb5-c5 Kf6-e5 Rc5-c7
Rg4-g3+ Kc3-d2 Rg3-g2+) -8.90/8 1} 134. Be6 {(Bd5-e6 Rb5-b6 Rg4-g3+ Kc3-d2
Kg7-f6 Rb6xe6+ Kf6xe6 Kd2-c2) +29.50/6 1} Rb8 {(Rb5-b8 Kg7-f6 Rb8-e8
Rg4-c4+ Kc3-d2 g6-g7 Kd2-e2 Nf7-e5 Re8xe6+) -11.20/9 1} 135. Rg3+ {(Rg4-g3+
Kc3-b2 Rg3-g1 Rb8-b6 Kg7-h6 Rb6xe6) +29.82/5 1} Kd4 {(Kc3-d4 Kg7-h7 Rb8-b2
g6-g7 Rb2-h2+ Rg3-h3 Rh2-g2 Rh3-h4+) -12.00/8 1} 136. Rg1 {(Rg3-g1 Rb8-g8+
Kg7xg8 Kd4-c5 Nf7-h8 Kc5-d6) +29.95/5 1} Rb2 {(Rb8-b2 Rg1-d1+ Kd4-e4
Nf7-d6+ Ke4-f3 Kg7-f6 Rb2-f2 Rd1-e1) -8.50/8 1} 137. Rd1+ {(Rg1-d1+ Rb2-d2
Rd1xd2+ Kd4-e3 Nf7-g5 Ke3xd2) +30.29/4 1} Ke4 {(Kd4-e4 Nf7-d6+ Ke4-f3
Kg7-f6 Rb2-f2 Be6-f5 Kf3-e2 Rd1-d5) -8.80/8 1} 138. Bd5+ {(Be6-d5+ Ke4-f4
Rd1-f1+ Rb2-f2 Rf1xf2+ Kf4-g4 Bd5-e6+ Kg4-g3 Rf2-f1) +30.38/5 1} Ke3
{(Ke4-e3 Nf7-e5 Rb2-b8 Rd1-d3+ Ke3-f4 Kg7-f6 Rb8-b6+ Ne5-c6) -8.80/8 1}
139. Rg1 {(Rd1-g1 Rb2-b6 Nf7-h8 Ke3-f4 Rg1-f1+) +29.57/5 1} Kd4 {(Ke3-d4
Bd5-c6 Rb2-d2 Rg1-g2 Rd2-d1 Rg2-e2 Rd1-c1 Nf7-e5) -8.05/8 1} 140. Bf3
{(Bd5-c6 Rb2-b6 Rg1-d1+ Kd4-e3 Nf7-h6 Ke3-e2) +29.04/5 1} Ke3 {(Kd4-e3
Rg1-f1 Rb2-b6 Nf7-e5 Ke3-d4 Ne5-c6+ Kd4-e3 Kg7-f6) -8.10/8 1} 141. Bh5
{(Bf3-h5 Rb2-g2 Rg1-a1 Ke3-d4 Ra1-a4+) +29.25/5 1} Rc2 {(Rb2-c2 Kg7-h6
Rc2-c6 Rg1-e1+ Ke3-d4 Re1-e7 Rc6-f6) -8.10/7 1} 142. Re1+ {(Rg1-e1+ Ke3-f2
Re1-e5 Rc2-c6 Re5-f5+ Kf2-g1 Rf5-g5+) +29.67/5 1} Kd4 {(Ke3-d4 Kg7-f6
Rc2-c6+ Kf6-e7 Rc6-c7+ Ke7-d6 Rc7-c2) -8.35/7 1} 143. ... {White forfeits
on time} 0-1
[/pgn]
Raphexon
Posts: 476
Joined: Sun Mar 17, 2019 12:00 pm
Full name: Henk Drost

Re: How to scale stockfish NNUE score?

Post by Raphexon »

hgm wrote: Sat Oct 17, 2020 9:23 pm
maksimKorzh wrote: Sat Oct 17, 2020 7:15 pmI am always getting excited when you're trying to implement engines for games other but chess. I'm just wondering what motivates you?
I mean usually people developing one engine for years and it's difficult to master chess programming at a decent level...
But you're trying many other games! This is incredible, so what motivates you? Thanks in advance.
I am driven mainly by curiosity, I like doing creative work, and it is gratifying to create things that others are eager to use. That sort of disqualifies orthodox Chess, for which there are already thousands of engines. Except for a handful of testers no one is interested in having yet another one. So I try to focus on games where nothing, or nothing decent exists yet. Or where it is truly unknown what is a good way to do it.

I find Paco Shako a very intriguing game in this respect; no one really knows how to play that. I am very curious what would be a good strategy for it. This NNUE method seems ideally suited for it, and material does not seem to be an important term in that game (it is impossible to lose any...), and King Safety is everything. And as I happen to have a lot of Janggi games handy, this seems a good opportunity to get some hands-on experience with this interesting NNUE technique. For Janggi there seems to hardly exist anything, and millions of potential users.
Yea, this was my main reason for initial excitement for NNUE.
It really eases engine development for alternative board games (or chess variants) since eval is no longer difficult.
Madeleine Birchfield
Posts: 512
Joined: Tue Sep 29, 2020 4:29 pm
Location: Dublin, Ireland
Full name: Madeleine Birchfield

Re: How to scale stockfish NNUE score?

Post by Madeleine Birchfield »

maksimKorzh wrote: Tue Oct 20, 2020 9:20 pm I'm facing some very weird behavior of Stockfish NNUE in my engine:
IT'S VERY POOR IN PLAYING ENDGAMES

e.g. my old noob's handcrafted eval mated with king queen and knight vs king EASILY while NNUE version manages to draw with 50 move rule.
I didn't touch search.

How on earth is tha possible???
Stockfish NNUE might be trained with games that are adjudicated at the 7 men tablebase scoring instead of at checkmate, meaning that it never saw any positions with seven or less pieces and therefore doesn't know how to deal with them.
Madeleine Birchfield
Posts: 512
Joined: Tue Sep 29, 2020 4:29 pm
Location: Dublin, Ireland
Full name: Madeleine Birchfield

Re: How to scale stockfish NNUE score?

Post by Madeleine Birchfield »

hgm wrote: Sat Oct 17, 2020 6:56 pm OK, thanks. I ask because I am interested in trying out this NNUE technique in a new engine, for Janggi. I know absolutely nothing about that game, but I do have a PGN file with 25000 games in it. And perhaps this is enough to train it, and get somewhat reasonable play.

It could also be interesting to try it for Paco Shako.
You could also use reinforcement learning
JohnWoe
Posts: 491
Joined: Sat Mar 02, 2013 11:31 pm

Re: How to scale stockfish NNUE score?

Post by JohnWoe »

Madeleine Birchfield wrote: Thu Oct 22, 2020 5:14 pm
maksimKorzh wrote: Tue Oct 20, 2020 9:20 pm I'm facing some very weird behavior of Stockfish NNUE in my engine:
IT'S VERY POOR IN PLAYING ENDGAMES

e.g. my old noob's handcrafted eval mated with king queen and knight vs king EASILY while NNUE version manages to draw with 50 move rule.
I didn't touch search.

How on earth is tha possible???
Stockfish NNUE might be trained with games that are adjudicated at the 7 men tablebase scoring instead of at checkmate, meaning that it never saw any positions with seven or less pieces and therefore doesn't know how to deal with them.
On my engine Mayhem it also apparent it wasn't trained on Chess960 positions. Also not endgames. I have a small "classical" evaluation function to finish the game. Otherwise it provides very accurate MG evals.