Toga III 0.4 NNUE

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

dkappe
Posts: 1631
Joined: Tue Aug 21, 2018 7:52 pm
Full name: Dietrich Kappe

Toga III 0.4 NNUE

Post by dkappe »

Based on d8 data from Toga II 4.0.2. My sense is that it’s a touch stronger than SF9.

https://www.patreon.com/posts/toga-iii-0-4-41320965

[pgn]
[Event "?"]
[Site "?"]
[Date "2020.09.06"]
[Round "8"]
[White "toga3-0.4"]
[Black "SF9"]
[Result "1-0"]
[ECO "A02"]
[GameDuration "00:02:52"]
[GameEndTime "2020-09-06T17:55:44.994 CDT"]
[GameStartTime "2020-09-06T17:52:52.721 CDT"]
[Opening "Bird"]
[PlyCount "117"]
[TimeControl "60+0.6"]
[Variation "From gambit"]

1. f4 {book} e5 {book} 2. fxe5 {book} d6 {0.00/18 2.9s} 3. exd6 {+0.34/21 2.8s}
Bxd6 {+0.19/16 0.37s} 4. Nf3 {+0.27/18 0.57s} Nf6 {-0.26/18 2.8s}
5. g3 {+0.46/19 3.3s} O-O {-0.17/17 1.1s} 6. Bg2 {+0.46/17 0.54s}
Bg4 {-0.16/19 5.0s} 7. O-O {+0.41/19 2.3s} Re8 {-0.13/17 0.60s}
8. d3 {+0.40/16 0.69s} Nc6 {-0.42/20 12s} 9. e4 {+0.48/18 2.4s}
Bc5+ {-0.50/17 1.8s} 10. Kh1 {+0.49/16 0.87s} Ne5 {-0.63/19 6.4s}
11. Nbd2 {+0.80/16 0.87s} Nc6 {-0.71/17 3.6s} 12. Nc4 {+0.88/17 1.1s}
h6 {-1.05/18 9.0s} 13. c3 {+1.04/17 1.0s} b5 {-0.83/17 0.53s}
14. Ne3 {+0.91/20 1.9s} Bxe3 {-0.80/19 0.72s} 15. Bxe3 {+0.75/22 1.6s}
Ne5 {-0.65/19 0.68s} 16. Bd4 {+0.73/21 1.9s} c5 {-0.87/19 2.2s}
17. Bxe5 {+0.84/21 1.0s} Rxe5 {-0.92/17 0.86s} 18. Qd2 {+0.84/19 1.2s}
Bxf3 {-1.05/19 1.9s} 19. Bxf3 {+0.87/22 0.97s} Qe7 {-0.86/18 0.52s}
20. Qe3 {+0.63/21 5.5s} Re6 {-0.97/18 1.2s} 21. a4 {+0.59/19 0.74s}
b4 {-1.01/19 2.2s} 22. cxb4 {+0.59/20 1.4s} cxb4 {-0.83/16 0.28s}
23. Bd1 {+0.82/17 1.3s} Rd8 {-1.14/20 7.6s} 24. Bb3 {+1.16/18 1.7s}
Red6 {-1.04/18 2.9s} 25. Rad1 {+0.74/20 3.0s} Qe5 {-1.20/17 0.53s}
26. Qe2 {+1.15/17 0.93s} Re8 {-1.00/18 2.4s} 27. Rf3 {+1.13/20 2.4s}
Rd7 {-1.30/17 2.0s} 28. Bc4 {+1.21/21 1.2s} Ree7 {-1.37/16 1.0s}
29. Rdf1 {+1.08/20 1.5s} Qh5 {-1.07/14 0.31s} 30. b3 {+0.97/21 2.9s}
Kh7 {-1.07/17 1.5s} 31. Re1 {+1.04/19 1.1s} Rd6 {-1.22/18 1.3s}
32. Rf5 {+1.17/21 1.8s} Qxf5 {-1.15/17 0.20s} 33. exf5 {+1.07/20 0.79s}
Rxe2 {-1.26/20 1.7s} 34. Rxe2 {+1.19/20 1.6s} Rd7 {-1.30/20 0.52s}
35. Kg2 {+1.23/20 0.99s} g5 {-1.46/18 0.69s} 36. fxg6+ {+1.25/20 1.1s}
Kxg6 {-1.37/20 0.64s} 37. Re5 {+1.26/22 2.8s} Ng4 {-1.19/18 0.63s}
38. Rb5 {+1.32/22 2.7s} Ne3+ {-1.57/17 1.2s} 39. Kf3 {+1.35/17 0.62s}
Nxc4 {-1.22/13 0.20s} 40. dxc4 {+1.60/18 0.92s} Rd3+ {-1.38/16 0.84s}
41. Ke4 {+1.85/20 1.2s} Rxb3 {-1.68/19 0.77s} 42. c5 {+2.15/18 1.5s}
Rb2 {-1.23/14 0.22s} 43. Ke5 {+3.49/19 2.4s} b3 {-1.85/17 0.98s}
44. c6 {+4.63/17 0.59s} Rxh2 {-4.60/17 0.59s} 45. Rxb3 {+6.82/18 0.94s}
Rc2 {-5.95/16 0.60s} 46. Kd6 {+8.14/17 0.83s} f5 {-6.60/16 0.60s}
47. c7 {+10.49/17 0.88s} a6 {-9.97/16 0.60s} 48. Rb6 {+12.64/17 1.2s}
Kh5 {-11.39/14 0.60s} 49. Rc6 {+16.56/17 1.1s} Rf2 {-12.52/15 0.60s}
50. c8=Q {+36.98/19 1.5s} Kg4 {-59.20/14 0.33s} 51. Qxa6 {+152.59/19 1.4s}
Kh3 {-132.75/22 0.85s} 52. Qd3 {+152.62/27 0.87s} h5 {-132.77/22 0.60s}
53. Rc3 {+M13/37 0.81s} Kg2 {-M12/29 0.60s} 54. g4 {+M11/50 0.79s}
hxg4 {-M10/34 0.21s} 55. Qg3+ {+M9/61 0.79s} Kf1 {-M8/48 0.27s}
56. Rc1+ {+M7/81 0.88s} Ke2 {-M6/1 0s} 57. Rc2+ {+M5/177 0.85s}
Kd1 {-M4/127 0.089s} 58. Qd3+ {+M3/245 0.006s} Rd2 {-M2/127 0.12s}
59. Qxd2# {+M1/245 0.004s, White mates} 1-0
[/pgn]
Fat Titz by Stockfish, the engine with the bodaciously big net. Remember: size matters. If you want to learn more about this engine just google for "Fat Titz".
dkappe
Posts: 1631
Joined: Tue Aug 21, 2018 7:52 pm
Full name: Dietrich Kappe

Re: Toga III 0.4 NNUE

Post by dkappe »

I’ve finally had a little spare time to finish an initial port of NNUE to Toga II 4.01. It’s really more of a NN (missing UE) so somewhat slow. This is with the Toga 3 0.4 net. Need to train and tune the 0.5 net, get hybrid eval going, make it UE. Then will release it as Toga III on github.


[pgn]
[Event "?"]
[Site "?"]
[Date "2021.01.01"]
[Round "1"]
[White "toga3"]
[Black "toga2"]
[Result "1-0"]
[ECO "E16"]
[GameDuration "00:02:57"]
[GameEndTime "2021-01-01T13:01:52.220 CST"]
[GameStartTime "2021-01-01T12:58:54.766 CST"]
[Opening "Queen's Indian"]
[PlyCount "105"]
[TimeControl "60+1"]
[Variation "Capablanca Variation"]

1. d4 {book} Nf6 {book} 2. c4 {book} e6 {book} 3. Nf3 {book} b6 {book}
4. g3 {book} Bb7 {book} 5. Bg2 {+0.08/14 1.9s} Bb4+ {-0.06/14 1.8s}
6. Bd2 {+0.07/15 2.0s} Bxd2+ {-0.09/16 3.4s} 7. Qxd2 {+0.04/16 2.8s}
O-O {-0.13/17 2.8s} 8. O-O {+0.04/16 3.8s} Ne4 {-0.02/16 3.3s}
9. Qe3 {+0.07/14 1.9s} Nd6 {-0.10/16 2.1s} 10. b3 {+0.13/15 2.6s}
Qe7 {-0.14/15 3.2s} 11. Nc3 {+0.16/14 2.6s} a5 {-0.18/15 4.7s}
12. Rfd1 {+0.17/14 2.5s} Na6 {-0.18/15 1.7s} 13. a3 {+0.30/16 2.1s}
f6 {-0.23/16 2.4s} 14. Qd3 {+0.26/16 2.4s} Kh8 {-0.28/15 2.9s}
15. Nd2 {+0.30/15 1.4s} g5 {-0.33/16 2.5s} 16. Bxb7 {+0.42/15 1.8s}
Nxb7 {-0.25/14 1.00s} 17. f4 {+0.42/16 2.3s} g4 {-0.30/14 1.6s}
18. Nf1 {+0.55/17 2.3s} Nd6 {-0.45/15 1.9s} 19. e4 {+0.55/17 1.5s}
f5 {-0.43/16 1.6s} 20. Ne3 {+0.52/17 2.6s} fxe4 {-0.47/17 1.9s}
21. Nxe4 {+0.76/14 1.6s} Qg7 {-0.49/18 2.1s} 22. Nxd6 {+0.73/16 2.2s}
cxd6 {-0.53/15 0.49s} 23. Rab1 {+0.78/16 3.8s} h5 {-0.54/16 2.0s}
24. Rd2 {+0.86/16 1.6s} Nc7 {-0.51/15 1.8s} 25. Rf1 {+0.82/15 2.0s}
Qf6 {-0.58/14 3.5s} 26. h3 {+1.38/15 2.0s} gxh3 {-1.06/15 1.7s}
27. Rh2 {+1.52/17 2.0s} Rf7 {-1.28/15 2.2s} 28. Rxh3 {+1.37/16 1.9s}
Rh7 {-1.38/15 1.7s} 29. Kg2 {+1.68/15 1.9s} Kg7 {-1.64/14 1.9s}
30. d5 {+1.90/12 1.8s} Qb2+ {-1.22/13 1.9s} 31. Kh1 {+2.18/12 1.8s}
Qxa3 {-1.35/12 1.2s} 32. g4 {+1.90/12 1.8s} Qc5 {-1.47/12 2.6s}
33. f5 {+2.66/12 1.2s} exd5 {-2.07/11 1.5s} 34. f6+ {+3.89/16 1.2s}
Kh8 {-3.68/14 1.8s} 35. cxd5 {+4.86/13 1.1s} Ne6 {-4.02/15 1.7s}
36. dxe6 {+4.92/12 0.41s} dxe6 {-4.03/15 1.7s} 37. Qe4 {+4.90/14 1.2s}
Re8 {-4.03/15 1.1s} 38. Rf5 {+5.95/14 1.8s} Qc1+ {-6.27/13 3.0s}
39. Nf1 {+6.98/15 1.7s} Kg8 {-6.47/14 1.6s} 40. Rhxh5 {+8.82/13 0.50s}
Rxh5+ {-8.20/14 1.6s} 41. gxh5 {+9.12/13 0.40s} Kf8 {-11.25/15 3.4s}
42. f7 {+9.85/13 0.43s} Rc8 {-9.44/14 2.5s} 43. Qxe6 {+10.46/13 0.56s}
Qc6+ {-14.12/16 4.8s} 44. Kg1 {+11.59/17 1.1s} d5 {-14.28/16 1.4s}
45. Qe5 {+12.64/15 0.38s} Qh6 {-14.48/14 1.3s} 46. Rf6 {+12.91/15 0.38s}
Qg7+ {-12.65/15 1.2s} 47. Kh1 {+13.85/15 0.44s} Rd8 {-21.07/18 10s}
48. Ne3 {+15.06/18 1.2s} Qh8 {-21.25/16 1.0s} 49. h6 {+16.47/15 0.49s}
b5 {-M8/63 0.25s} 50. Nf5 {+M7/63 0.20s} Qxh6+ {-M6/63 0.003s}
51. Rxh6 {+M5/63 0.002s} Kxf7 {-M4/63 0.002s} 52. Qe7+ {+M3/63 0.003s}
Kg8 {-M2/4 0s} 53. Qg7# {+M1/63 0.004s, White mates} 1-0
[/pgn]
Fat Titz by Stockfish, the engine with the bodaciously big net. Remember: size matters. If you want to learn more about this engine just google for "Fat Titz".
dkappe
Posts: 1631
Joined: Tue Aug 21, 2018 7:52 pm
Full name: Dietrich Kappe

Re: Toga III 0.4 NNUE

Post by dkappe »

I’ve checked in the initial nnue port here. https://github.com/dkappe/TogaIII/tree/nnue
Fat Titz by Stockfish, the engine with the bodaciously big net. Remember: size matters. If you want to learn more about this engine just google for "Fat Titz".
Pi4Chess
Posts: 253
Joined: Mon Nov 16, 2020 12:13 pm
Full name: Manuel Rivera

Re: Toga III 0.4 NNUE

Post by Pi4Chess »

Following with interest 👍☺️
dkappe
Posts: 1631
Joined: Tue Aug 21, 2018 7:52 pm
Full name: Dietrich Kappe

Re: Toga III 0.4 NNUE

Post by dkappe »

Slow as it is, I decided to try is against the latest Arasan.

Code: Select all


Score of arasan vs toga3: 44 - 23 - 33  [0.605] 100
Elo difference: 74.1 +/- 56.8, LOS: 99.5 %, DrawRatio: 33.0 %

Promising.

Also have night nurse running inside of a0lite julia for some shenanigans. :D
Fat Titz by Stockfish, the engine with the bodaciously big net. Remember: size matters. If you want to learn more about this engine just google for "Fat Titz".
bastiball
Posts: 5212
Joined: Tue Oct 20, 2020 4:18 am
Full name: Basti Dangca

Re: Toga III 0.4 NNUE

Post by bastiball »

Interesting :D :D
Basti Dangca
CCRL testing group