Great game
[pgn]
1. Nb1-a3 { 34.101 -0.06 } { }
1. d7-d5 { 2.026 0.04 } { }
2. e2-e3 { 1.842 -0.18 } { }
2. Bc8-g4 { 2.035 0.22 } { }
3. Qd1-g4 { 1.942 -0.47 } { }
3. d5-d4 { 2.161 0.40 } { }
4. e3-d4 { 1.600 -0.15 } { }
4. Qd8-c8 { 2.745 0.14 } { }
5. Qg4-c8 { 1.342 0.99 } { }
[/pgn]
Slippers shorties
Moderators: hgm, Rebel, chrisw
-
- Posts: 4052
- Joined: Thu May 15, 2008 9:57 pm
- Location: Berlin, Germany
- Full name: Sven Schüle
Re: Slippers shorties
How many years will it take to fix that?
Sven Schüle (engine author: Jumbo, KnockOut, Surprise)
-
- Posts: 7220
- Joined: Mon May 27, 2013 10:31 am
Re: Slippers shorties
Don't know. Plain alha zero method takes 11000 years for tuning on my computer. So we have to be patient.
But white did not play that bad. Looks like Black played suicide chess. (Maybe using wrong sign)
First step is to replace network with an old school evaluation and see if Monte Carlo tree search works normally.
-
- Posts: 7220
- Joined: Mon May 27, 2013 10:31 am
Re: Slippers shorties
I think I already found what went wrong. Wrong sign. Don't know for how long has this bug been there. All tuning time for nothing. Guess I can learn a lot from test driven development.Henk wrote: ↑Sun Aug 12, 2018 1:47 pmDon't know. Plain alha zero method takes 11000 years for tuning on my computer. So we have to be patient.
But white did not play that bad. Looks like Black played suicide chess. (Maybe using wrong sign)
First step is to replace network with an old school evaluation and see if Monte Carlo tree search works normally.
Played a new game but still playing lousy. But at least black not playing suicide chess. Makes same number of mistakes as white does. Might be another bug or not enough network tuning. That's why I have to replace network with normal evaluation just to see who is wrong: the network or something else.
-
- Posts: 4052
- Joined: Thu May 15, 2008 9:57 pm
- Location: Berlin, Germany
- Full name: Sven Schüle
Re: Slippers shorties
Let's be honest: you won't make a bet that there are less than five other bugs left in it, will you?
Sven Schüle (engine author: Jumbo, KnockOut, Surprise)
-
- Posts: 19
- Joined: Thu Aug 02, 2018 11:16 pm
- Full name: Raf Levsky
Re: Slippers shorties
Best game ever, reminds me my childhood, learn Leela
-
- Posts: 7220
- Joined: Mon May 27, 2013 10:31 am
Re: Slippers shorties
Slipper without net using monte carlo tree search with alpha beta search level 1 for evaluation.
Game looks 'normal'. So problem is bad evaluation of a position by neural network.
Training examples for neural network were generated using same alpha beta search level 1 for evaluation.
So it is not the training examples. Probably much more tuning and testing of neural network required.
[pgn] 1. Ng1-f3 { 2.010 0.02 } { } 1. Ng8-f6 { 2.024 -0.03 } { } 2. Nb1-c3 { 1.971 0.02 } { } 2. Nb8-c6 { 2.012 -0.12 } { } 3. d2-d4 { 1.938 -0.09 } { } 3. d7-d5 { 1.955 -0.15 } { } 4. Nf3-e5 { 1.959 -0.15 } { } 4. g7-g6 { 1.931 -0.17 } { } 5. Ne5-c6 { 1.911 -0.15 } { } 5. b7-c6 { 1.896 -0.43 } { } 6. f2-f4 { 1.860 -0.05 } { } 6. Qd8-d6 { 1.841 -0.12 } { } 7. Bc1-e3 { 1.827 -0.12 } { } 7. Qd6-b4 { 1.834 -0.20 } { } 8. Qd1-c1 { 1.776 -0.19 } { } 8. Nf6-e4 { 1.789 -0.11 } { } 9. a2-a3 { 1.818 -0.26 } { } 9. Qb4-a5 { 1.756 -0.81 } { } 10. b2-b4 { 1.774 0.20 } { } 10. Qa5-a6 { 1.717 -0.89 } { } 11. Nc3-e4 { 1.707 0.62 } { } 11. d5-e4 { 1.696 -0.60 } { } 12. c2-c4 { 1.679 0.08 } { } 12. Bc8-f5 { 1.674 -0.31 } { } 13. c4-c5 { 1.678 0.04 } { } 13. 0-0-0 { 1.645 -0.34 } { } 14. g2-g3 { 1.633 0.01 } { } 14. Rd8-d5 { 1.631 -0.33 } { } 15. Qc1-c3 { 1.581 0.01 } { } 15. e7-e6 { 1.592 -0.36 } { } 16. Bf1-g2 { 1.556 -0.01 } { } 16. f7-f6 { 1.611 -0.16 } { } 17. Qc3-c2 { 1.543 0.07 } { } 17. e6-e5 { 1.662 -0.39 } { } 18. d4-e5 { 1.547 0.36 } { } 18. f6-e5 { 1.555 -0.51 } { } 19. Bg2-e4 { 1.555 0.37 } { } 19. e5-f4 { 1.514 -0.51 } { } 20. g3-f4 { 1.481 0.12 } { } 20. Bf8-g7 { 1.516 -0.50 } { } 21. Be4-f5 { 1.485 0.22 } { } 21. Rd5-f5 { 1.424 -0.28 } { } 22. Ra1-a2 { 1.410 -0.04 } { } 22. Rh8-e8 { 1.440 -0.49 } { } 23. Qc2-b3 { 1.453 0.03 } { } 23. Re8-e4 { 1.400 -0.39 } { } 24. 0-0 { 1.471 0.13 } { } 24. Bg7-h6 { 1.415 -0.38 } { } 25. Qb3-g8 { 1.381 0.11 } { } 25. Bh6-f8 { 1.377 -0.43 } { } 26. Rf1-f3 { 1.376 0.16 } { } 26. Qa6-c4 { 1.349 -0.52 } { } 27. Qg8-c4 { 1.323 0.95 } { } 27. Re4-c4 { 1.285 -0.95 } { } 28. Kg1-h1 { 1.256 0.22 } { } 28. Rc4-e4 { 1.286 -0.55 } { } 29. Ra2-a1 { 1.243 0.19 } { } 29. a7-a5 { 1.294 -0.51 } { } 30. Ra1-b1 { 1.248 0.18 } { } 30. Rf5-d5 { 1.257 -0.54 } { } 31. Rf3-g3 { 1.215 0.19 } { } 31. Bf8-h6 { 1.230 -0.43 } { } 32. Rg3-h3 { 1.210 0.07 } { } 32. Bh6-f4 { 1.193 -0.49 } { } 33. Be3-f4 { 1.192 0.59 } { } 33. Re4-f4 { 1.182 -0.77 } { } 34. Rh3-h7 { 1.169 0.08 } { } 34. a5-b4 { 1.145 -0.58 } { } 35. Rh7-h8 { 1.148 0.17 } { } 35. Kc8-d7 { 1.148 -0.33 } { } 36. a3-b4 { 1.131 0.22 } { } 36. Rf4-e4 { 1.112 -0.57 } { } 37. Rh8-g8 { 1.091 0.25 } { } 37. g6-g5 { 1.081 -0.55 } { } 38. Rb1-g1 { 1.083 0.22 } { } 38. Re4-b4 { 1.112 -0.55 } { } 39. Rg8-g7 { 1.064 0.15 } { } 39. Kd7-c8 { 1.047 -0.25 } { } 40. Rg7-g5 { 1.026 -0.07 } { } 40. Rb4-d4 { 1.023 -0.48 } { } 41. Rg5-d5 { 1.009 0.40 } { } 41. c6-d5 { 1.017 -0.25 } { } 42. c5-c6 { 0.989 0.24 } { } 42. Kc8-b8 { 1.002 -0.29 } { } 43. Rg1-b1 { 0.977 0.19 } { } 43. Kb8-c8 { 0.974 -0.35 } { } 44. Rb1-f1 { 0.960 0.37 } { } 44. Kc8-b8 { 0.969 -0.28 } { } 45. Rf1-f5 { 0.946 0.21 } { } 45. Rd4-d1 { 0.970 -0.31 } { } 46. Kh1-g2 { 0.924 0.20 } { } 46. Rd1-d4 { 0.927 -0.25 } { } 47. e2-e3 { 0.928 0.17 } { } 47. Rd4-d1 { 0.923 -0.32 } { } 48. Rf5-e5 { 0.899 0.22 } { } 48. Rd1-d2 { 0.898 -0.30 } { } 49. Kg2-g1 { 0.878 0.39 } { } 49. Rd2-d1 { 0.886 -0.32 } { } 50. Kg1-f2 { 0.865 0.39 } { } 50. Rd1-d2 { 0.874 -0.31 } { } 51. Kf2-e1 { 0.849 0.42 } { } 51. Rd2-h2 { 0.855 -0.24 } { } 52. Re5-d5 { 0.845 0.20 } { } 52. Rh2-c2 { 0.860 -0.28 } { } 53. Ke1-d1 { 0.829 0.16 } { } 53. Rc2-c6 { 0.824 -0.17 } { } 54. e3-e4 { 0.820 -0.01 } { } 54. Rc6-e6 { 0.811 -0.05 } { } 55. e4-e5 { 0.807 -0.03 } { } 55. c7-c6 { 0.799 0.01 } { } 56. Rd5-d6 { 0.781 -0.04 } { } 56. Re6-e5 { 0.783 0.06 } { } 57. Rd6-c6 { 0.769 -0.22 } { } 57. Kb8-b7 { 0.783 0.00 } { } 58. Rc6-c4 { 0.765 -0.17 } { } 58. Re5-d5 { 0.770 -0.05 } { } 59. Kd1-c1 { 0.761 -0.01 } { } 59. Kb7-a8 { 0.752 -0.09 } { } 60. Rc4-e4 { 0.733 -0.05 } { } 60. Ka8-b8 { 0.733 -0.07 } { } 61. Re4-e8 { 0.724 -0.04 } { } 61. Kb8-a7 { 0.722 0.01 } { } 62. Re8-e4 { 0.706 -0.08 } { } 62. Ka7-a8 { 0.704 -0.09 } { } 63. Kc1-b1 { 0.693 -0.04 } { } 63. Ka8-b8 { 0.715 -0.04 } { } 64. Kb1-a1 { 0.680 -0.05 } { } 64. Kb8-a8 { 0.695 -0.04 } { } 65. Ka1-b1 { 0.682 -0.03 } { } 65. Ka8-b8 { 0.687 -0.05 } { } 66. Kb1-a1 { 0.657 -0.05 } { } 66. Kb8-a8 { 0.681 -0.05 } { } 67. Ka1-b1 { 0.663 -0.04 } { } [/pgn]
Game looks 'normal'. So problem is bad evaluation of a position by neural network.
Training examples for neural network were generated using same alpha beta search level 1 for evaluation.
So it is not the training examples. Probably much more tuning and testing of neural network required.
[pgn] 1. Ng1-f3 { 2.010 0.02 } { } 1. Ng8-f6 { 2.024 -0.03 } { } 2. Nb1-c3 { 1.971 0.02 } { } 2. Nb8-c6 { 2.012 -0.12 } { } 3. d2-d4 { 1.938 -0.09 } { } 3. d7-d5 { 1.955 -0.15 } { } 4. Nf3-e5 { 1.959 -0.15 } { } 4. g7-g6 { 1.931 -0.17 } { } 5. Ne5-c6 { 1.911 -0.15 } { } 5. b7-c6 { 1.896 -0.43 } { } 6. f2-f4 { 1.860 -0.05 } { } 6. Qd8-d6 { 1.841 -0.12 } { } 7. Bc1-e3 { 1.827 -0.12 } { } 7. Qd6-b4 { 1.834 -0.20 } { } 8. Qd1-c1 { 1.776 -0.19 } { } 8. Nf6-e4 { 1.789 -0.11 } { } 9. a2-a3 { 1.818 -0.26 } { } 9. Qb4-a5 { 1.756 -0.81 } { } 10. b2-b4 { 1.774 0.20 } { } 10. Qa5-a6 { 1.717 -0.89 } { } 11. Nc3-e4 { 1.707 0.62 } { } 11. d5-e4 { 1.696 -0.60 } { } 12. c2-c4 { 1.679 0.08 } { } 12. Bc8-f5 { 1.674 -0.31 } { } 13. c4-c5 { 1.678 0.04 } { } 13. 0-0-0 { 1.645 -0.34 } { } 14. g2-g3 { 1.633 0.01 } { } 14. Rd8-d5 { 1.631 -0.33 } { } 15. Qc1-c3 { 1.581 0.01 } { } 15. e7-e6 { 1.592 -0.36 } { } 16. Bf1-g2 { 1.556 -0.01 } { } 16. f7-f6 { 1.611 -0.16 } { } 17. Qc3-c2 { 1.543 0.07 } { } 17. e6-e5 { 1.662 -0.39 } { } 18. d4-e5 { 1.547 0.36 } { } 18. f6-e5 { 1.555 -0.51 } { } 19. Bg2-e4 { 1.555 0.37 } { } 19. e5-f4 { 1.514 -0.51 } { } 20. g3-f4 { 1.481 0.12 } { } 20. Bf8-g7 { 1.516 -0.50 } { } 21. Be4-f5 { 1.485 0.22 } { } 21. Rd5-f5 { 1.424 -0.28 } { } 22. Ra1-a2 { 1.410 -0.04 } { } 22. Rh8-e8 { 1.440 -0.49 } { } 23. Qc2-b3 { 1.453 0.03 } { } 23. Re8-e4 { 1.400 -0.39 } { } 24. 0-0 { 1.471 0.13 } { } 24. Bg7-h6 { 1.415 -0.38 } { } 25. Qb3-g8 { 1.381 0.11 } { } 25. Bh6-f8 { 1.377 -0.43 } { } 26. Rf1-f3 { 1.376 0.16 } { } 26. Qa6-c4 { 1.349 -0.52 } { } 27. Qg8-c4 { 1.323 0.95 } { } 27. Re4-c4 { 1.285 -0.95 } { } 28. Kg1-h1 { 1.256 0.22 } { } 28. Rc4-e4 { 1.286 -0.55 } { } 29. Ra2-a1 { 1.243 0.19 } { } 29. a7-a5 { 1.294 -0.51 } { } 30. Ra1-b1 { 1.248 0.18 } { } 30. Rf5-d5 { 1.257 -0.54 } { } 31. Rf3-g3 { 1.215 0.19 } { } 31. Bf8-h6 { 1.230 -0.43 } { } 32. Rg3-h3 { 1.210 0.07 } { } 32. Bh6-f4 { 1.193 -0.49 } { } 33. Be3-f4 { 1.192 0.59 } { } 33. Re4-f4 { 1.182 -0.77 } { } 34. Rh3-h7 { 1.169 0.08 } { } 34. a5-b4 { 1.145 -0.58 } { } 35. Rh7-h8 { 1.148 0.17 } { } 35. Kc8-d7 { 1.148 -0.33 } { } 36. a3-b4 { 1.131 0.22 } { } 36. Rf4-e4 { 1.112 -0.57 } { } 37. Rh8-g8 { 1.091 0.25 } { } 37. g6-g5 { 1.081 -0.55 } { } 38. Rb1-g1 { 1.083 0.22 } { } 38. Re4-b4 { 1.112 -0.55 } { } 39. Rg8-g7 { 1.064 0.15 } { } 39. Kd7-c8 { 1.047 -0.25 } { } 40. Rg7-g5 { 1.026 -0.07 } { } 40. Rb4-d4 { 1.023 -0.48 } { } 41. Rg5-d5 { 1.009 0.40 } { } 41. c6-d5 { 1.017 -0.25 } { } 42. c5-c6 { 0.989 0.24 } { } 42. Kc8-b8 { 1.002 -0.29 } { } 43. Rg1-b1 { 0.977 0.19 } { } 43. Kb8-c8 { 0.974 -0.35 } { } 44. Rb1-f1 { 0.960 0.37 } { } 44. Kc8-b8 { 0.969 -0.28 } { } 45. Rf1-f5 { 0.946 0.21 } { } 45. Rd4-d1 { 0.970 -0.31 } { } 46. Kh1-g2 { 0.924 0.20 } { } 46. Rd1-d4 { 0.927 -0.25 } { } 47. e2-e3 { 0.928 0.17 } { } 47. Rd4-d1 { 0.923 -0.32 } { } 48. Rf5-e5 { 0.899 0.22 } { } 48. Rd1-d2 { 0.898 -0.30 } { } 49. Kg2-g1 { 0.878 0.39 } { } 49. Rd2-d1 { 0.886 -0.32 } { } 50. Kg1-f2 { 0.865 0.39 } { } 50. Rd1-d2 { 0.874 -0.31 } { } 51. Kf2-e1 { 0.849 0.42 } { } 51. Rd2-h2 { 0.855 -0.24 } { } 52. Re5-d5 { 0.845 0.20 } { } 52. Rh2-c2 { 0.860 -0.28 } { } 53. Ke1-d1 { 0.829 0.16 } { } 53. Rc2-c6 { 0.824 -0.17 } { } 54. e3-e4 { 0.820 -0.01 } { } 54. Rc6-e6 { 0.811 -0.05 } { } 55. e4-e5 { 0.807 -0.03 } { } 55. c7-c6 { 0.799 0.01 } { } 56. Rd5-d6 { 0.781 -0.04 } { } 56. Re6-e5 { 0.783 0.06 } { } 57. Rd6-c6 { 0.769 -0.22 } { } 57. Kb8-b7 { 0.783 0.00 } { } 58. Rc6-c4 { 0.765 -0.17 } { } 58. Re5-d5 { 0.770 -0.05 } { } 59. Kd1-c1 { 0.761 -0.01 } { } 59. Kb7-a8 { 0.752 -0.09 } { } 60. Rc4-e4 { 0.733 -0.05 } { } 60. Ka8-b8 { 0.733 -0.07 } { } 61. Re4-e8 { 0.724 -0.04 } { } 61. Kb8-a7 { 0.722 0.01 } { } 62. Re8-e4 { 0.706 -0.08 } { } 62. Ka7-a8 { 0.704 -0.09 } { } 63. Kc1-b1 { 0.693 -0.04 } { } 63. Ka8-b8 { 0.715 -0.04 } { } 64. Kb1-a1 { 0.680 -0.05 } { } 64. Kb8-a8 { 0.695 -0.04 } { } 65. Ka1-b1 { 0.682 -0.03 } { } 65. Ka8-b8 { 0.687 -0.05 } { } 66. Kb1-a1 { 0.657 -0.05 } { } 66. Kb8-a8 { 0.681 -0.05 } { } 67. Ka1-b1 { 0.663 -0.04 } { } [/pgn]
-
- Posts: 7220
- Joined: Mon May 27, 2013 10:31 am
Re: Slippers shorties
[pgn]
1. Nb1-c3 { 1.508 0.03 } { }
1. f7-f6 { 1.538 -0.09 } { }
2. Ra1-b1 { 1.482 0.00 } { }
2. Nb8-c6 { 1.478 -0.02 } { }
3. e2-e4 { 1.462 0.03 } { }
3. d7-d5 { 1.455 -0.04 } { }
4. Qd1-e2 { 1.433 -0.07 } { }
4. Nc6-b4 { 1.427 -0.09 } { }
5. Qe2-e3 { 1.418 -0.09 } { }
5. d5-d4 { 1.411 -0.06 } { }
6. Bf1-b5 { 1.389 -0.17 } { }
6. Ke8-f7 { 1.393 0.15 } { }
7. Qe3-f3 { 1.364 -0.25 } { }
7. Nb4-c2 { 1.357 0.04 } { }
8. Ke1-f1 { 1.340 -0.15 } { }
8. Bc8-g4 { 1.337 0.12 } { }
9. Qf3-d3 { 1.315 -0.09 } { }
9. Nc2-b4 { 1.318 0.10 } { }
10. Qd3-c4 { 1.299 -0.20 } { }
10. Nb4-d5 { 1.297 0.14 } { }
11. Nc3-d5 { 1.271 -0.04 } { }
11. Bg4-d1 { 1.269 -0.15 } { }
12. Nd5-f4 { 1.251 -0.09 } { }
12. e7-e6 { 1.247 -0.65 } { }
13. Qc4-e6 { 1.225 0.98 } { }
[/pgn]