MRI - Match Result Inspector

Rebel · Post by **Rebel** » Mon Feb 10, 2020 12:10 pm

MRI (Match Result Inspector) is a tool to extract valuable information from a PGN engine-engine match provided the PGN output is created by ChessBase, Cutechess or Arena.

It's currently in alpha stage (not downloadable yet) and I prefer some feedback for improvements, more ideas before a beta release.

Functions:
1. Suspect opening lines overview
2. Crazy games (incompatible scores)
3. Games that should have been won
4. Drop in score (horizon effects mostly)
5. Double opening detector
6. Lost games analysis

Examples:

1. Suspect opening lines overview
[pgn][Event ""]
[Site ""]
[Date "2020.02.04"]
[Round "675"]
[White "Stockfish_8"]
[Black "Komodo_10"]
[Result "0-1"]

{Bad opening line for Stockfish_8 in game 675, start score -2.85, game lost. }1. e4 {book} e6 {book} 2. Nc3 {book} d5 {book} 3. exd5 {book} exd5 {book} 4. Qe2+ {book} Be7 {book} 5. d4 {book} Nf6 {book} 6. Nf3 {book} O-O {book} 7. b3 {book} Bb4 {book} 8. Bb2 {book} Re8 {book} 9. Ne5 {-2.85/21 3.8s} Ne4 {+2.85/17 2.0s} 10. Qe3 {-2.87/19 0.36s} c5 {+3.07/19 3.5s} 11. O-O-O {-3.47/22 4.0s} cxd4 {+3.12/19 2.7s} 12. Qxd4 {-3.46/20 0.60s} Qg5+ {+2.79/20 3.3s} 13. Kb1 {-3.20/23 1.8s} Nxc3+ {+2.83/21 3.5s} 14. Bxc3 {-3.48/20 0.35s} Bxc3 {+3.11/21 2.1s} 15. Qxc3 {-3.56/23 3.1s} Qxe5 {+3.06/22 2.1s} 16. Qxe5 {-3.62/18 0.47s} Rxe5 {+3.02/21 0.76s} 17. Bb5 {-3.62/23 6.7s} Nc6 {+3.26/21 2.2s} 18. f4 {-3.47/19 0.33s} Re4 {+3.30/21 1.2s} 19. Rxd5 {-3.77/22 4.6s} Be6 {+3.28/20 1.2s} 20. Bxc6 {-3.74/23 5.6s} bxc6 {+3.21/21 1.5s} 21. Rd3 {-3.78/22 8.4s} Rxf4 {+3.71/18 1.6s} 22. g3 {-3.86/21 7.3s} Rf2 {+3.83/19 1.5s} 23. Rhd1 {-3.82/22 1.7s} Kf8 {+4.03/20 2.3s} 24. R1d2 {-3.86/19 0.29s} Rxd2 {+3.94/22 0.99s} 25. Rxd2 {-3.86/23 2.2s} Ke7 {+4.03/22 3.1s} 26. Rd4 {-3.98/18 1.2s} c5 {+4.06/21 2.3s} 27. Rd3 {-4.13/20 5.9s} Rd8 {+4.13/22 1.7s} 28. Rxd8 {-4.38/20 2.1s} Kxd8 {+4.15/22 1.5s} 29. Kb2 {-4.81/21 4.1s} Kc7 {+4.65/21 6.3s} 30. h4 {-5.33/23 6.2s} Kd6 {+6.00/19 2.9s} 31. Ka3 {-6.17/20 3.3s} Ke5 {+7.07/20 2.3s} 32. Ka4 {-6.02/19 0.56s} Kf5 {+9.26/20 6.8s} 33. Kb5 {-8.27/16 0.77s} Kg4 {+9.82/19 2.2s} 34. Kc6 {-11.74/19 1.9s} Kxg3 {+10.92/18 5.1s} 35. a3 {-12.94/19 1.1s} f5 {+11.41/17 1.3s} 36. Kd6 {-13.29/17 0.63s} f4 {+12.15/17 2.2s} 37. Kxe6 {-13.58/16 0.34s} f3 {+12.17/18 1.0s} 38. h5 {-14.83/16 0.23s, Black wins by adjudication} 0-1[/pgn]
Time to remove opening lines like these to remove from your test set?

2. Crazy games (incompatible scores)
When 2 engines both show a very good positive score then usually one is wrong.
[pgn][Event ""]
[Site ""]
[Date "2020.01.26"]
[Round "197"]
[White "ProDeo"]
[Black "Fruit_2.3"]
[Result "0-1"]

{Crazy scores in game 197 (move 52) with scores like 1.36 2.09 2.28 1.53 }1. b3 {book} e5 {book} 2. Bb2 {book} Nc6 {book} 3. e3 {book} Nf6 {book} 4. Bb5 {book} d6 {book} 5. Ne2 {book} Bd7 {book} 6. O-O {book} a6 {book} 7. Bxc6 {book} Bxc6 {book} 8. d3 {book} Qe7 {book} 9. Nd2 {+0.04/10 1.5s} g6 {+0.12/11 1.3s} 10. e4 {-0.02/11 1.2s} Bh6 {+0.17/11 0.95s} 11. Nc4 {-0.07/11 1.7s} b5 {+0.25/12 0.86s} 12. Ne3 {-0.06/11 1.7s} Qe6 {+0.23/10 1.5s} 13. c4 {+0.15/11 1.2s} Bxe3 {+0.16/10 1.3s} 14. fxe3 {+0.16/10 0.53s} bxc4 {-0.04/12 2.0s} 15. bxc4 {+0.14/10 0.51s} O-O {-0.02/13 1.4s} 16. Nc3 {+0.33/12 1.5s} Rab8 {-0.01/12 0.91s} 17. Rb1 {+0.25/12 1.5s} Rb7 {+0.01/12 1.1s} 18. Nd5 {+0.22/12 1.1s} Bxd5 {-0.19/13 1.9s} 19. cxd5 {+0.05/10 0.24s} Qe7 {-0.10/14 1.3s} 20. Ba3 {+0.33/14 3.7s} Rfb8 {-0.06/12 1.8s} 21. Rxb7 {+0.39/12 0.69s} Rxb7 {-0.02/11 0.41s} 22. Qa4 {+0.36/12 1.0s} Rb6 {-0.04/13 1.3s} 23. h3 {+0.37/12 0.74s} Kg7 {-0.03/13 0.96s} 24. Qc2 {+0.43/12 0.90s} Rb5 {0.00/12 1.3s} 25. Kh2 {+0.40/11 1.1s} Qd8 {-0.07/12 1.3s} 26. g3 {+0.49/11 1.1s} Rb7 {-0.01/10 0.67s} 27. Bb2 {+0.46/11 1.3s} Qe7 {-0.19/11 1.8s} 28. Rf2 {+0.41/11 0.99s} Nd7 {-0.24/11 1.6s} 29. Ba3 {+0.53/12 1.3s} Nf6 {-0.10/11 1.1s} 30. Qc4 {+0.51/12 0.75s} Qe8 {-0.28/11 1.3s} 31. Qxa6 {+1.00/12 0.81s} Qb8 {-0.42/11 0.68s} 32. Qc4 {+1.04/12 2.8s} h6 {-0.50/11 2.3s} 33. Qc2 {+1.06/11 0.72s} Ra7 {-0.60/11 1.4s} 34. Bc1 {+1.19/11 0.80s} h5 {-0.58/11 1.3s} 35. Rf1 {+1.21/11 0.83s} Nd7 {-0.50/10 0.61s} 36. d4 {+1.22/10 0.71s} f6 {-0.60/10 0.85s} 37. Rf2 {+1.12/11 0.63s} Qb6 {-0.55/11 1.6s} 38. Qc4 {+1.35/12 1.4s} Qa6 {-0.71/10 0.83s} 39. Qxa6 {+1.49/13 0.68s} Rxa6 {-0.78/11 0.34s} 40. Rc2 {+1.00/13 0.78s} Kf7 {-0.78/12 0.44s} 41. Kg2 {+0.95/15 3.6s} Ra4 {-0.65/14 1.5s} 42. Kf3 {+1.15/13 0.67s} Ke7 {-0.59/14 1.6s} 43. Rxc7 {+1.11/14 0.84s} Rxa2 {-0.58/13 0.88s} 44. Rb7 {+0.99/13 0.90s} Rc2 {-0.28/14 0.73s} 45. dxe5 {+0.92/14 0.70s} Kd8 {0.00/15 1.0s} 46. Bb2 {+1.22/15 0.83s} Nc5 {0.00/15 0.91s} 47. Rb8+ {+1.63/13 0.65s} Kc7 {+0.97/13 0.40s} 48. exd6+ {+1.37/13 0.80s} Kxb8 {+0.73/15 0.57s} 49. Bxf6 {+1.02/14 1.1s} Kc8 {+0.92/14 0.99s} 50. e5 {+0.77/14 1.3s} Rd2 {+1.14/14 1.1s} 51. e4 {+0.83/13 0.79s} Rd3+ {+0.79/13 0.71s} 52. Kf4 {+0.92/13 1.2s} Rd1 {+1.36/15 0.90s} 53. e6 {+2.09/13 0.98s} Rf1+ {+2.28/15 0.78s} 54. Ke5 {+1.53/14 1.0s} Nd3+ {+2.60/16 1.0s} 55. Kd4 {+2.66/7 0.013s} Rxf6 {+2.75/17 0.92s} 56. Kxd3 {+0.73/13 0.78s} Rf3+ {+2.75/16 1.2s} 57. Kd4 {+0.40/13 0.79s} Kd8 {+3.61/16 1.4s} 58. Ke5 {+0.88/14 1.4s} g5 {+4.64/16 1.2s} 59. d7 {-0.38/14 1.1s} Kc7 {+5.03/16 0.65s} 60. g4 {0.00/14 1.3s} h4 {+11.09/15 1.0s} 61. Kd4 {-6.76/14 0.88s} Rxh3 {+11.46/14 0.61s} 62. e5 {-8.53/15 1.2s} Ra3 {+12.82/15 0.80s} 63. Ke4 {-9.17/14 0.91s} h3 {+13.65/14 0.77s} 64. Kf5 {-10.75/12 0.73s} h2 {+14.00/13 0.99s} 65. Kf6 {-10.93/13 1.0s, Black wins by adjudication} 0-1[/pgn]
Obviously ProDeo overestimated its passed pawns evaluation.

[pgn][Event ""]
[Site ""]
[Date "2020.02.10"]
[Round "789"]
[White "Ethereal_11.75"]
[Black "Xiphos_0.6"]
[Result "0-1"]

{Crazy scores in game 789 (move 35) with scores like 3.18 2.60 3.25 3.72 }1. d4 {book} f5 {book} 2. Nf3 {book} g6 {book} 3. Bf4 {book} Bg7 {book} 4. e3 {book} Nf6 {book} 5. Bc4 {book} d5 {book} 6. Bb3 {book} Be6 {book} 7. O-O {book} Qd7 {book} 8. Ng5 {book} Bg8 {book} 9. Nf3 {+1.49/17 3.3s} Be6 {0.00/40 0.84s} 10. Nbd2 {+1.46/17 2.2s} Nc6 {-1.11/17 1.3s} 11. Ba4 {+1.49/16 2.1s} Qc8 {-1.24/21 3.2s} 12. Ne5 {+1.72/18 2.4s} O-O {-1.27/22 0.89s} 13. Bxc6 {+1.69/19 2.0s} bxc6 {-1.02/16 0.81s} 14. Nb3 {+1.91/20 4.3s} Bd7 {-1.10/19 2.5s} 15. Nd3 {+1.96/19 1.9s} a5 {-1.07/19 2.2s} 16. a4 {+2.06/18 2.3s} Qb8 {-1.28/18 1.7s} 17. Nbc5 {+1.96/18 2.6s} Bc8 {-1.26/20 2.2s} 18. f3 {+1.96/20 1.6s} Ba6 {-1.45/19 3.6s} 19. Ne6 {+2.27/18 2.3s} Rc8 {-1.34/19 3.0s} 20. g4 {+2.51/18 2.2s} Bxd3 {-1.41/18 2.0s} 21. cxd3 {+2.54/18 2.5s} Qb6 {-1.54/21 2.6s} 22. Rc1 {+2.55/18 3.1s} Kf7 {-1.59/21 1.5s} 23. Nc5 {+2.35/17 3.2s} Qb8 {-1.43/17 3.1s} 24. gxf5 {+3.47/18 2.8s} gxf5 {-1.29/20 1.8s} 25. Kh1 {+3.56/18 2.5s} Rg8 {-1.61/18 3.6s} 26. Qe2 {+3.77/17 3.0s} Bh8 {-2.51/18 6.4s} 27. e4 {+3.63/18 3.7s} Nh5 {-2.86/20 2.1s} 28. Be5 {+3.89/18 3.5s} Qf8 {-2.22/21 2.1s} 29. Bxh8 {+3.36/19 4.4s} Qh6 {-2.10/23 5.0s} 30. Be5 {+2.87/17 1.6s} f4 {-2.10/26 1.7s} 31. Rg1 {+2.57/17 1.4s} Ng3+ {-2.42/22 2.4s} 32. Rxg3 {+2.98/18 1.2s} fxg3 {-2.38/23 2.4s} 33. Re1 {+3.02/17 1.8s} Qh3 {-2.10/23 6.3s} 34. Bxc7 {+3.14/19 3.9s} Rg6 {-2.10/24 1.1s} 35. Bf4 {+3.18/18 1.3s} gxh2 {+2.60/22 1.8s} 36. Bxh2 {+3.25/19 1.6s} Rag8 {+3.72/26 1.4s} 37. exd5 {+3.39/19 2.2s} e5 {+3.79/30 1.3s} 38. Nd7 {-5.82/21 3.1s} Rg2 {+3.84/28 1.6s} 39. Nxe5+ {-6.00/17 0.49s} Ke8 {+3.84/30 3.6s} 40. Nxc6+ {-6.12/18 1.6s} Rxe2 {+4.84/25 3.7s} 41. Rxe2+ {-6.04/19 3.0s} Kf8 {+5.02/24 1.8s} 42. Rf2 {-6.43/19 2.1s} Qh4 {+5.28/25 6.9s} 43. Re2 {-6.54/19 2.5s} Qh6 {+5.41/23 3.3s} 44. Rg2 {-6.42/19 3.0s} Rxg2 {+5.26/25 1.8s} 45. Kxg2 {-6.46/17 2.0s} Qg5+ {+5.41/23 3.6s} 46. Bg3 {-6.61/19 1.9s} Qxd5 {+5.72/23 6.8s} 47. Ne5 {-6.64/18 3.2s} Qxd4 {+5.71/20 1.4s} 48. f4 {-6.80/17 3.4s} Qxb2+ {+5.85/20 2.9s} 49. Bf2 {-6.62/17 2.9s} Qc2 {+5.61/18 2.5s} 50. Kf3 {-7.25/17 3.8s} Qxa4 {+6.17/18 2.5s} 51. Bc5+ {-7.69/16 4.5s} Kg7 {+6.21/21 2.9s} 52. Ke3 {-7.86/16 3.2s} Qb5 {+6.37/17 1.6s} 53. Bd4 {-8.18/16 5.1s} a4 {+6.58/17 1.0s} 54. f5 {-8.42/15 2.2s} Kf6 {+6.83/18 1.5s} 55. Nc4+ {-8.16/17 2.9s} Ke7 {+6.86/16 0.87s} 56. Be5 {-8.88/15 2.7s} Qd5 {+7.49/16 2.2s} 57. Ke2 {-9.39/16 5.0s} a3 {+8.06/17 0.93s} 58. Bc3 {-11.08/16 4.2s} Qg2+ {+8.57/18 1.7s} 59. Ke3 {-11.50/17 3.2s} a2 {+8.88/17 2.1s} 60. Nd2 {-11.71/16 2.4s} Qg5+ {+10.18/17 1.7s} 61. Ke2 {-12.63/18 5.3s, Black wins by adjudication} 0-1[/pgn]
Ethereal too optimistic.

3. Games that should have been won
When an engine shows a score of +9.92 one might expect it to win the game, not so for Stockfish 8.

[pgn][Event ""]
[Site ""]
[Date "2020.02.04"]
[Round "238"]
[White "Komodo_10"]
[Black "Stockfish_8"]
[Result "1/2-1/2"]

{Stockfish_8 should have won game 238 with a score of 9.92 (move 115... Nc2) draw only.}1. e4 {book} d6 {book} 2. d4 {book} Nf6 {book} 3. Nc3 {book} g6 {book} 4. Be3 {book} Bg7 {book} 5. f3 {book} O-O {book} 6. Qd2 {book} c6 {book} 7. Nge2 {book} Qc7 {book} 8. h4 {book} h5 {book} 9. a4 {+0.29/17 2.0s} e5 {-0.23/21 3.9s} 10. O-O-O {+0.39/16 1.9s} Be6 {-0.22/20 6.3s} 11. Kb1 {+0.26/17 5.3s} Na6 {-0.33/20 3.2s} 12. Nc1 {+0.25/16 1.9s} Nb4 {-0.31/19 1.5s} 13. dxe5 {+0.32/17 2.8s} dxe5 {-0.39/20 0.48s} 14. Qd6 {+0.26/19 1.9s} Qxd6 {-0.32/21 1.4s} 15. Rxd6 {+0.32/19 1.5s} b6 {-0.55/22 9.0s} 16. Nd1 {+0.35/18 2.0s} Rad8 {-0.22/19 1.2s} 17. Rxd8 {+0.29/20 1.5s} Rxd8 {-0.16/18 0.38s} 18. Be2 {+0.34/21 3.2s} c5 {-0.35/21 2.5s} 19. Bb5 {+0.46/20 2.2s} Rc8 {-0.46/19 0.41s} 20. Bf2 {+0.31/21 3.3s} c4 {-0.42/20 2.0s} 21. c3 {+0.37/20 3.4s} Nc6 {-0.17/21 1.0s} 22. Na2 {+0.26/20 3.3s} Na5 {-0.25/22 6.2s} 23. Ne3 {+0.34/20 1.6s} Rd8 {-0.29/22 2.2s} 24. Kc2 {+0.29/20 2.5s} Ne8 {-0.36/23 4.6s} 25. Nd5 {+0.28/20 1.9s} f5 {-0.02/22 7.8s} 26. Rd1 {+0.40/17 1.3s} Nd6 {-0.07/20 1.5s} 27. Be3 {+0.42/19 2.9s} Bxd5 {0.00/21 0.79s} 28. exd5 {+0.23/22 3.2s} Nxb5 {0.00/24 4.2s} 29. axb5 {+0.19/22 1.4s} Nb7 {-0.09/26 1.7s} 30. Nb4 {+0.32/19 2.2s} Nd6 {0.00/24 0.79s} 31. Nc6 {+0.74/19 1.4s} Rd7 {-0.05/26 1.6s} 32. f4 {+0.43/21 3.6s} e4 {0.00/23 0.21s} 33. Ne5 {+0.41/21 1.1s} Rc7 {0.00/24 1.6s} 34. Nxg6 {+0.49/22 1.7s} Bf6 {-0.08/25 2.0s} 35. Ne5 {+0.29/21 1.4s} Rg7 {0.00/22 0.24s} 36. Rg1 {+0.20/21 2.7s} Bxh4 {0.00/26 1.9s} 37. Kd1 {+0.22/23 5.4s} Bg3 {0.00/25 1.7s} 38. Rh1 {+0.19/21 1.2s} h4 {0.00/26 0.80s} 39. Ke2 {+0.12/20 0.98s} Rc7 {0.00/26 1.9s} 40. Nc6 {+0.22/20 4.2s} Nxb5 {0.00/25 3.8s} 41. Bd4 {+0.14/20 6.1s} Bxf4 {0.00/23 4.8s} 42. Bf6 {0.00/19 4.2s} Rh7 {+0.16/20 3.2s} 43. Rf1 {0.00/20 2.2s} Kf7 {+0.09/21 2.7s} 44. Be7 {0.00/22 2.5s} Bh2 {+0.40/17 1.5s} 45. Rxf5+ {-0.07/17 1.9s} Ke8 {+0.27/18 0.49s} 46. Rf8+ {-0.07/19 1.4s} Kd7 {+0.33/1 0s} 47. Rd8+ {-0.03/20 1.9s} Kc7 {+0.33/1 0s} 48. Rg8 {0.00/20 2.3s} Nd6 {+0.04/20 9.9s} 49. Bg5 {0.00/19 2.7s} Kb7 {+0.42/16 1.2s} 50. Rg6 {0.00/20 1.7s} a5 {+0.11/18 3.5s} 51. Nd4 {0.00/20 1.6s} a4 {0.00/19 3.4s} 52. Be3 {0.00/18 2.1s} h3 {+0.13/20 1.5s} 53. gxh3 {0.00/21 1.6s} Rxh3 {0.00/16 0.44s} 54. Rg7+ {0.00/22 1.9s} Ka6 {+0.30/19 1.6s} 55. Rg8 {0.00/21 0.91s} Be5 {+0.27/20 2.6s} 56. Nc6 {0.00/21 1.3s} Rh2+ {+0.21/17 0.37s} 57. Kd1 {-0.07/22 5.9s} Rh8 {+0.51/20 1.3s} 58. Nb4+ {-0.15/18 4.8s} Kb5 {+0.59/20 2.4s} 59. Rxh8 {-0.22/19 0.91s} Bxh8 {+0.49/20 0.92s} 60. Nc2 {-0.19/21 2.4s} Nf5 {+0.77/22 1.3s} 61. Bf2 {-0.34/19 1.3s} Ka6 {+0.67/21 0.51s} 62. Ke2 {-0.51/18 0.81s} b5 {+1.20/21 1.4s} 63. Bc5 {-0.62/21 2.9s} Be5 {+0.97/20 0.39s} 64. Ne3 {-0.77/20 1.8s} Nh6 {+1.00/23 2.1s} 65. Nc2 {-0.56/23 1.3s} Ng4 {+1.09/23 0.97s} 66. Nd4 {-0.79/23 4.4s} Bh2 {+0.97/27 8.6s} 67. d6 {-0.76/21 1.4s} Nf6 {+1.25/25 1.5s} 68. Ne6 {-0.80/22 1.1s} Nd7 {+1.23/25 0.69s} 69. Ba3 {-0.80/22 1.3s} Bg1 {+1.40/24 0.84s} 70. Nc7+ {-0.92/21 0.89s} Kb6 {+1.40/27 0.71s} 71. Nd5+ {-0.95/22 0.91s} Kb7 {+1.27/30 2.1s} 72. Ne7 {-0.99/23 0.86s} Nf6 {+1.40/26 0.88s} 73. Kf1 {-0.92/20 0.66s} Be3 {+1.33/29 1.9s} 74. Ke2 {-0.94/21 0.81s} Bg5 {+1.25/30 1.9s} 75. Nf5 {-0.97/22 1.1s} Bf4 {+1.25/30 1.4s} 76. Nd4 {-0.78/26 1.8s} Kb6 {+1.25/30 1.6s} 77. Ne6 {-0.85/26 1.5s} Bh6 {+1.24/29 1.6s} 78. Kd1 {-0.86/25 1.6s} Nd7 {+1.24/33 3.0s} 79. Ke2 {-0.86/27 0.81s} Bc1 {+1.24/32 2.1s} 80. Kd1 {-0.81/24 0.67s} Be3 {+1.18/31 0.79s} 81. Ke2 {-0.93/28 3.6s} Bh6 {+1.18/35 3.8s} 82. Kd1 {-0.73/28 5.3s} Nf6 {+0.76/30 6.3s} 83. Ke2 {-0.87/27 3.0s} Kb7 {+0.89/29 1.4s} 84. Nd4 {-0.94/27 6.2s} Ka6 {+0.71/31 4.6s} 85. Nf5 {-0.88/27 2.1s} Bf4 {+1.18/29 1.3s} 86. Ng7 {-0.85/24 1.4s} Bc1 {+1.24/28 3.0s} 87. Ne8 {-0.54/23 1.0s} Nd7 {+0.58/29 6.5s} 88. Nc7+ {-0.66/25 1.0s} Kb6 {+0.56/25 0.55s} 89. Kd1 {-0.73/25 1.3s} Bg5 {+0.83/28 1.4s} 90. Ne6 {-0.64/26 2.0s} Bh4 {+0.75/27 0.41s} 91. Ke2 {-0.52/24 1.1s} Bg3 {+0.57/29 3.5s} 92. Ke3 {-0.64/25 3.2s} Nf6 {+0.42/26 0.48s} 93. Nd4 {-0.46/24 1.9s} Be5 {+0.36/28 2.9s} 94. Nf5 {-0.48/26 2.1s} Kc6 {+0.84/27 0.49s} 95. Nd4+ {-0.51/25 0.88s} Bxd4+ {+0.98/28 1.5s} 96. Kxd4 {-0.50/25 0.62s} e3 {+0.48/26 0.49s} 97. Kxe3 {-0.58/26 1.3s} Ne8 {+0.35/28 2.6s} 98. d7 {-0.54/30 1.6s} Kxd7 {+0.35/26 0.33s} 99. Kd4 {-0.58/27 1.0s} Kc6 {+0.44/27 1.4s} 100. Bb4 {-0.54/29 0.78s} Nc7 {+0.79/29 1.1s} 101. Be7 {-0.57/28 0.86s} Ne6+ {+0.79/29 0.35s} 102. Ke5 {-0.54/28 0.72s} Nc5 {+0.79/34 1.8s} 103. Kd4 {-0.50/26 0.84s} Nd3 {+0.79/34 0.38s} 104. Ba3 {-0.64/27 0.87s} Nf4 {+0.79/37 1.8s} 105. Ke5 {-0.52/29 1.2s} Ne2 {+0.79/34 1.8s} 106. Be7 {-0.51/28 1.7s} Kb6 {+0.79/33 0.82s} 107. Ba3 {-0.38/32 2.4s} Nc1 {+0.79/38 1.6s} 108. Kd5 {-0.50/27 1.5s} Kb7 {+0.79/39 0.56s} 109. Kd6 {-0.45/30 1.1s} Nd3 {+0.79/42 2.9s} 110. Kd5 {-0.45/30 0.99s} Kc7 {+0.79/41 0.52s} 111. Bd6+ {-0.40/30 1.1s} Kb6 {+0.79/37 2.1s} 112. Ba3 {-0.40/32 1.5s} Ka5 {+0.79/40 2.1s} 113. Kc6 {-0.47/30 1.4s} Ka6 {+0.79/40 2.4s} 114. Kd5 {-0.40/31 1.4s} Ne1 {+0.79/40 1.1s} 115. Kc5 {-0.12/34 4.2s} Nc2 {+9.92/29 1.8s} 116. Bb4 {-0.12/35 2.2s} Ne3 {+0.10/36 3.9s} 117. Ba3 {-0.12/33 1.6s} Nd1 {+0.10/40 1.8s} 118. Kd5 {-0.12/35 2.1s} Kb6 {+0.25/28 1.4s} 119. Bc5+ {-0.12/34 2.2s} Kb7 {+0.10/41 4.9s} 120. Ba3 {-0.12/35 2.0s} Ka6 {+0.10/44 3.1s} 121. Kc6 {-0.12/35 3.3s} Nf2 {+0.10/43 1.3s} 122. Kc5 {-0.12/34 1.9s} Nh3 {+0.10/43 3.1s} 123. Kd5 {-0.12/32 1.4s} Ng5 {+0.10/43 3.0s} 124. Kd6 {-0.11/32 1.8s} Kb6 {+0.03/44 14s} 125. Bc5+ {-0.16/32 1.5s} Kb7 {+0.03/44 4.6s} 126. Kd5 {-0.15/35 4.1s} Nf7 {+0.03/36 1.9s} 127. Bb4 {-0.16/34 3.0s} Nh8 {0.00/35 2.6s} 128. Kc5 {-0.17/33 6.0s} Ka6 {0.00/39 0.39s} 129. Kc6 {-0.07/35 3.2s} Ng6 {0.00/44 1.8s} 130. Ba3 {-0.06/34 1.8s} Nf4 {0.00/43 1.6s} 131. Kc5 {0.00/34 1.5s} Ka5 {0.00/45 2.1s} 132. Bb4+ {0.00/46 3.5s} Ka6 {0.00/1 0s} 133. Ba3 {0.00/34 0.78s} Ka5 {0.00/47 3.3s} 134. Bb4+ {0.00/50 3.9s} Ka6 {0.00/1 0s} 135. Ba3 {0.00/55 3.2s, Draw by 3-fold repetition} 1/2-1/2[/pgn]
Whoops, a bug.

4. Drop in score (horizon effects mostly)
[pgn][Event ""]
[Site ""]
[Date "2020.02.04"]
[Round "982"]
[White "Komodo_10"]
[Black "Stockfish_8"]
[Result "1-0"]
[BlackElo ""]
[WhiteElo ""]

{Drop in score of 3.39 (0.46 to -2.93) for Stockfish_8 in game 982 during moves 30-31, game lost
}1. d4 {book} Nf6 {book} 2. c4 {book} g6 {book} 3. Nc3 {book} Bg7 {book} 4. e4 {book} O-O {book} 5. f3 {book} d6 {book} 6. Be3 {book} Nc6 {book} 7. Qd2 {book} Re8 {book} 8. O-O-O {book} a6 {book} 9. Kb1 {+0.56/16 1.3s} Bd7 {-0.65/19 6.0s} 10. h4 {+0.44/17 2.7s} h5 {-0.66/20 1.7s} 11. Nh3 {+0.46/21 2.0s} e5 {-0.58/21 1.6s} 12. d5 {+0.59/22 6.1s} Nd4 {-0.69/19 0.52s} 13. Ne2 {+0.59/21 2.3s} Bxh3 {-0.88/21 3.6s} 14. Rxh3 {+0.48/17 0.95s} Nd7 {-0.90/19 0.34s} 15. Nxd4 {+0.61/21 3.8s} exd4 {-1.00/22 3.0s} 16. Bxd4 {+0.62/22 1.6s} Bxd4 {-0.88/20 0.59s} 17. Qxd4 {+0.55/23 1.4s} Qe7 {-0.89/22 6.0s} 18. Bd3 {+0.55/19 3.7s} Rab8 {-0.89/19 3.7s} 19. Rd2 {+0.55/17 2.6s} Ne5 {-0.86/19 1.8s} 20. Bc2 {+0.63/17 1.1s} Qf6 {-0.59/18 3.2s} 21. c5 {+0.65/18 2.3s} dxc5 {-0.72/21 13s} 22. Qxc5 {+0.91/16 1.1s} b5 {-0.77/20 2.5s} 23. Qc3 {+0.67/17 3.2s} Rbc8 {-0.53/17 1.3s} 24. Rh1 {+0.79/18 3.6s} c6 {-0.28/18 0.86s} 25. d6 {+0.73/19 1.5s} Rcd8 {-0.45/21 2.8s} 26. Rhd1 {+0.44/18 2.5s} Qxh4 {-0.31/21 1.8s} 27. b3 {+0.49/17 2.1s} Qg5 {0.00/19 1.0s} 28. Rf1 {+0.45/19 5.4s} Qf4 {+0.31/19 1.7s} 29. Rdd1 {+0.33/18 4.8s} Re6 {+0.45/19 0.86s} 30. Qc5 {+0.65/17 0.96s} g5 {+0.46/18 1.8s} 31. g3 {+2.30/16 0.82s} Qf6 {-2.93/22 8.2s} 32. f4 {+2.29/17 0.70s} Rexd6 {-3.10/22 2.5s} 33. fxe5 {+2.63/17 1.3s} Rxd1+ {-2.86/15 0.43s} 34. Rxd1 {+2.67/18 1.1s} Rxd1+ {-2.90/15 0.18s} 35. Bxd1 {+2.67/19 1.8s} Qg6 {-2.88/18 1.6s} 36. Bc2 {+2.46/19 6.1s} h4 {-2.39/15 0.54s} 37. e6 {+2.36/16 0.68s} fxe6 {-2.19/14 0.24s} 38. Qxc6 {+2.54/18 2.5s} h3 {-2.63/20 2.4s} 39. e5 {+2.43/19 2.7s} Qf7 {-2.68/22 1.9s} 40. Qxa6 {+3.38/19 3.1s} h2 {-2.75/21 0.55s} 41. Qa8+ {+2.96/24 4.0s} Kg7 {-3.04/29 5.3s} 42. Qg2 {+3.51/22 2.6s} Qh5 {-3.04/30 1.3s} 43. Qh1 {+3.42/25 3.3s} g4 {-3.06/22 3.1s} 44. Bd3 {+3.20/23 1.9s} Qh3 {-2.20/23 3.7s} 45. Qb7+ {+3.04/24 6.8s} Kf8 {-2.27/22 0.48s} 46. Qc8+ {+3.04/26 2.9s} Kg7 {-2.37/24 5.8s} 47. Qd7+ {+2.86/25 3.5s} Kf8 {-2.27/21 0.75s} 48. Qd8+ {+2.83/26 6.8s} Kg7 {-2.23/23 3.6s} 49. Qf6+ {+2.80/24 2.6s} Kg8 {-2.23/1 0s} 50. Qxe6+ {+2.92/24 2.2s} Kg7 {-2.52/23 6.2s} 51. Qd7+ {+2.77/22 1.8s} Kf8 {-2.28/23 1.5s} 52. Qd6+ {+2.77/23 2.9s} Kg7 {-2.39/23 3.3s} 53. Qf6+ {+2.77/23 2.0s} Kg8 {-2.39/1 0s} 54. Qd8+ {+2.83/22 1.7s} Kg7 {-2.29/20 2.0s} 55. Qc7+ {+2.77/23 1.7s} Kg8 {-2.09/22 5.5s} 56. Qb8+ {+2.81/23 2.2s} Kg7 {-2.08/23 8.8s} 57. Qb7+ {+2.91/22 1.1s} Kf8 {-2.06/20 0.48s} 58. Qa8+ {+2.74/21 1.4s} Kg7 {-1.54/22 9.2s} 59. Qh1 {+1.74/19 2.0s} Qxg3 {-1.28/20 0.77s} 60. Qb7+ {+1.80/19 0.90s} Kf8 {-1.35/17 0.23s} 61. Qa8+ {+1.85/19 0.98s} Kg7 {-0.60/16 0.50s} 62. Qa7+ {+1.68/20 0.93s} Kg8 {-2.21/21 0.77s} 63. Qh7+ {+1.63/19 1.1s} Kf8 {-2.21/1 0s} 64. Qf5+ {+1.65/19 0.80s} Kg7 {-2.18/21 1.3s} 65. Be4 {+1.77/21 2.7s} Qe1+ {-2.18/20 1.2s} 66. Kc2 {+1.94/17 0.44s} Qe2+ {-2.11/20 0.31s} 67. Kc3 {+1.96/19 0.47s} Qe1+ {-2.18/21 2.1s} 68. Kd3 {+1.86/19 0.64s} Qd1+ {-2.47/18 2.2s} 69. Ke3 {+1.72/19 0.59s} Qe1+ {-2.36/15 0.20s} 70. Kf4 {+1.81/21 1.8s} Qc1+ {-2.68/18 1.5s} 71. Kxg4 {+1.78/21 1.3s} Qg1+ {-2.70/15 0.16s} 72. Kh5 {+2.30/19 0.90s} h1=Q+ {-2.70/18 1.1s} 73. Bxh1 {+2.24/19 0.69s} Qxh1+ {-2.70/19 0.40s} 74. Kg5 {+2.28/19 0.82s} Qh6+ {-2.53/17 1.2s} 75. Kg4 {+2.28/5 0s} Qc6 {-2.72/17 0.67s} 76. Qf6+ {+9.07/29 1.4s} Qxf6 {-M52/32 1.3s} 77. exf6+ {+9.67/29 0.65s} Kxf6 {-M50/32 0.66s} 78. Kf4 {+M55/34 1.3s} Ke6 {-M48/33 0.15s} 79. Ke4 {+M53/33 0.26s} Kd6 {-M46/36 2.3s} 80. Kd4 {+M51/33 0.87s} b4 {-M46/24 1.2s, White wins by adjudication} 1-0[/pgn]

5. Double opening detector

Code: Select all

1. e4 {book} e6 {book} 2. d4 {book} d5 {book} 3. e5 {book} c5 {book}
4. c3 {book} Nc6 {book} 5. Nf3 {book} Bd7 {book} 6. Be2 {book} f6 {book}
7. O-O {book} Qc7 {book} 8. Re1 {book} O-O-O {book} 9. Bb5 {+0.54/17 7.5s}

and:

Code: Select all

1. e4 {book} e6 {book} 2. d4 {book} d5 {book} 3. e5 {book} c5 {book}
4. c3 {book} Nc6 {book} 5. Nf3 {book} f6 {book} 6. Bd3 {book} Qc7 {book}
7. O-O {book} Bd7 {book} 8. Re1 {book} O-O-O {book} 9. Bb5 {+0.61/17 7.3s}

end in the same start position at move 9.

6. Lost games analysis
This option tries to find the moment where an engine starts to lose, it's not perfect but valuable it is.
[pgn][Event ""]
[Site ""]
[Date "2020.02.04"]
[Round "3"]
[White "Stockfish_8"]
[Black "Komodo_10"]
[Result "1-0"]
[BlackElo ""]
[WhiteElo ""]

{Game 3 Stockfish_8 - Komodo_10 1-0
37...Rg8 -0.29 38...Bd6 -1.22 39...Be5 -1.37 40...c5 -1.65}
1. e4 {book} e5 {book} 2. Nf3 {book} Nc6 {book} 3. Bb5 {book} a6 {book} 4. Bxc6 {book} dxc6 {book} 5. O-O {book} Bg4 {book} 6. d3 {book} Bd6 {book} 7. Be3 {book} Nf6 {book} 8. Nbd2 {book} Qe7 {book} 9. h3 {+0.26/17 3.3s} Be6 {-0.08/16 1.6s} 10. c3 {+0.31/20 3.2s} O-O {-0.07/17 2.4s} 11. d4 {+0.36/18 1.9s} exd4 {-0.10/19 5.6s} 12. cxd4 {+0.20/18 3.4s} Nd7 {0.00/20 6.9s} 13. Re1 {+0.22/19 6.4s} f6 {0.00/16 1.8s} 14. Nh4 {+0.28/19 2.2s} Rae8 {+0.22/17 5.0s} 15. f4 {+0.26/20 5.0s} Kh8 {+0.12/17 3.1s} 16. Nhf3 {+0.46/16 1.4s} g6 {0.00/16 1.8s} 17. Rc1 {+0.49/17 3.4s} Kg7 {0.00/17 4.0s} 18. a3 {+0.62/16 1.9s} Qd8 {-0.20/18 3.6s} 19. Qc2 {+0.66/17 3.4s} Kh8 {-0.15/18 4.4s} 20. Re2 {+0.60/18 2.1s} Qb8 {-0.03/16 2.9s} 21. g4 {+0.70/17 1.9s} Bf7 {-0.07/16 2.9s} 22. Rce1 {+0.70/17 2.5s} Be7 {-0.08/17 1.3s} 23. Bf2 {+0.83/16 2.4s} Qd8 {-0.06/16 1.7s} 24. Bg3 {+0.98/17 4.2s} Nb6 {-0.16/15 1.3s} 25. Nb3 {+0.86/18 4.3s} Qc8 {-0.23/16 2.2s} 26. Nc5 {+0.98/15 1.1s} Bc4 {-0.24/17 3.2s} 27. Rh2 {+1.02/18 2.2s} Bf7 {-0.14/17 4.5s} 28. Qc3 {+1.08/17 6.0s} Nc4 {-0.24/15 4.0s} 29. a4 {+1.10/16 3.1s} b6 {-0.21/14 1.6s} 30. Nd3 {+1.01/16 1.9s} Qd8 {-0.29/14 2.6s} 31. Bh4 {+1.14/14 0.59s} h6 {-0.21/14 1.7s} 32. f5 {+1.70/16 1.7s} gxf5 {-0.76/14 1.6s} 33. exf5 {+1.48/18 2.7s} Kh7 {-1.06/14 1.3s} 34. b3 {+1.43/18 1.1s} Na5 {-0.47/14 0.65s} 35. b4 {+1.02/17 0.38s} Nc4 {-0.50/15 0.89s} 36. Rhe2 {+1.19/17 1.7s} b5 {-0.44/15 0.80s} 37. Nf4 {+1.35/15 0.64s} Rg8 {-0.29/15 0.92s} 38. Ng6 {+2.12/16 0.95s} Bd6 {-1.22/13 0.80s} 39. Nfe5 {+1.97/16 0.29s} Bxe5 {-1.37/14 0.83s} 40. dxe5 {+2.43/17 1.1s} c5 {-1.65/14 0.85s} 41. Qc2 {+3.07/19 5.9s} cxb4 {-2.14/17 6.6s} 42. Rd1 {+3.66/20 9.3s} b3 {-2.31/18 7.9s} 43. Qb1 {+3.69/17 0.85s} Nd6 {-2.18/18 3.4s} 44. Nf4 {+4.17/18 1.9s} Bc4 {-2.64/14 4.1s} 45. Bxf6 {+4.34/18 1.3s} Qb8 {-3.11/16 3.3s} 46. Rf2 {+4.66/17 1.2s} bxa4 {-3.98/16 3.4s} 47. exd6 {+4.93/17 0.38s} cxd6 {-4.79/19 4.3s} 48. Be7 {+4.95/20 2.0s} Bf7 {-4.01/15 1.8s} 49. Nd5 {+5.13/19 0.42s} Qa7 {-4.08/17 4.3s} 50. Nf6+ {+5.24/19 1.8s} Kg7 {-4.19/17 1.8s} 51. Ne4 {+5.01/19 0.55s} Kh7 {-3.60/16 1.6s} 52. Bxd6 {+5.45/20 1.6s} Rc8 {-4.09/18 2.4s} 53. Qa1 {+6.32/17 1.5s} Rc2 {-4.67/17 1.3s} 54. Qe5 {+8.62/21 1.6s} b2 {-5.93/17 2.0s} 55. Nf6+ {+10.36/19 0.71s} Kh8 {-6.35/17 0.39s} 56. Nxg8+ {+11.97/21 1.5s} Kxg8 {-7.82/18 0.70s} 57. Bc5 {+12.71/21 0.94s} Rc1 {-9.24/19 1.7s} 58. Kh2 {+13.22/21 1.7s} Rxd1 {-9.38/19 1.2s} 59. Rxb2 {+14.17/18 0.36s} a3 {-9.84/18 1.8s} 60. Rb8+ {+M21/25 1.2s} Qxb8 {-10.85/17 0.70s} 61. Qxb8+ {+M19/27 0.43s} Kh7 {-M24/17 0.43s, White wins by adjudication} 1-0[/pgn]

Rebel · Post by **Rebel** » Mon Feb 10, 2020 12:17 pm

MRI output of a 1000 game match between Stockfish 8 and Komodo 10 at 40/80.

http://rebel13.nl/output.htm

Ratosh · Post by **Ratosh** » Tue Feb 11, 2020 9:32 pm

Great tool! Some things i would like to see:
Report:

Window for`Drop` (able to find X score drop in Y plies).
Show FEN positions in html report (easier to see/copy the FEN).
Phase overview in functions (Like the phase overview, but for functions - e.g. number of score drops per phase)

Functions:

Reverse games with different outcome (Show first diverged move and score).

Really like pgn output files.

Leo · Post by **Leo** » Tue Feb 11, 2020 9:49 pm

Looks interesting and useful.

Dann Corbit · Post by **Dann Corbit** » Tue Feb 11, 2020 10:08 pm

Suggestion:
Emit fully decorated EPD (with all the analysis from the logs) for any of the unusual data points found (inverted score, sudden drop, etc.)
It would be useful for building test suites that are tuned to an engines specific problems.

Rebel · Post by **Rebel** » Wed Feb 12, 2020 12:53 am

Ratosh wrote: ↑Tue Feb 11, 2020 9:32 pm Great tool! Some things i would like to see:
Report:

Window for`Drop` (able to find X score drop in Y plies).

Click on view, ir's all in the created PGN.

Ratosh wrote: ↑Tue Feb 11, 2020 9:32 pm [*]Show FEN positions in html report (easier to see/copy the FEN)

Makes sense.

Ratosh wrote: ↑Tue Feb 11, 2020 9:32 pm [*]Phase overview in functions (Like the phase overview, but for functions - e.g. number of score drops per phase)
[/list]

I rewrote the Phase Overview, an example of a match when developng Benjamin against Fruit 2.3

Code: Select all

Phase          Won Games (numbers)           Late Endgame           Match
Overview       MIDG END1 END2 END3      QUEEN ROOK LIGHT PAWN       Score
Fruit 2.3      1065   56  699  281         24   79    62    4   2724.5 (54.5%)
Benjamin        991   24  458  184         21   48    39    2   2275.5 (45.5%)

Phase              Won games %               Late Endgame           Match
Overview       MIDG END1 END2 END3      QUEEN ROOK LIGHT PAWN       Score
Fruit 2.3      51.8 70.0 60.4 60.4       53.3 62.2  61.4 66.7   2724.5 (54.5%)
Benjamin       48.2 30.0 39.6 39.6       46.7 37.8  38.6 33.3   2275.5 (45.5%)

Depths         MIDG END1 END2 END3     BOOK             TIME
Benjamin       11.5 12.0 13.6 15.3     8.0 (moves)      0:00
Fruit 2.3      11.6 12.1 15.8 18.7     8.0 (moves)      0:00

What immediately springs in mind is Benjamin's weak point, the endgame and looking at the depths it's likely outsearched.

Ratosh wrote: ↑Tue Feb 11, 2020 9:32 pm Functions:

Reverse games with different outcome (Show first diverged move and score).

Nice idea, I am afraid that list will be long.

Ratosh wrote: ↑Tue Feb 11, 2020 9:32 pm Really like pgn output files.

Thank you.

Rebel · Post by **Rebel** » Wed Feb 12, 2020 12:56 am

Dann Corbit wrote: ↑Tue Feb 11, 2020 10:08 pm Suggestion:
Emit fully decorated EPD (with all the analysis from the logs) for any of the unusual data points found (inverted score, sudden drop, etc.)
It would be useful for building test suites that are tuned to an engines specific problems.

Will do.

Ferdy · Post by **Ferdy** » Wed Feb 12, 2020 9:59 am

Rebel wrote: ↑Mon Feb 10, 2020 12:10 pm 6. Lost games analysis

All good, and I like that feature, showing the fen where it first made a suboptimal move.
Two things:
1. A single blunder that cost the game
2. An initial small mistake that leads to defeat

Guenther · Post by **Guenther** » Wed Feb 12, 2020 10:27 am

Ratosh wrote: ↑Tue Feb 11, 2020 9:32 pm Great tool! Some things i would like to see:
Report:

Window for`Drop` (able to find X score drop in Y plies).

Show FEN positions in html report (easier to see/copy the FEN).

...

The two points above exist already in Toms Game Analyser and it even has a GUI and eval graphs.

http://talkchess.com/forum3/viewtopic.p ... er#p750330
http://talkchess.com/forum3/viewtopic.p ... e+analyser

Guenther · Post by **Guenther** » Wed Feb 12, 2020 10:47 am

Rebel wrote: ↑Mon Feb 10, 2020 12:10 pm MRI (Match Result Inspector) is a tool to extract valuable information from a PGN engine-engine match provided the PGN output is created by ChessBase, Cutechess or Arena.

It's currently in alpha stage (not downloadable yet) and I prefer some feedback for improvements, more ideas before a beta release.

...

Functions:
...
3. Games that should have been won
...

The title of 3. is a bit missleading, a part of the games are actually not won, but missevaluated, so there never was a win, but a fata morgana.
The example in your post, might be even worse, a problem on the user side, also indicated by an incomprehensible sudden depth loss.
(ofc I wont rule out completely a hash bug in SF8)

Strange low depths single outsiders would be an interesting thing to find anyway ;-)
(do this since long with some stats sheets to sanity check pgn files found in talkchess from time to time)

[d]8/8/k7/1pK5/p1p5/B1P5/1P6/4n3 b - - 33 115

Code: Select all

115... Nc2 +9.92/29

It is impossible for me to reproduce that incredible score with SF8.
Neither with 5men Syzygy nor with no TBS at all. The score is always between 0.17 and 0.33 for all depths up to 60.

MRI - Match Result Inspector

MRI - Match Result Inspector

Re: MRI - Match Result Inspector

Re: MRI - Match Result Inspector

Re: MRI - Match Result Inspector

Re: MRI - Match Result Inspector

Re: MRI - Match Result Inspector

Re: MRI - Match Result Inspector

Re: MRI - Match Result Inspector

Re: MRI - Match Result Inspector

Re: MRI - Match Result Inspector