MRI - Match Result Inspector

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Dann Corbit
Posts: 12537
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: MRI - Match Result Inspector

Post by Dann Corbit »

Guenther wrote: Wed Feb 12, 2020 10:27 am
Ratosh wrote: Tue Feb 11, 2020 9:32 pm Great tool! Some things i would like to see:
Report:
  • Window for`Drop` (able to find X score drop in Y plies).
  • Show FEN positions in html report (easier to see/copy the FEN).

    ...
The two points above exist already in Toms Game Analyser and it even has a GUI and eval graphs.

http://talkchess.com/forum3/viewtopic.p ... er#p750330
http://talkchess.com/forum3/viewtopic.p ... e+analyser
Tom's game analyzer does not work with as many formats. But the graph feature is nice,
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
User avatar
Guenther
Posts: 4605
Joined: Wed Oct 01, 2008 6:33 am
Location: Regensburg, Germany
Full name: Guenther Simon

Re: MRI - Match Result Inspector

Post by Guenther »

Dann Corbit wrote: Wed Feb 12, 2020 6:22 pm
Guenther wrote: Wed Feb 12, 2020 10:27 am
Ratosh wrote: Tue Feb 11, 2020 9:32 pm Great tool! Some things i would like to see:
Report:
  • Window for`Drop` (able to find X score drop in Y plies).
  • Show FEN positions in html report (easier to see/copy the FEN).

    ...
The two points above exist already in Toms Game Analyser and it even has a GUI and eval graphs.

http://talkchess.com/forum3/viewtopic.p ... er#p750330
http://talkchess.com/forum3/viewtopic.p ... e+analyser
Tom's game analyzer does not work with as many formats. But the graph feature is nice,
It does easily with wb/banksia/cutechess/cute-cli/arena pgns with simple regex one second search+ replace.
(only CB and probably ChessGUI pgn would require a little bit more work)
https://rwbc-chess.de

trollwatch:
Chessqueen + chessica + AlexChess + Eduard + Sylwy
Dann Corbit
Posts: 12537
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: MRI - Match Result Inspector

Post by Dann Corbit »

Guenther wrote: Wed Feb 12, 2020 6:56 pm
Dann Corbit wrote: Wed Feb 12, 2020 6:22 pm
Guenther wrote: Wed Feb 12, 2020 10:27 am
Ratosh wrote: Tue Feb 11, 2020 9:32 pm Great tool! Some things i would like to see:
Report:
  • Window for`Drop` (able to find X score drop in Y plies).
  • Show FEN positions in html report (easier to see/copy the FEN).

    ...
The two points above exist already in Toms Game Analyser and it even has a GUI and eval graphs.

http://talkchess.com/forum3/viewtopic.p ... er#p750330
http://talkchess.com/forum3/viewtopic.p ... e+analyser
Tom's game analyzer does not work with as many formats. But the graph feature is nice,
It does easily with wb/banksia/cutechess/cute-cli/arena pgns with simple regex one second search+ replace.
(only CB and probably ChessGUI pgn would require a little bit more work)
It sounds convenient unless you have 500 files you want to process.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
Ratosh
Posts: 77
Joined: Mon Apr 16, 2018 6:56 pm

Re: MRI - Match Result Inspector

Post by Ratosh »

Does Score Drop detect drops in more than 1 ply? I wanted to be able to set the ply window to detect the drop.
User avatar
Guenther
Posts: 4605
Joined: Wed Oct 01, 2008 6:33 am
Location: Regensburg, Germany
Full name: Guenther Simon

Re: MRI - Match Result Inspector

Post by Guenther »

Ratosh wrote: Wed Feb 12, 2020 8:43 pm Does Score Drop detect drops in more than 1 ply? I wanted to be able to set the ply window to detect the drop.
Well, Toms Game Analyser does this too...
Image
https://rwbc-chess.de

trollwatch:
Chessqueen + chessica + AlexChess + Eduard + Sylwy
User avatar
Rebel
Posts: 6991
Joined: Thu Aug 18, 2011 12:04 pm

Re: MRI - Match Result Inspector

Post by Rebel »

UPDATE

Match SF11 vs Lc0 (various versions) taken from "fastgm" 16 cpu tournament, 2500 games.

http://rebel13.nl/output.htm

Main change, added EPD in html and in files.

Code: Select all

 Processed games         : 2500          All.epd                 : 38
 Suspect_openings.pgn    : 1             Suspect_openings.epd    : 1
 Crazy_games.pgn         : 9             Crazy_games.epd         : 9
 Possible_missed_wins.pgn: 20            Possible_missed_wins.epd: 20
 Drop_in_score.pgn       : 8             Drop_in_score.epd       : 8
 Lost_games.pgn          : 0             Lost_games.epd          : 0
PGN''s and EPD's attached.

I guess this addresses most of the raised issues for the moment.

Interesting to see Stockfish being superior in the mid-game while Lc0 is on par in the endgame, I expected it the other way around. Ha! what do I know about computer chess.
90% of coding is debugging, the other 10% is writing bugs.
User avatar
Rebel
Posts: 6991
Joined: Thu Aug 18, 2011 12:04 pm

Re: MRI - Match Result Inspector

Post by Rebel »

Guenther wrote: Wed Feb 12, 2020 10:47 am [d]8/8/k7/1pK5/p1p5/B1P5/1P6/4n3 b - - 33 115

Code: Select all

115... Nc2 +9.92/29
It is impossible for me to reproduce that incredible score with SF8.
Neither with 5men Syzygy nor with no TBS at all. The score is always between 0.17 and 0.33 for all depths up to 60.
Even Stockfish has bugs.
90% of coding is debugging, the other 10% is writing bugs.
User avatar
Rebel
Posts: 6991
Joined: Thu Aug 18, 2011 12:04 pm

Re: MRI - Match Result Inspector

Post by Rebel »

[Event "CCRL 40/15"]
[Site "CCRL"]
[Date "2020.01.19"]
[Round "703.2.691"]
[White "Komodo 13.2.5 MCTS 64-bit"]
[Black "Stockfish 11 64-bit"]
[Result "1/2-1/2"]
[ECO "B06"]
[Opening "Robatsch defence"]
[PlyCount "148"]
[WhiteElo "3282"]
[BlackElo "3432"]

1. e4 {+0.00/1 0s} g6 {+0.00/1 0s} 2. d4 {+0.00/1 0s} Bg7 {+0.00/1 0s} 3. Nc3
{+0.00/1 0s} c6 {+0.00/1 0s} 4. Be3 {+0.00/1 0s} Qb6 {+0.00/1 0s} 5. Qd2
{+0.73/13 34s} Qxb2 {(d6) -0.07/28 37s} 6. Rb1 {(Rb1) +0.28/11 24s} Qa3 {(Qa3)
+0.00/28 19s} 7. h4 {(Nf3) +0.39/11 34s} h5 {(Nf6) +0.10/27 44s} 8. e5 {(e5)

---------

Can someone tell me which interface produces this kind of PGN?

And about the move comment:

6. Rb1 {(Rb1) +0.28/11 24s}
7. h4 {(Nf3) +0.39/11 34s}

What does the move (Rb1 / Nf3) mean in the move comment?
90% of coding is debugging, the other 10% is writing bugs.
User avatar
Guenther
Posts: 4605
Joined: Wed Oct 01, 2008 6:33 am
Location: Regensburg, Germany
Full name: Guenther Simon

Re: MRI - Match Result Inspector

Post by Guenther »

Rebel wrote: Thu Feb 13, 2020 4:19 pm
Guenther wrote: Wed Feb 12, 2020 10:47 am [d]8/8/k7/1pK5/p1p5/B1P5/1P6/4n3 b - - 33 115

Code: Select all

115... Nc2 +9.92/29
It is impossible for me to reproduce that incredible score with SF8.
Neither with 5men Syzygy nor with no TBS at all. The score is always between 0.17 and 0.33 for all depths up to 60.
Even Stockfish has bugs.
Of course, but we don't know, if it was an SF bug in this case.
Anyhow, you adressed the point given and renamed that category to 'possible missed win' I see ;-)
https://rwbc-chess.de

trollwatch:
Chessqueen + chessica + AlexChess + Eduard + Sylwy
User avatar
Rebel
Posts: 6991
Joined: Thu Aug 18, 2011 12:04 pm

Re: MRI - Match Result Inspector

Post by Rebel »

Guenther wrote: Thu Feb 13, 2020 5:25 pm
Rebel wrote: Thu Feb 13, 2020 4:19 pm
Guenther wrote: Wed Feb 12, 2020 10:47 am [d]8/8/k7/1pK5/p1p5/B1P5/1P6/4n3 b - - 33 115

Code: Select all

115... Nc2 +9.92/29
It is impossible for me to reproduce that incredible score with SF8.
Neither with 5men Syzygy nor with no TBS at all. The score is always between 0.17 and 0.33 for all depths up to 60.
Even Stockfish has bugs.
Of course, but we don't know, if it was an SF bug in this case.
The alternative would be cutechess, unlikely.
Anyhow, you adressed the point given and renamed that category to 'possible missed win' I see ;-)
Sure, I asked for feedback :wink:
90% of coding is debugging, the other 10% is writing bugs.