Discussion of computer chess matches and engine tournaments.
Moderators: hgm, Rebel, chrisw
-
majortom
- Posts: 669
- Joined: Mon Nov 04, 2013 10:19 pm
Post
by majortom »
Code: Select all
# PLAYER : RATING ERROR POINTS PLAYED (%)
1 Stockfish 130418 D30 : 1077.6 178.9 97.0 100 97
2 Stockfish 130418 D15 : 467.8 68.9 551.5 700 79
3 LC0 173_101eeb41 N4k : 105.3 85.0 22.5 200 11
4 LC0 173_101eeb41 N2k : 39.2 96.5 16.0 200 8
5 LC0 173_101eeb41 N1k : 0.0 ---- 13.0 200 7
White advantage = 15.53 +/- 14.63
Draw rate (equal opponents) = 50.00 % +/- 0.00
-
majortom
- Posts: 669
- Joined: Mon Nov 04, 2013 10:19 pm
Post
by majortom »
Small update:
Code: Select all
# PLAYER : RATING ERROR POINTS PLAYED (%)
1 Stockfish 130418 D30 : 1096.6 153.6 134.0 138 97
2 Stockfish 130418 D15 : 473.9 64.2 629.0 826 76
3 LC0 173_101eeb41 N16k : 244.3 217.4 2.0 9 22
4 LC0 173_101eeb41 N8k : 118.7 116.3 9.5 79 12
5 LC0 173_101eeb41 N4k : 106.0 86.0 22.5 200 11
6 LC0 173_101eeb41 N2k : 39.4 95.6 16.0 200 8
7 LC0 173_101eeb41 N1k : 0.0 ---- 13.0 200 7
White advantage = 52.22 +/- 17.27
Draw rate (equal opponents) = 50.00 % +/- 0.00
-
Albert Silver
- Posts: 3019
- Joined: Wed Mar 08, 2006 9:57 pm
- Location: Rio de Janeiro, Brazil
Post
by Albert Silver »
Edsel Apostol wrote:Interesting! I would be curious to see a match with SF searching the same number of fixed nodes as well.
You cannot compare. For Stockfish, a node is a single board position, while for Leela a node is a full game.
"Tactics are the bricks and sticks that make up a game, but positional play is the architectural blueprint."
-
Gian-Carlo Pascutto
- Posts: 1243
- Joined: Sat Dec 13, 2008 7:00 pm
Post
by Gian-Carlo Pascutto »
Albert Silver wrote:while for Leela a node is a full game.
She doesn't play out games (there's no actual Monte Carlo simulation in the MCTS search).
But yes, obviously the amount of processing done per node is not comparable at all.
-
majortom
- Posts: 669
- Joined: Mon Nov 04, 2013 10:19 pm
Post
by majortom »
Code: Select all
# PLAYER : RATING ERROR POINTS PLAYED (%)
1 Stockfish 130418 D30 : 1059.4 127.3 172.5 179 96
2 Stockfish 130418 D15 : 475.9 67.6 688.0 937 73
3 LC0 173_101eeb41 N16k : 193.7 148.2 4.0 23 17
4 LC0 173_101eeb41 N8k : 172.1 89.2 21.0 135 16
5 LC0 173_101eeb41 N4k : 106.2 86.0 22.5 200 11
6 LC0 173_101eeb41 N2k : 39.5 93.9 16.0 200 8
7 LC0 173_101eeb41 N1k : 0.0 ---- 13.0 200 7
White advantage = 59.62 +/- 12.87
Draw rate (equal opponents) = 50.00 % +/- 0.00
-
majortom
- Posts: 669
- Joined: Mon Nov 04, 2013 10:19 pm
Post
by majortom »
[pgn][Event "?"]
[Site "?"]
[Date "2018.04.25"]
[Round "9"]
[White "LC0 173_101eeb41 N16k"]
[Black "Stockfish 130418 D15"]
[Result "1-0"]
[BlackTimeControl "inf"]
[FEN "rnbqkbnr/pppppppp/8/8/8/8/PPPPPPPP/RNBQKBNR w KQkq - 0 1"]
[GameEndTime "2018-04-25T23:40:26.329 RTZ 2 (зима)"]
[GameStartTime "2018-04-25T21:56:06.066 RTZ 2 (зима)"]
[PlyCount "121"]
[SetUp "1"]
[WhiteTimeControl "inf"]
1. e4 {book} e5 {book} 2. Bc4 {book} d6 {book} 3. Nf3 {book} Be7 {book}
4. Nc3 {+0.14/22 170s} Nf6 {-0.33/15 0.49s} 5. d4 {+0.13/22 130s}
exd4 {-0.31/15 0.27s} 6. Nxd4 {+0.11/21 90s} O-O {-0.13/15 0.31s}
7. Bf4 {+0.08/22 187s} a6 {-0.48/15 0.81s} 8. Qd2 {+0.16/22 240s}
c5 {+0.10/15 0.63s} 9. Nf5 {+0.36/21 130s} Bxf5 {-0.14/15 0.40s}
10. exf5 {+0.37/21 8.6s} Nc6 {+0.01/15 0.30s} 11. O-O-O {+0.40/21 52s}
Rc8 {-0.19/15 0.48s} 12. Bd5 {+0.37/21 150s} Nd4 {-0.31/15 0.78s}
13. g4 {+0.44/21 54s} Nxg4 {-0.36/15 0.53s} 14. Rhg1 {+0.73/21 62s}
Nf6 {-0.36/15 0.19s} 15. Bh6 {+0.78/21 49s} Nh5 {-0.40/15 0.26s}
16. Bxg7 {+3.25/21 97s} Nxg7 {-5.22/15 0.15s} 17. Qh6 {+4.19/20 6.9s}
Bf6 {-5.38/15 0.049s} 18. Ne4 {+4.53/21 84s} Be5 {-5.44/15 0.043s}
19. Rxd4 {+5.11/21 82s} Kh8 {-6.34/15 0.059s} 20. Ng5 {+6.31/20 25s}
Qxg5+ {-6.35/15 0.037s} 21. Qxg5 {+6.72/20 16s} Bxd4 {-6.06/15 0.072s}
22. f6 {+6.69/20 50s} Ne6 {-5.24/15 0.059s} 23. Bxe6 {+7.57/20 69s}
Rg8 {-5.65/15 0.074s} 24. Bxc8 {+7.62/20 9.7s} Rxg5 {-6.02/15 0.075s}
25. Rxg5 {+8.40/20 23s} Bxf6 {-6.14/15 0.059s} 26. Rg2 {+8.97/21 103s}
b6 {-6.38/15 0.14s} 27. Bxa6 {+9.94/20 117s} h6 {-6.29/15 0.058s}
28. a4 {+10.41/21 186s} Bg5+ {-5.77/15 0.087s} 29. Kb1 {+10.96/21 126s}
d5 {-6.45/15 0.097s} 30. Bb7 {+11.50/21 171s} d4 {-6.62/15 0.059s}
31. Be4 {+11.94/21 158s} Be7 {-7.01/15 0.16s} 32. Bd5 {+12.75/21 124s}
Bg5 {-7.23/15 0.066s} 33. f4 {+12.16/21 150s} Bxf4 {-7.02/15 0.068s}
34. Rf2 {+12.56/21 138s} Bg5 {-7.21/15 0.052s} 35. Rxf7 {+14.16/20 88s}
Bd2 {-6.68/15 0.041s} 36. Rb7 {+14.72/21 155s} Ba5 {-7.25/15 0.032s}
37. Be4 {+15.18/21 188s} Kg8 {-6.57/15 0.047s} 38. Bd5+ {+14.30/21 138s}
Kf8 {-6.57/15 0.030s} 39. Ka2 {+13.45/21 125s} Ke8 {-7.45/15 0.093s}
40. Kb3 {+14.73/21 144s} Kf8 {-7.50/15 0.19s} 41. Kc4 {+15.76/20 116s}
h5 {-7.95/15 0.089s} 42. Be6 {+16.15/21 155s} h4 {-7.74/15 0.13s}
43. Kd5 {+17.29/20 124s} Bd2 {-7.85/15 0.15s} 44. Ke5 {+18.80/20 126s}
Ke8 {-8.30/15 0.28s} 45. Kf6 {+18.92/21 141s} Bf4 {-8.39/15 0.073s}
46. Rxb6 {+18.54/20 97s} Bc7 {-8.49/15 0.007s} 47. Rc6 {+18.12/21 153s}
Bd8+ {-8.87/15 0.10s} 48. Ke5 {+16.58/20 71s} h3 {-9.06/15 0.12s}
49. Kd6 {+17.44/20 145s} Be7+ {-9.00/15 0.092s} 50. Ke5 {+16.95/20 71s}
Kf8 {-9.19/15 0.052s} 51. Rc8+ {+19.65/21 177s} Kg7 {-9.20/15 0.013s}
52. Rg8+ {+20.79/21 132s} Kh7 {-9.77/15 0.082s} 53. Re8 {+21.86/20 118s}
Bg5 {-13.34/15 0.25s} 54. Kf5 {+22.27/21 149s} Bh4 {-9.08/15 0.071s}
55. a5 {+23.49/21 141s} c4 {-16.28/15 0.047s} 56. a6 {+26.20/20 111s}
Kh6 {-M10/15 0.035s} 57. a7 {+37.91/20 100s} c3 {-M8/15 0.005s}
58. a8=Q {+50.75/20 103s} Bd8 {-M6/15 0.002s} 59. Rh8+ {+68.79/20 90s}
Kg7 {-M4/15 0.001s} 60. Qxd8 {+76.96/19 24s} d3 {-M2/15 0.001s}
61. Qg8# {+113.82/17 10s, White mates} 1-0
[/pgn]
-
Rubinus
- Posts: 1161
- Joined: Thu Jan 18, 2007 4:05 pm
- Location: Prague
- Full name: Pavel Háse
Post
by Rubinus »
majortom wrote:[pgn][Event "?"]
[Site "?"]
[Date "2018.04.25"]
[Round "9"]
[White "LC0 173_101eeb41 N16k"]
[Black "Stockfish 130418 D15"]
[Result "1-0"]
[BlackTimeControl "inf"]
[FEN "rnbqkbnr/pppppppp/8/8/8/8/PPPPPPPP/RNBQKBNR w KQkq - 0 1"]
[GameEndTime "2018-04-25T23:40:26.329 RTZ 2 (зима)"]
[GameStartTime "2018-04-25T21:56:06.066 RTZ 2 (зима)"]
[PlyCount "121"]
[SetUp "1"]
[WhiteTimeControl "inf"]
1. e4 {book} e5 {book} 2. Bc4 {book} d6 {book} 3. Nf3 {book} Be7 {book}
4. Nc3 {+0.14/22 170s} Nf6 {-0.33/15 0.49s} 5. d4 {+0.13/22 130s}
exd4 {-0.31/15 0.27s} 6. Nxd4 {+0.11/21 90s} O-O {-0.13/15 0.31s}
7. Bf4 {+0.08/22 187s} a6 {-0.48/15 0.81s} 8. Qd2 {+0.16/22 240s}
c5 {+0.10/15 0.63s} 9. Nf5 {+0.36/21 130s} Bxf5 {-0.14/15 0.40s}
10. exf5 {+0.37/21 8.6s} Nc6 {+0.01/15 0.30s} 11. O-O-O {+0.40/21 52s}
Rc8 {-0.19/15 0.48s} 12. Bd5 {+0.37/21 150s} Nd4 {-0.31/15 0.78s}
13. g4 {+0.44/21 54s} Nxg4 {-0.36/15 0.53s} 14. Rhg1 {+0.73/21 62s}
Nf6 {-0.36/15 0.19s} 15. Bh6 {+0.78/21 49s} Nh5 {-0.40/15 0.26s}
16. Bxg7 {+3.25/21 97s} Nxg7 {-5.22/15 0.15s} 17. Qh6 {+4.19/20 6.9s}
Bf6 {-5.38/15 0.049s} 18. Ne4 {+4.53/21 84s} Be5 {-5.44/15 0.043s}
19. Rxd4 {+5.11/21 82s} Kh8 {-6.34/15 0.059s} 20. Ng5 {+6.31/20 25s}
Qxg5+ {-6.35/15 0.037s} 21. Qxg5 {+6.72/20 16s} Bxd4 {-6.06/15 0.072s}
22. f6 {+6.69/20 50s} Ne6 {-5.24/15 0.059s} 23. Bxe6 {+7.57/20 69s}
Rg8 {-5.65/15 0.074s} 24. Bxc8 {+7.62/20 9.7s} Rxg5 {-6.02/15 0.075s}
25. Rxg5 {+8.40/20 23s} Bxf6 {-6.14/15 0.059s} 26. Rg2 {+8.97/21 103s}
b6 {-6.38/15 0.14s} 27. Bxa6 {+9.94/20 117s} h6 {-6.29/15 0.058s}
28. a4 {+10.41/21 186s} Bg5+ {-5.77/15 0.087s} 29. Kb1 {+10.96/21 126s}
d5 {-6.45/15 0.097s} 30. Bb7 {+11.50/21 171s} d4 {-6.62/15 0.059s}
31. Be4 {+11.94/21 158s} Be7 {-7.01/15 0.16s} 32. Bd5 {+12.75/21 124s}
Bg5 {-7.23/15 0.066s} 33. f4 {+12.16/21 150s} Bxf4 {-7.02/15 0.068s}
34. Rf2 {+12.56/21 138s} Bg5 {-7.21/15 0.052s} 35. Rxf7 {+14.16/20 88s}
Bd2 {-6.68/15 0.041s} 36. Rb7 {+14.72/21 155s} Ba5 {-7.25/15 0.032s}
37. Be4 {+15.18/21 188s} Kg8 {-6.57/15 0.047s} 38. Bd5+ {+14.30/21 138s}
Kf8 {-6.57/15 0.030s} 39. Ka2 {+13.45/21 125s} Ke8 {-7.45/15 0.093s}
40. Kb3 {+14.73/21 144s} Kf8 {-7.50/15 0.19s} 41. Kc4 {+15.76/20 116s}
h5 {-7.95/15 0.089s} 42. Be6 {+16.15/21 155s} h4 {-7.74/15 0.13s}
43. Kd5 {+17.29/20 124s} Bd2 {-7.85/15 0.15s} 44. Ke5 {+18.80/20 126s}
Ke8 {-8.30/15 0.28s} 45. Kf6 {+18.92/21 141s} Bf4 {-8.39/15 0.073s}
46. Rxb6 {+18.54/20 97s} Bc7 {-8.49/15 0.007s} 47. Rc6 {+18.12/21 153s}
Bd8+ {-8.87/15 0.10s} 48. Ke5 {+16.58/20 71s} h3 {-9.06/15 0.12s}
49. Kd6 {+17.44/20 145s} Be7+ {-9.00/15 0.092s} 50. Ke5 {+16.95/20 71s}
Kf8 {-9.19/15 0.052s} 51. Rc8+ {+19.65/21 177s} Kg7 {-9.20/15 0.013s}
52. Rg8+ {+20.79/21 132s} Kh7 {-9.77/15 0.082s} 53. Re8 {+21.86/20 118s}
Bg5 {-13.34/15 0.25s} 54. Kf5 {+22.27/21 149s} Bh4 {-9.08/15 0.071s}
55. a5 {+23.49/21 141s} c4 {-16.28/15 0.047s} 56. a6 {+26.20/20 111s}
Kh6 {-M10/15 0.035s} 57. a7 {+37.91/20 100s} c3 {-M8/15 0.005s}
58. a8=Q {+50.75/20 103s} Bd8 {-M6/15 0.002s} 59. Rh8+ {+68.79/20 90s}
Kg7 {-M4/15 0.001s} 60. Qxd8 {+76.96/19 24s} d3 {-M2/15 0.001s}
61. Qg8# {+113.82/17 10s, White mates} 1-0
[/pgn]
Some handicap time? Time LCO-SF cca 200:1.
-
majortom
- Posts: 669
- Joined: Mon Nov 04, 2013 10:19 pm
Post
by majortom »
-
majortom
- Posts: 669
- Joined: Mon Nov 04, 2013 10:19 pm
Post
by majortom »
Rubinus wrote:Some handicap time? Time LCO-SF cca 200:1.
LCZero ID173 - 16000 nodes per move vs. SF 130418 at 15 depth, and, of course, time per move is not equal.
BTW, about test conditions you can read on the first page.
-
majortom
- Posts: 669
- Joined: Mon Nov 04, 2013 10:19 pm
Post
by majortom »
Code: Select all
# PLAYER : RATING ERROR POINTS PLAYED (%)
1 Stockfish 130418 D30 : 581.4 92.2 193.0 200 97
2 Stockfish 130418 D15 : 0.0 ---- 7.0 200 4
White advantage = 7.01 +/- 12.78
Draw rate (equal opponents) = 50.00 % +/- 0.00
Games
Code: Select all
# PLAYER : RATING ERROR POINTS PLAYED (%)
1 Stockfish 130418 D30 : 1066.8 127.3 193.0 200 97
2 Stockfish 130418 D15 : 476.1 69.2 724.5 1002 72
3 LC0 173_101eeb41 N16k : 217.8 128.6 6.0 31 19
4 LC0 173_101eeb41 N8k : 175.4 85.7 27.0 171 16
5 LC0 173_101eeb41 N4k : 106.2 87.8 22.5 200 11
6 LC0 173_101eeb41 N2k : 39.5 97.9 16.0 200 8
7 LC0 173_101eeb41 N1k : 0.0 ---- 13.0 200 7
White advantage = 60.22 +/- 14.13
Draw rate (equal opponents) = 50.00 % +/- 0.00