Live Match Leela vs Stockfish

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

Engin
Posts: 918
Joined: Mon Jan 05, 2009 7:40 pm
Location: Germany
Full name: Engin Üstün

Live Match Leela vs Stockfish

Post by Engin »

Hello,
here are the last results of the 50 games match with TC 3+2
between Leela v0.16.0 cuda and Stockfish 5 64bit

Next match with the Network ID 531 is current underway at:
https://www.twitch.tv/deeplearningchess

LcZero v0.16.0 cuda ID 529 GTX 1060 vs Stockfish 5 64bit

Code: Select all

AMD8350-PC, Blitz 3m+2s
Coburg, 2018.07.31
                                     Score     12345678901234567890123456789012345678901234567890
--------------------------------------------------------------------------------------------------
 1: The Lc0 chess engine. v0.16.0  25.0 / 50   =0======1==0=0==001=1=00=01=1==11011===0101==0=1==  (+12 -12 =26)
 2: Stockfish 5 64                 25.0 / 50   =1======0==1=1==110=0=11=10=0==00100===1010==1=0==  (+12 -12 =26)
--------------------------------------------------------------------------------------------------
50 games: +19 -5 =26
All Games can be download here: http://www.mediafire.com/file/jph3152yp ... s.pgn/file


[pgn][Event "AMD8350-PC, Blitz 3m+2s"] [Site "Coburg"] [Date "2018.07.31"] [Round "9"] [White "The Lc0 chess engine. v0.16.0"] [Black "Stockfish 5 64"] [Result "1-0"] [ECO "D90"] [Annotator "0.46;0.32"] [PlyCount "127"] [TimeControl "180+2"] {AMD FX(tm)-8350 Eight-Core Processor 4000 MHz W=4.4 plies; 5kN/s; Book2018.ctg B=19.9 plies; 646kN/s; Book2018.ctg} 1. d4 {[%eval 0,0] [%emt 0: 00:00]} 1. ... Nf6 {[%eval 0,0] [%emt 0:00:00] } 2. c4 {[%eval 0,0] [%emt 0:00:00]} 2. ... g6 {[%eval 0,0] [%emt 0:00:00] } 3. Nc3 {[%eval 0,0] [%emt 0:00:00]} 3. ... d5 {[%eval 0, 0] [%emt 0:00:00]} 4. cxd5 {[%eval 0,0] [%emt 0:00:00]} 4. ... Nxd5 {[%eval 0,0] [%emt 0:00:00]} 5. Bd2 {[%eval 0,0] [%emt 0:00:00]} 5. ... Nb6 {[%eval 0,0] [%emt 0: 00:00]} 6. Bf4 {[%eval 0,0] [%emt 0:00:00]} 6. ... Bg7 { [%eval 0,0] [%emt 0:00:00]} 7. e3 {[%eval 0,0] [%emt 0:00:00]} 7. ... O-O {[%eval 0,0] [%emt 0:00:00]} 8. Nf3 {[%eval 0,0] [%emt 0:00:00]} 8. ... c5 {[%eval 0,0] [%emt 0:00:00]} 9. dxc5 {[%eval 0, 0] [%emt 0:00:00] Beide letzter Buchzug} 9. ... N6d7 {[%eval 32,17] [%emt 0:00:07]} 10. Nd5 { [%eval 46,4] [%emt 0:00:07]} 10. ... Bxb2 {[%eval 27,20] [%emt 0:00:20] (Sc6)} 11. Bc7 {[%eval 72,5] [%emt 0:00:06]} 11. ... Qe8 {[%eval 61,21] [%emt 0:00:09]} 12. Rb1 {[%eval 75,4] [%emt 0:00:03]} 12. ... Bg7 {[%eval 72,21] [%emt 0:00:08]} 13. Bb5 {[%eval 78,4] [%emt 0:00:03]} 13. ... Nc6 { [%eval 72,21] [%emt 0:00:03]} 14. Bg3 {[%eval 83,4] [%emt 0:00:02]} 14. ... Qd8 {[%eval 69,23] [%emt 0:00:03]} 15. Nc7 {[%eval 85,5] [%emt 0:00:04] (0-0)} 15. ... Rb8 {[%eval 67,19] [%emt 0:00:06]} 16. O-O {[%eval 91,4] [%emt 0:00:03]} 16. ... Nde5 {[%eval 62,22] [%emt 0:00:07]} 17. Nd5 {[%eval 95,4] [%emt 0:00:03]} 17. ... Nxf3+ {[%eval 62,22] [%emt 0:00:03]} 18. Qxf3 {[%eval 94,5] [%emt 0:00:04]} 18. ... Ne5 {[%eval 62,23] [%emt 0:00:03]} 19. Bxe5 {[%eval 96,4] [%emt 0:00:03]} 19. ... Bxe5 {[%eval 56,23] [%emt 0:00:03]} 20. Qe4 {[%eval 95,4] [%emt 0:00:02]} 20. ... Bf6 { [%eval 58,23] [%emt 0:00:12]} 21. Rfd1 {[%eval 91,4] [%emt 0:00:03]} 21. ... Bf5 {[%eval 58,22] [%emt 0:00:03]} 22. Qb4 {[%eval 86,4] [%emt 0:00:04]} 22. ... Qc8 {[%eval 58,22] [%emt 0:00:03]} 23. Rbc1 {[%eval 81,5] [%emt 0:00:08] (e4)} 23. ... Rd8 {[%eval 34,16] [%emt 0:00:05] (Le6) } 24. Qf4 {[%eval 83,4] [%emt 0:00:09] (Sxf6+)} 24. ... Be6 {[%eval 29,19] [%emt 0:00:11]} 25. e4 {[%eval 89,5] [%emt 0:00:05] (Sxf6+)} 25. ... Bxd5 {[%eval 37,21] [%emt 0:00:07] (Kg7)} 26. exd5 {[%eval 96,4] [%emt 0:00:06] } 26. ... a6 {[%eval 41,22] [%emt 0:00:20] (Lb2)} 27. Be2 {[%eval 184,5] [%emt 0:00:07]} 27. ... Bb2 {[%eval 41,21] [%emt 0:00:03] (Df5)} 28. Rc2 { [%eval 202,4] [%emt 0:00:06]} 28. ... e5 {[%eval 38,22] [%emt 0:00:03] (Lf6)} 29. Qe4 {[%eval 151,4] [%emt 0:00:08] (Dc4)} 29. ... Bd4 {[%eval 41,17] [%emt 0: 00:06]} 30. d6 {[%eval 145,4] [%emt 0:00:05] (Lf3)} 30. ... Kg7 {[%eval 45,18] [%emt 0: 00:03] (Dd7)} 31. Rxd4 {[%eval 203,4] [%emt 0:00:07] (Lf3)} 31. ... exd4 {[%eval 76,18] [%emt 0:00:05]} 32. Qxd4+ {[%eval 203,5] [%emt 0:00:04]} 32. ... Kg8 {[%eval 106,21] [%emt 0:00:16]} 33. h4 {[%eval 213,4] [%emt 0:00:04] (Lg4)} 33. ... Qd7 {[%eval 119,19] [%emt 0:00:15] (h5)} 34. h5 {[%eval 341,4] [%emt 0:00:06]} 34. ... Qe8 {[%eval 134,18] [%emt 0:00:05] (De7)} 35. Bc4 {[%eval 331,6] [%emt 0:00:09]} 35. ... Qf8 {[%eval 157, 18] [%emt 0:00:04]} 36. Rd2 {[%eval 317,4] [%emt 0:00:07] (Df4)} 36. ... Qg7 {[%eval 153,18] [%emt 0:00:18] (Tbc8)} 37. Qf4 {[%eval 352,3] [%emt 0:00:05]} 37. ... g5 {[%eval 163,19] [%emt 0:00:10]} 38. Qf5 {[%eval 436,4] [%emt 0:00:05] (Df3)} 38. ... Re8 { [%eval 210,17] [%emt 0:00:03]} 39. d7 {[%eval 483,4] [%emt 0:00:04]} 39. ... Re1+ {[%eval 238,21] [%emt 0:00:03]} 40. Kh2 {[%eval 475,4] [%emt 0:00:03]} 40. ... Rd8 {[%eval 276,22] [%emt 0:00:03]} 41. Bxf7+ {[%eval 495,3] [%emt 0:00:02]} 41. ... Kh8 {[%eval 318,23] [%emt 0:00:03]} 42. Rd5 {[%eval 508,3] [%emt 0:00:02] (Td6)} 42. ... g4 {[%eval 220,18] [%emt 0:00:05] (Te2)} 43. Be8 {[%eval 582,3] [%emt 0:00:05] (Kg3)} 43. ... Qe7 { [%eval 245,21] [%emt 0:00:12] (Texe8)} 44. Qxg4 {[%eval 712,3] [%emt 0:00:06]} 44. ... Qe4 {[%eval 265,22] [%emt 0:00:05] (Te4)} 45. Qg5 { [%eval 907, 6] [%emt 0:00:06]} 45. ... Qe7 {[%eval 277,23] [%emt 0:00:05]} 46. f4 {[%eval 914,5] [%emt 0:00:06] (Dxe7)} 46. ... Qxg5 {[%eval 239,18] [%emt 0:00:03]} 47. fxg5 {[%eval 917,5] [%emt 0:00:09] (Txg5)} 47. ... Kg8 {[%eval 254,19] [%emt 0:00:05] (Kg7)} 48. Kg3 {[%eval 987,5] [%emt 0:00:06] (Tf5)} 48. ... Re2 {[%eval 265,17] [%emt 0:00:04] (Kf8)} 49. a4 { [%eval 1008,4] [%emt 0:00:08] (Tf5)} 49. ... a5 {[%eval 274,16] [%emt 0:00:04] (Kf8)} 50. Kf3 {[%eval 1085,5] [%emt 0:00:08] (Tf5)} 50. ... Ra2 {[%eval 255,17] [%emt 0:00:02]} 51. Rd4 {[%eval 936,4] [%emt 0:00:06] (Tf5)} 51. ... Rc2 {[%eval 242,17] [%emt 0:00:01]} 52. Rd5 {[%eval 778,5] [%emt 0:00:04] (h6)} 52. ... Ra2 {[%eval 0,41] [%emt 0:00:02] (Tc4)} 53. Ke4 {[%eval 913,5] [%emt 0:00:06]} 53. ... Rxg2 {[%eval 367, 17] [%emt 0:00:04] (Kf8)} 54. Kf5 {[%eval 1164,4] [%emt 0:00:06]} 54. ... Kf8 { [%eval 412,16] [%emt 0:00:01]} 55. Ke6 {[%eval 1247,5] [%emt 0:00:04] (Kf6)} 55. ... Rxe8+ {[%eval 362,17] [%emt 0:00:02]} 56. dxe8=N {[%eval 1289,5] [%emt 0:00:05] (dxe8D+)} 56. ... Kxe8 {[%eval 379,18] [%emt 0:00:02]} 57. c6 {[%eval 1350,4] [%emt 0: 00:04]} 57. ... bxc6 {[%eval 383,19] [%emt 0:00:01]} 58. Rxa5 {[%eval 1326,5] [%emt 0: 00:02]} 58. ... Re2+ {[%eval 397,20] [%emt 0:00:04] (Kd8)} 59. Kf6 {[%eval 1362,6] [%emt 0:00:05] (Kd6)} 59. ... c5 {[%eval 460,16] [%emt 0:00:02] (Kd7)} 60. Rxc5 {[%eval 1829,5] [%emt 0:00:04]} 60. ... Rb2 {[%eval 601,16] [%emt 0:00:02] (Th2)} 61. Kg7 {[%eval 1938,5] [%emt 0:00:06] (Tc8+)} 61. ... Rb7+ {[%eval 741,19] [%emt 0:00:02]} 62. Kh6 {[%eval 1872,6] [%emt 0:00:04]} 62. ... Rf7 {[%eval 1031,18] [%emt 0:00:02] (Ta7)} 63. Rc8+ {[%eval 1938,5] [%emt 0:00:06]} 63. ... Kd7 {[%eval 1198,19] [%emt 0: 00:02]} 64. Rh8 {[%eval 2090,5] [%emt 0:00:05]} 1-0[/pgn]
Engin
Posts: 918
Joined: Mon Jan 05, 2009 7:40 pm
Location: Germany
Full name: Engin Üstün

Re: Live Match Leela vs Stockfish

Post by Engin »

Hi,
here are the 150 match games between Leela v0.16 cuda ID 531 vs Stockfish 5, this time +12 elo for Leela :-)

Code: Select all

AMD8350-PC, Blitz 3m+2s
Coburg, 2018.08.01 - 2018.08.02
                                     Score                                                                                                         
---------------------------------------------------------------
 1: The Lc0 chess engine. v0.16.0  77.5 / 150  (+34 -29 =87)
 2: Stockfish 5 64                 72.5 / 150  (+29 -34 =87)
---------------------------------------------------------------
150 games: +41 -22 =87

All Results and Games can be Download here:
https://www.mediafire.com/folder/p25bsbxcah9bn/public


Twitch Live Broadcast at: https://www.twitch.tv/deeplearningchess
Vinvin
Posts: 5228
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: Live Match Leela vs Stockfish

Post by Vinvin »

Please, play against SF 7 also.
Leela tends to make better performance against stronger engines.
Engin wrote: Thu Aug 02, 2018 12:55 pm Hi,
here are the 150 match games between Leela v0.16 cuda ID 531 vs Stockfish 5, this time +12 elo for Leela :-)

Code: Select all

AMD8350-PC, Blitz 3m+2s
Coburg, 2018.08.01 - 2018.08.02
                                     Score                                                                                                         
---------------------------------------------------------------
 1: The Lc0 chess engine. v0.16.0  77.5 / 150  (+34 -29 =87)
 2: Stockfish 5 64                 72.5 / 150  (+29 -34 =87)
---------------------------------------------------------------
150 games: +41 -22 =87

All Results and Games can be Download here:
https://www.mediafire.com/folder/p25bsbxcah9bn/public


Twitch Live Broadcast at: https://www.twitch.tv/deeplearningchess
Engin
Posts: 918
Joined: Mon Jan 05, 2009 7:40 pm
Location: Germany
Full name: Engin Üstün

Re: Live Match Leela vs Stockfish

Post by Engin »

OK, i will try next time but SF 7 is elo 3354 thats nearly 100 elo stronger then SF 5
Engin
Posts: 918
Joined: Mon Jan 05, 2009 7:40 pm
Location: Germany
Full name: Engin Üstün

Re: Live Match Leela vs Stockfish

Post by Engin »

Leela vs Stockfish 7 is live now !

twitch: https://www.twitch.tv/deeplearningchess
Vinvin
Posts: 5228
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: Live Match Leela vs Stockfish

Post by Vinvin »

Engin wrote: Thu Aug 02, 2018 10:38 pm OK, i will try next time but SF 7 is elo 3354 thats nearly 100 elo stronger then SF 5
On CCRL, SF7 is only 52 points above SF5

Code: Select all

Stockfish 7 64-bit	3246
Stockfish 5 64-bit	3194
http://www.computerchess.org.uk/ccrl/4040/
User avatar
Guenther
Posts: 4605
Joined: Wed Oct 01, 2008 6:33 am
Location: Regensburg, Germany
Full name: Guenther Simon

Re: Live Match Leela vs Stockfish

Post by Guenther »

Vinvin wrote: Fri Aug 03, 2018 11:21 am
Engin wrote: Thu Aug 02, 2018 10:38 pm OK, i will try next time but SF 7 is elo 3354 thats nearly 100 elo stronger then SF 5
On CCRL, SF7 is only 52 points above SF5

Code: Select all

Stockfish 7 64-bit	3246
Stockfish 5 64-bit	3194
http://www.computerchess.org.uk/ccrl/4040/
In 40/4 it is 110 points and the TC used in Engins' test is much closer to that.

Code: Select all

Stockfish 7 64-bit                 3354  +14  -14  76.0% -187.5  2066
Stockfish 6 64-bit                 3318  +12  -11  70.6% -147.5  2833
Stockfish 5 64-bit                 3244  +19  -19  77.0% -202.8  1129
Stockfish 020514 64-bit            3237  +17  -17  66.3% -108.3  1143
Stockfish 5 syzygy 64-bit          3235  +17  -17  72.3% -154.6  1328
Stockfish DD 64-bit                3227  +18  -18  57.0%  -43.9   912
Stockfish 4 64-bit                 3180  +13  -13  60.2%  -67.6  2038
https://rwbc-chess.de

trollwatch:
Chessqueen + chessica + AlexChess + Eduard + Sylwy
Engin
Posts: 918
Joined: Mon Jan 05, 2009 7:40 pm
Location: Germany
Full name: Engin Üstün

Re: Live Match Leela vs Stockfish

Post by Engin »

yes my TC 3+2 is closer to CCRL 40/4 ratings.
Engin
Posts: 918
Joined: Mon Jan 05, 2009 7:40 pm
Location: Germany
Full name: Engin Üstün

Re: Live Match Leela vs Stockfish

Post by Engin »

Ok, here the games and results against vs Stockfish 7 64bit.

Code: Select all

AMD8350-PC, Blitz 3m+2s
-, 2018.08.03
                                     Score     12345678901234567890123456789012345678901234567890  
----------------------------------------------------------------------------------------------------
 1: Stockfish 7 64                 29.5 / 52   =1==01=1=1===1==0==1=======0=0=011==1==0=10111=01==1  (+15 -8 =29)
 2: The Lc0 chess engine. v0.16.0  22.5 / 52   =0==10=0=0===0==1==0=======1=1=100==0==1=01000=10==0  (+8 -15 =29)
----------------------------------------------------------------------------------------------------
52 games: +14 -9 =29
Leela is -47 elo below SF7 this time, but not bad at all :-)

you can find all games here: http://www.mediafire.com/folder/p25bsbxcah9bn/public