Trying out the Leela Hybrid engine (NN with AB)

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

User avatar
AdminX
Posts: 6339
Joined: Mon Mar 13, 2006 2:34 pm
Location: Acworth, GA

Trying out the Leela Hybrid engine (NN with AB)

Post by AdminX »

LeelaFish is a modified version of the Lc0 engine that gets help from an outside (auxiliary) engine. Leela uses the AuxEngine's PV to boost the Policy of those moves.
https://github.com/killerducky/lc0/wiki/LeelaFish

Gui: Chessbase/ Fritz
OS: Windows Pro 64
System: i7-4790 CPU @ 3060GHz : 32 GB Ram : 2x GTX 1060
AuxEngine: Stockfish 10 64bit BMI
AuxEngineOptions: Hash=1024;Threads=2

[pgn] [Event "Rated game, 60m+15s"] [Site "Engine Room"] [Date "2019.02.19"] [Round "?"] [White "Karl-HeinzFischer, Eman 3.22 64-bit BM"] [Black "NYTed, Lc0 v0.21.0-Fish 32"] [Result "1/2-1/2"] [ECO "E15"] [WhiteElo "2505"] [BlackElo "2507"] [Annotator "0.64;0.25"] [PlyCount "259"] [EventDate "2019.02.19"] [SourceTitle "playchess.com"] [TimeControl "3600+15"] {Eman 3.22 64-bit BMI2 (8 threads): 50.2 plies; 12,254kN/s Intel(R) Core(TM) i7-7700K CPU @ 4.20GHz 4200MHz, (4 cores, 8 threads), Perfect2018.ctg, 16384 MB } 1. d4 {B 0} Nf6 {B 0} 2. c4 {B 0} e6 {B 0} 3. Nf3 {B 0} b6 {B 0} 4. g3 {B 0} Ba6 {B 0} 5. b3 {B 0} Bb4+ {B 0} 6. Bd2 {B 0} Be7 {B 0} 7. Bg2 {B 0} c6 {B 0} 8. Bc3 {B 0} d5 {B 0} 9. Ne5 {B 0} Nfd7 {0.25/12 52} 10. Nxd7 {B 0} Nxd7 { 0.28/14 53} 11. Nd2 {B 0} O-O {0.30/13 146} 12. O-O {B 0} Rc8 {0.29/13 10} 13. e4 {B 0 (Rc1)} b5 {0.26/16 118} 14. Re1 {B 0} dxc4 {0.38/18 209} 15. bxc4 {B 0} bxc4 {0.38/26 2} 16. Qa4 {B 0} Bb5 {0.40/23 7} 17. Qc2 {B 0} Ba6 {0.42/19 231} 18. Qa4 {0.64/39 474 (Bf1)} Bb5 {0.39/14 64} 19. Qc2 {0.47/35 65} Ba6 {0.45/14 1 (a5)} 20. a4 {0.75/37 85 (Rad1)} Bg5 {0.44/14 291 (Dc7)} 21. Rad1 {0.69/32 40 (Bf1)} h6 {0.38/13 102 (Tb8)} 22. Bf1 {0.62/40 442} Bxd2 {0.51/16 1} 23. Qxd2 {0.40/38 86} Qc7 {0.53/16 1} 24. Qa2 {0.32/37 90} Rfd8 {0.56/16 15} 25. Bxc4 {0.66/40 258 (h4)} Bxc4 {0.48/19 199} 26. Qxc4 {0.63/41 9} Nb6 {0.50/20 73 (c5)} 27. Qa2 {0.75/44 333} c5 {0.57/25 1} 28. d5 {0.53/43 135} exd5 { 0.60/23 0} 29. a5 {0.62/44 141} d4 {0.63/20 1} 30. axb6 {0.58/42 103} axb6 { 0.63/21 2} 31. Ba1 {0.60/41 86 (Bb2)} b5 {0.31/17 445} 32. Qa6 {0.51/45 115 (e5)} Rb8 {0.17/14 186} 33. Rb1 {0.42/41 28 (e5)} Rd6 {0.06/14 154 (c4)} 34. Qa3 {0.23/38 113} Rdd8 {0.05/17 16} 35. Red1 {0.23/42 203 (Qa6)} Qb6 {0.05/14 154 (Ta8)} 36. Qb2 {0.69/41 334} Re8 {0.14/25 1 (Dc6)} 37. Qe2 {0.33/43 343} Red8 {0.15/27 1} 38. Qb2 {0.33/40 27 (e5)} Re8 {0.08/13 244} 39. f3 {0.33/46 66 (Qc2)} Red8 {-0.09/11 305 (Te7)} 40. Kg2 {0.25/36 62} Rd7 {0.00/11 89 (Tb7)} 41. Qe2 {0.76/36 88} Ra7 {0.02/11 0 (Tbb7)} 42. Rd2 {0.73/32 18} Ra4 {0.25/10 205 (Ta6)} 43. Bb2 {0.87/34 34} Rd8 {0.28/10 48} 44. Rc1 {0.79/37 129 (e5)} Ra6 {0.31/10 79} 45. Kf1 {0.61/37 68 (Rcd1)} Ra7 {0.04/10 68} 46. Kg2 {0.51/35 9} Rad7 {0.17/10 85 (Ta6)} 47. Qf2 {0.55/39 45 (Rcd1)} Qa7 {0.07/10 51 (c4)} 48. Rcd1 {0.95/34 46} Qa6 {0.22/11 127} 49. Qe2 {0.88/42 0} Qc6 {0.29/10 46 (Db6)} 50. g4 {0.88/39 21 (h4)} Re8 {0.30/10 73 (Da6)} 51. Rc1 {0.88/40 27 (Rc2)} Red8 {0.34/11 47 (Db6)} 52. Qf2 {0.88/43 17} Qb6 {0.43/11 46} 53. h3 {0.97/39 7 (h4) } Qa7 {0.28/9 66 (Td6)} 54. Rcd1 {0.88/43 21} Qa6 {0.34/11 23 (Db6)} 55. Rc1 { 0.88/41 20 (Qe2)} Qa7 {0.34/11 62 (Db6)} 56. Rcd1 {0.88/46 20} Qa6 {0.36/12 8} 57. h4 {0.87/38 11 (Qe2)} b4 {0.25/13 46 (De6)} 58. Rc2 {0.77/41 33} c4 { 0.29/16 54} 59. Rxd4 {0.77/47 0} Rxd4 {0.31/14 22 (c3)} 60. Bxd4 {0.10/40 115} c3 {0.30/14 0} 61. Bxc3 {0.09/37 13} bxc3 {0.31/11 0} 62. Rxc3 {0.05/36 29} g6 {0.30/10 10 (Df6)} 63. Qc2 {0.77/43 24 (Rc2)} Qf6 {0.23/10 69} 64. Kh3 { 0.67/47 10} Qd4 {0.22/11 60 (Df4)} 65. Rc8 {0.77/47 14 (Qc1)} Rxc8 {0.22/11 23} 66. Qxc8+ {0.77/50 0} Kg7 {0.24/10 23} 67. Qc2 {0.77/51 0} Qg1 {0.24/9 31} 68. Qh2 {0.76/51 0 (Qd2)} Qe1 {0.19/9 32 (De3)} 69. Qe5+ {0.76/46 21} Kg8 {0.23/10 15 (Kh7)} 70. Qb8+ {0.76/49 17 (Qc5)} Kg7 {0.20/10 20 (Kh7)} 71. Qe5+ {0.76/51 20 (Qb6)} Kg8 {0.25/10 19 (Kh7)} 72. Qd4 {0.76/52 33} Qh1+ {0.36/11 11 (Kh7)} 73. Kg3 {0.76/1 0} Qe1+ {0.33/10 20} 74. Qf2 {0.57/45 7} Qc3 {0.32/9 10} 75. Kg2 {0.57/48 6} Kg7 {0.32/8 35 (Kf8)} 76. Qe2 {0.27/46 20} Qf6 {0.36/8 15 (Kf8) } 77. Qe1 {0.18/47 40} Qb2+ {0.38/8 9 (Kh7)} 78. Kh3 {0.18/48 43 (Qf2)} Qd4 { 0.31/8 23 (Db3)} 79. Kg2 {0.18/51 14} g5 {0.32/8 19 (Db2+)} 80. h5 {0.76/56 20 (Qf2)} Qb2+ {0.21/7 14} 81. Qf2 {0.76/58 0} Qc3 {0.20/7 17} 82. Kg3 {0.76/60 2 (Qe2)} Qe5+ {0.19/8 14 (Dc7+)} 83. Kg2 {0.76/60 13} Qc3 {0.17/8 12} 84. Qe2 { 0.76/58 8 (Qa2)} Qc1 {0.23/8 17} 85. Kf2 {0.76/58 0} Qc5+ {0.20/8 14 (Dc3)} 86. Kg2 {0.76/62 15} Qe5 {0.20/8 25 (Dc3)} 87. Qd2 {0.76/64 21 (Kh3)} Qc5 {0.22/8 10 (De6)} 88. Qb2+ {0.76/58 15} Kg8 {0.19/9 6 (Kh7)} 89. Kh2 {0.57/57 38 (Qe2)} Qe3 {0.13/8 24 (Kh7)} 90. Kg2 {0.56/58 14} Qc5 {0.15/9 21} 91. Kf1 {0.56/55 0 (e5)} Qc7 {0.12/8 11 (Kh7)} 92. Qf2 {0.00/61 77 (Qb3)} Qc1+ {0.19/8 16 (Dc3)} 93. Qe1 {0.00/60 11 (Kg2)} Qa3 {0.17/8 12 (Db2)} 94. Kf2 {0.00/58 13 (Qe2)} Qc5+ {0.20/8 16 (Db2+)} 95. Kg2 {0.00/60 12 (Kg3)} Qb5 {0.23/7 17 (Dd4)} 96. Qc3 {0.00/59 22 (e5)} Qe2+ {0.17/8 19} 97. Kg3 {0.00/67 0} Qf1 {0.22/9 10} 98. Qd4 {0.00/68 22 (Qe3)} Qe1+ {0.18/9 20} 99. Kg2 {0.00/72 45} Qe2+ {0.17/10 0} 100. Qf2 {0.00/73 15} Qd3 {0.18/9 10 (Dxf2+)} 101. Qb2 {0.00/65 12 (e5)} Qe3 { 0.15/9 28 (Dd1)} 102. Qb8+ {0.00/62 24 (Qf2)} Kg7 {0.16/10 16 (Kh7)} 103. Qe5+ {0.00/68 10 (Qb2+)} Kg8 {0.15/10 20} 104. Qe8+ {0.00/65 29 (Qb8+)} Kg7 { 0.11/9 7} 105. Qe5+ {0.00/68 3 (Qb5)} Kg8 {0.10/9 14} 106. Qb5 {0.00/64 0 (Qf6) } Kg7 {0.14/9 22} 107. Qc4 {0.00/66 34 (Qb4)} Qe1 {0.18/8 18 (Kg8)} 108. Qd3 { 0.00/64 10 (Qb5)} Kg8 {0.16/8 11} 109. Qb5 {0.00/67 2 (Qc2)} Qd2+ {0.08/9 14 (Kg7)} 110. Kg3 {0.00/64 11 (Kf1)} Qe1+ {0.04/9 13 (Df4+)} 111. Kg2 {0.00/63 12 } Qd2+ {0.05/9 13} 112. Kf1 {0.00/65 3} Qc3 {0.11/9 15 (Df4)} 113. Kf2 { 0.00/61 12 (Qe2)} Qd2+ {0.15/8 17 (Dd4+)} 114. Qe2 {0.00/66 16} Qd4+ {0.19/8 18 } 115. Ke1 {0.00/64 0 (Qe3)} Qg1+ {0.11/8 13} 116. Kd2 {0.00/61 0} Qd4+ { 0.11/8 14} 117. Qd3 {0.00/62 38 (Kc2)} Qf2+ {0.15/9 19} 118. Kc1 {0.00/62 46 (Kc3)} Kg7 {0.11/8 14 (Dc5+)} 119. Qc3+ {0.00/54 11} Kg8 {0.12/10 6} 120. Qf6 { 0.00/60 13 (e5)} Qe1+ {0.14/9 30 (Df1+)} 121. Kb2 {0.00/61 11 (Kc2)} Qb4+ { 0.11/9 14 (Dd2+)} 122. Kc2 {0.00/65 26} Qa4+ {0.13/10 13 (Dc4+)} 123. Kd2 { 0.00/63 15} Qb4+ {0.17/10 9 (Da2+)} 124. Ke2 {0.00/66 11} Qc4+ {0.17/10 22} 125. Kd2 {0.00/68 24 (Ke3)} Qa2+ {0.14/9 13 (Db4+)} 126. Ke3 {0.00/72 31 (Kd3)} Qb3+ {0.14/9 17} 127. Kf2 {0.00/70 0 (Ke2)} Qc2+ {0.10/8 13} 128. Ke1 {0.00/72 9 (Kg3)} Qc1+ {0.04/5 13} 129. Kf2 {0.00/74 41 (Ke2)} Qd2+ {0.00/3 16} 130. Kg1 {0.00/127 0 (Kf1)} 1/2-1/2 [/pgn]
"Good decisions come from experience, and experience comes from bad decisions."
__________________________________________________________________
Ted Summers
Jouni
Posts: 3279
Joined: Wed Mar 08, 2006 8:15 pm

Re: Trying out the Leela Hybrid engine (NN with AB)

Post by Jouni »

Which engine is this Eman? It's topping same rating lists in PlayChess! SF clone?
Jouni
User avatar
AdminX
Posts: 6339
Joined: Mon Mar 13, 2006 2:34 pm
Location: Acworth, GA

Re: Trying out the Leela Hybrid engine (NN with AB)

Post by AdminX »

Jouni wrote: Tue Feb 19, 2019 3:01 pm Which engine is this Eman? It's topping same rating lists in PlayChess! SF clone?
That is the theory that I subscribed to. I believe it is a Stockfish clone. Maybe someone else will correct me If I am wrong.
"Good decisions come from experience, and experience comes from bad decisions."
__________________________________________________________________
Ted Summers
henk2
Posts: 30
Joined: Mon Jan 14, 2019 7:55 am
Full name: Henk Verbaasdonk

Re: Trying out the Leela Hybrid engine (NN with AB)

Post by henk2 »

Why not let Leela play until there are X pieces left and then let Stockfish take over?
No need for an A/B veto early-middle game.
Damir
Posts: 2801
Joined: Mon Feb 11, 2008 3:53 pm
Location: Denmark
Full name: Damir Desevac

Re: Trying out the Leela Hybrid engine (NN with AB)

Post by Damir »

Jouni wrote: Tue Feb 19, 2019 3:01 pm Which engine is this Eman? It's topping same rating lists in PlayChess! SF clone?
http://eman.zohosites.com/
Eduard
Posts: 1439
Joined: Sat Oct 27, 2018 12:58 am
Location: Germany
Full name: N.N.

Re: Trying out the Leela Hybrid engine (NN with AB)

Post by Eduard »

It seems that this Hybrid works only with GPU (CUDA). Right?
User avatar
AdminX
Posts: 6339
Joined: Mon Mar 13, 2006 2:34 pm
Location: Acworth, GA

Re: Trying out the Leela Hybrid engine (NN with AB)

Post by AdminX »

Eduard wrote: Tue Feb 19, 2019 5:34 pm It seems that this Hybrid works only with GPU (CUDA). Right?
I have not tried it with CPU, but I would think that it should work with the CPU version. On second thought, I think you are right. :oops: Only Cuda binary.
"Good decisions come from experience, and experience comes from bad decisions."
__________________________________________________________________
Ted Summers
User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: Trying out the Leela Hybrid engine (NN with AB)

Post by Laskos »

AdminX wrote: Tue Feb 19, 2019 2:52 pm
LeelaFish is a modified version of the Lc0 engine that gets help from an outside (auxiliary) engine. Leela uses the AuxEngine's PV to boost the Policy of those moves.
https://github.com/killerducky/lc0/wiki/LeelaFish
With default settings and SF10 auxiliary on 1 thread, +40 Elo points to pure Lc0 with t30 and t40 nets at bullet TC. Much better tactically. With late t30 nets, strongest engine on my PC.
User avatar
M ANSARI
Posts: 3707
Joined: Thu Mar 16, 2006 7:10 pm

Re: Trying out the Leela Hybrid engine (NN with AB)

Post by M ANSARI »

Well ... it was only a matter of time that someone did the obvious. Kudos to whoever did that!
Milos
Posts: 4190
Joined: Wed Nov 25, 2009 1:47 am

Re: Trying out the Leela Hybrid engine (NN with AB)

Post by Milos »

Laskos wrote: Tue Feb 19, 2019 6:40 pm
AdminX wrote: Tue Feb 19, 2019 2:52 pm
LeelaFish is a modified version of the Lc0 engine that gets help from an outside (auxiliary) engine. Leela uses the AuxEngine's PV to boost the Policy of those moves.
https://github.com/killerducky/lc0/wiki/LeelaFish
With default settings and SF10 auxiliary on 1 thread, +40 Elo points to pure Lc0 with t30 and t40 nets at bullet TC. Much better tactically. With late t30 nets, strongest engine on my PC.
Pity aux engine threads are done in a clumsy way, instead of launching a separate instance of SF for each node on a different thread coz each instance of SF will use very little memory due to low hash requirements of SF search, it launches low-depth SMP SF search that is highly inefficient.