Trying out the Leela Hybrid engine (NN with AB)

[Jaglo]

A quote from the CombiChess page:

"The rules that it uses are fairly simple:
If 2 out of 3 engines give the same best move, then do that move and cancel work of the third.
if all 3 engines say something else, listen to the 'Master engine'. The master engine is simply engine0
if all 3 engines agree, do that move."

LC0 is the "Master engine". If all 3 engines say something else, then LC0 is playing.

If there is a strong tactical play, Stockfish and Houdini will find it. The rule will work: "If 2 out of 3 engines give the same best move, then do that move". The same is true for endings.

[Ozymandias]

A quote from the CombiChess page:

"The rules that it uses are fairly simple:
If 2 out of 3 engines give the same best move, then do that move and cancel work of the third.
if all 3 engines say something else, listen to the 'Master engine'. The master engine is simply engine0
if all 3 engines agree, do that move."

LC0 is the "Master engine". If all 3 engines say something else, then LC0 is playing.

If there is a strong tactical play, Stockfish and Houdini will find it. The rule will work: "If 2 out of 3 engines give the same best move, then do that move". The same is true for endings.

I guess that way of selecting moves works for (most) tactical shots, but I'm not so sure about endings. When heavily probing syzygy, several moves often lead to the same outcome (it's not DTM) so the other engines might not agree on the move and allow Lc0 to mess the position up.

[Jaglo]

I'm sure you're right. I used the ready-to-use solution, but it seems to me that 3 engines is too much. You should use two to avoid the problem of what you write.

[Laskos]

I'm sure you're right. I used the ready-to-use solution, but it seems to me that 3 engines is too much. You should use two to avoid the problem of what you write.

The easiest would be to play Leela for say 35 moves, and then switch to Stockfish. There is a tool that theoretically does that, ChessCombi v1, but for some reason it doesn't work properly for me.

[Jaglo]

I also tried Chesscombi v1 and didn't get any positive results. In my opinion this adapter has bad assumptions.

[Laskos]

I also tried Chesscombi v1 and didn't get any positive results. In my opinion this adapter has bad assumptions.

Based on its output I concluded it is buggy.

[Jaglo]

My personal ranking of hybrids:

1) Leelafish
2) Combichess (Python)
3) Triplebrain (Shredder)
4) Chesscombi v1

killerducky, is the Leelafish project evolving?

[Jaglo]

Another interesting project.

https://github.com/feldi/py-goratschin

Similar to CombiChess, but uses 2 engines. I think the assumptions are OK. Unfortunately, the project is underdeveloped and requires testing (only LC0 works, Stockfish doesn't).

[Nordlandia]

What's leela's assessment of this position. Komodo held it against SF Dev, draw after 5 hours and 13 minutes.

[pgn][Event "i7-5960X 4.5GHz"]
[Site "i7-5960X 4.5GHz"]
[Date "2019.05.19"]
[Round "?"]
[White "komodo-13.01-64bit-bmi2"]
[Black "Stockfish_19051713_x64_bmi2"]
[Result "1/2-1/2"]
[SetUp "1"]
[FEN "r1bqk2r/pp3ppp/8/3p4/3Np3/1P2P3/PB1P1PPP/3Q1RK1 b kq - 0 1"]
[PlyCount "395"]
[EventDate "2019.??.??"]
[TimeControl "3600+30"]

1... O-O {1.53/36 81s} 2. Qh5 {-1.14/38 165s} f5 {1.56/33 69s} 3. Ra1 {-0.90/
40 244s} Bd7 {1.56/36 41} 4. f4 {-0.91/45 319s} Rf6 {1.65/37 51} 5. Qe2 {
-0.87/47 93s} Rh6 {1.54/42 79s} 6. h3 {-0.87/47 348s} Rg6 {1.45/46 68s} 7. Qh5
{-0.86/44 106s} Rh6 {1.45/46 77s} 8. Qe2 {-0.85/48 82s} a6 {1.72/42 82s} 9. Kh2
{-0.84/46 88s} Rg6 {1.53/45 93s} 10. Qe1 {-0.83/43 79s} h6 {1.53/48 211s} 11.
Ne2 {-0.77/41 81s} Kh7 {1.53/43 90s} 12. Be5 {-0.76/53 86s} Qf8 {1.53/47 105s}
13. Nd4 {-0.54/53 84s} Qa3 {1.53/44 43} 14. Nc2 {-0.56/51 97s} Qf8 {1.53/45 47}
15. Nd4 {-0.56/55 86s} Qa3 {1.53/49 50} 16. Nc2 {-0.56/56 80s} Qc5 {1.52/47 52}
17. Nd4 {-0.58/55 89s} Qf8 {1.52/46 64s} 18. a3 {-0.57/56 91s} b5 {1.42/42 62s}
19. Kh1 {-0.56/52 91s} Qe7 {1.53/49 82s} 20. Kh2 {-0.56/53 138s} a5 {1.52/47 50
} 21. Qf2 {-0.56/50 99s} Qd8 {1.52/49 83s} 22. Rc1 {-0.56/51 77s} Rc8 {1.52/50
53} 23. Ra1 {-0.55/54 68s} Ra8 {1.52/52 51} 24. Qe1 {-0.55/52 80s} Qf8 {
1.52/51 55} 25. Qf2 {-0.54/51 84s} Qe7 {1.52/52 67s} 26. Qe1 {-0.54/50 68s} Rc8
{1.52/53 116s} 27. Kh1 {-0.54/49 71s} Rh8 {1.52/52 64s} 28. Qf2 {-0.54/49 70s}
Rf8 {1.52/54 72s} 29. Qg1 {-0.54/50 75s} Qc5 {1.52/54 87s} 30. Qf1 {-0.54/51
76s} Rc8 {1.52/53 69s} 31. Qe1 {-0.53/50 121s} Qe7 {1.52/52 73s} 32. Qf2 {
-0.53/48 70s} Kh8 {1.52/52 75s} 33. Kh2 {-0.52/49 86s} Kg8 {1.52/50 70s} 34.
Kh1 {-0.52/48 82s} Rb6 {1.52/50 63s} 35. Kh2 {-0.52/49 69s} Kh7 {1.52/53 75s}
36. Qe1 {-0.52/49 94s} Rg6 {1.52/54 66s} 37. Kh1 {-0.52/47 67s} Qd8 {1.52/53
148s} 38. Kh2 {-0.52/47 58} Rb6 {1.52/51 63s} 39. Kg1 {-0.52/48 68s} Qe7 {
1.52/51 64s} 40. Kh2 {-0.52/46 61s} Qd8 {1.52/53 95s} 41. Qf2 {-0.52/46 60s}
Kg8 {1.52/52 87s} 42. Qe1 {-0.52/46 79s} Rg6 {1.52/54 111s} 43. Kh1 {-0.52/50
63s} Kh7 {1.52/52 66s} 44. Qf2 {-0.51/49 57} Rb6 {1.52/51 55} 45. Qe2 {-0.51/
47 51} Qe8 {1.52/53 73s} 46. Kh2 {-0.50/48 46} Rg6 {1.52/52 65s} 47. Qe1 {
-0.50/51 48} Qf7 {1.52/47 54} 48. Qf1 {-0.51/50 49} Qe8 {1.52/51 60s} 49. Qe1 {
-0.50/49 45} Qd8 {1.52/54 74s} 50. Kh1 {-0.50/50 40} Qe7 {1.52/50 52} 51. Kh2 {
-0.50/51 45} Qd8 {1.52/51 57} 52. Qf2 {-0.49/49 67s} Rc5 {1.52/49 50} 53. Qe1 {
-0.48/48 37} Ra6 {1.52/50 53} 54. Qf2 {-0.49/47 42} Rg6 {1.52/50 46} 55. Re1 {
-0.48/47 37} Qc8 {1.52/54 55} 56. Qf1 {-0.48/47 36} Qg8 {1.52/49 48} 57. Ra1 {
-0.48/48 40} Qf7 {1.52/53 57} 58. Kh1 {-0.48/47 35} Qe7 {1.39/49 444s} 59. Qe1
{-0.48/50 37} a4 {1.33/52 58} 60. b4 {-0.48/52 44} Rc4 {1.33/48 41} 61. Kh2 {
-0.49/50 38} Qf8 {1.33/48 38} 62. Rc1 {-0.48/48 44} Qe7 {1.33/49 35} 63. Rd1 {
-0.48/50 35} Rc8 {1.33/52 36} 64. Ra1 {-0.48/51 35} Qf7 {1.33/55 159s} 65. Rd1
{-0.47/51 44} Kh8 {1.33/53 57} 66. Rc1 {-0.47/50 41} Rc4 {1.33/53 32} 67. Rd1 {
-0.48/50 39} Kg8 {1.33/52 31} 68. Ra1 {-0.48/47 38} Qe7 {1.33/54 38} 69. Rd1 {
-0.48/45 37} Qf8 {1.33/54 39} 70. Qf2 {-0.48/48 32} Qc8 {1.33/52 31} 71. Qf1 {
-0.46/48 44} Qe8 {1.33/49 31} 72. Qe1 {-0.46/44 33} Rc8 {1.33/53 33} 73. Rc1 {
-0.40/45 31} Rc4 {1.33/52 33} 74. Ra1 {-0.46/47 39} Kh7 {1.33/50 41} 75. Qf2 {
-0.45/46 38} Qf7 {1.33/49 42} 76. Rg1 {-0.45/49 32} Qe7 {1.33/52 32} 77. Re1 {
-0.45/48 34} Rc8 {1.33/52 37} 78. Rd1 {-0.45/46 55} Qf7 {1.33/51 38} 79. Rb1 {
-0.43/45 31} Qe7 {1.33/50 30} 80. Re1 {-0.44/44 29} Kh8 {1.33/53 38} 81. Rd1 {
-0.44/48 31} Qe8 {1.33/53 31} 82. Re1 {-0.44/50 38} Kg8 {1.33/52 35} 83. Rd1 {
-0.44/49 31} Rb6 {1.33/51 31} 84. Qh4 {-0.44/44 37} Kh7 {1.33/49 30} 85. Qf2 {
-0.45/46 34} Qe7 {1.33/51 37} 86. Rf1 {-0.44/48 38} Rg6 {1.33/53 45} 87. Kh1 {
-0.43/46 35} Kg8 {1.33/51 28} 88. Re1 {-0.43/46 28} Rb6 {1.33/51 35} 89. Rf1 {
-0.43/44 31} Rg6 {1.33/51 33} 90. Rg1 {-0.43/45 31} Qe8 {1.33/51 30} 91. Qf1 {
-0.42/46 32} Rb6 {1.33/50 32} 92. Qd1 {-0.42/47 29} Qg6 {1.33/49 35} 93. Kh2 {
-0.42/46 34} Qf7 {1.24/48 287s} 94. Qe2 {-0.42/46 32} g5 {1.23/44 80s} 95. Rf1
{-0.40/44 33} Qe7 {1.23/43 13} 96. Qh5 {-0.41/41 33} Kh7 {1.23/44 30} 97. Kh1 {
-0.41/46 35} Qe8 {1.23/45 27} 98. Qe2 {-0.41/47 36} Kg8 {1.23/44 20} 99. g3 {
-0.41/45 27} Kh7 {1.23/48 21} 100. Kg2 {-0.41/49 29} Kg8 {1.23/45 21} 101. Kh2
{-0.41/48 31} Rg6 {1.23/46 24} 102. Qf2 {-0.41/46 28} Kh7 {1.23/45 22} 103. Qe2
{-0.41/49 35} Kg8 {1.23/48 33} 104. Qh5 {-0.41/46 30} Rb6 {1.23/46 23} 105. Qd1
{-0.42/47 34} Rg6 {1.23/49 32} 106. Qh5 {-0.41/47 35} Kh7 {1.23/49 27} 107. Qe2
{-0.42/50 31} Rg8 {1.23/45 21} 108. Qe1 {-0.42/48 31} Rc4 {1.23/46 23} 109. Qf2
{-0.42/40 28} Qe7 {1.23/47 60s} 110. Kg2 {-0.42/43 28} Rgc8 {1.23/43 17} 111.
Qe1 {-0.42/45 27} Rg8 {1.23/47 21} 112. Qa1 {-0.42/44 35} Rg6 {1.23/46 26} 113.
Kh2 {-0.42/45 31} Rb6 {1.23/45 24} 114. Qd1 {-0.42/46 29} Rg6 {1.23/49 27} 115.
Qe2 {-0.42/46 27} Qe8 {1.23/48 23} 116. Qf2 {-0.42/42 27} Kg8 {1.23/46 24} 117.
Qe2 {-0.42/47 30} Kh7 {1.23/49 27} 118. Kg2 {-0.42/48 33} Qe7 {1.23/46 23} 119.
Qh5 {-0.41/44 39} Rg8 {1.23/46 23} 120. Qe2 {-0.41/47 31} Qe8 {1.23/45 25} 121.
Qf2 {-0.41/44 37} Qe7 {1.23/47 32} 122. Qe2 {-0.41/43 31} Rf8 {1.23/47 31} 123.
Qe1 {-0.41/45 27} Re8 {1.23/49 28} 124. Qd1 {-0.41/45 27} Rcc8 {1.23/47 33}
125. Qh5 {-0.41/47 27} Rf8 {1.23/49 25} 126. Qe2 {-0.41/46 28} Rc4 {1.23/49 28}
127. Qd1 {-0.42/46 29} Re8 {1.23/47 27} 128. Qh5 {-0.42/42 38} Rf8 {1.23/48 43}
129. Qe2 {-0.42/44 28} Kg6 {1.23/44 27} 130. Qd1 {-0.42/43 27} Rfc8 {1.22/42 38
} 131. Qe1 {-0.42/44 29} Kh7 {1.22/46 45} 132. Qa1 {-0.43/44 38} Ra8 {1.22/45
26} 133. Qe1 {-0.43/45 34} Ra6 {1.22/44 52} 134. Qf2 {-0.43/45 98s} Rg6 {
1.13/46 44} 135. Kh2 {-0.42/46 23} Qf7 {1.13/42 24} 136. Ra1 {-0.42/43 26} Rc8
{1.13/40 23} 137. Rf1 {-0.42/47 26} Kg8 {1.13/43 29} 138. Kg2 {-0.42/44 24} Qe7
{1.13/44 24} 139. Qe2 {-0.42/46 29} gxf4 {1.13/44 22} 140. Bxf4 {-0.42/47 24}
Qf6 {1.13/50 41} 141. Kh1 {-0.42/46 32} Kh7 {1.13/47 24} 142. Kh2 {-0.41/46 36}
Rg7 {1.13/46 26} 143. Qh5 {-0.41/46 30} Rc4 {1.13/46 25} 144. Qe2 {-0.41/45 24}
Rg6 {1.13/48 24} 145. Qf2 {-0.41/45 29} Rg8 {1.13/49 34} 146. Qe2 {-0.41/47 38}
Rg7 {1.13/50 35} 147. Qh5 {-0.41/44 25} Rc8 {1.13/49 27} 148. Qe2 {-0.41/44 33}
Qg6 {1.13/48 25} 149. Qf2 {-0.41/47 25} Qh5 {1.13/47 30} 150. Qg2 {-0.41/40 26}
Qg6 {1.13/50 24} 151. Qe2 {-0.41/46 51} Rf7 {1.13/48 31} 152. Be5 {-0.41/44 24}
Re7 {1.13/48 27} 153. Bf4 {-0.41/45 26} Rc4 {1.13/48 32} 154. Qf2 {-0.41/44 30}
Re8 {1.13/49 29} 155. Qe1 {-0.41/45 34} Qf6 {1.13/49 29} 156. Qf2 {-0.41/44 26}
Rec8 {1.13/49 26} 157. Qe1 {-0.41/43 25} Rg8 {1.13/48 27} 158. Qf2 {-0.41/46 29
} Rf8 {1.13/49 24} 159. Qe2 {-0.41/44 25} Kg6 {1.13/48 25} 160. Qf2 {-0.41/45
29} Re8 {1.13/45 27} 161. Qe2 {-0.41/44 27} Rg8 {1.13/48 35} 162. Rg1 {-0.41/
42 26} Rf8 {1.13/48 26} 163. Rf1 {-0.41/44 25} Kh7 {1.13/48 25} 164. Qf2 {
-0.41/45 25} Qg6 {1.13/49 33} 165. Qe1 {-0.40/42 29} Rf7 {1.13/48 30} 166. Qf2
{-0.40/40 43} Qf6 {1.13/48 24} 167. Qe1 {-0.40/42 26} Qg6 {1.13/50 66s} 168.
Qd1 {-0.40/43 35} Rc8 {1.13/49 25} 169. Rf2 {-0.40/44 27} Rg7 {1.13/45 28} 170.
Qf1 {-0.40/42 25} Rc4 {1.13/47 27} 171. Qa1 {-0.39/44 33} Qf6 {1.13/46 28} 172.
Rf1 {-0.38/42 33} Kg8 {1.13/43 29} 173. Kh1 {-0.36/41 27} Rg6 {1.13/43 31} 174.
Qd1 {-0.31/40 26} Kh7 {1.13/41 26} 175. Kh2 {-0.28/42 29} Qg7 {1.12/45 56} 176.
Qe2 {-0.26/43 35} Qf8 {1.12/42 47} 177. Qf2 {-0.26/43 29} Qe7 {1.03/42 63s}
178. Re1 {-0.25/43 26} Rc8 {1.03/45 33} 179. Qe2 {-0.25/44 31} Qg7 {1.03/46 21}
180. Rb1 {0.00/37 39} Qf6 {1.03/45 111s} 181. Rd1 {-0.25/43 25} Rc4 {1.03/41 23
} 182. Rf1 {0.00/46 26} Rg8 {1.03/43 42} 183. Qd1 {-0.25/41 26} Rf8 {0.73/42
117s} 184. Qe2 {-0.24/43 49} Kg6 {0.73/34 25} 185. Rg1 {-0.24/43 26} Rfc8 {
1.03/40 11} 186. Qe1 {-0.24/43 30} Kh7 {0.40/43 79s} 187. Qa1 {-0.12/43 55} Re8
{0.40/44 13} 188. Re1 {-0.12/44 24} Rf8 {0.40/44 14} 189. Rg1 {-0.12/43 27} h5
{0.40/47 21} 190. Qd1 {-0.12/44 30} Qg6 {0.40/45 18} 191. Rf1 {-0.12/42 32}
Rcc8 {0.40/44 17} 192. Ne2 {-0.11/36 35} Rg8 {0.40/42 21} 193. Rf2 {-0.13/37 48
} Qf7 {0.40/44 26} 194. h4 {0.00/40 23} Rc6 {0.00/42 100s} 195. Nc3 {0.00/41 26
} Ra6 {0.00/37 11} 196. Ne2 {0.00/38 27} Qg7 {0.00/39 21} 197. Nd4 {0.00/42 27}
Qf7 {0.00/43 21} 198. Bg5 {0.00/43 24} Rc8 {adjudication 0.00/41 15s, Draw by
adjudication} 1/2-1/2

[/pgn]

[Eduard]

Dear killerducky,
is it possible to release now a leelafish for android?