TalkChess.com

mwyoung wrote: ↑Sun Jan 03, 2021 10:02 pm Some observations of Ceres in the current version being tested.

1. Ceres is +100 Elo. False
2. Ceres is 2.3x faster. False.
3. And Lc0 is out searching Ceres by many ply with the same size net.

Current score Lc0 vs Ceres. +2 =28 -0 +23 Elo for Lc0

I will switch Lc0 to the same exact NN after this test.

DESKTOP-CORSAIR, Blitz 3.0min+2.0sec  0

                           
1   Lc0 v0.26.3 (1)   +17  +2/=38/-0 52.50%   21.0/40
2   Ceres             -17  +0/=38/-2 47.50%   19.0/40

Albert Silver wrote: ↑Sat Jan 02, 2021 3:56 pm

MMarco wrote: ↑Sat Jan 02, 2021 2:44 pm

Albert Silver wrote: ↑Sat Jan 02, 2021 1:02 am How does that compare with Lc0 v26?

I did a quick bench on my 3080 of CERES and LC0-26.3-cuda. Default settings for CERES, defaults and NNcache=10M, smart-pruning-factor=0 for Lc0. The measured "speedup" (if we can say so, we are comparing nps from two different engines): 30x384 = 15%, 20x256 = 28%, 10x128 = 68%.

Startposition, go movetime 60000

30x384
*****************
LC0-66740
info depth 12 seldepth 42 time 59800 nodes 1383904 score cp 10 nps 25720
CERES-66740
info depth 14 seldepth 36 time 60006 nodes 1773283 score cp 8 nps 29552

20x256
******************
LC0-LS-15
info depth 23 seldepth 68 time 59800 nodes 4135219 score cp 15 nps 77013
CERES-LS-15
info depth 25 seldepth 53 time 56979 nodes 5618322 score cp 11 nps 98603

10x128
*******************
LC0-703810
info depth 14 seldepth 50 time 59800 nodes 8140461 score cp 12 nps 151242
CERES-703810
info depth 17 seldepth 51 time 59991 nodes 15210428 score cp 11 nps 253544

Ok, thanks. This is very interesting and actually seems to match what I suspected is happening. While there may be a normal speedup, if modest, over Lc0 v26, its biggest strength (for play, not for development) is removing the scaling shackles. Meaning smaller nets will gain the most from powerful cards, and above all will suffer less from the scaling issues on multi-gpu setups. Time will tell how accurate this read is, but it is what I am gathering from the results.

cc2150dx wrote: ↑Mon Jan 04, 2021 12:07 am Odd exceptions:

[pgn][Event "Jason, Blitz 5.0min+3.0sec"]
[Site "?"]
[Date "2021.01.03"]
[Round "4"]
[White "Stockfish 311220"]
[Black "Ceres"]
[Result "*"]
[ECO "B69"]
[Annotator "0.54;0.24"]
[PlyCount "139"]
[TimeControl "300+3"]

{AMD Ryzen 5 3600 6-Core Processor 3600 MHz W=39.9 plies; 14,009kN/s;
11,009,283 TBAs B=7.6 plies; 44kN/s; 4,598 TBAs} 1. e4 c5 2. Nf3 Nc6 3. d4 cxd4
4. Nxd4 Nf6 5. Nc3 d6 6. Bg5 e6 7. Qd2 a6 8. O-O-O {Both last book move} Bd7 {
0.24/15 19} 9. f4 {0.54/35 40} Be7 {0.22/8 12} 10. Nf3 {0.46/35 6} b5 {0.21/5 7
} 11. Bxf6 {0.55/31 6} gxf6 {0.20/0 0} 12. f5 {0.37/38 45} Qb6 {0.20/9 14} 13.
Kb1 {0.32/30 4} O-O-O {0.20/6 11} 14. a3 {0.44/35 29} Kb8 {0.19/9 14} 15. Be2 {
0.36/35 6 (Nd4)} Rc8 {0.12/11 19 (Rdg8)} 16. Nd4 {0.38/31 5} Ne5 {0.14/9 12}
17. Nb3 {0.47/38 66 (Rhf1)} Rc7 {0.09/11 17} 18. Qd4 {0.37/31 3} Kb7 {0.11/7
13 (Qxd4)} 19. Qxb6+ {0.42/31 6 (g4)} Kxb6 {0.25/14 14} 20. Bh5 {0.49/34 16}
Rg8 {0.28/8 12 (a5)} 21. Nd4 {0.79/27 3} Bc8 {0.29/5 6} 22. g3 {0.84/30 8} Rg5
{0.28/0 0} 23. Be2 {0.75/32 11} Ng4 {0.27/6 11 (Nc4)} 24. Bxg4 {0.64/36 26}
Rxg4 {0.27/5 8} 25. Rd3 {0.36/33 12 (Rhe1)} Kb7 {0.27/8 15} 26. h3 {0.51/31 4
(Rf1)} Rg5 {0.24/10 13} 27. Re1 {0.43/34 26 (g4)} h5 {0.18/9 12} 28. Ree3 {
0.37/30 3 (Rf1)} Kb8 {0.15/9 13} 29. b3 {0.44/33 11 (Rd1)} Rc5 {0.17/9 13} 30.
Nce2 {0.44/32 4 (Kb2)} Bf8 {0.15/11 11 (Bd7)} 31. Kb2 {0.20/37 5} Bd7 {0.15/7
10} 32. b4 {0.20/37 4 (Rd1)} Rc4 {0.14/10 10 (Rc8)} 33. Nf3 {0.30/31 5 (Rd1)}
Rg8 {0.15/11 10 (Rg7)} 34. Nd2 {0.30/32 4} Rc8 {0.15/7 6} 35. Nf4 {0.26/36 3}
h4 {0.16/6 6 (exf5)} 36. fxe6 {0.06/34 4} fxe6 {0.15/4 4} 37. gxh4 {0.00/40 3}
f5 {0.17/0 0} 38. exf5 {0.04/40 5} exf5 {0.16/8 7} 39. c3 {0.00/42 3} Bh6 {
0.14/9 7} 40. Rf3 {0.00/45 3} Bc6 {0.13/6 5} 41. Rf2 {0.09/43 7} Kc7 {0.13/0 0
(Be4)} 42. Nd5+ {0.10/33 3} Bxd5 {0.12/4 4} 43. Rxd5 {0.06/34 3} Rcf8 {0.12/0 0
} 44. Nf3 {0.00/38 3 (Kc2)} Be3 {0.13/11 8} 45. Rf1 {0.07/36 3} Rg3 {0.12/7 8}
46. a4 {0.00/40 3 (Kb3)} bxa4 {0.13/7 7} 47. Ka3 {0.00/39 6} f4 {0.13/6 9 (Bb6)
} 48. Kxa4 {0.00/39 3} Kc6 {0.13/4 6} 49. Rg5 {0.00/40 4} Rxh3 {0.12/7 6} 50.
Kb3 {0.00/42 3} Rg3 {0.12/6 8 (Rf6)} 51. Ra5 {0.00/39 6} Kb7 {0.11/7 7} 52. Rg5
{0.00/40 3 (Rd5)} Kc6 {0.10/8 6} 53. Ra5 {0.00/44 3 (Rh5)} Kb7 {0.11/9 6} 54.
Rh5 {0.00/44 3 (Rd5)} Bb6 {0.12/9 7 (Kc6)} 55. Rh7+ {0.00/32 3 (Rh6)} Kc6 {
0.14/10 5} 56. Rh6 {0.00/35 3} a5 {0.14/6 4} 57. Rd1 {0.00/43 6 (Ne5+)} Rxf3 {
0.16/14 5} 58. Rdxd6+ {0.00/47 2} Kc7 {0.14/8 4} 59. Rc6+ {0.00/52 3} Kd7 {
0.13/6 4} 60. Rxb6 {0.00/55 3} axb4 {0.13/4 3} 61. Kxb4 {0.00/46 4} Rf1 {
0.13/6 5 (Rh3)} 62. Kc4 {0.00/47 6 (Rbd6+)} f3 {0.07/10 5} 63. Rh7+ {0.00/50 2
(Rbd6+)} Kc8 {0.01/7 4} 64. Rc6+ {0.00/58 6} Kb8 {0.02/5 4} 65. Rb6+ {0.00/44
5 (Rcc7)} Kc8 {0.00/2 6 (Ka8)} 66. Ra6 {0.00/49 2} Kb8 {0.00/6 5 (Rb1)} 67.
Raa7 {0.00/59 3} f2 {0.01/4 5 (Rf4+)} 68. Rab7+ {0.00/62 3 (Rhb7+)} Ka8 {
0.01/2 5} 69. Ra7+ {0.00/66 2} Kb8 {0.01/0 0} 70. Rhb7+ {0.00/73 2 Ceres: no
move Ceres caused an exception, game stopped.} *

[/pgn]

[pgn][Event "Jason, Blitz 5.0min+3.0sec"]
[Site "?"]
[Date "2021.01.03"]
[Round "1"]
[White "Ceres"]
[Black "Stockfish 311220"]
[Result "*"]
[ECO "B80"]
[Annotator "0.31;0.13"]
[PlyCount "130"]
[TimeControl "300+3"]

{AMD Ryzen 5 3600 6-Core Processor 3600 MHz W=8.9 plies; 38kN/s; 4,792
TBAs B=44.4 plies; 14,944kN/s; 20,040,044 TBAs} 1. Nf3 c5 2. e4 d6 3. d4 cxd4
4. Nxd4 Nf6 5. Nc3 a6 6. Be3 e6 7. f3 b5 {Both last book move} 8. Qd2 {0.31/19
16} b4 {0.13/35 36 (Nbd7)} 9. Na4 {0.27/20 15} Nbd7 {0.24/30 5} 10. O-O-O {
0.25/8 6} Qa5 {0.25/33 5} 11. b3 {0.25/0 0} Bb7 {0.10/33 8} 12. Kb1 {0.29/8 6
(h4)} Nc5 {0.00/35 9} 13. a3 {0.28/0 0} Nxa4 {0.18/32 5} 14. axb4 {0.30/6 5}
Qc7 {0.08/34 8} 15. bxa4 {0.30/0 0} Be7 {0.21/35 13 (d5)} 16. c3 {0.30/10 10}
O-O {0.00/34 6} 17. Rc1 {0.31/5 8 (Kb2)} Rfb8 {0.44/33 16} 18. Bd3 {0.28/7 10}
Bc8 {0.39/35 17 (e5)} 19. g4 {0.27/15 15 (Rhd1)} e5 {0.26/31 9} 20. Nf5 {
0.32/10 9} Bxf5 {0.24/32 6} 21. gxf5 {0.30/0 0} d5 {0.17/33 6} 22. exd5 {
0.32/7 11} Nxd5 {0.16/36 7} 23. f6 {0.35/0 0} Nxf6 {0.30/37 8} 24. Rhd1 {
0.36/4 6} Rd8 {0.08/37 7 (g6)} 25. Qa2 {0.45/14 16} Qc6 {0.11/37 6} 26. a5 {
0.27/10 11} Nd5 {0.14/37 8} 27. Bd2 {0.22/7 7} Rd6 {0.00/41 6} 28. Qc4 {
0.15/7 9 (Be4)} Qd7 {0.00/38 5} 29. Bc2 {0.16/0 0} Rd8 {0.00/36 8 (g6)} 30. Bb3
{0.14/15 19} h5 {0.12/37 6 (g6)} 31. Kb2 {0.25/14 14} Bf6 {0.00/41 5} 32. Ka3 {
0.17/9 11} Qh3 {0.00/44 19} 33. Rg1 {0.19/6 11} Kh8 {0.00/47 5} 34. Be1 {
0.25/10 12} Qxf3 {0.00/46 5 (Qxh2)} 35. Bh4 {0.14/10 15} Ne3 {0.00/52 6 (Bxh4)}
36. Qxf7 {0.11/11 11} R6d7 {0.00/54 7} 37. Rg3 {0.10/0 0 (Qg6)} Qf5 {0.00/55 6}
38. Qe6 {0.10/0 0} Qf4 {0.00/55 7} 39. Rxe3 {0.07/5 9 (Bxf6)} Qxe3 {0.00/42 6}
40. Re1 {0.07/3 5} Qxc3 {0.00/50 7} 41. Qf5 {0.07/0 0 (Bxf6)} Qd3 {-0.17/32 5
(Rd5)} 42. Qxh5+ {-0.41/18 11} Qh7 {-0.30/30 1} 43. Qxh7+ {-0.37/9 8} Kxh7 {
-0.20/28 1} 44. Bf2 {-0.34/6 8} Rd3 {-0.06/42 30 (Rd2)} 45. Bb6 {-0.31/8 8} Rc8
{-0.05/39 3} 46. Bc5 {-0.30/6 7} Rf3 {0.00/39 7 (Rc3)} 47. Ka4 {-0.27/9 8} Rf4
{-0.06/45 7} 48. Bc2+ {-0.25/6 8} g6 {0.00/43 5} 49. Kb3 {-0.25/5 7} Rf3+ {
0.00/42 7} 50. Kc4 {-0.24/5 7} Rf4+ {0.00/46 8 (Rh3)} 51. Kb3 {-0.11/11 9 (Kd5)
} Rf3+ {0.00/44 5 (Bg7)} 52. Kc4 {-0.25/12 10} Bg7 {0.00/46 11} 53. Re4 {
-0.23/10 9} Kh6 {0.00/43 6 (Rf4)} 54. Bd3 {-0.13/12 8 (Re2)} g5 {0.00/47 5
(Bf8)} 55. h4 {-0.09/12 7} gxh4 {0.00/48 5} 56. Rxh4+ {-0.08/9 6} Kg5 {0.00/45
1} 57. Re4 {-0.07/5 6} Bf8 {0.00/52 5 (Re8)} 58. Rxe5+ {-0.05/9 6} Kf6 {
0.00/57 5} 59. Rd5 {-0.05/5 6} Bxc5 {0.00/56 7} 60. bxc5 {-0.04/6 6} Ke7 {
0.00/60 5} 61. Re5+ {-0.04/5 6} Kd8 {0.00/64 5} 62. Re6 {-0.03/5 6} Rc7 {
0.00/67 5 (Kc7)} 63. Rxa6 {-0.01/4 6} Rxd3 {0.00/83 5 (Rxc5+)} 64. Kxd3 {
-0.01/0 7} Rxc5 {0.00/143 5} 65. Rh6 {0.01/0 0} Kc7 {0.00/44 5 Ceres: no move
Ceres caused an exception, game stopped.} *

[/pgn]

mwyoung wrote: ↑Mon Jan 04, 2021 12:18 am

cc2150dx wrote: ↑Mon Jan 04, 2021 12:07 am Odd exceptions:

[pgn][Event "Jason, Blitz 5.0min+3.0sec"]
[Site "?"]
[Date "2021.01.03"]
[Round "4"]
[White "Stockfish 311220"]
[Black "Ceres"]
[Result "*"]
[ECO "B69"]
[Annotator "0.54;0.24"]
[PlyCount "139"]
[TimeControl "300+3"]

{AMD Ryzen 5 3600 6-Core Processor 3600 MHz W=39.9 plies; 14,009kN/s;
11,009,283 TBAs B=7.6 plies; 44kN/s; 4,598 TBAs} 1. e4 c5 2. Nf3 Nc6 3. d4 cxd4
4. Nxd4 Nf6 5. Nc3 d6 6. Bg5 e6 7. Qd2 a6 8. O-O-O {Both last book move} Bd7 {
0.24/15 19} 9. f4 {0.54/35 40} Be7 {0.22/8 12} 10. Nf3 {0.46/35 6} b5 {0.21/5 7
} 11. Bxf6 {0.55/31 6} gxf6 {0.20/0 0} 12. f5 {0.37/38 45} Qb6 {0.20/9 14} 13.
Kb1 {0.32/30 4} O-O-O {0.20/6 11} 14. a3 {0.44/35 29} Kb8 {0.19/9 14} 15. Be2 {
0.36/35 6 (Nd4)} Rc8 {0.12/11 19 (Rdg8)} 16. Nd4 {0.38/31 5} Ne5 {0.14/9 12}
17. Nb3 {0.47/38 66 (Rhf1)} Rc7 {0.09/11 17} 18. Qd4 {0.37/31 3} Kb7 {0.11/7
13 (Qxd4)} 19. Qxb6+ {0.42/31 6 (g4)} Kxb6 {0.25/14 14} 20. Bh5 {0.49/34 16}
Rg8 {0.28/8 12 (a5)} 21. Nd4 {0.79/27 3} Bc8 {0.29/5 6} 22. g3 {0.84/30 8} Rg5
{0.28/0 0} 23. Be2 {0.75/32 11} Ng4 {0.27/6 11 (Nc4)} 24. Bxg4 {0.64/36 26}
Rxg4 {0.27/5 8} 25. Rd3 {0.36/33 12 (Rhe1)} Kb7 {0.27/8 15} 26. h3 {0.51/31 4
(Rf1)} Rg5 {0.24/10 13} 27. Re1 {0.43/34 26 (g4)} h5 {0.18/9 12} 28. Ree3 {
0.37/30 3 (Rf1)} Kb8 {0.15/9 13} 29. b3 {0.44/33 11 (Rd1)} Rc5 {0.17/9 13} 30.
Nce2 {0.44/32 4 (Kb2)} Bf8 {0.15/11 11 (Bd7)} 31. Kb2 {0.20/37 5} Bd7 {0.15/7
10} 32. b4 {0.20/37 4 (Rd1)} Rc4 {0.14/10 10 (Rc8)} 33. Nf3 {0.30/31 5 (Rd1)}
Rg8 {0.15/11 10 (Rg7)} 34. Nd2 {0.30/32 4} Rc8 {0.15/7 6} 35. Nf4 {0.26/36 3}
h4 {0.16/6 6 (exf5)} 36. fxe6 {0.06/34 4} fxe6 {0.15/4 4} 37. gxh4 {0.00/40 3}
f5 {0.17/0 0} 38. exf5 {0.04/40 5} exf5 {0.16/8 7} 39. c3 {0.00/42 3} Bh6 {
0.14/9 7} 40. Rf3 {0.00/45 3} Bc6 {0.13/6 5} 41. Rf2 {0.09/43 7} Kc7 {0.13/0 0
(Be4)} 42. Nd5+ {0.10/33 3} Bxd5 {0.12/4 4} 43. Rxd5 {0.06/34 3} Rcf8 {0.12/0 0
} 44. Nf3 {0.00/38 3 (Kc2)} Be3 {0.13/11 8} 45. Rf1 {0.07/36 3} Rg3 {0.12/7 8}
46. a4 {0.00/40 3 (Kb3)} bxa4 {0.13/7 7} 47. Ka3 {0.00/39 6} f4 {0.13/6 9 (Bb6)
} 48. Kxa4 {0.00/39 3} Kc6 {0.13/4 6} 49. Rg5 {0.00/40 4} Rxh3 {0.12/7 6} 50.
Kb3 {0.00/42 3} Rg3 {0.12/6 8 (Rf6)} 51. Ra5 {0.00/39 6} Kb7 {0.11/7 7} 52. Rg5
{0.00/40 3 (Rd5)} Kc6 {0.10/8 6} 53. Ra5 {0.00/44 3 (Rh5)} Kb7 {0.11/9 6} 54.
Rh5 {0.00/44 3 (Rd5)} Bb6 {0.12/9 7 (Kc6)} 55. Rh7+ {0.00/32 3 (Rh6)} Kc6 {
0.14/10 5} 56. Rh6 {0.00/35 3} a5 {0.14/6 4} 57. Rd1 {0.00/43 6 (Ne5+)} Rxf3 {
0.16/14 5} 58. Rdxd6+ {0.00/47 2} Kc7 {0.14/8 4} 59. Rc6+ {0.00/52 3} Kd7 {
0.13/6 4} 60. Rxb6 {0.00/55 3} axb4 {0.13/4 3} 61. Kxb4 {0.00/46 4} Rf1 {
0.13/6 5 (Rh3)} 62. Kc4 {0.00/47 6 (Rbd6+)} f3 {0.07/10 5} 63. Rh7+ {0.00/50 2
(Rbd6+)} Kc8 {0.01/7 4} 64. Rc6+ {0.00/58 6} Kb8 {0.02/5 4} 65. Rb6+ {0.00/44
5 (Rcc7)} Kc8 {0.00/2 6 (Ka8)} 66. Ra6 {0.00/49 2} Kb8 {0.00/6 5 (Rb1)} 67.
Raa7 {0.00/59 3} f2 {0.01/4 5 (Rf4+)} 68. Rab7+ {0.00/62 3 (Rhb7+)} Ka8 {
0.01/2 5} 69. Ra7+ {0.00/66 2} Kb8 {0.01/0 0} 70. Rhb7+ {0.00/73 2 Ceres: no
move Ceres caused an exception, game stopped.} *

[/pgn]

[pgn][Event "Jason, Blitz 5.0min+3.0sec"]
[Site "?"]
[Date "2021.01.03"]
[Round "1"]
[White "Ceres"]
[Black "Stockfish 311220"]
[Result "*"]
[ECO "B80"]
[Annotator "0.31;0.13"]
[PlyCount "130"]
[TimeControl "300+3"]

{AMD Ryzen 5 3600 6-Core Processor 3600 MHz W=8.9 plies; 38kN/s; 4,792
TBAs B=44.4 plies; 14,944kN/s; 20,040,044 TBAs} 1. Nf3 c5 2. e4 d6 3. d4 cxd4
4. Nxd4 Nf6 5. Nc3 a6 6. Be3 e6 7. f3 b5 {Both last book move} 8. Qd2 {0.31/19
16} b4 {0.13/35 36 (Nbd7)} 9. Na4 {0.27/20 15} Nbd7 {0.24/30 5} 10. O-O-O {
0.25/8 6} Qa5 {0.25/33 5} 11. b3 {0.25/0 0} Bb7 {0.10/33 8} 12. Kb1 {0.29/8 6
(h4)} Nc5 {0.00/35 9} 13. a3 {0.28/0 0} Nxa4 {0.18/32 5} 14. axb4 {0.30/6 5}
Qc7 {0.08/34 8} 15. bxa4 {0.30/0 0} Be7 {0.21/35 13 (d5)} 16. c3 {0.30/10 10}
O-O {0.00/34 6} 17. Rc1 {0.31/5 8 (Kb2)} Rfb8 {0.44/33 16} 18. Bd3 {0.28/7 10}
Bc8 {0.39/35 17 (e5)} 19. g4 {0.27/15 15 (Rhd1)} e5 {0.26/31 9} 20. Nf5 {
0.32/10 9} Bxf5 {0.24/32 6} 21. gxf5 {0.30/0 0} d5 {0.17/33 6} 22. exd5 {
0.32/7 11} Nxd5 {0.16/36 7} 23. f6 {0.35/0 0} Nxf6 {0.30/37 8} 24. Rhd1 {
0.36/4 6} Rd8 {0.08/37 7 (g6)} 25. Qa2 {0.45/14 16} Qc6 {0.11/37 6} 26. a5 {
0.27/10 11} Nd5 {0.14/37 8} 27. Bd2 {0.22/7 7} Rd6 {0.00/41 6} 28. Qc4 {
0.15/7 9 (Be4)} Qd7 {0.00/38 5} 29. Bc2 {0.16/0 0} Rd8 {0.00/36 8 (g6)} 30. Bb3
{0.14/15 19} h5 {0.12/37 6 (g6)} 31. Kb2 {0.25/14 14} Bf6 {0.00/41 5} 32. Ka3 {
0.17/9 11} Qh3 {0.00/44 19} 33. Rg1 {0.19/6 11} Kh8 {0.00/47 5} 34. Be1 {
0.25/10 12} Qxf3 {0.00/46 5 (Qxh2)} 35. Bh4 {0.14/10 15} Ne3 {0.00/52 6 (Bxh4)}
36. Qxf7 {0.11/11 11} R6d7 {0.00/54 7} 37. Rg3 {0.10/0 0 (Qg6)} Qf5 {0.00/55 6}
38. Qe6 {0.10/0 0} Qf4 {0.00/55 7} 39. Rxe3 {0.07/5 9 (Bxf6)} Qxe3 {0.00/42 6}
40. Re1 {0.07/3 5} Qxc3 {0.00/50 7} 41. Qf5 {0.07/0 0 (Bxf6)} Qd3 {-0.17/32 5
(Rd5)} 42. Qxh5+ {-0.41/18 11} Qh7 {-0.30/30 1} 43. Qxh7+ {-0.37/9 8} Kxh7 {
-0.20/28 1} 44. Bf2 {-0.34/6 8} Rd3 {-0.06/42 30 (Rd2)} 45. Bb6 {-0.31/8 8} Rc8
{-0.05/39 3} 46. Bc5 {-0.30/6 7} Rf3 {0.00/39 7 (Rc3)} 47. Ka4 {-0.27/9 8} Rf4
{-0.06/45 7} 48. Bc2+ {-0.25/6 8} g6 {0.00/43 5} 49. Kb3 {-0.25/5 7} Rf3+ {
0.00/42 7} 50. Kc4 {-0.24/5 7} Rf4+ {0.00/46 8 (Rh3)} 51. Kb3 {-0.11/11 9 (Kd5)
} Rf3+ {0.00/44 5 (Bg7)} 52. Kc4 {-0.25/12 10} Bg7 {0.00/46 11} 53. Re4 {
-0.23/10 9} Kh6 {0.00/43 6 (Rf4)} 54. Bd3 {-0.13/12 8 (Re2)} g5 {0.00/47 5
(Bf8)} 55. h4 {-0.09/12 7} gxh4 {0.00/48 5} 56. Rxh4+ {-0.08/9 6} Kg5 {0.00/45
1} 57. Re4 {-0.07/5 6} Bf8 {0.00/52 5 (Re8)} 58. Rxe5+ {-0.05/9 6} Kf6 {
0.00/57 5} 59. Rd5 {-0.05/5 6} Bxc5 {0.00/56 7} 60. bxc5 {-0.04/6 6} Ke7 {
0.00/60 5} 61. Re5+ {-0.04/5 6} Kd8 {0.00/64 5} 62. Re6 {-0.03/5 6} Rc7 {
0.00/67 5 (Kc7)} 63. Rxa6 {-0.01/4 6} Rxd3 {0.00/83 5 (Rxc5+)} 64. Kxd3 {
-0.01/0 7} Rxc5 {0.00/143 5} 65. Rh6 {0.01/0 0} Kc7 {0.00/44 5 Ceres: no move
Ceres caused an exception, game stopped.} *

[/pgn]

If you have your GPU overclocked then do not overclock your GPU. Ceres did not like any overclock. And I got the same exception. Running stock speed fixed the issue.

cc2150dx wrote: ↑Mon Jan 04, 2021 2:01 am

mwyoung wrote: ↑Mon Jan 04, 2021 12:18 am

cc2150dx wrote: ↑Mon Jan 04, 2021 12:07 am Odd exceptions:

[pgn][Event "Jason, Blitz 5.0min+3.0sec"]
[Site "?"]
[Date "2021.01.03"]
[Round "4"]
[White "Stockfish 311220"]
[Black "Ceres"]
[Result "*"]
[ECO "B69"]
[Annotator "0.54;0.24"]
[PlyCount "139"]
[TimeControl "300+3"]

{AMD Ryzen 5 3600 6-Core Processor 3600 MHz W=39.9 plies; 14,009kN/s;
11,009,283 TBAs B=7.6 plies; 44kN/s; 4,598 TBAs} 1. e4 c5 2. Nf3 Nc6 3. d4 cxd4
4. Nxd4 Nf6 5. Nc3 d6 6. Bg5 e6 7. Qd2 a6 8. O-O-O {Both last book move} Bd7 {
0.24/15 19} 9. f4 {0.54/35 40} Be7 {0.22/8 12} 10. Nf3 {0.46/35 6} b5 {0.21/5 7
} 11. Bxf6 {0.55/31 6} gxf6 {0.20/0 0} 12. f5 {0.37/38 45} Qb6 {0.20/9 14} 13.
Kb1 {0.32/30 4} O-O-O {0.20/6 11} 14. a3 {0.44/35 29} Kb8 {0.19/9 14} 15. Be2 {
0.36/35 6 (Nd4)} Rc8 {0.12/11 19 (Rdg8)} 16. Nd4 {0.38/31 5} Ne5 {0.14/9 12}
17. Nb3 {0.47/38 66 (Rhf1)} Rc7 {0.09/11 17} 18. Qd4 {0.37/31 3} Kb7 {0.11/7
13 (Qxd4)} 19. Qxb6+ {0.42/31 6 (g4)} Kxb6 {0.25/14 14} 20. Bh5 {0.49/34 16}
Rg8 {0.28/8 12 (a5)} 21. Nd4 {0.79/27 3} Bc8 {0.29/5 6} 22. g3 {0.84/30 8} Rg5
{0.28/0 0} 23. Be2 {0.75/32 11} Ng4 {0.27/6 11 (Nc4)} 24. Bxg4 {0.64/36 26}
Rxg4 {0.27/5 8} 25. Rd3 {0.36/33 12 (Rhe1)} Kb7 {0.27/8 15} 26. h3 {0.51/31 4
(Rf1)} Rg5 {0.24/10 13} 27. Re1 {0.43/34 26 (g4)} h5 {0.18/9 12} 28. Ree3 {
0.37/30 3 (Rf1)} Kb8 {0.15/9 13} 29. b3 {0.44/33 11 (Rd1)} Rc5 {0.17/9 13} 30.
Nce2 {0.44/32 4 (Kb2)} Bf8 {0.15/11 11 (Bd7)} 31. Kb2 {0.20/37 5} Bd7 {0.15/7
10} 32. b4 {0.20/37 4 (Rd1)} Rc4 {0.14/10 10 (Rc8)} 33. Nf3 {0.30/31 5 (Rd1)}
Rg8 {0.15/11 10 (Rg7)} 34. Nd2 {0.30/32 4} Rc8 {0.15/7 6} 35. Nf4 {0.26/36 3}
h4 {0.16/6 6 (exf5)} 36. fxe6 {0.06/34 4} fxe6 {0.15/4 4} 37. gxh4 {0.00/40 3}
f5 {0.17/0 0} 38. exf5 {0.04/40 5} exf5 {0.16/8 7} 39. c3 {0.00/42 3} Bh6 {
0.14/9 7} 40. Rf3 {0.00/45 3} Bc6 {0.13/6 5} 41. Rf2 {0.09/43 7} Kc7 {0.13/0 0
(Be4)} 42. Nd5+ {0.10/33 3} Bxd5 {0.12/4 4} 43. Rxd5 {0.06/34 3} Rcf8 {0.12/0 0
} 44. Nf3 {0.00/38 3 (Kc2)} Be3 {0.13/11 8} 45. Rf1 {0.07/36 3} Rg3 {0.12/7 8}
46. a4 {0.00/40 3 (Kb3)} bxa4 {0.13/7 7} 47. Ka3 {0.00/39 6} f4 {0.13/6 9 (Bb6)
} 48. Kxa4 {0.00/39 3} Kc6 {0.13/4 6} 49. Rg5 {0.00/40 4} Rxh3 {0.12/7 6} 50.
Kb3 {0.00/42 3} Rg3 {0.12/6 8 (Rf6)} 51. Ra5 {0.00/39 6} Kb7 {0.11/7 7} 52. Rg5
{0.00/40 3 (Rd5)} Kc6 {0.10/8 6} 53. Ra5 {0.00/44 3 (Rh5)} Kb7 {0.11/9 6} 54.
Rh5 {0.00/44 3 (Rd5)} Bb6 {0.12/9 7 (Kc6)} 55. Rh7+ {0.00/32 3 (Rh6)} Kc6 {
0.14/10 5} 56. Rh6 {0.00/35 3} a5 {0.14/6 4} 57. Rd1 {0.00/43 6 (Ne5+)} Rxf3 {
0.16/14 5} 58. Rdxd6+ {0.00/47 2} Kc7 {0.14/8 4} 59. Rc6+ {0.00/52 3} Kd7 {
0.13/6 4} 60. Rxb6 {0.00/55 3} axb4 {0.13/4 3} 61. Kxb4 {0.00/46 4} Rf1 {
0.13/6 5 (Rh3)} 62. Kc4 {0.00/47 6 (Rbd6+)} f3 {0.07/10 5} 63. Rh7+ {0.00/50 2
(Rbd6+)} Kc8 {0.01/7 4} 64. Rc6+ {0.00/58 6} Kb8 {0.02/5 4} 65. Rb6+ {0.00/44
5 (Rcc7)} Kc8 {0.00/2 6 (Ka8)} 66. Ra6 {0.00/49 2} Kb8 {0.00/6 5 (Rb1)} 67.
Raa7 {0.00/59 3} f2 {0.01/4 5 (Rf4+)} 68. Rab7+ {0.00/62 3 (Rhb7+)} Ka8 {
0.01/2 5} 69. Ra7+ {0.00/66 2} Kb8 {0.01/0 0} 70. Rhb7+ {0.00/73 2 Ceres: no
move Ceres caused an exception, game stopped.} *

[/pgn]

[pgn][Event "Jason, Blitz 5.0min+3.0sec"]
[Site "?"]
[Date "2021.01.03"]
[Round "1"]
[White "Ceres"]
[Black "Stockfish 311220"]
[Result "*"]
[ECO "B80"]
[Annotator "0.31;0.13"]
[PlyCount "130"]
[TimeControl "300+3"]

{AMD Ryzen 5 3600 6-Core Processor 3600 MHz W=8.9 plies; 38kN/s; 4,792
TBAs B=44.4 plies; 14,944kN/s; 20,040,044 TBAs} 1. Nf3 c5 2. e4 d6 3. d4 cxd4
4. Nxd4 Nf6 5. Nc3 a6 6. Be3 e6 7. f3 b5 {Both last book move} 8. Qd2 {0.31/19
16} b4 {0.13/35 36 (Nbd7)} 9. Na4 {0.27/20 15} Nbd7 {0.24/30 5} 10. O-O-O {
0.25/8 6} Qa5 {0.25/33 5} 11. b3 {0.25/0 0} Bb7 {0.10/33 8} 12. Kb1 {0.29/8 6
(h4)} Nc5 {0.00/35 9} 13. a3 {0.28/0 0} Nxa4 {0.18/32 5} 14. axb4 {0.30/6 5}
Qc7 {0.08/34 8} 15. bxa4 {0.30/0 0} Be7 {0.21/35 13 (d5)} 16. c3 {0.30/10 10}
O-O {0.00/34 6} 17. Rc1 {0.31/5 8 (Kb2)} Rfb8 {0.44/33 16} 18. Bd3 {0.28/7 10}
Bc8 {0.39/35 17 (e5)} 19. g4 {0.27/15 15 (Rhd1)} e5 {0.26/31 9} 20. Nf5 {
0.32/10 9} Bxf5 {0.24/32 6} 21. gxf5 {0.30/0 0} d5 {0.17/33 6} 22. exd5 {
0.32/7 11} Nxd5 {0.16/36 7} 23. f6 {0.35/0 0} Nxf6 {0.30/37 8} 24. Rhd1 {
0.36/4 6} Rd8 {0.08/37 7 (g6)} 25. Qa2 {0.45/14 16} Qc6 {0.11/37 6} 26. a5 {
0.27/10 11} Nd5 {0.14/37 8} 27. Bd2 {0.22/7 7} Rd6 {0.00/41 6} 28. Qc4 {
0.15/7 9 (Be4)} Qd7 {0.00/38 5} 29. Bc2 {0.16/0 0} Rd8 {0.00/36 8 (g6)} 30. Bb3
{0.14/15 19} h5 {0.12/37 6 (g6)} 31. Kb2 {0.25/14 14} Bf6 {0.00/41 5} 32. Ka3 {
0.17/9 11} Qh3 {0.00/44 19} 33. Rg1 {0.19/6 11} Kh8 {0.00/47 5} 34. Be1 {
0.25/10 12} Qxf3 {0.00/46 5 (Qxh2)} 35. Bh4 {0.14/10 15} Ne3 {0.00/52 6 (Bxh4)}
36. Qxf7 {0.11/11 11} R6d7 {0.00/54 7} 37. Rg3 {0.10/0 0 (Qg6)} Qf5 {0.00/55 6}
38. Qe6 {0.10/0 0} Qf4 {0.00/55 7} 39. Rxe3 {0.07/5 9 (Bxf6)} Qxe3 {0.00/42 6}
40. Re1 {0.07/3 5} Qxc3 {0.00/50 7} 41. Qf5 {0.07/0 0 (Bxf6)} Qd3 {-0.17/32 5
(Rd5)} 42. Qxh5+ {-0.41/18 11} Qh7 {-0.30/30 1} 43. Qxh7+ {-0.37/9 8} Kxh7 {
-0.20/28 1} 44. Bf2 {-0.34/6 8} Rd3 {-0.06/42 30 (Rd2)} 45. Bb6 {-0.31/8 8} Rc8
{-0.05/39 3} 46. Bc5 {-0.30/6 7} Rf3 {0.00/39 7 (Rc3)} 47. Ka4 {-0.27/9 8} Rf4
{-0.06/45 7} 48. Bc2+ {-0.25/6 8} g6 {0.00/43 5} 49. Kb3 {-0.25/5 7} Rf3+ {
0.00/42 7} 50. Kc4 {-0.24/5 7} Rf4+ {0.00/46 8 (Rh3)} 51. Kb3 {-0.11/11 9 (Kd5)
} Rf3+ {0.00/44 5 (Bg7)} 52. Kc4 {-0.25/12 10} Bg7 {0.00/46 11} 53. Re4 {
-0.23/10 9} Kh6 {0.00/43 6 (Rf4)} 54. Bd3 {-0.13/12 8 (Re2)} g5 {0.00/47 5
(Bf8)} 55. h4 {-0.09/12 7} gxh4 {0.00/48 5} 56. Rxh4+ {-0.08/9 6} Kg5 {0.00/45
1} 57. Re4 {-0.07/5 6} Bf8 {0.00/52 5 (Re8)} 58. Rxe5+ {-0.05/9 6} Kf6 {
0.00/57 5} 59. Rd5 {-0.05/5 6} Bxc5 {0.00/56 7} 60. bxc5 {-0.04/6 6} Ke7 {
0.00/60 5} 61. Re5+ {-0.04/5 6} Kd8 {0.00/64 5} 62. Re6 {-0.03/5 6} Rc7 {
0.00/67 5 (Kc7)} 63. Rxa6 {-0.01/4 6} Rxd3 {0.00/83 5 (Rxc5+)} 64. Kxd3 {
-0.01/0 7} Rxc5 {0.00/143 5} 65. Rh6 {0.01/0 0} Kc7 {0.00/44 5 Ceres: no move
Ceres caused an exception, game stopped.} *

[/pgn]

If you have your GPU overclocked then do not overclock your GPU. Ceres did not like any overclock. And I got the same exception. Running stock speed fixed the issue.

No, just a base EVGA RTX 2060. I don't even know how to overclock even if I wanted to

mwyoung wrote: ↑Sun Jan 03, 2021 11:44 pm Live Ceres (703810) vs Lc0 0.26.3 (703810) (TC=3m+2s)

Same NN for each engine. 703810

Hardware 2950x, RTX 2080TI

The top ten 7 man tablebases.

Opening book to 6 moves

Live Stream:

mwyoung wrote: ↑Mon Jan 04, 2021 3:30 am

mwyoung wrote: ↑Sun Jan 03, 2021 11:44 pm Live Ceres (703810) vs Lc0 0.26.3 (703810) (TC=3m+2s)

Same NN for each engine. 703810

Hardware 2950x, RTX 2080TI

The top ten 7 man tablebases.

Opening book to 6 moves

Live Stream:

Ceres takes the lead +2 =24 -0 +27 Elo.

DESKTOP-CORSAIR, Blitz 3.0min+2.0sec  0

                           
1   Ceres             +22  +2/=30/-0 53.12%   17.0/32
2   Lc0 v0.26.3 (2)   -22  +0/=30/-2 46.88%   15.0/32

Ceres wrote: Ceres is a newly released chess engine which has a re-implementation of MCTS search over the lc0 backends. It shows very strong search performance characteristics which will be interesting to learn from. The specific details of some of those performance characteristics would likely be difficult to copy in to lc0, without also requiring a full rewrite. So there has been some talk of possibly migrating to Ceres as a a replacement for the lc0 engine in general. This post isn’t about that though. Instead I wanted a place to capture the ‘details’ of difference as I read through the Ceres codebase.