TCEC Season 12 with Stockfish Zero aka Leela Chess Zero

[duncan]

stockfish 1.0 equal to Leela right now in TCEC

http://tcec.chessdom.com/bonus/live.php

+ 1 = 2 - 1

[duncan]

All 3 sentences are total BS. LC0 on 1080Ti OC or not OC is weaker than the one on TCEC hardware. Version on TCEC hardware is probably around 2700Elo.

and your estimate for elo on 1080Ti and tcec hardware tournament conditions is ?

[Milos]

All 3 sentences are total BS. LC0 on 1080Ti OC or not OC is weaker than the one on TCEC hardware. Version on TCEC hardware is probably around 2700Elo.

and your estimate for elo on 1080Ti and tcec hardware tournament conditions is ?

Every estimate is just a guess since there is no formal methodology of testing employed. TCEC hardware is slightly stronger so 20-30 Elo difference compared to 1080Ti. And strength for both cases is probably in the ballpark of 2700+/-50Elo.

[duncan]

stockfish 1.0 equal to Leela right now in TCEC

http://tcec.chessdom.com/bonus/live.php

+ 1 = 2 - 1

5th game win for stockfish

[whereagles]

match is very even, with SF1 leading by just 1 win and 5 games to go.

[whereagles]

leela just turned loss into win and match is equal with 4 games to go

[Guenther]

Zero is already strong enough for TCEC season 12 division 4 :D

It is around 2000 Elo CCRL if Dann is right. The Baron, 7th in TCEC division 4, is 2800, and Scorpio, last in division 4, is 3000 Elo.

It is around 2300 currently, which is of course not enough for TCEC Div. 4.

Hardware and time control dependant. On my Nvidia 1060 it's around 2600 elo CCRL at LTC

Of course, but I meant ordinary hardware and faster time controls.

[Guenther]

Leela is beating Stockfish 1.0 right now in TCEC demo matches:

http://tcec.chessdom.com/bonus/live.php

+1 =1 -0

BTW did you notice that the TCEC GUI has a problem with the calculation
of the kn/s (speed) of LCZero?
Most of the times it is completely off and it is not a simple rounding error.

Code: Select all

[Event "TCEC Season 13 - Preview"]
[Site "http://tcec.chessdom.com"]
[Date "2018.04.16"]
[Round "2"]
[White "LCZero ID125"]
[Black "Stockfish 1.0"]
[Result "1-0"]
[BlackElo "2754"]
[ECO "B12"]
[EventDate "2018.04.16"]
[GameDuration "00:20:20"]
[Opening "Caro-Kann: Advance, 3...c5 4.dxc5 Nc6"]
[PlyCount "51"]
[Termination "adjudication"]
[TerminationDetails "TCEC win rule"]
[TimeControl "900+10"]
[WhiteElo "2400"]

{ WhiteEngineOptions: Protocol=UCI; Threads=43; OwnBook=false; Ponder=false;, BlackEngineOptions: Protocol=UCI; Hash=4096; Threads=8; SyzygyPath=C:/Syzygy/; OwnBook=false; Ponder=false; }
1. e4 { book } c6 { book } 2. d4 { book } d5 { book } 3. e5 { book } c5 { book } 4. dxc5 { book } Nc6 { book } 5. f4 { book }
6.;Be3;d=;24;pd=;d4;mt=;00:00:16;tl=;00:15:43;s=;3;kN/s;n=;64604
7.;Bc1;d=;26;pd=;Bxc5;mt=;00:00:20;tl=;00:15:33;s=;5;kN/s;n=;175829
8.;Nd2;d=;25;pd=;Nge7;mt=;00:00:12;tl=;00:15:30;s=;3;kN/s;n=;110416
9.;a3;d=;25;pd=;Nd5;mt=;00:00:15;tl=;00:15:25;s=;4;kN/s;n=;116280
10.;Nf3;d=;25;pd=;Nd5;mt=;00:00:19;tl=;00:15:15;s=;4;kN/s;n=;114152
11.;Bd3;d=;25;pd=;Ne3;mt=;00:00:10;tl=;00:15:14;s=;3;kN/s;n=;74297
12.;O-O;d=;24;pd=;Nxd3;mt=;00:00:15;tl=;00:15:09;s=;3;kN/s;n=;63102
13.;cxd3;d=;25;pd=;Be7;mt=;00:00:09;tl=;00:15:09;s=;3;kN/s;n=;82569
14.;Qe1;d=;25;pd=;b6;mt=;00:00:08;tl=;00:15:11;s=;3;kN/s;n=;93614
15.;Qg3;d=;24;pd=;Kh8;mt=;00:00:18;tl=;00:15:02;s=;2;kN/s;n=;53555
16.;Ne4;d=;25;pd=;f5;mt=;00:00:24;tl=;00:14:48;s=;2;kN/s;n=;114493
17.;Bg5;d=;24;pd=;Qxd3;mt=;00:00:18;tl=;00:14:39;s=;3;kN/s;n=;69368
18.;Bf6;d=;24;pd=;gxf6;mt=;00:00:19;tl=;00:14:29;s=;2;kN/s;n=;53459
19.;exf6;d=;24;pd=;g6;mt=;00:00:19;tl=;00:14:20;s=;2;kN/s;n=;56346
20.;Nfg5;d=;24;pd=;Ne5;mt=;00:00:13;tl=;00:14:16;s=;2;kN/s;n=;74723
21.;Rae1;d=;25;pd=;Kg8;mt=;00:00:17;tl=;00:14:09;s=;3;kN/s;n=;105558
22.;Qh4;d=;24;pd=;h5;mt=;00:00:18;tl=;00:14:00;s=;4;kN/s;n=;107997
23.;Qxg4;d=;25;pd=;e5;mt=;00:00:21;tl=;00:13:48;s=;4;kN/s;n=;107941
24.;Qh4;d=;25;pd=;h5;mt=;00:00:15;tl=;00:13:43;s=;4;kN/s;n=;126301
25.;h3;d=;25;pd=;Bxh3;mt=;00:00:08;tl=;00:13:44;s=;3;kN/s;n=;151346
26.;Qxh3;d=;25;pd=;Rad8;mt=;00:00:18;tl=;00:13:35;s=;3;kN/s;n=;123770
1-0

m#  m     depth   ponder m   mtime s  time left      speed      nodes       real speed!
                                                                            in nps
 6  Be3   d=  24  pd=  d4    mt=  16  tl=  00:15:43  s= 3 kN/s  n=   64604   4037.750
 7  Bc1   d=  26  pd=  Bxc5  mt=  20  tl=  00:15:33  s= 5 kN/s  n=  175829   8791.450
 8  Nd2   d=  25  pd=  Nge7  mt=  12  tl=  00:15:30  s= 3 kN/s  n=  110416   9201.333
 9  a3    d=  25  pd=  Nd5   mt=  15  tl=  00:15:25  s= 4 kN/s  n=  116280   7752.000
10  Nf3   d=  25  pd=  Nd5   mt=  19  tl=  00:15:15  s= 4 kN/s  n=  114152   6008.000
11  Bd3   d=  25  pd=  Ne3   mt=  10  tl=  00:15:14  s= 3 kN/s  n=   74297   7429.700
12  O-O   d=  24  pd=  Nxd3  mt=  15  tl=  00:15:09  s= 3 kN/s  n=   63102   4206.800
13  cxd3  d=  25  pd=  Be7   mt=   9  tl=  00:15:09  s= 3 kN/s  n=   82569   9174.333
14  Qe1   d=  25  pd=  b6    mt=   8  tl=  00:15:11  s= 3 kN/s  n=   93614  11701.750
15  Qg3   d=  24  pd=  Kh8   mt=  18  tl=  00:15:02  s= 2 kN/s  n=   53555   2975.278
16  Ne4   d=  25  pd=  f5    mt=  24  tl=  00:14:48  s= 2 kN/s  n=  114493   4770.542
17  Bg5   d=  24  pd=  Qxd3  mt=  18  tl=  00:14:39  s= 3 kN/s  n=   69368   3853.778
18  Bf6   d=  24  pd=  gxf6  mt=  19  tl=  00:14:29  s= 2 kN/s  n=   53459   2813.632
19  exf6  d=  24  pd=  g6    mt=  19  tl=  00:14:20  s= 2 kN/s  n=   56346   2965.579
20  Nfg5  d=  24  pd=  Ne5   mt=  13  tl=  00:14:16  s= 2 kN/s  n=   74723   5747.923
21  Rae1  d=  25  pd=  Kg8   mt=  17  tl=  00:14:09  s= 3 kN/s  n=  105558   6209.294
22  Qh4   d=  24  pd=  h5    mt=  18  tl=  00:14:00  s= 4 kN/s  n=  107997   5999.833
23  Qxg4  d=  25  pd=  e5    mt=  21  tl=  00:13:48  s= 4 kN/s  n=  107941   5140.048
24  Qh4   d=  25  pd=  h5    mt=  15  tl=  00:13:43  s= 4 kN/s  n=  126301   8420.067
25  h3    d=  25  pd=  Bxh3  mt=   8  tl=  00:13:44  s= 3 kN/s  n=  151346  18918.250
26  Qxh3  d=  25  pd=  Rad8  mt=  18  tl=  00:13:35  s= 3 kN/s  n=  123770   6876.111

[duncan]

stockfish 1 should win leela 11.5- 8.5. what elo performance would this be for leela ?

[Guenther]

stockfish 1 should win leela 11.5- 8.5. what elo performance would this be for leela ?

Ordo with 200 simuls and SF1 fixed to 2754
(The same number, which TCEC has taken from the CCRL 40/40 list,
but there it appears as Stockfish 1.01 w/o core # and w/o info about 32/64 bit, while in this match it played with 8 cores.
It is also unclear to me why the pgn header gives syzygy bases for SF, while SF1 wasn't able to use any tablebases at all)

A lot of unknowns and of course huge error bars as 20 games is nothing results in this:

Code: Select all

   # PLAYER           :   RATING   ERROR  POINTS  PLAYED   (%)
   1 Stockfish 1.0    :  2754.00    ----    11.5      20  57.5
   2 LCZero ID125     :  2676.27  201.55     8.5      20  42.5

White advantage = 226.17 +/- 105.79
Draw rate (equal opponents) = 19.40 % +/- 15.67