TCEC Question
Moderators: hgm, Rebel, chrisw
-
- Posts: 3707
- Joined: Thu Mar 16, 2006 7:10 pm
Re: TCEC Question
I think TCEC should be looked at more for the entertainment value rather than a test to see which engine is stronger. Of course if one engine blows the other out of the water, then that can give a good idea of one engine's superiority over another. But since entertainment value is more important here, the openings used might favor one engine over another as one engine can play a certain type of position better than another ... and if those types of positions are forced by opening choice then it might skew the results in favor to one side. I think it is impressive how strong SF has become and it seems to not fall for many of the strong positional plans that Lc0 used to get easy wins with. Maybe it is just the increase in core count, but most likely it is improvement in the evaluation. Lc0 does seem to still have the annoying trolling intact and maybe not as sane in the endgame. I do think that SF has just improved more than Lc0 in the last year or so as Lc0 improvements seem to have stagnated while SF just improves methodically.
-
- Posts: 1080
- Joined: Fri Sep 16, 2016 6:55 pm
- Location: USA/Minnesota
- Full name: Leo Anger
Re: TCEC Question
I wonder how the TCEC LCO net made it to the superfinal. What net won the SF last season?MMarco wrote: ↑Wed Jul 01, 2020 2:26 amMaybe simply because Lc0 net isn't the best around. It seems to be 75 elo lower than other big nets. Have a look here: http://talkchess.com/forum3/viewtopic.p ... 29#p849247
It is on the 30th rank.
Advanced Micro Devices fan.
-
- Posts: 195
- Joined: Sun Apr 12, 2020 1:09 am
- Full name: Marc-O Moisan-Plante
Re: TCEC Question
The net that won TCEC 17 was 384x30-T60-3010 I believe (with Lc0 24). From what I read, players are allowed to submit a new net before the superfinal. Apparently, Lc0 team had several new nets that looked promising at low nodes games, but they couldn't test them thouroughly before the submission deadline. Unfortunately for them, they didn't take the best choice. Also Stockfish did really improve since the last superfinal. If I'm not mistaken, net 3972_20k played only the superfinal, T60-3010 played the qualifiers.Leo wrote: ↑Wed Jul 01, 2020 9:58 amI wonder how the TCEC LCO net made it to the superfinal. What net won the SF last season?MMarco wrote: ↑Wed Jul 01, 2020 2:26 amMaybe simply because Lc0 net isn't the best around. It seems to be 75 elo lower than other big nets. Have a look here: http://talkchess.com/forum3/viewtopic.p ... 29#p849247
It is on the 30th rank.
-
- Posts: 195
- Joined: Sun Apr 12, 2020 1:09 am
- Full name: Marc-O Moisan-Plante
Re: TCEC Question
Maybe it is not the end of the story. The test will be rerun: http://talkchess.com/forum3/viewtopic.p ... 29#p849379MMarco wrote: ↑Wed Jul 01, 2020 12:21 pmThe net that won TCEC 17 was 384x30-T60-3010 I believe (with Lc0 24). From what I read, players are allowed to submit a new net before the superfinal. Apparently, Lc0 team had several new nets that looked promising at low nodes games, but they couldn't test them thouroughly before the submission deadline. Unfortunately for them, they didn't take the best choice. Also Stockfish did really improve since the last superfinal. If I'm not mistaken, net 3972_20k played only the superfinal, T60-3010 played the qualifiers.Leo wrote: ↑Wed Jul 01, 2020 9:58 amI wonder how the TCEC LCO net made it to the superfinal. What net won the SF last season?MMarco wrote: ↑Wed Jul 01, 2020 2:26 amMaybe simply because Lc0 net isn't the best around. It seems to be 75 elo lower than other big nets. Have a look here: http://talkchess.com/forum3/viewtopic.p ... 29#p849247
It is on the 30th rank.
-
- Posts: 1080
- Joined: Fri Sep 16, 2016 6:55 pm
- Location: USA/Minnesota
- Full name: Leo Anger
Re: TCEC Question
Much to my surprise LCO is really getting beat up. AB engines are not dead. Not even close.
Advanced Micro Devices fan.
-
- Posts: 2041
- Joined: Wed Mar 08, 2006 8:30 pm
-
- Posts: 550
- Joined: Tue Nov 19, 2019 8:48 pm
- Full name: Alayan Feh
Re: TCEC Question
Leela ratio is useless.
-
- Posts: 511
- Joined: Sun Apr 26, 2020 11:40 pm
- Full name: Brian D. Smith
Re: TCEC Question
ALL sporting events are for 'entertainment value'...but someone has to win and it comes down to whomever does whatever is needed to win...more than the other guy. Same here.M ANSARI wrote: ↑Wed Jul 01, 2020 7:14 am I think TCEC should be looked at more for the entertainment value rather than a test to see which engine is stronger. Of course if one engine blows the other out of the water, then that can give a good idea of one engine's superiority over another. But since entertainment value is more important here, the openings used might favor one engine over another as one engine can play a certain type of position better than another ... and if those types of positions are forced by opening choice then it might skew the results in favor to one side. I think it is impressive how strong SF has become and it seems to not fall for many of the strong positional plans that Lc0 used to get easy wins with. Maybe it is just the increase in core count, but most likely it is improvement in the evaluation. Lc0 does seem to still have the annoying trolling intact and maybe not as sane in the endgame. I do think that SF has just improved more than Lc0 in the last year or so as Lc0 improvements seem to have stagnated while SF just improves methodically.
Arguably you could find a bunch of starting positions that favor Lc0 by nature...run things again and get a different result. That also plays a result- not sure how the organizers decide on the starting positions.
Re: TCEC Question
Could be that Leela's MLH doesn't fare well at TCEC time control. It may not interact well with the WDL head and the high draw score. Definitely noticeable compared to last SuFi, Leela's eval score is low even when she's in a winning position.
Re: TCEC Question
Also possible SF improved so much, that Leela's eval only appears to be conservative. In other words, SF sees the clear win for Leela before she does.