TCEC season 13, 2 NN engines will be participating, Leela and Deus X

[Laskos]

I think this move may backfire and will hurt TCEC more than it will do good. People are not stupid and want diversity, not 32 clones of SF. Deus X will use lc0 with a custom net. Shouldn't be allowed imho.

I agree, it seems rather difficult to me to justify allowing Deus X while not letting developers of other strong engines enter clones with changed parameters under a new name. Let's see how TCEC spins this once the complaints to this move start coming in...

For Season 13, it seems the decision is made, but for the season after this they'll have to come up with a new set of rules and follow it consistently.

I don't agree. One uses supervised learning, another reinforcement learning. They will play completely different chess. Also, as the 2 groups (main and test) seem to stall at significantly below A0 level (even if put on the same hardware), supervised learning is worth give a try. I hope this Deus X wins the TCEC, and all these discussions will be put to rest.

[AndrewGrant]

I think this move may backfire and will hurt TCEC more than it will do good. People are not stupid and want diversity, not 32 clones of SF. Deus X will use lc0 with a custom net. Shouldn't be allowed imho.

I agree, it seems rather difficult to me to justify allowing Deus X while not letting developers of other strong engines enter clones with changed parameters under a new name. Let's see how TCEC spins this once the complaints to this move start coming in...

For Season 13, it seems the decision is made, but for the season after this they'll have to come up with a new set of rules and follow it consistently.

I don't agree. One uses supervised learning, another reinforcement learning. They will play completely different chess. Also, as the 2 groups (main and test) seem to stall at significantly below A0 level (even if put on the same hardware), supervised learning is worth give a try. I hope this Deus X wins the TCEC, and all these discussions will be put to rest.

I don't think anyone here is questioning the possible promise of this supervised learning.

They are questioning why TCEC is allowing the same engine to play twice. There is more to it than just the weights.

[Daniel Shawul]

Well, there is extreme high possibility that Deus X authour is Deep Junior Authour, Shay Bushinsky.
https://www.aaai.org/ojs/index.php/aima ... /view/2255

So you will be seeing updated version(work of art) of Junior!!

No - you're wrong, but my lips are sealed.

What about Tencent company?
https://www.chess.com/forum/view/genera ... -season-13

http://www.chessdom.com/deus-x-the-nn-c ... rt-silver/

Meanwhile, Scorpio with neural networks is ignored ...

It uses supervised learning (just like the deuce) with different NN architecture, search, backend etc...

Hurts to be ignored after investing so much time in it ... is it because I am black (obviously I am joking here)

[CMCanavessi]

Well, there is extreme high possibility that Deus X authour is Deep Junior Authour, Shay Bushinsky.
https://www.aaai.org/ojs/index.php/aima ... /view/2255

So you will be seeing updated version(work of art) of Junior!!

No - you're wrong, but my lips are sealed.

What about Tencent company?
https://www.chess.com/forum/view/genera ... -season-13

http://www.chessdom.com/deus-x-the-nn-c ... rt-silver/

Meanwhile, Scorpio with neural networks is ignored ...

It uses supervised learning (just like the deuce) with different NN architecture, search, backend etc...

Hurts to be ignored after investing so much time in it ... is it because I am black (obviously I am joking here)

True, I would have preferred Scorpio much more than Deus X. At least it's a completely different an original approach _and_ engine.

[AndrewGrant]

Well, there is extreme high possibility that Deus X authour is Deep Junior Authour, Shay Bushinsky.
https://www.aaai.org/ojs/index.php/aima ... /view/2255

So you will be seeing updated version(work of art) of Junior!!

No - you're wrong, but my lips are sealed.

What about Tencent company?
https://www.chess.com/forum/view/genera ... -season-13

http://www.chessdom.com/deus-x-the-nn-c ... rt-silver/

Meanwhile, Scorpio with neural networks is ignored ...

It uses supervised learning (just like the deuce) with different NN architecture, search, backend etc...

Hurts to be ignored after investing so much time in it ... is it because I am black (obviously I am joking here)

True, I would have preferred Scorpio much more than Deus X. At least it's a completely different an original approach _and_ engine.

I too would prefer Scorpio. I have been ragging on it because of the crashes, but putting that aside -- If TCEC is actually interested in showcasing a diverse suite of emerging Neural Networks, Leela + Scorpio is what you choose. We have Leela doing an OpenSource version of AlphaZero, and we have Scorpio trying to merge the idea into the existing chess engine literature. Two applications of NN, two VERY different approaches, two different results, two reasons to watch TCEC.

[jkiliani]

Meanwhile, Scorpio with neural networks is ignored ...

It uses supervised learning (just like the deuce) with different NN architecture, search, backend etc...

Hurts to be ignored after investing so much time in it ... is it because I am black (obviously I am joking here)

I still haven't seen any information who the last three nominations for Div 4 are going to be... having Scorpio-NN included would have been nice, but I presume you haven't been approached?

[AndrewGrant]

Meanwhile, Scorpio with neural networks is ignored ...

It uses supervised learning (just like the deuce) with different NN architecture, search, backend etc...

Hurts to be ignored after investing so much time in it ... is it because I am black (obviously I am joking here)

I still haven't seen any information who the last three nominations for Div 4 are going to be... having Scorpio-NN included would have been nice, but I presume you haven't been approached?

Cato hinted at chess22k, Rodent III, and IvanHoe .... the last of which raises even more questions.

[Graham Banks]

Meanwhile, Scorpio with neural networks is ignored ...

It uses supervised learning (just like the deuce) with different NN architecture, search, backend etc...

Hurts to be ignored after investing so much time in it ... is it because I am black (obviously I am joking here)

I still haven't seen any information who the last three nominations for Div 4 are going to be... having Scorpio-NN included would have been nice, but I presume you haven't been approached?

Cato hinted at chess22k, Rodent III, and IvanHoe .... the last of which raises even more questions.

Marvin has also been suggested.

[Error323]

I think this move may backfire and will hurt TCEC more than it will do good. People are not stupid and want diversity, not 32 clones of SF. Deus X will use lc0 with a custom net. Shouldn't be allowed imho.

I agree, it seems rather difficult to me to justify allowing Deus X while not letting developers of other strong engines enter clones with changed parameters under a new name. Let's see how TCEC spins this once the complaints to this move start coming in...

For Season 13, it seems the decision is made, but for the season after this they'll have to come up with a new set of rules and follow it consistently.

I don't agree. One uses supervised learning, another reinforcement learning. They will play completely different chess. Also, as the 2 groups (main and test) seem to stall at significantly below A0 level (even if put on the same hardware), supervised learning is worth give a try. I hope this Deus X wins the TCEC, and all these discussions will be put to rest.

It might be worth a try for fun, we also did it in the initial phase of lc0 development, see https://github.com/glinscott/leela-ches ... -361063249. We didn't have the fast engine with cudnn then and limited ourselves to 64x6. It was done to make sure the actual network architecture was sane (not just weights) .

I think it's very unlikely that this approach will beat A0 ever. It's based on human games, with its human flaws and limitations. It'll obtain generalized knowledge across many humans which is of course better, but it will still not see beyond human capability (given just a nn forward inference, with MCTS combined it will somewhat).

A nn trained through Selfplay from scratch, however won't be bound by humans. And looking at deepmind results for Go, it far surpassed the supervised approach. We're (lc0) just struggling/learning to find the optimal parameters for training and avoiding overfitting, as it's much more challenging to get right (and actually write the entire engine etc). But do note that our 20b net is still in it's infancy, it'll become interesting as it drops learning-rate and starts fine-tuning its performance.

[frankp]

[/quote]

It might be worth a try for fun, we also did it in the initial phase of lc0 development, see https://github.com/glinscott/leela-ches ... -361063249. We didn't have the fast engine with cudnn then and limited ourselves to 64x6. It was done to make sure the actual network architecture was sane (not just weights) .

I think it's very unlikely that this approach will beat A0 ever. It's based on human games, with its human flaws and limitations. It'll obtain generalized knowledge across many humans which is of course better, but it will still not see beyond human capability (given just a nn forward inference, with MCTS combined it will somewhat).

A nn trained through Selfplay from scratch, however won't be bound by humans. And looking at deepmind results for Go, it far surpassed the supervised approach. We're (lc0) just struggling/learning to find the optimal parameters for training and avoiding overfitting, as it's much more challenging to get right (and actually write the entire engine etc). But do note that our 20b net is still in it's infancy, it'll become interesting as it drops learning-rate and starts fine-tuning its performance.
[/quote]

This is the key interest for me. A0 and Leela seem to play chess in a different and superior way to humans - which of course includes standard ABsearch engines that mimic/encode the human approach.

Constraining leela through blinkered 'human expert'' training seems fundamentally an incorrect approach, as seems to have been demonstrated with AlphaZero (Go) as you say.

This is not to say, of course, that a NN trained on human games will not be interesting.