AlphaZero Chess is not that strong ...

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

mjlef
Posts: 1494
Joined: Thu Mar 30, 2006 2:08 pm

Re: AlphaZero Chess is not that strong ...

Post by mjlef »

I do not quite understand your graph, but is your program using LazySMP? Because hash size is going to have a large effect using that search scheme.

It seems to be time to fixed depth searches. But with LazySMP, time to depth suffers while the goes up.
User avatar
hgm
Posts: 27828
Joined: Fri Mar 10, 2006 10:06 am
Location: Amsterdam
Full name: H G Muller

Re: AlphaZero Chess is not that strong ...

Post by hgm »

The graph was for single thread. Indeed time to depth, and load factor defined as reported node count divided by number of table entries.

Whether SMP would behave significantly different is certainly worth investigating, but not so obvious to me that it can be assumed without evidence. With SMP, threads tend to work in the same sub-tree, which can easily be just 10% of the total tree, and thus still fit in the hash table even under conditions of large overloading.
Werewolf
Posts: 1797
Joined: Thu Sep 18, 2008 10:24 pm

Re: AlphaZero Chess is not that strong ...

Post by Werewolf »

mjlef wrote:
Because hash size is going to have a large effect using that search scheme.

It seems to be time to fixed depth searches. But with LazySMP, time to depth suffers while the goes up.
It would be really nice to get to the truth on this. HG Muller claimed that going from 1GB to 32 GB only adds 7.5 elo which is quite a bit below what I had guessed (25 elo).
User avatar
mclane
Posts: 18757
Joined: Thu Mar 09, 2006 6:40 pm
Location: US of Europe, germany
Full name: Thorsten Czub

Re: AlphaZero Chess is not that strong ...

Post by mclane »

hgm wrote:So a good book makes it impossible to see the difference between a 3500 and a 6000-Elo engine: all games will be draw. To test engines it is thus essential to play them without a good book. Tests with a book are meaningless; they say nothing about the engine, but only something about the book.
What is the sense of creating a big searchtree like stockfish / Komodo / Houdini are doing so, if the outcome is that the engine has almost no clue what is going on on the board although it was computing 23-28 searches deep in the middle game.

Stockfish has material on board that gets 3,5 and more pawns value but the pieces cannot move !!

Pieces that cannot move are worthless.

Stockfish ate almost if not all sacrifices by AZ.

This is the indicator that it had no clue what was going on.

Although „evaluating“ 70.000.000 nodes per second.

Either the evaluation is completely wrong then or the search tree is build in a completely wrong and wasted area or the second is a result of the first.


What we need now, is IMO a complete NEW cut and new ideas.

We cannot continue like this.

We thought this is the way to go in the last 50 years.
But it seems this is a dead end street.
What seems like a fairy tale today may be reality tomorrow.
Here we have a fairy tale of the day after tomorrow....
Werewolf
Posts: 1797
Joined: Thu Sep 18, 2008 10:24 pm

Re: AlphaZero Chess is not that strong ...

Post by Werewolf »

mclane wrote:
We thought this is the way to go in the last 50 years.
But it seems this is a dead end street.
Of course it's not a dead-end. Engines are improving at 30 elo a year - that is PROGRESS.

Just because they can't play perfectly yet isn't the same as saying there's no progress.
User avatar
hgm
Posts: 27828
Joined: Fri Mar 10, 2006 10:06 am
Location: Amsterdam
Full name: H G Muller

Re: AlphaZero Chess is not that strong ...

Post by hgm »

Werewolf wrote:It would be really nice to get to the truth on this. HG Muller claimed that going from 1GB to 32 GB only adds 7.5 elo which is quite a bit below what I had guessed (25 elo).
Well, take Stockfish, take a machine with quie a few cores (8 threads would already give a good indication), make a graph like the one I posted, and you would know.
User avatar
mclane
Posts: 18757
Joined: Thu Mar 09, 2006 6:40 pm
Location: US of Europe, germany
Full name: Thorsten Czub

Re: AlphaZero Chess is not that strong ...

Post by mclane »

Did you take a look into the game and in stockfishs Evaluation during its games ?!
What seems like a fairy tale today may be reality tomorrow.
Here we have a fairy tale of the day after tomorrow....
FWCC
Posts: 117
Joined: Wed Aug 22, 2007 4:39 pm

Re: AlphaZero Chess is not that strong ...

Post by FWCC »

Alphazero IS THAT STRONG I think it is revolutionary
User avatar
fern
Posts: 8755
Joined: Sun Feb 26, 2006 4:07 pm

Re: AlphaZero Chess is not that strong ...

Post by fern »

I do not see the point of trying to minmize this new monster feat compared with the stuff we already know. The essence of the matter if that this new criature is capable of learning chess and playing at SGM level after a couple of hours of learning from zero.
If it is not better than Stockfish or any other no doubt it will be in the next iteration.
We are in presence of something new.

Fern
mario carbonell
Posts: 20
Joined: Tue Dec 12, 2017 7:14 pm

Re: AlphaZero Chess is not that strong ...

Post by mario carbonell »

fern wrote:I do not see the point of trying to minmize this new monster feat compared with the stuff we already know. The essence of the matter if that this new criature is capable of learning chess and playing at SGM level after a couple of hours of learning from zero.
If it is not better than Stockfish or any other no doubt it will be in the next iteration.
We are in presence of something new.

Fern

That is the point.

AlphaZero is the first iteration of a new technology.

Somebody will continue their work and do something even stronger. Maybe in a few years every chess engine will be derived from AlphaZero.

Another interesting thing that can be done with neural networks is style transfer. Maybe it could be trained to imitate the style of you favorite chess player, could be Mijail Tal, Anatoly Karpov, Gary Kasparov etc...



Image