AlphaZero is not like other chess programs

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Dann Corbit
Posts: 12537
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

AlphaZero is not like other chess programs

Post by Dann Corbit »

Comparing AlphaZero to Stockfish is like comparing an airplane to a motorboat.

Both can be used to cross a sea, but they are using completely different techniques to get there.

SF won't run on tensor chips.
AlphaZero won't run on ordinary CPUs.

The approach is very different.

The horsepower of AlphaZero is enormous. But that does not diminish the outcome. If we gave SF a trillion cores, the last 99.999999999 % don't help anyway,
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
syzygy
Posts: 5557
Joined: Tue Feb 28, 2012 11:56 pm

Re: AlphaZero is not like other chess programs

Post by syzygy »

Well said.
Milos
Posts: 4190
Joined: Wed Nov 25, 2009 1:47 am

Re: AlphaZero is not like other chess programs

Post by Milos »

Dann Corbit wrote:Comparing AlphaZero to Stockfish is like comparing an airplane to a motorboat.

Both can be used to cross a sea, but they are using completely different techniques to get there.

SF won't run on tensor chips.
AlphaZero won't run on ordinary CPUs.

The approach is very different.

The horsepower of AlphaZero is enormous. But that does not diminish the outcome. If we gave SF a trillion cores, the last 99.999999999 % don't help anyway,
AlphaZero could actually run on ordinary CPUs. The only thing it needs is TensorFlow lib which more than successfully runs on general CPUs. The other question is how slow it would be.

If SF had access to trillion cores, you could simply just play rollouts from the root position and reach almost perfect play in every position.
corres
Posts: 3657
Joined: Wed Nov 18, 2015 11:41 am
Location: hungary

Re: AlphaZero is not like other chess programs

Post by corres »

[quote="Dann Corbit"]

Comparing AlphaZero to Stockfish is like comparing an airplane to a motorboat.
Both can be used to cross a sea, but they are using completely different techniques to get there.
SF won't run on tensor chips.
AlphaZero won't run on ordinary CPUs.
The approach is very different.
The horsepower of AlphaZero is enormous. But that does not diminish the outcome. If we gave SF a trillion cores, the last 99.999999999 % don't help anyway,

[/quote]

I agree.
An AlphaZero-type system is appropriate to optimize the parameters of normal chess engines, too. I think with the help of such a system the team of Stockfish could enhance the Elo of Stockfish so high than AlphaZero have. Maybe it needs also some modifications of the code of Stockfish.
Albert Silver
Posts: 3019
Joined: Wed Mar 08, 2006 9:57 pm
Location: Rio de Janeiro, Brazil

Re: AlphaZero is not like other chess programs

Post by Albert Silver »

Milos wrote:
Dann Corbit wrote:Comparing AlphaZero to Stockfish is like comparing an airplane to a motorboat.

Both can be used to cross a sea, but they are using completely different techniques to get there.

SF won't run on tensor chips.
AlphaZero won't run on ordinary CPUs.

The approach is very different.

The horsepower of AlphaZero is enormous. But that does not diminish the outcome. If we gave SF a trillion cores, the last 99.999999999 % don't help anyway,
AlphaZero could actually run on ordinary CPUs. The only thing it needs is TensorFlow lib which more than successfully runs on general CPUs. The other question is how slow it would be.

If SF had access to trillion cores, you could simply just play rollouts from the root position and reach almost perfect play in every position.
Actually, I am curious to know if one could run it well using GPUs, such as a couple of nVidia's high-end Titans. Gian-Carlo's Leela benefits greatly from a good GPU.

https://www.sjeng.org/leela.html
"Tactics are the bricks and sticks that make up a game, but positional play is the architectural blueprint."
pilgrimdan
Posts: 405
Joined: Sat Jul 02, 2011 10:49 pm

Re: AlphaZero is not like other chess programs

Post by pilgrimdan »

Albert Silver wrote:
Milos wrote:
Dann Corbit wrote:Comparing AlphaZero to Stockfish is like comparing an airplane to a motorboat.

Both can be used to cross a sea, but they are using completely different techniques to get there.

SF won't run on tensor chips.
AlphaZero won't run on ordinary CPUs.

The approach is very different.

The horsepower of AlphaZero is enormous. But that does not diminish the outcome. If we gave SF a trillion cores, the last 99.999999999 % don't help anyway,
AlphaZero could actually run on ordinary CPUs. The only thing it needs is TensorFlow lib which more than successfully runs on general CPUs. The other question is how slow it would be.

If SF had access to trillion cores, you could simply just play rollouts from the root position and reach almost perfect play in every position.
Actually, I am curious to know if one could run it well using GPUs, such as a couple of nVidia's high-end Titans. Gian-Carlo's Leela benefits greatly from a good GPU.

https://www.sjeng.org/leela.html
"Alpha Go runs on about $25 million in hardware--it's not exactly a lightweight system... "

https://www.inc.com/lisa-calhoun/google ... learn.html

I realize the quote says alphago ... but I would imagine the same would be true for alphazero also ...
jhellis3
Posts: 546
Joined: Sat Aug 17, 2013 12:36 am

Re: AlphaZero is not like other chess programs

Post by jhellis3 »

Nah, the hardware Alpha Zero runs on is much less expensive, but by no means cheap. It ran/runs on 4 2nd gen google TPUs.

For those interested, you can now buy Titan V cards (the first consumer cards with Tensor units) now for $3,000 a pop here:
https://www.nvidia.com/en-us/titan/titan-v/

Currently limited to 2 per customer but assuming you could buy 4, that would be 12k + rest of system, and get you about 2/3rds+ of the performance of the TPUs depending on the workload bottlenecks.

Or you could spend $70,000 and get a pre-built machine from Nvidia which is about 75%+ the performance.

Of course, as node shrinks happen, die sizes shrink, and the NN improves, perf/dollar and perf/watt will continue to increase.
Last edited by jhellis3 on Sat Dec 09, 2017 4:15 am, edited 1 time in total.
shrapnel
Posts: 1339
Joined: Fri Nov 02, 2012 9:43 am
Location: New Delhi, India

Re: AlphaZero is not like other chess programs

Post by shrapnel »

Albert Silver wrote:Actually, I am curious to know if one could run it well using GPUs, such as a couple of nVidia's high-end Titans. Gian-Carlo's Leela benefits greatly from a good GPU.

https://www.sjeng.org/leela.html
That would indeed be great.
I have always found it ridiculous that Chess programs depend so much on CPUs when modern GPUs are so much more powerful.
As you know, similarly, Video Gaming really came into its own when the Developers stopped relying so much on CPU and started using the power of the GPU !
i7 5960X @ 4.1 Ghz, 64 GB G.Skill RipJaws RAM, Twin Asus ROG Strix OC 11 GB Geforce 2080 Tis
Cardoso
Posts: 362
Joined: Thu Mar 16, 2006 7:39 pm
Location: Portugal
Full name: Alvaro Cardoso

Re: AlphaZero is not like other chess programs

Post by Cardoso »

This "zero" approach really surprised me, starting from almost nothing except the game's rules. I wasn't expecting this advancement so soon, even though they used pretty powerful hardware.

One of the things that amazes me is that Alpha Zero isn't blind to deep tactics (taking into consideration it only runs at 80K positions per second).
Can someone try to explaine this?
I mean I can understand it plays well positionally, but also being tactical so strong is surprising to me.
shrapnel
Posts: 1339
Joined: Fri Nov 02, 2012 9:43 am
Location: New Delhi, India

Re: AlphaZero is not like other chess programs

Post by shrapnel »

Cardoso wrote:This "zero" approach really surprised me, starting from almost nothing except the game's rules. I wasn't expecting this advancement so soon, even though they used pretty powerful hardware.

One of the things that amazes me is that Alpha Zero isn't blind to deep tactics (taking into consideration it only runs at 80K positions per second).
Can someone try to explaine this?
I mean I can understand it plays well positionally, but also being tactical so strong is surprising to me.
Quite simple.
Scientific explanation others can give you. I can just tell you what it means.
Positional Play, Tactical Play.... these are just Terms used by humans and obsolete chess engines like Stockfish, Houdini and Komodo.
The AlphaZero Program, after learning Chess in just a few Hours, has one and only one Goal, to Mate the Enemy King, NOTHING else !
What you see as Positional or Tactical Play, means NOTHING to this Monster Program. It wants to win and only win !
Positional or Tactical Play, is only a means to an end, for this Program.
It doesn't care what you call the type of Moves it makes.
It just makes the Moves it needs to make, to achieve its goal of winning.
Simple but deadly.
i7 5960X @ 4.1 Ghz, 64 GB G.Skill RipJaws RAM, Twin Asus ROG Strix OC 11 GB Geforce 2080 Tis