Page 1 of 3

Looking inside NNs

Posted: Fri Mar 09, 2018 10:47 pm
by jwes
I ran across this which claims to explain the predictions of a NN. I have no idea if it works, but it would be interesting to run it on AlphaZero or giraffe.
code is here

Re: Looking inside NNs

Posted: Fri Mar 09, 2018 11:33 pm
by Henk
There are three things you should know about a neural network.
It is slow, slow and slow.

I am only talking about one CPU. I have no GPU.

Re: Looking inside NNs

Posted: Fri Mar 09, 2018 11:41 pm
by Dann Corbit
Henk wrote:There are three things you should know about a neural network.
It is slow, slow and slow.

I am only talking about one CPU. I have no GPU.
A 2 TF GPU does not cost very much.

Re: Looking inside NNs

Posted: Fri Mar 09, 2018 11:51 pm
by Henk
I only buy new hardware after ten years. My computer is 'only' five years old and you always buy too early.

Re: Looking inside NNs

Posted: Sat Mar 10, 2018 12:06 am
by Dann Corbit
Henk wrote:I only buy new hardware after ten years. My computer is 'only' five years old and you always buy too early.
You don't need a whole new computer, just a card to pop into it.
https://www.videocardbenchmark.net/gpu_value.html
Most MIPS per Dollar:
Radeon RX 550

About $100.

Re: Looking inside NNs

Posted: Sat Mar 10, 2018 12:24 am
by Henk
If it is only plug in and play.

I also am scared of opening machines I know nothing about. Maybe if there are good instruction videos.

They also told me never to repair your TV yourself because you may get electro shock.

Re: Looking inside NNs

Posted: Sat Mar 10, 2018 2:53 am
by jdart
It's also, by the nature of the thing, kind of opaque. You can explain a traditional chess evaluation function in words but explaining what a NN does in evaluation is difficult (the linked software provides a local linear approximation but that is not a good model of the NN in general).

--Jon

Re: Looking inside NNs

Posted: Sat Mar 10, 2018 5:16 am
by Dann Corbit
Henk wrote:If it is only plug in and play.

I also am scared of opening machines I know nothing about. Maybe if there are good instruction videos.

They also told me never to repair your TV yourself because you may get electro shock.
Unplug your computer from the wall and there is no danger.
If you are nervous to do it, find a friend who will do it for you.
It is at two minute job.

Re: Looking inside NNs

Posted: Sat Mar 10, 2018 10:07 am
by Henk
I think computershop do upgrades too. But then I probably pay 100 euro more.

My father upgraded his computer some years ago. But was not a success for after a few years it was still too slow.


Value of hardware and software is just like firework. Zero.

I remember university department buying expensive graphical chip in 1991 for tons or millions of dollars. Being worthless after three years. I remember they were complaining about it.

Re: Looking inside NNs

Posted: Sat Mar 10, 2018 10:34 am
by Dann Corbit
Henk wrote:I think computershop do upgrades too. But then I probably pay 100 euro more.

My father upgraded his computer some years ago. But was not a success for after a few years it was still too slow.


Value of hardware and software is just like firework. Zero.

I remember university department buying expensive graphical chip in 1991 for tons or millions of dollars. Being worthless after three years. I remember they were complaining about it.
All hardware decays exponentially in comparison to previous generations. But during the period that you use it, the value is palpable.

Therefore, it is not necessary to avoid buying hardware simply because it will be out of date quickly.

But if you are not comfortable performing the upgrade or you are not comfortable having a friend perform the upgrade or you are not interested in performing an upgrade or you do not feel the value of the upgrade is equivalent to the price then I suggest that you do not perform the upgrade.