dkappe wrote: You remind me of that guy who prattles on and on about Hopfield networks, believing that just because they have “neural network” in their name, they have anything to do with ResNets.
dkappe wrote:You *are* the Hopfield Networks guy.
Moderators: hgm, Rebel, chrisw
dkappe wrote: You remind me of that guy who prattles on and on about Hopfield networks, believing that just because they have “neural network” in their name, they have anything to do with ResNets.
dkappe wrote:You *are* the Hopfield Networks guy.
Perfectly fine. I was attacking your knowledge and understanding, not your motive or character.
It seems that basic set theory reasoning and ad hominem are the only places you can detect a fallacy, so you shoehorn everything into them, whether it fits or not.
You my friend have a conflict with a basic logic. The "fact" that the net with 18 pieces can't memorize the opening with 32 pieces has absolutely nothing to do with refuting that net with 32 pieces can memorize the opening with 32 pieces. You are just repeating your non sequitur argument, nothing else.
So your hypothesis is that a leela type network memorizes openings. How do we test this hypothesis? What evidence, for instance, would show this hypothesis to be false? If there is no possible way for the hypothesis to be disproven, then it is vacuous.Milos wrote: ↑Mon Sep 14, 2020 4:43 amYou my friend have a conflict with a basic logic. The "fact" that the net with 18 pieces can't memorize the opening with 32 pieces has absolutely nothing to do with refuting that net with 32 pieces can memorize the opening with 32 pieces. You are just repeating your non sequitur argument, nothing else.
To simplify the argument for you so you'd be able to actually follow - NN is equal to book+evaluation. When you enter a position with 32 pieces into NN that is trained on 18 pieces NN will perform only eval. When you enter a position that has 32 pieces and that net has actually been trained at it will output book score adjusted by its eval.
I cant explain it like you can but I agree with your assesment.Alayan wrote: ↑Tue Aug 25, 2020 5:30 pm People who believe Leela networks that see some early-game position hundreds of thousands to tens of millions of times in a training run perform no memorization whatsoever are deluding themselves.
This doesn't mean Leela networks are just a book, their ability in unknown positions proves there is a lot of pattern recognition going on, but perform a moderate start position alteration (invert bishops and knights, keep king/rook the same for castling) and you'll see relative performance drop against an engine with handcrafted eval. You may argue that it's because the patterns that come from the modified start position are somewhat different, but part of it may just as well come from the net weights not being tuned to play the best early moves. That is, not having memorized them.
Some people, like dkappe, argue about this topic as if there can only be two truths, Leela 0% book and Leela 100% book. This is a fallacy.
That the memorization is not some trivial mapping like a list of positions with move/eval is irrelevant. If you analyzed the brains of human chess players, you wouldn't be able to find neurons responsible for knowing that 1. e4 and 1. d4 are the best opening moves. But if you claim human chess players don't memorize early opening moves, you're delusional. So, the ability to memorize isn't determined by the way the memorized data is stored.
To put it another way : Magnus Carlsen isn't an opening book. But Magnus Carlsen do memorize openings, and it makes him play stronger.
Bringing SF-NNUE to the table has little relevance. NNUE doesn't feature a "policy" output that gives a weighted ordered list of expected best moves in a position, it only outputs an evaluation. The core of "Leela is a book" claim comes from the behavior of this "policy" output that can often play the theory move with no search whatsoever.
Besides, if a Leela-like net was paired with SF search, the arguments about "book" behavior would be just as relevant.
That the real God made.Milos wrote: ↑Wed Aug 26, 2020 4:19 pmYour argumentation is on the level of cavemen. You are attaching divine attributes to things you don't understand. Cavemen thought sun is a beautiful god just because they didn't understand that sun is actually a giant fusion reactor.Dann Corbit wrote: ↑Wed Aug 26, 2020 10:00 amAye, and there's the rub.AndrewGrant wrote: ↑Wed Aug 26, 2020 7:18 amI've never been a fan of Leela, due to the fact that its just a book.
And frankly, I don't know how to read.
Leela sings a beautiful song, and none of us even knows the key.
But I disagree. There is no book.
The robot bears the blade just as well, and with malice.
The book was not written by the lady
It was just a set of instructions how to kill
We, the gentle folk, knew little of her ways
But she borne razor knives the same, to force her wicked will