TalkChess.com

jp wrote: ↑Tue Dec 11, 2018 2:44 pm

Laskos wrote: ↑Tue Dec 11, 2018 12:48 pm

noobpwnftw wrote: ↑Tue Dec 11, 2018 12:26 pm Is it because people who wrote those 'fully decent' papers are not Google-branded?
But in my view a 'decent paper' is still a decent paper even if it is published on a morning newspaper.

You have no idea how is to publish in "Nature" and "Science" (Deep Mind publishing in both on this same theme). HGM has a "Nature" paper. I don't have, although I do have (few) papers in the best journals of physics (Phys. Rev. Letters, for example). I don't know about morning newspapers, not exactly my field of expertise. Many, many very solid researchers never in their life get to have a "Nature" or a "Science" paper.

That's because Nature & Science are for trendy stuff that the public can get excited over. That does not mean trendy stuff the public gets excited over has to be bad, just that work that's extremely good but not trendy and understandable by the public will not be in there.

Exactly and that is why these publication are used as virtual press releases by the big companies.
The procedure is the following, you publish an article in Nature, Science, then you issue an actual press release, then you invite scientific journalists to an open day or similar, then you get a lot of press and finally you announce a new product/technology.
Most ppl are naive or don't know, while others pretend. I'm pretty sure I know it, you know it, Kai knows it, Bojun knows it, Matthew knows it (maybe he doesn't he's just too young ), even HGM knows it but just plays dumb.

I find it interesting that the purpose of such journals are for people to have a place to share their discoveries among others, when they have no ability to reach the audience on their own. Why would anyone want to 'bar' their own papers from getting published anyway? If you don't want to get it published, don't even bother writing a paper on it.

Barring is what the journals supposed to do, if

many, many very solid researchers never in their life get to have a "Nature" or a "Science" paper.

then the problem is not with the researchers.

I do not see any necessity to have my emotions attached to such titles, but maybe that's not for everyone.

Matthew, I have one last question regarding the implementation details that aren't explicit in the paper.

Normally, an MCTS search would do "tree reuse" from move to move, carrying forward the subtree that was actually chosen. But during the training, there is noise added to the root. If one does tree reuse, the effect of the noise is lessened. Leela Chess Zero decided to disable tree reuse because of that. Leela Zero has kept it enabled.

Could you clarify how it was done in DeepMind's version?

noobpwnftw wrote: ↑Tue Dec 11, 2018 3:30 pm I find it interesting that the purpose of such journals are for people to have a place to share their discoveries among others, when they have no ability to reach the audience on their own. Why would anyone want to 'bar' their own papers from getting published anyway? If you don't want to get it published, don't even bother writing a paper on it.

Barring is what the journals supposed to do, if

many, many very solid researchers never in their life get to have a "Nature" or a "Science" paper.

then the problem is not with the researchers.

I do not see any necessity to have my emotions attached to such titles, but maybe that's not for everyone.

I don't understand a word of what you wrote. Top journals ("Nature" and "Science" are the top journals in sciences) want to be relevant, and their content to have high significance for current science and its development.
The simple fact that ML, especially reinforcement learning using deep networks proved above-human-capabilities first in Go and IIRC only later, with more involved techniques, in Pac-Man, is very noteworthy even for me, a complete amateur in this field. We are closer to understanding what humans are up to in daily life, Pac-Man being an ultra-simplified caricature of the daily life. Deep Mind paper on Go and this more generalized AlphaZero paper ARE significant, absolutely the level to be published in "Nature" and "Science". That Google/DeepMind have it easy to get such feats, that it's a PR stunt, marketing trick and so on, is not the business of these journals, as long as corruption is not involved. These journals, if they want to preserve their stature and authority, have to inform from specialists to amateurs in this field like me how the significant progress in this important research domain is going.

Gian-Carlo Pascutto wrote: ↑Tue Dec 11, 2018 4:12 pm Matthew, I have one last question regarding the implementation details that aren't explicit in the paper.

Normally, an MCTS search would do "tree reuse" from move to move, carrying forward the subtree that was actually chosen. But during the training, there is noise added to the root. If one does tree reuse, the effect of the noise is lessened. Leela Chess Zero decided to disable tree reuse because of that. Leela Zero has kept it enabled.

Could you clarify how it was done in DeepMind's version?

It is enabled at all times unless we are testing something specific that will be affected by it. We introduce diversity in two ways - dirichlet noise and visit count sampling.

Dirichlet noise is used to modify prior at the root node before each search (if it's enabled). So if a subtree is reused, when the next search starts it will be added to the node that is now the root node.

Visit count sampling isn't really affected.

jp wrote: ↑Tue Dec 11, 2018 2:44 pm That is not true. It's definitely possible to get the paper accepted without reviewers all being happy.


But the publication policies of Nature & Science probably shouldn't be the main topic here.

Oh yeah? How many Science or Nature papers do you have to your name that did not have the approval of the referees?

Milos wrote: ↑Tue Dec 11, 2018 2:39 pmAnd regarding anonymous peer reviewing, it is never double-blind even when journal policy says so.

That you even mention 'double blind' here shows that you have no clue whatsoever how the peer-review system works, and are just shooting off your mouth as usual. Of course it is not double blind. I have refereed hundreds of papers for Journals like Science, Nature, Pys. Rev. Lett., Phys. Rev. A, J. Phys. B etc, and I always got to see the full title and author list as a referee. 'Anonymous referee' just means that the authors who submitted the paper don't know the referee. So that it would be impossible to affect their decision by threats or bribes, without actually bribing everyone in the field.

hgm wrote: ↑Tue Dec 11, 2018 5:13 pm

jp wrote: ↑Tue Dec 11, 2018 2:44 pm That is not true. It's definitely possible to get the paper accepted without reviewers all being happy.

But the publication policies of Nature & Science probably shouldn't be the main topic here.

Oh yeah?

Yes, yeah. The reviewers can be in disagreement. It happens. Depends how much the unhappy reviewer wants to fight.

This discussion of Nature & Science is sorta off topic, but if everyone wants to talk about it that's ok.

hgm wrote: ↑Tue Dec 11, 2018 5:13 pm

jp wrote: ↑Tue Dec 11, 2018 2:44 pm That is not true. It's definitely possible to get the paper accepted without reviewers all being happy.


But the publication policies of Nature & Science probably shouldn't be the main topic here.

Oh yeah? How many Science or Nature papers do you have to your name that did not have the approval of the referees?

Milos wrote: ↑Tue Dec 11, 2018 2:39 pmAnd regarding anonymous peer reviewing, it is never double-blind even when journal policy says so.

That you even mention 'double blind' here shows that you have no clue whatsoever how the peer-review system works, and are just shooting off your mouth as usual. Of course it is not double blind. I have refereed hundreds of papers for Journals like Science, Nature, Pys. Rev. Lett., Phys. Rev. A, J. Phys. B etc, and I always got to see the full title and author list as a referee. 'Anonymous referee' just means that the authors who submitted the paper don't know the referee. So that it would be impossible to affect their decision by threats or bribes, without actually bribing everyone in the field.

It seems with age you are becoming dyslexic. Kind of missed the whole part of the sentence starting with "even when" (or "all being happy" in jp's comment). There is quite bunch of journals that have a double blind policy. That fact you didn't hear about it reflects more on your lack of actual experience outside of your small self-centric world and the need of empty bragging than anything else.

jp wrote: ↑Tue Dec 11, 2018 5:29 pmYes, yeah. The reviewers can be in disagreement. It happens. Depends how much the unhappy reviewer wants to fight.

That did not answer my question. How many Science papers did you publish that way?

Laskos wrote: ↑Tue Dec 11, 2018 1:42 pm Yes, but didn't they take SF8 + book itself, and not the full BrainFish with its UCI option? That would be a good match: A0 versus full BrainFish of early 2018 with varied openings UCI option, but they seem to not have done that.

This is an important question. Matthew, can you confirm whether Brainfish was used, or merely Stockfish with the Cerebellum polyglot book? It's my understanding that the Brainfish binary will use the stored evaluations in search, whereas SF + polyglot will not.

-Carl