NNUE Poll

Discussion of chess software programming and technical issues.

Moderator: Ras

How do you feel about using NNUE based evaluation in your engine?

I'm already using NNUE in my engine
14
27%
I'd like to adopt NNUE but I lack the time or knowledge to implement it
11
22%
I don't want to use 3rd party training data / trainers and it's too much work to do everything from scratch
1
2%
I don't want to turn my engine into "yet another" NNUE engine
8
16%
I don't want to introduce the interpretability and transparency issues of neural networks into my evaluation
0
No votes
I may use NNUE in the future but there are other ideas I want to explore first
17
33%
 
Total votes: 51

smatovic
Posts: 3225
Joined: Wed Mar 10, 2010 10:18 pm
Location: Hamburg, Germany
Full name: Srdja Matovic

Re: NNUE Poll

Post by smatovic »

dangi12012 wrote: Wed Apr 26, 2023 4:52 pm
hgm wrote: Wed Apr 26, 2023 1:16 pm [...]
[...]
I get that people are exited about NNUE, new tech toys for us, like Christmas (and we have an excuse to buy new, geeky, hardware :)), but would people be that exited if they run Texel Tuning on an multidimensional PSQT?

--
Srdja
Patrice Duhamel
Posts: 194
Joined: Sat May 25, 2013 11:17 am
Location: France
Full name: Patrice Duhamel

Re: NNUE Poll

Post by Patrice Duhamel »

I may try NNUE in future, but there are things I want to try before, and I also lack of time, knowledge on how to implement it, and certainly lack of CPU power to train the network.
Anything that can go wrong will go wrong.
JoAnnP38
Posts: 253
Joined: Mon Aug 26, 2019 4:34 pm
Location: Clearwater, Florida USA
Full name: JoAnn Peeler

Re: NNUE Poll

Post by JoAnnP38 »

smatovic wrote: Thu Apr 27, 2023 5:36 pm
dangi12012 wrote: Wed Apr 26, 2023 4:52 pm
hgm wrote: Wed Apr 26, 2023 1:16 pm [...]
[...]
I get that people are exited about NNUE, new tech toys for us, like Christmas (and we have an excuse to buy new, geeky, hardware :)), but would people be that exited if they run Texel Tuning on an multidimensional PSQT?

--
Srdja
I would be! In fact, the I am planning on adding that to Pedantic in release 0.3 God willing. Of course, I guess then my HCE becomes NNLite and maybe that's the point you are trying to make.
smatovic
Posts: 3225
Joined: Wed Mar 10, 2010 10:18 pm
Location: Hamburg, Germany
Full name: Srdja Matovic

Re: NNUE Poll

Post by smatovic »

JoAnnP38 wrote: Thu Apr 27, 2023 8:27 pm I would be!
Beautiful, that's the spirit :)

I find it interesting to utilize the CPU SIMD unit for NN inference, or move generation, a new programming challenge.

--
Srdja
dangi12012
Posts: 1062
Joined: Tue Apr 28, 2020 10:03 pm
Full name: Daniel Infuehr

Re: NNUE Poll

Post by dangi12012 »

NNUE is a really bad term because people think it's one thing. If you read many engines source code you see it's really not.
Even Stockfish went through 5 architectures.

The shared idea is the incremental update for the input layer depending on: color, king SQ, piece, piece SQ. Everything else is different.

So the stigma around using NNUE is not warranted imo - it's another tool in the toolbox and it's really not 1 fixed thing that is set in stone.
Just call it incrementally updated eval NN and use it as drop in piece square table replacement.

"Someone" will soon share a single header file version with no external dependencies and just 100 lines of code or so. Bonus of code simplification is that the compiler emits mostly performant intrinsic like madd_epi16 from the scalar source on its own - so it's reasonably fast.
Worlds-fastest-Bitboard-Chess-Movegenerator
Daniel Inführ - Software Developer
User avatar
Rebel
Posts: 7299
Joined: Thu Aug 18, 2011 12:04 pm
Full name: Ed Schröder

Re: NNUE Poll

Post by Rebel »

dangi12012 wrote: Fri Apr 28, 2023 10:15 am NNUE is a really bad term because people think it's one thing. If you read many engines source code you see it's really not.
Even Stockfish went through 5 architectures.
We are already at 22 architectures.
90% of coding is debugging, the other 10% is writing bugs.
chrisw
Posts: 4624
Joined: Tue Apr 03, 2012 4:28 pm
Location: Midi-Pyrénées
Full name: Christopher Whittington

Re: NNUE Poll

Post by chrisw »

Rebel wrote: Fri Apr 28, 2023 10:22 am
dangi12012 wrote: Fri Apr 28, 2023 10:15 am NNUE is a really bad term because people think it's one thing. If you read many engines source code you see it's really not.
Even Stockfish went through 5 architectures.
We are already at 22 architectures.
Very likely Stockfish went through many more, testing and throwing away. But unless you keep trying, start simple, testing and building, you cannot really hope to comprehend the characteristics of architectural changes, or even get a handle on the their time costs.
User avatar
Eelco de Groot
Posts: 4658
Joined: Sun Mar 12, 2006 2:40 am
Full name:   Eelco de Groot

Re: NNUE Poll

Post by Eelco de Groot »

Joost Buijs wrote: Thu Apr 27, 2023 5:30 pm
hgm wrote: Wed Apr 26, 2023 1:16 pm Making an NNUE evaluation is not really programming. It requires some rather trivial standard code for running the NN. There is no creativity there, I might as well write a program to calculate my tax returns. What is the fun in that? Basically you let the computer write its own engine, and the only contribution you make yourself is paying the electricity bill. In the end you will get something that might play strong chess, but you would still have no clue why or how it does this. So as a method of getting some understanding is is also a bust.
If it is all so simple, why couldn't you get something trivial like this to work than? https://talkchess.com/forum3/viewtopic.php?f=7&t=76465
Maybe it is not so simple as you think it is. In the end all that matters is playing strength, nobody cares if it's been done with HCE, NNUE or whatever.
I am sure that many programmers would agree that it goes deeper than that. Computer chess is, in many senses, for me at least, still a Drosophila and a microcosm for what will happen, or could happen, in our relation with AI and how it could change our existence, fundamentally. As in a meeting with another intelligence. Like in Science Fiction, the Vulcans detecting Faster Than Light travel from the Phoenix engineered by Zephram Cochrane in 2063 and initiating First Contact.
Or the story of Prometheus (I think it was). The gods not wanting people to have fire and challenge them, like the Olympian gods overthrew themselves the Titans. I mean, these are existential questions.

Some related posts:
forum3/viewtopic.php?f=2&t=81876
https://prodeo.actieforum.com/t1150-alw ... ange#12906

"Full disclosure" as Srdja correctly asks for in the above thread, I think should no be some fleeting posts on Discord or even here but at the least some article, like in the IGCA journal. I mean, this could start a whole new science. And if you don't publish, somebody else will claim to be the first. That's how it works. Unfortunately, Ed and Chris are not on the best footing with the IGCA and Jaap van den Herik, if Jaap hasn't retired yet. There are other ways to publish of course. I'm sure Robert Hyatt could help bringing them into contact with the Association for Computing Machinery or some such. Does it still exist... But unfortunately, Ed and Chris are not on the best footing with Bob either... Maybe Peter Berger could help here...
Debugging is twice as hard as writing the code in the first
place. Therefore, if you write the code as cleverly as possible, you
are, by definition, not smart enough to debug it.
-- Brian W. Kernighan
syzygy
Posts: 5694
Joined: Tue Feb 28, 2012 11:56 pm

Re: NNUE Poll

Post by syzygy »

smatovic wrote: Thu Apr 27, 2023 5:36 pm
dangi12012 wrote: Wed Apr 26, 2023 4:52 pm
hgm wrote: Wed Apr 26, 2023 1:16 pm [...]
[...]
I get that people are exited about NNUE, new tech toys for us, like Christmas (and we have an excuse to buy new, geeky, hardware :)), but would people be that exited if they run Texel Tuning on an multidimensional PSQT?
But people have been tuning their parameters for a very long time already (and obviously without any chance of "understanding" why the tuned values are better). This is how you get more Elo.

There are people who are not interested in Elo and never ever considered to tune their parameters, so yeah, then why switch to NNUE.
smatovic
Posts: 3225
Joined: Wed Mar 10, 2010 10:18 pm
Location: Hamburg, Germany
Full name: Srdja Matovic

Re: NNUE Poll

Post by smatovic »

I am excited, Uri Blass mentioned that he could read PSQTs and that they made sense to him but not the NNUE weights.

Not only cos of more Elo, more Elo verifies that NNUE is superior, but this is the next step, we programmers start to replace ourselves with a black box, philosophical implication, the Technological Singularity.

***edit***
Maybe it is about the narrative, the pov, for some people it just extended tuning of parameters, for others new tech toys, for others more Elo, for others the takeoff of the TS....

--
Srdja