Using Neural Network or Syzygy tables

Discussion of chess software programming and technical issues.

Moderator: Ras

OliverBr
Posts: 741
Joined: Tue Dec 18, 2007 9:38 pm
Location: Munich, Germany
Full name: Dr. Oliver Brausch

Using Neural Network or Syzygy tables

Post by OliverBr »

Hello,

now we are watching new engines reaching ELO 3600+ by using Neural Network. A lot of engines are using syzygy tables which is will enhance their performance a lot.

Just asking for a friend:
Is this really the "essence" of chess programming? Aren't the most difficult parts, the eval and the endgame, just being outsourced? Or did every of those engines program those features for their own?
Chess Engine OliThink: http://brausch.org/home/chess
OliThink GitHub:https://github.com/olithink
AndrewGrant
Posts: 1953
Joined: Tue Apr 19, 2016 6:08 am
Location: U.S.A
Full name: Andrew Grant

Re: Using Neural Network or Syzygy tables

Post by AndrewGrant »

I'll just chime in at least to say that Syzygy tablebases are worth almost 0 elo now in the top engines.
So that aspect of "outsourc[ing]" is not really relevant.
Ciekce
Posts: 190
Joined: Sun Oct 30, 2022 5:26 pm
Full name: Conor Anstey

Re: Using Neural Network or Syzygy tables

Post by Ciekce »

OliverBr wrote: Sun May 25, 2025 11:24 pm Or did every of those engines program those features for their own?
people aren't sharing networks, despite unfounded accusations from a certain longstanding community member
OliverBr
Posts: 741
Joined: Tue Dec 18, 2007 9:38 pm
Location: Munich, Germany
Full name: Dr. Oliver Brausch

Re: Using Neural Network or Syzygy tables

Post by OliverBr »

AndrewGrant wrote: Mon May 26, 2025 12:03 am I'll just chime in at least to say that Syzygy tablebases are worth almost 0 elo now in the top engines.
It may be so because most are using Neural Network? Could this render Syzygy tablebases less useful?
So that aspect of "outsourc[ing]" is not really relevant.
So engines could just not use Syzygy tables, but many do. Why?
Last edited by OliverBr on Mon May 26, 2025 1:18 am, edited 1 time in total.
Chess Engine OliThink: http://brausch.org/home/chess
OliThink GitHub:https://github.com/olithink
OliverBr
Posts: 741
Joined: Tue Dec 18, 2007 9:38 pm
Location: Munich, Germany
Full name: Dr. Oliver Brausch

Re: Using Neural Network or Syzygy tables

Post by OliverBr »

Ciekce wrote: Mon May 26, 2025 1:11 am
OliverBr wrote: Sun May 25, 2025 11:24 pm Or did every of those engines program those features for their own?
people aren't sharing networks, despite unfounded accusations from a certain longstanding community member
I am not saying anyone is sharing a network. But did everyone create the program that created the network by him/her/itself?
Chess Engine OliThink: http://brausch.org/home/chess
OliThink GitHub:https://github.com/olithink
mar
Posts: 2646
Joined: Fri Nov 26, 2010 2:00 pm
Location: Czech Republic
Full name: Martin Sedlak

Re: Using Neural Network or Syzygy tables

Post by mar »

OliverBr wrote: Sun May 25, 2025 11:24 pm Hello,

now we are watching new engines reaching ELO 3600+ by using Neural Network. A lot of engines are using syzygy tables which is will enhance their performance a lot.

Just asking for a friend:
Is this really the "essence" of chess programming? Aren't the most difficult parts, the eval and the endgame, just being outsourced? Or did every of those engines program those features for their own?
what's the point of all this? are you trying to imply something?!

egtbs only bring a handful of elo at best (I got about 10 self-play with syzygy and my engine is far from top) - so why use it?
I have watched way too many games where the engine was trying to win dead endgame draws, looking silly

as for nets: I use libtorch for low level net optimization, however the trainer itself is written by me.
everything else is completely custom, including topology, indexing scheme and inference code
there are also people who wrote trainers completely from scratch without even relying on third party libraries
also I only used self-play for training, no external factors involved except data was generated with syzygy enabled
and btw generating positions is by far the most time consuming process

lastly I'd like to thank Jay and Peter again, who were very helpful when I was transitioning my engine to NNs

we are all "outsourcing" compilers and operating systems. even compilers often "outsource" LLVM
User avatar
towforce
Posts: 12324
Joined: Thu Mar 09, 2006 12:57 am
Location: Birmingham UK
Full name: Graham Laight

Re: Using Neural Network or Syzygy tables

Post by towforce »

AndrewGrant wrote: Mon May 26, 2025 12:03 am I'll just chime in at least to say that Syzygy tablebases are worth almost 0 elo now in the top engines.
So that aspect of "outsourc[ing]" is not really relevant.

Thank you: would not have realised that if you hadn't "chimed in". :)
Yesterday, upon the stair,
I met a man who wasn't there!
He wasn't there again today,
I wish, I wish he'd go away!
OliverBr
Posts: 741
Joined: Tue Dec 18, 2007 9:38 pm
Location: Munich, Germany
Full name: Dr. Oliver Brausch

Re: Using Neural Network or Syzygy tables

Post by OliverBr »

towforce wrote: Wed May 28, 2025 10:51 pm
AndrewGrant wrote: Mon May 26, 2025 12:03 am I'll just chime in at least to say that Syzygy tablebases are worth almost 0 elo now in the top engines.
So that aspect of "outsourc[ing]" is not really relevant.

Thank you: would not have realised that if you hadn't "chimed in". :)
It may be so for "Top" engines, especially with a neural net.
But: If you consider a "normal" engine, everything hand-crafted, own ideas, no neural network, I really do think, that Syzygy tablebases increase the ELO of such an engine.
Chess Engine OliThink: http://brausch.org/home/chess
OliThink GitHub:https://github.com/olithink
User avatar
lithander
Posts: 913
Joined: Sun Dec 27, 2020 2:40 am
Location: Bremen, Germany
Full name: Thomas Jahn

Re: Using Neural Network or Syzygy tables

Post by lithander »

Tapered PSQTs where you find the the values with something like Texel's tuning method is considered normal and an essential part of a basic HCE, right?

But it's not more or less original and handcrafted than using NNUEs. In both cases the chess knowledge is encoded in weights/coefficients and found via machine learning approaches.
Minimal Chess (simple, open source, C#) - Youtube & Github
Leorik (competitive, in active development, C#) - Github & Lichess