Tablebase suggestion

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

User avatar
Nordlandia
Posts: 2830
Joined: Fri Sep 25, 2015 9:38 pm
Location: Sortland, Norway

Re: Tablebase suggestion

Post by Nordlandia »

How feasible is undertaking 8-man tables or partly about let's say 2030 around. Is the equipment up to snuff, or do we need something like Lomonosov II SuperComputer contraption or deemed obsolete by 2030 to commence 8-man EGTBs generation.
syzygy
Posts: 5873
Joined: Tue Feb 28, 2012 11:56 pm

Re: Tablebase suggestion

Post by syzygy »

Nordlandia wrote: Sun Feb 01, 2026 5:08 am How feasible is undertaking 8-man tables or partly about let's say 2030 around. Is the equipment up to snuff, or do we need something like Lomonosov II SuperComputer contraption or deemed obsolete by 2030 to commence 8-man EGTBs generation.
For the largest pawnless tables a PC with at least 37.2 TB of shared RAM would be needed if the algorithm uses 1 byte per position.
Most pawnless 8-piece tables will have two identical pieces of the same colour, which would halve the requirements. But 18.6 TB of RAM is still a lot.

It is possible to generate them with less RAM and instead a lot of disk I/O. I think only hard disks could be used for this because SSDs would not survive for long. Generation would be quite slow, but perhaps it is doable.

Pawnful tables could be generated with about 4TB of RAM with 1 byte per position (by splitting the table in 24 parts, pawn on a2-d7) and a reasonable amount of disk I/O. If we don't care about the price (at the moment RAM prices are ridiculously high), then this is possible with a dual-socket or even single-socket EPYC server. But first the relevant pawnless tables would need to be generated.

Total storage for WDL+DTZ should be 1-2 PB or something of that order. This is a lot but it fits in a room. (Whether they can be accessed fast enough for generating tables that promote into them is another question.)

I guess all 8-piece tables will eventually be generated. This is less clear for 9-piece tables.

Here are statistics of tables generated by Marc Bourzutschky:
https://drive.google.com/drive/folders/ ... PuGCkwXDTI
As far as I can tell, all tables have at least two same pieces of the same colour. One of them is KQRBNvKQQ:

Code: Select all

Ending kqrbnkqq
WTM max win:  114
BTM max loss: 114
WTM wins:   3,179,192,378,285 (70.9%)
BTM loses:  1,518,211,034,482 (32.5%)
White wins: 4,697,403,412,767 (51.3%)
WTM legal:  4,483,788,773,672
BTM legal:  4,669,054,760,916

BTM stalemated: 0
WTM winning captures: 2,604,087,801,230
WTM win percent without captures: 30.60
BTM saving captures: 2,710,869,905,387
BTM loss percent without captures: 77.53

Depth          Wins
    1 2683624174292
    2  231127732226
    3  108520251790
    4   65418752434
    ...
I read somewhere that Marc's machine has 1.5 TB of RAM, so his(/Yakov Konoval's) generator might be able to generate the biggest tables using 3 TB of RAM. I don't know if they saved them.

Ah, there is also a readme.txt:
syzygy
Posts: 5873
Joined: Tue Feb 28, 2012 11:56 pm

Re: Tablebase suggestion

Post by syzygy »

syzygy wrote: Sun Feb 01, 2026 6:59 amFor the largest pawnless tables a PC with at least 37.2 TB of shared RAM would be needed if the algorithm uses 1 byte per position.
The Wu-Beal algorithm apparently requires only 1 bit per position and only for one side to move, which would mean 2.32 TB.

Once there are two identical pieces, this goes down to 1.16 TB, which indeed fits in 1.5 TB.

So a machine with 4 TB of shared RAM should be enough.
Most pawnless tables will have to be generated using the Wu-Beal algorithm.
Pawnful tables, of which there are many more, can be generated more efficiently, but they are also bigger, and they require a lot of probing of other 8-piece table to resolve pawn promotions, whicih will be slow. (Doing the pawnless tables, which for a large part already seems to have been done, will be the easy part.)
User avatar
Nordlandia
Posts: 2830
Joined: Fri Sep 25, 2015 9:38 pm
Location: Sortland, Norway

Re: Tablebase suggestion

Post by Nordlandia »

Is it difficult to predict whether it is more difficult to hold on to the 8-piece constellation or whether liquidation to 7-pieces is generally more common?

It has been suggested that eight-piece configurations possess reduced utility, as they can be more quickly liquidated into seven-piece positions.
syzygy
Posts: 5873
Joined: Tue Feb 28, 2012 11:56 pm

Re: Tablebase suggestion

Post by syzygy »

Nordlandia wrote: Sun Feb 01, 2026 9:46 am Is it difficult to predict whether it is more difficult to hold on to the 8-piece constellation or whether liquidation to 7-pieces is generally more common?

It has been suggested that eight-piece configurations possess reduced utility, as they can be more quickly liquidated into seven-piece positions.
If you pick a position at random, then the more pieces on the board, the higher the probability that the side to move's best move is a capture gaining material. But in chess games pieces generally defend each other, so the interesting positions are not randomly selected.

A better argument "against" the utility of 8-piece tablebases might be that 8-piece positions occurring in games tend to be either too balanced to not be an easy draw, or too unbalanced to not be an easy win for the stronger side. Positions where the material differs by exactly one pawn will always have an odd number of pieces. But of course there are lots of ways in which a 4v4 can be unbalanced, and 5v3 can still be nearly balanced.