"All-metrics" 8-men tablebase generator

Discussion of chess software programming and technical issues.

Moderator: Ras

noobpwnftw
Posts: 700
Joined: Sun Nov 08, 2015 11:10 pm
Full name: Bojun Guo

"All-metrics" 8-men tablebase generator

Post by noobpwnftw »

I vibe coded this on top of my old xiangqi tablebase generator, which will produce chess tablebases of various metrics:
https://github.com/noobpwnftw/chesstb

It will probably use some 4TB of RAM to build the largest 8-men tables after king adjacent slices based paging, but given that you'd need storage in petabytes anyways, having to use a few machines with adequate RAM seems to make sense. So I decided not to go the full on-disk route(refer to syzygy's new generator for that).

This paging scheme also unlocks building of compact DTM50 tables and everything in between, well under available RAM on commodity hardware. So that part is also settled. By compact, WDL and DTC tables are in the same ballpark as syzygy counterparts, flat DTM tables are some 4x smaller than existing alternatives while my unified DTM50 tables are roughly equal to them in size but packs 100x extra hmc layers of information. Numbers are measured from built 3-5 men tables.

I will do a full 6-men run and publish tables once they are built.
noobpwnftw
Posts: 700
Joined: Sun Nov 08, 2015 11:10 pm
Full name: Bojun Guo

Re: "All-metrics" 8-men tablebase generator

Post by noobpwnftw »

All 6-men tables are built.

DTM50 hmc=0 longest:

Code: Select all

dtm50/KQPPKQ.info (328 bytes)
  WHITE  win=7909793770  draw=727557884  lose=30926828  illegal=4871315278  legal=8668278482
         longest_win=367 idx=777398272 fen="8/4k3/8/Q7/8/7P/P7/q1K5 w"
  BLACK  win=2721097158  draw=2989555702  lose=3480049284  illegal=4348891616  legal=9190702144
         longest_win=87 idx=4541603208 fen="2K5/6Q1/3P4/8/2P5/5k2/q7/8 b"

dtm50/KQKPPP.info (328 bytes)
  WHITE  win=2191554586  draw=80206484  lose=9134218  illegal=1068973200  legal=2280895288
         longest_win=135 idx=303382637 fen="8/1K6/5Q2/2p5/8/8/3p3p/2k5 w"
  BLACK  win=798949726  draw=354833594  lose=1921497752  illegal=274587416  legal=3075281072
         longest_win=359 idx=1932109028 fen="8/5k1p/p7/4Q3/8/8/5p2/1K6 b"
Daniel Shawul
Posts: 4187
Joined: Tue Mar 14, 2006 11:34 am
Location: Ethiopia

Re: "All-metrics" 8-men tablebase generator

Post by Daniel Shawul »

Did you really vibe-coded your tb generation code? I guess it is true what they are discussing at TCEC: whether fully vibe-coded engines should or should not be allowed to participate. I would be pretty impressed with the existence of a >3000 elo engine fully vibe-coded!
noobpwnftw
Posts: 700
Joined: Sun Nov 08, 2015 11:10 pm
Full name: Bojun Guo

Re: "All-metrics" 8-men tablebase generator

Post by noobpwnftw »

I think the real question is how much credit people still have to give to something that already claimed to be 100% vibe coded slop.