Stockfish github has nice syzygy test
Moderators: hgm, Rebel, chrisw
-
- Posts: 3291
- Joined: Wed Mar 08, 2006 8:15 pm
Stockfish github has nice syzygy test
2-6 pieces and up to 80 000 games. But I don't find it anymore. Where is it?
Jouni
-
- Posts: 3291
- Joined: Wed Mar 08, 2006 8:15 pm
Re: Stockfish github has nice syzygy test
Of course I mean 3-6 piece. And 3-4 gave nothing as SF has basic knowledge.
Jouni
-
- Posts: 3291
- Joined: Wed Mar 08, 2006 8:15 pm
Re: Stockfish github has nice syzygy test
It was cleverly hidden https://github.com/glinscott/fishtest/wiki/UsefulData.
Elo gain using syzygy
Tested at 10+0.1, with all syzygy WDL files on tmpfs (i.e. RAM), testing using none(0), 4, 5, and 6 man TB in a round-robin tournament (SF10dev).
Rank Name Elo +/- Games Score Draws
1 syzygy6 13 2 82591 51.8% 59.5%
2 syzygy5 2 2 82590 50.3% 59.4%
3 syzygy4 -7 2 82591 49.0% 59.3%
4 syzygy0 -7 2 82592 48.9% 59.4%
Tested at 60+0.6, with all syzygy WDL files on tmpfs (i.e. RAM), testing using none(0) against 6 man TB:
Score of syzygy6 vs syzygy0: 4084 - 3298 - 18510 [0.515] 25892 Elo difference: 10.55 +/- 2.25
So 6 piece = 149 GB data gives STC 20 ELO and LTC 10 ELO. Maybe at tournament level and SMP 5 ELO only ! Waste of storage?
Elo gain using syzygy
Tested at 10+0.1, with all syzygy WDL files on tmpfs (i.e. RAM), testing using none(0), 4, 5, and 6 man TB in a round-robin tournament (SF10dev).
Rank Name Elo +/- Games Score Draws
1 syzygy6 13 2 82591 51.8% 59.5%
2 syzygy5 2 2 82590 50.3% 59.4%
3 syzygy4 -7 2 82591 49.0% 59.3%
4 syzygy0 -7 2 82592 48.9% 59.4%
Tested at 60+0.6, with all syzygy WDL files on tmpfs (i.e. RAM), testing using none(0) against 6 man TB:
Score of syzygy6 vs syzygy0: 4084 - 3298 - 18510 [0.515] 25892 Elo difference: 10.55 +/- 2.25
So 6 piece = 149 GB data gives STC 20 ELO and LTC 10 ELO. Maybe at tournament level and SMP 5 ELO only ! Waste of storage?
Jouni
-
- Posts: 10948
- Joined: Wed Jul 26, 2006 10:21 pm
- Full name: Kai Laskos
Re: Stockfish github has nice syzygy test
Hmmm, curious scaling. I would expect stronger play would be decided more often in endgames. Thanks for pointing, needs explanation, the increased draw rate here from 59% to 71% cannot stand alone for explanation.Jouni wrote: ↑Thu Jan 23, 2020 9:15 am It was cleverly hidden https://github.com/glinscott/fishtest/wiki/UsefulData.
Elo gain using syzygy
Tested at 10+0.1, with all syzygy WDL files on tmpfs (i.e. RAM), testing using none(0), 4, 5, and 6 man TB in a round-robin tournament (SF10dev).
Rank Name Elo +/- Games Score Draws
1 syzygy6 13 2 82591 51.8% 59.5%
2 syzygy5 2 2 82590 50.3% 59.4%
3 syzygy4 -7 2 82591 49.0% 59.3%
4 syzygy0 -7 2 82592 48.9% 59.4%
Tested at 60+0.6, with all syzygy WDL files on tmpfs (i.e. RAM), testing using none(0) against 6 man TB:
Score of syzygy6 vs syzygy0: 4084 - 3298 - 18510 [0.515] 25892 Elo difference: 10.55 +/- 2.25
So 6 piece = 149 GB data gives STC 20 ELO and LTC 10 ELO. Maybe at tournament level and SMP 5 ELO only ! Waste of storage?
-
- Posts: 204
- Joined: Tue Oct 15, 2013 2:34 am
- Location: US
- Full name: Mike Babigian
Re: Stockfish github has nice syzygy test
149GB is a fly spitting into the wind. Even if the occasional extra win was not a whole ELO point it would be worth it. Now if full 7 piece or 8, gave less than 5 ELO a debate about wasted space could be had.
At current storage costs 149GB is imperceptible bit dust. I have a thumb drive with more storage plugged into my TV.
At current storage costs 149GB is imperceptible bit dust. I have a thumb drive with more storage plugged into my TV.
“Censorship is telling a man he can't have a steak just because a baby can't chew it.” ― Mark Twain
-
- Posts: 2727
- Joined: Wed May 12, 2010 10:00 pm
Re: Stockfish github has nice syzygy test
I agree with the numbers 5 to 20 Elo depending on the time controls. And this is what I see in my testing. But this is not the whole story. What does this Elo gain mean. It can mean 1 to 3 extra wins or saved losses in every 100 games. And Stockfish uses TB's very well because of the SF search, NN on the other had do not IMO. If I throw out 149 GB of Table Bases to save storage, on a 2 TB drive. Is this a wise move? No!Jouni wrote: ↑Thu Jan 23, 2020 9:15 am It was cleverly hidden https://github.com/glinscott/fishtest/wiki/UsefulData.
Elo gain using syzygy
Tested at 10+0.1, with all syzygy WDL files on tmpfs (i.e. RAM), testing using none(0), 4, 5, and 6 man TB in a round-robin tournament (SF10dev).
Rank Name Elo +/- Games Score Draws
1 syzygy6 13 2 82591 51.8% 59.5%
2 syzygy5 2 2 82590 50.3% 59.4%
3 syzygy4 -7 2 82591 49.0% 59.3%
4 syzygy0 -7 2 82592 48.9% 59.4%
Tested at 60+0.6, with all syzygy WDL files on tmpfs (i.e. RAM), testing using none(0) against 6 man TB:
Score of syzygy6 vs syzygy0: 4084 - 3298 - 18510 [0.515] 25892 Elo difference: 10.55 +/- 2.25
So 6 piece = 149 GB data gives STC 20 ELO and LTC 10 ELO. Maybe at tournament level and SMP 5 ELO only ! Waste of storage?
Accumulation of small advantages is how you win at chess at this Level!
"The worst thing that can happen to a forum is a running wild attacking moderator(HGM) who is not corrected by the community." - Ed Schröder
But my words like silent raindrops fell. And echoed in the wells of silence.
But my words like silent raindrops fell. And echoed in the wells of silence.
-
- Posts: 204
- Joined: Tue Oct 15, 2013 2:34 am
- Location: US
- Full name: Mike Babigian
Re: Stockfish github has nice syzygy test
Exactly. I also agree that LCO's tablebase usage is a cruel joke.If I throw out 149 GB of Table Bases to save storage, on a 2 TB drive. Is this a wise move? No!
Accumulation of small advantages is how you win at chess at this Level!
“Censorship is telling a man he can't have a steak just because a baby can't chew it.” ― Mark Twain