will Tcec allow Stockfish with a Leela net to play?

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Raphexon
Posts: 476
Joined: Sun Mar 17, 2019 12:00 pm
Full name: Henk Drost

Re: will Tcec allow Stockfish with a Leela net to play?

Post by Raphexon »

kranium wrote: Sat Jun 19, 2021 1:55 am
AndrewGrant wrote: Sat Jun 19, 2021 12:32 am
connor_mcmonigle wrote: Sat Jun 19, 2021 12:04 am
Have you ever actually tried a match between Stockfish with EGTB vs. without EGTB? With 6 man EGTB, one can expect less than 10 elo. For comparison, let's try Stockfish with an evaluation function vs. without an evaluation function... oh wait, that would be stupid. They're not remotely comparable and you know it.

You're just arguing in bad faith at this point so I don't see any reason to continue this discussion.
Correct on all accounts: http://chess.grantnet.us/test/11234/

And if anyone thinks a few hundred TB hits in the early game has any impact on the search tree ... well you don't have great intuition.

You should be getting at least 15-18, especially at longer TCs

CalPoly did a thorough study on this:
https://digitalcommons.calpoly.edu/cgi/ ... text=cpesp

Basically their results were as follows:

"Tablebase use has a significant performance benefit across all tested levels of play when using a short time control.
This gain can be expected to be approximately +20 Elo points for engines similar to those tested.

In longer games, Tablebase use tends to help stronger engines more. Stockfish saw an 18-point gain on increased time settings, whereas Spike and N2 had changes of +6 and -6, respectively."

Not sure why Ethereal benefits so little...maybe you can investigate after you've resolved the timeout issues.
Why are you linking an article that bases its conclusions on 240/250 game samples?
AndrewGrant
Posts: 1758
Joined: Tue Apr 19, 2016 6:08 am
Location: U.S.A
Full name: Andrew Grant

Re: will Tcec allow Stockfish with a Leela net to play?

Post by AndrewGrant »

Raphexon wrote: Sat Jun 19, 2021 11:12 am Why are you linking an article that bases its conclusions on 240/250 game samples?
In his defense, thats 10x the sample size of the average talkchess thread :lol:
#WeAreAllDraude #JusticeForDraude #RememberDraude #LeptirBigUltra
"Those who can't do, clone instead" - Eduard ( A real life friend, not this forum's Eduard )
kranium
Posts: 2129
Joined: Thu May 29, 2008 10:43 am

Re: will Tcec allow Stockfish with a Leela net to play?

Post by kranium »

AndrewGrant wrote: Sat Jun 19, 2021 11:15 am
Raphexon wrote: Sat Jun 19, 2021 11:12 am Why are you linking an article that bases its conclusions on 240/250 game samples?
In his defense, thats 10x the sample size of the average talkchess thread :lol:
well you're right..good point
it's unfortunate, the paper is so well done otherwise, and extremely thorough
tested so many variables

tablebase size
engine strength
(weak medium strong)
game length
tablebase size & performance
tablebase access time
drive speed
tactics

only to fall short in the # of games chosen to play
(although they do consistently reach 70-80% LOS)

that really seems to be it's achilles heel
:roll: