How much elo is pondering worth?
Moderators: hgm, Rebel, chrisw
-
- Posts: 2272
- Joined: Mon Sep 29, 2008 1:50 am
How much elo is pondering worth?
Has this question been researched?
-
- Posts: 3226
- Joined: Wed May 06, 2009 10:31 pm
- Location: Fuquay-Varina, North Carolina
Re: How much elo is pondering worth?
I have one scant piece of data related to your question. Playing 750 games each at the CCRL blitz time control against a gauntlet of opponents, Gaviota 0.86 with ponder on measured 66 Elo stronger than ponder off (as measured by Ordo).
-
- Posts: 2272
- Joined: Mon Sep 29, 2008 1:50 am
Re: How much elo is pondering worth?
Thank you!
66 elo is a lot. You would think that pondering at most doubles your
thinking time. So 70 elo should be an upperbound.
It appears that Gaviota reaches this upperbound in your experiment but of course there are error bars to be considered which are quite large for
750 games.
66 elo is a lot. You would think that pondering at most doubles your
thinking time. So 70 elo should be an upperbound.
It appears that Gaviota reaches this upperbound in your experiment but of course there are error bars to be considered which are quite large for
750 games.
-
- Posts: 10948
- Joined: Wed Jul 26, 2006 10:21 pm
- Full name: Kai Laskos
Re: How much elo is pondering worth?
If 70 points is the doubling, isn't pondering worth significantly less? The ponder hits are about 60% for unrelated engines, so I would expect ~45 points if 70 is the doubling.Michel wrote:Thank you!
66 elo is a lot. You would think that pondering at most doubles your
thinking time. So 70 elo should be an upperbound.
It appears that Gaviota reaches this upperbound in your experiment but of course there are error bars to be considered which are quite large for
750 games.
-
- Posts: 3232
- Joined: Mon May 31, 2010 1:29 pm
- Full name: lucasart
Re: How much elo is pondering worth?
Doubling is probably worth more than 70 elo. Although it depends on the time control and the absolute strength of the engine at hand (diminishing returns effect on both variable).
Theory and practice sometimes clash. And when that happens, theory loses. Every single time.
-
- Posts: 10948
- Joined: Wed Jul 26, 2006 10:21 pm
- Full name: Kai Laskos
Re: How much elo is pondering worth?
I measured that, at 40/4' CCRL and CEGT one core doubling is 70 Elo points for Houdini 3. By extrapolation, doubling at 40/40' CCRL and CEGT one core is worth 55 points, and 40/120' 1 core 45 Elo points.lucasart wrote:Doubling is probably worth more than 70 elo. Although it depends on the time control and the absolute strength of the engine at hand (diminishing returns effect on both variable).
http://talkchess.com/forum/viewtopic.ph ... 3&start=12
Last edited by Laskos on Wed Aug 07, 2013 12:57 pm, edited 1 time in total.
-
- Posts: 2272
- Joined: Mon Sep 29, 2008 1:50 am
Re: How much elo is pondering worth?
70 elo/doubling is a rule of thumb that appears to be generally accepted (it has been reported here that it is not valid for very fast time controls; but Adam's experiment was for CCRL blitz time controls which are certainly not "very fast").f 70 points is the doubling, isn't pondering worth significantly less? The ponder hits are about 60% for unrelated engines, so I would expect ~45 points if 70 is the doubling.
45 elo would be compatible with the error bars in Adam's experiment.
-
- Posts: 10948
- Joined: Wed Jul 26, 2006 10:21 pm
- Full name: Kai Laskos
Re: How much elo is pondering worth?
Diminishing returns are very visible, at ultra-short controls doubling can be 150 points, at blitz CCRL and CEGT 70 points, and on 8 core 40/120' 35 points. So, one has to assume 40/4' on a pretty old CCRL and CEGT core to talk of 70 points for doubling.Michel wrote:70 elo/doubling is a rule of thumb that appears to be generally accepted (it has been reported here that it is not valid for very fast time controls; but Adam's experiment was for CCRL blitz time controls which are certainly not "very fast").f 70 points is the doubling, isn't pondering worth significantly less? The ponder hits are about 60% for unrelated engines, so I would expect ~45 points if 70 is the doubling.
45 elo would be compatible with the error bars in Adam's experiment.
-
- Posts: 3226
- Joined: Wed May 06, 2009 10:31 pm
- Location: Fuquay-Varina, North Carolina
Re: How much elo is pondering worth?
The ponder on/ponder off games used an actual time time control of 40 moves in 155 seconds, which roughly equates games on my (deceased) computer to the CCRL 40/4 reference. From previous time odds experiments, I estimate that doubling the speed at that time control on my computer is worth 70 to 90 Elo.
-
- Posts: 1600
- Joined: Mon Feb 21, 2011 9:48 am
Re: How much elo is pondering worth?
But it seems very difficult to measure these issues.
If you put "ponder ON" in both engines should not have differences.
For example, Houdini has a strength of 3000 on computer "A" of a core, and will have an strength of 3000 on computer "B"of a 4 cores,
against ther others engines within the same system.
But if it competes "A" versus "B", things change, still the same engine,
"B" crush "A".
The grace of "Ponder ON" the engine is hand made the expected move, which will be already stored in the HASH, but if the move is a surprise, is useless.
If you put "ponder ON" in both engines should not have differences.
For example, Houdini has a strength of 3000 on computer "A" of a core, and will have an strength of 3000 on computer "B"of a 4 cores,
against ther others engines within the same system.
But if it competes "A" versus "B", things change, still the same engine,
"B" crush "A".
The grace of "Ponder ON" the engine is hand made the expected move, which will be already stored in the HASH, but if the move is a surprise, is useless.