If you look at the current TCEC games, in each and every game, Crystal draws a sawtooth pattern while no other engine does that.
Possible explanation:
A term that should be applied to black's score is applied to white or vice versa.
Just examine any game. Something is not what it ought to be.
There could be some other explanation, but that is the only one that occurs to me.
I think Crystal must have an eval bug
Moderators: hgm, Rebel, chrisw
-
- Posts: 12538
- Joined: Wed Mar 08, 2006 8:57 pm
- Location: Redmond, WA USA
I think Crystal must have an eval bug
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
-
- Posts: 546
- Joined: Sat Aug 17, 2013 12:36 am
Re: I think Crystal must have an eval bug
No...
Crystal does not touch eval except to reduce it for shuffling. What you are perceiving is the result of mcts eval being very stable and Crystal exploring suboptimal paths, correcting the score, and switching off of them.
Crystal does not touch eval except to reduce it for shuffling. What you are perceiving is the result of mcts eval being very stable and Crystal exploring suboptimal paths, correcting the score, and switching off of them.
-
- Posts: 12538
- Joined: Wed Mar 08, 2006 8:57 pm
- Location: Redmond, WA USA
Re: I think Crystal must have an eval bug
The other AB engines (even SF) do not appear to behave in the same way.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
-
- Posts: 546
- Joined: Sat Aug 17, 2013 12:36 am
Re: I think Crystal must have an eval bug
Yes, Crystal will often have the most unstable eval out of all the engines, by design. At least when the position is not a draw .
The other AB engines do not have progress detection (or at least not to the level of Crystal) either.
There are also many situations where Crystal has had both the most stable and most accurate eval for the vast majority of the game.
People classifying any unexpected behavior as a bug is tiresome.
If one desires a more stable eval from Crystal, try zooming out on the graph, works wonders.
The other AB engines do not have progress detection (or at least not to the level of Crystal) either.
There are also many situations where Crystal has had both the most stable and most accurate eval for the vast majority of the game.
People classifying any unexpected behavior as a bug is tiresome.
If one desires a more stable eval from Crystal, try zooming out on the graph, works wonders.
-
- Posts: 4556
- Joined: Tue Jul 03, 2007 4:30 am
Re: I think Crystal must have an eval bug
Yeah, a "bug" is an unexpected behavior that appeared and wasn't intended by the programmer. No matter how weird it looks, if it's there by design it can't be a "bug".
-
- Posts: 12538
- Joined: Wed Mar 08, 2006 8:57 pm
- Location: Redmond, WA USA
Re: I think Crystal must have an eval bug
My mistake, and I do repent on bended knee in dust and ashes.jhellis3 wrote: ↑Sun Jun 14, 2020 3:20 pm Yes, Crystal will often have the most unstable eval out of all the engines, by design. At least when the position is not a draw .
The other AB engines do not have progress detection (or at least not to the level of Crystal) either.
There are also many situations where Crystal has had both the most stable and most accurate eval for the vast majority of the game.
People classifying any unexpected behavior as a bug is tiresome.
If one desires a more stable eval from Crystal, try zooming out on the graph, works wonders.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.