Search found 737 matches

by Desperado
Mon Jan 18, 2021 1:41 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Tapered Evaluation and MSE (Texel Tuning)
Replies: 148
Views: 3191

Re: Tapered Evaluation and MSE (Texel Tuning)

... One would probably get better evaluations (in term of Elo for the engines using them, not in terms of MSE) by testing on games of lower quality. The quicker development of large imbalances would probably be more important than whether an imbalance, once it occurs, would be perfectly mapped on i...
by Desperado
Mon Jan 18, 2021 12:12 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Tapered Evaluation and MSE (Texel Tuning)
Replies: 148
Views: 3191

Re: Tapered Evaluation and MSE (Texel Tuning)

In the end, I found out what was obvious from the beginning. The quality/content of the evaluation function in combination with the quality/selection of the data strongly influence the result of tuning. What is not so obvious is how this data is determined from general sources that fit the own evalu...
by Desperado
Mon Jan 18, 2021 11:05 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Tapered Evaluation and MSE (Texel Tuning)
Replies: 148
Views: 3191

Re: Tapered Evaluation and MSE (Texel Tuning)

Are you refering to my last answer now? I tried to put some light on the data. Sort of. You gave (fictitious) numbers for the piece values. But no indication of the MSE. Has that spectacularly dropped from the 0.13, for the full evaluation? To, say, around 0.06? Yes, it did. I would be able to repr...
by Desperado
Mon Jan 18, 2021 10:32 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Tapered Evaluation and MSE (Texel Tuning)
Replies: 148
Views: 3191

Re: Tapered Evaluation and MSE (Texel Tuning)

Are you refering to my last answer now? I tried to put some light on the data. Sort of. You gave (fictitious) numbers for the piece values. But no indication of the MSE. Has that spectacularly dropped from the 0.13, for the full evaluation? To, say, around 0.06? Yes, it did. I would be able to repr...
by Desperado
Mon Jan 18, 2021 10:14 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Tapered Evaluation and MSE (Texel Tuning)
Replies: 148
Views: 3191

Re: Tapered Evaluation and MSE (Texel Tuning)

I am not worried in the first place about what vector comes out, but whether the predictions made on the basis of that vector are any good. Even if what comes out seems reasonable, but isn't able to accurately predict the result (i.e. cause low MSE), we have achieved nothing. Piece values that we r...
by Desperado
Mon Jan 18, 2021 9:02 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Tapered Evaluation and MSE (Texel Tuning)
Replies: 148
Views: 3191

Re: Tapered Evaluation and MSE (Texel Tuning)

We measure eval in centi-Pawn here. So eval = 0 means result prediction 0.5, not 0. Wether 0.13 is bad or very bad depends on the draw fraction in the test set. If there really are 50% draws, it would be worse than the constant eval, which in itself is the worst possible eval that doesn't intention...
by Desperado
Sun Jan 17, 2021 8:12 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Tapered Evaluation and MSE (Texel Tuning)
Replies: 148
Views: 3191

Re: Tapered Evaluation and MSE (Texel Tuning)

Now the really interesting part... THE VALIDATION SETUP Algorithm: cpw-algorithm Stepsize: 5 evaltype: qs() tapered - material only initial vector: 100,100,300,300,300,300,500,500,1000,1000 param-content: P,P,N,N,B,B,R,R,Q,Q anchor: none K: 1.0 database: material.epd 13994 positions batchsize: 13994...
by Desperado
Sun Jan 17, 2021 7:51 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Tapered Evaluation and MSE (Texel Tuning)
Replies: 148
Views: 3191

Re: Tapered Evaluation and MSE (Texel Tuning)

To make that known exceptions from addition of piece values won't spoil the fit that much, you could add the rule in your evaluation that you divide the advantage by 2 if the leading side has no Pawn, and multiply it by 1.5 or 2 when the defender has only Pawns (or a bare King). Hello HG, sometimes...
by Desperado
Sun Jan 17, 2021 7:42 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Tapered Evaluation and MSE (Texel Tuning)
Replies: 148
Views: 3191

Re: Tapered Evaluation and MSE (Texel Tuning)

Please don't hate me, but here is the tuner algorithm in two methods. The minimizing code double Tuner::minimize(param_t* param, int stepsize) { double fitness; bool improved = TRUE; int backup; // mse for the current vector double bestFitness = mse(); for(int i = 0; i < pcount; i++) { improved = FA...