lucasart wrote: ↑Wed Nov 28, 2018 12:30 pm
But
information (in a statistical sense) is what matters for me, not just draw rate. It's an important distinction to understand. TCEC openings are quite poor, despite the low draw rate. When you have an opening that gives white a practically won game, that means 2 games that provide zero information: engine A will win with white, then engine B will win with white, no statistical information obtained as to the relative strength of A vs. B, so 2 games wasted (unless the elo diff between engines is so large that you don't end-up with a double 1-0 score, but for engine developement this is never the case, you want to measure small incremental elo gains).
This is of course correct. Thats why it is important to look at the scores of asmFish and Komodo in that testruns, not only at the draw-rate. A draw has the same effect on the scores as two wins for white or two wins for black out of one position: The score of both engines will be pushed towards 50% (because both engines will get a win and a loose, which is the same as 2 draws = 1 point for each engine out of 2 games out of one opening-position = 50% score).
With the "normal, classical" openings (FEOBOS, SF 8 moves, HERT), asmFish-score was around
58-60%. An improved opening-set should give a better score for asmFish (more away from 50%) and a lower score for Komodo (more away from 50%, too), because of a lower number of draws and not too much 2 wins for one color out of one openings-position.
And the score of asmFish of your set was
64.2% (really good), SALC V5 big set: 61.6% (okay...) and
Drawkiller (Big set): Score
63.8% - 36.2%, draws: 39.5%
Drawkiller (Normal set): Score:
65.3% - 34.7%, draws: 33.5%
Drawkiller (Tournament set): Score:
65.3% - 34.7%, draws: 33.5%
So, Drawkiller Normal and Tournament have the best scores of asmFish and Komodo (most far away from 50%), too, not only the lowest draw-rate. And the Drawkiller Big-set has 63.8%, which is good, but not overwhelming and very close to your openings.
Lucasart short-openings set:
64.2% - 35.8% , draws: 52.2%
Regards - Stefan (SPCC)
PS: The Drawkiller openings were filtered with Komodo 11.2.2. Komodo checked all endpositions (using pgnscanner-tool), running on a i7-6700HQ 2.6GHz Notebook (Skylake CPU) with all 4 cores and 2048 Hash, Contempt=0.
The Komodo evaluation had to be in that interval for the big-files and the normal-files, otherwise, the position was deleted:
eval: [-0.49;-0.10] or [+0.10;+0.49]
For the tournament-files, the Komodo evaluation had to be in an even smaller interval:
eval: [-0.39;-0.20] or [+0.20;+0.39]
You can see, that the eval-intervals are quite small. No endposition of any Drawkiller opening can give a huge advantage to white or black!
Thinking-time for each endposition was:
Normal/Tournament set: 45''
Big set: 30''
( it took several months to finish these calculations!)