Rebel wrote: ↑Thu Aug 07, 2025 5:22 pm
pohl4711 wrote: ↑Thu Aug 07, 2025 7:03 am
I think, I understand whats happend. Its not a bug in the tools,
you mismatched results, using Gauntlet-EAS tool and/or EAS-tool with the hardcoded movelimit for short-wins bonus and the normal EAS-tool (here this movelimit is calculated out of the average length of all won games of the source.pgn). This leads (of course) to completely different values for the shorts-stat. But not only Patricia, this affects of course, all engines in a source.pgn.
LOL, now it's my fault
I am glad you tagged the problem, just tell me step by step which version to download and how to run it.
This depends on what you want to do with the EAS-Tool. The hardcoded movelimit versions in the for_engine_developers-folder should be only used, if you really need this hardcoded number.
This is from the ReadMe:
Normally the EAS-Tool calculates the shortwin movelimit (the limit, below an engine gets bonuspoints for a won game, because it is a short win) based on the average length of all won games in the input.pgn But this can lead to unstable results, when engine-developers play gauntlets with their new engine-version vs. a bunch of opponents (compared to the EAS-results, when a RoundRobin is evaluated).
Example: Rebel Extreme dev is tested by you in a gauntlet vs. some opponents (normal case). Because Rebel has much more short wins than a "normal" engine, here the calculation of the average length of won games (normally done by the EAS-tool) in such a Gauntlet-gamebase would lead to a very low number. Lower than the average length of won games in full RoundRobin-gamebase. So, Rebel Extreme Gauntlets would lead to higher EAS-scores than expected, because the average length of won games is too small in the Gauntlet-calculation.
The hardcoded EAS-Tools offer the opportunity to fix this by hardcoding the movelimit for short-wins. You can open the .bat file with an editor and set the hardcoded movelimit to any number.
These are the first lines of the tools:
REM **************************************************************************************
REM *** special hardcoded shortwin_movelimit here, change to other values, if you want ***
REM *** set it to 0, to deactivate the hardcode-override
set /A hardlimit=60
REM **************************************************************************************
Example 1: Average won game length in the source.pgn is 78 moves: Rounded to 75 and -15 = 60 is the
upper limit, followed by 55, 50, 45, 40
Example 2: Average won game length is 58 moves: Rounded to 55 and -15 = 40 is the upper limit,
followed by 35, 30, 25, 20
In all other cases, I would always recommend to use only the "normal" EAS-Tools in the main folder.
