Alayan wrote: ↑Wed Feb 26, 2020 1:12 am
I don't want the elo of rating lists to predict best result in a world championship setting, I want it to predict best result if taking an imperfect position from a game and playing it on.
But what game is it? If it's some random position of some random game then Stockfish or Leela with 2GPUs are already going to play much better this position than this engine, so all your elo would say is how weaker than top engines it'd do.
If it's a specific line from a game the engine is playing, doing so the way I say could reveal a position that this engine likes so much that it plays it better than Stockfish or Leela, because they just have higher ELO in general over the subset of opening the tester chooses (which isn't bigger than than the subset the engine plays best; I know because I built a chess map and can compare sizes), and if only this line was played the engine would show a higher elo than them, unless the tester also did this for them and made them avoid the positions they're bad at (that aren't necessarily bad positions, just positions current top engines don't know how to play.)
Alayan wrote: ↑Wed Feb 26, 2020 1:12 am How is the tester supposed to make sure he makes the engine play the lines it's best at ?
You start generic and delete the bad lines from the custom books of engines. What if there's an engine that excels with 1.f4? You test that and if it's good you keep it, if not you delete it until no engine plays the bird, but you don't make those decisions a priori for all engines by choosing a generic set that supposedly generalizes chess openings and call it a day, if one engine doesn't like one of your choices you have no reason to force it on it.
Alayan wrote: ↑Wed Feb 26, 2020 1:12 amDragonMist, former ICCF world champion, told me that at this point he considers top-level CC dead because it's becoming near-impossible to get wins against strong well-prepared opponents.
I'm not convinced about it, I think that if the prize was 1000000 dollars we'd see top-level CC alive and kicking with some amazing chess we have yet to witness, and that time travelers with software and hardware from 2025 would destroy today's top-level CC, so those winning strings exist, but nobody's life have depended on finding them so they'd rather play an easy game they can draw than getting into a complex position with 5% drawing chances that they could lose, but win as well.
Alayan wrote: ↑Wed Feb 26, 2020 1:12 amWe can agree to disagree I guess.
That's fine. I'll just claim that my method is better, and the only culprit is the time requirement that it has. Nobody has the time to prepare the strongest possible opening book for every engine they test, but I don't know if it was done some engine like Houdini 6 would rise to the top (it'd just need to play from both sides the best openings that it plays instead of this generic mess that has the top engines static.)