marsell wrote: ↑Sat Jun 15, 2019 11:36 am
The engine BrainLearn from Kelly Kinyama produces significantly more files than 8. Nearly 900
What am I doing wrong??
You're not doing anything wrong. If you read my post carefully, I wrote, 8 files per single different opening- line. As much different openings, as much .bin- files (except experience.bin remaining a single one) x7 + 1 experience.bin.
If you stick to a single line of opening- moves of >7 moves length, there will be 8 files only but constantly growing with the amount of games played with the same one opening.
That's my way of doing it, having separate folders of .bin- files for each and every single opening line (e.g. corr.- game) of interest of mine.
I played an engine torunament between Komodo 13, Komodo 13 MCTS and Stockfish 10 - on a P5-8400, 2GB Hash, 5 Cores, 40/2h+20/1h+30 mode with the 2017perfect book. 90 games, took almost a month.
Komodo 13 MCTS finished last. It was beaten by its own "regular" version (+0, -5, =25) as well as by Stockfish (+0, -6, =24).
Regular Komodo 13 lost to Stockfish by +0, -9, =21.
From the individual games it looks as if neither version of the new Komodo has any hope to beat Stockfish, not even once.
sound67 wrote: ↑Tue Jun 18, 2019 12:41 pm
I played an engine torunament between Komodo 13, Komodo 13 MCTS and Stockfish 10 - on a P5-8400, 2GB Hash, 5 Cores, 40/2h+20/1h+30 mode with the 2017perfect book. 90 games, took almost a month.
Komodo 13 MCTS finished last. It was beaten by its own "regular" version (+0, -5, =25) as well as by Stockfish (+0, -6, =24).
Regular Komodo 13 lost to Stockfish by +0, -9, =21.
From the individual games it looks as if neither version of the new Komodo has any hope to beat Stockfish, not even once.
Now try the same match at MultiPV=4 (as some people use in analysis)
Your beliefs create your reality, so be careful what you wish for.
Ovyron wrote: ↑Tue Jun 18, 2019 11:13 pm
Now try the same match at MultiPV=4 (as some people use in analysis)
I used the maximum number of cores for the engines that my P5 processor allowed, MultiPV=5. Ponder=Off.
Did you set MultiPV = 5 for ALL engines, not just Komodo? With that setting, Komodo 13.02 MCTS is MUCH stronger than normal Komodo, and about the same strength as Stockfish 10 (also using MultiPV). If you are getting results with Komodo MCTS below normal Komodo, something is wrong.
lkaufman wrote: ↑Wed Jun 19, 2019 6:07 pm
With that setting, Komodo 13.02 MCTS is MUCH stronger than normal Komodo, and about the same strength as Stockfish 10 (also using MultiPV).
But why set SF multPV too, when that'll weaken it? What is the elo drop of SF with multiPV > 1?
lkaufman wrote: ↑Wed Jun 19, 2019 6:07 pm
With that setting, Komodo 13.02 MCTS is MUCH stronger than normal Komodo, and about the same strength as Stockfish 10 (also using MultiPV).
But why set SF multPV too, when that'll weaken it? What is the elo drop of SF with multiPV > 1?
The idea is to test the engines the way many users actually use them, with MultiPV = 4 or 5. The drop in strength in SF (or any A/B engine) with MCTS is nearly as bad as cutting the time by that ratio, so SF with MultiPV = 5 is like SF with one fifth of the time in strength, roughly speaking. Komodo MCTS doesn't gain in strength my displaying more moves, it just doesn't lose strength the way all A/B engines do. No one is suggesting that all testing be done this way, it's just useful for those who normally use MultiPV.
Ovyron wrote: ↑Tue Jun 18, 2019 11:13 pm
Now try the same match at MultiPV=4 (as some people use in analysis)
I used the maximum number of cores for the engines that my P5 processor allowed, MultiPV=5. Ponder=Off.
Did you set MultiPV = 5 for ALL engines, not just Komodo?
Just Komodo.
Your point about MPV and analysis is well taken. Komodo MCTS is superb for analysis, and is even more compelling it you don't have a multi-core monster machine.
