Stockfish and Multi-PV

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

User avatar
Rebel
Posts: 6991
Joined: Thu Aug 18, 2011 12:04 pm

Re: Stockfish and Multi-PV

Post by Rebel »

Lots of truth in there. We need a CCRL shorty rating list. A couple of years ago I (out of curiosity) played a shorty match between 2 equal rated versions of Stockfish and Komodo and the latter was crushed. And I concluded Stockfish had the better opening code. Now I know better lol. What you said, the last bastion. We need a new competition to tickle the programmers.
90% of coding is debugging, the other 10% is writing bugs.
User avatar
MikeB
Posts: 4889
Joined: Thu Mar 09, 2006 6:34 am
Location: Pen Argyl, Pennsylvania

Re: Stockfish and Multi-PV

Post by MikeB »

Rebel wrote: Fri Jun 07, 2019 6:01 am Lots of truth in there. We need a CCRL shorty rating list. A couple of years ago I (out of curiosity) played a shorty match between 2 equal rated versions of Stockfish and Komodo and the latter was crushed. And I concluded Stockfish had the better opening code. Now I know better lol. What you said, the last bastion. We need a new competition to tickle the programmers.
Stockfish could use an opening phase function in its evaluation. My thought was that HIARCS always seemed to play pretty well without an opening book - but that was from observations years ago - not sure today If i would have the same opinion.
Image
User avatar
Rebel
Posts: 6991
Joined: Thu Aug 18, 2011 12:04 pm

Re: Stockfish and Multi-PV

Post by Rebel »

One idea would be to create a STS type of opening set rating engines with MEA from Ferdy.

Such as:
1.d4 and 1.e4 10 points
1.c4 and 1.Nf3 8 points
1.f4 6 points

etc.

http://rebel13.nl/rebel13/experiments.html#six
Last edited by Rebel on Fri Jun 07, 2019 12:45 pm, edited 1 time in total.
90% of coding is debugging, the other 10% is writing bugs.
jp
Posts: 1470
Joined: Mon Apr 23, 2018 7:54 am

Re: Stockfish and Multi-PV

Post by jp »

Ovyron wrote: Fri Jun 07, 2019 5:37 am
Rebel wrote: Mon Jun 03, 2019 3:29 pm I think I am wasting my time looking at the moves it sometimes produces.
This situation happened because engine testers chose to play with generic books that take over the opening and play reasonable moves for the engine, and when the engine has to play it already skipped the problem entirely.

Engine developers have had no reason whatsoever to get better at the opening, and self-play has had a similar resolution. The elo chase is real

InfinityChess's Chess Engine Master tournament has shown that Leela isn't good at the openings either
That's why it's bad to give Leela tablebases. There needs to be incentive to improve its endgame play.
User avatar
Ovyron
Posts: 4556
Joined: Tue Jul 03, 2007 4:30 am

Re: Stockfish and Multi-PV

Post by Ovyron »

Rebel wrote: Fri Jun 07, 2019 12:32 pmSuch as:
1.d4 and 1.e4 10 points
1.c4 and 1.Nf3 8 points
1.f4 6 points
Hmmm, what recent developments in opening theory have showed me is that I'm not sure anymore if our preconceptions about what opening moves are best is good.

This started because of the bin book I downloaded that was bugged, and played 1.Nc3 no matter what, and I had a great performance with it. Then someone beat me with the black pieces, and I took a look, and noticed 1.Nc3 had 0% probability. I "fixed" it, and the book was now playing 1.e4 and 1.d4 as it should. And with those moves people keep beating me with the black pieces and have had the worst performance since then.

What if 1.Nc3 is a great move but people haven't found about it because it's an undiscovered gem? I have been using it to beat +2000 rated players on lichess.com and got 2nd place on < chess.com tourney, no way I could have done that with 1.e4 or 1.d4.

Should we give 1.Nc3 11 points in the test your propose? What if Rybka 2.2n2 (that loves the move) is best on the opening, but plays really badly the early middle game that nobody knows?

Maybe what we need is software like Aiquiry, that allows one engine to be used "as book", to play without book assistance until some point in the game, then switches to Stockfish, or some other at some point in the game, and we see how this new chess entity plays, maybe it'll play better than Stockfish without book all game, maybe some engine can push Leela's results beyond what we've seen. Maybe some engine without book with very low rating helps discover a new variation that is great that nobody has paid attention to because that engine misplays the positions.

The sky is the limit, but we have no idea of what openings are best, just what current entities are best at, but top Correspondence chess players, those that play at 2 years per game time control, have a preferrence of 1.c4 over 1.d4 or 1.e4, because at that level it's easier to with with c4. It's a bit mysterious.
Your beliefs create your reality, so be careful what you wish for.