Opening Book Project: v01 after Houdini analysis available!

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

BrendanJNorman
Posts: 2553
Joined: Mon Feb 08, 2016 12:43 am
Full name: Brendan J Norman

Re: Opening Book Project: v01 after Houdini analysis availab

Post by BrendanJNorman »

leavenfish wrote:Any 'book' that can't include my favorite Bent Larsen contribution: 1. g3 e5, 2. Bg2 d5, 3. Nf3 (often aiming for a reversed Alekhine...tempo up) doesn't get the time of day from me! :wink:

But seriously (?) very interesting project.
Wasn't Bent Larson, buddy.

That system was first (to my mind) played, via transposition by Reti against Alekhine in Baden Baden 1925 in what become one of the most beautiful games ever played.
Frank Quisinsky
Posts: 6811
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: I hope others have interest to help ...

Post by Frank Quisinsky »

Hi Terrence,

if ready ...
Could I added your file to my project files later?

Thanks again!

I think it will be a secret which engine on your PC is still running!?

Best
Frank
Frank Quisinsky
Posts: 6811
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: Opening Book Project: v01 after Houdini analysis availab

Post by Frank Quisinsky »

Hi Dann,

thanks again!

1. If we have later more engine analysis we should add all in one Excel file. Much more easy to compare the 0,00 evals. I am thinking this will be the last step for the database, means to reject 0.0 positions from the database.

2. If you will help with analysis, it's very important that you are using the file: beta-v03_endpos-n.epd.

At first Stockfish and Komodo are cleaning the beta-v03 main database only. The beta-v01 and beta-v02 files are not longer important.

If different engines later analyzing the beta-v03_endpos-n.epd we can do a lot with all the statistics.

If you like I can added the files you created to the project files later.
Very nice that I have Dann Corbit in the boat.

Best
Frank
Dann Corbit
Posts: 12563
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Opening Book Project: v01 after Houdini analysis availab

Post by Dann Corbit »

Frank Quisinsky wrote:Hi Dann,

thanks again!

1. If we have later more engine analysis we should add all in one Excel file. Much more easy to compare the 0,00 evals. I am thinking this will be the last step for the database, means to reject 0.0 positions from the database.

2. If you will help with analysis, it's very important that you are using the file: beta-v03_endpos-n.epd.

At first Stockfish and Komodo are cleaning the beta-v03 main database only. The beta-v01 and beta-v02 files are not longer important.

If different engines later analyzing the beta-v03_endpos-n.epd we can do a lot with all the statistics.

If you like I can added the files you created to the project files later.
Very nice that I have Dann Corbit in the boat.

Best
Frank
I used beta-v03_endpos-n.epd

I have every position analyzed. Most are 30 plies deep or more, but a few are less than 30 plies.

90% of the analysis is Stockfish.
8% of what is left is Komodo
The last 2% is Houdini.

Unfortunately, I cannot tell you which is which for the EPD records because I did not design the database to store the engine details.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
Tdunbug
Posts: 47
Joined: Mon Mar 07, 2016 12:46 am

Re: Opening Book Project: v01 after Houdini analysis availab

Post by Tdunbug »

How the hell did you get through the database so quickly! I am not even a quarter the way through!
Dann Corbit
Posts: 12563
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Opening Book Project: v01 after Houdini analysis availab

Post by Dann Corbit »

Tdunbug wrote:How the hell did you get through the database so quickly! I am not even a quarter the way through!
I have an army of machine.
I have most commonly played positions already analyzed (I have about a billion analyzed positions).
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
Milos
Posts: 4190
Joined: Wed Nov 25, 2009 1:47 am

Re: Opening Book Project: v01 after Houdini analysis availab

Post by Milos »

Tdunbug wrote:How the hell did you get through the database so quickly! I am not even a quarter the way through!
I have couple of machines but only analyse it on 16 core server. If I left it 1min per thread, 32 threads, 26k positions, that would be less than 820 minutes or less than 14h. There were like 56 hours (4 times 14h) between Frank's and Dann's post. ;)
Tdunbug
Posts: 47
Joined: Mon Mar 07, 2016 12:46 am

Re: Opening Book Project: v01 after Houdini analysis availab

Post by Tdunbug »

so is it recommended to analysis pre thread or full cpu power?
Dann Corbit
Posts: 12563
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Opening Book Project: v01 after Houdini analysis availab

Post by Dann Corbit »

Tdunbug wrote:so is it recommended to analysis pre thread or full cpu power?
If I am going to use a position for an opening book, I analyze to 36 plies (at least).

The more threads you use, the faster you get there.

It is sometimes good to do it in layers, so that you find the really awful ones more quickly and do not waste time on them.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
Milos
Posts: 4190
Joined: Wed Nov 25, 2009 1:47 am

Re: Opening Book Project: v01 after Houdini analysis availab

Post by Milos »

Tdunbug wrote:so is it recommended to analysis pre thread or full cpu power?
Always per thread. SMP search per position yields quite some overhead, especially if you use many threads.