ProDeo Knowledge

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

User avatar
Rebel
Posts: 6997
Joined: Thu Aug 18, 2011 12:04 pm
Full name: Ed Schröder

ProDeo Knowledge

Post by Rebel »

Knowledge Base is the work of months building a quality Polyglot database with analyzed positions by top engines.

Updated Knowledge Base with 25 gambits analyzed with Stockfish 13 to be used with ProDeo Knowledge or PGN Annotator.

http://rebel13.nl/prodeo/prodeo-3.1.html#knowledge
http://rebel13.nl/rebel13/pgn-annotator.html#updates

Position statistic of engines used in the Full edition.

Code: Select all

  0. Unknown-Engine          107.021
  1. Stockfish-12            35.180.626
  2. Komodo-Dragon           73.045
  3. Houdini-6               96.997
  4. Komodo-14               151.846
  5. Lc0                     456.965
  6. CCRL-ELO-3200+          2.687.123
  7. Strong-Engine           10.795.259
  8. TCEC-Engine             1.327.566
  9. CCC-Engine              1.222.152
 10. Stockfish-13            8.571.340
The full Polyglot database currently contains 60.669.940 million positions, zipped 504 Mb, unzipped 926 Mb and counting.
90% of coding is debugging, the other 10% is writing bugs.
User avatar
lithander
Posts: 881
Joined: Sun Dec 27, 2020 2:40 am
Location: Bremen, Germany
Full name: Thomas Jahn

Re: ProDeo Knowledge

Post by lithander »

I know that "bin" files are opening books and I use them in CuteChess for example. As I understand it "Knowledge Base" is a particularily large and well curated one?

I've browsed your site and learned a lot about how you make those books and that there are many tools to help book creation. I wonder if this is a one-way street, though? Is it possible to reverse the process and extract the positions again into a non-binary format? Can I create EPDs from all the positions in the book together with additional information like the the winning ratio's from this position?
Minimal Chess (simple, open source, C#) - Youtube & Github
Leorik (competitive, in active development, C#) - Github & Lichess
cpeters
Posts: 115
Joined: Wed Feb 17, 2021 7:44 pm
Full name: Christian Petersen

Re: ProDeo Knowledge

Post by cpeters »

You could 'reverse' the process with this:

Code: Select all

 polyglot dump-book -bin gambits.bin -color white -out aha
In 'aha' there are linesandlinesandlines:

Code: Select all

1: 1. e4{68%} c5 2. Nf3{100%} d6 3. d4{100%} cxd4 4. Nxd4{100%} Nf6 5. Nc3{100%} a6 6. Bg5{100%} e6 7. f4{100%} Qb6 8. Qd2{100%} Qxb2 9. Rb1{50%} Qxa2 10. Bxa6{100%} Ra7 11. Nxe6{100%} Nfd7 12. Bf1{100%} Qxc2 13. f5{100%} Nb6 14. Nd4{100%} Na4 15. Na2{100%} Bd7 16. Nb5{100%} Nc3 17. Na3{100%} Qb3 18. Be2{100%} 
2: 1. e4{68%} c5 2. Nf3{100%} d6 3. d4{100%} cxd4 4. Nxd4{100%} Nf6 5. Nc3{100%} a6 6. Bg5{100%} e6 7. f4{100%} Qb6 8. Qd2{100%} Qxb2 9. Rb1{50%} Qa3 10. Be2{100%} b5 11. e5{100%} b4 12. Rb3{100%} bxc3 13. Qxc3{100%} Qc5 14. Qxc5{100%} dxc5 15. exf6{100%} Nd7 16. fxg7{100%} Bxg7 17. Nc6{100%} c4 18. Rg3{100%} a5 19. f5{100%} Ra6 20. fxe6{100%} Rxc6 21. exd7+{100%} Bxd7 22. O-O{100%} Bd4+ 23. Kh1{100%} Be6 24. Rd1{100%} Bb6 25. Bf6{100%} Rf8 26. Bf3{100%} Bd5 27. Bg7{100%} Bxf3 28. Re1+{100%} Re6 29. Rxe6+{100%} fxe6 30. Bxf8{100%} 
3: 1. e4{68%} c5 2. Nf3{100%} d6 3. d4{100%} cxd4 4. Nxd4{100%} Nf6 5. Nc3{100%} a6 6. Bg5{100%} e6 7. f4{100%} Qb6 8. Qd2{100%} Qxb2 9. Rb1{50%} Qa3 10. Be2{100%} e5 11. fxe5{100%} dxe5 12. Nf3{100%} Nc6 13. O-O{100%} Bb4 14. Rb3{100%} Bxc3 15. Rxa3{100%} Bxd2 16. Nxd2{100%} Nd7 17. Bc4{100%} f6 18. Be3{100%} b6 19. Bd5{100%} Bb7 20. Nc4{100%} Ke7 21. Nxb6{100%} Rab8 22. Rb3{100%} Na5 23. Rbb1{100%} Nxb6 24. Rxb6{100%} Bxd5 25. exd5{100%} Rxb6 26. Bxb6{100%} Nc4 27. Bc5+{100%} Kd7 28. Rb1{100%} Rc8 29. Rb7+{100%} Rc7 30. Rxc7+{100%} 
4: 1. e4{68%} c5 2. Nf3{100%} d6 3. d4{100%} cxd4 4. Nxd4{100%} Nf6 5. Nc3{100%} a6 6. Bg5{100%} e6 7. f4{100%} Qb6 8. Qd2{100%} Qxb2 9. Rb1{50%} Qa3 10. Be2{100%} h6 11. Bxf6{50%} gxf6 12. Bh5{100%} Qc5 13. f5{100%} Nc6 14. Nxc6{100%} bxc6 15. Na4{100%} Qe5 16. O-O{100%} d5 17. exd5{100%} Bd6 18. g3{100%} Qxd5 19. Qxd5{100%} exd5 20. Rfe1+{100%} Kf8 21. Nb6{100%} Bc5+ 22. Kg2{100%} Bxb6 23. Rxb6{100%} Bxf5 24. Rxc6{100%} Be6 25. Rc7{100%} Re8 26. Rb1{100%} Kg7 27. Rbb7{100%} Rc8 28. Be2{100%} d4 29. Kf2{100%} Rxc7 30. Rxc7{100%} 
5: 1. e4{68%} c5 2. Nf3{100%} d6 3. d4{100%} cxd4 4. Nxd4{100%} Nf6 5. Nc3{100%} a6 6. Bg5{100%} e6 7. f4{100%} Qb6 8. Qd2{100%} Qxb2 9. Rb1{50%} Qa3 10. Be2{100%} h6 11. Bh4{50%} g5 12. fxg5{100%} hxg5 13. Bxg5{100%} Bg7 14. O-O{100%} Nh7 15. Bh5{100%} Rf8 16. Bh6{100%} Qc5 17. Bxg7{100%} Qxh5 18. Bxf8{100%} Kxf8 19. Na4{100%} Nd7 20. Nxe6+{100%} Kg8 21. Nc7{100%} Rb8 22. Rb3{100%} Ndf6 23. Rxf6{100%} Nxf6 24. Qxd6{100%} Nxe4 25. Qd8+{100%} Kh7 26. Ne8{100%} Qh6 27. Rf3{100%} Qc1+ 28. Rf1{100%} Qe3+ 29. Kh1{100%} 
6: 1. e4{68%} c5 2. Nf3{100%} d6 3. d4{100%} cxd4 4. Nxd4{100%} Nf6 5. Nc3{100%} a6 6. Bg5{100%} e6 7. f4{100%} Qb6 8. Qd2{100%} Qxb2 9. Rb1{50%} Qa3 10. Be2{100%} Nc6 11. Nxc6{97%} bxc6 12. O-O{60%} d5 13. Kh1{100%} Qa5 14. exd5{100%} cxd5 15. f5{100%} Be7 16. Bf3{100%} Qd8 17. Bxf6{100%} Bxf6 18. fxe6{100%} fxe6 19. Nxd5{100%} exd5 20. Rfe1+{100%} Kf8 21. Qb4+{100%} Be7 22. Qf4+{100%} Bf6 23. Qb4+{100%} {cycle: ply=41}

etc...

It's human-readable though.
User avatar
Rebel
Posts: 6997
Joined: Thu Aug 18, 2011 12:04 pm
Full name: Ed Schröder

Re: ProDeo Knowledge

Post by Rebel »

lithander wrote: Tue Mar 16, 2021 11:54 am I know that "bin" files are opening books and I use them in CuteChess for example. As I understand it "Knowledge Base" is a particularily large and well curated one?

I've browsed your site and learned a lot about how you make those books and that there are many tools to help book creation. I wonder if this is a one-way street, though? Is it possible to reverse the process and extract the positions again into a non-binary format? Can I create EPDs from all the positions in the book together with additional information like the the winning ratio's from this position?
Made it easy - http://rebel13.nl/dl.html?file=dl/gambits-epd.7z

7 million epd's analyzed with SF13 with depths and scores.
90% of coding is debugging, the other 10% is writing bugs.
User avatar
Graham Banks
Posts: 41473
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: ProDeo Knowledge

Post by Graham Banks »

Is the knowledge base available as a pgn?
gbanksnz at gmail.com
User avatar
Rebel
Posts: 6997
Joined: Thu Aug 18, 2011 12:04 pm
Full name: Ed Schröder

Re: ProDeo Knowledge

Post by Rebel »

Graham Banks wrote: Tue Mar 16, 2021 11:20 pm Is the knowledge base available as a pgn?
Most of the Knowledge Base I extract from MillionBase (3.5 million games) and a Correspondence database of 2 million games and I don't have an interest to keep the extracted PGN's since they are not of any use once they have been analyzed. Not sure what your interest is but I still have the PGN's of the 25 gambits I analyzed, if you want to have them lemme know else they sooner or later are trashed.
90% of coding is debugging, the other 10% is writing bugs.
User avatar
Graham Banks
Posts: 41473
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: ProDeo Knowledge

Post by Graham Banks »

Rebel wrote: Wed Mar 17, 2021 1:33 am
Graham Banks wrote: Tue Mar 16, 2021 11:20 pm Is the knowledge base available as a pgn?
Most of the Knowledge Base I extract from MillionBase (3.5 million games) and a Correspondence database of 2 million games and I don't have an interest to keep the extracted PGN's since they are not of any use once they have been analyzed. Not sure what your interest is but I still have the PGN's of the 25 gambits I analyzed, if you want to have them lemme know else they sooner or later are trashed.
Hi Ed,

only reason I asked was because I could have created a book for ChessGUI using the pgn file. :)

Graham.
gbanksnz at gmail.com
User avatar
Rebel
Posts: 6997
Joined: Thu Aug 18, 2011 12:04 pm
Full name: Ed Schröder

Re: ProDeo Knowledge

Post by Rebel »

Graham Banks wrote: Wed Mar 17, 2021 9:00 am
Rebel wrote: Wed Mar 17, 2021 1:33 am
Graham Banks wrote: Tue Mar 16, 2021 11:20 pm Is the knowledge base available as a pgn?
Most of the Knowledge Base I extract from MillionBase (3.5 million games) and a Correspondence database of 2 million games and I don't have an interest to keep the extracted PGN's since they are not of any use once they have been analyzed. Not sure what your interest is but I still have the PGN's of the 25 gambits I analyzed, if you want to have them lemme know else they sooner or later are trashed.
Hi Ed,

only reason I asked was because I could have created a book for ChessGUI using the pgn file. :)

Graham.
I suspected that :) looks interesting to me adding some gambits to the CCRL testing, I (still) have the 25 PGN's listed at -

http://rebel13.nl/rebel13/pgn-annotator.html#gambits
90% of coding is debugging, the other 10% is writing bugs.
User avatar
Rebel
Posts: 6997
Joined: Thu Aug 18, 2011 12:04 pm
Full name: Ed Schröder

Re: ProDeo Knowledge

Post by Rebel »

I noticed a serious bug, people who already downloaded can use a quick-fix and replace ProDeo.exe or re-download.

Something was wrong while sorting the moves on engine-score, resulting that the output in knowledge.txt is often mixed-up and thus unreliable.
90% of coding is debugging, the other 10% is writing bugs.
User avatar
Ponti
Posts: 493
Joined: Wed Mar 15, 2006 6:13 am
Location: Curitiba - PR - BRAZIL

Re: ProDeo Knowledge

Post by Ponti »

Is there a linux version of Prodeo ?
A. Ponti
AMD Ryzen 1800x, Windows 10.
FIDE current ratings: standard 1913, rapid 1931