ChessUSA.com TalkChess.com
Hosted by Your Move Chess & Games
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

Comparison data of Crafty vs Rybka that I promised 2 days ag
Post new topic    TalkChess.com Forum Index -> Computer Chess Club: Programming and Technical Discussions Flat
View previous topic :: View next topic  
Author Message
Les



Joined: 11 Mar 2006
Posts: 114
Location: NY
PostPost subject: Movei added to Crafty vs Rybka comaprison data    Posted: Fri Jun 01, 2007 4:06 am Reply to topic Reply with quote
Dann Corbit has just finished running the data set we used for the Crafty vs Rybka data using Uri Movei. I have combiend all 3 comparisons for your review. Again all data in the tables represents seconds.
I will post a New post for the 44 positions that were used to generated all this data for any of you that are interested in it.

Code:

The following EPD was the position I started with.

4r1k1/p1qr1p2/2pb1Bp1/1p3Q1p/3P1n1R/1B3P2/PP3PK1/7R w - - pv Qxf4; ce 32756;

Crafty-2014   and Rybka v1.2.w32  and Movei  Analysis time was set to 1 minute and Dann Corbit ran these on the same Hardware. (Thx Dann)

What I did was seeing if there were any differences between these 2 engines by not only looking at reflected positions but also all legal slider positions.  Since this position is a guaranteed mate position the slider positions are all legal derivations from the original EPD string.  As I mnetiones in a post here several days ago a slider is placing the piece to move on any square that still allows the piece to move to hit the target square.  The thinking behind this is that all positions should be close to the same across the 4 way rotations for each of the slider positions.  The table below appears to show Rybka much better across the reflections compared to Crafty.  And for almost all the 11 slider positions holds true.  Perhaps Crafty is having a bit of trouble depending as to how Bobs engine works.  I am no expert when it comes to chess engines but I thought Uri especially and others might be interested in this.  In case the table is not clear the 4 way rotations are represented across the columns 1-4 and for this particular position there are 11 slider positions for each of the reflected boards.  All data in all tables represent seconds to solution.

Reflections 1 and 2 was WTM and 3 and 4 was BTM

              Crafty            Rybka                Movei
          1   2   3   4      1   2   3   4       1   2   3   4
Slider
1        54  23  22  57      7   7   7   7      19  17  19  21
2         2   3   3   3      2   2   2   2       1   1   1   1
3         0   0   0   0      0   0   0   0       0   0   0   0
4        11  13  11  13      4   4   4   4       3   3   4   3
5        22  29  40  21      4   4   4   4      16  15  15  16
6        45  51  41  16      8   8   8   8       3   3   3   3
7        56  16  39   8      4   4   4   4       3   3  12   2
8        56  43  10   8      8   8   6   6       9   8   7   8
9        44  12  48   9     10   6  10   9       3   3  15   3
10       13  37  49  22      5   5   5   5       5   5   6   6
11       15  44  28  12      8   8   4   4      10  11   2   3

Notice how much less deviation there is across the reflections in almost all the slider positions comparing Rybka to Crafty!  Can someone perhaps provide me with some explanation as to what could be causing this?  Bob may be interested in this data to improving this part of Crafty.

HTH

Les
Back to top
View user's profile Send private message
Display posts from previous:   
Subject Author Date/Time
Comparison data of Crafty vs Rybka that I promised 2 days ag Les Fri Jun 01, 2007 3:12 am
      Re: Comparison data of Crafty vs Rybka that I promised 2 day Dann Corbit Fri Jun 01, 2007 3:14 am
      Movei added to Crafty vs Rybka comaprison data Les Fri Jun 01, 2007 4:06 am
            Re: Movei added to Crafty vs Rybka comaprison data Robert Hyatt Sat Jun 02, 2007 1:41 am
                  Re: Movei added to Crafty vs Rybka comaprison data Steven Edwards Sat Jun 02, 2007 2:04 am
                        Re: Movei added to Crafty vs Rybka comaprison data Robert Hyatt Sat Jun 02, 2007 5:56 am
                  Re: Movei added to Crafty vs Rybka comaprison data Dann Corbit Sat Jun 02, 2007 4:00 am
                        Re: Movei added to Crafty vs Rybka comaprison data Dann Corbit Sat Jun 02, 2007 4:48 am
                              Re: Movei added to Crafty vs Rybka comaprison data Robert Hyatt Sat Jun 02, 2007 6:00 am
                                    Re: Movei added to Crafty vs Rybka comaprison data Dann Corbit Sat Jun 02, 2007 7:18 am
                                          Re: Movei added to Crafty vs Rybka comaprison data Robert Hyatt Sun Jun 03, 2007 8:38 pm
                                                Re: Movei added to Crafty vs Rybka comaprison data Les Sun Jun 03, 2007 11:28 pm
                                                      Re: Movei added to Crafty vs Rybka comaprison data Edsel Apostol Mon Jun 04, 2007 7:10 am
                                                            Re: Movei added to Crafty vs Rybka comaprison data Robert Hyatt Mon Jun 04, 2007 7:06 pm
                                                                  Re: Movei added to Crafty vs Rybka comaprison data Edsel Apostol Tue Jun 05, 2007 6:15 am
                                                                        Re: Movei added to Crafty vs Rybka comaprison data Dann Corbit Tue Jun 05, 2007 7:00 pm
                                                                              Re: Movei added to Crafty vs Rybka comaprison data Edsel Apostol Wed Jun 06, 2007 3:29 am
                                                                                    Re: Movei added to Crafty vs Rybka comaprison data Dann Corbit Wed Jun 06, 2007 3:44 am
                                                                                          Re: Movei added to Crafty vs Rybka comaprison data Edsel Apostol Wed Jun 06, 2007 3:52 am
                                                                        Re: Movei added to Crafty vs Rybka comaprison data Robert Hyatt Wed Jun 06, 2007 1:16 am
                                                                  Re: Movei added to Crafty vs Rybka comaprison data Dann Corbit Tue Jun 05, 2007 7:03 pm
                                                                        Re: Movei added to Crafty vs Rybka comaprison data Gerd Isenberg Tue Jun 05, 2007 8:04 pm
                                                      Re: Movei added to Crafty vs Rybka comaprison data Robert Hyatt Mon Jun 04, 2007 7:02 pm
                                                            Re: Movei added to Crafty vs Rybka comaprison data Gerd Isenberg Mon Jun 04, 2007 9:39 pm
                                                                  Re: Movei added to Crafty vs Rybka comaprison data Gerd Isenberg Tue Jun 05, 2007 7:55 pm
                                                                        Re: Movei added to Crafty vs Rybka comaprison data Uri Blass Tue Jun 05, 2007 9:25 pm
                                                                        Re: Movei added to Crafty vs Rybka comaprison data Gerd Isenberg Wed Jun 06, 2007 10:15 pm
                        Re: Movei added to Crafty vs Rybka comaprison data Robert Hyatt Sat Jun 02, 2007 5:58 am
Post new topic    TalkChess.com Forum Index -> Computer Chess Club: Programming and Technical Discussions

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum




Powered by phpBB © 2001, 2005 phpBB Group
Enhanced with Moby Threads