ChessUSA.com TalkChess.com
Hosted by Your Move Chess & Games
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

EPD test suites by Aser Huerga
Post new topic    TalkChess.com Forum Index -> Computer Chess Club: Programming and Technical Discussions Flat
View previous topic :: View next topic  
Author Message
Don Dailey



Joined: 29 Apr 2008
Posts: 4322
PostPost subject: Re: EPD test suites by Aser Huerga    Posted: Mon May 14, 2012 4:02 pm Reply to topic Reply with quote
lucasart wrote:
Don wrote:
lucasart wrote:
Much more interesting that the antiquated WAC suite.

Given 1 sec and 64 MB Hash, DC scored only 86/250 on the tactical one and 84/250 on the endgame one. As a speed benchmark, I run ./stockfish_2.2.2 bench in 5.38 seconds.

I wonder how other programs score here. Probably even the top engines have a lot of problems to solve these too. My money goes on Critter Wink



The current development version of Komodo scores:

181/250 in the tactical set
178/250 in the Endgame set

Using the conditions specified, 1 core - 64 meg hash

on a budget quad deskop: Intel(R) Core(TM) i5-2320 CPU @ 3.00GHz

I would expect some other top programs to score better as Komodo is not particularly tactical.

Woaw, that's quite good!

This test suite is interesting. It's the first time I seriously code an EPD analysis function, and it's helped me find bugs already Smile

I'd be curious to see how Critter and IvanHoe score there. These two engines are generaly very good at tactics.


Here are some other results on the same hardware:

Code:
Komodo 4: 171 [ave: depth=9.7 time=0.25 nodes=248928]
4430.00 : 181 [ave: depth=9.7 time=0.25 nodes=327315]
4429.10 : 178 [ave: depth=9.4 time=0.21 nodes=282378]
Sf2.2.2 : 140 [ave: depth=10.7 time=0.29 nodes=488845]
Hou 1.5 : 211 [ave: depth=10.0 time=0.16 nodes=385531]
cr 1.4  : 213 [ave: depth=10.6 time=0.16 nodes=352184]



cr is critter 1.4 which is the best scoring version as someone predicted. Versions with names like 4430.00 are development versions of Komodo.
_________________
"Your superior intellect is no match for our puny weapons." -Kang and Kodos
Back to top
View user's profile Send private message Send e-mail
Display posts from previous:   
Subject Author Date/Time
EPD test suites by Aser Huerga Lucas Braesch Fri May 11, 2012 12:48 pm
      Re: EPD test suites by Aser Huerga Don Dailey Mon May 14, 2012 1:14 am
            Re: EPD test suites by Aser Huerga Lucas Braesch Mon May 14, 2012 10:52 am
                  Re: EPD test suites by Aser Huerga Don Dailey Mon May 14, 2012 4:02 pm
                        Re: EPD test suites by Aser Huerga Jouni Uski Mon May 14, 2012 5:11 pm
                              Re: EPD test suites by Aser Huerga Don Dailey Mon May 14, 2012 7:25 pm
      Re: EPD test suites by Aser Huerga Jouni Uski Mon May 14, 2012 3:38 pm
      Re: EPD test suites by Aser Huerga Peter Österlund Mon May 14, 2012 5:39 pm
            Re: EPD test suites by Aser Huerga Lucas Braesch Tue May 15, 2012 11:39 am
            Re: EPD test suites by Aser Huerga Don Dailey Tue May 15, 2012 12:53 pm
                  Re: EPD test suites by Aser Huerga Don Dailey Tue May 15, 2012 1:06 pm
Post new topic    TalkChess.com Forum Index -> Computer Chess Club: Programming and Technical Discussions

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum




Powered by phpBB © 2001, 2005 phpBB Group
Enhanced with Moby Threads