Testing Stockfish 11-03-13. 480 Games.

Discussion of computer chess matches and engine tournaments.

Moderators: bob, hgm, Harvey Williamson

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Post Reply
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 7:09 pm

Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass » Fri Mar 15, 2013 9:19 am

TESTING STOCKFISH 110313: 480 GAMES.

I7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012
Time control: 4 min +0 sec/ game
No tablebases

Stockfish 110313 – Criter 1.6 +8/=26/-6 21.0 – 19.0 52.50%
Stockfish 110313 – Deep Rybka 4.1 +12/=21/-7 22.5 – 17,5 56.25%
Stockfish 110313 – Houdini 3.0Pro +5/=16/-19 13.0 – 27.0 32.50%

I7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012
Time control: 2 min +2 sec/ game
No tablebases

Stockfish 110313 – Criter 1.6 +13/=22/-5 24.0 – 16.0 60.0%
Stockfish 110313 – Deep Rybka 4.1 +13/=23/-4 24.5 – 15.5 61.25%
Stockfish 110313 – Houdini 3.0Pro +7/=15/-18 14.5 – 25.5 36.25%

240 games x 6 cores http://www.mediafire.com/?cu97cn269a6rdfs

Overall Average with 6 cores (119.5 – 120.5) = 49.58%



i7 975 3.33 Ghz.
4 real cores
GUI: Fritz 12
Book: Fritz 12
Time control: 4 min + 0 sec/ game
Ponder: Off
No tablebases

Stockfish 110313 - Critter 1.6a +7/=23/-10 18.5 - 21.5 46.25%
Stockfish 110313 - Deep Rybka +12/=20/-8 22.0 -18.0 55.00%
Stockfish 110313 - Houdini3.0Pro +3/=21/-16 13.5 – 26.5 33.75%
i7 975 3.33 Ghz.
4 real cores
GUI: Fritz 12
Book: Fritz 12
Time control: 2 min + 2 sec/ game
Ponder: Off
No tablebases

Stockfish 110313 - Critter 1.6a +6/=29/-5 20.5 – 19.5 51.25%
Stockfish 110313 - Deep Rybka +13/=22/-5 24.0 – 16.0 60.00%
Stockfish 110313 - Houdini3.0Pro +9/=24/-7 21.0 – 19.0 52.50%

240 games x 4cores http://www.mediafire.com/?xmprtbf7bf4c5mv

Overall average with 4 cores ( 119.5 – 120.5) : 49.58%

… and after 480 games: 239.0 – 241.0 : 49.58%

Just two comments:

- This version of Stockfish has got the best result ever in my tests.
- Please note the substantial difference between 4+0 and 2+2 time control.

Regards,

Tom.

gladius
Posts: 538
Joined: Tue Dec 12, 2006 9:10 am

Re: Testing Stockfish 11-03-13. 480 Games.

Post by gladius » Fri Mar 15, 2013 12:50 pm

Tomcass wrote:This version of Stockfish has got the best result ever in my tests.
Great! Thanks for the test Tom :).

User avatar
lucasart
Posts: 3040
Joined: Mon May 31, 2010 11:29 am
Full name: lucasart
Contact:

Re: Testing Stockfish 11-03-13. 480 Games.

Post by lucasart » Fri Mar 15, 2013 2:07 pm

Tom,

This is interesting. But if you really want to make your computing power effectively help the Stockfish project, you should have a look at Gary's FishTest project.

Here's the webpage that monitors current activity, just to give you an idea of what is going on there:
http://54.235.120.254:6543/tests

Have a look at Gary's repository if you want to join
https://github.com/glinscott/fishtest

It was initially Linux only, but I hear that it's now open for Windows users too, and Marco is currently using it from a Windows 7 machine, it seems.

It's truely awesome :D
Theory and practice sometimes clash. And when that happens, theory loses. Every single time.

Vinvin
Posts: 4374
Joined: Thu Mar 09, 2006 8:40 am
Full name: Vincent Lejeune

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Vinvin » Fri Mar 15, 2013 2:56 pm

Very great results !!
Thanks to share.

ernest
Posts: 1860
Joined: Wed Mar 08, 2006 7:30 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by ernest » Fri Mar 15, 2013 4:30 pm

lucasart wrote:Have a look at Gary's repository if you want to join
https://github.com/glinscott/fishtest
Please note that GitHub no longer supports Internet Explorer versions 7 or 8.

What a crap!... :o

Any reason?

User avatar
ilari
Posts: 750
Joined: Mon Mar 27, 2006 5:45 pm
Location: Finland
Contact:

Re: Testing Stockfish 11-03-13. 480 Games.

Post by ilari » Fri Mar 15, 2013 4:37 pm

ernest wrote:
lucasart wrote:Have a look at Gary's repository if you want to join
https://github.com/glinscott/fishtest
Please note that GitHub no longer supports Internet Explorer versions 7 or 8.

What a crap!... :o
It's not crap, it's progress. Even IE 9's HTML5 support is very much lacking and causing a lot of pain to web developers, but supporting IE versions 6 to 8 is a colossal waste of developer time.

Sorry for venting. I write web applications for a living and IE really makes me suffer every week.

ernest
Posts: 1860
Joined: Wed Mar 08, 2006 7:30 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by ernest » Fri Mar 15, 2013 4:58 pm

OK thanks for the explanation...

Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 7:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass » Fri Mar 15, 2013 5:14 pm

Thanks for your advice, Lucas. In fact I was considering this option some days ago. But because of the use I give to my computers, by the moment I prefer keep testing Stockfish 'from outside'. Although not being so useful for Stockfish, I hope that my tests also will add also my two cents to this exciting project.

Tha Stockfish team is doing a great work and I am sure that the new system to test new options will definitely put this engine very soon in the second place of the world ranking, only after Houdini 3.0 Pro.

Regards,

Tom.

Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 7:09 pm

Re: Testing Stockfish 15-03-13. 480 Games.

Post by Tomcass » Sat Mar 16, 2013 9:55 pm

TESTING STOCKFISH 150313

I7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012
Time control: 4 min +0 sec/ game
No tablebases

Stockfish 150313 – Criter 1.6 +14/=20/-6 24.0- 16.0 60.00%
Stockfish 150313 – Deep Rybka 4.1 +11/=24/-5 23.0 -17.0 57.50%
Stockfish 150313 – Houdini 3.0Pro +5/=19/-16 14.5 – 25.5 36.25%

I7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012
Time control: 2 min +2 sec/ game
No tablebases

Stockfish 150313 – Criter 1.6 +8/=20/-12 18.0 – 22.0 45.00%
Stockfish 150313 – Deep Rybka 4.1 +6/=26/-8 19.0 – 21.0 47.50%
Stockfish 150313 – Houdini 3.0Pro +3/=18/-19 12.0 – 28.0 30.00%

240 games x 6 cores : http://www.mediafire.com/?24cnvazua4pa4oa

Overall Average with 6 cores (110.5 – 129.5) = 46.04%

i7 975 3.33 Ghz.
4 real cores
GUI: Fritz 12
Book: Fritz 12
Time control: 4 min + 0 sec/ game
Ponder: Off
No tablebases

Stockfish 150313 - Critter 1.6a +8/=24/-8 20.0 – 20.0 50.00%
Stockfish 150313 - Deep Rybka +12/=26/-2 25.0 – 15.0 62.50%
Stockfish 150313 - Houdini3.0Pro +2/=30/-8 17.0 – 23.0 42.50%


i7 975 3.33 Ghz.
4 real cores
GUI: Fritz 12
Book: Fritz 12
Time control: 2 min + 2 sec/ game
Ponder: Off
No tablebases

Stockfish 150313 - Critter 1.6a +8/=24/-8 20.0 – 20.0 50.00%
Stockfish 150313 - Deep Rybka +9/=24/-7 21.0 -19.0 52.50%
Stockfish 150313 - Houdini3.0Pro +7/=26/-7 20.0 – 20.0 50.00%

240 games x 4cores : http://www.mediafire.com/?0ja2mgcf4z5i3u8

Overall average with 4 cores ( 123.0 – 117.0) : 51.25%

… and after 480 games: 233.5 – 246.5 : 48.65%

Regards,

Tom.

Vinvin
Posts: 4374
Joined: Thu Mar 09, 2006 8:40 am
Full name: Vincent Lejeune

Re: Testing Stockfish 15-03-13. 480 Games.

Post by Vinvin » Mon Mar 18, 2013 11:17 am

Is there some hope to get a new stronger release (SF 2.4) soon ?

Thanks,
Vincent

Post Reply