Testing Stockfish 11-03-13. 480 Games.

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

TESTING STOCKFISH 110313: 480 GAMES.

I7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012
Time control: 4 min +0 sec/ game
No tablebases

Stockfish 110313 – Criter 1.6 +8/=26/-6 21.0 – 19.0 52.50%
Stockfish 110313 – Deep Rybka 4.1 +12/=21/-7 22.5 – 17,5 56.25%
Stockfish 110313 – Houdini 3.0Pro +5/=16/-19 13.0 – 27.0 32.50%

I7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012
Time control: 2 min +2 sec/ game
No tablebases

Stockfish 110313 – Criter 1.6 +13/=22/-5 24.0 – 16.0 60.0%
Stockfish 110313 – Deep Rybka 4.1 +13/=23/-4 24.5 – 15.5 61.25%
Stockfish 110313 – Houdini 3.0Pro +7/=15/-18 14.5 – 25.5 36.25%

240 games x 6 cores http://www.mediafire.com/?cu97cn269a6rdfs

Overall Average with 6 cores (119.5 – 120.5) = 49.58%



i7 975 3.33 Ghz.
4 real cores
GUI: Fritz 12
Book: Fritz 12
Time control: 4 min + 0 sec/ game
Ponder: Off
No tablebases

Stockfish 110313 - Critter 1.6a +7/=23/-10 18.5 - 21.5 46.25%
Stockfish 110313 - Deep Rybka +12/=20/-8 22.0 -18.0 55.00%
Stockfish 110313 - Houdini3.0Pro +3/=21/-16 13.5 – 26.5 33.75%
i7 975 3.33 Ghz.
4 real cores
GUI: Fritz 12
Book: Fritz 12
Time control: 2 min + 2 sec/ game
Ponder: Off
No tablebases

Stockfish 110313 - Critter 1.6a +6/=29/-5 20.5 – 19.5 51.25%
Stockfish 110313 - Deep Rybka +13/=22/-5 24.0 – 16.0 60.00%
Stockfish 110313 - Houdini3.0Pro +9/=24/-7 21.0 – 19.0 52.50%

240 games x 4cores http://www.mediafire.com/?xmprtbf7bf4c5mv

Overall average with 4 cores ( 119.5 – 120.5) : 49.58%

… and after 480 games: 239.0 – 241.0 : 49.58%

Just two comments:

- This version of Stockfish has got the best result ever in my tests.
- Please note the substantial difference between 4+0 and 2+2 time control.

Regards,

Tom.
gladius
Posts: 568
Joined: Tue Dec 12, 2006 10:10 am
Full name: Gary Linscott

Re: Testing Stockfish 11-03-13. 480 Games.

Post by gladius »

Tomcass wrote:This version of Stockfish has got the best result ever in my tests.
Great! Thanks for the test Tom :).
User avatar
lucasart
Posts: 3232
Joined: Mon May 31, 2010 1:29 pm
Full name: lucasart

Re: Testing Stockfish 11-03-13. 480 Games.

Post by lucasart »

Tom,

This is interesting. But if you really want to make your computing power effectively help the Stockfish project, you should have a look at Gary's FishTest project.

Here's the webpage that monitors current activity, just to give you an idea of what is going on there:
http://54.235.120.254:6543/tests

Have a look at Gary's repository if you want to join
https://github.com/glinscott/fishtest

It was initially Linux only, but I hear that it's now open for Windows users too, and Marco is currently using it from a Windows 7 machine, it seems.

It's truely awesome :D
Theory and practice sometimes clash. And when that happens, theory loses. Every single time.
Vinvin
Posts: 5228
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Vinvin »

Very great results !!
Thanks to share.
ernest
Posts: 2041
Joined: Wed Mar 08, 2006 8:30 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by ernest »

lucasart wrote:Have a look at Gary's repository if you want to join
https://github.com/glinscott/fishtest
Please note that GitHub no longer supports Internet Explorer versions 7 or 8.

What a crap!... :o

Any reason?
User avatar
ilari
Posts: 750
Joined: Mon Mar 27, 2006 7:45 pm
Location: Finland

Re: Testing Stockfish 11-03-13. 480 Games.

Post by ilari »

ernest wrote:
lucasart wrote:Have a look at Gary's repository if you want to join
https://github.com/glinscott/fishtest
Please note that GitHub no longer supports Internet Explorer versions 7 or 8.

What a crap!... :o
It's not crap, it's progress. Even IE 9's HTML5 support is very much lacking and causing a lot of pain to web developers, but supporting IE versions 6 to 8 is a colossal waste of developer time.

Sorry for venting. I write web applications for a living and IE really makes me suffer every week.
ernest
Posts: 2041
Joined: Wed Mar 08, 2006 8:30 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by ernest »

OK thanks for the explanation...
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 11-03-13. 480 Games.

Post by Tomcass »

Thanks for your advice, Lucas. In fact I was considering this option some days ago. But because of the use I give to my computers, by the moment I prefer keep testing Stockfish 'from outside'. Although not being so useful for Stockfish, I hope that my tests also will add also my two cents to this exciting project.

Tha Stockfish team is doing a great work and I am sure that the new system to test new options will definitely put this engine very soon in the second place of the world ranking, only after Houdini 3.0 Pro.

Regards,

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 15-03-13. 480 Games.

Post by Tomcass »

TESTING STOCKFISH 150313

I7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012
Time control: 4 min +0 sec/ game
No tablebases

Stockfish 150313 – Criter 1.6 +14/=20/-6 24.0- 16.0 60.00%
Stockfish 150313 – Deep Rybka 4.1 +11/=24/-5 23.0 -17.0 57.50%
Stockfish 150313 – Houdini 3.0Pro +5/=19/-16 14.5 – 25.5 36.25%

I7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012
Time control: 2 min +2 sec/ game
No tablebases

Stockfish 150313 – Criter 1.6 +8/=20/-12 18.0 – 22.0 45.00%
Stockfish 150313 – Deep Rybka 4.1 +6/=26/-8 19.0 – 21.0 47.50%
Stockfish 150313 – Houdini 3.0Pro +3/=18/-19 12.0 – 28.0 30.00%

240 games x 6 cores : http://www.mediafire.com/?24cnvazua4pa4oa

Overall Average with 6 cores (110.5 – 129.5) = 46.04%

i7 975 3.33 Ghz.
4 real cores
GUI: Fritz 12
Book: Fritz 12
Time control: 4 min + 0 sec/ game
Ponder: Off
No tablebases

Stockfish 150313 - Critter 1.6a +8/=24/-8 20.0 – 20.0 50.00%
Stockfish 150313 - Deep Rybka +12/=26/-2 25.0 – 15.0 62.50%
Stockfish 150313 - Houdini3.0Pro +2/=30/-8 17.0 – 23.0 42.50%


i7 975 3.33 Ghz.
4 real cores
GUI: Fritz 12
Book: Fritz 12
Time control: 2 min + 2 sec/ game
Ponder: Off
No tablebases

Stockfish 150313 - Critter 1.6a +8/=24/-8 20.0 – 20.0 50.00%
Stockfish 150313 - Deep Rybka +9/=24/-7 21.0 -19.0 52.50%
Stockfish 150313 - Houdini3.0Pro +7/=26/-7 20.0 – 20.0 50.00%

240 games x 4cores : http://www.mediafire.com/?0ja2mgcf4z5i3u8

Overall average with 4 cores ( 123.0 – 117.0) : 51.25%

… and after 480 games: 233.5 – 246.5 : 48.65%

Regards,

Tom.
Vinvin
Posts: 5228
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: Testing Stockfish 15-03-13. 480 Games.

Post by Vinvin »

Is there some hope to get a new stronger release (SF 2.4) soon ?

Thanks,
Vincent