Testing Stockfish 11-03-13. 480 Games.

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 15-03-13. 480 Games.

Post by Tomcass »

STOCKFISH 07-04-13. 480 GAMES

I7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012
Time control: 4 min +0 sec/ game
No tablebases

Stockfish 070413 – Criter 1.6 +9/=27/-4 22.5-17.5 56.25%
Stockfish 070413 – Deep Rybka 4.1 +15/=21/-4 25.5 – 14.5 63.75%
Stockfish 070413 – Houdini 3.0Pro +8/=17/-15 16.5 – 23.5 41.25%

I7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012
Time control: 2 min +2 sec/ game
No tablebases

Stockfish 070413 – Criter 1.6 +5/=30/-5 20.0 – 20.0 50.00%
Stockfish 070413 – Deep Rybka 4.1 +9/=23/-8 20.5 – 19.5 51.25%
Stockfish 070413 – Houdini 3.0Pro +7/=18/-15 16.0 – 24.0 40.00%

Overall average with 6 cores : ( 121.0-119.0) : 50.42%

X6 240 GAMES http://www.mediafire.com/?bcbjnt11nl9bngy
i7 975 3.33 Ghz.
4 real cores
GUI: Fritz 12
Book: Fritz 12
Time control: 4 min + 0 sec/ game
Ponder: Off
No tablebases

Stockfish 070413 - Critter 1.6a +9/=24/-7 21.0 – 19.0 52.50%%
Stockfish 070413 - Deep Rybka +8/=25/-7 20.5 – 19.5 51.25%
Stockfish 070413 - Houdini3.0Pro +5/=24/-11 17.0 – 23.0 42.50%

i7 975 3.33 Ghz.
4 real cores
GUI: Fritz 12
Book: Fritz 12
Time control: 2 min + 2 sec/ game
Ponder: Off
No tablebases

Stockfish 070413 - Critter 1.6a +7/=27/-6 20.5 – 19.5 51.25%
Stockfish 070413 - Deep Rybka +13/=24/-3 25.0 – 15.0 62.50%
Stockfish 070413 - Houdini3.0 Pro +7/=24/-9 19.0 – 21.0 47.50%

Overall average with 4 cores ( 123.0 – 117.0) : 51.25%

X4 240 GAMES http://www.mediafire.com/?zr6jb7bt75xrzpb

Global Score: 50.83% - NEW RECORD IN MY TESTS

Against
Critter: 52.50% Deep Rybka: 57.19% Houdini 3.0 Pro: 42.81%

This is a new best score for Stockfish in my tests, although only a bit better than the previous best. (16-03-13 got 50.73%).

Only two things to comment:

1.- No one single loss in the 8 matches against Critter 1.6 and Deep Rybka 4.
2.- This is the best result ever against Houdini 3.0 Pro in my tests. In all four legs against H.3 Pro it has scored 40% or more, with an impressive average of 42.81%.

IMHO Stockfish is already the second best engine in the world, only after Houdini.

Regards from Barcelona.

Tom.
Jouni
Posts: 3281
Joined: Wed Mar 08, 2006 8:15 pm

Re: Testing Stockfish 15-03-13. 480 Games.

Post by Jouni »

In my dual Pentium PC SF has NEVER won so far 40 games match against Critter. I just finished 60 game match with latest SF version. Level 4m + 0s and Fritz 12 tournament book.

Stockfish 10-04-13 64bit +5/=43/-12 44.17% 26.5/60 -41 ELO
Jouni
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 15-03-13. 480 Games.

Post by Tomcass »

STOCKFISH 10-04-13. 480 GAMES

I7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012
Time control: 4 min +0 sec/ game
No tablebases

Stockfish 100413 – Criter 1.6 +11/=21/-8 21.5-18.5 53.75%
Stockfish 100413 – Deep Rybka 4.1 +12/=21/-7 22.5 – 17.5 56.25%
Stockfish 100413 – Houdini 3.0Pro +3/=24/-13 15.0 – 25.0 37.50%

I7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012
Time control: 2 min +2 sec/ game
No tablebases

Stockfish 100413 – Criter 1.6 +10/=23/-7 21.5 – 18.5 53.75%
Stockfish 100413 – Deep Rybka 4.1 +5/=28/-7 19.0-21.0 47.50%
Stockfish 100413 – Houdini 3.0Pro +7/=19/-14 16.5 – 23.5 41.25%

Overall average with 6 cores : ( 116.0-124.0) : 48.33%

100413 x6 240 games: http://www.mediafire.com/?pi58yv0c34q4esw

i7 975 3.33 Ghz.
4 real cores
GUI: Fritz 12
Book: Fritz 12
Time control: 4 min + 0 sec/ game
Ponder: Off
No tablebases

Stockfish 100413 - Critter 1.6a +8/=25/-7 20.5 – 19.5 51.25%
Stockfish 100413 - Deep Rybka 4 +13/=21/-6 23.5 – 16.5 58.75%
Stockfish 100413 - Houdini3.0Pro +8/=22/-10 19.0 – 21.0 47.50%

i7 975 3.33 Ghz.
4 real cores
GUI: Fritz 12
Book: Fritz 12
Time control: 2 min + 2 sec/ game
Ponder: Off
No tablebases

Stockfish 100413 - Critter 1.6a +7/=23/-10 18.5 – 21.5 46.25%
Stockfish 100413 - Deep Rybka 4 +7/=28/-5 21.0 – 19.0 52.50%
Stockfish 100413 - Houdini3.0 Pro +7/=19/-14 16.5 – 23.5 41.25%

Overall average with 4 cores ( 119.0 – 121.0) : 49.58%

100413 x4 240 games: http://www.mediafire.com/?ym22q7g9qap4xxa

Global Score: 48.96%

Against
Critter: 51.25% Deep Rybka: 53.75% Houdini 3.0 Pro: 41.87%


Another good performance against Houdini 3.0 Pro and Critter 1.6. Not so brilliant against Deep Rybka.

Regards from my sunny Barcelona,

Tom.
ernest
Posts: 2041
Joined: Wed Mar 08, 2006 8:30 pm

Re: Testing Stockfish 15-03-13. 480 Games.

Post by ernest »

How about the Stockfish 120413 used in the current tournament TCEC Stage 4 ?
(I suppose that is the stockfish 120413 x64 SSE4.2.exe compiled by Ipman, but I can't be sure)
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 15-03-13. 480 Games.

Post by Tomcass »

STOCKFISH 12-04-13 IPMAN: 480 GAMES

I7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012
Time control: 4 min +0 sec/ game
No tablebases

Stockfish 120413 – Criter 1.6 +6/=22/-12 17.0-23.0 42.50%
Stockfish 120413 – Deep Rybka 4.1 +12/=24/-4 24.0-16.0 60.00%
Stockfish 120413 – Houdini 3.0Pro +7/=17/-16 15.5–24.5 38.75%

I7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012
Time control: 2 min +2 sec/ game
No tablebases

Stockfish 120413 – Criter 1.6 +9/=23/-8 20.5–19.5 51.25%
Stockfish 120413 – Deep Rybka 4.1 +11/=19/-10 20.5-19.6 51.25%
Stockfish 120413 – Houdini 3.0Pro +7/=17/-16 15.5–24.5 38.75%

Overall average with 6 cores : ( 113.0-127.0) : 47.08%

X6 240 games http://www.mediafire.com/?b5zbsx3wo81zs16

i7 975 3.33 Ghz.
4 real cores
GUI: Fritz 12
Book: Fritz 12
Time control: 4 min + 0 sec/ game
Ponder: Off
No tablebases

Stockfish 120413 - Critter 1.6a +6/=28/-6 20.0–20.0 50.00%
Stockfish 120413 - Deep Rybka 4 +15/=20/-5 25.0–15.0 62.50%
Stockfish 120413 - Houdini3.0Pro +12/=17/-11 20.5–19.5 51.25%

i7 975 3.33 Ghz.
4 real cores
GUI: Fritz 12
Book: Fritz 12
Time control: 2 min + 2 sec/ game
Ponder: Off
No tablebases

Stockfish 120413 - Critter 1.6a +8/=26/-6 21.0–19.0 52.50%
Stockfish 120413 - Deep Rybka 4 +9/=27/-4 22.5–17.5 52.50%
Stockfish 120413 - Houdini3.0 Pro +6/=24/-10 18.0–22.0 45.00%

Overall average with 4 cores ( 127.0 – 113.0) : 52.92%

X4 240 games http://www.mediafire.com/?aau9wbw5in7u0at

Global Score: 50.00%

Against Critter 1.6: 49.06% Deep Rybka 4: 57.50% Houdini 3.0: 43.44%



This is a good compile. A 43.44% score against Houdini 3.0 Pro after 160 games is a great result. Well done, Ipman & Stockfish Team!.

Regards,

Tom.
ernest
Posts: 2041
Joined: Wed Mar 08, 2006 8:30 pm

Re: Testing Stockfish 15-03-13. 480 Games.

Post by ernest »

Tomcass wrote:This is a good compile. A 43.44% score against Houdini 3.0 Pro after 160 games is a great result.
Interesting, in view of what is happening right now in the TCEC tournament
http://www.tcec-chess.net/live.php
Jouni
Posts: 3281
Joined: Wed Mar 08, 2006 8:15 pm

Re: Testing Stockfish 15-03-13. 480 Games.

Post by Jouni »

Finally Critter is beaten:

Stockfish 19-04-13 64bit +36/=75/-29 52.50% 73.5/140 +17 ELO

:)
Jouni
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 15-03-13. 480 Games.

Post by Tomcass »

STOCKFISH 14-04-13 : 480 GAMES

I7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012
Time control: 4 min +0 sec/ game
No tablebases

Stockfish 140413 – Criter 1.6 +7/=22/-11 18.0-22.0 45.00%
Stockfish 140413 – Deep Rybka 4.1 +11/=22/-7 22.0-18.0 55.00%
Stockfish 140413 – Houdini 3.0Pro +5/=20/-15 15.0–25.0 37.50%

I7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012
Time control: 2 min +2 sec/ game
No tablebases

Stockfish 140413 – Criter 1.6 +14/=19/-7 23.5–16.5 58.75%
Stockfish 140413 – Deep Rybka 4.1 +7/=24/-9 19.0-21.0 47.50%
Stockfish 140413 – Houdini 3.0Pro +4/=18/-18 13.0–27.0 32.50%

Overall average with 6 cores : ( 110.5-129.5) : 46.04%

X6 240 games http://www.mediafire.com/?jne741b91yhfsri

i7 975 3.33 Ghz.
4 real cores
GUI: Fritz 12
Book: Fritz 12
Time control: 4 min + 0 sec/ game
Ponder: Off
No tablebases

Stockfish 140413 - Critter 1.6a +10/=26/-4 23.0–17.0 50.00%
Stockfish 140413 - Deep Rybka 4 +11/=26/-3 24.0–16.0 60.00%
Stockfish 140413 - Houdini3.0Pro +6/=26/-8 19.0–21.0 47.50%

i7 975 3.33 Ghz.
4 real cores
GUI: Fritz 12
Book: Fritz 12
Time control: 2 min + 2 sec/ game
Ponder: Off
No tablebases

Stockfish 140413 - Critter 1.6a +13=21/-6 23.5–16.5 58.75%
Stockfish 140413 - Deep Rybka 4 +8/=29/-3 22.5–17.5 56.25%
Stockfish 140413 - Houdini3.0 Pro +2/=28/-10 16.0–24.0 40.00%

Overall average with 4 cores ( 128.0 – 112.0) : 53.33%

X4 240 games http://www.mediafire.com/?elx603n6xhd31td

Global Score: 49.69%

Against Critter 1.6: 55.00% Deep Rybka 4: 54.69% Houdini 3.0: 39.37%

Good result against Critter 1.6, but the strength of Houdini 3.0 Pro pushed the Stockfish score below 40% in their face to face match.

Regards,

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 15-03-13. 480 Games.

Post by Tomcass »

STOCKFISH 19-04-13 : 480 GAMES

I7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012
Time control: 4 min +0 sec/ game
No tablebases

Stockfish 190413 – Criter 1.6 +7/=25/-8 19.5-20.5 48.75%
Stockfish 190413 – Deep Rybka 4.1 +12/=23/-5 23.5-16.5 58.75%
Stockfish 190413 – Houdini 3.0Pro +7/=22/-11 18.0–22.0 45.00%

I7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012
Time control: 2 min +2 sec/ game
No tablebases

Stockfish 190413 – Criter 1.6 +9/=20/-11 19.0–21.0 47.50%
Stockfish 190413 – Deep Rybka 4.1 +12/=22/-6 23.0-17.0 57.50%
Stockfish 190413 – Houdini 3.0Pro +5/=23/-12 16.5–23.5 41.25%

Overall average with 6 cores : ( 119.5-120.5) : 49.79%


X6 240 games : http://www.mediafire.com/?9xgrpewt1v5c851
i7 975 3.33 Ghz.
4 real cores
GUI: Fritz 12
Book: Fritz 12
Time control: 4 min + 0 sec/ game
Ponder: Off
No tablebases

Stockfish 190413 - Critter 1.6a +10/=26/-4 23.0–17.0 50.00%
Stockfish 190413 - Deep Rybka 4 +14/=20/-6 24.0–16.0 60.00%
Stockfish 190413 - Houdini3.0Pro +5/=15/-20 12.5–27.5 31.25%

i7 975 3.33 Ghz.
4 real cores
GUI: Fritz 12
Book: Fritz 12
Time control: 2 min + 2 sec/ game
Ponder: Off
No tablebases

Stockfish 190413 - Critter 1.6a +7=25/-8 19.5–20.5 48.75%
Stockfish 190413 - Deep Rybka 4 +7/=27/-6 20.5–19.5 51.25%
Stockfish 190413 - Houdini3.0 Pro +5/=23/-12 16.5–23.5 41.25%

Overall average with 4 cores ( 128.0 – 112.0) : 53.33%

X4 240 games http://www.mediafire.com/?0ljxnm2cumezak6

Global Score: 49.07%

Against Critter 1.6: 50.63% Deep Rybka 4: 56.88% Houdini 3.0: 39.69%


Regards,

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Testing Stockfish 15-03-13. 480 Games.

Post by Tomcass »

Sorry, in my previous post there is a mistake I can not edit (Time out):

Overall average with 4 cores ( 116.0 – 124.0) : 48.33%

Tom.