Testing Stockfish 11-03-13. 480 Games.

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

fauzi
Posts: 61
Joined: Wed Nov 20, 2013 10:42 am

Re: no more tests?

Post by fauzi »

the second link is again not valid because containing dots in the center , please fix Tom :D , Regards Fauzi.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: no more tests?

Post by Tomcass »

Hi Fauzi,

I hope this link will work well. (Anyway I have found 19 downloads till now). :D

http://www.mediafire.com/view/7jlczukc2 ... 0Games.pgn

Best regards,

Tom.
fauzi
Posts: 61
Joined: Wed Nov 20, 2013 10:42 am

Re: no more tests?

Post by fauzi »

yes this one works, thanks Tom, anyway I think You found 19 downloads because this is not the only forum You post Your tests, so maybe in another forum You posted the link right but here the full link was missing :D thanks alot for your effort
kranium
Posts: 2129
Joined: Thu May 29, 2008 10:43 am

Re: no more tests?

Post by kranium »

ouachita wrote:We have/had an ID issue. Stockfish 041213 = April 12, 2013 to me. Best format is US military, 04Dec13.

In any case, my bad.
Hi Bobby-

"month year day" is used in the US (as you well know),
but here in Europe, most (all?) countries use "day month year"

(which actually kinda makes sense: periods of time increase naturally as you read from left to right)

regards-
Norm
ouachita
Posts: 454
Joined: Tue Jan 15, 2013 4:33 pm
Location: Ritz-Carlton, NYC
Full name: Bobby Johnson

Re: no more tests?

Post by ouachita »

Norman,
SF's file ID system gets even more weird:

The version at the site - month, day, time, year
The downloaded file name - year, month, day, X(mystery ID ?)
The file name shown in (Fritz) UCI - day, month, year

All I'm saying is, there's better ways.
SIM, PhD, MBA, PE
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: no more tests?

Post by Tomcass »

480 Games Tournament

Players:
Stockfish 071213 - Bench: 8322172 - Timestamp: 1386415938
Houdini 4.0 Standard Contempt 0
Stockwood 061213 (Stockfish Rockwood 061213)

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 512
Relative Speed: 28.66
Knodes per second: 13.759

Time Control= 4+0.

1 Stockfish 071213 64 SSE4.2X6 19.5 - 20.5 22.5 - 17.5 42.0/80
2 Stockwood 061213 64 SSE4.2X6 20.5 - 19.5 19.5 - 20.5 40.0/80
3 Houdini 4 x64_st_X6_CT0 17.5 - 22.5 20.5 - 19.5 38.0/80

120 Games = http://www.mediafire.com/view/272gobx2b ... 6cores.pgn

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control= 4+0


1 Stockfish 071213 64 SSE4.2x 21.5 - 18.5 21.5 - 18.5 43.0/80
2 Houdini 4 x64xCT0 18.5 - 21.5 23.0 - 17.0 41.5/80
3 Stockwood 061213 64 SSE4.2x 18.5 - 21.5 17.0 - 23.0 35.5/80

120 Games= http://www.mediafire.com/view/rajwe503b ... _4%2B0.pgn

Summary after 240 Games at Fixed Time Control:

1 Stockfish 071213 64 SSE4.2x 85.0/160
2 Houdini 4 x64xCT0 79.5/160
3 Stockwood 061213 64 SSE4.2x 75.5/160

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 512
Relative Speed: 28.66
Knodes per second: 13.759

Time Control= 2+2.

1 Stockwood 061213 64 SSE4.2X6 22.0 - 18.020.5 - 19.5** 42.5/80
2 Houdini 4 x64_st_X6_CT0 18.0 - 22.021.5 - 18.5 ** 39.5/80
3 Stockfish 071213 64 SSE4.2X6 19.5 - 20.518.5 - 21.5 ** 38.0/80

120 Games = http://www.mediafire.com/view/jug8411kf ... 6cores.pgn


i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control= 2+2

1 Stockwood 061213 64 SSE4.2x 21.0 - 19.021.0 - 19.0** 42.0/80
2 Houdini 4 x64xCT0 19.0 - 21.021.5 - 18.5 ** 40.5/80
3 Stockfish 071213 64 SSE4.2x 19.0 - 21.018.5 - 21.5 ** 37.5/80

120 Games= http://www.mediafire.com/view/y6c8xmd2o ... _2%2B2.pgn

Summary after 240 Games at Incremental Time Control:

1 Stockwood 061213 64 SSE4.2x 84.5/160
2 Houdini 4 x64xCT0 80.0/160
3 Stockfish 071213 64 SSE4.2x 75.5/160

GLOBAL SCORE AFTER 480 GAMES:

1 Stockfish 071213 64 SSE4.2x 160.5/320
2 Stockwood 061213 64 SSE4.2x 160.0/320
3 Houdini 4 x64xCT0 159.5/320


Extreme equality between these three engines, with clear differences in function of the time control.


Regards,

Tom.
ouachita
Posts: 454
Joined: Tue Jan 15, 2013 4:33 pm
Location: Ritz-Carlton, NYC
Full name: Bobby Johnson

Re: no more tests?

Post by ouachita »

Tomcass wrote: Extreme equality between these three engines, with clear differences in function of the time control.
Chess Engine Rule #1: The precision of the analysis is determined by time available per move, or by the fixed calculation depth you allocate.

Chess Engine Rule #2: The precision achieved by each engine per second of analysis varies for each engine.

The testing confirmations here of H's dominance in TC <30+ are now too numerous to count. However, such is not the case in TC >60+ where H appears to be #3.
SIM, PhD, MBA, PE
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: no more tests?

Post by Tomcass »

ouachita wrote:
Tomcass wrote: Extreme equality between these three engines, with clear differences in function of the time control.
Chess Engine Rule #1: The precision of the analysis is determined by time available per move, or by the fixed calculation depth you allocate.

Chess Engine Rule #2: The precision achieved by each engine per second of analysis varies for each engine.

The testing confirmations here of H's dominance in TC <30+ are now too numerous to count. However, such is not the case in TC >60+ where H appears to be #3.
Chess Engine Rule 3 (mine) :wink: = The speed of the computer is very relevant.

Example: If a computer A) has a Fritz Benchmark of 20,000 KNS and computer B) has one of 1,000 KNS , the precision of the analysis will be higher in a 1 minute per move for A) than in a 10 minutes per move for B).

IMHO the relevant point is therefore not the time avalilable per move, but the number of nodes calculated per move, taking in consideration not only the time available, but also the speed of the computer.

Regards,

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: no more tests?

Post by Tomcass »

TESTING Stockfish 091213SL 64 SSE4.2L IPMAN = 480 GAMES

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Large Pages = Allowed
Hash 512
Relative Speed: 28.66
Knodes per second: 13.759

Time Control= 4+0.

Stockfish 091213SL 64 SSE4.2L - Houdini 4 x64_st_X6_CT0 20.5 - 19.5 +7/=27/-6 51.25%
Stockfish 091213SL 64 SSE4.2L - Stockwood 061213 64 SSE 19.5 - 20.5 +2/=35/-3 48.75%
Stockfish 091213SL 64 SSE4.2L - Stockfish 071213 64 SSE4. 20.0 - 20.0 +4/=32/-4 50.00%

Time Control= 2+2

Stockfish 091213SL 64 SSE4.2L - Houdini 4 x64_st_X6_CT0 20.0 - 20.0 +9/=22/-9 50.00%
Stockfish 091213SL 64 SSE4.2L - Stockfish 071213 64 SSE 20.5 - 19.5 +5/=31/-4 51.25%
Stockfish 091213SL 64 SSE4.2L - Stockwood 061213 64 SSE 19.5 - 20.5 +3/=33/-4 48.75%

Score using 6 cores= 120.0 – 120.0
240 GAMES: http://www.mediafire.com/download/4pe66wo17pifgvf/


i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Large Pages = Allowed
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control= 4+0

Stockfish 091213SL 64 SSE4.2L - Houdini 4 x64xCT0 19.0 - 21.0 +9/=20/-11 47.50%
Stockfish 091213SL 64 SSE4.2L - Stockwood 061213 64 20.5 - 19.5 +7/=27/-6 51.25%
Stockfish 091213SL 64 SSE4.2L - Stockfish 071213 64 23.0 - 17.0 +8/=30/-2 57.50%

Time Control= 2+2

Stockfish 091213SL 64 SSE4.2L - Houdini 4 x64xCT0 21.5 - 18.5 +9/=25/-6 53.75%
Stockfish 091213SL 64 SSE4.2L - Stockwood 061213 64 20.0 - 20.0 +2/=36/-2 50.00%
Stockfish 091213SL 64 SSE4.2L - Stockfish 071213 64 18.0 - 22.0 +4/=28/-8 45.00%

Score using 4 cores= 122.0 – 118.0
240 GAMES = http://www.mediafire.com/download/4790aoxonlz6bbd/

Fixed = 122.5 – 117.5 = 51.04%
Incremental = 119.5 – 120.5 = 49.79%

Global Score: 242.0-238.0 = 50.42%



If I make a fussion between my two latest tests –same engines and same time controls- we get this

OVERALL PICTURE AFTER 960 GAMES:


1.- Stockfish 091213SL 64 SSE4.2L 242.0/480 50.42%
2.- Stockwood 061213 64 SSE4.2 240.5/480 50.10%
3.- Stockfish 071213 64 SSE4.2x 239.0/480 49.79%
4.- Houdini 4 x64 x CT0 238.5/480 49.69%


Under my testing conditions the differences among these four engines are very small indeed.

Regards,

Tom.
fauzi
Posts: 61
Joined: Wed Nov 20, 2013 10:42 am

Re: no more tests?

Post by fauzi »

the second link is set to private, cannot download :)