Testing Stockfish 11-03-13. 480 Games.

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Timestamps of Stockfish..SF_0308 - Komodo 51MP 58%

Post by Tomcass »

Stockfish 080813 480games / Bench: 4356801 / Timestamp: 1375950528

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases
Relative Speed: 28.66
Knodes per second: 13.759

Time Control_4+0

Stockfish 080813 64 SSE4.2_ - Critter 1.6 64-bitx6_nob 22.0 - 18.0 +11/=22/-7 55.00%
Stockfish 080813 64 SSE4.2_ - Deep Rybka 4.1 SSE42 x64 (x6) 26.5 - 13.5 +17/=19/-4 66.25%
Stockfish 080813 64 SSE4.2_ - Houdini 3 Pro x64_6 19.0 - 21.0 +11/=16/-13 47.50%

Time Control_ 2+2

Stockfish 080813 64 SSE4.2_ - Critter 1.6 64-bitx6_nob 18.5 - 21.5 +8/=21/-11 46.25%
Stockfish 080813 64 SSE4.2_ - Deep Rybka 4.1 SSE42 x64 (x6) 26.5 - 13.5 +17/=19/-4 66.25%
Stockfish 080813 64 SSE4.2_ - Houdini 3 Pro x64_6 19.0 - 21.0 +9/=20/-11 47.50%

240 games 6 cores= http://www.mediafire.com/?nli2j9qhc60j5y0
Global Score with 6 cores: 131.5-108.5 = 54.79%

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases
Relative Speed: 20.62
Knodes per second: 9.899

Time control 4+0

Stockfish 080813 64 SSE4.2_ - Critter 1.6a 64-bitnob_4 25.5 - 14.5 +16/=19/-5 63.75%
Stockfish 080813 64 SSE4.2_ - Deep Rybka 4 x64 (x4) 25.5 - 14.5 +15/=21/-4 63.75%
Stockfish 080813 64 SSE4.2_ - Houdini 3 Pro x64_4 13.0 - 27.0 +6/=14/-20 32.50%

Time Control 2+2

Stockfish 080813 64 SSE4.2_ - Critter 1.6a 64-bitnob_4 22.5 - 17.5 +9/=27/-4 56.25%
Stockfish 080813 64 SSE4.2_ - Deep Rybka 4 x64 (x4) 26.5 - 13.5 +17/=19/-4 66.25%
Stockfish 080813 64 SSE4.2_ - Houdini 3 Pro x64_4 18.5 - 21.5 +10/=17/-13 46.25%

240 games 4 cores= http://www.mediafire.com/?bst7ot8g6zgu70b
Global Score with 4 cores= 131.5-108.5 = 54.79%

Global Score: 263.0 – 217.0 = 54.79%
Against Critter 1.6: 55.31% Deep Rybka 4: 65.62% Houdini 3.0: 43.44%
Estimated ELO Performance: 3128

Segmenting by time control=

Fixed Time Control = 54.79%
Incremental Time Control = 54.79%

Stockfish consolidates its improvement with another excellent score.

Regards from Barcelona.

Tom.
Top
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Timestamps of Stockfish..SF_0308 - Komodo 51MP 58%

Post by Tomcass »

Stockfish 090813 = 480 games.

bench: 4303194 Timestamp: 1376029315

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases
Relative Speed: 28.66
Knodes per second: 13.759

Time Control_4+0

Stockfish 090813 64 SSE4.2_ - Critter 1.6 64-bitx6_nob 20.5 - 19.5 +11/=19/-10 51.25%
Stockfish 090813 64 SSE4.2_ - Deep Rybka 4.1 SSE42 x64 (x6) 24.5 - 15.5 +14/=21/-5 61.25%
Stockfish 090813 64 SSE4.2_ - Houdini 3 Pro x64_6 18.0 - 22.0 +8/=20/-12 45.00%

Time Control 2+2

Stockfish 090813 64 SSE4.2_ - Critter 1.6 64-bitx6_nob 21.0 - 19.0 +7/=28/-5 52.50%
Stockfish 090813 64 SSE4.2_ - Deep Rybka 4.1 SSE42 x64 (x6) 22.5 - 17.5 +8/=29/-3 56.25%
Stockfish 090813 64 SSE4.2_ - Houdini 3 Pro x64_6 16.0 - 24.0 +6/=20/-14 40.00%

240 games x 6 cores = http://www.mediafire.com/?tmbq2oz5cg756x5
Global Score using 6 cores = 122.5-117.5 = 51.04%

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases
Relative Speed: 20.62
Knodes per second: 9.899

Time Control_4+0

Stockfish 090813 64 SSE4.2_ - Critter 1.6a 64-bitnob_4 21.5 - 18.5 +11/=21/-8 53.75%
Stockfish 090813 64 SSE4.2_ - Deep Rybka 4 x64 (x4) 28.5 - 11.5 +19/=19/-2 71.25%
Stockfish 090813 64 SSE4.2_ - Houdini 3 Pro x64_4 20.5 - 19.5 +9/=23/-8 51.25%

Time Control 2+2

Stockfish 090813 64 SSE4.2_ - Critter 1.6a 64-bitnob_4 19.5 - 20.5 +10/=19/-11 48.75%
Stockfish 090813 64 SSE4.2_ - Deep Rybka 4 x64 (x4) 27.5 - 12.5 +18/=19/-3 68.75%
Stockfish 090813 64 SSE4.2_ - Houdini 3 Pro x64_4 16.0 - 24.0 +9/=14/-17 40.00%

Global Score using 4 cores= 133.5-106.5 = 55.62%
240 games x 4 cores = http://www.mediafire.com/?pdyb4kdfmxlgf85

Global Score: 256.0 – 224.0 = 53.33%
Against Critter 1.6: 51.56% Deep Rybka 4: 64.37% Houdini 3.0: 44.06%
Estimated ELO Performance: 3117

Segmenting by time control:

Fixed Time Control = 55.62%
Incremental Time Control = 51.04%

Not so brilliant score this time. Better at Fixed Time Control.

Regards.

Tom.
Top
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Timestamps of Stockfish..SF_0308 - Komodo 51MP 58%

Post by Tomcass »

Stockfish 110813 480 GAMES bench: 4944581 Timestamp: 1376396402

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases
Relative Speed: 28.66
Knodes per second: 13.759

Time Control_4+0

Stockfish 110813 64 SSE4.2_ - Critter 1.6 64-bitx6_nob 21.0 - 19.0 +11/=20/-9 52.50%
Stockfish 110813 64 SSE4.2_ - Deep Rybka 4.1 SSE42 x64 27.0 - 13.0 +18/=18/-4 67.50%
Stockfish 110813 64 SSE4.2_ - Houdini 3 Pro x64_6 18.5 - 21.5 +9/=19/-12 46.25%

Time Control 2+2

Stockfish 110813 64 SSE4.2_ - Critter 1.6 64-bitx6_nob 22.5 - 17.5 +9/=27/-4 56.25%
Stockfish 110813 64 SSE4.2_ - Deep Rybka 4.1 SSE42 x64 25.0 - 15.0 +12/=26/-2 62.50%
Stockfish 110813 64 SSE4.2_ - Houdini 3 Pro x64_6 16.0 - 24.0 +8/=16/-16 40.00%

240 games x 6 cores= http://www.mediafire.com/?ncd437xcqe6iron
Global Score using 6 cores = 130.0-110.0 = 54.17%

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases
Relative Speed: 20.62
Knodes per second: 9.899

Time Control_4+0

Stockfish 110813 64 SSE4.2_ - Critter 1.6a 64-bitnob_4 21.5 - 18.5 +11/=21/-8 53.75%
Stockfish 110813 64 SSE4.2_ - Deep Rybka 4 x64 (x4) 28.0 - 12.0 +19/=18/-3 70.00%
Stockfish 110813 64 SSE4.2_ - Houdini 3 Pro x64_4 17.0 - 23.0 +7/=20/-13 42.50%

Time Control 2+2

Stockfish 110813 64 SSE4.2_ - Critter 1.6a 64-bitnob_4 25.0 - 15.0 +15/=20/-5 62.50%
Stockfish 110813 64 SSE4.2_ - Deep Rybka 4 x64 (x4) 25.5 - 14.5 +13/=25/-2 63.75%
Stockfish 110813 64 SSE4.2_ - Houdini 3 Pro x64_4 20.0 - 20.0 +8/=24/-8 50.00%

240 games x 4 cores= http://www.mediafire.com/?11pn4kvfyv5e5t1
Global Score using 4 cores= 137.0-103.0 = 57.08%

By Time Control=
Fixed = 55.42%
Incremental = 55.83%

Global Score= 267.0-213.0 = 55.62%
Against Critter 1.6 = 56.25% Against Deep Rybka 4= 65.94% Against Houdini 3.0 = 44.69%

Estimated Elo Performance = 3.233

This is another very good score for Stockfish. Very close to its record.

Regards,

Tom.
Top
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Timestamps of Stockfish..SF_0308 - Komodo 51MP 58%

Post by Tomcass »

Stockfish 130813 480 GAMES bench: 4944581 Timestamp: 1376396402

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases
Hash 512
Relative Speed: 28.66
Knodes per second: 13.759

Time Control_4+0

Stockfish 130813 64 SSE4.2_ - Critter 1.6 64-bitx6_nob 20.0 - 20.0 +8/=24/-8 50.00%
Stockfish 130813 64 SSE4.2_ - Deep Rybka 4.1 SSE42 x64 26.5 - 13.5 +20/=13/-7 66.25%
Stockfish 130813 64 SSE4.2_ - Houdini 3 Pro x64_6 20.0 - 20.0 +10/=20/-10 50.00%

Time Control_2+2


Stockfish 130813 64 SSE4.2_ - Critter 1.6 64-bitx6_nob 21.5 - 18.5 +10/=23/-7 53.75%
Stockfish 130813 64 SSE4.2_ - Deep Rybka 4.1 SSE42 x64) 24.0 - 16.0 +16/=16/-8 60.00%
Stockfish 130813 64 SSE4.2_ - Houdini 3 Pro x64_6 19.5 - 20.5 +10/=19/-11 48.75%

240 games x 6 cores= http://www.mediafire.com/?kn58mgfqw2iuf18
Score using 6 cores = 131.5-108.5 = 54.79%

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control_4+0

Stockfish 130813 64 SSE4.2_ - Critter 1.6a 64-bitnob_4 23.5 - 16.5 +13/=21/-6 58.75%
Stockfish 130813 64 SSE4.2_ - Deep Rybka 4 x64 (x4) 26.5 - 13.5 +17/=19/-4 66.25%
Stockfish 130813 64 SSE4.2_ - Houdini 3 Pro x64_4 12.5 - 27.5 +4/=17/-19 31.25%

Time Control_2+2

Stockfish 130813 64 SSE4.2_ - Critter 1.6a 64-bitnob_4 23.0 - 17.0 +12/=22/-6 57.50%
Stockfish 130813 64 SSE4.2_ - Deep Rybka 4 x64 (x4) 23.0 - 17.0 +12/=22/-6 57.50%
Stockfish 130813 64 SSE4.2_ - Houdini 3 Pro x64_4 19.5 - 20.5 +10/=19/-11 48.75%

240 games x 4 cores= http://www.mediafire.com/?2t62x2hka0c9tdi
Score using 4 cores = 128.0-112.0 = 53.33%

Global Score= 259.5-220.5 = 54.06%
Against Critter 1.6 =55.00 % Against Deep Rybka 4= 62.50% Against Houdini 3.0 = 44.69%

Estimated Elo Performance = 3.225

By Time Control:

Fixed = 53.75%
Incremental = 54.37%

Regards,

Tom.
Top
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Timestamps of Stockfish..SF_0308 - Komodo 51MP 58%

Post by Tomcass »

... wooops!. I have discovered a mistake in the benchmark and timestamp reported in my test of SF 110813.

I posted:

Stockfish 110813 bench: 4944581 Timestamp: 1376396402

... but the right reference is:

Stockfish 110813 bench: 4634244 Timestamp: 1376197370

Sorry for my mistake. :oops:

Best regards,

Tom.
Top
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Timestamps of Stockfish..SF_0308 - Komodo 51MP 58%

Post by Tomcass »

Stockfish 150813 480 GAMES

Bench: 4944581 Timestamp: 1376552186

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases
Hash 512
Relative Speed: 28.66
Knodes per second: 13.759


Time Control_4+0

Stockfish 150813 64 SSE4.2_ - Critter 1.6 64-bitx6_nob 22.5 - 17.5 +8/=29/-3 56.25%
Stockfish 150813 64 SSE4.2_ - Deep Rybka 4.1 SSE42 x64 26.5 - 13.5 +18/=17/-5 66.25%
Stockfish 150813 64 SSE4.2_ - Houdini 3 Pro x64_6 18.0 - 22.0 +9/=18/-13 45.00%

Tine Control_2+2

Stockfish 150813 64 SSE4.2_ - Critter 1.6 64-bitx6_nob 24.0 - 16.0 +14/=20/-6 60.00%
Stockfish 150813 64 SSE4.2_ - Deep Rybka 4.1 SSE42 x64) 24.5 - 15.5 +16/=17/-7 61.25%
Stockfish 150813 64 SSE4.2_ - Houdini 3 Pro x64_6 17.5 - 22.5 +7/=21/-12 43.75%

240 Games x 6 cores = http://www.mediafire.com/?7vmm1tvikuzol8w
Score using 6 cores = 133.0-107-0 = 55.42%

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control_4+0

Stockfish 150813 64 SSE4.2_ - Critter 1.6a 64-bitnob_4 21.5 - 18.5 +9/=25/-6 53.75%
Stockfish 150813 64 SSE4.2_ - Deep Rybka 4 x64 (x4) 24.0 - 16.0 +14/=20/-6 60.00%
Stockfish 150813 64 SSE4.2_ - Houdini 3 Pro x64_4 19.5 - 20.5 +10/=19/-11 48.75%

Time Control_2+2

Stockfish 150813 64 SSE4.2_ - Critter 1.6a 64-bitnob_4 23.0 - 17.0 +9/=28/-3 57.50%
Stockfish 150813 64 SSE4.2_ - Deep Rybka 4 x64 (x4) 26.5 - 13.5 +17/=19/-4 66.25%
Stockfish 150813 64 SSE4.2_ - Houdini 3 Pro x64_4 16.5 - 23.5 +7/=19/-14 41.25%

240 Games x 4 cores = http://www.mediafire.com/?x973aweltj3cr7a
Score using 4 cores = 131.0-109.0 = 54.58%

Segmenting by Time Control:

Fixed = 55%
Incremental = 55%

Global Score: 264.0 – 216.0 = 55.00%
Against Critter 1.6: 56.87% Deep Rybka 4: 63.44% Houdini 3.0: 44.69%
Estimated ELO Performance: 3229

Kind regards,

Tom.
Top
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Timestamps of Stockfish..SF_0308 - Komodo 51MP 58%

Post by Tomcass »

Stockfish 180813 480 Games.

Bench: 4132374 Timestamp: 1376810037

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases
Hash 512
Relative Speed: 28.66
Knodes per second: 13.759

Time Control_4+0_120games

Stockfish 180813 64 SSE4.2_X - Critter 1.6 64-bitx6_nob 20.5 - 19.5 +10/=21/-9 51.25%
Stockfish 180813 64 SSE4.2_X - Deep Rybka 4.1 SSE42 x64 27.0 - 13.0 +17/=20/-3 67.50%
Stockfish 180813 64 SSE4.2_X - Houdini 3 Pro x64_6 17.0 - 23.0 +6/=22/-12 42.50%

Time Control_2+2_120games

Stockfish 180813 64 SSE4.2_X - Critter 1.6 64-bitx6_nob 23.5 - 16.5 +11/=25/-4 58.75%
Stockfish 180813 64 SSE4.2_X - Deep Rybka 4.1 SSE42 x64 24.5 - 15.5 +14/=21/-5 61.25%
Stockfish 180813 64 SSE4.2_X - Houdini 3 Pro x64_6 16.5 - 23.5 +8/=17/-15 41.25%

240 Games = http://www.mediafire.com/?zvabi0r9hazmfxl
Score using 6 cores = 129.0-111.0 = 53.75%

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control_4+0
Stockfish 180813 64 SSE4.2_X - Critter 1.6a 64-bitnob_4 25.5 - 14.5 +15/=21/-4 63.75%
Stockfish 180813 64 SSE4.2_X - Deep Rybka 4 x64 (x4) 24.0 - 16.0 +16/=16/-8 60.00%
Stockfish 180813 64 SSE4.2_X - Houdini 3 Pro x64_4 15.0 - 25.0 +7/=16/-17 37.50%

Time Control_2+2

Stockfish 180813 64 SSE4.2_X - Critter 1.6a 64-bitnob_4 22.0 - 18.0 +11/=22/-7 55.00%
Stockfish 180813 64 SSE4.2_X - Deep Rybka 4 x64 (x4) 26.0 - 14.0 +16/=20/-4 65.00%
Stockfish 180813 64 SSE4.2_X - Houdini 3 Pro x64_4 17.0 - 23.0 +8/=18/-14 42.50%

240 Games= http://www.mediafire.com/?99qubquxb6cu9ia
Score using 4 cores= 129.5-110.5 = 53.96%

Segmenting by Time Control:

Fixed = 53.75%
Incremental = 53.96%

Global Score: 258.5 – 221.5 = 53.85%
Against Critter 1.6: 57.19% Deep Rybka 4: 63.44% Houdini 3.0: 40.94%
Estimated ELO Performance: 3221

Regards,

Tom.
Top
Lion
Posts: 539
Joined: Fri Mar 31, 2006 1:26 pm
Location: Switzerland

Re: Timestamps of Stockfish..SF_0308 - Komodo 51MP 58%

Post by Lion »

Since all the new versions and testing, I am a little bit lost.....
Which version seems currently to perform the best ?

Rgds and thanks
Top
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Timestamps of Stockfish..SF_0308 - Komodo 51MP 58%

Post by Tomcass »

Hi, Bigler.

I test the Development versions, but I suggest you to try the new Stockfish 4. Probably it is the best Stockfish till now:

http://cl.ly/2l153X213N1h/download/stockfish-4-win.zip

Kind regards,

Tom.
Top
Kohflote
Posts: 240
Joined: Wed Sep 19, 2007 11:07 am
Location: Singapore

Re: Timestamps of Stockfish..SF_0308 - Komodo 51MP 58%

Post by Kohflote »

Hi Bigler,

Based on the kind testings by Tom, so far, the best is 3rd August 2013.

Best wishes,
Koh, Kah Huat
Top

Return to “Computer Chess Club: Tournaments and Matches”