Testing Stockfish 11-03-13. 480 Games.

[ernest]

If I look at the global results, for the last versions (since 07-04), they are all pretty much in the same range, if you take in account the error bars.

[Tomcass]

I agree with you, Ernest. We can not expect a big jump in the strength of Stockfish in just a few days. Anyway, the system the Stockfish Team uses results in succesive marginal -but clearly perceptible!- improvements. Please give a look to my next post.

Tom.

[Tomcass]

STOCKFISH 19-04-13 IPMAN: 480 GAMES

I7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012
Time control: 4 min +0 sec/ game
No tablebases

SF190413 x64pop_IP-Critter 1.6 23.0 - 17.0 +12/=22/-6 57.50%
SF190413 x64pop_IP- Deep Rybka 4.1 20.5 - 19.5 +12/=17/-11 51.25%
SF190413 x64pop_IP- Houdini 3 Pro x64 17.0 - 23.0 +5/=24/-11 42.50%

X6 120 games: http://www.mediafire.com/?qwraab9bf4k4a70

I7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012
Time control: 2 min +2 sec/ game
No tablebases

201304SF190413Ipman_2+2_120games 2013

SF190413 x64pop_IP-Critter 1.6 20.0 - 20.0 +8/=24/-8 50.00%
SF190413 x64pop_IP- Deep Rybka 4.1 24.5 - 15.5 +13/=23/-4 61.25%
SF190413 x64pop_IP - Houdini 3 Pro 17.5 - 22.5 +7/=21/-12 43.75%

X6 120 games: http://www.mediafire.com/?6vvwou4vlbz956l

Overall average with 6 cores : ( 122.5-117.5) : 51.04%


i7 975 3.33 Ghz.
4 real cores
GUI: Fritz 12
Book: Fritz 12
Time control: 4 min + 0 sec/ game
Ponder: Off
No tablebases

Stockfish 64bit SSE4.2_1904IP- Critter 1.6 22.0 - 18.0 +9/=26/-5 55.00%
Stockfish 64bit SSE4.2_1904IP- Deep Rybka 4 23.0 - 17.0 +12/=22/-6 57.50%
Stockfish 64bit SSE4.2_1904IP- Houdini 3 Pro 17.5 - 22.5 +3/=29/-8 43.75%

X4 120 GAMES: http://www.mediafire.com/?b1kvff9hs2mdnb9

i7 975 3.33 Ghz.
4 real cores
GUI: Fritz 12
Book: Fritz 12
Time control: 2 min + 2 sec/ game
Ponder: Off
No tablebases

Stockfish 64bit SSE4.2_1904IP-Critter 1.6 17.5 - 22.5 +4/=27/-9 43.75%
Stockfish 64bit SSE4.2_1904IP-Deep Rybka 4 25.0 - 15.0 +14/=22/-4 62.50%
Stockfish 64bit SSE4.2_1904IP-Houdini 3 Pro 19.5 - 20.5 +9/=21/-10 48.75%

http://www.mediafire.com/?7fk1e7bnktbi25b

Overall average with 4 cores ( 124.5– 115.5) : 51.87%.

Global Score: 51.46% . New record for Stockfish in my tests.

Against: Critter 1.6: 51.56%, Deep Rybka 4: 58.12%, Houdini 3.0: 44.69%

This is a very strong compile!. Thanks IPMAN & SF Team!.

Best regards from Barcelona.

Tom.

[Kohflote]

Dear Tom,

Where could I download 190413 IP, 64bits SSE4.2 version?

Thank you,
Koh, Kah Huat

[Tomcass]

Dear Tom,

Where could I download 190413 IP, 64bits SSE4.2 version?

Thank you,
Koh, Kah Huat

Hello, my friend!. I think I am not allowed to post the file here. I contact you privately.

Regards,

Tom.

[geots]

Dear Tom,

Where could I download 190413 IP, 64bits SSE4.2 version?

Thank you,
Koh, Kah Huat

Hello, my friend!. I think I am not allowed to post the file here. I contact you privately.

Regards,

Tom.

Tom, would you mind sending me the 2 versions above that you think are the strongest. If you don't mind, you could just PM me with a link. I am headed now to try and get a bit of sleep. Maybe when I get back you will have noticed my thread. I would really like to test them at a longer control, like 40/20 repeating.



Thanks and all the best to you- (and great work!)

george

[Uri Blass]

Dear Tom,

Where could I download 190413 IP, 64bits SSE4.2 version?

Thank you,
Koh, Kah Huat

you can probably download it here

http://abrok.eu/stockfish/

There are 2 versions from 19.4 so I am not sure which version is the relevant version but there are later versions than 19.4

[Tomcass]

Hi George,

Thanks for your kind words. I have posted you the link where you can find Ipman's compile.

Best regards,

Tom.

[Tomcass]

STOCKFISH 27-04-13 : 480 GAMES

I7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012
Time control: 4 min +0 sec/ game
No tablebases

SF270413 x64-Critter 1.6 19.5 - 20.5 +7/=25/-8 48.75%
SF270413 x64- Deep Rybka 4.1 23.0 – 17.0 +10/=26/-4 57.50%
SF270413 x64- Houdini 3 Pro x64 18.0 - 22.0 +9/=18/-13 45.00%

I7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012
Time control: 2 min +2 sec/ game
No tablebases

201304SF190413Ipman_2+2_120games 2013

SF270413 x64- Critter 1.6 21.5 – 18.5 +9/=25/-6 53.75%
SF270413 x64- Deep Rybka 4.1 24.0 - 16.0 +12/=24/-4 60.00%
SF270413 x64- Houdini 3 Pro 15.0 – 25.0 +4=22/-14 37.50%
X6 270413 240 games http://www.mediafire.com/?87a5hm2ukrxj0wo

Overall average with 6 cores : ( 129.5-110.5) : 53.96%


i7 975 3.33 Ghz.
4 real cores
GUI: Fritz 12
Book: Fritz 12
Time control: 4 min + 0 sec/ game
Ponder: Off
No tablebases

Stockfish 64bit SSE4.2_2704- Critter 1.6 24.0 - 16.0 +11/=26/-3 60.00%
Stockfish 64bit SSE4.2_2704- Deep Rybka 4 24.0 - 16.0 +14/=20/-6 60.00%
Stockfish 64bit SSE4.2_2704- Houdini 3 Pro 21.0- 19.0 +8/=26/-6 52.50%


i7 975 3.33 Ghz.
4 real cores
GUI: Fritz 12
Book: Fritz 12
Time control: 2 min + 2 sec/ game
Ponder: Off
No tablebases
Stockfish 64bit SSE4.2_2704-Critter 1.6 21.5 - 18.5 +5/=33/-2 53.75%
Stockfish 64bit SSE4.2_2704-Deep Rybka 4 22.0 - 18.0 +6/=32/-2 55.00%
Stockfish 64bit SSE4.2_2704-Houdini 3 Pro 16.5 - 23.5 +6/=21/-13 40.62%

240 games 270413 x4 cores: http://www.mediafire.com/?49rh9nwbi8zsypj


Overall average with 4 cores ( 120.5– 119.5) : 50.21%

Global Score: 52.08% - NEW BEST SCORE IN MY TESTS!

Against Critter 1.6: 54.06% Deep Rybka 4: 58.12% Houdini 3.0: 44.06%

The current development of Stockfish remind me the great vault champion Sergei Bubka. He improved his world record only one centimeter every attempt. Obviously Stockfish is not the world champion -Houdini 3.0 Pro deserves this honour- but his progressive improvement, centimeter to centimeter, is clearly perceptible from the tests.

I know that from a strict statistical point of view there is still an error margin before saying that this is the second best engine in the world -and the best free one- ... but I simply suggest you to give a look to the games. Some are really impressive!. Enjoy!.

Best regards from Barcelona!

Tom.

[Tomcass]

STOCKFISH 28-04-13 IPMAN : 480 GAMES

I7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012
Time control: 4 min +0 sec/ game
No tablebases

SF280413 64p RTB_IP_6 - Critter 1.6 64-bitx6_nob 18.0 - 22.0 +8/=20/-12 45.00%
SF280413 64p RTB_IP_6 - Deep Rybka 4.1 SSE42 x64 (x6) 25.5 - 14.5 +19/=13/-8 63.75%
SF280413 64p RTB_IP_6 - Houdini 3 Pro x64_6 15.5 - 24.5 +5/=21/-14 38.75%

I7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012
Time control: 2 min +2 sec/ game
No tablebases

201304SF280413Ipman_2+2_120games 2013

SF280413 64p RTB_IP_6 - Critter 1.6 64-bitx6_nob 20.5 - 19.5 +10/=21/-9 51.25%
SF280413 64p RTB_IP_6 - Deep Rybka 4.1 SSE42 x64 (x6) 21.0 - 19.0 +11/=20/-9 52.50%
SF280413 64p RTB_IP_6 - Houdini 3 Pro x64_6 15.5 - 24.5 +8/=15/-17 38.75%

X6 240 Games http://www.mediafire.com/?8f3u7es978estb6

Overall average with 6 cores ( 116.0– 124.0) : 48.33%

i7 975 3.33 Ghz.
4 real cores
GUI: Fritz 12
Book: Fritz 12
Time control: 4 min + 0 sec/ game
Ponder: Off
No tablebases

SF280413 64p RTB_IP - Critter 1.6a 64-bitnob_4 19.5 - 20.5 +6/=27/-7 48.75%
SF280413 64p RTB_IP - Deep Rybka 4 x64 (x4) 24.5 - 15.5 +13/=23/-4 61.25%
SF280413 64p RTB_IP - Houdini 3 Pro x64_4 16.5 - 23.5 +7/=19/-14 41.25%

i7 975 3.33 Ghz.
4 real cores
GUI: Fritz 12
Book: Fritz 12
Time control: 2 min + 2 sec/ game
Ponder: Off
No tablebases

SF280413 64p RTB_IP - Critter 1.6a 64-bitnob_4 25.0 - 15.0 +16/=18/-6 62.50%
SF280413 64p RTB_IP - Deep Rybka 4 x64 (x4) 25.0 - 15.0 +13/=24/-3 62.50%
SF280413 64p RTB_IP - Houdini 3 Pro x64_4 19.5 - 20.5 +8/=23/-9 48.75%

X4 240 games http://www.mediafire.com/?ps323i3c48k1e22

Overall average with 4 cores ( 130.0– 110.0) : 54.17%

Global Score: 51.25%

Against Critter 1.6: 51.87% Deep Rybka 4: 60.00% Houdini 3.0: 41.87%

Again above 51%. Another good score for SF, Ipman compile, in my test.

Regards,

Tom.