Testing Stockfish 11-03-13. 480 Games.

[Masta]

STOCKFISH 01102013 - IPMAN COMPILE = 480 Games.

This time my test is of a compile from another friend: Ipman.

The source is here : https://github.com/mcostalba/Stockfish/commits/master

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. RTB not installed yet in my computers.
Hash 512
Large Pages ALLOWED
Relative Speed: 28.66
Knodes per second: 13.759

Time Control_4+0

Stockfish 011013 64 SSE4.2I - Critter 1.6a 64-bit_NOB 24.0 - 16.0 +14/=20/-6 60.00%
Stockfish 011013 64 SSE4.2I - Houdini 3 Pro x64_6 20.5 - 19.5 +9/=23/-8 51.25%
Stockfish 011013 64 SSE4.2I - Komodo 5.1r2 64-bitx6nob 22.5 - 17.5 +9/=27/-4 56.25%

Time Control_2+2

Stockfish 011013 64 SSE4.2I - Critter 1.6a 64-bit_NOB 24.0 - 16.0 +11/=26/-3 60.00%
Stockfish 011013 64 SSE4.2I - Houdini 3 Pro x64_6 21.5 - 18.5 +10/=23/-7 53.75%
Stockfish 011013 64 SSE4.2I - Komodo 5.1r2 64-bitx6nob 22.0 - 18.0 +11/=22/-7 55.00%

240 Games X 6 Cores = http://www.mediafire.com/?am5vz63oaj02i86
Score using 6 cores = 134.5-105.5 = 56.04%

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases
Hash 256
Large Pages ALLOWED
Relative Speed: 20.62
Knodes per second: 9.899

Time Control_4+0

Stockfish 011013 64 SSE4.2I - Critter 1.6a 64-bitnob_4 22.5 - 17.5 +10/=25/-5 56.25%
Stockfish 011013 64 SSE4.2I - Houdini 3 Pro x64_4 23.0 - 17.0 +13/=20/-7 57.50%
Stockfish 011013 64 SSE4.2I - Komodo 5.1r2 64-bitnob 23.5 - 16.5 +11/=25/-4 58.75%

Time Control_2+2

Stockfish 011013 64 SSE4.2I - Critter 1.6a 64-bitnob_4 23.0 - 17.0 +13/=20/-7 57.50%
Stockfish 011013 64 SSE4.2I - Houdini 3 Pro x64_4 22.0 - 18.0 +10/=24/-6 55.00%
Stockfish 011013 64 SSE4.2I - Komodo 5.1r2 64-bitnob 25.5 - 14.5 +13/=25/-2 63.75%

240 Games X 4 Cores = http://www.mediafire.com/?9scgvsgrnec4avx
Score using 4 Cores = 139.5-100.5 = 58.12%

Segmenting the result by Time Control:

Fixed = 136.0-104.0 = 56.67%
Incremental = 138.0-102.0 = 57.50%

Global Score: 274.0-206.0 = 57.08%
Against Critter 1.6a (3093): 58.44% Houdini 3.0 Pro (3172): 54.37% Komodo 5.1r2 (3135): 58.44%

Average ELO of opponents= 3.133
Estimated ELO Performance= 3.183

This is an EXCELLENT performance, with an Estimated ELO 11 points better than Houdini 3.0 Pro and a clear win in the four face-to-face legs. I will keep testing this compile until 1.440 games, to minimize the statistical noise.

Congratulations again to Stockfish Team for their great work. And thanks to Ipman for this fast compile. I find all this Stockfish development really fascinating.

Regards,

Tom.

Hi Tom!! Can you pls give a link for this Ipman´s version?

Ty very much and nice tests!

[Tomcass]

Hi Alexandre.

Here you have the link for downloading, as requested.

http://www.mediafire.com/?9agun9dhct2jqdo (Thanks Ipman!).

The source is here: https://github.com/mcostalba/Stockfish/commits/master

Kind regards from Barcelona.

Tom.

[Izak Pretorius]

Hi Alexandre.

Here you have the link for downloading, as requested.

http://www.mediafire.com/?9agun9dhct2jqdo (Thanks Ipman!).

The source is here: https://github.com/mcostalba/Stockfish/commits/master

Kind regards from Barcelona.

Tom.

hi Tom

This is not the correct source link.
As you well know this compile includes the use of Large Pages.
Your link is the default Stockfish latest source,which does not include Large Pages.
The correct source is @ this link.
It is the current Stockfish source,+ the sbases + the Large Pages added.
Executable also included,but anyone can compile this is they wish.
Unfortunately i have not included the Linux Large Page code but it can easy be added.

http://speedy.sh/kjPt3/sygzy30.rar
EDIT:Mirror link added as well
http://www.mediafire.com/download/zuied ... ygzy30.rar

Best Regards
Peterpan (Izak)

[Tomcass]

Hi Alexandre.

Here you have the link for downloading, as requested.

http://www.mediafire.com/?9agun9dhct2jqdo (Thanks Ipman!).

The source is here: https://github.com/mcostalba/Stockfish/commits/master

Kind regards from Barcelona.

Tom.

hi Tom

This is not the correct source link.
As you well know this compile includes the use of Large Pages.
Your link is the default Stockfish latest source,which does not include Large Pages.
The correct source is @ this link.
It is the current Stockfish source,+ the sbases + the Large Pages added.
Executable also included,but anyone can compile this is they wish.
Unfortunately i have not included the Linux Large Page code but it can easy be added.

http://speedy.sh/kjPt3/sygzy30.rar

Best Regards
Peterpan (Izak)

Woops!

Thank you very much for your clarification about this point, Izak. And congrats four your excellent work!.

Best regards, my friend.

Tom.

[Tomcass]

STOCKFISH 011013 (IPMAN COMPILE) Test 2 and 3 = 960 GAMES

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. RTB not installed yet in my computers.
Hash 512
Large Pages ALLOWED
Relative Speed: 28.66
Knodes per second: 13.759

Time Control_4+0

201310SF011013ST66_4+0_240games_IPMAN_2 2013

Stockfish 011013 64 SSE4.2I - Critter 1.6a 64-bit_NOB 44.0 - 36.0 +21/=46/-13 55.00%
Stockfish 011013 64 SSE4.2I - Houdini 3 Pro x64_6 47.0 - 33.0 +29/=36/-15 58.75%
Stockfish 011013 64 SSE4.2I - Komodo 5.1r2 64-bitx6nob 45.5 - 34.5 +24/=43/-13 56.88%

Time Control_2+2

201310SF011013ST66_2+_240games_IPMAN_2_ 2013

Stockfish 011013 64 SSE4.2I - Critter 1.6a 64-bit_NOB 44.0 - 36.0 +19/=50/-11 55.00%
Stockfish 011013 64 SSE4.2I - Houdini 3 Pro x64_6 32.5 - 47.5 +14/=37/-29 40.63%
Stockfish 011013 64 SSE4.2I - Komodo 5.1r2 64-bitx6nob 45.0 - 35.0 +22/=46/-12 56.25%

240 Games X 6 Cores = http://www.mediafire.com/?3mudh1azalb52a3
Score using 6 cores = 258.0-222.0 = 53.75%

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases
Hash 256
Large Pages ALLOWED
Relative Speed: 20.62
Knodes per second: 9.899

Time Control_4+0

Stockfish 011013 64 SSE4.2I - Critter 1.6a 64-bitnob_4 52.0 - 28.0 +32/=40/-8 65.00%
Stockfish 011013 64 SSE4.2I - Houdini 3 Pro x64_4 35.5 - 44.5 +14/=43/-23 44.38%
Stockfish 011013 64 SSE4.2I - Komodo 5.1r2 64-bitnob 50.5 - 29.5 +28/=45/-7 63.13%

Time Control_2+2

Stockfish 011013 64 SSE4.2I - Critter 1.6a 64-bitnob_4 49.0 - 31.0 +26/=46/-8 61.25%
Stockfish 011013 64 SSE4.2I - Houdini 3 Pro x64_4 42.5 - 37.5 +20/=45/-15 53.13%
Stockfish 011013 64 SSE4.2I - Komodo 5.1r2 64-bitnob 48.5 - 31.5 +30/=37/-13 60.63%

240 Games X 4 Cores = http://www.mediafire.com/?xhm48n95qgs8xh4
Score using 4 Cores = 278.0-202.0 = 57.92%

Segmenting the result by Time Control:

Fixed = 274.5 – 205.5 = 57.19%
Incremental = 261.5 – 218.5 = 54.48%

Global Score: 536.0 – 424.0 = 55.83%
Against Critter 1.6a (3093): 59.06% Houdini 3.0 Pro (3172): 49.22% Komodo 5.1r2 (3135): 59.22%

Average ELO of opponents= 3.133
Estimated ELO Performance= 3.174

--------------------------------------------------


Summary of tests 1 , 2 and 3 = 1.440 games

Global Score= 810.0-630.0 = 56.25%
Against Critter 1.6a (3093): 58.85% Houdini 3.0 Pro (3172): 50.94% Komodo 5.1r2 (3135): 58.96%

Average ELO of Opponents= 3.133
Estimated ELO performance= 3.177

-------------------------------------------------------


After three tests including 1.440 games, Stockfish 011013 Ipman remains ahead of Houdini 3.0 Pro. It has been approximately 6 ELO points better than Houdini 3.0 Pro under my testing conditions.

This is the best Stockfish in my tests so far with a small improvement (2 Estimated ELO points) over 140813 version.

Regards,

Tom.

[Tomcass]

In my previous post I wrote:

This is the best Stockfish in my tests so far with a small improvement (2 Estimated ELO points) over 140813 version.

--------------------------------------

Sorry, I meant 2 Estimated Elo Points over 140913 Version. Only as a reference, this Ipman compile is 48 Elo Points better than Stockfish 4. What an amazing improvement!.

Kind regards from Barcelona.

Tom.

[Kohflote]

Hi,

I have downloaded Stockfish from the link given by Izak but the version is 300913.

Would appreciate if someone could give the link to Ipman's Stockfish 011013 version, please.

Thank you,
Koh, Kah Huat

[Tomcass]

Hi,

I have downloaded Stockfish from the link given by Izak but the version is 300913.

Would appreciate if someone could give the link to Ipman's Stockfish 011013 version, please.

Thank you,
Koh, Kah Huat

Hello, Kah Huat

You can find the link in my post above dated Oct 3. (Before Thanks, Ipman!).

Best regards,

Tom.

[Kohflote]

Thank you, Tom.

I always look forward to your testing

Best wishes,
Koh, Kah Huat

[Masta]

No more tests? The latest SF is rocking. Sure it deserves a test run.