Testing Stockfish 11-03-13. 480 Games.

[Tomcass]

Hi Tom,

Welcome back and glad to see your testing again . Two questions, please:

(1) where do get IPman's version?
(2) what do you think the performance of SF same version without LP?

Best wishes,
Koh, Kah Huat

Dear Kah Huat,

Thanks for your welcome. You can find the answer to your second question in my previous post. Regarding the link to Ipman's version, since I am not sure that I am allowed to post it here, I will send it to you privately.

If any other member is interested, please feel free to contact me.

Best regards, my friend!

Tom.

[Tomcass]

TESTING Stockfish 161113SL 64 SSE4.2L With Large Pages (Ipman’s Compile) = 480 Games.

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Large Pages Allowed
Hash 512
Relative Speed: 28.66
Knodes per second: 13.759

Time Control_4+0

Stockfish 161113SL 64 SSE4.2L - Critter 1.6a 64-bitX6_NOB 26.5 - 13.5 +17/=19/-4 66.25%
Stockfish 161113SL 64 SSE4.2L - Houdini 3 Pro x64_6 22.5 - 17.5 +14/=17/-9 56.25%
Stockfish 161113SL 64 SSE4.2L - Komodo 6 64-bitx6NOB 23.5 - 16.5 +13/=21/-6 58.75%

Time Control_2+2

Stockfish 161113SL 64 SSE4.2L - Critter 1.6a 64-bitX6_NOB 25.5 - 14.5 +16/=19/-5 63.75%
Stockfish 161113SL 64 SSE4.2L - Houdini 3 Pro x64_6 19.5 - 20.5 +10/=19/-11 48.75%
Stockfish 161113SL 64 SSE4.2L - Komodo 6 64-bitx6NOB 22.0 - 18.0 +11/=22/-7 55.00%

240 Games X 6 Cores = http://www.mediafire.com/?39vmqdztk6rk7lq
Score using 6 cores = 139.5 – 100.5 = 58.12%

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Large Pages Allowed
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control_4+0

Stockfish 161113SL 64 SSE4.2L - Critter 1.6a 64-bitnob_4 19.0 - 21.0 +6/=26/-8 47.50%
Stockfish 161113SL 64 SSE4.2L - Houdini 3 Pro x64_4 25.5 - 14.5 +16/=19/-5 63.75%
Stockfish 161113SL 64 SSE4.2L - Komodo 6 64-bitx4_NOB 22.5 - 17.5 +13/=19/-8 56.25%

Time Control_2+2

Stockfish 161113SL 64 SSE4.2L - Critter 1.6a 64-bitnob_4 27.5 - 12.5 +17/=21/-2 68.75%
Stockfish 161113SL 64 SSE4.2L - Houdini 3 Pro x64_4 24.0 - 16.0 +12/=24/-4 60.00%
Stockfish 161113SL 64 SSE4.2L - Komodo 6 64-bitx4_NOB 25.5 - 14.5 +15/=21/-4 63.75%

240 Games X 4 cores = http://www.mediafire.com/?gd2gq79wtboo5ch
Scores using 4 cores = 144.0 – 96.0 = 60.00%

Segmenting the result by Time Control:

Fixed = 139.5 – 100.5 = 58.12%
Incremental = 144.0 – 96.0 = 60.00%

Global Score: 283.5 – 196.5 = 59.06%
Against Critter 1.6a (3093): 61.56% Houdini 3.0 Pro (3172): 57.19% Komodo 6 (3154): 58.44%

Average ELO of opponents= 3.140
Estimated ELO Performance= 3.203

Not so brilliant as the Ipman's 111113SL version, but this is the second best score ever in my tests.

Regards,

Tom.

[overlord]

Hello Tom,

could you please specify timestamp of the SF 111113 that used in your test. I am sorry for my stupid question but there are more development versions loaded on November 11.

[Tomcass]

Hello Tom,

could you please specify timestamp of the SF 111113 that used in your test. I am sorry for my stupid question but there are more development versions loaded on November 11.

Hi, Miroslav!

I am not sure about the timestamp used by Ipman for his compile using Large Pages. I guess that it is:

Author: Joona Kiiski
Date: Mon Nov 11 08:46:11 2013 +0100
Timestamp: 1384155971

Te other two versions with the same date are with 'no functional changes'.

Regards,

Tom.

[Tomcass]

TESTING Stockfish 191113 64 SSE4.2 = 480 Games.

Author: Marco Costalba
Date: Tue Nov 19 07:20:50 2013 +0100
Timestamp: 1384842050
Bench: 8331357

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
No Large Pages
Hash 512
Relative Speed: 28.66
Knodes per second: 13.759

Time Control_4+0

Stockfish 191113 64 SSE4.2x - Critter 1.6a 64-bitX6_NOB 28.5 - 11.5 +21/=15/-4 71.25%
Stockfish 191113 64 SSE4.2x - Houdini 3 Pro x64_6 21.0 - 19.0 +10/=22/-8 52.50%
Stockfish 191113 64 SSE4.2x - Komodo 6 64-bitx6NOB 23.5 - 16.5 +12/=23/-5 58.75%

Time Control_2+2

Stockfish 191113 64 SSE4.2x - Critter 1.6a 64-bitX6_NOB 27.5 - 12.5 +15/=25/-0 68.75%
Stockfish 191113 64 SSE4.2x - Houdini 3 Pro x64_6 23.5 - 16.5 +15/=17/-8 58.75%
Stockfish 191113 64 SSE4.2x - Komodo 6 64-bitx6NOB 22.5 - 17.5 +9/=27/-4 56.25%


240 Games X 6 Cores = http://www.mediafire.com/download/zw...240games_2.pgn
Score using 6 cores = 146.5 – 93.5 = 61.04%

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Large Pages Allowed
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control_4+0

Stockfish 191113 64 SSE4.2x - Critter 1.6a 64-bitnob_4 22.5 - 17.5 +11/=23/-6 56.25%
Stockfish 191113 64 SSE4.2x - Houdini 3 Pro x64_4 20.5 - 19.5 +11/=19/-10 51.25%
Stockfish 191113 64 SSE4.2x - Komodo 6 64-bitx4_NOB 21.0 - 19.0 +7/=28/-5 52.50%

Time Control_2+2

Stockfish 191113 64 SSE4.2x - Critter 1.6a 64-bitnob_4 25.5 - 14.5 +15/=21/-4 63.75%
Stockfish 191113 64 SSE4.2x - Houdini 3 Pro x64_4 22.5 - 17.5 +12/=21/-7 56.25%
Stockfish 191113 64 SSE4.2x - Komodo 6 64-bitx4_NOB 25.5 - 14.5 +15/=21/-4 63.75%

240 Games X 4 cores = https://www.mediafire.com/?lvm5lkm763sj7pc
Scores using 4 cores = 137.5 – 102.5 = 57.29%

Segmenting the result by Time Control:

Fixed = 137.0 – 103.0 = 57.08%
Incremental = 147.0 – 93.0 = 61.25%

Global Score: 284.0 – 196.0 = 59.17%
Against Critter 1.6a (3093): 65.00% Houdini 3.0 Pro (3172): 54.69% Komodo 6 (3154): 57.81%

Average ELO of opponents= 3.140
Estimated ELO Performance= 3.204

This is the best score till now in my tests with no Large Pages allowed. SF scores consistently more than 30 Estimated Elo Points above Houdini 3,0 Pro in my latest 3 tests. (1.440 games)

With Large Pages (Ipman's compiles):

Stockfish 111113SL 64 SSE4.2I = 3224
Stockfish 161113SL 64 SSE4.2L = 3203

Average using Large Pages = 3213.5 Estimated Elo Points. (41.5 EEP above Houdini 3.0 Pro)

Without Large Pages:

Stockfish 191113 64 SSE4.2x = 3204 (32 EEP above Houdini 3.0 Pro).

Awesome performance of Stockfish in these last three tests. Congratulations again to Marco and team!.

Regards,

Tom.

[Tomcass]

... woops! I have realized that the link to the games with 6 cores does not work well. If anyone wants to download the games, please use thgis link.

240 games x 6 cores = https://www.mediafire.com/?zmmcfxp445moe04

Sorry!

Tom.

[Tomcass]

Finally I have solved the problem with Mediafire. If anyone is interested in the games of my latest test, here you have the links:

Stockfish 191113 240 games using 6 cores.

http://www.mediafire.com/view/zwefcy...240games_2.pgn

Stockfish 191113 240 games using 4 cores.

http://www.mediafire.com/view/lvm5lk...4_240games.pgn

I hope it will be ok now. Thanks for your patience.

Tom.

[fauzi]

Invalid or Deleted File.

I think not solved yet

[Tomcass]

Thank you for your feed back, Akram. I hope the problem will be soved in this test:

Stockfish 231113SL 64 SSE4.2L With Large Pages (Ipman’s Compile) = 480 Games.


i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Large Pages Allowed
Hash 512
Relative Speed: 28.66
Knodes per second: 13.759

Time Control_4+0

Stockfish 231113SL 64 SSE4.2L - Critter 1.6a 64-bitX6_NOB 27.0 - 13.0 +17/=20/-3 67.50%
Stockfish 231113SL 64 SSE4.2L - Houdini 3 Pro x64_6 24.0 - 16.0 +15/=18/-7 60.00%
Stockfish 231113SL 64 SSE4.2L - Komodo 6 64-bitx6NOB 25.5 - 14.5 +19/=13/-8 63.75%

Time Control_2+2

Stockfish 231113SL 64 SSE4.2L - Critter 1.6a 64-bitX6_NOB 26.5 - 13.5 +14/=25/-1 66.25%
Stockfish 231113SL 64 SSE4.2L - Houdini 3 Pro x64_6 25.0 - 15.0 +16/=18/-6 62.50%
Stockfish 231113SL 64 SSE4.2L - Komodo 6 64-bitx6NOB 23.0 - 17.0 +11/=24/-5 57.50%

240 Games X 6 Cores=
http://www.mediafire.com/view/x0rhzv...240gamesLP.pgn
Score using 6 cores = 151.0 – 89.0 = 62.92%


i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. No RTB used.
Large Pages Allowed
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control_4+0

Stockfish 231113SL 64 SSE4.2L - Critter 1.6a 64-bitnob_4 26.5 - 13.5 +15/=23/-2 66.25%
Stockfish 231113SL 64 SSE4.2L - Houdini 3 Pro x64_4 25.5 - 14.5 +17/=17/-6 63.75%
Stockfish 231113SL 64 SSE4.2L - Komodo 6 64-bitx4_NOB 27.0 - 13.0 +14/=26/-0 67.50%

Time Control_2+2

Stockfish 231113SL 64 SSE4.2L - Critter 1.6a 64-bitnob_4 23.0 - 17.0 +12/=22/-6 57.50%
Stockfish 231113SL 64 SSE4.2L - Houdini 3 Pro x64_4 20.5 - 19.5 +13/=15/-12 51.25%
Stockfish 231113SL 64 SSE4.2L - Komodo 6 64-bitx4_NOB 21.0 - 19.0 +6/=30/-4 52.50%

240 Games X 4 cores = http://www.mediafire.com/view/vohua0...40games_LP.pgn
Scores using 4 cores = 143.5- 96.5 = 59.79%

Segmenting the result by Time Control:

Fixed = 155.5 – 84.5 = 64.79%
Incremental = 139.0 -101.0 = 57.92%

Global Score: 294.5 – 185.5 = 61.35%
Against Critter 1.6a (3093): 64.37% Houdini 3.0 Pro (3172): 59.37% Komodo 6 (3154): 60.31%

Average ELO of opponents= 3.140
Estimated ELO Performance= 3.219

The second best score ever in my tests, only 5 Estimated Elo Points below the record of SF 111113SL (Ipman’s compile).

Regards,

Tom.

[Masta]

Where can I get IPman´s compile?

Ty very much.