Testing Stockfish 11-03-13. 480 Games.

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Timestamps of Stockfish..SF_0308 - Komodo 51MP 58%

Post by Tomcass »

Stockfish 140913 = 480 GAMES

Bench: 3846852 Timestamp: 1379156917

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases
Hash 512
Relative Speed: 28.66
Knodes per second: 13.759

Time Control_4+0

Stockfish 140913 64 SSE4.2_ - Critter 1.6a 64-bit_NOB 27.0 - 13.0 +16/=22/-2 67.50%
Stockfish 140913 64 SSE4.2_ - Houdini 3 Pro x64_6 21.0 - 19.0 +12/=18/-10 52.50%
Stockfish 140913 64 SSE4.2_ - Komodo 5.1r2 64-bitx6nob 22.5 - 17.5 +12/=21/-7 56.25%

Time Control_2+2

Stockfish 140913 64 SSE4.2_ - Critter 1.6a 64-bit_NOB 25.5 - 14.5 +13/=25/-2 63.75%
Stockfish 140913 64 SSE4.2_ - Houdini 3 Pro x64_6 21.5 - 18.5 +9/=25/-6 53.75%
Stockfish 140913 64 SSE4.2_ - Komodo 5.1r2 64-bitx6nob 20.5 - 19.5 +8/=25/-7 51.25%


240 Games X6 = http://www.mediafire.com/?pgaebug4az5em40
Score using 6 cores = 138.0-102.0 = 57.50%

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control_4+0

Stockfish 140913 64 SSE4.2x - Critter 1.6a 64-bitnob_4 22.0 - 18.0 +11/=22/-7 55.00%
Stockfish 140913 64 SSE4.2x - Houdini 3 Pro x64_4 26.5 - 13.5 +16/=21/-3 66.25%
Stockfish 140913 64 SSE4.2x - Komodo 5.1r2 64-bitnob 18.5 - 21.5 +8/=21/-11 46.25%

Time Control_2+2

Stockfish 140913 64 SSE4.2x - Critter 1.6a 64-bitnob_4 23.5 - 16.5 +12/=23/-5 58.75%
Stockfish 140913 64 SSE4.2x - Houdini 3 Pro x64_4 19.0 - 21.0 +11/=16/-13 47.50%
Stockfish 140913 64 SSE4.2x - Komodo 5.1r2 64-bitnob 28.5 - 11.5 +21/=15/-4 71.25%

240 Games X 4 = http://www.mediafire.com/?4wjwfx44y39y4w9
Score using 4 cores= 138.0-102.0 = 57.50%

Segmenting the result by Time Control:

Fixed = 137.5-102.5 = 57.29%
Incremental = 138.5-101.5 = 57.71%

Global Score: 276.0-204.0 = 57.50%
Against Critter 1.6a (3093): 61.25% Houdini 3.0 Pro (3172): 55.00% Komodo 5.1r2 (3135): 56.25%

Average ELO of opponents= 3.133
Estimated ELO Performance= 3.185


This a new BEST SCORE for Stockfish in my tests.

Around 13 ELO points ahead of Houdini 3.0 Pro. Simply impressive. If you have some time, please give a look randomly to the games.

Best regards,

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Timestamps of Stockfish..SF_0308 - Komodo 51MP 58%

Post by Tomcass »

Stockfish 160913 = 480 GAMES

Bench: 3884409 Timestamp: 1379368777

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases
Hash 512
Relative Speed: 28.66
Knodes per second: 13.759

Time Control_4+0

Stockfish 160913 64 SSE4.2x - Critter 1.6a 64-bit_NOB 23.0 - 17.0 +12/=22/-6 57.50%
Stockfish 160913 64 SSE4.2x - Houdini 3 Pro x64_6 17.5 - 22.5 +7/=21/-12 43.75%
Stockfish 160913 64 SSE4.2x - Komodo 5.1r2 64-bitx6nob 24.5 - 15.5 +14/=21/-5 61.25%

Time Control_2+2

Stockfish 160913 64 SSE4.2x - Critter 1.6a 64-bit_NOB 21.5 - 18.5 +10/=23/-7 53.75%
Stockfish 160913 64 SSE4.2x - Houdini 3 Pro x64_6 19.5 - 20.5 +6/=27/-7 48.75%
Stockfish 160913 64 SSE4.2x - Komodo 5.1r2 64-bitx6nob 24.5 - 15.5 +16/=17/-7 61.25%

240 Games X6 = http://www.mediafire.com/?w509d7qdt4kq46u
Score using 6 cores = 130.5-109.5 = 54.37%

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control_4+0

Stockfish 160913 64 SSE4.2x - Critter 1.6a 64-bitnob_4 21.0 - 19.0 +9/=24/-7 52.50%
Stockfish 160913 64 SSE4.2x - Houdini 3 Pro x64_4 17.0 - 23.0 +6/=22/-12 42.50%
Stockfish 160913 64 SSE4.2x - Komodo 5.1r2 64-bitnob 20.0 - 20.0 +8/=24/-8 50.00%

Time Control_2+2

Stockfish 160913 64 SSE4.2x - Critter 1.6a 64-bitnob_4 27.0 - 13.0 +16/=22/-2 67.50%
Stockfish 160913 64 SSE4.2x - Houdini 3 Pro x64_4 21.5 - 18.5 +10/=23/-7 53.75%
Stockfish 160913 64 SSE4.2x - Komodo 5.1r2 64-bitnob 22.0 - 18.0 +13/=18/-9 55.00%

240 Games X 4 = http://www.mediafire.com/?cd124oche6dwb1p
Score using 4 cores = 128.5 – 111.5 = 53.54%

Segmenting the result by Time Control:

Fixed = 123.0-117.0 = 51.25%
Incremental = 136.0-104.0 = 56.67%

Global Score: 259.0-221.0 = 53.96%
Against Critter 1.6a (3093): 57.81% Houdini 3.0 Pro (3172): 47.18% Komodo 5.1r2 (3135): 56.87%
Average ELO of opponents= 3.133
Estimated ELO Performance= 3.161


Regards,

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Timestamps of Stockfish..SF_0308 - Komodo 51MP 58%

Post by Tomcass »

Stockfish 230913 = 480 GAMES

Bench: 3529630 Timestamp: 1379916703

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases
Hash 512
Relative Speed: 28.66
Knodes per second: 13.759

Time Control_4+0

Stockfish 230913 64 SSE4.2x - Critter 1.6a 64-bit_NOB 23.5 - 16.5 +11/=25/-4 58.75%
Stockfish 230913 64 SSE4.2x - Houdini 3 Pro x64_6 20.0 - 20.0 +10/=20/-10 50.00%
Stockfish 230913 64 SSE4.2x - Komodo 5.1r2 64-bitx6nob 22.5 - 17.5 +11/=23/-6 56.25%

Time Control_2+2
Stockfish 230913 64 SSE4.2x - Critter 1.6a 64-bit_NOB 19.0 - 21.0 +8/=22/-10 47.50%
Stockfish 230913 64 SSE4.2x - Houdini 3 Pro x64_6 22.5 - 17.5 +11/=23/-6 56.25%
Stockfish 230913 64 SSE4.2x - Komodo 5.1r2 64-bitx6nob 21.0 - 19.0 +8/=26/-6 52.50%

240 Games X6 = http://www.mediafire.com/?xdes6oxc6ww698x
Score using 6 cores = 128.5-111.5 = 53.54%

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control_4+0

Stockfish 230913 64 SSE4.2_ - Critter 1.6a 64-bitnob_4 20.5 - 19.5 +10/=21/-9 51.25%
Stockfish 230913 64 SSE4.2_ - Houdini 3 Pro x64_4 20.5 - 19.5 +13/=15/-12 51.25%
Stockfish 230913 64 SSE4.2_ - Komodo 5.1r2 64-bitnob 21.5 - 18.5 +11/=21/-8 53.75%

Time Control_2+2
Stockfish 230913 64 SSE4.2_ - Critter 1.6a 64-bitnob_4 26.0 - 14.0 +17/=18/-5 65.00%
Stockfish 230913 64 SSE4.2_ - Houdini 3 Pro x64_4 19.0 - 21.0 +10/=18/-12 47.50%
Stockfish 230913 64 SSE4.2_ - Komodo 5.1r2 64-bitnob 19.5 - 20.5 +8/=23/-9 48.75%

240 Games X4 = http://www.mediafire.com/?gg3q4sugqme0lua


Score using 4 cores = 127.0 – 113.0 = 52.92%

Segmenting the result by Time Control:

Fixed = 128.5-111.5 = 53.54%
Incremental = 127.0-113.0 = 52.92%

Global Score: 255.5-224.5 = 53.23%

Against Critter 1.6a (3093): 55.62% Houdini 3.0 Pro (3172): 51.25% Komodo 5.1r2 (3135): 52.81%

Average ELO of opponents= 3.133
Estimated ELO Performance= 3.156


Good but not great performance for Stockfish in the two latest development versions. I will retest the best performing version in my tests so far: 140913. Bench: 3846852 Timestamp: 1379156917. Let’s try to reduce the statistical noise.

Regards,

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Timestamps of Stockfish..SF_0308 - Komodo 51MP 58%

Post by Tomcass »

In an attempt to minimize the statistical noise, I have retested SH 140913 version.

Stockfish 140913 = 480 GAMES (Second test)

Bench: 3846852 Timestamp: 1379156917

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases
Hash 512
Relative Speed: 28.66
Knodes per second: 13.759

Time Control_4+0

Stockfish 140913 64 SSE4.2_ - Critter 1.6a 64-bit_NOB 25.0 - 15.0 +15/=20/-5 62.50%
Stockfish 140913 64 SSE4.2_ - Houdini 3 Pro x64_6 20.0 - 20.0 +9/=22/-9 50.00%
Stockfish 140913 64 SSE4.2_ - Komodo 5.1r2 64-bitx6nob 21.0 - 19.0 +8/=26/-6 52.50%

Time Control_2+2

Stockfish 140913 64 SSE4.2_ - Critter 1.6a 64-bit_NOB 27.5 - 12.5 +16/=23/-1 68.75%
Stockfish 140913 64 SSE4.2_ - Houdini 3 Pro x64_6 20.5 - 19.5 +12/=17/-11 51.25%
Stockfish 140913 64 SSE4.2_ - Komodo 5.1r2 64-bitx6nob 22.5 - 17.5 +10/=25/-5 56.25%

240 Games X6 = http://www.mediafire.com/?w6fo2upgf52ujzp
Score using 6 cores = 136.5-103.5 = 56.87%

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control_4+0

Stockfish 140913 64 SSE4.2x - Critter 1.6a 64-bitnob_4 22.0 - 18.0 +9/=26/-5 55.00%
Stockfish 140913 64 SSE4.2x - Houdini 3 Pro x64_4 21.0 - 19.0 +9/=24/-7 52.50%
Stockfish 140913 64 SSE4.2x - Komodo 5.1r2 64-bitnob 20.5 - 19.5 +13/=15/-12 51.25%

Time Control_2+2

Stockfish 140913 64 SSE4.2x - Critter 1.6a 64-bitnob_4 26.0 - 14.0 +17/=18/-5 65.00%
Stockfish 140913 64 SSE4.2x - Houdini 3 Pro x64_4 19.5 - 20.5 +11/=17/-12 48.75%
Stockfish 140913 64 SSE4.2x - Komodo 5.1r2 64-bitnob 19.0 - 21.0 +9/=20/-11 47.50%

240 Games X4 = http://www.mediafire.com/?f9xwptv355ma0mh
Score using 4 Cores = 128.0-112.0 = 53.33%

Segmenting the result by Time Control:

Fixed = 129.5-110.5 = 53.96%
Incremental = 135.0-105.0 = 56.25%


Global Score: 264.5-215.5 = 55.10%

Against Critter 1.6a (3093): 62.81% Houdini 3.0 Pro (3172): 50.62% Komodo 5.1r2 (3135): 51.87%

Average ELO of opponents= 3.133
Estimated ELO Performance= 3.169


--------------------------------------

Summary of tests 1 and 2 of 140913 Version = 960 games

Global Score= 540.5-419.5 = 56.30%
Against Critter 1.6a (3093): 62.03% Houdini 3.0 Pro (3172): 52.81% Komodo 5.1r2 (3135): 54.06%

Average ELO of Opponents= 3.133
Estimated ELO performance= 3.177



Still above Houdini 3.0 after 960 games. I have just started the third and last 480 games test of this version. The strongest one of Stockfish in my tests till now.

Regards,

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Timestamps of Stockfish..SF_0308 - Komodo 51MP 58%

Post by Tomcass »

... and this is the third and latest test for this version:

Stockfish 140913 = 480 GAMES (Third test)

Bench: 3846852 Timestamp: 1379156917

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases
Hash 512
Relative Speed: 28.66
Knodes per second: 13.759

Time Control_4+0

Stockfish 140913 64 SSE4.2_ - Critter 1.6a 64-bit_NOB 21.0 - 19.0 +9/=24/-7 52.50%
Stockfish 140913 64 SSE4.2_ - Houdini 3 Pro x64_6 25.5 - 14.5 +15/=21/-4 63.75%
Stockfish 140913 64 SSE4.2_ - Komodo 5.1r2 64-bitx6nob 23.0 - 17.0 +14/=18/-8 57.50%

Time Control_2+2

Stockfish 140913 64 SSE4.2_ - Critter 1.6a 64-bit_NOB 25.0 - 15.0 +13/=24/-3 62.50%
Stockfish 140913 64 SSE4.2_ - Houdini 3 Pro x64_6 19.5 - 20.5 +10/=19/-11 48.75%
Stockfish 140913 64 SSE4.2_ - Komodo 5.1r2 64-bitx6nob 21.0 - 19.0 +9/=24/-7 52.50%

240 Games X6 = http://www.mediafire.com/?pvhwqy6wre7r8v1
Score using 6 cores = 135.0-105.0 = 56.25%

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control_4+0

Stockfish 140913 64 SSE4.2x - Critter 1.6a 64-bitnob_4 22.5 - 17.5 +12/=21/-7 56.25%
Stockfish 140913 64 SSE4.2x - Houdini 3 Pro x64_4 19.5 - 20.5 +8/=23/-9 48.75%
Stockfish 140913 64 SSE4.2x - Komodo 5.1r2 64-bitnob 23.0 - 17.0 +12/=22/-6 57.50%

Time Control_2+2

Stockfish 140913 64 SSE4.2x - Critter 1.6a 64-bitnob_4 24.0 - 16.0 +12/=24/-4 60.00%
Stockfish 140913 64 SSE4.2x - Houdini 3 Pro x64_4 20.0 - 20.0 +12/=16/-12 50.00%
Stockfish 140913 64 SSE4.2x - Komodo 5.1r2 64-bitnob 22.0 - 18.0 +11/=22/-7 55.00%

240 Games X4 = http://www.mediafire.com/?2ef94ux5gjw5aij
Score using 4 Cores = 131.0-109.0 = 54.58%

Segmenting the result by Time Control:

Fixed = 134.5-105.5 = 56.04%
Incremental = 131.5-108.5 = 54.79%


Global Score: 266.0-214.0= 55.42%
Against Critter 1.6a (3093): 57.81% Houdini 3.0 Pro (3172): 52.81% Komodo 5.1r2 (3135): 55.62%

Average ELO of opponents= 3.133
Estimated ELO Performance= 3.171


-----------------------

Summary of tests 1 , 2 and 3 = 1.440 games

Global Score= 806.5-633.5 = 56.01%
Against Critter 1.6a (3093): 60.62% Houdini 3.0 Pro (3172): 52.81% Komodo 5.1r2 (3135): 54.58%

Average ELO of Opponents= 3.133
Estimated ELO performance= 3,175


-------------------------

After three tests including 1.440 games, Stockfish 140913 remains somewhat ahead of Houdini 3.0 Pro. Only 3 Elo points in the global estimate (Not relevant. Still within the statistical noise range, despite the number of games), but a more relevant 52.81% score after the 480 games played one–to-one. What a pleasure watching these top level games!.

Under my test settings environment, I can confirm that this is the best Stockfish version so far. I am sure that new improvements will appear soon. Well done, Stockfish TEAM!. :D

Regards,

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Timestamps of Stockfish..SF_0308 - Komodo 51MP 58%

Post by Tomcass »

Stockfish 280913 = 480 GAMES

Bench: 3172206 Timestamp: 1380376079

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases
Hash 512
Relative Speed: 28.66
Knodes per second: 13.759

Time Control_4+0

Stockfish 280913 64 SSE4.2x - Critter 1.6a 64-bit_NOB 24.5 - 15.5 +12/=25/-3 61.25%
Stockfish 280913 64 SSE4.2x - Houdini 3 Pro x64_6 20.0 - 20.0 +8/=24/-8 50.00%
Stockfish 280913 64 SSE4.2x - Komodo 5.1r2 64-bitx6nob 23.0 - 17.0 +12/=22/-6 57.50%

Time Control_2+2

201309SF280913ST66_2+2_120games 2013

Stockfish 280913 64 SSE4.2x - Critter 1.6a 64-bit_NOB 21.0 - 19.0 +9/=24/-7 52.50%
Stockfish 280913 64 SSE4.2x - Houdini 3 Pro x64_6 22.5 - 17.5 +11/=23/-6 56.25%
Stockfish 280913 64 SSE4.2x - Komodo 5.1r2 64-bitx6nob 20.5 - 19.5 +9/=23/-8 51.25%

240 Games X 6 Cores = http://www.mediafire.com/?z791k4c62fanid6
Score using 6 cores = 131.5-108.5 = 54.79%

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control_4+0

Stockfish 280913 64 SSE4.2x - Critter 1.6a 64-bitnob_4 24.0 - 16.0 +12/=24/-4 60.00%
Stockfish 280913 64 SSE4.2x - Houdini 3 Pro x64_4 22.5 - 17.5 +10/=25/-5 56.25%
Stockfish 280913 64 SSE4.2x - Komodo 5.1r2 64-bitnob 22.0 - 18.0 +11/=22/-7 55.00%

Time Control_2+2

Stockfish 280913 64 SSE4.2x - Critter 1.6a 64-bitnob_4 19.0 - 21.0 +8/=22/-10 47.50%
Stockfish 280913 64 SSE4.2x - Houdini 3 Pro x64_4 17.0 - 23.0 +5/=24/-11 42.50%
Stockfish 280913 64 SSE4.2x - Komodo 5.1r2 64-bitnob 22.5 - 17.5 +12/=21/-7 56.25%

http://www.mediafire.com/?saf5mb2c8s01nao
Score using 4 Cores = 127.0-113.0 = 52.92%

Segmenting the result by Time Control:

Fixed = 136.0-104.0 = 56.67%
Incremental = 122.5-117.5 = 51.04%


Global Score: 258.5-221.5= 53.86%
Against Critter 1.6a (3093): 55.31% Houdini 3.0 Pro (3172): 51.25% Komodo 5.1r2 (3135): 55.00%

Average ELO of opponents= 3.133
Estimated ELO Performance= 3.160


This estimated ELO performance is around 15 points below the best score obtained by Version 140913.

Regards,

Tom.
kranium
Posts: 2129
Joined: Thu May 29, 2008 10:43 am

Re: Timestamps of Stockfish..SF_0308 - Komodo 51MP 58%

Post by kranium »

a big thx Tom...
for all your hard work and expert testing of all these Stockfish dev versions!
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Timestamps of Stockfish..SF_0308 - Komodo 51MP 58%

Post by Tomcass »

Thanks for your kind words, Norman. I am delighted to test the brilliant improvements of the Stockfish team. An also a BIG THANKS to you for your work at the origin of all this great development. :-)

Best regards from Barcelona.

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Timestamps of Stockfish..SF_0308 - Komodo 51MP 58%

Post by Tomcass »

Stockfish 290913 (PeterPan compile) = 480 GAMES

This time my test is of a compile from PeterPan. According to his words:

“ The source is here ->https://github.com/mcostalba/Stockfish/commits/master
Add to that the source from here -> https://github.com/syzygy1/Stockfish
Mix it all together,cook for 5 minutes,and you have the compile. “ ;-)

RTB not installed yet in my computers.

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases
Hash 512
Relative Speed: 28.66
Knodes per second: 13.759

Time Control_4+0

Stockfish 290913 64 SSE4.2p - Critter 1.6a 64-bit_NOB 24.0 - 16.0 +13/=22/-5 60.00%
Stockfish 290913 64 SSE4.2p - Houdini 3 Pro x64_6 21.0 - 19.0 +14/=14/-12 52.50%
Stockfish 290913 64 SSE4.2p - Komodo 5.1r2 64-bitx6nob 26.0 - 14.0 +16/=20/-4 65.00%

Time Control_2+2

Stockfish 290913 64 SSE4.2p - Critter 1.6a 64-bit_NOB 23.5 - 16.5 +13/=21/-6 58.75%
Stockfish 290913 64 SSE4.2p - Houdini 3 Pro x64_6 17.5 - 22.5 +6/=23/-11 43.75%
Stockfish 290913 64 SSE4.2p - Komodo 5.1r2 64-bitx6nob 22.0 - 18.0 +13/=18/-9 55.00%

240 Games X 6 Cores = http://www.mediafire.com/?2m8kabpz2vluncm
Score using 6 cores = 134.0-106.0= 55.83%

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899

Time Control_4+0

Stockfish 290913 64 SSE4.2x - Critter 1.6a 64-bitnob_4 25.5 - 14.5 +15/=21/-4 63.75%
Stockfish 290913 64 SSE4.2x - Houdini 3 Pro x64_4 18.5 - 21.5 +8/=21/-11 46.25%
Stockfish 290913 64 SSE4.2x - Komodo 5.1r2 64-bitnob 22.0 - 18.0 +11/=22/-7 55.00%

Time Control_2+2
Stockfish 290913 64 SSE4.2x - Critter 1.6a 64-bitnob_4 23.0 - 17.0 +12/=22/-6 57.50%
Stockfish 290913 64 SSE4.2x - Houdini 3 Pro x64_4 18.5 - 21.5 +7/=23/-10 46.25%
Stockfish 290913 64 SSE4.2x - Komodo 5.1r2 64-bitnob 20.0 - 20.0 +7/=26/-7 50.00%

240 Games X 4 Cores = http://www.mediafire.com/?c3szkbofql91euj
Score using 4 Cores = 127.5-112.5 = 53.12%

Segmenting the result by Time Control:

Fixed = 137.0-103.0 = 57.08%
Incremental = 124.5-115.5 = 51.87%


Global Score: 261.5-218.5= 54.48%
Against Critter 1.6a (3093): 60.00% Houdini 3.0 Pro (3172): 47.19% Komodo 5.1r2 (3135): 56.25%

Average ELO of opponents= 3.133
Estimated ELO Performance= 3.164


Thank you very much Izak! This is a very nice try. Only about 11 Elo points below the best score. (Please note that I have not allowed yet Large Pages as you suggested).

Regards,

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: Timestamps of Stockfish..SF_0308 - Komodo 51MP 58%

Post by Tomcass »

STOCKFISH 01102013 - IPMAN COMPILE = 480 Games.

This time my test is of a compile from another friend: Ipman.

The source is here : https://github.com/mcostalba/Stockfish/commits/master

i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases. RTB not installed yet in my computers.
Hash 512
Large Pages ALLOWED
Relative Speed: 28.66
Knodes per second: 13.759

Time Control_4+0

Stockfish 011013 64 SSE4.2I - Critter 1.6a 64-bit_NOB 24.0 - 16.0 +14/=20/-6 60.00%
Stockfish 011013 64 SSE4.2I - Houdini 3 Pro x64_6 20.5 - 19.5 +9/=23/-8 51.25%
Stockfish 011013 64 SSE4.2I - Komodo 5.1r2 64-bitx6nob 22.5 - 17.5 +9/=27/-4 56.25%

Time Control_2+2

Stockfish 011013 64 SSE4.2I - Critter 1.6a 64-bit_NOB 24.0 - 16.0 +11/=26/-3 60.00%
Stockfish 011013 64 SSE4.2I - Houdini 3 Pro x64_6 21.5 - 18.5 +10/=23/-7 53.75%
Stockfish 011013 64 SSE4.2I - Komodo 5.1r2 64-bitx6nob 22.0 - 18.0 +11/=22/-7 55.00%

240 Games X 6 Cores = http://www.mediafire.com/?am5vz63oaj02i86
Score using 6 cores = 134.5-105.5 = 56.04%

i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2012c
No tablebases
Hash 256
Large Pages ALLOWED
Relative Speed: 20.62
Knodes per second: 9.899

Time Control_4+0

Stockfish 011013 64 SSE4.2I - Critter 1.6a 64-bitnob_4 22.5 - 17.5 +10/=25/-5 56.25%
Stockfish 011013 64 SSE4.2I - Houdini 3 Pro x64_4 23.0 - 17.0 +13/=20/-7 57.50%
Stockfish 011013 64 SSE4.2I - Komodo 5.1r2 64-bitnob 23.5 - 16.5 +11/=25/-4 58.75%

Time Control_2+2

Stockfish 011013 64 SSE4.2I - Critter 1.6a 64-bitnob_4 23.0 - 17.0 +13/=20/-7 57.50%
Stockfish 011013 64 SSE4.2I - Houdini 3 Pro x64_4 22.0 - 18.0 +10/=24/-6 55.00%
Stockfish 011013 64 SSE4.2I - Komodo 5.1r2 64-bitnob 25.5 - 14.5 +13/=25/-2 63.75%

240 Games X 4 Cores = http://www.mediafire.com/?9scgvsgrnec4avx
Score using 4 Cores = 139.5-100.5 = 58.12%

Segmenting the result by Time Control:

Fixed = 136.0-104.0 = 56.67%
Incremental = 138.0-102.0 = 57.50%

Global Score: 274.0-206.0 = 57.08%
Against Critter 1.6a (3093): 58.44% Houdini 3.0 Pro (3172): 54.37% Komodo 5.1r2 (3135): 58.44%

Average ELO of opponents= 3.133
Estimated ELO Performance= 3.183


This is an EXCELLENT performance, with an Estimated ELO 11 points better than Houdini 3.0 Pro and a clear win in the four face-to-face legs. I will keep testing this compile until 1.440 games, to minimize the statistical noise.

Congratulations again to Stockfish Team for their great work. And thanks to Ipman for this fast compile. I find all this Stockfish development really fascinating.

Regards,

Tom.