Testing Stockfish 11-03-13. 480 Games.

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

Jouni
Posts: 3283
Joined: Wed Mar 08, 2006 8:15 pm

Re: For Tom- or Maybe Anyone Who Knows!!

Post by Jouni »

You are simply re-testing 221215 version :) .
Jouni
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: For Tom- or Maybe Anyone Who Knows!!

Post by Tomcass »

Jouni wrote:You are simply re-testing 221215 version :) .
Hi, Jouni. Thanks for your comment.

I am obviously conscious that SF Development 221215 and Stockfish7 Beta1 have the same Bench: 8355485.

But the score of this two engines is very different. You can see it in my next post. After 2400 games, 1920 + 480, the output is substantially different. I will keep testing Stockfish 7 Beta 1 to confirm or not if its performance is worse than SF Development 221215. Let's keep testing. :wink:

Regards from Barcelona,

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: For Tom- or Maybe Anyone Who Knows!!

Post by Tomcass »

TESTING STOCKFISH 7 BETA 1: 480 Games
Bench: 8355485
Second Leg: 240 Games at IncrementalTime control.

6 real cores
Ponder: Off.
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Time Control= 2+2
Stockfish 7Beta1 64 POPCNT_6 - Komodo 9.3 64-bit_ST_NOB_x6 16.0 – 14.0 +6/=20/-4 53.33%
Stockfish 7Beta1 64 POPCNT_6 - SugaR PrO v1.3 64 POPCNT_X6 14.0 - 16.0 +0/=28/-2 46.67%
Stockfish 7Beta1 64 POPCNT_6 - Houdini 4 Pro x64_Ct0_X6 19.5 - 10.5 +11/=17/-2 65.00%
Stockfish 7Beta1 64 POPCNT_6 - Gull 3 x64 XP_X6 19.5 - 10.5 +12/=15/-3 65.007%

Score after 120 games using 6 cores: 69.0 – 51.0 = 57.50%
120 Games: http://www.mediafire.com/download/3wyer9k83ayprbi

8 real cores
Ponder: Off
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 1024
Relative Speed: 53.22
Knodes per Second: 25.543

Time Control 2+2.
Stockfish 7Beta1 64 BMI2_8 - Komodo 9.3 64-bit_St_nob_X8 16.5 - 13.5 +9/=15/-6 55.00%
Stockfish 7Beta1 64 BMI2_8 - SugaR PrO v1.3 64 BMI2_X8 16.0 - 14.0 +3/=26/-1 53.33%
Stockfish 7Beta1 64 BMI2_8 - Houdini 4 Pro x64_Ct0_8 21.0 - 9.0 +14/=14/-2 70.00%
Stockfish 7Beta1 64 BMI2_8 - Gull 3 x64 XPx8 20.5 - 9.5 +12/=17/-1 68.33%

Score after 120 games using 8 cores= 74.0 – 46.0= 61.67%
120 Games: http://www.mediafire.com/download/ninc8mjcbkpb1cn/

GLOBAL SCORE FOR STOCKFISH 7 BETA1 AFTER 240 GAMES AT INCREMENTAL TIME CONTROL: 143.0 – 97.0 = 59.58%
AVERAGE ELO OF OPONENTS= 3.195
ESTIMATED ELO FOR SF DEVELOPMENT 221215= 3.262.

GLOBAL SCORE FOR STOCKFISH 7 BETA 1 AFTER 480 GAMES
286.5 – 193.5 = 59.69%
AVERAGE ELO OF OPONENTS= 3.195
ESTIMATED ELO FOR STOCKFISH 7 BETA 1 AFTER 480 GAMES= 3.26
3


Only as a reference I post the score by SF Development 221215:

GLOBAL SCORE FOR STOCKFISH DEVELOPMENT 221215 AFTER 1920 GAMES
1181 – 739 = 61.51%
AVERAGE ELO OF OPONENTS= 3.195
ESTIMATED ELO FOR SF DEVELOPMENT 221215= 3.276

Having the same Bench: 8355485, Stockfish7 Beta 1 has performed 13 Elo points below SF Development 221215. Although the number of games -2.400- is not big enough to conclude anything, I only try to give to the Stockfish Team -and the computer chess community- the scores and games I get. IMHO there is something wrong in Stockfish 7 Beta 1. I don’t know what, obviously. I am just a simple tester.

Let's test Stockfish7 Beta 2. :D

Regards,

Tom.
User avatar
Ozymandias
Posts: 1534
Joined: Sun Oct 25, 2009 2:30 am

Re: For Tom- or Maybe Anyone Who Knows!!

Post by Ozymandias »

Tomcass wrote:Stockfish7 Beta 1 has performed 13 Elo points below SF Development 221215. Although the number of games -2.400- is not big enough to conclude anything, I only try to give to the Stockfish Team -and the computer chess community- the scores and games I get. IMHO there is something wrong in Stockfish 7 Beta 1.
Still between the margin of error, anything is possible.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: For Tom- or Maybe Anyone Who Knows!!

Post by Tomcass »

Who knows, Juan? :D

Anyway I am pretty sure that Stockfish 7 Beta 1 is not at all the best option available. Here you have the score for SF7 Beta2 after 480 games at Fixed Time Control.

TESTING STOCKFISH 7 BETA 2. 960 GAMES
480 Games at Fixed Time control. Bench: 8355485


6 real cores
Ponder: Off.
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Time Control= 4+0
Stockfish 7Beta2 64 POPCNT_ - Komodo 9.3 64-bit_ST_NOB_x6 33.0 - 27.0 +14/=38/-8 55.00%
Stockfish 7Beta2 64 POPCNT_ - SugaR PrO v1.3 64 POPCNT_X6 29.5 - 30.5 +3/=53/-4 49.17%
Stockfish 7Beta2 64 POPCNT_ - Houdini 4 Pro x64_Ct0_X6 42.0 - 18.0 +27/=30/-3 70.00%
Stockfish 7Beta2 64 POPCNT_ - Gull 3 x64 XP_X6 43.5 - 16.5 +29/=29/-2 72.50%

Score after 240 games using 6 cores= 148.0 – 92.0 = 61.67%
240 Games = http://www.mediafire.com/download/sam4w4b8mffh9bd

8 real cores
Ponder: Off
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 1024
Relative Speed: 53.22
Knodes per Second: 25.543

Time Control: 4+0
Stockfish 7Beta2 64 BMI2_8 - Komodo 9.3 64-bit_St_nob_X8 32.5 - 27.5 +13/=39/-8 54.17%
Stockfish 7Beta2 64 BMI2_8 - SugaR PrO v1.3 64 BMI2_X8 30.0 - 30.0 +4/=52/-4 50.00%
Stockfish 7Beta2 64 BMI2_8 - Houdini 4 Pro x64_Ct0_8 43.5 - 16.5 +29/=29/-2 72.50%
Stockfish 7Beta2 64 BMI2_8 - Gull 3 x64 XPx8 41.5 - 18.5 +26/=31/-3 69.17%

Score after 240 games using 8 cores= 147.5 – 92.5 = 61.46%
240 games: http://www.mediafire.com/download/j4dtydntt11zw9a/

GLOBAL SCORE FOR STOCKFISH 7 BETA2 AFTER 480 GAMES AT FIXED TIME CONTROL: 295.5 – 182.5 = 61.56%
AVERAGE ELO OF OPONENTS= 3.195
ESTIMATED ELO FOR SF DEVELOPMENT 221215= 3.276


Stockfish Beta 2 has permormed much better -12 Elo Points- than SF Beta 1 at fixed Time Control. Its score is very similar to that of Stockfish Development 221215 (3278).

Let’s test it at Incremental Time Control.

Happy New Year 2016!!

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: For Tom- or Maybe Anyone Who Knows!!

Post by Tomcass »

TESTING STOCKFISH 7= 960 GAMES
Timestamp: 1451766362 Bench: 8355485

FIRST LEG: 480 GAMES AT FIXED TIME CONTROL
.


6 real cores
Ponder: Off.
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Time Control= 4+0

Stockfish 7 64 POPCNT_6 - Komodo 9.3 64-bit_nob_St_6 31.0 - 29.0 +13/=36/-11 51.67%
Stockfish 7 64 POPCNT_6 - SugaR PrO v1.3 64 POPCNT_ 29.5 - 30.5 +5/=49/-6 49.17%
Stockfish 7 64 POPCNT_6 - Houdini 4 Pro x64_St_Ct0_X6 38.5 - 21.5 +21/=35/-4 64.17%
Stockfish 7 64 POPCNT_6 - Gull 3 x64 XP_X6 42.0 - 18.0 +25/=34/-1 70.00%
Score after 240 games using 6 cores= 141.0 – 99.0= 58.75%
240 Games = http://www.mediafire.com/download/vkkcfebgbcwmk61

8 real cores
Ponder: Off
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 1024
Relative Speed: 53.22
Knodes per Second: 25.543

Time Control: 4+0
Stockfish 7 64 BMI2_X8 - Komodo 9.3 64-bit_St_nob_X8 30.0 - 30.0 +13/=34/-13 50.00%
Stockfish 7 64 BMI2_X8 - SugaR PrO v1.3 64 BMI2_X8 30.5 - 29.5 +3/=55/-2 50.83%
Stockfish 7 64 BMI2_X8 - Houdini 4 Pro x64_Ct0_8 41.0 - 19.0 +25/=32/-3 68.33%
Stockfish 7 64 BMI2_X8 - Gull 3 x64 BMI2_X8 43.0 - 17.0 +27/=32/-1 71.67%

Score after 240 games using 8 cores= 144.5 – 95.5 = 60.21%
240 Games= http://www.mediafire.com/download/dr6m9fe3e12ahu6

GLOBAL SCORE FOR STOCKFISH 7 AFTER 480 GAMES AT FIXED TIME CONTROL: 285.5 – 194,5= 59.48%

AVERAGE ELO OF OPONENTS= 3.195

ESTIMATED ELO FOR STOCKFISH 7 AT FIXED TIME CONTROL= 3.261


Regards,

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: For Tom- or Maybe Anyone Who Knows!!

Post by Tomcass »

TESTING STOCKFISH 7: 960 GAMES
SECOND LEG: 480 GAMES AT INCREMENTAL TIME CONTROL.


6 real cores
Ponder: Off.
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Time Control= 2+2
Stockfish 7 64 POPCNT_6 - Komodo 9.3 64-bit_nob_St_6 33.5 - 26.5 +12/=43/-5 55.83%
Stockfish 7 64 POPCNT_6 - SugaR PrO v1.3 64 POPCNT_ 30.0 - 30.0 +3/=54/-3 50.00%
Stockfish 7 64 POPCNT_6 - Houdini 4 Pro x64_St_Ct0_X6 41.5 - 18.5 +25/=33/-2 69.17%
Stockfish 7 64 POPCNT_6 - Gull 3 x64 XP_X6 44.5 - 15.5 +31/=27/-2 74.17%

Score after 240 games using 6 cores= 149.5 – 90.5= 62.29%
240 Games = http://www.mediafire.com/download/vesqxuyt61ntgco

8 real cores
Ponder: Off
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 1024
Relative Speed: 53.22
Knodes per Second: 25.543

Time Control: 2+2
Stockfish 7 64 BMI2_X8 - Komodo 9.3 64-bit_St_nob_X8 27.0 - 33.0 +5/=44/-11 45.00%
Stockfish 7 64 BMI2_X8 - SugaR PrO v1.3 64 BMI2_X8 30.0 - 30.0 +2/=56/-2 50.00%
Stockfish 7 64 BMI2_X8 - Houdini 4 Pro x64_Ct0_8 41.0 - 19.0 +23/=36/-1 68.33%
Stockfish 7 64 BMI2_X8 - Gull 3 x64 BMI2_X8 47.5 - 12.5 +37/=21/-2 79.17%

Score after 240 games using 8 cores= 145.5 – 94.5 = 60.62%
240 Games= http://www.mediafire.com/download/rgj45312bx4gupi

GLOBAL SCORE FOR STOCKFISH 7 AFTER 480 GAMES AT INCREMENTAL TIME CONTROL:
295.0 – 185.0= 61.46%
AVERAGE ELO OF OPONENTS= 3.195
ESTIMATED ELO FOR STOCKFISH 7 AT INCREMENTAL TIME CONTROL= 3.275

GLOBAL SCORE FOR STOCKFISH 7 AFTER 960 GAMES AT FIXED AND INCREMENTAL TIME CONTROL: 580.5 – 379.5 = 60.47%

Against Komodo 9.3 (3259) = 50.62% SugaR Pro v1.3 (3280)= 50.00% Houdini 4 Pro (3136)= 67.50% Gull 3XP (3103) = 73.75%

AVERAGE ELO OF OPONENTS= 3.195
ESTIMATED ELO FOR STOCKFISH 7= 3.268


The most surprising thing in this test is that for the first time Stockfish has performed much better at incremental time control (3275) than at fixed time control (3261).

NEW RANKING AFTER THIS TEST:

New ranking after this score:
1.- SugaR Pro v1.3= 3.280
2.- Stockfish 121115 IPMAN= 3.277
3.- Stockfish Development 221215 = 3.276
4.- Stockfish 7 = 3.268
5.- Stockfish 021115 KP= 3.267
6.- Komodo 9.3 = 3.259
7.- Komodo 9.2 = 3.251.
8.- Komodo 9.1= 3.247
9.- Stockfish 6= 3.219
10.- Komodo 9= 3.209
11.- Houdini 4= 3.136
12.- Gull 3 XP= 3.103

Regards,

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: For Tom- or Maybe Anyone Who Knows!!

Post by Tomcass »

TESTING STOCKFISH DEVELOPMENT 030116= 960 GAMES
Timestamp: 1451842416 Bench: 8603285

6 real cores
Ponder: Off.
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Fixed Time Control 4+0

Stockfish 030116 64 POPCNT_ - Komodo 9.3 64-bit_nob_St_6 17.0 - 13.0 +7/=20/-3 56.67%
Stockfish 030116 64 POPCNT_ - SugaR PrO v1.3 64 POPCNT_ 15.5 - 14.5 +3/=25/-2 51.67%
Stockfish 030116 64 POPCNT_ - Houdini 4 Pro x64_St_Ct0_X6 21.5 - 8.5 +14/=15/-1 71.67%
Stockfish 030116 64 POPCNT_ - Gull 3 x64 XP_X6 22.0 - 8.0 +15/=14/-1 73.33%

Stockfish 030116 64 POPCNT_ - Komodo 9.3 64-bit_nob_St_6 17.5 - 12.5 +7/=21/-2 58.33%
Stockfish 030116 64 POPCNT_ - SugaR PrO v1.3 64 POPCNT_ 14.0 - 16.0 +0/=28/-2 46.67%
Stockfish 030116 64 POPCNT_ - Houdini 4 Pro x64_St_Ct0_X6 22.0 - 8.0 +15/=14/-1 73.33%
Stockfish 030116 64 POPCNT_ - Gull 3 x64 XP_X6 20.0 - 10.0 +12/=16/-2 66.67%

Score after 240 Games at Fixed Time Control using 6 cores= 149.5 – 90.5 = 62.29%
240 Games: http://www.mediafire.com/download/2hkr25l4ry1efkk

Incremental Time Control 2+2

Stockfish 030116 64 POPCNT_ - Komodo 9.3 64-bit_nob_St_6 32.0 - 28.0 +15/=34/-11 53.33%
Stockfish 030116 64 POPCNT_ - SugaR PrO v1.3 64 POPCNT_ 29.5 - 30.5 +2/=55/-3 49.17%
Stockfish 030116 64 POPCNT_ - Houdini 4 Pro x64_St_Ct0_X6 42.0 - 18.0 +26/=32/-2 70.00%
Stockfish 030116 64 POPCNT_ - Gull 3 x64 XP_X6 42.0 - 18.0 +26/=32/-2 70.00%

Score after 240 Games at Incremental Time Control using 6 cores= 145.5 – 94.5= 60.62%
240 Games: http://www.mediafire.com/download/k16u2l7pb5iwtdi

8 real cores
Ponder: Off
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 1024
Relative Speed: 53.22
Knodes per Second: 25.543

Fixed Time Control 4+0
Stockfish 030116 64 BMI2_ - Komodo 9.3 64-bit_St_nob_X8 17.0 - 13.0 +5/=24/-1 56.67%
Stockfish 030116 64 BMI2_ - SugaR PrO v1.3 64 BMI2_X8 15.0 - 15.0 +1/=28/-1 50.00%
Stockfish 030116 64 BMI2_ - Houdini 4 Pro x64_Ct0_8 21.5 - 8.5 +14/=15/-1 71.67%
Stockfish 030116 64 BMI2_ - Gull 3 x64 BMI2_X8 23.0 - 7.0 +16/=14/-0 76.67%

Stockfish 030116 64 BMI2_ - Komodo 9.3 64-bit_St_nob_X8 16.5 - 13.5 +7/=19/-4 55.00%
Stockfish 030116 64 BMI2_ - SugaR PrO v1.3 64 BMI2_X8 14.5 - 15.5 +0/=29/-1 48.33%
Stockfish 030116 64 BMI2_ - Houdini 4 Pro x64_Ct0_8 21.5 - 8.5 +13/=17/-0 71.67%
Stockfish 030116 64 BMI2_ - Gull 3 x64 BMI2_X8 23.0 - 7.0 +16/=14/-0 76.67%

Score after 240 games at Fixed Time Control using 8 cores= 152.0 – 88.0= 63.33%
240 Games= http://www.mediafire.com/download/190z4wyj9qmob4l

Incremental Time Control 2+2

Stockfish 030116 64 BMI2_ - Komodo 9.3 64-bit_St_nob_X8 33.0 - 27.0 +14/=38/-8 55.00%
Stockfish 030116 64 BMI2_ - SugaR PrO v1.3 64 BMI2_X8 31.5 - 28.5 +3/=57/-0 52.50%
Stockfish 030116 64 BMI2_ - Houdini 4 Pro x64_Ct0_8 43.0 - 17.0 +28/=30/-2 71.67%
Stockfish 030116 64 BMI2_ - Gull 3 x64 BMI2_X8 40.0 - 20.0 +23/=34/-3 66.67%

Score after 240 games at Incremental Time Control using 8 cores= 147.5 – 92.5= 61.46%
240 Games= http://www.mediafire.com/download/2qurdkfxut8edw8/

GLOBAL SCORE FOR STOCKFISH DEV. 030116 AFTER 960 GAMES AT FIXED AND INCREMENTAL TIME CONTROL: 594.5 – 365.5 = 61.93%

Against Komodo 9.3 (3259) = 55.42% SugaR Pro v1.3 (3280)= 50.00% Houdini 4 Pro (3136)= 71.46% Gull 3XP (3103) = 70.83%

AVERAGE ELO OF OPONENTS= 3.195
ESTIMATED ELO FOR STOCKFISH DEV 030116= 3.278

This score is 10 elo points better than Stockfish 7 -previous post- under the same testing conditions and after 960 games each.

Regards,
Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: For Tom- or Maybe Anyone Who Knows!!

Post by Tomcass »

TESTING STOCKFISH 150116 IPMAN: 960 GAMES

6 real cores
Ponder: Off.
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Time Control 4+0
SF 150116IP 64 POPCNT_ - Komodo 9.3 64-bit_nob_St_6 32.5 - 27.5 +14/=37/-9 54.17%
SF 150116IP 64 POPCNT_ - SugaR 2.0 64 POPCNT_X6 29.5 - 30.5 +4/=51/-5 49.17%
SF 150116IP 64 POPCNT_ - Houdini 4 Pro x64_St_Ct0_X6 47.0 - 13.0 +35/=24/-1 78.33%
SF 150116IP 64 POPCNT_ - Gull 3 x64 XP_X6 43.0 - 17.0 +29/=28/-3 71.67%

Time Control 2+2
SF 150116IP 64 POPCNT_ - Komodo 9.3 64-bit_nob_St_6 31.5 - 28.5 +11/=41/-8 52.50%
SF 150116IP 64 POPCNT_ - SugaR 2.0 64 POPCNT_X6 28.5 - 31.5 +2/=53/-5 47.50%
SF 150116IP 64 POPCNT_ - Houdini 4 Pro x64_St_Ct0_X6 45.5 - 14.5 +32/=27/-1 75.83%
SF 150116IP 64 POPCNT_ - Gull 3 x64 XP_X6 44.0 - 16.0 +28/=32/-0 73.33%

Score after 480 games using 6 cores= 301.5 – 178.5 = 62.81%
480 Games = http://www.mediafire.com/download/paipw3xjw1pkr5b/

8 real cores
Ponder: Off
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 1024
Relative Speed: 53.22
Knodes per Second: 25.543

Time Control 4+0
SF 150116IP 64 BMI2_ - Komodo 9.3 64-bit_St_nob_X8 35.0 - 25.0 +15/=40/-5 58.33%
SF 150116IP 64 BMI2_ - SugaR 2.0 64 BMI2_X8 28.5 - 31.5 +3/=51/-6 47.50%
SF 150116IP 64 BMI2_ - Houdini 4 Pro x64_Ct0_8 43.5 - 16.5 +30/=27/-3 72.50%
SF 150116IP 64 BMI2_ - Gull 3 x64 BMI2_X8 43.5 - 16.5 +28/=31/-1 72.50%

Time Control 2+2
SF 150116IP 64 BMI2_ - Komodo 9.3 64-bit_St_nob_X8 33.5 - 26.5 +12/=43/-5 55.83%
SF 150116IP 64 BMI2_ - SugaR 2.0 64 BMI2_X8 32.0 - 28.0 +6/=52/-2 53.33%
SF 150116IP 64 BMI2_ - Houdini 4 Pro x64_Ct0_8 43.5 - 16.5 +27/=33/-0 72.50%
SF 150116IP 64 BMI2_ - Gull 3 x64 BMI2_X8 37.5 - 22.5 +17/=41/-2 62.50%

Score after 480 games using 8 cores= 297.5 – 182.5 = 61.98%
480 Games= http://www.mediafire.com/download/jj9v31k66skkhlq/

Global score for Stockfish 150116 IPMAN after 960 games = 599.0 – 361.0 = 62.40%

Against: Komodo 9.3 (3259): 55.21% - SugaR 2.0 (3.285): 49.38% - Houdini 4 (3136): 74.79% - Gull3 XP (3103) : 70.00%

Average Elo of Oponents= 3196
Estimated Elo for Stockfish 150116 IPMAN = 3.283


This is a very good score, only 2 ELO points below the current leader SugaR 2.0. Well done, Ipman!. :wink:


New ranking after this score:

1.- SugaR 2.0= 3.285
2.- Stockfish Development 150116 IPMAN= 3.283
3.- SugaR Pro v1.3= 3.280
4.- Stockfish Development 221215 = 3.276
5.- Stockfish 7 = 3.268
6.- Komodo 9.3 = 3.259
7.- Komodo 9.2 = 3.251.
8.- Komodo 9.1= 3.247
9.- Stockfish 6= 3.219
10.- Komodo 9= 3.209
11.- Houdini 4= 3.136
12.- Gull 3 XP= 3.103

Regards,

Tom.
Tomcass
Posts: 786
Joined: Sun Apr 16, 2006 9:09 pm

Re: For Tom- or Maybe Anyone Who Knows!!

Post by Tomcass »

TESTING STOCKFISH DEVELOPMENT 200116= 960 GAMES

Timestamp: 1453303461 Bench: 7751425

6 real cores
Ponder: Off.
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 512
Relative Speed: 29.54
Knodes per second: 14.177

Fixed Time Control 4+0

Stockfish 200116 64 POPCNT_6 - Komodo 9.3 64-bit_nob_St_6 36.0 - 24.0 +15/=42/-3 60.00%
Stockfish 200116 64 POPCNT_6 - SugaR 2.0 64 POPCNT_X6 30.5 - 29.5 +4/=53/-3 50.83%
Stockfish 200116 64 POPCNT_6 - Houdini 4 Pro x64_St_Ct0_X6 41.5 - 18.5 +25/=33/-2 69.17%
Stockfish 200116 64 POPCNT_6 - Gull 3 x64 XP_X6 41.5 - 18.5 +26/=31/-3 69.17%

Incremental Time Control 2+2

Stockfish 200116 64 POPCNT_6 - Komodo 9.3 64-bit_nob_St_6 36.0 - 24.0 +19/=34/-7 60.00%
Stockfish 200116 64 POPCNT_6 - SugaR 2.0 64 POPCNT_X6 29.5 - 30.5 +3/=53/-4 49.17%
Stockfish 200116 64 POPCNT_6 - Houdini 4 Pro x64_St_Ct0_X6 40.5 - 19.5 +23/=35/-2 67.50%
Stockfish 200116 64 POPCNT_6 - Gull 3 x64 XP_X6 45.5 - 14.5 +31/=29/-0 75.83%

Score after 480 Games using 6 cores= 301.0 – 179.0= 61.43%
480 Games: http://www.mediafire.com/download/mkwbly2251y3cbo

8 real cores
Ponder: Off
GUI: Fritz 14
Book: Perfect 2014c – Limit 5 moves. Sedat –
No tablebases. No RTB used.
Hash 1024
Relative Speed: 53.22
Knodes per Second: 25.543


Fixed Time Control 4+0

Stockfish 200116 64 BMI2_8 - Komodo 9.3 64-bit_St_nob_X8 37.0 - 23.0 +21/=32/-7 61.67%
Stockfish 200116 64 BMI2_8 - SugaR 2.0 64 BMI2_X8 28.0 - 32.0 +3/=50/-7 46.67%
Stockfish 200116 64 BMI2_8 - Houdini 4 Pro x64_Ct0_8 41.5 - 18.5 +27/=29/-4 69.17%
Stockfish 200116 64 BMI2_8 - Gull 3 x64 BMI2_X8 42.0 - 18.0 +24/=36/-0 70.00%

Incremental Time Control 2+2

Stockfish 200116 64 BMI2_8 - Komodo 9.3 64-bit_St_nob_X8 34.0 - 26.0 +16/=36/-8 56.67%
Stockfish 200116 64 BMI2_8 - SugaR 2.0 64 BMI2_X8 31.5 - 28.5 +5/=53/-2 52.50%
Stockfish 200116 64 BMI2_8 - Houdini 4 Pro x64_Ct0_8 39.5 - 20.5 +21/=37/-2 65.83%
Stockfish 200116 64 BMI2_8 - Gull 3 x64 BMI2_X8 41.5 - 18.5 +24/=35/-1 69.17%

Score after 480 games using 8 cores= 295.0 – 185.0= 62.08%
480 Games= http://www.mediafire.com/download/kg3l4n4v6oe5o54

GLOBAL SCORE FOR STOCKFISH DEV. 200116 AFTER 960 GAMES AT FIXED AND INCREMENTAL TIME CONTROL: 596.0 – 364.0 = 61.93%

Against Komodo 9.3 (3259) = 59.58% SugaR 2.0 (3285)= 49.79% Houdini 4 Pro (3136)= 67.92% Gull 3XP (3103) = 71.04%

AVERAGE ELO OF OPONENTS= 3.196
ESTIMATED ELO FOR STOCKFISH Dev. 200116= 3.281


RANKING OF SELECTED ENGINES

1.- SugaR 2.0= 3.285
2.- Stockfish Development 150116 IPMAN= 3.283
3.- Stockfish Development 200116 = 3.281
4.- SugaR Pro v1.3= 3.280
5.- Stockfish 7 = 3.268
6.- Komodo 9.3 = 3.259
7.- Komodo 9.2 = 3.251.
8.- Komodo 9.1= 3.247
9.- Stockfish 6= 3.219
10.- Komodo 9= 3.209
11.- Houdini 4= 3.136
12.- Gull 3 XP= 3.103

Regards,

Tom.