Page 1 of 5

TCEC Season 6 - Stage 4 now live

Posted: Thu May 01, 2014 5:05 pm
by Martin Thoresen
Congratulations to Stockfish, Houdini, Critter and Komodo for qualifying for Stage 4 after Stage 3 ended yesterday.

Stage 4:
16 cores, ponder off.
Up to 16 GB hash.
Time control is 120' + 30".
Hexadeca round robin, 96 games.
Top 2 qualifies for the Superfinal.

http://tcec.chessdom.com/live.php

Full rules can be read on the TCEC website, click "Help" in the top menu then "Rules & Information".

Finished games can be viewed and downloaded in the Archive page:
http://tcec.chessdom.com/archive.php

Code: Select all

N Engine           Rtng Pts Gm   SB St Ko Cr Ho

 1 Stockfish 300414 3157 0.0  0 0.00 ··         
 2 Komodo 1223      3148 0.0  0 0.00    ··      
 3 Critter 1.6a     3038 0.0  0 0.00       ··   
 4 Houdini 4        3148 0.0  0 0.00          ··
This Komodo development version is using Syzygy tablebases as well, so all 4 participants are using tablebases of some sort.

Best of luck to all engines!

Re: TCEC Season 6 - Stage 4 now live

Posted: Thu May 01, 2014 9:53 pm
by Uri Blass
I think that it may be better to have a rule in the next TCEC that a program that score less than 50% simply does not promote to the next stage.

It is possible to have an exception only for the superfinal so at least 2 programs always promote to the next stage.

It can help to prevent cases when one program that is clearly weaker than the rest of the programs promote.

It happened in this season more than once.

1)Shredder scored only 7 out of 15 and promoted to stage 3
2)Critter scored only 13 out of 28 and promoted to stage 4

Re: TCEC Season 6 - Stage 4 now live

Posted: Fri May 02, 2014 1:22 am
by Martin Thoresen
This doesn't make any sense to me.
Shredder qualified fair and square, the same did Critter. :)

If we are supposed to eliminate every "clearly weaker program" as you say it, then why not simply let SF, H and K play each other the whole Season?

Re: TCEC Season 6 - Stage 4 now live

Posted: Tue May 06, 2014 9:52 am
by Laskos
Simulations Stage 4 after 4 RR out of 16 RR:


STAGE 4: To Superfinal

SF: 0.83
K: 0.75
H: 0.42
Cr: 0.00
__________

TO WIN STAGE 4

SF: 0.50
K: 0.37
H: 0.13
Cr: 0.00
__________

Victory in Superfinal

SF: 0.55
K: 0.32
H: 0.13
Cr: 0.00
___________

SF adversary in case it's in Superfinal

K: 0.70
H: 0.30
Cr: 0.00

Re: TCEC Season 6 - Stage 4 now live

Posted: Tue May 06, 2014 1:40 pm
by JJJ
Nice statistique. But why the hell H4 doing less better than Komodo ? I have see Houdini doing really well ins these private tournament except versus stockfish. I don't understand.

Re: TCEC Season 6 - Stage 4 now live

Posted: Tue May 06, 2014 2:06 pm
by Uri Blass
JJJ wrote:Nice statistique. But why the hell H4 doing less better than Komodo ? I have see Houdini doing really well ins these private tournament except versus stockfish. I don't understand.
I think that Komodo earns more from 16 cores relative to houdini.

Komodo also may be better than the commercial version that won
latest TCEC so komodo is favourite to do better result than houdini.

Re: TCEC Season 6 - Stage 4 now live

Posted: Tue May 06, 2014 3:33 pm
by IanO
The crosstable with a quarter of the games played:

Code: Select all

 N Engine           Rtng Pts  Gm    SB Ko   St   Ho   Cr   

 1 Komodo 1223      3148 7.5  12 39.25 ···· 1=== ==01 =1=1
 2 Stockfish 300414 3157 7.5  12 36.25 0=== ···· 1=== 1=11
 3 Houdini 4        3148 6.5  12 33.75 ==10 0=== ···· 1=1=
 4 Critter 1.6a     3038 2.5  12 17.75 =0=0 0=00 0=0= ····

Re: TCEC Season 6 - Stage 4 now live

Posted: Tue May 06, 2014 6:30 pm
by Laskos
JJJ wrote:Nice statistique. But why the hell H4 doing less better than Komodo ? I have see Houdini doing really well ins these private tournament except versus stockfish. I don't understand.
I started with reasonable assumptions and TCEC ratings. H4 lost to SF and K in the previous season. SF improved quite a bit, K probably too, since that season. So, rating at these extreme LTC and hardware I set to be 20 Elo points SF, 10 Elo points K, 0 Elo points H, and -70 Elo points Cr. They are middle ground from TCEC ratings and common sense. As it shows, even 10 Elo points disadvantage H vs. K is noticeable in predictions, besides that, SF and K already have 1 point advantage after 4 RR out of 16 RR. I have a draw model giving ~55% draws, a bit more for stronger engines, a bit less for weaker like Critter.

The interesting thing is also that the new TCEC format with more games per engine and carefully selected openings is able to discern reasonably 15-20 Elo points differences.

Re: TCEC Season 6 - Stage 4 now live

Posted: Wed May 07, 2014 3:31 am
by JJJ
Laskos wrote:
JJJ wrote:Nice statistique. But why the hell H4 doing less better than Komodo ? I have see Houdini doing really well ins these private tournament except versus stockfish. I don't understand.
I started with reasonable assumptions and TCEC ratings. H4 lost to SF and K in the previous season. SF improved quite a bit, K probably too, since that season. So, rating at these extreme LTC and hardware I set to be 20 Elo points SF, 10 Elo points K, 0 Elo points H, and -70 Elo points Cr. They are middle ground from TCEC ratings and common sense. As it shows, even 10 Elo points disadvantage H vs. K is noticeable in predictions, besides that, SF and K already have 1 point advantage after 4 RR out of 16 RR. I have a draw model giving ~55% draws, a bit more for stronger engines, a bit less for weaker like Critter.

The interesting thing is also that the new TCEC format with more games per engine and carefully selected openings is able to discern reasonably 15-20 Elo points differences.
I see. Komodo will be updated one more time if it pass to the final. Do you think it will be able to defeat Stockfish ? Or to be as good than it or better ?

Re: TCEC Season 6 - Stage 4 now live

Posted: Wed May 07, 2014 11:09 am
by Laskos
JJJ wrote:
Laskos wrote:
JJJ wrote:Nice statistique. But why the hell H4 doing less better than Komodo ? I have see Houdini doing really well ins these private tournament except versus stockfish. I don't understand.
I started with reasonable assumptions and TCEC ratings. H4 lost to SF and K in the previous season. SF improved quite a bit, K probably too, since that season. So, rating at these extreme LTC and hardware I set to be 20 Elo points SF, 10 Elo points K, 0 Elo points H, and -70 Elo points Cr. They are middle ground from TCEC ratings and common sense. As it shows, even 10 Elo points disadvantage H vs. K is noticeable in predictions, besides that, SF and K already have 1 point advantage after 4 RR out of 16 RR. I have a draw model giving ~55% draws, a bit more for stronger engines, a bit less for weaker like Critter.

The interesting thing is also that the new TCEC format with more games per engine and carefully selected openings is able to discern reasonably 15-20 Elo points differences.
I see. Komodo will be updated one more time if it pass to the final. Do you think it will be able to defeat Stockfish ? Or to be as good than it or better ?
SF has a patch too, regarding multithreading. I keep the same supposed ratings (and assume H4 is not updated) , and the new predictions after 5 RR out of 16 RR are:

STAGE 4: To Superfinal

SF: 0.87
K: 0.74
H4: 0.39
Cr: 0.00

__________

TO WIN STAGE 4

SF: 0.57
K: 0.31
H4: 0.12
Cr: 0.00

__________

Victory in Superfinal

SF: 0.58
K: 0.30
H4: 0.12
Cr: 0.00

__________

SF adversary if it's in Superfinal

K: 0.70
H4: 0.30
Cr: 0.00