Page 1 of 5
TCEC Season 6 - Stage 4 now live
Posted: Thu May 01, 2014 5:05 pm
by Martin Thoresen
Congratulations to Stockfish, Houdini, Critter and Komodo for qualifying for Stage 4 after Stage 3 ended yesterday.
Stage 4:
16 cores, ponder off.
Up to 16 GB hash.
Time control is 120' + 30".
Hexadeca round robin, 96 games.
Top 2 qualifies for the Superfinal.
http://tcec.chessdom.com/live.php
Full rules can be read on the TCEC website, click "Help" in the top menu then "Rules & Information".
Finished games can be viewed and downloaded in the Archive page:
http://tcec.chessdom.com/archive.php
Code: Select all
N Engine Rtng Pts Gm SB St Ko Cr Ho
1 Stockfish 300414 3157 0.0 0 0.00 ··
2 Komodo 1223 3148 0.0 0 0.00 ··
3 Critter 1.6a 3038 0.0 0 0.00 ··
4 Houdini 4 3148 0.0 0 0.00 ··
This Komodo development version is using Syzygy tablebases as well, so all 4 participants are using tablebases of some sort.
Best of luck to all engines!
Re: TCEC Season 6 - Stage 4 now live
Posted: Thu May 01, 2014 9:53 pm
by Uri Blass
I think that it may be better to have a rule in the next TCEC that a program that score less than 50% simply does not promote to the next stage.
It is possible to have an exception only for the superfinal so at least 2 programs always promote to the next stage.
It can help to prevent cases when one program that is clearly weaker than the rest of the programs promote.
It happened in this season more than once.
1)Shredder scored only 7 out of 15 and promoted to stage 3
2)Critter scored only 13 out of 28 and promoted to stage 4
Re: TCEC Season 6 - Stage 4 now live
Posted: Fri May 02, 2014 1:22 am
by Martin Thoresen
This doesn't make any sense to me.
Shredder qualified fair and square, the same did Critter.
If we are supposed to eliminate every "clearly weaker program" as you say it, then why not simply let SF, H and K play each other the whole Season?
Re: TCEC Season 6 - Stage 4 now live
Posted: Tue May 06, 2014 9:52 am
by Laskos
Simulations Stage 4 after 4 RR out of 16 RR:
STAGE 4: To Superfinal
SF: 0.83
K: 0.75
H: 0.42
Cr: 0.00
__________
TO WIN STAGE 4
SF: 0.50
K: 0.37
H: 0.13
Cr: 0.00
__________
Victory in Superfinal
SF: 0.55
K: 0.32
H: 0.13
Cr: 0.00
___________
SF adversary in case it's in Superfinal
K: 0.70
H: 0.30
Cr: 0.00
Re: TCEC Season 6 - Stage 4 now live
Posted: Tue May 06, 2014 1:40 pm
by JJJ
Nice statistique. But why the hell H4 doing less better than Komodo ? I have see Houdini doing really well ins these private tournament except versus stockfish. I don't understand.
Re: TCEC Season 6 - Stage 4 now live
Posted: Tue May 06, 2014 2:06 pm
by Uri Blass
JJJ wrote:Nice statistique. But why the hell H4 doing less better than Komodo ? I have see Houdini doing really well ins these private tournament except versus stockfish. I don't understand.
I think that Komodo earns more from 16 cores relative to houdini.
Komodo also may be better than the commercial version that won
latest TCEC so komodo is favourite to do better result than houdini.
Re: TCEC Season 6 - Stage 4 now live
Posted: Tue May 06, 2014 3:33 pm
by IanO
The crosstable with a quarter of the games played:
Code: Select all
N Engine Rtng Pts Gm SB Ko St Ho Cr
1 Komodo 1223 3148 7.5 12 39.25 ···· 1=== ==01 =1=1
2 Stockfish 300414 3157 7.5 12 36.25 0=== ···· 1=== 1=11
3 Houdini 4 3148 6.5 12 33.75 ==10 0=== ···· 1=1=
4 Critter 1.6a 3038 2.5 12 17.75 =0=0 0=00 0=0= ····
Re: TCEC Season 6 - Stage 4 now live
Posted: Tue May 06, 2014 6:30 pm
by Laskos
JJJ wrote:Nice statistique. But why the hell H4 doing less better than Komodo ? I have see Houdini doing really well ins these private tournament except versus stockfish. I don't understand.
I started with reasonable assumptions and TCEC ratings. H4 lost to SF and K in the previous season. SF improved quite a bit, K probably too, since that season. So, rating at these extreme LTC and hardware I set to be 20 Elo points SF, 10 Elo points K, 0 Elo points H, and -70 Elo points Cr. They are middle ground from TCEC ratings and common sense. As it shows, even 10 Elo points disadvantage H vs. K is noticeable in predictions, besides that, SF and K already have 1 point advantage after 4 RR out of 16 RR. I have a draw model giving ~55% draws, a bit more for stronger engines, a bit less for weaker like Critter.
The interesting thing is also that the new TCEC format with more games per engine and carefully selected openings is able to discern reasonably 15-20 Elo points differences.
Re: TCEC Season 6 - Stage 4 now live
Posted: Wed May 07, 2014 3:31 am
by JJJ
Laskos wrote:JJJ wrote:Nice statistique. But why the hell H4 doing less better than Komodo ? I have see Houdini doing really well ins these private tournament except versus stockfish. I don't understand.
I started with reasonable assumptions and TCEC ratings. H4 lost to SF and K in the previous season. SF improved quite a bit, K probably too, since that season. So, rating at these extreme LTC and hardware I set to be 20 Elo points SF, 10 Elo points K, 0 Elo points H, and -70 Elo points Cr. They are middle ground from TCEC ratings and common sense. As it shows, even 10 Elo points disadvantage H vs. K is noticeable in predictions, besides that, SF and K already have 1 point advantage after 4 RR out of 16 RR. I have a draw model giving ~55% draws, a bit more for stronger engines, a bit less for weaker like Critter.
The interesting thing is also that the new TCEC format with more games per engine and carefully selected openings is able to discern reasonably 15-20 Elo points differences.
I see. Komodo will be updated one more time if it pass to the final. Do you think it will be able to defeat Stockfish ? Or to be as good than it or better ?
Re: TCEC Season 6 - Stage 4 now live
Posted: Wed May 07, 2014 11:09 am
by Laskos
JJJ wrote:Laskos wrote:JJJ wrote:Nice statistique. But why the hell H4 doing less better than Komodo ? I have see Houdini doing really well ins these private tournament except versus stockfish. I don't understand.
I started with reasonable assumptions and TCEC ratings. H4 lost to SF and K in the previous season. SF improved quite a bit, K probably too, since that season. So, rating at these extreme LTC and hardware I set to be 20 Elo points SF, 10 Elo points K, 0 Elo points H, and -70 Elo points Cr. They are middle ground from TCEC ratings and common sense. As it shows, even 10 Elo points disadvantage H vs. K is noticeable in predictions, besides that, SF and K already have 1 point advantage after 4 RR out of 16 RR. I have a draw model giving ~55% draws, a bit more for stronger engines, a bit less for weaker like Critter.
The interesting thing is also that the new TCEC format with more games per engine and carefully selected openings is able to discern reasonably 15-20 Elo points differences.
I see. Komodo will be updated one more time if it pass to the final. Do you think it will be able to defeat Stockfish ? Or to be as good than it or better ?
SF has a patch too, regarding multithreading. I keep the same supposed ratings (and assume H4 is not updated) , and the new predictions after 5 RR out of 16 RR are:
STAGE 4: To Superfinal
SF: 0.87
K: 0.74
H4: 0.39
Cr: 0.00
__________
TO WIN STAGE 4
SF: 0.57
K: 0.31
H4: 0.12
Cr: 0.00
__________
Victory in Superfinal
SF: 0.58
K: 0.30
H4: 0.12
Cr: 0.00
__________
SF adversary if it's in Superfinal
K: 0.70
H4: 0.30
Cr: 0.00