Houdini 5 dev in TCEC

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

daws
Posts: 916
Joined: Wed Mar 08, 2006 10:03 pm

Re: Houdini 5 dev in TCEC

Post by daws »

It will be a big test for Houdini in the final playing against an engine that has gone, if I've worked it out correctly, 101 games without defeat. I wonder if that is a TCEC record? Even in some games where Stockfish seemed, at least to a human observer, to have a lost position, it somehow managed to brilliantly get a draw.
Isaac
Posts: 265
Joined: Sat Feb 22, 2014 8:37 pm

Re: Houdini 5 dev in TCEC

Post by Isaac »

daws wrote:It will be a big test for Houdini in the final playing against an engine that has gone, if I've worked it out correctly, 101 games without defeat. I wonder if that is a TCEC record? Even in some games where Stockfish seemed, at least to a human observer, to have a lost position, it somehow managed to brilliantly get a draw.
Tecnically there is no such a long streak of non lost games because Stockfish got updated between stages. And the final will be between some Houdini version and a Stockfish version that hasn't played a single game in the TCEC yet.
I'm not taking away Stockfish's credit though.
rcmaddox
Posts: 181
Joined: Mon Oct 14, 2013 8:59 pm
Location: Winder, GA
Full name: Robert C. Maddox

Re: Houdini 5 dev in TCEC

Post by rcmaddox »

shrapnel wrote:
JJJ wrote:The settings problem wasn't Komodo team fault
If you believe that, you probably also believe in Fairies and Santa Claus, too ! Cho Chweet !
And if you don't believe it, you probably believe the moon landings never happened and G.W. Bush was behind the 9/11 attacks.
JJJ
Posts: 1346
Joined: Sat Apr 19, 2014 1:47 pm

Re: Houdini 5 dev in TCEC

Post by JJJ »

rcmaddox wrote:
shrapnel wrote:
JJJ wrote:The settings problem wasn't Komodo team fault
If you believe that, you probably also believe in Fairies and Santa Claus, too ! Cho Chweet !
And if you don't believe it, you probably believe the moon landings never happened and G.W. Bush was behind the 9/11 attacks.
I believe the moon landings never happened and illuminatis are behind the 9/11. I believe in fairies but not Santa Claus.

And of course, I believe the settings problem wasn't Komodo team fault.
Alexander Schmidt
Posts: 1202
Joined: Thu May 10, 2007 2:49 pm

Re: Houdini 5 dev in TCEC

Post by Alexander Schmidt »

Jouni wrote:Robert has really improved engine. In CCRL, CEGT and IPON Houdini 4 was 119, 154 and 137 points below Komodo 10.1. So progress has been around 140 ELO! Also the qualification to superfinal was the greatest surprise in last ten years or ever!!
So Houdini 5 is as strong as Stockfish? What are the odds!
APassionForCriminalJustic
Posts: 417
Joined: Sat May 24, 2014 9:16 am

Re: Houdini 5 dev in TCEC

Post by APassionForCriminalJustic »

Alexander Schmidt wrote:
Jouni wrote:Robert has really improved engine. In CCRL, CEGT and IPON Houdini 4 was 119, 154 and 137 points below Komodo 10.1. So progress has been around 140 ELO! Also the qualification to superfinal was the greatest surprise in last ten years or ever!!
So Houdini 5 is as strong as Stockfish? What are the odds!
I don't know why people claim such stupid things. We watch one stage of the final of TCEC and think we can say just how much stronger Houdini development is relative to Houdini 4. 140 Elo is absolutely ludicrous. Houdini definitely looks stronger; we still need to wait for its eventual release before we can test the bad boy for ourselves to see the true gain. The new Stockfish regression test is showing +65 Elo over Stockfish 7 which is absolutely massive. I would not expect Houdini to put up much of a fight in the final - such as was the case with Komodo. A good prediction for the score after 100 games would be something to the effect of 20-5-75 in favour of Stockfish. It won't be some two or three point difference.
kasinp
Posts: 251
Joined: Sat Dec 02, 2006 10:47 pm
Location: Toronto
Full name: Peter Kasinski

Re: Houdini 5 dev in TCEC

Post by kasinp »

APassionForCriminalJustic wrote:
Alexander Schmidt wrote:
Jouni wrote:Robert has really improved engine. In CCRL, CEGT and IPON Houdini 4 was 119, 154 and 137 points below Komodo 10.1. So progress has been around 140 ELO! Also the qualification to superfinal was the greatest surprise in last ten years or ever!!
So Houdini 5 is as strong as Stockfish? What are the odds!
I don't know why people claim such stupid things. We watch one stage of the final of TCEC and think we can say just how much stronger Houdini development is relative to Houdini 4. 140 Elo is absolutely ludicrous. Houdini definitely looks stronger; we still need to wait for its eventual release before we can test the bad boy for ourselves to see the true gain. The new Stockfish regression test is showing +65 Elo over Stockfish 7 which is absolutely massive. I would not expect Houdini to put up much of a fight in the final - such as was the case with Komodo. A good prediction for the score after 100 games would be something to the effect of 20-5-75 in favour of Stockfish. It won't be some two or three point difference.
Your first two sentences make it difficult to accept the conclusion.
User avatar
michiguel
Posts: 6401
Joined: Thu Mar 09, 2006 8:30 pm
Location: Chicago, Illinois, USA

Re: Houdini 5 dev in TCEC

Post by michiguel »

Jouni wrote:Robert has really improved engine. In CCRL, CEGT and IPON Houdini 4 was 119, 154 and 137 points below Komodo 10.1. So progress has been around 140 ELO! Also the qualification to superfinal was the greatest surprise in last ten years or ever!!
H qualified? wow, that is a surprise. Any help to see the standings? I cannot find them.

Miguel
User avatar
Eelco de Groot
Posts: 4561
Joined: Sun Mar 12, 2006 2:40 am
Full name:   

Re: Houdini 5 dev in TCEC

Post by Eelco de Groot »

They are currently playing an interim Rapid tournament, takes six weeks, according to Michael Scheidl on CSS? But they are offline again at the moment, so it takes a bit longer. The table was visible on the TCEC front page but is down. I think this was about the end standings: http://forum.computerschach.de/cgi-bin/ ... pid=103271
Debugging is twice as hard as writing the code in the first
place. Therefore, if you write the code as cleverly as possible, you
are, by definition, not smart enough to debug it.
-- Brian W. Kernighan
Edsel Apostol
Posts: 803
Joined: Mon Jul 17, 2006 5:53 am
Full name: Edsel Apostol

Re: Houdini 5 dev in TCEC

Post by Edsel Apostol »

michiguel wrote:
Jouni wrote:Robert has really improved engine. In CCRL, CEGT and IPON Houdini 4 was 119, 154 and 137 points below Komodo 10.1. So progress has been around 140 ELO! Also the qualification to superfinal was the greatest surprise in last ten years or ever!!
H qualified? wow, that is a surprise. Any help to see the standings? I cannot find them.

Miguel

Code: Select all

N Engine           Rtng  Pts  Gm     SB St       Ho       Ko       Fi       An       Jo       Gu       Ry      

 1 Stockfish 160716 3224 39.0  56 1008.50 ········ ====1=1= ==1===== ===1=1=1 =11==1=1 1=1==11= 1=11==1= =1=1=1=1
 2 Houdini 200716   3176 35.5  56 907.75 ====0=0= ········ ======1= =======1 ==1=1=1= =11=11== 11==1=1= ==11=1=1
 3 Komodo 10.1      3230 34.5  56 885.25 ==0===== ======0= ········ 1======= =11101== 11====1= ===1111= 1===1=11
 4 Fire 5           3099 28.5  56 753.00 ===0=0=0 =======0 0======= ········ 1======= ==1====1 =====1== =1=1====
 5 Andscacs 0.872b  3106 23.5  56 624.50 =00==0=0 ==0=0=0= =00010== 0======= ········ ====0=== =1=11=0= 10==1===
 6 Jonny 8          3018 22.0  56 590.50 0=0==00= =00=00== 00====0= ==0====0 ====1=== ········ ==10=010 1=======
 7 Gull 3           3123 20.5  56 559.00 0=00==0= 00==0=0= ===0000= =====0== =0=00=1= ==01=101 ········ =====0==
 8 Rybka 4.1        3120 20.5  56 555.00 =0=0=0=0 ==00=0=0 0===0=00 =0=0==== 01==0=== 0======= =====1== ········