AH_LTC Match: Stockfish DD vs Komodo TCEC

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

User avatar
Aser Huerga
Posts: 812
Joined: Tue Jun 16, 2009 10:09 am
Location: Spain

AH_LTC Match: Stockfish DD vs Komodo TCEC

Post by Aser Huerga »

AH_LTC Match: Stockfish DD vs Komodo TCEC

Five i7-3930K CPUs 4.25 GHz
90'+30" TC
1 core for all engines
Ponder off
1024 Hash
3-4-5 EGTBs (when available) in SSDs
150 Early Starting Positions Suite, slightly tunned to avoid transpositions (checked with engine vs same-engine matches), and created as a proportional representation of the most played openings/variations on recent years in high quality human chess tournaments (source TWIC, only 2400+ ELO players) AH_150_Opening_Suite
All positions are played with Switched Colors for a total of 300 games per match
Games available for download, including eval/time/depth and PV for each move

Results:

Code: Select all

1 Stockfish DD 3230 +63/-56/=181 51.17% 153.5/300
2 Komodo TCEC  3222 +56/-63/=181 48.83% 146.5/300
[/color]

Games: Stockfish DD - Komodo TCEC


AH_LTC Stairway To Heaven competition

AH_LTC Made In Heaven class

Code: Select all

   # PLAYER                   : RATING  ERROR   POINTS  PLAYED    (%)
   1 Stockfish DD             : 3235.1   29.9    488.0     900   54.2%
   2 Komodo TCEC              : 3226.8   41.1    146.5     300   48.8%
     Stockfish_SZ 13110122    : 3210.6   22.8    486.0     900   54.0%
   3 Houdini 4                : 3206.5   27.0    447.0     900   49.7%
     Komodo 6                 : 3181.0   22.0    564.0    1200   47.0%
     Houdini 3                : 3158.0   ----    268.5     600   44.8%
                                (Created by Ordo v0.8)

Code: Select all

1 Stockfish DD              :   900 (+232,=512,-156), 54.2 %

Komodo 6                      : 300 (+ 87,=176,- 37), 58.3 %
Houdini 4                     : 300 (+ 82,=155,- 63), 53.2 %
Komodo TCEC                   : 300 (+ 63,=181,- 56), 51.2 %

2 Komodo TCEC               :   300 (+ 56,=181,- 63), 48.8 %

Stockfish DD                  : 300 (+ 56,=181,- 63), 48.8 %

  Stockfish_SZ 13110122     :   900 (+225,=522,-153), 54.0 %

Houdini 3                     : 300 (+ 94,=159,- 47), 57.8 %
Komodo 6                      : 300 (+ 70,=188,- 42), 54.7 %
Houdini 4                     : 300 (+ 61,=175,- 64), 49.5 %

3 Houdini 4                 :   900 (+203,=488,-209), 49.7 %

Komodo 6                      : 300 (+ 76,=158,- 66), 51.7 %
Stockfish_SZ 13110122         : 300 (+ 64,=175,- 61), 50.5 %
Stockfish DD                  : 300 (+ 63,=155,- 82), 46.8 %

  Komodo 6                  :   1200 (+219,=690,-291), 47.0 %

Houdini 3                     : 300 (+ 74,=168,- 58), 52.7 %
Stockfish_SZ 13110122         : 300 (+ 42,=188,- 70), 45.3 %
Houdini 4                     : 300 (+ 66,=158,- 76), 48.3 %
Stockfish DD                  : 300 (+ 37,=176,- 87), 41.7 %

  Houdini 3                 :   600 (+105,=327,-168), 44.8 %

Komodo 6                      : 300 (+ 58,=168,- 74), 47.3 %
Stockfish_SZ 13110122         : 300 (+ 47,=159,- 94), 42.2 %

Next Match: Komodo TCEC vs Houdini 4
ouachita
Posts: 454
Joined: Tue Jan 15, 2013 4:33 pm
Location: Ritz-Carlton, NYC
Full name: Bobby Johnson

Re: AH_LTC Match: Stockfish DD vs Komodo TCEC

Post by ouachita »

Stairway to Heaven by Led Zeppelin. Album : Led Zepplein IV (4) Year : 1971 Lyrics: There's a lady who's ...
SIM, PhD, MBA, PE
User avatar
Aser Huerga
Posts: 812
Joined: Tue Jun 16, 2009 10:09 am
Location: Spain

Re: AH_LTC Match: Stockfish DD vs Komodo TCEC

Post by Aser Huerga »

ouachita wrote:Stairway to Heaven by Led Zeppelin. Album : Led Zepplein IV (4) Year : 1971 Lyrics: There's a lady who's ...
Yes :D I like to put a musical touch in my tests :D
Adam Hair
Posts: 3226
Joined: Wed May 06, 2009 10:31 pm
Location: Fuquay-Varina, North Carolina

Re: AH_LTC Match: Stockfish DD vs Komodo TCEC

Post by Adam Hair »

Sometime in the future, I would like to see this:

AH_LTC Total Destruction To Your Mind competition

:wink:
ouachita
Posts: 454
Joined: Tue Jan 15, 2013 4:33 pm
Location: Ritz-Carlton, NYC
Full name: Bobby Johnson

Re: AH_LTC Match: Stockfish DD vs Komodo TCEC

Post by ouachita »

Jerry Williams, Jr., pseudonym Swamp Dogg, 1970/1971?, released 2013
SIM, PhD, MBA, PE
Adam Hair
Posts: 3226
Joined: Wed May 06, 2009 10:31 pm
Location: Fuquay-Varina, North Carolina

Re: AH_LTC Match: Stockfish DD vs Komodo TCEC

Post by Adam Hair »

ouachita wrote:Jerry Williams, Jr., pseudonym Swamp Dogg, 1970/1971?, released 2013
That's right.
Aser has a great love of music, especially soul and funk. His collection of music is vastly greater than mine, but I was able to introduce him to Swamp Dogg.
User avatar
michiguel
Posts: 6401
Joined: Thu Mar 09, 2006 8:30 pm
Location: Chicago, Illinois, USA

Re: AH_LTC Match: Stockfish DD vs Komodo TCEC

Post by michiguel »

Adam Hair wrote:Sometime in the future, I would like to see this:

AH_LTC Total Destruction To Your Mind competition

:wink:
I would like to see AH_LTC Seagull & Bad Company competition

or Gaviota vs. The Clones. It does not end well though...

"Now you fly, through the sky, never asking why,
And you fly all around 'til somebody, Shoots you down."

Miguel
PS: Then AH_LTC_Freebird competition by syszygy... no sorry, got confused, lynyrd skynyrd.
lkaufman
Posts: 5960
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA

Re: AH_LTC Match: Stockfish DD vs Komodo TCEC

Post by lkaufman »

Aser Huerga wrote: AH_LTC Match: Stockfish DD vs Komodo TCEC

Five i7-3930K CPUs 4.25 GHz
90'+30" TC
1 core for all engines
Ponder off
1024 Hash
3-4-5 EGTBs (when available) in SSDs
150 Early Starting Positions Suite, slightly tunned to avoid transpositions (checked with engine vs same-engine matches), and created as a proportional representation of the most played openings/variations on recent years in high quality human chess tournaments (source TWIC, only 2400+ ELO players) AH_150_Opening_Suite
All positions are played with Switched Colors for a total of 300 games per match
Games available for download, including eval/time/depth and PV for each move

Results:

Code: Select all

1 Stockfish DD 3230 +63/-56/=181 51.17% 153.5/300
2 Komodo TCEC  3222 +56/-63/=181 48.83% 146.5/300
[/color]

Games: Stockfish DD - Komodo TCEC


AH_LTC Stairway To Heaven competition

AH_LTC Made In Heaven class

Code: Select all

   # PLAYER                   : RATING  ERROR   POINTS  PLAYED    (%)
   1 Stockfish DD             : 3235.1   29.9    488.0     900   54.2%
   2 Komodo TCEC              : 3226.8   41.1    146.5     300   48.8%
     Stockfish_SZ 13110122    : 3210.6   22.8    486.0     900   54.0%
   3 Houdini 4                : 3206.5   27.0    447.0     900   49.7%
     Komodo 6                 : 3181.0   22.0    564.0    1200   47.0%
     Houdini 3                : 3158.0   ----    268.5     600   44.8%
                                (Created by Ordo v0.8)

Code: Select all

1 Stockfish DD              :   900 (+232,=512,-156), 54.2 %

Komodo 6                      : 300 (+ 87,=176,- 37), 58.3 %
Houdini 4                     : 300 (+ 82,=155,- 63), 53.2 %
Komodo TCEC                   : 300 (+ 63,=181,- 56), 51.2 %

2 Komodo TCEC               :   300 (+ 56,=181,- 63), 48.8 %

Stockfish DD                  : 300 (+ 56,=181,- 63), 48.8 %

  Stockfish_SZ 13110122     :   900 (+225,=522,-153), 54.0 %

Houdini 3                     : 300 (+ 94,=159,- 47), 57.8 %
Komodo 6                      : 300 (+ 70,=188,- 42), 54.7 %
Houdini 4                     : 300 (+ 61,=175,- 64), 49.5 %

3 Houdini 4                 :   900 (+203,=488,-209), 49.7 %

Komodo 6                      : 300 (+ 76,=158,- 66), 51.7 %
Stockfish_SZ 13110122         : 300 (+ 64,=175,- 61), 50.5 %
Stockfish DD                  : 300 (+ 63,=155,- 82), 46.8 %

  Komodo 6                  :   1200 (+219,=690,-291), 47.0 %

Houdini 3                     : 300 (+ 74,=168,- 58), 52.7 %
Stockfish_SZ 13110122         : 300 (+ 42,=188,- 70), 45.3 %
Houdini 4                     : 300 (+ 66,=158,- 76), 48.3 %
Stockfish DD                  : 300 (+ 37,=176,- 87), 41.7 %

  Houdini 3                 :   600 (+105,=327,-168), 44.8 %

Komodo 6                      : 300 (+ 58,=168,- 74), 47.3 %
Stockfish_SZ 13110122         : 300 (+ 47,=159,- 94), 42.2 %

Next Match: Komodo TCEC vs Houdini 4
Wow, 20 elo above Houdini 4! But we still have to win the direct match to confirm this; 300 games is still a small sample. But your tests so far, plus TCEC, plus Clemens Keck "3champs" event all agree that Houdini 4 is relegated to third place at standard time control chess, even if it is still king at blitz.
User avatar
Aser Huerga
Posts: 812
Joined: Tue Jun 16, 2009 10:09 am
Location: Spain

Re: AH_LTC Match: Stockfish DD vs Komodo TCEC

Post by Aser Huerga »

Adam Hair wrote:
ouachita wrote:Jerry Williams, Jr., pseudonym Swamp Dogg, 1970/1971?, released 2013
That's right.
Aser has a great love of music, especially soul and funk. His collection of music is vastly greater than mine, but I was able to introduce him to Swamp Dogg.
Yes, it was a great discovery :wink: . Lately I am starting out in classical music, but soul, funk, rock and jazz was always walking with me.

Time ago, when I run gauntlets for CCRL I used to choose musical names like "Even In The Quiescent Searches..." (Supertramp), "Rock aRound The Doch" (Bill Haley) or "Prelude To A Check" (Duke Ellington), and others ( http://www.talkchess.com/forum/search.p ... &start=260 ) :lol:

Back to the topic, there's a point that I'd like to stand out, and is the improve that Komodo TCEC is showing at LTC in front of Komodo 6, which I guess the Komodo TCEC - Houdini 4 match will confirm.
lkaufman
Posts: 5960
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA

Re: AH_LTC Match: Stockfish DD vs Komodo TCEC

Post by lkaufman »

Which Gui do you use for your matches? Have there been any time forfeits in any match?

Larry