Congrats the Komodo Team

Discussion of anything and everything relating to chess playing software and machines.

Moderators: bob, hgm, Harvey Williamson

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
mjlef
Posts: 1424
Joined: Thu Mar 30, 2006 12:08 pm
Contact:

Re: Congrats the Komodo Team

Post by mjlef » Fri Aug 16, 2019 4:24 am

zullil wrote:
Thu Aug 15, 2019 4:06 pm
mehmet karaman wrote:
Thu Aug 15, 2019 3:58 pm
Komodo won the WCCC.

After 9 rounds Komodo has 7 points at 9 game. Komodo is 1.5 points ahead of Chiron. Komodo guaranteed to be champion with one game left.

We now that Stockfish and Stockfish derivatives like Cfish, asmFish are the strongest engines. Lc0 is as strong as Stockfish with very powerful GPU's.
At WCCC not only chess engine is important. Also hardware, opening book and tablebase are important. The operator is important too. (We saw this last WCCC)

No doubt that TCEC is the best chess engine tournament in the world. But this tournament isn' t same category with TCEC.
WCCC is a whole system (software+ hardware+ operator) tournament. This success isn' t only belongs to Larry Kaufman and Mark Lefler (and Don Dailey). Erdogan Gunes has a share in success too.
And maybe the biggest share of the success goes to

8 x Intel (R) Xeon(R) Platinum 8168 CPU @ 2.7 GHz, 128 cores used. :wink:

But now Komodo can be marketed as the "World Computer Chess Champion".
Having the big machine certainly helps. I think it helps more in longer time controls. For Speed Chess we might have done better if we used a faster per core 16 core machine. It was not NUMA, so avoids the whole slow memory access, and it was over clocked above 4 GHz. But the 128 core was used in Speed Chess and WCCC this time. I think I need to do some more programming to take advantage of an 8 NUMA node machine. All those cores trying to access memory requires more speical memory management, so we will work on it. Komodo was getting about 70-90 million nps for much of the positions, but faster in endgames. With some work it can probably do better, but each processor doubling gives less and less elo and at some point, more is less.

User avatar
Graham Banks
Posts: 33020
Joined: Sun Feb 26, 2006 9:52 am
Location: Auckland, NZ

Re: Congrats the Komodo Team

Post by Graham Banks » Fri Aug 16, 2019 5:10 am

Congratulations to the Komodo team. :)
My email addresses:
gbanksnz at gmail.com
gbanksnz at yahoo.co.nz

User avatar
phhnguyen
Posts: 372
Joined: Wed Apr 21, 2010 2:58 am
Location: Australia
Full name: Nguyen Hong Pham
Contact:

Re: Congrats the Komodo Team

Post by phhnguyen » Fri Aug 16, 2019 9:38 am

zullil wrote:
Thu Aug 15, 2019 4:06 pm
And maybe the biggest share of the success goes to

8 x Intel (R) Xeon(R) Platinum 8168 CPU @ 2.7 GHz, 128 cores used. :wink:
Can someone give me an estimate about the price of that computer? Thanks
http://banksiagui.com
A freeware chess GUI, based on opensource Banksia - the chess tournament manager

zullil
Posts: 5611
Joined: Mon Jan 08, 2007 11:31 pm
Location: PA USA
Full name: Louis Zulli

Re: Congrats the Komodo Team

Post by zullil » Fri Aug 16, 2019 10:09 am

mjlef wrote:
Fri Aug 16, 2019 4:24 am
I think I need to do some more programming to take advantage of an 8 NUMA node machine. All those cores trying to access memory requires more speical memory management, so we will work on it. Komodo was getting about 70-90 million nps for much of the positions, but faster in endgames. With some work it can probably do better, but each processor doubling gives less and less elo and at some point, more is less.
Out of curiosity, what are the "node distances" on that machine? Under Linux, that table is provided by running

Code: Select all

numactl --hardware

zullil
Posts: 5611
Joined: Mon Jan 08, 2007 11:31 pm
Location: PA USA
Full name: Louis Zulli

Re: Congrats the Komodo Team

Post by zullil » Fri Aug 16, 2019 10:13 am

phhnguyen wrote:
Fri Aug 16, 2019 9:38 am
zullil wrote:
Thu Aug 15, 2019 4:06 pm
And maybe the biggest share of the success goes to

8 x Intel (R) Xeon(R) Platinum 8168 CPU @ 2.7 GHz, 128 cores used. :wink:
Can someone give me an estimate about the price of that computer? Thanks
Well, each CPU is about $6000 (6000 USD). :D

mjlef
Posts: 1424
Joined: Thu Mar 30, 2006 12:08 pm
Contact:

Re: Congrats the Komodo Team

Post by mjlef » Sat Aug 17, 2019 1:25 am

zullil wrote:
Fri Aug 16, 2019 10:09 am
mjlef wrote:
Fri Aug 16, 2019 4:24 am
I think I need to do some more programming to take advantage of an 8 NUMA node machine. All those cores trying to access memory requires more speical memory management, so we will work on it. Komodo was getting about 70-90 million nps for much of the positions, but faster in endgames. With some work it can probably do better, but each processor doubling gives less and less elo and at some point, more is less.
Out of curiosity, what are the "node distances" on that machine? Under Linux, that table is provided by running

Code: Select all

numactl --hardware
here they are:
node distances:
node 0 1 2 3 4 5 6 7
0: 10 20 20 20 20 20 20 20
1: 20 10 20 20 20 20 20 20
2: 20 20 10 20 20 20 20 20
3: 20 20 20 10 20 20 20 20
4: 20 20 20 20 10 20 20 20
5: 20 20 20 20 20 10 20 20
6: 20 20 20 20 20 20 10 20
7: 20 20 20 20 20 20 20 10

bob
Posts: 20478
Joined: Mon Feb 27, 2006 6:30 pm
Location: Birmingham, AL

Re: Congrats the Komodo Team

Post by bob » Sat Aug 17, 2019 1:31 am

that is actually pretty amazing numbers...

User avatar
phhnguyen
Posts: 372
Joined: Wed Apr 21, 2010 2:58 am
Location: Australia
Full name: Nguyen Hong Pham
Contact:

Re: Congrats the Komodo Team

Post by phhnguyen » Sat Aug 17, 2019 8:13 am

zullil wrote:
Fri Aug 16, 2019 10:13 am
phhnguyen wrote:
Fri Aug 16, 2019 9:38 am
zullil wrote:
Thu Aug 15, 2019 4:06 pm
And maybe the biggest share of the success goes to

8 x Intel (R) Xeon(R) Platinum 8168 CPU @ 2.7 GHz, 128 cores used. :wink:
Can someone give me an estimate about the price of that computer? Thanks
Well, each CPU is about $6000 (6000 USD). :D
Amazing expensiveness!!!

So the price of Komodo computer should be from $60K.

Another curious/stupid question: if we spend $60K to buy a computer/station with strong GPUs (not to hire special ones from Google/Amazon) for Leela0, can it beat Komodo with its $60K computer? (all counted recent status/versions)
http://banksiagui.com
A freeware chess GUI, based on opensource Banksia - the chess tournament manager

mehmet karaman
Posts: 142
Joined: Tue Jan 28, 2014 7:37 am
Location: TURKEY

Re: Congrats the Komodo Team

Post by mehmet karaman » Sat Aug 17, 2019 10:00 am

Elo of Stockfish 10 is 47 points higher than Komodo 13.02
https://ssdf.bosjo.net/list.htm

At TCEC conditions elo of Stockfish 10 is 35 points higher than Komodo 13.02

Elo of Stockfish 18042019 (version played at TCEC 15 Super Final) is ~ 50 elo higher than Komodo 13.02

Elo of Lc0 0.21.2 T40.T8.610 (version played at TCEC 15 Super Final) is ~20 elo higher than Stockfish 18042019

Elo of last version Lc0 (Lc0 427xx) is ~10 elo higher than Lc0 0.21.2 T40.T8.610

Komodo XXX (WCCC 2019) is 5-10 elo higher 13.02

Elo of Lc0 427xx is ~ 70 elo higher than Komodo

Lc0 (RTX 2080 Tİ + RTX 2080) is 70 elo higher than Komodo XXX (44 CPU)

Lc0 (RTX 2080 Tİ + RTX 2080) is 10 elo higher than Komodo XXX (128 CPU)


My conclusion is strongest Lc0 version at RTX 2080 Tİ + RTX 2080 is a bit stronger than Komodo WCCC 2019 version at 128 CPU (with same opening book)

zullil
Posts: 5611
Joined: Mon Jan 08, 2007 11:31 pm
Location: PA USA
Full name: Louis Zulli

Re: Congrats the Komodo Team

Post by zullil » Sat Aug 17, 2019 10:07 am

mjlef wrote:
Sat Aug 17, 2019 1:25 am
zullil wrote:
Fri Aug 16, 2019 10:09 am
mjlef wrote:
Fri Aug 16, 2019 4:24 am
I think I need to do some more programming to take advantage of an 8 NUMA node machine. All those cores trying to access memory requires more speical memory management, so we will work on it. Komodo was getting about 70-90 million nps for much of the positions, but faster in endgames. With some work it can probably do better, but each processor doubling gives less and less elo and at some point, more is less.
Out of curiosity, what are the "node distances" on that machine? Under Linux, that table is provided by running

Code: Select all

numactl --hardware
here they are:
node distances:
node 0 1 2 3 4 5 6 7
0: 10 20 20 20 20 20 20 20
1: 20 10 20 20 20 20 20 20
2: 20 20 10 20 20 20 20 20
3: 20 20 20 10 20 20 20 20
4: 20 20 20 20 10 20 20 20
5: 20 20 20 20 20 10 20 20
6: 20 20 20 20 20 20 10 20
7: 20 20 20 20 20 20 20 10
Thanks. So all other nodes are "equidistant" from any one fixed node. So even if a given search thread wanders off its preferred node, the penalty is never too severe.

Post Reply