90 threads now on CCC 3

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Jouni
Posts: 3286
Joined: Wed Mar 08, 2006 8:15 pm

90 threads now on CCC 3

Post by Jouni »

CPUs: 2 x Intel Xeon Platinum 8168 @ 2.70 GHz 33 MB L3 Threads: 90 threads with HT on

Is this much faster than TCEC hardware here : 2 x Intel Xeon E5 2699 v4 @ 2.8 GHz Cores: 44 physical?

So far Houdini seems to like HT.
Jouni
jdart
Posts: 4366
Joined: Fri Mar 10, 2006 5:23 am
Location: http://www.arasanchess.org

Re: 90 threads now on CCC 3

Post by jdart »

I am not really sure running with these high core counts is such as great idea because you're taking a program designed for one kind of environment and dropping it into something quite different.

There are going to be some inefficiencies that prevent linear scaling. Some engines may do better than others in this respect. But these environments may test scaling more than they test search or eval, and the results won't give a very indicator of relative strength to people who don't have $20,000+ computer systems.

--Jon
User avatar
CMCanavessi
Posts: 1142
Joined: Thu Dec 28, 2017 4:06 pm
Location: Argentina

Re: 90 threads now on CCC 3

Post by CMCanavessi »

jdart wrote: Fri Dec 07, 2018 6:02 pm I am not really sure running with these high core counts is such as great idea because you're taking a program designed for one kind of environment and dropping it into something quite different.

There are going to be some inefficiencies that prevent linear scaling. Some engines may do better than others in this respect. But these environments may test scaling more than they test search or eval, and the results won't give a very indicator of relative strength to people who don't have $20,000+ computer systems.

--Jon
True, but sooner or later 90 threads will become "normal" in home computers, so it's just a matter of time... engines WILL have to adapt, or be relegated.
Follow my tournament and some Leela gauntlets live at http://twitch.tv/ccls
Leo
Posts: 1080
Joined: Fri Sep 16, 2016 6:55 pm
Location: USA/Minnesota
Full name: Leo Anger

Re: 90 threads now on CCC 3

Post by Leo »

What is CCC 3? I am all for huge hardware. Let us know your results.
Advanced Micro Devices fan.
User avatar
CMCanavessi
Posts: 1142
Joined: Thu Dec 28, 2017 4:06 pm
Location: Argentina

Re: 90 threads now on CCC 3

Post by CMCanavessi »

Leo wrote: Fri Dec 07, 2018 8:28 pm What is CCC 3? I am all for huge hardware. Let us know your results.
https://www.chess.com/computer-chess-championship
Follow my tournament and some Leela gauntlets live at http://twitch.tv/ccls
arunsoorya1309
Posts: 214
Joined: Tue Nov 03, 2015 4:55 pm

Re: 90 threads now on CCC 3

Post by arunsoorya1309 »

Thanks CM,

John Dart, if there are serious concerns you can email us and we can discuss about this further.

Regards,
Arun
Leo
Posts: 1080
Joined: Fri Sep 16, 2016 6:55 pm
Location: USA/Minnesota
Full name: Leo Anger

Re: 90 threads now on CCC 3

Post by Leo »

CMCanavessi wrote: Fri Dec 07, 2018 8:37 pm
Leo wrote: Fri Dec 07, 2018 8:28 pm What is CCC 3? I am all for huge hardware. Let us know your results.
https://www.chess.com/computer-chess-championship
Thanks.
Advanced Micro Devices fan.
User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: 90 threads now on CCC 3

Post by Laskos »

Jouni wrote: Fri Dec 07, 2018 3:16 pm CPUs: 2 x Intel Xeon Platinum 8168 @ 2.70 GHz 33 MB L3 Threads: 90 threads with HT on

Is this much faster than TCEC hardware here : 2 x Intel Xeon E5 2699 v4 @ 2.8 GHz Cores: 44 physical?

So far Houdini seems to like HT.
NPS probably 20% or so higher, depending on engine. But I am not sure about the effective speed-up from 45 threads on 45 physical cores to 90 threads on 48 physical cores with HT with Lazy SMP. In old times, with YBW, this was a clear NO, but nowadays I am not sure. Probably they would have better left 45 threads on 45 cores, less engines will have problems, less heat or possible throttle from using almost all CPU resources. The gain, if any, is anyway small even for well scaling SMP, and some engines might even perform worse.
jdart
Posts: 4366
Joined: Fri Mar 10, 2006 5:23 am
Location: http://www.arasanchess.org

Re: 90 threads now on CCC 3

Post by jdart »

Yes, one of the points is that after a while you don't get much gain from more cores.

The scaling does vary though. I am noticing right now that Houdini is apparently getting something over 100M nodes/second on the CCC hardware, which is quite an astonishing number, and Arasan is getting about 30M, a bit more in the endgame. I did give them a version for Windows that is aware of processor groups but I am not clear that is what they are running. I don't have hardware even close to this to test on.

--Jon
User avatar
lucasart
Posts: 3232
Joined: Mon May 31, 2010 1:29 pm
Full name: lucasart

Re: 90 threads now on CCC 3

Post by lucasart »

jdart wrote: Fri Dec 07, 2018 6:02 pm I am not really sure running with these high core counts is such as great idea because you're taking a program designed for one kind of environment and dropping it into something quite different.

There are going to be some inefficiencies that prevent linear scaling. Some engines may do better than others in this respect. But these environments may test scaling more than they test search or eval, and the results won't give a very indicator of relative strength to people who don't have $20,000+ computer systems.

--Jon
Indeed. This will not be so much a chess contest than a stability contest. Those that don't crash win. Most engines aren't tested for this kind of use case. And even those that are flawless without any SMP bug (assuming this is even possible which I doubt) will show very little gain on so many threads. You're probably better off stopping at 8 or 16 threads. After that you are just wasting electricity, and crashing engines.
Theory and practice sometimes clash. And when that happens, theory loses. Every single time.