Page 1 of 3

90 threads now on CCC 3

Posted: Fri Dec 07, 2018 3:16 pm
by Jouni
CPUs: 2 x Intel Xeon Platinum 8168 @ 2.70 GHz 33 MB L3 Threads: 90 threads with HT on

Is this much faster than TCEC hardware here : 2 x Intel Xeon E5 2699 v4 @ 2.8 GHz Cores: 44 physical?

So far Houdini seems to like HT.

Re: 90 threads now on CCC 3

Posted: Fri Dec 07, 2018 6:02 pm
by jdart
I am not really sure running with these high core counts is such as great idea because you're taking a program designed for one kind of environment and dropping it into something quite different.

There are going to be some inefficiencies that prevent linear scaling. Some engines may do better than others in this respect. But these environments may test scaling more than they test search or eval, and the results won't give a very indicator of relative strength to people who don't have $20,000+ computer systems.

--Jon

Re: 90 threads now on CCC 3

Posted: Fri Dec 07, 2018 6:26 pm
by CMCanavessi
jdart wrote: Fri Dec 07, 2018 6:02 pm I am not really sure running with these high core counts is such as great idea because you're taking a program designed for one kind of environment and dropping it into something quite different.

There are going to be some inefficiencies that prevent linear scaling. Some engines may do better than others in this respect. But these environments may test scaling more than they test search or eval, and the results won't give a very indicator of relative strength to people who don't have $20,000+ computer systems.

--Jon
True, but sooner or later 90 threads will become "normal" in home computers, so it's just a matter of time... engines WILL have to adapt, or be relegated.

Re: 90 threads now on CCC 3

Posted: Fri Dec 07, 2018 8:28 pm
by Leo
What is CCC 3? I am all for huge hardware. Let us know your results.

Re: 90 threads now on CCC 3

Posted: Fri Dec 07, 2018 8:37 pm
by CMCanavessi
Leo wrote: Fri Dec 07, 2018 8:28 pm What is CCC 3? I am all for huge hardware. Let us know your results.
https://www.chess.com/computer-chess-championship

Re: 90 threads now on CCC 3

Posted: Fri Dec 07, 2018 9:08 pm
by arunsoorya1309
Thanks CM,

John Dart, if there are serious concerns you can email us and we can discuss about this further.

Regards,
Arun

Re: 90 threads now on CCC 3

Posted: Fri Dec 07, 2018 11:22 pm
by Leo
CMCanavessi wrote: Fri Dec 07, 2018 8:37 pm
Leo wrote: Fri Dec 07, 2018 8:28 pm What is CCC 3? I am all for huge hardware. Let us know your results.
https://www.chess.com/computer-chess-championship
Thanks.

Re: 90 threads now on CCC 3

Posted: Fri Dec 07, 2018 11:39 pm
by Laskos
Jouni wrote: Fri Dec 07, 2018 3:16 pm CPUs: 2 x Intel Xeon Platinum 8168 @ 2.70 GHz 33 MB L3 Threads: 90 threads with HT on

Is this much faster than TCEC hardware here : 2 x Intel Xeon E5 2699 v4 @ 2.8 GHz Cores: 44 physical?

So far Houdini seems to like HT.
NPS probably 20% or so higher, depending on engine. But I am not sure about the effective speed-up from 45 threads on 45 physical cores to 90 threads on 48 physical cores with HT with Lazy SMP. In old times, with YBW, this was a clear NO, but nowadays I am not sure. Probably they would have better left 45 threads on 45 cores, less engines will have problems, less heat or possible throttle from using almost all CPU resources. The gain, if any, is anyway small even for well scaling SMP, and some engines might even perform worse.

Re: 90 threads now on CCC 3

Posted: Sat Dec 08, 2018 1:30 am
by jdart
Yes, one of the points is that after a while you don't get much gain from more cores.

The scaling does vary though. I am noticing right now that Houdini is apparently getting something over 100M nodes/second on the CCC hardware, which is quite an astonishing number, and Arasan is getting about 30M, a bit more in the endgame. I did give them a version for Windows that is aware of processor groups but I am not clear that is what they are running. I don't have hardware even close to this to test on.

--Jon

Re: 90 threads now on CCC 3

Posted: Sat Dec 08, 2018 2:45 am
by lucasart
jdart wrote: Fri Dec 07, 2018 6:02 pm I am not really sure running with these high core counts is such as great idea because you're taking a program designed for one kind of environment and dropping it into something quite different.

There are going to be some inefficiencies that prevent linear scaling. Some engines may do better than others in this respect. But these environments may test scaling more than they test search or eval, and the results won't give a very indicator of relative strength to people who don't have $20,000+ computer systems.

--Jon
Indeed. This will not be so much a chess contest than a stability contest. Those that don't crash win. Most engines aren't tested for this kind of use case. And even those that are flawless without any SMP bug (assuming this is even possible which I doubt) will show very little gain on so many threads. You're probably better off stopping at 8 or 16 threads. After that you are just wasting electricity, and crashing engines.