CEGT - rating lists March 29th 2020

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

User avatar
Werner
Posts: 2871
Joined: Wed Mar 08, 2006 10:09 pm
Location: Germany
Full name: Werner Schüle

CEGT - rating lists March 29th 2020

Post by Werner »

Hi all,
our actual rating lists are online and can be found under the attached links!

40 / 20:
New games: 2.461; 30 different engines
Total:   1.326.964

NEW Engines
151 SlowChess Blitz Classic 2.0: 3122 - 1000 games (+124 to v. 1.8)
4 LCZero 0.24.1 Cuda (t40-1541): 3493 - 500 games (+18 to v. 0.23.2)
1129 Devel 3.0.0a w32: 2557 - 457 games (< v. 2.0000; stopped-to much games lost in time)

UPDATES
1 Stockfish 11.0 x64 4CPU: 3518 - 1385 games (-1)
462 Topple 0.7.5 x64 1CPU: 2858 - 998 games (-2)


40 / 4
last update was March 25th

40 / 120:
There was an update on 28th of January with +1424 games.

5'+3'' pb=on
Last update was March 23th
with Ethereal 12.0 x64 3243/1600 +9
we are testing SlowChess Blitz Classic 2.0

3'+1'' pb=on
Last update was March 23th
with Ethereal 12.00 x64 3250/2800 +7

A big „Thank you“ to all testers as usual!!

Links

40/20: http://www.cegt.net/rating.htm
Blitz: http://www.cegt.net/blitz.htm
40/120: http://www.cegt.net/rating120.htm
Tester: http://www.cegt.net/testers/testers.htm
3+1 pb=on: http://www.cegt.net/rating3plus1pbon.htm
5+3 pb=on: http://www.cegt.net/rating5plus3pbon.htm
Games of the week: http://www.cegt.net/40_40%20Rating%20Li ... on/gow.jpg

Werner Schüle
CEGT-Team
jdart
Posts: 4366
Joined: Fri Mar 10, 2006 5:23 am
Location: http://www.arasanchess.org

Re: CEGT - rating lists March 29th 2020

Post by jdart »

"Best Single Versions" for 40/20 has 3 versions of Lc0 and 2 versions of Komodo MCTS:

http://www.cegt.net/40_40%20Rating%20Li ... liste.html
User avatar
Werner
Posts: 2871
Joined: Wed Mar 08, 2006 10:09 pm
Location: Germany
Full name: Werner Schüle

Re: CEGT - rating lists March 29th 2020

Post by Werner »

Thanks for the hint,
we will remove some next Sunday.
Regards
Werner
lkaufman
Posts: 5960
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA

Re: CEGT - rating lists March 29th 2020

Post by lkaufman »

jdart wrote: Sun Mar 29, 2020 3:38 pm "Best Single Versions" for 40/20 has 3 versions of Lc0 and 2 versions of Komodo MCTS:

http://www.cegt.net/40_40%20Rating%20Li ... liste.html
This brings up the question of why NNs that require both a GPU and a CPU are even included in a Single Version list, as they require two processors, not one. A normal pc will have several CPU cores but only one GPU, so if a program is mostly GPU-bound then limiting it to only 1 CPU core is only a minor restriction. I imagine there are very few users with just one CPU who also have a decent GPU. I'm glad you include the NNs on your rating list, just not on the Single Version list.
Komodo rules!
Modern Times
Posts: 3546
Joined: Thu Jun 07, 2012 11:02 pm

Re: CEGT - rating lists March 29th 2020

Post by Modern Times »

lkaufman wrote: Sun Mar 29, 2020 8:55 pm
This brings up the question of why NNs that require both a GPU and a CPU are even included in a Single Version list, as they require two processors, not one. A normal pc will have several CPU cores but only one GPU, so if a program is mostly GPU-bound then limiting it to only 1 CPU core is only a minor restriction. I imagine there are very few users with just one CPU who also have a decent GPU. I'm glad you include the NNs on your rating list, just not on the Single Version list.
It is a tricky issue. In CCRL we currently treat the GTX1050 and below as single CPU, and the RTX2080 as multiple CPU. I'm not sure there is a right or wrong answer. In reality the GTX1050 is probably in between 1 and 2CPU. But your point is that all GPU engines should be treated as multi-CPU because they use both CPU and GPU ? Definitely a strong argument for that. GPU testing is a bit of a nightmare !
jp
Posts: 1470
Joined: Mon Apr 23, 2018 7:54 am

Re: CEGT - rating lists March 29th 2020

Post by jp »

Modern Times wrote: Sun Mar 29, 2020 9:14 pm It is a tricky issue. In CCRL we currently treat the GTX1050 and below as single CPU, and the RTX2080 as multiple CPU. I'm not sure there is a right or wrong answer. In reality the GTX1050 is probably in between 1 and 2CPU.
But is the CPU version of Leela on the list? That obviously can be single CPU with no fudging.
User avatar
Werner
Posts: 2871
Joined: Wed Mar 08, 2006 10:09 pm
Location: Germany
Full name: Werner Schüle

Re: CEGT - rating lists March 29th 2020

Post by Werner »

lkaufman wrote: Sun Mar 29, 2020 8:55 pm This brings up the question of why NNs that require both a GPU and a CPU are even included in a Single Version list, as they require two processors, not one. A normal pc will have several CPU cores but only one GPU, so if a program is mostly GPU-bound then limiting it to only 1 CPU core is only a minor restriction. I imagine there are very few users with just one CPU who also have a decent GPU. I'm glad you include the NNs on your rating list, just not on the Single Version list.
We slowed down our graphic cards to get a ratio near 1 in comparison to 1CPU Stockfish. This is the way we tried to solve this issue (this is our standard). And here for instance for some faster cards we even use 1CPU for NN engines. This is not always easy as Scorpio uses per default all threads of the pc and Stoofvlees is a hybrid engine using 4 threads of my quad but with only 25% of the CPU.
Werner
Modern Times
Posts: 3546
Joined: Thu Jun 07, 2012 11:02 pm

Re: CEGT - rating lists March 29th 2020

Post by Modern Times »

jp wrote: Sun Mar 29, 2020 10:33 pm
Modern Times wrote: Sun Mar 29, 2020 9:14 pm It is a tricky issue. In CCRL we currently treat the GTX1050 and below as single CPU, and the RTX2080 as multiple CPU. I'm not sure there is a right or wrong answer. In reality the GTX1050 is probably in between 1 and 2CPU.
But is the CPU version of Leela on the list? That obviously can be single CPU with no fudging.
Yes.