THE SSDF RATING LIST 2019-12-10

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

Lars Sandin
Posts: 2032
Joined: Sun Nov 18, 2007 5:17 pm
Location: Sundsvall, Sweden

THE SSDF RATING LIST 2019-12-10

Post by Lars Sandin »

Code: Select all

THE SSDF RATING LIST 2019-12-10    152211 games played by  387 computers							
                                           Rating   +	  -  Games   Won  Oppo
                                           ------  ---   --- -----   ---  ----
   1 Stockfish 10 x64 1800X 3.6 GHz          3529   30   -28   680   72%  3366
   2 Stockfish 9 x64 1800X 3.6 GHz           3486   28   -26   802   71%  3327
   3 Komodo 13.1 x64 1800X 3.6 GHz           3470   32   -30   520   64%  3374
   4 Komodo 13.02 x64 1800X 3.6 GHz          3465   30   -29   600   65%  3354
   5 Komodo 12.3 x64 1800X 3.6 GHz           3454   27   -26   760   66%  3336
   6 Stockfish 9 x64 Q6600 2.4 GHz           3449   32   -31   480   56%  3401
   7 Komodo 12.3 x64 Q6600 2.4 GHz           3441   38   -36   360   60%  3364
   8 Stockfish 8 x64 1800X 3.6 GHz           3431   23   -21  1260   75%  3241
   9 Stockfish 8 x64 Q6600 2.4 GHz           3412   31   -30   560   65%  3302
  10 Komodo 13.02 MCTS x64 1800X 3.6 GHz     3401   31   -30   520   57%  3349
  11 Komodo 11.01 x64 1800X 3.6 GHz          3394   22   -21  1254   70%  3247
  12 Deep Shredder 13 x64 1800X 3.6 GHz      3358   24   -24   880   64%  3256
  13 Booot 6.3.1 x64 1800X 3.6 GHz           3354   24   -23   843   51%  3345
  14 Komodo 11.01 x64 Q6600 2.4 GHz          3343   27   -27   642   50%  3339
  15 Komodo 9.1 x64 Q6600 2.4 GHz            3338   20   -19  1475   72%  3177
  16 Stockfish 6 x64 Q6600 2.4 GHz           3326   21   -20  1256   69%  3191
  17 Vajolet2 2.8 x64 1800X 3.6 GHz          3301   61   -65   123   43%  3351
  18 Booot 6.3.1 x64 Q6600 2.4 GHz           3299   30   -30   520   53%  3271
  19 Deep Shredder 13 x64 Q6600 2.4 GHz      3295   24   -23   884   64%  3192
  20 Arasan 21.2 x64 1800X 3.6 GHz           3279   29   -30   560   40%  3348
  21 Komodo 7 x64 Q6600 2.4 GHz              3269   23   -23   974   65%  3159
  22 Komodo 5.1 x64 Q6600 2.4 GHz            3245   22   -22  1038   64%  3145
  23 Arasan 21.2 x64 Q6600 2.4 GHz           3235   48   -52   200   38%  3322
  24 Wasp 3.5 x64 1800X 3.6 GHz              3230   31   -33   520   32%  3359
  25 Deep Hiarcs 14 1800X 3.6 GHz            3217   26   -26   720   40%  3290
  26 Wasp 3 x64 1800X 3.6 GHz                3214   24   -25   842   39%  3292
  27 Stockfish 3 x64 Q6600 2.4 GHz           3202   19   -18  1420   61%  3127
  28 Deep Rybka 4 x64 Q6600 2.4 GHz          3199   20   -19  1368   65%  3093
  29 Deep Rybka 3 x64 Q6600 2.4 GHz          3194   22   -21  1371   75%  3003
  30 Deep Hiarcs 14 Q6600 2.4 GHz            3188   19   -18  1450   61%  3112
  31 Chiron 3.01 x64 Q6600 2.4 GHz           3178   27   -27   656   45%  3215
  32 Wasp 3.5 x64 Q6600 2.4 GHz              3176   41   -42   280   45%  3205
  33 Naum 4.2 x64 Q6600 2.4 GHz              3146   21   -21  1123   60%  3078
  34 Deep Junior Yokohama x64 Q6600 2.4 GHz  3126   22   -22  1010   42%  3184
  35 Hiarcs 14 Athlon 1.2 GHz                3100   29   -29   560   55%  3065
  36 Deep Fritz 13 Q6600 2.4 GHz             3097   24   -24   826   55%  3064
  37 The Baron 3.43 x64 1800X 3.6 GHz        3091   29   -31   680   26%  3272
  38 Revelation 2 Hiarcs 14.1 PXA320 800 MHz 2924   47   -46   220   55%  2889
  39 Chessmaster King 3.5 x64 Q6600 2.4 GHz  2860   24   -25   932   30%  3009
  40 Revelation Hiarcs 13.3 PXA255 500 MHz   2772   57   -52   177   66%  2661
  41 Revelation Shredder 12 PXA255 500 MHz   2703   60   -58   140   56%  2663
  42 Revelation Rybka 2.2 PXA255 500 MHz     2628   47   -44   240   62%  2545
  43 Revelation Deep Sjeng 3 PXA255 500 MHz  2599   68   -76   100   37%  2691
  44 ChessGenius 3 ZTE Apex3 ARM A53 1.3 GHz 2457   75   -68   100   62%  2376
  45 Revelation Ruffian 2.1 PXA255 500 MHz   2352   68   -71   100   45%  2388
  46 TASC R30 v. 2.5 ARM6 30 MHz             2274   42   -38   343   69%  2137
  47 Millenium ChessGenius Excl. M7 300 MHz  2251   71   -68   101   55%  2211
  48 Millenium ChessGenius Pro M4 120 MHz    2166   59   -54   160   63%  2070
  49 Millenium ChessGenius ARM M4 48 MHz     2076   51   -47   211   63%  1986
  50 Mephisto London 68000 12 MHz            2008   59   -58   140   53%  1983

 3 Komodo 13.1 x64 1800X 3.6 GHz, 3470											
Stoc10 1800X      18-22    Stock9 1800X      20-20    Stock9 Q6600      22-18
Komo12 Q6600    22,5-18    Stock8 1800X      20-20    Stock8 Q6600    23,5-16,5
Komo11 1800X      22-18    Booot6 1800X    28,5-12    Komo11 Q6600    27,5-12,5
Booot6 Q6600      29-11    Arasa21 1800X   29,5-11    Was35 1800X     35,5-4,5 
DHiar14 1800X   32,5-8     

 17 Vajolet2 2.8 x64 1800X 3.6 GHz, 3301											
Stoc10 1800X       7-33    Stock8 1800X      12-28    Booot6 1800X       1-2 
Baro343 1800X     33-7     

 47 Millenium ChessGenius Excl. M7 300 MHz, 2251											
Rebel 9.0 P90    6,5-14    Nimzo 3.0 P90      8-12    PTiger09 Tung     12-8 
MCG Pro           13-7     Star Sapphire   15,5-5     Meph. MM 5         1-0 

On this wintry December rating list of 2019, we can present three new entrants.

First out is the Komodo-version which won the ICGA World Computer Chess 
Championship (WCCC) and World Software Chess Championship (WSCC) in Macau this
summer. Komodo is programmed by Mark Lefler and Larry Kaufman, and we have used
Erdogan Guenes opening book for the testing. After 520 games it has placed 
itself third in the rating list with a rating of 3470 on our 1800X platform. 
This is 5 points ahead of the 13.02 version and 16 points behind Stockfish 9. 

Next out is a newcomer on our rating list, namely Vajolet2 2.8 by Marco Belli. 
So far we have only played 123 games, but after those first couple of matches, 
it has performed admirably with a rating of 3301. More games will be needed 
to get a more reliable rating figure and lower the error bars, but the start 
has been very good. We have used Sedat Canbaz free opening book "Perfect2019.abk"
for the testing of Vajolet2 2.8.

Last out this time is the manually tested dedicated chess computer from the 
Millenium GmbH company, named Millenium ChessGenius Exclusive. It has an 
ARM Cortex M7 processor which is clocked at 300 MHz, and has the famous 
ChessGenius program by Richard Lang. Similar to the testing of 
ChessGenius Pro, we have used the opening book by Mark Uniacke for the 
testing. After the first 101 games it has achieved a rating of 2251, which 
is 85 points higher than the ChessGenius Pro.

Some notable losses/gains from the previous list was: Komodo 11.01 Q6600 and 
Booot 6.3.1 Q6600 which gained 10 points each. The rating of Komodo 13.02 1800X
and Komodo 13.02 MCTS 1800X fell after more games was played, and they lost 17
and 23 points. Arasan 21.2 Q6600 also lost 15 points from the last list.

Our upcoming plan is to get more games with Vajolet2 2.8 on the 1800X level and 
also to be able to present enough games with it on our Q6600 hardware. 
The Q6600-version missed the mark for this list, but will be introduced in the 
upcoming rating list instead. We will hopefully also be able to introduce 
some other new programs for that list.

For all those that celebrate Christmas and/or New Year, I will take the 
opportunity to wish you all a Merry Christmas and a Happy New Year from us in
the SSDF. 

Lars Sandin

P.S. Minor correction from the last list: It was Fauzi Dabat's opening book 
which we have used for the testing of Stockfish 10, and not Sedat's. D.S. 
Lars Sandin, SSDF
User avatar
Graham Banks
Posts: 41455
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: THE SSDF RATING LIST 2019-12-10

Post by Graham Banks »

Merry Christmas to you as well, Lars. :)
gbanksnz at gmail.com
Vinvin
Posts: 5228
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: THE SSDF RATING LIST 2019-12-10

Post by Vinvin »

Hi Lars !
Thanks for this new list !

May I suggest some new engines for next updates ?

1) Ethereal 11.75 and Xiphos 0.6 are interesting freewares, their development last for a couple of years, and they reach the very top of engines.

2) Would it be possible to add an engine on a smartphone ? For example DroidFish (= Stockfish) on average Android phone (Processor Cortex-A53, 4 cores @ 1.5 GHz, speed around 1 Mn/sec).

3) Stockfish 11 is coming in a couple of months (or sooner :-) )
Dann Corbit
Posts: 12541
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: THE SSDF RATING LIST 2019-12-10

Post by Dann Corbit »

I am guessing the phones will be difficult.
Unless there is an Auto232 connection or some other way to automate it.
Imagine doing 1000 40/2hrs games by hand.
You gotta sleep sometime
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
User avatar
Ovyron
Posts: 4556
Joined: Tue Jul 03, 2007 4:30 am

Re: THE SSDF RATING LIST 2019-12-10

Post by Ovyron »

I want Leela or another NN on there. Fat Fritz perhaps?
Dann Corbit
Posts: 12541
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: THE SSDF RATING LIST 2019-12-10

Post by Dann Corbit »

If you buy them some GPUs, I bet they would jump on it.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.