THE SSDF RATING LIST 2018-10-16

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

Lars Sandin
Posts: 2032
Joined: Sun Nov 18, 2007 5:17 pm
Location: Sundsvall, Sweden

THE SSDF RATING LIST 2018-10-16

Post by Lars Sandin »

Code: Select all

THE SSDF RATING LIST 2018-10-16    146423 games played by  371 computers							
                                           Rating   +	  -  Games   Won  Oppo
                                           ------  ---   --- -----   ---  ----
   1 Stockfish 9 x64 1800X 3.6 GHz           3502   38   -35   482   76%  3302
   2 Stockfish 8 x64 1800X 3.6 GHz           3430   30   -27   860   79%  3203
   3 Stockfish 8 x64 Q6600 2.4 GHz           3416   47   -43   280   70%  3269
   4 Komodo 11.01 x64 1800X 3.6 GHz          3395   26   -24   974   75%  3208
   5 Deep Shredder 13 x64 1800X 3.6 GHz      3367   30   -28   640   68%  3238
   6 Booot 6.3.1 x64 1800X 3.6 GHz           3347   40   -38   320   60%  3273
   7 Komodo 9.1 x64 Q6600 2.4 GHz            3342   21   -20  1395   73%  3167
   8 Komodo 11.01 x64 Q6600 2.4 GHz          3340   35   -34   402   60%  3269
   9 Stockfish 6 x64 Q6600 2.4 GHz           3330   22   -21  1176   69%  3190
  10 Deep Shredder 13 x64 Q6600 2.4 GHz      3296   24   -23   884   64%  3193
  11 Komodo 7 x64 Q6600 2.4 GHz              3269   24   -23   934   65%  3159
  12 Komodo 5.1 x64 Q6600 2.4 GHz            3246   22   -22  1038   64%  3145
  13 Deep Hiarcs 14 1800X 3.6 GHz            3211   30   -31   520   41%  3270
  14 Stockfish 3 x64 Q6600 2.4 GHz           3202   19   -19  1380   61%  3125
  15 Deep Rybka 4 x64 Q6600 2.4 GHz          3201   21   -20  1288   67%  3080
  16 Deep Rybka 3 x64 Q6600 2.4 GHz          3194   22   -21  1371   75%  3002
  17 Deep Hiarcs 14 Q6600 2.4 GHz            3188   19   -18  1450   61%  3113
  18 Chiron 3.01 x64 Q6600 2.4 GHz           3182   27   -28   616   45%  3217
  19 Wasp 2.01 x64 1800X 3.6 GHz             3161   28   -29   646   35%  3270
  20 Naum 4.2 x64 Q6600 2.4 GHz              3146   21   -21  1123   60%  3078
  21 Deep Junior Yokohama x64 Q6600 2.4 GHz  3125   22   -23   930   43%  3170
  22 Naum 4 x64 Q6600 2.4 GHz                3120   19   -18  1436   61%  3039
  23 Deep Junior 13.3 x64 Q6600 2.4 GHz      3117   19   -19  1290   50%  3119
  24 The Baron 3.43 x64 1800X 3.6 GHz        3115   39   -42   320   35%  3222
  25 Spike 1.4 Q6600 2.4 GHz                 3109   16   -16  1911   53%  3090
  26 Deep Shredder 12 x64 Q6600 2.4 GHz      3104   18   -18  1507   62%  3016
  27 Hiarcs 14 Athlon 1.2 GHz                3100   33   -31   480   62%  3018
  28 Hiarcs 13.1 Q6600 2.4 GHz               3099   24   -23   868   56%  3055
  29 Deep Hiarcs 13.2 Q6600 2.4 GHz          3098   23   -23   872   55%  3061
  30 Deep Fritz 13 Q6600 2.4 GHz             3097   24   -24   826   55%  3064
  31 Wasp 2.01 x64 Q6600 2.4 GHz             3062   42   -50   362   19%  3312
  32 Crafty 25 x64 Q6600 2.4 GHz             3028   25   -26   804   35%  3135
  33 The Baron 3.43 x64 Q6600 2.4 GHz        3026   34   -34   400   50%  3022
  34 Arasan 17.2 x64 Q6600 2.4 GHz           3000   26   -26   686   46%  3029
  35 Naum 4 Athlon 1.2 GHz                   2996   23   -24   876   40%  3066
  36 Fritz 13 Athlon 1.2 GHz                 2992   45   -41   280   65%  2881
  37 Shredder 12 Athlon 1.2 GHz              2982   25   -27   760   35%  3089
  38 Wasp 2.01 Athlon 1.2 GHz                2960   32   -31   480   55%  2924
  39 Revelation 2 Hiarcs 14.1 PXA320 800 MHz 2923   47   -46   220   55%  2889
  40 Chessmaster King 3.5 x64 Q6600 2.4 GHz  2861   24   -25   932   30%  3010
  41 Pro Deo 2.1 YAT Athlon 1.2 GHz          2826   32   -31   480   57%  2780
  42 Revelation Hiarcs 13.3 PXA255 500 MHz   2772   57   -52   177   66%  2660
  43 Revelation Shredder 12 PXA255 500 MHz   2703   60   -58   140   56%  2663
  44 Revelation Rybka 2.2 PXA255 500 MHz     2628   47   -44   240   62%  2545
  45 Revelation Deep Sjeng 3 PXA255 500 MHz  2599   68   -76   100   37%  2691
  46 ChessGenius 3 ZTE Apex3 ARM A53 1.3 GHz 2458   75   -68   100   62%  2375
  47 Revelation Ruffian 2.1 PXA255 500 MHz   2351   68   -71   100   45%  2392
  48 TASC R30 v. 2.5 ARM6 30 MHz             2273   42   -38   343   69%  2136
  49 Millenium ChessGenius Pro M4 120 MHz    2179   72   -63   120   68%  2051
  50 Millenium ChessGenius ARM M4 48 MHz     2087   57   -53   169   62%  2001

 1 Stockfish 9 x64 1800X 3.6 GHz, 3502											
Stock8 1800X    21,5-18,5  Stock8 Q6600    26,5-13,5  Komo11 1800X      25-15
DShre13 1800X     27-13    Booot6 1800X      28-12    Komo9.1 Q6600     34-8 
Komo11 Q6600    28,5-11,5  Stockf6 Q6600     33-7     Komo7.0 Q6600   32,5-7,5 
Wasp201 1800X     35-5     Baro343 1800X   37,5-2,5   Spike14 Q6600     37-3 

 3 Stockfish 8 x64 Q6600 2.4 GHz, 3416											
Stock9 1800X    13,5-26,5  Booot6 1800X    27,5-12,5  Komo9.1 Q6600   28,5-11,5
Komo11 Q6600    21,5-18,5  Stockf6 Q6600   28,5-11,5  Baro343 Q6600   37,5-2,5 
Glaurung Q660     39-1     
 
 6 Booot 6.3.1 x64 1800X 3.6 GHz, 3347											
Stock9 1800X      12-28    Stock8 Q6600    12,5-27,5  Komo9.1 Q6600     19-21
Stockf6 Q6600   19,5-20,5  DHiar14 1800X   29,5-10,5  Wasp201 1800X   32,5-7,5 
Baro343 1800X     35-5     Spike14 Q6600   32,5-7,5   

 24 The Baron 3.43 x64 1800X 3.6 GHz, 3115											
Stock9 1800X     2,5-37,5  Komo11 1800X       7-33    Booot6 1800X       5-35
Stockf6 Q6600      3-37    Wasp201 1800X   16,5-23,5  Spike14 Q6600     19-21
Zap!Mx2 Q6600     24-16    King3.5 Q6600     35-5     

 33 The Baron 3.43 x64 Q6600 2.4 GHz, 3026											
Stock8 Q6600     2,5-37,5  DShre13 Q6600    5,5-34,5  Hiarc14 A1200   17,5-22,5
Hia13.2 Q6600     12-28    DShre11 Q6600   18,5-21,5  Naum 4  A1200     24-16
DFritz8 Q6600   24,5-15,5  Junio10 A1200   32,5-7,5   PDeo21 A1200    26,5-13,5
Hiarcs9 A1200     38-2     

For this October Rating list we can present five new Chess Computer programs.
First out is Stockfish 9 by Tord Romstad, Marco Costalba and Joona Kiiski. For
the testing of this program, we have used the updated free opening book from 
Fauzi Dabat, called "Aggressive 3.5 by Fauzi.abk". As you can see from the 
Rating list, this very strong combo has managed to break the 3500-barrier for 
the first time in our Rating list! The rating of 3502 after 482 played games
is a whopping 72 point stronger than it's former version which we introduced 
in the list back in January this year. 

The next new version we have in this list, is the Stockfish 8, which 
we now have enough games with on our older Q6600-platform. After 280 played 
games it has reached a very strong rating of 3416, trailing it's 8-sibling on 
our fastest 1800X-hardware by only 14 points! More games will be needed to 
see if this difference will hold steady. We have of course used the same 
opening book for the testing of Stockfish 8 Q6600, as we have used when we
tested Stockfish 8 on the 1800X, that is the "Aggressive 3.2 by Fauzi.abk".

The next new entrant was one of the contenders in the ICGA World Chess
Championship, which was held here in Sweden/Stockholm in July this year. 
This program is called Booot 6.3.1, is made by Alex Morozov and 
became runner-up behind Komodo in the Unified Hardware category of the 
Championship! Its rating of 3347 after 320 games are indeed very strong and
especially considering it hasn't support for Endgame Tablebases like the 
other programs which we have tested on our Ryzen 1800X-hardware.
Alex wanted us to use the same book in our testing, as he used in the 
championship, that is the free "perfect2017.abk" opening book by Sedat Canbaz. 

The last entrant on our ratinglist was also a contender in the ICGA
Championship, and it is Richard Pijl's - The Baron. On our fastest hardware - 
the 1800X, The Baron 3.43 has reached a rating of 3115 after 320 games. 
We have also tested it on our Q6600-hardware and there it has reached a 
rating of 3026 after 400 played games.

It uses its own opening book and tablebases on our Q6600 and 1800X machines,
but has had some tablebase issues with 5 piece Endgame Tablebases like the 
standard we have on our Q6600 machines. This has affected its performance  
somewhat. According to Richard, this issue is corrected for future releases 
of The Baron, so we hope to be able to test an updated version in an upcoming
Rating list. This issue hasn't affected the testing on the 1800X-machines, as
it hasn't any issues with the 6 piece Endgame Tablebases we have as standard 
on this hardware.

Compared to our former Rating list, Komodo 11.01 Q6600 gained 7 points, Pro
Deo 2.1 YAT A1200 gained 6, while Spike 1.4 Q6600 and the Android version
of Chess Genius 3 gained 4 points. Komodo 9.1 Q6600 lost 10 points, Wasp 2.01
on the A1200 lost 8, Revelation Ruffian lost 6 and Hiarcs 14 A1200 lost 5 
points. 

We have begun testing of John Stanback's latest Wasp version for our next 
Rating list, and we hope to also begin testing of a more recent version of 
both the ordinary Komodo and its Monte Carlo Tree Search (MCTS) version. 
We will also hopefully be able to add both Stockfish 9 and Booot to our 
testing on the Q6600 hardware level. 

The next list will be out approximately in December/January depending 
on how many new games we will have until then. 
 
Lars Sandin 
Lars Sandin, SSDF
mehmet karaman
Posts: 142
Joined: Tue Jan 28, 2014 8:37 am
Location: TURKEY

Re: THE SSDF RATING LIST 2018-10-16

Post by mehmet karaman »

Thanks for this great rating list. Thanks for a quarter century of working.
Modern Times
Posts: 3546
Joined: Thu Jun 07, 2012 11:02 pm

Re: THE SSDF RATING LIST 2018-10-16

Post by Modern Times »

I second that.
ernest
Posts: 2041
Joined: Wed Mar 08, 2006 8:30 pm

Re: THE SSDF RATING LIST 2018-10-16

Post by ernest »

mehmet karaman wrote: Tue Oct 16, 2018 8:42 pm ... Thanks for a quarter century of working.
No, 34 years !!! :D
Dann Corbit
Posts: 12538
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: THE SSDF RATING LIST 2018-10-16

Post by Dann Corbit »

Thanks for your tremendous, tireless efforts.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
User avatar
icander
Posts: 921
Joined: Fri Mar 10, 2006 11:21 am
Location: Lulea, Sweden

Re: THE SSDF RATING LIST 2018-10-16

Post by icander »

ernest wrote: Wed Oct 17, 2018 1:15 am
mehmet karaman wrote: Tue Oct 16, 2018 8:42 pm ... Thanks for a quarter century of working.
No, 34 years !!! :D
We actually started 1979. So it will soon be 40 years.
Tony, SSDF