THE SSDF RATING LIST 2017-07-27

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

Lars Sandin
Posts: 2032
Joined: Sun Nov 18, 2007 5:17 pm
Location: Sundsvall, Sweden

THE SSDF RATING LIST 2017-07-27

Post by Lars Sandin »

Code: Select all

THE SSDF RATING LIST 2017-07-27   %142106 games played by  360 computers							
                                           Rating   +	  -  Games   Won  Oppo
                                           ------  ---   --- -----   ---  ----
   1 Komodo 11.01 MP x64 16GB 1800X 3,6 GHz  3406   44   -40   334   72%  3244
   2 Deep Shredder 13 x64 16GB 1800X 3,6 GHz 3385   41   -38   360   70%  3237
   3 Komodo 9.1 MP x64 2GB Q6600 2,4 GHz     3354   25   -23  1191   78%  3133
   4 Stockfish 6 MP x64 2GB Q6600 2,4 GHz    3331   26   -24   936   73%  3155
   5 Deep Shredder 13 x64 2GB Q6600 2,4 GHz  3297   26   -25   764   64%  3198
   6 Komodo 7.0 MP x64 2GB Q6600 2,4 GHz     3270   27   -25   814   69%  3130
   7 Komodo 5.1 MP x64 2GB Q6600 2,4 GHz     3245   23   -22   998   65%  3134
   8 Deep Hiarcs 14 16GB 1800X 3,6 GHz       3207   41   -42   280   43%  3258
   9 Stockfish 3 MP x64 2GB Q6600 2,4 GHz    3205   19   -19  1340   62%  3117
  10 Deep Rybka 4 x64  2GB Q6600 2,4 GHz     3201   21   -20  1288   67%  3080
  11 Deep Rybka 3 x64  2GB Q6600 2,4 GHz     3193   22   -21  1371   75%  3001
  12 Deep Hiarcs 14 2GB Q6600 2,4 GHz        3190   19   -19  1330   62%  3107
  13 Chiron 3.01 MP x64 2GB Q6600 2,4 GHz    3182   32   -32   456   47%  3202
  14 Naum 4.2 MP x64 2GB Q6600 2,4 GHz       3146   21   -21  1123   60%  3077
  15 Deep Junior Yokoh x64 2GB Q6600 2,4 GHz 3122   25   -25   730   49%  3129
  16 Naum 4 x64  2GB Q6600 2,4 GHz           3118   20   -19  1356   64%  3016
  17 Deep Junior 13.3 x64 2GB Q6600 2,4 GHz  3115   20   -20  1170   51%  3106
  18 Hiarcs 14 256MB Athlon 1200 MHz         3106   34   -33   440   62%  3019
  19 Spike 1.4 MP 2GB Q6600  2,4 GHz         3104   17   -17  1631   56%  3059
  20 Deep Shredder 12 x64 2GB Q6600 2,4 GHz  3103   18   -18  1507   62%  3015
  21 Hiarcs 13.1  2GB Q6600 2,4 GHz          3099   24   -23   868   56%  3054
  22 Deep Fritz 13 2GB Q6600 2,4 GHz         3097   24   -24   826   55%  3064
  23 Deep Hiarcs 13.2  2GB Q6600 2,4 GHz     3096   24   -24   832   55%  3064
  24 Deep Fritz 12 2GB Q6600 2,4 GHz         3090   20   -20  1200   55%  3054
  25 Deep Rybka 3  256MB Athlon 1200 MHz     3074   39   -37   332   58%  3018
  26 Deep Junior 12 x64 2GB  Q6600 2,4 GHz   3071   20   -20  1198   57%  3018
  27 Deep Fritz 11  2GB Q6600 2,4 GHz        3059   18   -18  1504   62%  2975
  28 Zappa Mexico II x64  2GB Q6600 2,4 GHz  3059   23   -22   942   56%  3014
  29 Naum 3.1 x64  2GB Q6600 2,4 GHz         3044   23   -23   906   52%  3031
  30 Crafty 25.0 MP x64 2GB Q6600 2,4 GHz    3023   25   -26   764   37%  3118
  31 Naum 4  256MB Athlon 1200 MHz           3000   24   -24   836   40%  3069
  32 Arasan 17.2 MP x64 2GB Q6600 2,4 GHz    2999   26   -26   686   46%  3027
  33 Fritz 13 256MB Athlon 1200 MHz          2995   45   -41   280   65%  2887
  34 Glaurung 2.2 x64 MP 2GB Q6600 2,4 GHz   2994   20   -19  1225   55%  2961
  35 Wasp 2.01 256 MB Athlon 1200 MHz        2988   55   -49   200   68%  2862
  36 Shredder 12 256MB A1200 MHz             2984   25   -27   760   35%  3090
  37 Fritz 12  256MB  A1200 MHz              2953   25   -24   820   63%  2862
  38 Revelation II Hiarcs 14.1               2924   47   -46   220   55%  2888
  39 CM King 3.5 x64 MP 2GB  Q6600 2,4 GHz   2858   25   -26   852   30%  3006
  40 Pro Deo 2.1 YAT 256MB Athlon 1200 MHz   2821   34   -33   440   59%  2758
  41 Pro Deo 2.0 256MB Athlon 1200 MHz       2798   30   -30   520   46%  2825
  42 Pocket Fritz 4 Naum 4.2 Ipaq 214        2785   50   -47   210   60%  2711
  43 Revelation Hiarcs 13.3 XScale 500 MHz   2772   57   -52   177   66%  2660
  44 Revelation Shredder 12  XScale 500 MHz  2705   60   -58   140   56%  2664
  45 Revelation Rybka 2.2  XScale 500 MHz    2629   47   -44   240   62%  2546
  46 Revelation Deep Sjeng 3.0               2599   68   -76   100   37%  2691
  47 R30 v. 2.5                              2273   42   -38   343   69%  2135
  48 Millenium ChessGenius Pro M4 120 MHz    2180   92   -72   100   76%  1988
  49 Millenium ChessGenius ARM M4 48 MHz     2077   61   -57   140   59%  2018
  50 Mephisto Nigel Short 6502 5 MHz         1954   52   -52   177   51%  1949

 1 Komodo 11.01 MP x64 16GB 1800X 3,6 GHz, 3406											
Komo9.1 Q6600   25,5-18,5  Stockf6 Q6600   24,5-15,5  DShre13 Q6600     30-10
Komo7.0 Q6600   29,5-10,5  Stockf3 Q6600   34,5-15,5  DRybka4 Q6600   30,5-9,5 
DHiar14 Q6600   30,5-9,5   Spike14 Q6600     34-6     

 2 Deep Shredder 13 x64 16GB 1800X 3,6 GHz, 3385											
Komo9.1 Q6600     21-19    Stockf6 Q6600   23,5-16,5  DShre13 Q6600   23,5-16,5
Komo7.0 Q6600     26-14    DHiar14 1800X     25-15    Stockf3 Q6600   33,5-6,5 
DHiar14 Q6600     31-9     Chiro3 Q6600    29,5-10,5  Hia13.2 Q6600   38,5-1,5 

 8 Deep Hiarcs 14 16GB 1800X 3,6 GHz, 3207											
DShre13 1800X     15-25    Komo9.1 Q6600   12,5-27,5  Stockf6 Q6600    9,5-30,5
DShre13 Q6600   11,5-28,5  Stockf3 Q6600     20-20    Naum 4  Q6600     25-15
DJun133 Q6600     26-14    

 35 Wasp 2.01 256 MB Athlon 1200 MHz, 2988											
Fritz13 A1200   17,5-22,5  Fritz12 A1200     23-17    Zap!Zan A1200   30,5-9,5 
PDeo20 A1200    31,5-8,5   GT2.0 A1200     32,5-7,5   

 48 Millenium ChessGenius Pro M4 120 MHz, 2180											
MCG               13-7     Star Sapphire   12,5-7,5   Milano Pro      15,5-4,5 
Nigel Short     15,5-4,5   Diablo 68000      19-1     

We can now present the early results from the testing on our new hardware
level - the AMD Ryzen 7 1800X, which is an 8-core processor at 3,6 GHz. We 
have opted for 16 GB RAM as standard on this hardware - compared to 2 GB 
on our older Q6600 hardware. Similar to the Q6600, we utilize a 64-bit OS for 
the testing. On our older hardware we had 5 piece Nalimov/Syzygy endgame 
databases as standard. On this new platform we have chosen to also add 6 piece 
Syzygy, installed on SSD, for the programs that are able to utilize it.

We started of by testing two programs which we already had tested on our older
Q6600 level: Mark Uniackes Deep Hiarcs 14 and Stefan Meyer-Kahlens Deep 
Shredder 13. Deep Hiarcs 14 has reached the rating of 3207 after the first 280
games, while Deep Shredder 13 has a rating of 3385 after the first 360 games. 
The difference in rating between the Q6600 and 1800X are +17 and +88 points
for these two programs. We will see what will happen as more games will be 
played. 

Topping our list, 21 points above Deep Shredder 13, is Komodo 11.01, which we
have tested on our 1800X hardware level. It's the first program on our
ratinglist to break the 3400-mark and Komodo 11.01 has got a rating of 3406
after the first 334 games! Congratulations to Mark Lefler and Larry Kaufman
for achieving this! 

The fourth new entrant on the list is a very welcome comeback by the former
Zarkov-programmer - John Stanback, with his latest program Wasp 2.01. We have
started of by testing his program on our single processor, 32 bit hardware 
level, the A1200. After 200 games his latest program has reached a rating just
shy of the 3000-mark by a mere 12 points. As it was released without any 
opening-book, we have used the free 'Perfect 2017' book by Sedat Canbaz.
As Wasp is multi-processor capable, we will also test it on our other hardware
levels for upcoming lists. 

The last new entrant on our latest ratinglist is the manually tested,
Millenium ChessGenius Pro dedicated chess computer. It is a faster version of 
the already tested Millenium ChessGenius chess computer, with more memory and 
an updated Modern opening book - which we have used for the testing. It was 
released in the autumn of 2016 by the company Millenium GmbH. It includes the 
program of Richard Lang and recieves its power from an ARM Cortex M4 processor 
running at a frequency of 120 MHz. After 100 games it has recieved a rating of 
2180, which is a good 103 points more than its former version! 

For the upcoming lists we will get some more games with the newest additions, 
but will also extend our testing on the 1800X with more programs. We have 
started the testing of Komodo 11.01 on our Q6600 level and Wasp 2.01 on our 
Q6600, and 1800X level. Hopefully we can also present a later Stockfish 
version on our upcoming list. For the next list we will most probably have 
enough games to be able to present the Chess Genius 3 for Android and 
possibly also the Revelation Ruffian 2.1 dedicated chess computer. 
We will shortly begin testing of the newest Millenium ChessGenius Exclusive
computer, but as it takes some time to reach our limit of 100 manual 
testgames, it will most probably not have enough games before next year. 

Lars Sandin  
Lars Sandin, SSDF
Lyudmil Tsvetkov
Posts: 6052
Joined: Tue Jun 12, 2012 12:41 pm

Re: THE SSDF RATING LIST 2017-07-27

Post by Lyudmil Tsvetkov »

Lars Sandin wrote:

Code: Select all

THE SSDF RATING LIST 2017-07-27   %142106 games played by  360 computers							
                                           Rating   +	  -  Games   Won  Oppo
                                           ------  ---   --- -----   ---  ----
   1 Komodo 11.01 MP x64 16GB 1800X 3,6 GHz  3406   44   -40   334   72%  3244
   2 Deep Shredder 13 x64 16GB 1800X 3,6 GHz 3385   41   -38   360   70%  3237
   3 Komodo 9.1 MP x64 2GB Q6600 2,4 GHz     3354   25   -23  1191   78%  3133
   4 Stockfish 6 MP x64 2GB Q6600 2,4 GHz    3331   26   -24   936   73%  3155
   5 Deep Shredder 13 x64 2GB Q6600 2,4 GHz  3297   26   -25   764   64%  3198
   6 Komodo 7.0 MP x64 2GB Q6600 2,4 GHz     3270   27   -25   814   69%  3130
   7 Komodo 5.1 MP x64 2GB Q6600 2,4 GHz     3245   23   -22   998   65%  3134
   8 Deep Hiarcs 14 16GB 1800X 3,6 GHz       3207   41   -42   280   43%  3258
   9 Stockfish 3 MP x64 2GB Q6600 2,4 GHz    3205   19   -19  1340   62%  3117
  10 Deep Rybka 4 x64  2GB Q6600 2,4 GHz     3201   21   -20  1288   67%  3080
  11 Deep Rybka 3 x64  2GB Q6600 2,4 GHz     3193   22   -21  1371   75%  3001
  12 Deep Hiarcs 14 2GB Q6600 2,4 GHz        3190   19   -19  1330   62%  3107
  13 Chiron 3.01 MP x64 2GB Q6600 2,4 GHz    3182   32   -32   456   47%  3202
  14 Naum 4.2 MP x64 2GB Q6600 2,4 GHz       3146   21   -21  1123   60%  3077
  15 Deep Junior Yokoh x64 2GB Q6600 2,4 GHz 3122   25   -25   730   49%  3129
  16 Naum 4 x64  2GB Q6600 2,4 GHz           3118   20   -19  1356   64%  3016
  17 Deep Junior 13.3 x64 2GB Q6600 2,4 GHz  3115   20   -20  1170   51%  3106
  18 Hiarcs 14 256MB Athlon 1200 MHz         3106   34   -33   440   62%  3019
  19 Spike 1.4 MP 2GB Q6600  2,4 GHz         3104   17   -17  1631   56%  3059
  20 Deep Shredder 12 x64 2GB Q6600 2,4 GHz  3103   18   -18  1507   62%  3015
  21 Hiarcs 13.1  2GB Q6600 2,4 GHz          3099   24   -23   868   56%  3054
  22 Deep Fritz 13 2GB Q6600 2,4 GHz         3097   24   -24   826   55%  3064
  23 Deep Hiarcs 13.2  2GB Q6600 2,4 GHz     3096   24   -24   832   55%  3064
  24 Deep Fritz 12 2GB Q6600 2,4 GHz         3090   20   -20  1200   55%  3054
  25 Deep Rybka 3  256MB Athlon 1200 MHz     3074   39   -37   332   58%  3018
  26 Deep Junior 12 x64 2GB  Q6600 2,4 GHz   3071   20   -20  1198   57%  3018
  27 Deep Fritz 11  2GB Q6600 2,4 GHz        3059   18   -18  1504   62%  2975
  28 Zappa Mexico II x64  2GB Q6600 2,4 GHz  3059   23   -22   942   56%  3014
  29 Naum 3.1 x64  2GB Q6600 2,4 GHz         3044   23   -23   906   52%  3031
  30 Crafty 25.0 MP x64 2GB Q6600 2,4 GHz    3023   25   -26   764   37%  3118
  31 Naum 4  256MB Athlon 1200 MHz           3000   24   -24   836   40%  3069
  32 Arasan 17.2 MP x64 2GB Q6600 2,4 GHz    2999   26   -26   686   46%  3027
  33 Fritz 13 256MB Athlon 1200 MHz          2995   45   -41   280   65%  2887
  34 Glaurung 2.2 x64 MP 2GB Q6600 2,4 GHz   2994   20   -19  1225   55%  2961
  35 Wasp 2.01 256 MB Athlon 1200 MHz        2988   55   -49   200   68%  2862
  36 Shredder 12 256MB A1200 MHz             2984   25   -27   760   35%  3090
  37 Fritz 12  256MB  A1200 MHz              2953   25   -24   820   63%  2862
  38 Revelation II Hiarcs 14.1               2924   47   -46   220   55%  2888
  39 CM King 3.5 x64 MP 2GB  Q6600 2,4 GHz   2858   25   -26   852   30%  3006
  40 Pro Deo 2.1 YAT 256MB Athlon 1200 MHz   2821   34   -33   440   59%  2758
  41 Pro Deo 2.0 256MB Athlon 1200 MHz       2798   30   -30   520   46%  2825
  42 Pocket Fritz 4 Naum 4.2 Ipaq 214        2785   50   -47   210   60%  2711
  43 Revelation Hiarcs 13.3 XScale 500 MHz   2772   57   -52   177   66%  2660
  44 Revelation Shredder 12  XScale 500 MHz  2705   60   -58   140   56%  2664
  45 Revelation Rybka 2.2  XScale 500 MHz    2629   47   -44   240   62%  2546
  46 Revelation Deep Sjeng 3.0               2599   68   -76   100   37%  2691
  47 R30 v. 2.5                              2273   42   -38   343   69%  2135
  48 Millenium ChessGenius Pro M4 120 MHz    2180   92   -72   100   76%  1988
  49 Millenium ChessGenius ARM M4 48 MHz     2077   61   -57   140   59%  2018
  50 Mephisto Nigel Short 6502 5 MHz         1954   52   -52   177   51%  1949

 1 Komodo 11.01 MP x64 16GB 1800X 3,6 GHz, 3406											
Komo9.1 Q6600   25,5-18,5  Stockf6 Q6600   24,5-15,5  DShre13 Q6600     30-10
Komo7.0 Q6600   29,5-10,5  Stockf3 Q6600   34,5-15,5  DRybka4 Q6600   30,5-9,5 
DHiar14 Q6600   30,5-9,5   Spike14 Q6600     34-6     

 2 Deep Shredder 13 x64 16GB 1800X 3,6 GHz, 3385											
Komo9.1 Q6600     21-19    Stockf6 Q6600   23,5-16,5  DShre13 Q6600   23,5-16,5
Komo7.0 Q6600     26-14    DHiar14 1800X     25-15    Stockf3 Q6600   33,5-6,5 
DHiar14 Q6600     31-9     Chiro3 Q6600    29,5-10,5  Hia13.2 Q6600   38,5-1,5 

 8 Deep Hiarcs 14 16GB 1800X 3,6 GHz, 3207											
DShre13 1800X     15-25    Komo9.1 Q6600   12,5-27,5  Stockf6 Q6600    9,5-30,5
DShre13 Q6600   11,5-28,5  Stockf3 Q6600     20-20    Naum 4  Q6600     25-15
DJun133 Q6600     26-14    

 35 Wasp 2.01 256 MB Athlon 1200 MHz, 2988											
Fritz13 A1200   17,5-22,5  Fritz12 A1200     23-17    Zap!Zan A1200   30,5-9,5 
PDeo20 A1200    31,5-8,5   GT2.0 A1200     32,5-7,5   

 48 Millenium ChessGenius Pro M4 120 MHz, 2180											
MCG               13-7     Star Sapphire   12,5-7,5   Milano Pro      15,5-4,5 
Nigel Short     15,5-4,5   Diablo 68000      19-1     

We can now present the early results from the testing on our new hardware
level - the AMD Ryzen 7 1800X, which is an 8-core processor at 3,6 GHz. We 
have opted for 16 GB RAM as standard on this hardware - compared to 2 GB 
on our older Q6600 hardware. Similar to the Q6600, we utilize a 64-bit OS for 
the testing. On our older hardware we had 5 piece Nalimov/Syzygy endgame 
databases as standard. On this new platform we have chosen to also add 6 piece 
Syzygy, installed on SSD, for the programs that are able to utilize it.

We started of by testing two programs which we already had tested on our older
Q6600 level: Mark Uniackes Deep Hiarcs 14 and Stefan Meyer-Kahlens Deep 
Shredder 13. Deep Hiarcs 14 has reached the rating of 3207 after the first 280
games, while Deep Shredder 13 has a rating of 3385 after the first 360 games. 
The difference in rating between the Q6600 and 1800X are +17 and +88 points
for these two programs. We will see what will happen as more games will be 
played. 

Topping our list, 21 points above Deep Shredder 13, is Komodo 11.01, which we
have tested on our 1800X hardware level. It's the first program on our
ratinglist to break the 3400-mark and Komodo 11.01 has got a rating of 3406
after the first 334 games! Congratulations to Mark Lefler and Larry Kaufman
for achieving this! 

The fourth new entrant on the list is a very welcome comeback by the former
Zarkov-programmer - John Stanback, with his latest program Wasp 2.01. We have
started of by testing his program on our single processor, 32 bit hardware 
level, the A1200. After 200 games his latest program has reached a rating just
shy of the 3000-mark by a mere 12 points. As it was released without any 
opening-book, we have used the free 'Perfect 2017' book by Sedat Canbaz.
As Wasp is multi-processor capable, we will also test it on our other hardware
levels for upcoming lists. 

The last new entrant on our latest ratinglist is the manually tested,
Millenium ChessGenius Pro dedicated chess computer. It is a faster version of 
the already tested Millenium ChessGenius chess computer, with more memory and 
an updated Modern opening book - which we have used for the testing. It was 
released in the autumn of 2016 by the company Millenium GmbH. It includes the 
program of Richard Lang and recieves its power from an ARM Cortex M4 processor 
running at a frequency of 120 MHz. After 100 games it has recieved a rating of 
2180, which is a good 103 points more than its former version! 

For the upcoming lists we will get some more games with the newest additions, 
but will also extend our testing on the 1800X with more programs. We have 
started the testing of Komodo 11.01 on our Q6600 level and Wasp 2.01 on our 
Q6600, and 1800X level. Hopefully we can also present a later Stockfish 
version on our upcoming list. For the next list we will most probably have 
enough games to be able to present the Chess Genius 3 for Android and 
possibly also the Revelation Ruffian 2.1 dedicated chess computer. 
We will shortly begin testing of the newest Millenium ChessGenius Exclusive
computer, but as it takes some time to reach our limit of 100 manual 
testgames, it will most probably not have enough games before next year. 

Lars Sandin  
comfortable 80 elo lead for Komodo over SF here.

obviously, SF is lagging far far behind...
JJJ
Posts: 1346
Joined: Sat Apr 19, 2014 1:47 pm

Re: THE SSDF RATING LIST 2017-07-27

Post by JJJ »

Didn't you see it is wrote Stockfish 6 ?
User avatar
Thomas Lagershausen
Posts: 328
Joined: Mon Jun 11, 2007 6:59 pm

Re: THE SSDF RATING LIST 2017-07-27

Post by Thomas Lagershausen »

With this new hardware and the longer timecontrol the SSDF will be a very interesting ratinglist.

I will follow it.

I hope you can test a Stockfish released at the time of Komodo 11.01 soon.

Houdini 5 is also a very welcome guest in a ratinglist.

Thx for your work.
TL
Uri Blass
Posts: 10267
Joined: Thu Mar 09, 2006 12:37 am
Location: Tel-Aviv Israel

Re: THE SSDF RATING LIST 2017-07-27

Post by Uri Blass »

I wonder what is the reason that out of the new engines in the list wasp got inferior hardware.