SSDF Rating List 2013-11-11

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

Lars Sandin
Posts: 2032
Joined: Sun Nov 18, 2007 5:17 pm
Location: Sundsvall, Sweden

SSDF Rating List 2013-11-11

Post by Lars Sandin »

Code: Select all

THE SSDF RATING LIST 2013-11-11   %132746 games played by  337 computers							
                                           Rating   +	  -  Games   Won  Oppo
                                           ------  ---   --- -----   ---  ----
   1 Komodo 5.1 MP x64 2GB Q6600 2,4 GHz     3241   56   -51   181   65%  3132
   2 Stockfish 3 MP x64 2GB Q6600 2,4 GHz    3211   27   -25   838   72%  3051
   3 Deep Rybka 4 x64  2GB Q6600 2,4 GHz     3208   26   -24   966   74%  3028
   4 Deep Hiarcs 14 2GB Q6600 2,4 GHz        3205   25   -24   928   69%  3064
   5 Deep Rybka 3 x64  2GB Q6600 2,4 GHz     3197   23   -21  1331   76%  2995
   6 Naum 4.2 MP x64 2GB Q6600 2,4 GHz       3150   23   -22   999   62%  3062
   7 Hiarcs 14 256MB Athlon 1200 MHz         3134   88   -65   160   84%  2845
   8 Naum 4 x64  2GB Q6600 2,4 GHz           3123   22   -21  1156   69%  2981
   9 Deep Junior 13.3 2GB x64 Q6600 2,4 GHz  3117   24   -23   842   56%  3074
  10 Deep Shredder 12 x64 2GB Q6600 2,4 GHz  3107   19   -19  1421   64%  3006
  11 Spike 1.4 MP 2GB Q6600  2,4 GHz         3106   20   -19  1309   62%  3019
  12 Deep Hiarcs 13.2  2GB Q6600 2,4 GHz     3103   28   -27   632   60%  3031
  13 Hiarcs 13.1  2GB Q6600 2,4 GHz          3101   24   -24   828   58%  3044
  14 Deep Fritz 13 2GB Q6600 2,4 GHz         3100   26   -26   706   57%  3049
  15 Deep Fritz 12 2GB Q6600 2,4 GHz         3091   21   -21  1080   55%  3053
  16 Deep Rybka 3  256MB Athlon 1200 MHz     3074   39   -37   332   58%  3018
  17 Deep Junior 12 x64 2GB  Q6600 2,4 GHz   3071   22   -21  1058   60%  2997
  18 Deep Fritz 11  2GB Q6600 2,4 GHz        3063   19   -18  1464   62%  2975
  19 Zappa Mexico II x64  2GB Q6600 2,4 GHz  3054   25   -25   776   59%  2989
  20 Naum 3.1 x64  2GB Q6600 2,4 GHz         3040   27   -26   692   58%  2986
  21 Deep Hiarcs 12  2GB Q6600 2,4 GHz       3018   18   -18  1427   54%  2993
  22 Deep Shredder 11 x64 2GB Q6600  2,4 GHz 3013   22   -22   968   52%  3001
  23 Arasan 16.0 MP x64 2GB Q6600 2,4 GHz    3006   41   -43   286   38%  3092
  24 Glaurung 2.2 x64 MP 2GB Q6600 2,4 GHz   2992   21   -21  1085   57%  2941
  25 Hiarcs 11.2 MP  2GB  Q6600  2,4 GHz     2991   21   -21  1085   48%  3004
  26 Naum 4  256MB Athlon 1200 MHz           2986   28   -28   614   50%  2983
  27 Fritz 13 256MB Athlon 1200 MHz          2982   55   -51   180   63%  2889
  28 Shredder 12 256MB A1200 MHz             2969   29   -30   534   46%  2997
  29 Deep Junior 10.1  2GB  Q6600  2,4 GHz   2967   23   -23   886   46%  2995
  30 Fritz 12  256MB  A1200 MHz              2947   28   -27   660   61%  2868
  31 Rybka 2.3.1 Arena 256MB Athlon 1200 MHz 2917   21   -21  1025   51%  2911
  32 Jonny 4.0 MP 2GB Q6600 2,4 GHz          2901   29   -31   640   29%  3056
  33 Deep Fritz 8 2GB  Q6600  2,4 GHz        2898   23   -24   969   35%  3009
  34 Shredder 8 MP 2GB  Q6600  2,4 GHz       2885   24   -25   908   32%  3012
  35 Deep Junior 8  2GB Q6600 2,4 GHz        2861   24   -25   952   30%  3011
  36 CM King 3.5 x64 MP 2GB  Q6600 2,4 GHz   2856   26   -28   752   29%  3008
  37 Zap!Chess Zanzibar 256MB Athlon 1200 MH 2832   21   -21  1100   50%  2836
  38 Fruit 2.2.1  256MB Athlon 1200 MHz      2829   18   -18  1465   59%  2767
  39 Pocket Fritz 4 Naum 4.2 Ipaq 214        2812   66   -59   135   64%  2708
  40 Pro Deo 1.82 256MB Athlon 1200 MHz      2796   37   -37   346   45%  2830
  41 Pocket Fritz 4 Hiarcs 13 Ipaq 214       2755   57   -54   160   59%  2689
  42 Revelation Shredder 12  XScale 500 MHz  2705   60   -58   140   56%  2665
  43 Pocket Shredder Ipaq 114 624 MHz        2700   55   -51   180   63%  2612
  44 Hiarcs Palm Chess 12.1 T5               2652   63   -64   120   48%  2663
  45 Revelation Rybka 2.2  XScale 500 MHz    2628   47   -44   240   62%  2546
  46 Resurrection Rybka 2.2 StrongARM 203 MH 2484   43   -42   260   51%  2477
  47 Resurrection Fruit '05 StrongARM 203 MH 2393   67   -62   120   60%  2320
  48 R30 v. 2.5                              2271   42   -38   343   69%  2134
  49 Chess Genius 3 Iphone 4 ARM A8 800MHz   2258   82   -69   100   69%  2119
  50 Palm Tiger 2009 Tung C  400 MHz         2230   51   -53   180   43%  2277


 1 Komodo 5.1 MP x64 2GB Q6600 2,4 GHz, 3242											
Stockf3 Q6600   21,5-18,5  DHiar14 Q6600   23,5-16,5  Naum4.2 Q6600     24-16
DJuni12 Q6600   29,5-10,5  Rybk231 A1200   19,5-1,5   

 2 Stockfish 3 MP x64 2GB Q6600 2,4 GHz, 3211											
Komo5.1 Q6600   18,5-21,5  DRybka4 Q6600     19-21    DHiar14 Q6600   22,5-21,5
DRybka3 Q6600     19-21    Naum4.2 Q6600     23-17    Naum 4  Q6600     28-12
DJun133 Q6600     28-14    DShre12 Q6600     30-10    Spike14 Q6600     26-14
Hiarc13 Q6600     28-12    DFrit13 Q6600   24,5-15,5  DFrit12 Q6600   26,5-13,5
DJuni12 Q6600   27,5-12,5  Arasa16 Q6600     34-6     Hiar112 Q6600   33,5-6,5 
Shred12 A1200   40,5-7,5   Jonny 4 Q6600   36,5-3,5   Juni101 A1200   41,5-6,5 
CT 2007 A1200     47-1     PDeo182 A1200     46-2     

 7 Hiarcs 14 256MB Athlon 1200 MHz, 3135											
Fritz13 A1200   27,5-12,5  Fritz12 A1200   32,5-7,5   Zap!Che A1200     37-3 
DpFritz A1200   37,5-2,5   

 23 Arasan 16.0 MP x64 2GB Q6600 2,4 GHz, 3007											
Stockf3 Q6600      6-34    DHiar14 Q6600      8-36    DRybka3 Q6600     12-28
DJuni12 Q6600     17-23    DFrit11 Q6600   16,5-23,5  Hiar112 Q6600   17,5-24,5
DFritz8 Q6600     31-9     

 27 Fritz 13 256MB Athlon 1200 MHz, 2978											
Hiarc14 A1200   12,5-27,5  Shred12 A1200     25-15    PDeo182 A1200     32-8 
PF4 Hiarc 13    15,5-4,5   GT2.0 A1200     28,5-11,5  

 40 Pro Deo 1.82 256MB Athlon 1200 MHz, 2796											
Stockf3 Q6600      2-46    Fritz13 A1200      8-32    Juni101 A1200    2,5-11,5
Spike12 A1200     22-22    Zap!Che A1200     24-16    Gandal6 A1200   19,5-20,5
DpFritz A1200     29-11    Junior7 A1200     23-17    Shre532 A1200     26-14

 49 Chess Genius 3 Iphone 4 ARM A8 800MHz, 2257											
Rebel 9.0 P90    6,5-13,5  PTiger09 Tung   12,5-7,5   Montreux          16-4 
Star Sapphire     16-4     Diablo 68000      18-2   


On our latest ratinglist we have a new leader! It's Don Dailey and Larry
Kaufman's Komodo 5.1, which we have tested on our Q6600-hardware. More 
games will be played, but after the first 181 games, its rating is 3241! 
Following the wish of Don Dailey and Larry Kaufman, we have tested it with 
the setting Best Book Line switched to off and with the Komodo Variety book.

Our new number two on the list is the program of Tord Romstad, Joona Kiiski 
and Marco Costalba - Stockfish 3. We have tested it on our Q6600-level and 
after 838 games it has a rating of 3211!

Another new Q6600-program on this list are Jon Dart’s program Arasan 16.0.
Similar to the tested programs above, it’s a 64-bit program. Its rating 
are 3006 after the first 286 games. 
 
New on our list are also the three programs which we have tested on our 
A1200-level. These three programs are: Hiarcs 14 by Mark Uniacke, Fritz 13 
by Frans Morsch/Mathias Feist and Pro Deo 1.82 by Ed Schroeder.

Hiarcs 14 A1200 is rated at 3134 after 160 games played. It’s only 69 
points shy from the Q6600-version Deep Hiarcs, but more games will of course 
be needed for the rating to be more secure.

Fritz 13 A1200 has got the rating 2947 after 180 games played. At the 
moment it is placed 35 points higher than Fritz 12, and the difference
between the A1200 and Q6600-versions of Fritz 13 are 118 points. 

Pro Deo 1.82 A1200 is rated 85 points higher than our last tested Pro Deo
version 1.1, and has got the rating 2796 after 346 games played.

We have also reached 100 games with Richard Lang’s - Chess Genius 3 for
mobile phones. We have manually tested it on a Iphone 4 and since it
doesn’t feature a dedicated tournament level, we have used the level 
3 min/move like before when we tested the Chess Genius 1.4 on the 
Siemens SX1 mobile phone. It is rated 2257 after 100 games played and 
the difference between the two are 110 points.  

As we now have made the full transition from our old ratinglist-program to
its new environment, we are no longer tied to our former limit of 312
computers. This also means we can reintroduce 18 of the formerly tested
chess computers to the list. Out of the original 22, four of them had less
than 100 games played and are out of the list until we could testplay
the necessary games with them. The full list now consists of 337 computers!

The next list is planned to be released as soon as we have some more games
with our tested programs and when our manual testing of the Revelation 
Hiarcs 13.3 has reached over 100 games. We are also testing the new
Deep Junior Yokohama on Q6600 and hopefully we will also be able to test 
any of the latest Komodo and Stockfish-versions for the next list.

Lars Sandin
Lars Sandin, SSDF
jdart
Posts: 4367
Joined: Fri Mar 10, 2006 5:23 am
Location: http://www.arasanchess.org

Re: SSDF Rating List 2013-11-11

Post by jdart »

Thanks for the the update.

It is nice to see new engines on the list, including Arasan for the first time.

--Jon
Modern Times
Posts: 3550
Joined: Thu Jun 07, 2012 11:02 pm

Re: SSDF Rating List 2013-11-11

Post by Modern Times »

Thanks also for the update, and for the work your testers do.
jplchess
Posts: 115
Joined: Mon Jan 25, 2010 7:13 am

Re: SSDF Rating List 2013-11-11

Post by jplchess »

Thanks for all of the hard work that you do. It is now time to use Stockfish 4 and (Houdini 1.5 or better) in the next update 6 months from now.

Good luck,
Jonathan Lee
Vinvin
Posts: 5228
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: SSDF Rating List 2013-11-11

Post by Vinvin »

May be it's even better to wait for Stockfish 5, the dev version is already 50 pts over version 4.
jplchess wrote:Thanks for all of the hard work that you do. It is now time to use Stockfish 4 and (Houdini 1.5 or better) in the next update 6 months from now.

Good luck,
Jonathan Lee
jplchess
Posts: 115
Joined: Mon Jan 25, 2010 7:13 am

Re: SSDF Rating List 2013-11-11 (Where is Stockfish 5???)

Post by jplchess »

To Vincent:
Where is the source of your information on Stockfish 5?
I looked at rating lists and search engine AND found nothing about this 50 point improvement over Stockfish 4.
Jonathan Lee
Vinvin
Posts: 5228
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: SSDF Rating List 2013-11-11 (Where is Stockfish 5???)

Post by Vinvin »

From the dev test page : http://tests.stockfishchess.org/tests
Latest tests vs SF4 give +64 (may be less against other engines).
jplchess wrote:To Vincent:
Where is the source of your information on Stockfish 5?
I looked at rating lists and search engine AND found nothing about this 50 point improvement over Stockfish 4.
Jonathan Lee