SSDF Rating List 2014-05-12

[Lars Sandin]

Code: Select all

THE SSDF RATING LIST 2014-05-12   %134044 games played by  339 computers							
                                           Rating   +	  -  Games   Won  Oppo
                                           ------  ---   --- -----   ---  ----
   1 Komodo 5.1 MP x64 2GB Q6600 2,4 GHz     3259   30   -28   693   73%  3086
   2 Stockfish 3 MP x64 2GB Q6600 2,4 GHz    3211   26   -24   918   71%  3050
   3 Deep Rybka 4 x64  2GB Q6600 2,4 GHz     3209   24   -23  1048   73%  3039
   4 Deep Hiarcs 14 2GB Q6600 2,4 GHz        3199   24   -23   968   68%  3065
   5 Deep Rybka 3 x64  2GB Q6600 2,4 GHz     3194   22   -21  1371   75%  3002
   6 Naum 4.2 MP x64 2GB Q6600 2,4 GHz       3152   22   -21  1041   62%  3063
   7 Naum 4 x64  2GB Q6600 2,4 GHz           3121   22   -21  1196   69%  2984
   8 Deep Junior 13.3 2GB x64 Q6600 2,4 GHz  3113   23   -22   926   54%  3084
   9 Hiarcs 14 256MB Athlon 1200 MHz         3113   47   -42   307   74%  2936
  10 Deep Junior Yokoh x64 2GB Q6600 2,4 GHz 3111   33   -32   448   56%  3069
  11 Deep Hiarcs 13.2  2GB Q6600 2,4 GHz     3104   28   -27   659   60%  3033
  12 Deep Shredder 12 x64 2GB Q6600 2,4 GHz  3104   18   -18  1507   62%  3015
  13 Spike 1.4 MP 2GB Q6600  2,4 GHz         3103   19   -19  1349   61%  3025
  14 Deep Fritz 13 2GB Q6600 2,4 GHz         3101   25   -25   746   56%  3059
  15 Hiarcs 13.1  2GB Q6600 2,4 GHz          3101   24   -24   828   58%  3043
  16 Deep Fritz 12 2GB Q6600 2,4 GHz         3092   21   -20  1120   55%  3059
  17 Deep Rybka 3  256MB Athlon 1200 MHz     3074   39   -37   332   58%  3017
  18 Deep Junior 12 x64 2GB  Q6600 2,4 GHz   3071   22   -21  1058   60%  2997
  19 Deep Fritz 11  2GB Q6600 2,4 GHz        3063   19   -18  1464   62%  2974
  20 Zappa Mexico II x64  2GB Q6600 2,4 GHz  3054   25   -25   776   59%  2988
  21 Naum 3.1 x64  2GB Q6600 2,4 GHz         3040   27   -26   692   58%  2984
  22 Deep Hiarcs 12  2GB Q6600 2,4 GHz       3018   18   -18  1427   54%  2992
  23 Deep Shredder 11 x64 2GB Q6600  2,4 GHz 3013   22   -22   968   52%  2999
  24 Arasan 16.0 MP x64 2GB Q6600 2,4 GHz    3008   36   -38   366   37%  3095
  25 Glaurung 2.2 x64 MP 2GB Q6600 2,4 GHz   2993   20   -20  1165   55%  2960
  26 Hiarcs 11.2 MP  2GB  Q6600  2,4 GHz     2989   20   -20  1125   47%  3007
  27 Naum 4  256MB Athlon 1200 MHz           2987   26   -27   662   48%  3002
  28 Fritz 13 256MB Athlon 1200 MHz          2982   55   -51   180   63%  2883
  29 Shredder 12 256MB A1200 MHz             2971   28   -29   582   43%  3018
  30 Deep Junior 10.1  2GB  Q6600  2,4 GHz   2967   23   -23   886   46%  2994
  31 Fritz 12  256MB  A1200 MHz              2950   27   -26   700   62%  2863
  32 Rybka 2.3.1 Arena 256MB Athlon 1200 MHz 2918   21   -21  1073   49%  2927
  33 Jonny 4.0 MP 2GB Q6600 2,4 GHz          2901   29   -31   640   29%  3055
  34 Deep Fritz 8 2GB  Q6600  2,4 GHz        2898   23   -24   969   35%  3008
  35 CM King 3.5 x64 MP 2GB  Q6600 2,4 GHz   2856   26   -28   752   29%  3007
  36 Zap!Chess Zanzibar 256MB Athlon 1200 MH 2835   20   -20  1186   49%  2843
  37 Fruit 2.2.1  256MB Athlon 1200 MHz      2829   18   -18  1465   59%  2767
  38 Pocket Fritz 4 Naum 4.2 Ipaq 214        2808   60   -55   155   62%  2720
  39 Revelation Hiarcs 13.3 XScale 500 MHz   2798   82   -69   103   70%  2653
  40 Pro Deo 1.82 256MB Athlon 1200 MHz      2793   33   -34   426   43%  2842
  41 Pocket Fritz 4 Hiarcs 13 Ipaq 214       2755   57   -54   160   59%  2690
  42 Pocket Shredder Ipaq 114 624 MHz        2705   51   -48   200   61%  2630
  43 Revelation Shredder 12  XScale 500 MHz  2705   60   -58   140   56%  2665
  44 Hiarcs Palm Chess 12.1 T5               2652   63   -64   120   48%  2664
  45 Revelation Rybka 2.2  XScale 500 MHz    2628   47   -44   240   62%  2545
  46 Resurrection Rybka 2.2 StrongARM 203 MH 2484   43   -42   260   51%  2477
  47 Resurrection Fruit '05 StrongARM 203 MH 2393   67   -62   120   60%  2320
  48 R30 v. 2.5                              2271   42   -38   343   69%  2134
  49 Chess Genius 3 Iphone 4 ARM A8 800MHz   2258   82   -69   100   69%  2119
  50 Palm Tiger 2009 Tung C  400 MHz         2230   51   -53   180   43%  2277

 10 Deep Junior Yokoh x64 2GB Q6600 2,4 GHz, 3111											
Komo5.1 Q6600   10,5-29,5  DRybka4 Q6600     11-29    DHiar14 Q6600   21,5-18,5
Naum4.2 Q6600   16,5-25,5  Naum 4  Q6600     21-19    DJun133 Q6600     19-21
DShre12 Q6600   23,5-20,5  Arasa16 Q6600   24,5-15,5  Hiar112 Q6600     30-10
Spike12 A1200   35,5-4,5   CT 2007 A1200   37,5-4,5   

 39 Revelation Hiarcs 13.3 XScale 500 MHz, 2798											
Zap!Zan A1200      2-4     PF4 Naum 4.2    10,5-9,5   P Shredder      11,5-8,5 
DpFritz7 K6-2   14,5-5,5   Junior6 K6450     17-3     MCP 8 P200MMX   16,5-0,5 

New on our list is Amir Ban and Shay Bushinskys latest version of Deep Junior, 
named after the city where it became the ICGA World Computer Chess Champion
in 2013. Deep Junior Yokohama is rated at 3111 after 448 games played, and 
is so far trailing its former version by two points. 

Another new entrant on our list is the manually tested Revelation Hiarcs 13.3, 
Mark Uniacke's version of Hiarcs 13.3 made for Ruud Martins Revelation board. 
It's the strongest dedicated chesscomputer we have ever tested and with its 
rating of 2798 after 103 games played, it has positioned itself 93 points 
over its nearest rival, Revelation Shredder 12!

Since last time we have also played some more games with Komodo 5.1 Q6600,
and it has gained 19 points, reaching a rating of 3259 after 693 games played! 
Hiarcs 14 on our A1200-level has lost 21 points since last time, but still 
has a respectable 3113 rating after 307 games played!

For our next list we hope to have some more new programs on both our 
hardware levels and hopefully also some new manually played program. We plan
on having our next list out in the autumn of 2014. 

Lars Sandin

[Harvey Williamson]

I like this part

Another new entrant on our list is the manually tested Revelation Hiarcs 13.3,
Mark Uniacke's version of Hiarcs 13.3 made for Ruud Martins Revelation board.
It's the strongest dedicated chesscomputer we have ever tested and with its
rating of 2798 after 103 games played, it has positioned itself 93 points
over its nearest rival, Revelation Shredder 12!

[Vinvin]

Please, test Stockfish (with a small opening book) !!

[jdart]

Stockfish 3 has been tested but not (I think) later versions.

SSDF usually uses "own books". I don't know what book they used for Stockfish.

--Jon

[overlord]

This rating list still exist? Why??? It is absolutly useless. Stockfish 3 is included...very nice joke

[Graham Banks]

This rating list still exist? Why??? It is absolutly useless. Stockfish 3 is included...very nice joke

They are doing the best that they can with the resources that they have available.
They do deserve respect for the time and effort they put in, regardless of finding it hard to keep right up to date.

[kaissa]

[quote="overlord"]This rating list still exist? Why??? It is absolutly useless. Stockfish 3 is included...very nice joke :D[/quote]

They test only at 40/2 hr time control and have been testing for years now. It is the only list that I can see past computers, software, PDAs being rated. They may not be able to test the latest versions but the way they run the games gives me confidence. Kudos to all of them.

[Modern Times]

Yes, big respect for SSDF.

[GONeill]

I agree, but I'm surprised after all these years they still have a bug in the generation of the main list. The front screen shows Palm Tiger in 50th place but if you download the file you find it is really:

Code: Select all

THE SSDF RATING LIST 2014-05-12   134044 games played by  339 computers							
                                           Rating   +	  -  Games   Won  Oppo
                                           ------  ---   --- -----   ---  ----
   1 Komodo 5.1 MP x64 2GB Q6600 2,4 GHz     3259   30   -28   693   73%  3086
   2 Stockfish 3 MP x64 2GB Q6600 2,4 GHz    3211   26   -24   918   71%  3050
   3 Deep Rybka 4 x64  2GB Q6600 2,4 GHz     3209   24   -23  1048   73%  3039
   4 Deep Hiarcs 14 2GB Q6600 2,4 GHz        3199   24   -23   968   68%  3065
   5 Deep Rybka 3 x64  2GB Q6600 2,4 GHz     3194   22   -21  1371   75%  3002
   6 Naum 4.2 MP x64 2GB Q6600 2,4 GHz       3152   22   -21  1041   62%  3063
   7 Naum 4 x64  2GB Q6600 2,4 GHz           3121   22   -21  1196   69%  2984
   8 Deep Junior 13.3 2GB x64 Q6600 2,4 GHz  3113   23   -22   926   54%  3084
   9 Hiarcs 14 256MB Athlon 1200 MHz         3113   47   -42   307   74%  2936
  10 Deep Junior Yokoh x64 2GB Q6600 2,4 GHz 3111   33   -32   448   56%  3069
  11 Deep Hiarcs 13.2  2GB Q6600 2,4 GHz     3104   28   -27   659   60%  3033
  12 Deep Shredder 12 x64 2GB Q6600 2,4 GHz  3104   18   -18  1507   62%  3015
  13 Spike 1.4 MP 2GB Q6600  2,4 GHz         3103   19   -19  1349   61%  3025
  14 Deep Fritz 13 2GB Q6600 2,4 GHz         3101   25   -25   746   56%  3059
  15 Hiarcs 13.1  2GB Q6600 2,4 GHz          3101   24   -24   828   58%  3043
  16 Deep Fritz 12 2GB Q6600 2,4 GHz         3092   21   -20  1120   55%  3059
  17 Deep Rybka 3  256MB Athlon 1200 MHz     3074   39   -37   332   58%  3017
  18 Deep Junior 12 x64 2GB  Q6600 2,4 GHz   3071   22   -21  1058   60%  2997
  19 Deep Fritz 11  2GB Q6600 2,4 GHz        3063   19   -18  1464   62%  2974
  20 Zappa Mexico II x64  2GB Q6600 2,4 GHz  3054   25   -25   776   59%  2988
  21 Naum 3.1 x64  2GB Q6600 2,4 GHz         3040   27   -26   692   58%  2984
  22 Deep Hiarcs 12  2GB Q6600 2,4 GHz       3018   18   -18  1427   54%  2992
  23 Deep Shredder 11 x64 2GB Q6600  2,4 GHz 3013   22   -22   968   52%  2999
  24 Arasan 16.0 MP x64 2GB Q6600 2,4 GHz    3008   36   -38   366   37%  3095
  25 Glaurung 2.2 x64 MP 2GB Q6600 2,4 GHz   2993   20   -20  1165   55%  2960
  26 Hiarcs 11.2 MP  2GB  Q6600  2,4 GHz     2989   20   -20  1125   47%  3007
  27 Naum 4  256MB Athlon 1200 MHz           2987   26   -27   662   48%  3002
  28 Fritz 13 256MB Athlon 1200 MHz          2982   55   -51   180   63%  2883
  29 Shredder 12 256MB A1200 MHz             2971   28   -29   582   43%  3018
  30 Deep Junior 10.1  2GB  Q6600  2,4 GHz   2967   23   -23   886   46%  2994
  31 Fritz 12  256MB  A1200 MHz              2950   27   -26   700   62%  2863
  32 Rybka 2.3.1 Arena 256MB Athlon 1200 MHz 2918   21   -21  1073   49%  2927
  33 Fritz 11  256MB Athlon 1200 MHz         2912   23   -24   853   42%  2966
  34 Rybka 1.2  256MB Athlon 1200 MHz        2906   25   -24   933   70%  2760
  35 Jonny 4.0 MP 2GB Q6600 2,4 GHz          2901   29   -31   640   29%  3055
  36 Deep Fritz 8 2GB  Q6600  2,4 GHz        2898   23   -24   969   35%  3008
  37 Deep Shredder 11  256MB  Athlon 1200    2896   28   -29   574   45%  2930
  38 Shredder 8 MP 2GB  Q6600  2,4 GHz       2885   24   -25   908   32%  3011
  39 Hiarcs 11.1  256MB  Athlon 1200 MHz     2876   21   -21  1077   45%  2911
  40 Deep Junior 8  2GB Q6600 2,4 GHz        2861   24   -25   952   30%  3010
  41 Junior 10.1  256MB Athlon 1200 MHz      2858   17   -18  1539   42%  2911
  42 CM King 3.5 x64 MP 2GB  Q6600 2,4 GHz   2856   26   -28   752   29%  3007
  43 Fritz 10  256MB Athlon 1200 MHz         2845   34   -32   458   64%  2744
  44 Junior 10  256MB Athlon 1200 MHz        2843   22   -22  1042   64%  2740
  45 Zap!Chess Zanzibar 256MB Athlon 1200 MH 2835   20   -20  1186   49%  2843
  46 Hiarcs 10 HypMod 256MB Athlon 1200 MHz  2833   20   -19  1416   69%  2698
  47 Fruit 2.2.1  256MB Athlon 1200 MHz      2829   18   -18  1465   59%  2767
  48 Shredder 10 UCI  256MB Athlon 1200 MHz  2824   20   -19  1246   58%  2768
  49 Spike 1.2  256MB Athlon 1200 MHz        2819   22   -22   932   49%  2823
  50 Fritz 9.0  256MB Athlon 1200 MHz        2815   16   -16  1787   49%  2818

I found an old copy of one of their rating lists. This is from 1997:

Code: Select all

THE SSDF RATING LIST 1997-05-24   55422 games played by 170 computers

                                           Rating   +     -  Games   Won  Oppo
                                           ------  ---   --- -----   ---  ----
   1 Hiarcs 6.0 Pentium MMX 200 MHz          2587   65   -57   152   73%  2416
   2 Rebel 8.0 Pentium MMX 200 MHz           2516   72   -64   118   68%  2382
   3 Hiarcs 6.0 Pentium 90 MHz               2470   31   -29   573   65%  2361
   4 Rebel 8.0 Pentium 90 MHz                2465   25   -24   877   65%  2358
   5 Hiarcs 5.0 Pentium 90 MHz               2443   41   -39   323   63%  2349
   6 MChess Pro 6.0 Pentium 90 MHz           2432   24   -24   856   58%  2373
   7 Genius 5.0 Pentium 90 MHz               2424   27   -26   690   57%  2376
   8 Rebel 6.0 Pentium 90 MHz                2412   31   -30   540   60%  2340
   8 Genius 4.0 Pentium 90 MHz               2412   25   -25   809   64%  2313
  10 MChess Pro 5.0 Pentium 90 MHz           2411   26   -25   759   62%  2321
  10 Genius 3.0 Pentium 90 MHz               2411   27   -26   715   62%  2324
  12 Rebel 7.0 Pentium 90 MHz                2406   26   -26   725   60%  2333
  13 Hiarcs 4.0 Pentium 90 MHz               2398   26   -25   756   55%  2363
  14 Nimzo 3.5 Pentium 90 MHz                2388   30   -29   560   52%  2374
  15 Chessmaster 5000 Pentium 90 MHz         2387   49   -45   240   67%  2262
  16 Nimzo 3.0  Pentium 90 MHz               2386   26   -25   755   58%  2330
  17 Hiarcs 3.0 Pentium 90 MHz               2379   30   -30   545   56%  2334
  18 Genius 4.0 486/50-66 MHz                2377   26   -26   714   54%  2348
  19 R30 v. 2.5                              2374   44   -42   283   66%  2256
  20 Junior 3.3-3.5  Pentium 90 MHz          2373   33   -33   436   49%  2377
  21 MChess Pro 4.0 Pentium 90 MHz           2360   29   -29   578   52%  2344
  22 Genius 3.0 486/50-66 MHz                2359   24   -23   910   62%  2271
  23 Fritz 3.0 Pentium 90 MHz                2350   24   -24   855   49%  2354
  24 Mephisto Genius 2.0  486/50-66 MHz      2339   23   -23   917   58%  2280
  25 Fritz 4.0 Pentium 90 MHz                2337   40   -39   324   60%  2266
  26 MChess Pro 5.0 486/50-66 MHz            2336   28   -28   628   52%  2324
  27 Rebel 7.0 486/50-66 MHz                 2335   26   -26   697   51%  2329
  28 WChess 1.06 Pentium 90 MHz              2332   26   -26   738   47%  2354
  29 Kallisto 1.98 Pentium 90 MHz            2331   26   -26   697   47%  2353
  30 MChess Pro 4.0 486/50-66 MHz            2314   24   -24   846   53%  2290
  31 Chess Machine 30-32 MHz Schroder 3.1    2302   32   -30   546   68%  2171
  31 WChess 1.03 486/50-66 MHz               2302   27   -27   677   49%  2308
  33 Hiarcs 3.0 486/50-66 MHz                2301   24   -24   865   50%  2298
  34 Rebel 6.0 486/50-66 MHz                 2300   24   -23   884   55%  2266
  35 Meph Genius 68030 33 MHz                2299   47   -46   228   57%  2252
  36 Ch.Machine 30 MHz King 2.0 aggr/R30 off 2295   21   -20  1190   64%  2192
  37 Chessmaster 4000 486/50-66 MHz          2292   34   -33   462   66%  2172
  38 Chess Genius 1.0  486/50-66 MHz         2286   23   -23   931   54%  2258
  39 Rebel Decade Pentium 90 MHz             2281   29   -30   563   45%  2318
  40 Chess Machine 30 MHz Schroder 3.0       2274   62   -55   168   73%  2102
  41 Mephisto Gideon Pro  486/50-66 MHz      2272   35   -34   421   62%  2184
  42 MChess Pro 3.5  486/50-66 MHz           2271   23   -23   926   52%  2254
  43 MChess Pro 3.12  486/50-66 MHz          2265   36   -34   438   69%  2122
  44 Fritz 3.0 486/50-66 MHz                 2258   21   -21  1065   50%  2260
  45 Mephisto Lyon  68030 36 MHz             2254   28   -27   716   68%  2119
  46 Chess Genius 1.0  486/33 MHz            2242   32   -32   463   50%  2242
  47 Mephisto Portorose  68030 36 MHz        2237   40   -36   407   77%  2028
  48 Mephisto Vancouver  68030 36 MHz        2227   35   -33   471   71%  2071
  48 MChess Pro 3.12  486/33 MHz             2227   50   -48   208   60%  2153
  50 Berlin Pro 68 020 24 MHz                2223   25   -24   816   58%  2163

I wonder what ranking Stockfish would get on a 486/50-66Mhz? And does anybody have a list older than this?

[lucasart]

Code: Select all

THE SSDF RATING LIST 2014-05-12   %134044 games played by  339 computers							
                                           Rating   +	  -  Games   Won  Oppo
                                           ------  ---   --- -----   ---  ----
   1 Komodo 5.1 MP x64 2GB Q6600 2,4 GHz     3259   30   -28   693   73%  3086
   2 Stockfish 3 MP x64 2GB Q6600 2,4 GHz    3211   26   -24   918   71%  3050
   3 Deep Rybka 4 x64  2GB Q6600 2,4 GHz     3209   24   -23  1048   73%  3039
   4 Deep Hiarcs 14 2GB Q6600 2,4 GHz        3199   24   -23   968   68%  3065
   5 Deep Rybka 3 x64  2GB Q6600 2,4 GHz     3194   22   -21  1371   75%  3002
   6 Naum 4.2 MP x64 2GB Q6600 2,4 GHz       3152   22   -21  1041   62%  3063
   7 Naum 4 x64  2GB Q6600 2,4 GHz           3121   22   -21  1196   69%  2984
   8 Deep Junior 13.3 2GB x64 Q6600 2,4 GHz  3113   23   -22   926   54%  3084
   9 Hiarcs 14 256MB Athlon 1200 MHz         3113   47   -42   307   74%  2936
  10 Deep Junior Yokoh x64 2GB Q6600 2,4 GHz 3111   33   -32   448   56%  3069

The problem with SSDF is that it's always years out of date, and systematically geared towards commercial programs:

• out of date: have you ever heard about Komodo 7? Stockfish 5? Rybka 4.1?
• biais towards commercial programs: what about Gull 3? Critter 1.6a? Fire 3.0? Hannibal 1.4b? Senpai 1.0? Protector 1.6? Texel 1.04? All of these are easily stronger than Deep Junior Yokohama, the so called "world champion".

That's why SSDF is completely irrelevant, and the only thing people look at are CCRL and CEGT.