SSDF Rating List 2023-12-31

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

Lars Sandin
Posts: 2032
Joined: Sun Nov 18, 2007 5:17 pm
Location: Sundsvall, Sweden

SSDF Rating List 2023-12-31

Post by Lars Sandin »

Code: Select all

THE SSDF RATING LIST 2023-12-31    164540 games played by  440 computers							
                                           Rating   +	  -  Games   Won  Oppo
                                           ------  ---   --- -----   ---  ----
   1 Lc0 0.29.0 Cuda-808544 3060Ti           3586   30   -28   600   63%  3493
   2 Stockfish 16 x64 1800X 3.6 GHz          3582   50   -48   200   58%  3523
   3 Stockfish 15 x64 1800X 3.6 GHz          3573   37   -35   400   65%  3466
   4 Dragon Komodo 3 x64 1800X 3.6 GHz       3569   36   -34   400   60%  3498
   5 Lc0 0.28.2 Cuda-611213 3060Ti           3569   26   -25   780   66%  3457
   6 Lc0 0.26.3 Cuda(67362) 3060Ti           3569   29   -27   680   68%  3441
   7 Stockfish 13 x64 1800X 3.6 GHz          3569   35   -32   480   69%  3431
   8 Dragon Komodo 3.3 x64 1800X 3.6 GHz     3568   46   -43   248   60%  3492
   9 Dragon Komodo 2.51 x64 1800X 3.6 GHz    3562   39   -36   360   63%  3468
  10 Stockfish 14 x64 1800X 3.6 GHz          3556   37   -35   400   65%  3451
  11 Rebel 16.2 x64 1800X 3.6 GHz            3547   39   -38   320   53%  3526
  12 Stockfish 12 NNUE x64 1800X 3.6 GHz     3547   25   -25   768   59%  3481
  13 Dragon by Komodo x64 1800X 3.6 GHz      3536   34   -32   460   63%  3442
  14 Stockfish 11 x64 1800X 3.6 GHz          3529   36   -34   450   70%  3384
  15 Arasan 23.4 x64 1800X 3.6 GHz           3523   44   -45   240   46%  3541
  16 Dragon Komodo 3.1 MCTS 1800X 3.6 GHz    3514   31   -30   520   58%  3457
  17 Stockfish 10 x64 1800X 3.6 GHz          3502   25   -23   920   67%  3378
  18 Booot 7.1 x64 1800X 3.6 GHz             3484   48   -50   200   42%  3536
  19 Dragon Komodo 2 MCTS x64 1800X 3.6 GHz  3484   41   -41   280   53%  3459
  20 Booot 7 x64 1800X 3.6 GHz               3475   39   -40   300   46%  3508
  21 Arasan 23.01 x64 1800X 3.6 GHz          3449   33   -34   420   48%  3461
  22 Arasan 23.4 x64 Q6600 2.4 GHz           3444   38   -35   400   69%  3306
  23 Wasp 6.5 x64 1800X 3.6 GHz              3442   31   -31   480   51%  3433
  24 Pedone 3.1 x64 1800X 3.6 GHz            3430   38   -39   320   45%  3468
  25 Booot 6.5 x64 1800X 3.6 GHz             3424   34   -34   400   48%  3435
  26 Wasp 5.5 x64 1800X 3.6 GHz              3383   37   -39   360   36%  3480
  27 Marvin 6.0.0 x64 1800X 3.6 GHz          3357   35   -38   420   31%  3495
  28 Pedone 3.1 x64 Q6600 2.4 GHZ            3356   38   -37   340   58%  3302
  29 Deep Shredder 13 x64 1800X 3.6 GHz      3346   24   -23   920   62%  3260
  30 Chiron 5.01 x64 1800X 3.6 GHz           3345   32   -34   480   33%  3464
  31 Chiron 5.01 x64 Q6600 2.4 GHz           3315   34   -34   400   52%  3302
  32 Revelation 2 A.E. Komodo 12.1 A7 1 GHz  3176   73   -68   100   59%  3112
  33 The Baron 3.45 x64 1800X 3.6 GHz        3081   58   -71   160   24%  3280
  34 The Baron 3.43 x64 1800X 3.6 GHz        3076   29   -31   680   26%  3259
  35 The Baron 3.45 x64 Q6600 2.4 GHz        3053   36   -37   360   45%  3086
  36 The Baron 3.43 x64 Q6600 2.4 GHz        3018   32   -32   460   49%  3022
  37 Revelation 2 Hiarcs 14.1 PXA320 800 MHz 2924   47   -45   228   56%  2880
  38 Chessmaster King 3.5 x64 Q6600 2.4 GHz  2855   23   -25   972   30%  3006
  39 Revelation Hiarcs 13.3 PXA255 500 MHz   2772   57   -52   177   66%  2660
  40 Revelation Shredder 12 PXA255 500 MHz   2706   60   -58   140   56%  2666
  41 Revelation Rybka 2.2 PXA255 500 MHz     2635   45   -43   260   63%  2546
  42 Revelation Deep Sjeng 3 PXA255 500 MHz  2600   62   -67   120   41%  2665
  43 Millennium The King Exclusive 300 MHz   2534   49   -48   200   55%  2501
  44 Revelation Ruffian 2.1 PXA255 500 MHz   2347   68   -71   100   45%  2385
  45 Millennium ChessGenius Excl. M7 300 MHz 2249   50   -48   204   58%  2193
  46 Mephisto London 68030 33 MHz            2195   31   -31   482   50%  2192
  47 Millennium ChessGenius Pro M4 120 MHz   2163   59   -54   160   63%  2067
  48 Mephisto London 68020 12 MHz            2089   60   -53   171   68%  1957
  49 Millennium ChessGenius ARM M4 48 MHz    2070   45   -43   251   58%  2016
  50 Mephisto Roma II 68000 10 MHz           1898   63   -59   132   58%  1843

 2 Stockfish 16 x64 1800X 3.6 GHz. 3582											
Lc029 3060Ti      20-20    Dra33 1800X       20-20    Dra251 1800X      21-19
Boo71 1800X       26-14    Stock8 1800X      28-12    

 8 Dragon Komodo 3.3 x64 1800X 3.6 GHz. 3568											
Lc029 3060Ti    19.5-20.5  Stoc16 1800X      20-20    Reb162 1800X      21-19
SF12NU 1800X       4-4     Aras234 1800X     24-16    Mar60 1800X     30.5-9.5 
Chi5 1800X      30.5-9.5   

 18 Booot 7.1 x64 1800X 3.6 GHz. 3484											
Lc029 3060Ti    16.5-23.5  Stoc16 1800X      14-26    Reb162 1800X      14-26
Aras234 1800X   19.5-20.5  Wasp65 1800X    20.5-19.5  

 33 The Baron 3.45 x64 1800X 3.6 GHz. 3081											
Komo11 1800X       7-33    Mar51 1800X      7.5-32.5  Ped21 1800X        9-31
Wasp201 1800X     15-25    

 35 The Baron 3.45 x64 Q6600 2.4 GHz. 3053											
Stockf3 Q6600     12-28    DRybka4 Q6600      5-35    DRybka3 Q6600    9.5-30.5
DHiar14 Q6600   15.5-24.5  Chiro3 Q6600    10.5-29.5  Craf25 Q6600      34-26
Arasa16 Q6600   44.5-15.5  King3.5 Q6600     31-9     

This last rating list of 2023 consists of five new entrants. First one out 
is the latest version from Team Stockfish, named Stockfish 16. We have as usual 
used an opening book from Fauzi Dabat for the testing, and this one is called:
"Aggressive 5.6 by fauzi.abk". It's of course still early on in the testing, but 
Stockfish 16 has reached the very strong rating of 3582 after the first 200 
games and have taken over the second place in the rating list.
 
Even though the earlier Stockfish 15 gained 3 points since the last list, 
Stockfish 16 now has a gap of 9 rating points ahead of its former version. 
As Lc0 lost a considerable amount of points since the last rating list, the 
gap between Stockfish and Lc0 have now gone from 40 to just 4 points. It will 
surely be exciting to see how the rating will continue to fluctuate 
in the top of the list as more games will be played with all the top programs.

As incidentally mentioned, Lc0 wasn't able to keep up with its strong start 
in the last rating list and with more than 300 games added since last time,
its rating has been lowered with 24 points. Lc0 still holds the number one 
spot in the list, but now with a much smaller gap to its nearest competitor - 
Stockfish.

Our second newcomer on the list are Mark Lefler's and Larry Kaufmans's - Dragon
Komodo 3.3. It's extremely congested in the top at the moment and even though
Dragon Komodo has made a good impression in its first 248 games, it is at the 
moment only placed eigth in the list, with the rating of 3568. This is one
point behind Dragon Komodo 3, but also just five points behind Stockfish 15 in
third place, so more games will be needed to find out how it will fare in the 
absolute top of the rating list.  As opening book for Dragon Komodo 3.3, we have 
used Erdogan Günes's opening book: "Out10-35.bin". 

Third one out is Alex Morozov's - Booot 7.1, which after the first 200 games
have reached a rating of 3484, which is 9 points ahead of the 7.0 version. 
As opening book for Booot 7.1, we have used Sedat Canbaz's: "Perfect2021.abk".

Last but not least are Richard Pijl's - The Baron 3.45, which we have tested
on both our hardware platforms. As opening book we have used The Baron's own
opening book. On our 1800X hardware, The Baron 3.45 has reached a rating 
of 3081 after the first 160 games. This is at the moment 4 points ahead of 
the 3.43 version which we had tested earlier. On our Q6600 hardware, 
The Baron 3.45 has recieved a rating of 3053 after 360 games played.
This is 35 points ahead of the 3.43 version on the Q6600 hardware, so more 
games will be needed on the 1800X hardware to see if the smaller margin there
will get bigger as more games are played. 

Hope that you all have had a merry Christmas and a happy New Year

Lars Sandin
Lars Sandin, SSDF
User avatar
Graham Banks
Posts: 43955
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: SSDF Rating List 2023-12-31

Post by Graham Banks »

Happy New Year, Lars. Keep up the good work. :)
gbanksnz at gmail.com
Jouni
Posts: 3621
Joined: Wed Mar 08, 2006 8:15 pm
Full name: Jouni Uski

Re: SSDF Rating List 2023-12-31

Post by Jouni »

Long running list! 40th anniversary.
1984 Novag Super Constellation 6502 4 MHz 1631
Jouni
Werewolf
Posts: 1989
Joined: Thu Sep 18, 2008 10:24 pm

Re: SSDF Rating List 2023-12-31

Post by Werewolf »

Lars Sandin wrote: Thu Jan 04, 2024 9:08 pm

Code: Select all

THE SSDF RATING LIST 2023-12-31    164540 games played by  440 computers							
                                           Rating   +	  -  Games   Won  Oppo
                                           ------  ---   --- -----   ---  ----
   1 Lc0 0.29.0 Cuda-808544 3060Ti           3586   30   -28   600   63%  3493
   2 Stockfish 16 x64 1800X 3.6 GHz          3582   50   -48   200   58%  3523
   3 Stockfish 15 x64 1800X 3.6 GHz          3573   37   -35   400   65%  3466
   4 Dragon Komodo 3 x64 1800X 3.6 GHz       3569   36   -34   400   60%  3498
   5 Lc0 0.28.2 Cuda-611213 3060Ti           3569   26   -25   780   66%  3457
   6 Lc0 0.26.3 Cuda(67362) 3060Ti           3569   29   -27   680   68%  3441
   7 Stockfish 13 x64 1800X 3.6 GHz          3569   35   -32   480   69%  3431
   8 Dragon Komodo 3.3 x64 1800X 3.6 GHz     3568   46   -43   248   60%  3492
   9 Dragon Komodo 2.51 x64 1800X 3.6 GHz    3562   39   -36   360   63%  3468
  10 Stockfish 14 x64 1800X 3.6 GHz          3556   37   -35   400   65%  3451
  11 Rebel 16.2 x64 1800X 3.6 GHz            3547   39   -38   320   53%  3526
  12 Stockfish 12 NNUE x64 1800X 3.6 GHz     3547   25   -25   768   59%  3481
  13 Dragon by Komodo x64 1800X 3.6 GHz      3536   34   -32   460   63%  3442
  14 Stockfish 11 x64 1800X 3.6 GHz          3529   36   -34   450   70%  3384
  15 Arasan 23.4 x64 1800X 3.6 GHz           3523   44   -45   240   46%  3541
  16 Dragon Komodo 3.1 MCTS 1800X 3.6 GHz    3514   31   -30   520   58%  3457
  17 Stockfish 10 x64 1800X 3.6 GHz          3502   25   -23   920   67%  3378
  18 Booot 7.1 x64 1800X 3.6 GHz             3484   48   -50   200   42%  3536
  19 Dragon Komodo 2 MCTS x64 1800X 3.6 GHz  3484   41   -41   280   53%  3459
  20 Booot 7 x64 1800X 3.6 GHz               3475   39   -40   300   46%  3508
  21 Arasan 23.01 x64 1800X 3.6 GHz          3449   33   -34   420   48%  3461
  22 Arasan 23.4 x64 Q6600 2.4 GHz           3444   38   -35   400   69%  3306
  23 Wasp 6.5 x64 1800X 3.6 GHz              3442   31   -31   480   51%  3433
  24 Pedone 3.1 x64 1800X 3.6 GHz            3430   38   -39   320   45%  3468
  25 Booot 6.5 x64 1800X 3.6 GHz             3424   34   -34   400   48%  3435
  26 Wasp 5.5 x64 1800X 3.6 GHz              3383   37   -39   360   36%  3480
  27 Marvin 6.0.0 x64 1800X 3.6 GHz          3357   35   -38   420   31%  3495
  28 Pedone 3.1 x64 Q6600 2.4 GHZ            3356   38   -37   340   58%  3302
  29 Deep Shredder 13 x64 1800X 3.6 GHz      3346   24   -23   920   62%  3260
  30 Chiron 5.01 x64 1800X 3.6 GHz           3345   32   -34   480   33%  3464
  31 Chiron 5.01 x64 Q6600 2.4 GHz           3315   34   -34   400   52%  3302
  32 Revelation 2 A.E. Komodo 12.1 A7 1 GHz  3176   73   -68   100   59%  3112
  33 The Baron 3.45 x64 1800X 3.6 GHz        3081   58   -71   160   24%  3280
  34 The Baron 3.43 x64 1800X 3.6 GHz        3076   29   -31   680   26%  3259
  35 The Baron 3.45 x64 Q6600 2.4 GHz        3053   36   -37   360   45%  3086
  36 The Baron 3.43 x64 Q6600 2.4 GHz        3018   32   -32   460   49%  3022
  37 Revelation 2 Hiarcs 14.1 PXA320 800 MHz 2924   47   -45   228   56%  2880
  38 Chessmaster King 3.5 x64 Q6600 2.4 GHz  2855   23   -25   972   30%  3006
  39 Revelation Hiarcs 13.3 PXA255 500 MHz   2772   57   -52   177   66%  2660
  40 Revelation Shredder 12 PXA255 500 MHz   2706   60   -58   140   56%  2666
  41 Revelation Rybka 2.2 PXA255 500 MHz     2635   45   -43   260   63%  2546
  42 Revelation Deep Sjeng 3 PXA255 500 MHz  2600   62   -67   120   41%  2665
  43 Millennium The King Exclusive 300 MHz   2534   49   -48   200   55%  2501
  44 Revelation Ruffian 2.1 PXA255 500 MHz   2347   68   -71   100   45%  2385
  45 Millennium ChessGenius Excl. M7 300 MHz 2249   50   -48   204   58%  2193
  46 Mephisto London 68030 33 MHz            2195   31   -31   482   50%  2192
  47 Millennium ChessGenius Pro M4 120 MHz   2163   59   -54   160   63%  2067
  48 Mephisto London 68020 12 MHz            2089   60   -53   171   68%  1957
  49 Millennium ChessGenius ARM M4 48 MHz    2070   45   -43   251   58%  2016
  50 Mephisto Roma II 68000 10 MHz           1898   63   -59   132   58%  1843

 2 Stockfish 16 x64 1800X 3.6 GHz. 3582											
Lc029 3060Ti      20-20    Dra33 1800X       20-20    Dra251 1800X      21-19
Boo71 1800X       26-14    Stock8 1800X      28-12    

 8 Dragon Komodo 3.3 x64 1800X 3.6 GHz. 3568											
Lc029 3060Ti    19.5-20.5  Stoc16 1800X      20-20    Reb162 1800X      21-19
SF12NU 1800X       4-4     Aras234 1800X     24-16    Mar60 1800X     30.5-9.5 
Chi5 1800X      30.5-9.5   

 18 Booot 7.1 x64 1800X 3.6 GHz. 3484											
Lc029 3060Ti    16.5-23.5  Stoc16 1800X      14-26    Reb162 1800X      14-26
Aras234 1800X   19.5-20.5  Wasp65 1800X    20.5-19.5  

 33 The Baron 3.45 x64 1800X 3.6 GHz. 3081											
Komo11 1800X       7-33    Mar51 1800X      7.5-32.5  Ped21 1800X        9-31
Wasp201 1800X     15-25    

 35 The Baron 3.45 x64 Q6600 2.4 GHz. 3053											
Stockf3 Q6600     12-28    DRybka4 Q6600      5-35    DRybka3 Q6600    9.5-30.5
DHiar14 Q6600   15.5-24.5  Chiro3 Q6600    10.5-29.5  Craf25 Q6600      34-26
Arasa16 Q6600   44.5-15.5  King3.5 Q6600     31-9     

This last rating list of 2023 consists of five new entrants. First one out 
is the latest version from Team Stockfish, named Stockfish 16. We have as usual 
used an opening book from Fauzi Dabat for the testing, and this one is called:
"Aggressive 5.6 by fauzi.abk". It's of course still early on in the testing, but 
Stockfish 16 has reached the very strong rating of 3582 after the first 200 
games and have taken over the second place in the rating list.
 
Even though the earlier Stockfish 15 gained 3 points since the last list, 
Stockfish 16 now has a gap of 9 rating points ahead of its former version. 
As Lc0 lost a considerable amount of points since the last rating list, the 
gap between Stockfish and Lc0 have now gone from 40 to just 4 points. It will 
surely be exciting to see how the rating will continue to fluctuate 
in the top of the list as more games will be played with all the top programs.

As incidentally mentioned, Lc0 wasn't able to keep up with its strong start 
in the last rating list and with more than 300 games added since last time,
its rating has been lowered with 24 points. Lc0 still holds the number one 
spot in the list, but now with a much smaller gap to its nearest competitor - 
Stockfish.

Our second newcomer on the list are Mark Lefler's and Larry Kaufmans's - Dragon
Komodo 3.3. It's extremely congested in the top at the moment and even though
Dragon Komodo has made a good impression in its first 248 games, it is at the 
moment only placed eigth in the list, with the rating of 3568. This is one
point behind Dragon Komodo 3, but also just five points behind Stockfish 15 in
third place, so more games will be needed to find out how it will fare in the 
absolute top of the rating list.  As opening book for Dragon Komodo 3.3, we have 
used Erdogan Günes's opening book: "Out10-35.bin". 

Third one out is Alex Morozov's - Booot 7.1, which after the first 200 games
have reached a rating of 3484, which is 9 points ahead of the 7.0 version. 
As opening book for Booot 7.1, we have used Sedat Canbaz's: "Perfect2021.abk".

Last but not least are Richard Pijl's - The Baron 3.45, which we have tested
on both our hardware platforms. As opening book we have used The Baron's own
opening book. On our 1800X hardware, The Baron 3.45 has reached a rating 
of 3081 after the first 160 games. This is at the moment 4 points ahead of 
the 3.43 version which we had tested earlier. On our Q6600 hardware, 
The Baron 3.45 has recieved a rating of 3053 after 360 games played.
This is 35 points ahead of the 3.43 version on the Q6600 hardware, so more 
games will be needed on the 1800X hardware to see if the smaller margin there
will get bigger as more games are played. 

Hope that you all have had a merry Christmas and a happy New Year

Lars Sandin
Would you consider testing The ChessMachine 2.54 (King) at 32 MHz? Currently it's just the 2.0 version.
Vinvin
Posts: 5287
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: SSDF Rating List 2023-12-31

Post by Vinvin »

Hi, Lars !
Is there any hope to upgrade the hardware ? The Ryzen 7800x (12 cores) is about 4 times faster than the current 1800x.
Vinvin
Posts: 5287
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: SSDF Rating List 2023-12-31

Post by Vinvin »

Vinvin wrote: Sun Jan 07, 2024 7:08 pm Ryzen 7800x (12 cores)
I mean "Ryzen 7900x"