FGRL, 16 Cores vs RTX 2070 - 54. Scorpio 3.0.12 NN-ens-net-20x256

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

fastgm
Posts: 818
Joined: Mon Aug 19, 2013 6:57 pm

FGRL, 16 Cores vs RTX 2070 - 54. Scorpio 3.0.12 NN-ens-net-20x256

Post by fastgm »

New: 54. Scorpio 3.0.12 NN-ens-net-20x256 (+97 to Scorpio 3.07 NN-ens-net-20x256)

Code: Select all

   # Engine                              :    Elo  Error   Games    Points    (%)      W      D      L     D(%)   CFS
 ---------------------------------------------------------------------------------------------------------------------
   1 Fat Fritz 2 (in SF)                 :   3542      8    3000    1679.5   55.98    434   2491     75   83.03    71
   2 Stockfish 210131                    :   3539      8    2500    1363.5   54.54    289   2149     62   85.96    55
   3 Stockfish 13                        :   3538      7    3000    1664.5   55.48    404   2521     75   84.03   100
   4 Stockfish 12                        :   3518      5    5750    3190.5   55.49    880   4621    249   80.37    64
   5 Lc0 0.26.3 384x30-J94-130           :   3516      7    4250    2954.0   69.51   1809   2290    151   53.88    55
   6 Lc0 0.26.3 384x30-J98.1-16          :   3515      8    4500    3154.0   70.09   1962   2384    154   52.98    68
   7 Lc0 0.26.3 67630                    :   3513      8    3500    2470.0   70.57   1582   1776    142   50.74    51
   8 Lc0 0.26.3 384x30-J94-80            :   3513      7    4750    3350.5   70.54   2124   2453    173   51.64    64
   9 Lc0 0.26.3 66750                    :   3511      7    4500    3133.5   69.63   1929   2409    162   53.53    65
  10 Lc0 0.27.0 67890                    :   3509      9    2750    1917.0   69.71   1195   1444    111   52.51    54
  11 Lc0 0.26.3 384x30-J96-28            :   3508      7    4500    3120.0   69.33   1914   2412    174   53.60    56
  12 Lc0 0.26.3 384x30-J92-260           :   3507      7    5250    3756.5   71.55   2472   2569    209   48.93    51
  13 Lc0 0.26.3 66625                    :   3507      7    4500    3115.5   69.23   1913   2405    182   53.44    54
  14 Stockfish 200813 82215d0fd0df       :   3507      8    2500    1477.5   59.10    541   1873     86   74.92    56
  15 Lc0 0.26.3 384x30-J92-330           :   3506      7    5000    3537.0   70.74   2287   2500    213   50.00    76
  16 Lc0 0.26.3 RC2 384x30-J92-130       :   3502      8    4000    3051.5   76.29   2190   1723     87   43.08    52
  17 Dragon by Komodo Chess 1.0          :   3502      6    5000    2603.5   52.07    575   4057    368   81.14    89
  18 Stockfish NNUE SV20200725-1313      :   3496      8    2500    1475.0   59.00    520   1910     70   76.40    74
  19 Lc0 0.26.3 66511                    :   3492      7    4500    3041.5   67.59   1822   2439    239   54.20    89
  20 Lc0 0.26.3 65681                    :   3486      8    4250    3013.5   70.91   1972   2083    195   49.01    89
  21 Lc0 0.25.1 LS 15                    :   3480      6    6000    4320.0   72.00   2928   2784    288   46.40    84
  22 Lc0 0.24.1 LS 14.3                  :   3475      6    6000    4292.0   71.53   2870   2844    286   47.40    61
  23 Lc0 0.26.2 384x30-J92-220           :   3474      8    3750    2745.0   73.20   1877   1736    137   46.29    73
  24 Lc0 0.24.1 LS 14.2                  :   3470      9    3250    2472.5   76.08   1799   1347    104   41.45    78
  25 Lc0 0.26.1 384x30-J92-115           :   3465      8    3750    2772.5   73.93   1915   1715    120   45.73    69
  26 Lc0 0.24.0 LS 14                    :   3462      9    3500    2677.0   76.49   1964   1426    110   40.74    86
  27 Lc0k 0.23.2 256x20-T40-1541         :   3456      5    7750    5415.5   69.88   3537   3757    456   48.48    83
  28 Lc0 0.26.1 384x30-T60-4585          :   3451      9    3250    2295.5   70.63   1509   1573    168   48.40    64
  29 Lc0 0.24.1 LS 13                    :   3448      9    3000    2187.5   72.92   1508   1359    133   45.30    68
  30 Stockfish NNUE GK200627             :   3446      8    2500    1305.5   52.22    321   1969    210   78.76    68
  31 Lc0 0.26.1 384x30-T60-4619          :   3443      7    4250    3038.0   71.48   2010   2056    184   48.38    56
  32 Stockfish 200502 C0                 :   3442      8    2500    1301.5   52.06    383   1837    280   73.48    63
  33 Lc0 0.26.1 64498                    :   3441      7    4750    3252.5   68.47   2068   2369    313   49.87    74
  34 Stockfish 12 Classic                :   3437      8    2500    1013.5   40.54    144   1739    617   69.56    80
  35 Lc0 0.24.1 384x30-T60-3010          :   3432      7    5000    3477.5   69.55   2256   2443    301   48.86    61
  36 Lc0 0.25.1 63681                    :   3431      6    5250    3573.5   68.07   2248   2651    351   50.50    53
  37 Fat Fritz 1.1                       :   3431      7    4000    2921.0   73.03   2066   1710    224   42.75    76
  38 Stockfish 11 C0                     :   3428      5    6750    3390.0   50.22    851   5078    821   75.23    58
  39 Lc0 0.22.0 42850                    :   3427      7    4500    3173.5   70.52   2142   2063    295   45.84    51
  40 Lc0 0.22.0 T40B.4-160               :   3427      7    4500    3173.0   70.51   2131   2084    285   46.31    78
  41 Stockfish 11                        :   3423      7    4000    2157.5   53.94    777   2761    462   69.03    64
  42 Lc0 0.25.1 63305                    :   3421      7    4750    3176.5   66.87   1926   2501    323   52.65    80
  43 Lc0 0.25.1 63305 (Kayra4)           :   3417      8    3250    2285.5   70.32   1477   1617    156   49.75    54
  44 Lc0 0.25.1 3972_20k_TCEC            :   3416      8    3500    2418.5   69.10   1513   1811    176   51.74    78
  45 Lc0k 0.23.2 62172                   :   3412      7    4750    3160.0   66.53   1924   2472    354   52.04    85
  46 Lc0 LS-LS 12.2                      :   3406      8    3750    2680.5   71.48   1809   1743    198   46.48    59
  47 Lc0 0.22.0 J13B.2-188               :   3405      7    4500    3068.0   68.18   1955   2226    319   49.47    68
  48 Lc0 0.25.1 703042                   :   3403      7    4750    3073.5   64.71   1917   2313    520   48.69    72
  49 Lc0 LS-LS 12.1                      :   3400      8    3000    2056.0   68.53   1299   1514    187   50.47    53
  50 Lc0k 0.23.2 384x30-T40-2036         :   3399      7    4250    2905.0   68.35   1923   1964    363   46.21    99
  51 Fat Fritz 1.0                       :   3386      8    3000    2012.0   67.07   1311   1402    287   46.73    87
  52 Lc0 0.22.0 32930                    :   3380      7    4500    2942.0   65.38   1821   2242    437   49.82    67
  53 Lc0 0.22.0 LS 12 preview            :   3378      9    2750    1876.0   68.22   1258   1236    256   44.95    51
  54 Scorpio 3.0.12 NN-ens-net-20x256    :   3378      8    2500    1299.0   51.96    497   1604    399   64.16    56
  55 Stockfish 10                        :   3377      7    2750    1337.5   48.64    428   1819    503   66.15    72
  56 Lc0 0.23.2 61950                    :   3374      8    3750    2482.0   66.19   1550   1864    336   49.71    72
  57 Lc0 0.23.2 58613+                   :   3371      8    3500    2268.5   64.81   1426   1685    389   48.14    64
  58 Lc0 0.22.0 384x30-T40-1573          :   3368      9    2750    1846.0   67.13   1220   1252    278   45.53    97
  59 Lc0 0.25.1 3972_20k_TCEC+           :   3356      9    2500    1646.5   65.86    944   1405    151   56.20    90
  60 Komodo 14.1                         :   3349      6    5250    1695.5   32.30    207   2977   2066   56.70    73
  61 Komodo 14                           :   3346      5    6000    2229.0   37.15    400   3658   1942   60.97    89
  62 Lc0 0.22.0 11260                    :   3340      8    2750    1755.5   63.84   1044   1423    283   51.75   100
  63 Komodo 13.3                         :   3325      7    3750    1379.0   36.77    294   2170   1286   57.87    54
  64 Houdini 6.03                        :   3325      4   12000    4193.0   34.94    833   6720   4447   56.00   100
  65 Komodo 13.2.5                       :   3312      6    4500    1749.5   38.88    503   2493   1504   55.40    88
  66 Nemorino 6.00                       :   3305     10    2750     708.0   25.75     55   1306   1389   47.49    94
  67 Ethereal 12.75                      :   3296      6    5750    1528.0   26.57    142   2772   2836   48.21    80
  68 SlowChess Blitz NN 2.5              :   3291      9    3250     789.5   24.29     83   1413   1754   43.48    93
  69 Scorpio 3.07 NN-ens-net-20x256      :   3281      8    2500    1466.5   58.66    855   1223    422   48.92    97
  70 Ethereal 12.50                      :   3269      9    3000     806.5   26.88     84   1445   1471   48.17    90
  71 RubiChess 2.0 NNUE                  :   3260     10    3000     635.0   21.17     38   1194   1768   39.80    60
  72 Ethereal 12.25                      :   3258      8    3500     954.5   27.27    145   1619   1736   46.26    83
  73 Igel 2.8.0 NNUE                     :   3253      7    4750    1049.0   22.08     76   1946   2728   40.97    60
  74 SlowChess Blitz Classic 2.4         :   3251      9    4000     827.5   20.69     66   1523   2411   38.08    96
  75 Igel 2.9.0                          :   3240     10    3500     679.5   19.41     32   1295   2173   37.00   100
  76 Ethereal 12.00                      :   3223      7    5250    1300.0   24.76    213   2174   2863   41.41    59
  77 SlowChess Blitz Classic 2.3         :   3222      9    4000     834.5   20.86     82   1505   2413   37.63    85
  78 Xiphos 0.6                          :   3217      5   11500    2635.0   22.91    326   4618   6556   40.16    91
  79 SlowChess Blitz Classic 2.2         :   3210      9    3500     780.5   22.30    102   1357   2041   38.77    51
  80 Ethereal 11.75                      :   3210      7    4500    1196.0   26.58    210   1972   2318   43.82    99
  81 Fire 7.1                            :   3200      5   11500    2452.0   21.32    382   4140   6978   36.00   100
  82 RofChade 2.3                        :   3167      6    9000    1519.0   16.88    148   2742   6110   30.47   100
  83 Booot 6.4                           :   3142      7    7500    1212.5   16.17    127   2171   5202   28.95    84
  84 Laser 1.7                           :   3137      7    7750    1401.0   18.08    201   2400   5149   30.97    72
  85 Schooner 2.2                        :   3133     11    4000     571.0   14.28     48   1046   2906   26.15    86
  86 Andscacs 0.95                       :   3126      7    7250    1262.0   17.41    205   2114   4931   29.16   100
  87 Deep Shredder 13                    :   3104      9    5000     818.0   16.36    114   1408   3478   28.16    84
  88 Booot 6.3.1                         :   3098      9    4750     767.0   16.15    118   1298   3334   27.33   ---

White advantage = 59.20 +/- 0.53
Draw rate (equal opponents) = 73.36 % +/- 0.16

Games        : 195.750 (finished)

White Wins   :  62.198 (31.8 %)
Black Wins   :  37.251 (19.0 %)
Draws        :  96.301 (49.2 %)

White Score  : 56.4 %
Black Score  : 43.6 %
http://www.fastgm.de
Daniel Shawul
Posts: 4185
Joined: Tue Mar 14, 2006 11:34 am
Location: Ethiopia

Re: FGRL, 16 Cores vs RTX 2070 - 54. Scorpio 3.0.12 NN-ens-net-20x256

Post by Daniel Shawul »

Thanks for testing Scorpio!

Did you use uci or winboard mode for Scorpio ? I discovered a bug in winboard mode relating time controls
using fractions as you do, with 60+0.6. It will think the increment is 0 instead of 0.6.
This bug is not present in UCI mode though.

Daniel
fastgm
Posts: 818
Joined: Mon Aug 19, 2013 6:57 pm

Re: FGRL, 16 Cores vs RTX 2070 - 54. Scorpio 3.0.12 NN-ens-net-20x256

Post by fastgm »

Hi Daniel!

I did use the UCI mode.

Andreas
Daniel Shawul
Posts: 4185
Joined: Tue Mar 14, 2006 11:34 am
Location: Ethiopia

Re: FGRL, 16 Cores vs RTX 2070 - 54. Scorpio 3.0.12 NN-ens-net-20x256

Post by Daniel Shawul »

Good to know!

Again thanks for testing.

Daniel