FCP Tourney Ratings ...

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

Frank Quisinsky
Posts: 6808
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

FCP Tourney Ratings ...

Post by Frank Quisinsky »

Hi there,

if I added all the games from FCP Tourneys to a rating list ...
Interesting for me for calculate the tournament average for FCP Tourney-2021.
I believe 3080 is not right if Shredder 13 have 3125.

Have a look here:

Code: Select all

   # Player                          :      Elo  Games  Score%  Draw%  Error   OppAvg   OppE   OppD
   1 Stockfish 110121 NN BMI2 x64    :  3486.50    200    89.0   22.0  55.76  3086.28  24.81   40.0
   2 Dragon by Komodo NN AVX2 x64    :  3465.04    200    87.8   23.5  52.87  3086.81  24.88   40.0
   3 Stockfish 11 BMI2 x64           :  3362.54   2000    83.7   32.1  15.16  3049.74  11.93   40.0
   4 Komodo 14.0 BMI2 x64            :  3291.99   2000    77.7   40.5  14.34  3051.51  11.95   40.0
   5 SlowChess 2.5 NN AVX2 x64       :  3288.45    200    73.5   39.0  38.38  3091.23  25.25   40.0
   6 Houdini 6.03 Pro x64            :  3282.51   2000    76.8   43.3  13.62  3051.74  11.97   40.0
   7 Ethereal 12.75 PEXT x64         :  3278.63    200    72.5   46.0  38.71  3091.48  25.24   40.0
   8 Ethereal 12.25 PEXT x64         :  3222.93   2000    70.7   50.5  12.99  3053.23  11.99   40.0
   9 Igel 2.9.0 NN BMI2 x64          :  3219.64    200    66.0   53.0  37.48  3092.95  25.27   40.0
  10 RubiChess 1.9 NN BMI2 x64       :  3200.57    200    63.8   52.5  34.82  3093.43  25.34   40.0
  11 Nemorino 6.04 NN PEXT x64       :  3198.30    200    63.5   50.0  35.27  3093.48  25.32   40.0
  12 SlowChess 2.2 x64               :  3192.21   2000    67.2   50.1  12.72  3054.00  11.99   40.0
  13 Fire 7.1 POP x64                :  3190.07   2000    67.0   52.1  13.26  3054.05  11.98   40.0
  14 Pedone 3.0 NN BMI2 x64          :  3184.19    200    61.8   57.5  34.10  3093.84  25.35   40.0
  15 Xiphos 0.6 BMI2 x64             :  3170.56   2200    64.2   53.1  11.55  3058.14  13.29   49.1
  16 Lc0 0.26.3 NN CPU x64           :  3169.28    540    75.5   37.2  24.08  2936.00  25.59   76.1
  17 rofChade 2.3 BMI2 x64           :  3166.97   2200    63.8   51.2  11.61  3058.23  13.28   49.1
  18 Booot 6.4 POPCNT x64            :  3166.42   2200    63.7   55.0  11.70  3058.25  13.28   49.1
  19 Defenchess 2.3 dev BMI2 x64     :  3165.70    200    59.5   48.0  34.41  3094.30  25.35   40.0
  20 Laser 1.7 BMI2 x64              :  3141.82   2200    60.7   54.8  11.62  3058.86  13.28   49.1
  21 Shredder 13 POPCNT x64          :  3125.00   2200    58.6   52.5  11.16  3059.28  13.30   49.1
  22 Fritz 17 (Ginkgo) x64           :  3123.93   2200    58.5   54.6  11.64  3059.31  13.28   49.1
  23 Schooner 2.2 SSE x64            :  3121.78   2200    58.2   57.0  11.46  3059.36  13.29   49.1
  24 Defenchess 2.2 POP x64          :  3116.61   2000    58.0   57.3  11.97  3055.89  12.01   40.0
  25 RubiChess 1.7.3 x64             :  3112.88   2000    57.5   53.9  12.32  3055.98  12.00   40.0
  26 Andscacs 0.95 BMI2 x64          :  3105.08   2000    56.5   54.0  12.02  3056.18  12.01   40.0
  27 Fizbo 2.0 BMI2 x64              :  3090.80   2200    54.2   51.1  11.39  3060.14  13.29   49.1
  28 Wasp 4.50 Modern x64            :  3084.02    200    49.0   60.0  33.40  3096.34  25.37   40.0
  29 Andscacs 0.95.123 x64           :  3077.83    200    48.3   57.5  33.96  3096.50  25.36   40.0
  30 GullChess 3.0 Sy BMI2 x64       :  3074.93    300    49.3   52.7  26.28  3083.86  28.58   34.8
  31 Wasp 4.08 dev Modern x64        :  3073.00    440    70.8   40.7  26.20  2893.75  27.61   46.1
  32 Arasan 22.2 BMI2 x64            :  3068.66    200    47.0   52.0  33.81  3096.72  25.36   40.0
  33 Arasan 22.1.0 Numa BMI2 x64     :  3067.16    100    51.0   54.0  44.93  3059.99  30.90    5.0
  34 Winter 0.9 NN BMI2 x64          :  3064.27    300    47.8   50.3  28.29  3084.74  28.41   34.8
  35 Arasan 22.0 BMI2 x64            :  3058.69   2000    50.5   51.9  11.74  3057.34  12.02   40.0
  36 GullChess 3.0 BMI2 x64          :  3055.63   2000    50.0   55.0  12.46  3057.41  12.00   40.0
  37 Pedone 2.1 BMI2 x64             :  3055.22    100    49.0   60.0  47.08  3062.37  30.47    5.0
  38 Koivisto 4.19 AVX x64           :  3054.87    200    45.3   49.5  32.20  3097.07  25.40   40.0
  39 Combusken 1.4.0 AMD x64         :  3032.51    300    43.3   52.0  26.66  3087.39  28.54   34.8
  40 Marvin 5.0.0 NN AVX2 x64        :  3029.73    200    42.0   50.0  32.45  3097.70  25.39   40.0
  41 Halogen 9 NN PEXT x64           :  3023.88    200    41.3   51.5  33.26  3097.84  25.37   40.0
  42 Fritz 16 (Rybka) x64            :  3018.89   2000    45.3   50.8  11.95  3058.33  12.01   40.0
  43 Pedone 2.0 BMI2 x64             :  3010.62   2000    44.2   52.1  12.21  3058.54  12.01   40.0
  44 Chiron 4 x64                    :  3008.84   2200    43.5   52.0  11.60  3062.19  13.28   49.1
  45 Orion 0.8 NN POP AVX FMA x64    :  3007.81    540    58.2   47.2  21.15  2939.89  25.66   76.1
  46 Vajolet2 2.8 BMI2 x64           :  3006.85   2200    43.3   52.4  11.23  3062.24  13.29   49.1
  47 Winter 0.8 x64                  :  3006.18   2000    43.6   48.1  11.76  3058.65  12.02   40.0
  48 Wasp 4.00 Modern x64            :  3005.60   2000    43.5   52.9  12.28  3058.67  12.00   40.0
  49 Nirvanachess 2.5 POPCNT x64     :  2995.84    200    37.8   48.5  34.31  3098.55  25.35   40.0
  50 chess22k 1.14 JAVA x64          :  2995.06    540    56.8   42.0  21.68  2940.20  25.65   76.1
  51 Critter 1.6a x64                :  2994.71   2200    41.7   48.6  11.31  3062.54  13.29   49.1
  52 Igel 2.5.0 BMI2 x64             :  2992.41   2000    41.8   52.3  11.69  3059.00  12.02   40.0
  53 Equinox 3.30 x64                :  2992.22   2000    41.8   53.1  12.13  3059.00  12.01   40.0
  54 Demolito 2020-12-24 PEXT x64    :  2990.24    200    37.0   41.0  33.60  3098.68  25.37   40.0
  55 Texel 1.08a13 BMI2 x64          :  2987.72    200    36.8   53.5  33.37  3098.75  25.37   40.0
  56 Nirvanachess 2.4 POPCNT x64     :  2987.64   2340    45.0   51.2  10.57  3028.33  14.06   59.6
  57 Koivisto 4.0 POPCNT AVX x64     :  2985.85    340    66.9   41.5  27.18  2847.26  25.51   44.3
  58 Seer 1.2.1 NN Skylake x64       :  2980.46    540    55.0   45.6  21.26  2940.55  25.66   76.1
  59 Nemorino 5.00 BMI2 x64          :  2975.16   2000    39.6   47.0  12.01  3059.43  12.01   40.0
  60 Demolito 2020-05-14 PEXT x64    :  2966.04   2000    38.5   45.9  11.77  3059.65  12.02   40.0
  61 iCE 4.0 v853 Modern x64         :  2963.47   2200    37.8   47.2  11.68  3063.32  13.28   49.1
  62 Protector 1.9.0 x64             :  2962.67   2540    41.2   48.5  10.29  3034.49  15.00   68.7
  63 ChessBrainVB 3.74 TCEC w32      :  2958.78    340    63.7   39.7  26.06  2847.89  25.54   44.3
  64 Hannibal 1.7 x64                :  2955.92   2200    36.8   48.3  11.21  3063.51  13.29   49.1
  65 Texel 1.07 BMI2 x64             :  2952.20   2000    36.8   47.2  11.90  3060.00  12.01   40.0
  66 Minic 2.33 x64                  :  2949.97   2000    36.5   46.0  12.26  3060.06  12.00   40.0
  67 Marvin 4.0.1 POPCNT x64         :  2946.79    340    62.2   43.8  26.35  2848.17  25.53   44.3
  68 Senpai 2.0 BMI2 x64             :  2930.68   2000    34.1   46.3  12.18  3060.54  12.01   40.0
  69 Combusken 1.2.0 x64             :  2917.46   2000    32.5   44.7  12.66  3060.87  11.99   40.0
  70 pirarucu 3.3.5 JAVA x64         :  2916.58    540    47.3   43.9  21.34  2942.09  25.66   76.1
  71 SmarThink 1.98 AVX2 x64         :  2904.81   2340    34.8   39.7  11.05  3030.38  14.05   59.6
  72 Halogen 8.1 PEXT-AVX2 x64       :  2900.19    340    56.3   43.8  25.54  2849.27  25.55   44.3
  73 Topple 0.7.5 Skylake x64        :  2897.90    340    56.0   45.6  25.64  2849.32  25.55   44.3
  74 Topple 0.8.0 Modern x64         :  2897.18    200    26.3   41.5  35.89  3101.01  25.31   40.0
  75 Amoeba 3.2 x64                  :  2894.47    340    55.6   44.7  26.30  2849.41  25.53   44.3
  76 Bagatur 2.2 JAVA x64            :  2893.33    340    55.4   45.0  26.01  2849.43  25.54   44.3
  77 Naum 4.6 x64                    :  2891.05    340    55.1   47.9  25.87  2849.49  25.54   44.3
  78 Cheng 4.40 dev AVX2 x64         :  2881.95    340    54.0   42.6  26.04  2849.70  25.54   44.3
  79 Monolith 2.01 PEXT x64          :  2879.20   2340    31.9   44.8  11.12  3031.01  14.05   59.6
  80 FabChess 1.16 BMI2 x64          :  2878.54    340    53.5   50.0  25.49  2849.78  25.55   44.3
  81 Rodent IV 0.30 BMI2 x64         :  2874.01    340    52.9   48.8  25.21  2849.89  25.56   44.3
  82 Rodent IV 0.22 POP x64          :  2872.24   2000    27.4   42.0  12.90  3062.00  11.99   40.0
  83 Weiss 1.2 PEXT x64              :  2868.35    340    52.2   43.8  26.37  2850.02  25.53   44.3
  84 Tucano 9.00 x64                 :  2867.22    340    52.1   43.5  25.23  2850.05  25.56   44.3
  85 Hakkapeliitta TCEC v2 x64       :  2864.96    340    51.8   43.5  25.89  2850.10  25.54   44.3
  86 Gödel 7.0 SSE42 x64             :  2860.43    340    51.2   40.0  26.12  2850.21  25.54   44.3
  87 Hiarcs 14 WCSC w32              :  2823.09    340    46.3   45.6  25.62  2851.09  25.55   44.3
  88 Crafty 25.6 x64                 :  2802.55    340    43.7   44.4  26.12  2851.57  25.54   44.3
  89 Junior 13.3.00 x64              :  2799.10    340    43.2   40.0  27.03  2851.65  25.52   44.3
  90 Francesca 0.29a x64             :  2796.80    340    42.9   40.6  25.20  2851.70  25.56   44.3
  91 Asymptote 0.8 Broadwell x64     :  2791.03    340    42.2   40.3  25.60  2851.84  25.55   44.3
  92 Gogobello 2.2 BMI2 x64          :  2786.40    340    41.6   43.8  25.96  2851.95  25.54   44.3
  93 Dirty Cucumber x64              :  2781.74    340    41.0   42.6  26.94  2852.06  25.52   44.3
  94 Atlas 3.91 POPCNT x64           :  2774.73    340    40.1   35.6  26.98  2852.22  25.52   44.3
  95 Gaviota 1.0 AVX x64             :  2766.49    340    39.1   36.5  26.58  2852.42  25.53   44.3
  96 Spike 1.4 Leiden w32            :  2765.31    340    39.0   37.9  26.50  2852.44  25.53   44.3
  97 Quazar 0.4 x64                  :  2762.94    340    38.7   39.7  27.15  2852.50  25.51   44.3
  98 Stash 24.0 BMI2 x64             :  2759.37    340    38.2   36.5  26.46  2852.58  25.53   44.3
  99 Invictus r305 PEXT x64          :  2726.56    340    34.3   37.9  27.18  2853.36  25.51   44.3
 100 TheBaron 3.44.1 x64             :  2705.06    340    31.8   42.9  27.59  2853.86  25.50   44.3
 101 Mr Bob 0.9.0 POPCNT x64         :  2698.59    340    31.0   34.4  29.05  2854.01  25.47   44.3
 102 Cheese 2.2 POPCNT x64           :  2690.73    340    30.1   30.3  29.76  2854.20  25.45   44.3
 103 Spark 1.0 Core-i x64            :  2647.88    180    27.5   23.9  39.95  2839.33  26.34   45.0
 104 K2 0.96 dev x64                 :  2599.63    180    22.8   26.7  42.27  2840.40  26.29   45.0
 105 GreKo 2020.03 x64               :  2596.61    180    22.5   28.3  41.00  2840.47  26.32   45.0
 106 ProDeo 3.0 w32                  :  2587.40    180    21.7   25.6  42.40  2840.67  26.28   45.0
 107 OpenTal 1.0 POPCNT x64          :  2415.25    180     9.7    5.0  61.82  2844.50  25.85   45.0

White advantage = 49.03 +/- 1.09
Draw rate (equal opponents) = 60.12 % +/- 0.27

Frank Quisinsky
Posts: 6808
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: FCP Tourney Ratings ...

Post by Frank Quisinsky »

Now have a look here:
The 41 engines build at the moment an average from 3096,04 Elo.
In Shredder GUI tournament *.html table I added 3080 Elo, same for Excel statistics.

We have to make a correction and to looking again after round 10 out of 50 (engines played 400 games).

Code: Select all

   # Player                          :      Elo  Games  Score%  Draw%  Error   OppAvg   OppE   OppD
   1 Stockfish 110121 NN BMI2 x64    :  3486.50    200    89.0   22.0  55.76  3086.28  24.81   40.0
   2 Dragon by Komodo NN AVX2 x64    :  3465.04    200    87.8   23.5  52.87  3086.81  24.88   40.0
   3 SlowChess 2.5 NN AVX2 x64       :  3288.45    200    73.5   39.0  38.38  3091.23  25.25   40.0
   4 Ethereal 12.75 PEXT x64         :  3278.63    200    72.5   46.0  38.71  3091.48  25.24   40.0
   5 Igel 2.9.0 NN BMI2 x64          :  3219.64    200    66.0   53.0  37.48  3092.95  25.27   40.0
   6 RubiChess 1.9 NN BMI2 x64       :  3200.57    200    63.8   52.5  34.82  3093.43  25.34   40.0
   7 Nemorino 6.04 NN PEXT x64       :  3198.30    200    63.5   50.0  35.27  3093.48  25.32   40.0
   8 Pedone 3.0 NN BMI2 x64          :  3184.19    200    61.8   57.5  34.10  3093.84  25.35   40.0
   9 Xiphos 0.6 BMI2 x64             :  3170.56   2200    64.2   53.1  11.55  3058.14  13.29   49.1
  10 Lc0 0.26.3 NN CPU x64           :  3169.28    540    75.5   37.2  24.08  2936.00  25.59   76.1
  11 rofChade 2.3 BMI2 x64           :  3166.97   2200    63.8   51.2  11.61  3058.23  13.28   49.1
  12 Booot 6.4 POPCNT x64            :  3166.42   2200    63.7   55.0  11.70  3058.25  13.28   49.1
  13 Defenchess 2.3 dev BMI2 x64     :  3165.70    200    59.5   48.0  34.41  3094.30  25.35   40.0
  14 Laser 1.7 BMI2 x64              :  3141.82   2200    60.7   54.8  11.62  3058.86  13.28   49.1
  15 Shredder 13 POPCNT x64          :  3125.00   2200    58.6   52.5  11.16  3059.28  13.30   49.1
  16 Fritz 17 (Ginkgo) x64           :  3123.93   2200    58.5   54.6  11.64  3059.31  13.28   49.1
  17 Schooner 2.2 SSE x64            :  3121.78   2200    58.2   57.0  11.46  3059.36  13.29   49.1
  18 Fizbo 2.0 BMI2 x64              :  3090.80   2200    54.2   51.1  11.39  3060.14  13.29   49.1
  19 Wasp 4.50 Modern x64            :  3084.02    200    49.0   60.0  33.40  3096.34  25.37   40.0
  20 Andscacs 0.95.123 x64           :  3077.83    200    48.3   57.5  33.96  3096.50  25.36   40.0
  21 GullChess 3.0 Sy BMI2 x64       :  3074.93    300    49.3   52.7  26.28  3083.86  28.58   34.8
  22 Arasan 22.2 BMI2 x64            :  3068.66    200    47.0   52.0  33.81  3096.72  25.36   40.0
  23 Winter 0.9 NN BMI2 x64          :  3064.27    300    47.8   50.3  28.29  3084.74  28.41   34.8
  24 Koivisto 4.19 AVX x64           :  3054.87    200    45.3   49.5  32.20  3097.07  25.40   40.0
  25 Combusken 1.4.0 AMD x64         :  3032.51    300    43.3   52.0  26.66  3087.39  28.54   34.8
  26 Marvin 5.0.0 NN AVX2 x64        :  3029.73    200    42.0   50.0  32.45  3097.70  25.39   40.0
  27 Halogen 9 NN PEXT x64           :  3023.88    200    41.3   51.5  33.26  3097.84  25.37   40.0
  28 Chiron 4 x64                    :  3008.84   2200    43.5   52.0  11.60  3062.19  13.28   49.1
  29 Orion 0.8 NN POP AVX FMA x64    :  3007.81    540    58.2   47.2  21.15  2939.89  25.66   76.1
  30 Vajolet2 2.8 BMI2 x64           :  3006.85   2200    43.3   52.4  11.23  3062.24  13.29   49.1
  31 Nirvanachess 2.5 POPCNT x64     :  2995.84    200    37.8   48.5  34.31  3098.55  25.35   40.0
  32 chess22k 1.14 JAVA x64          :  2995.06    540    56.8   42.0  21.68  2940.20  25.65   76.1
  33 Critter 1.6a x64                :  2994.71   2200    41.7   48.6  11.31  3062.54  13.29   49.1
  34 Demolito 2020-12-24 PEXT x64    :  2990.24    200    37.0   41.0  33.60  3098.68  25.37   40.0
  35 Texel 1.08a13 BMI2 x64          :  2987.72    200    36.8   53.5  33.37  3098.75  25.37   40.0
  36 Seer 1.2.1 NN Skylake x64       :  2980.46    540    55.0   45.6  21.26  2940.55  25.66   76.1
  37 iCE 4.0 v853 Modern x64         :  2963.47   2200    37.8   47.2  11.68  3063.32  13.28   49.1
  38 Protector 1.9.0 x64             :  2962.67   2540    41.2   48.5  10.29  3034.49  15.00   68.7
  39 Hannibal 1.7 x64                :  2955.92   2200    36.8   48.3  11.21  3063.51  13.29   49.1
  40 pirarucu 3.3.5 JAVA x64         :  2916.58    540    47.3   43.9  21.34  2942.09  25.66   76.1
  41 Topple 0.8.0 Modern x64         :  2897.18    200    26.3   41.5  35.89  3101.01  25.31   40.0

  126.937,63 : 41 = 3.096,04
fastgm
Posts: 818
Joined: Mon Aug 19, 2013 6:57 pm

Re: FCP Tourney Ratings ...

Post by fastgm »

Hi Frank,

I think 3125 Elo is a good value for Shredder 13.
In my 60 min + 15 sec rating list, Shredder 13 has 3126 Elo

http://fastgm.de/60min.html

Andreas
Frank Quisinsky
Posts: 6808
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: FCP Tourney Ratings ...

Post by Frank Quisinsky »

Hi there,

I am honest ... for NNUE engines more as I await ... much more!

Stockfish 12 to the current Stockfish dev. is around +20 Elo.
In testgames before (other system) I have from Stockfish 11 to Stockfish 12 = 85 Elo.
I believe that for FCP Tourney 2021 Elo will go a little bit down for Stockfish 11012021 and Dragon.

Dragon with NN is much stronger as Stockfish with NN.

Nemorino 6.00 is around 75 Elo stronger as Nemorino 6.04 with own train network file.
Andscacs 0.95.123 have start problems for FCP Toruney-2021, sure that Elo goes higher.

What I like is to look in Rubichess games.
Very hard chess what RubiChess like to play, full the Karpow style.
Not easy to beat ...

Wasp 4.5 with a great king safty plays also very hard chess, if no possibility for a fast won game.
Often Wasp lost in endgames with many pawns on board, often in balanced endgames with rook / pawns on the board.
Very dynamic positional play with a great "short-game statistics" but a high draw quote. Logical ... engine is on the middle of the field (higher draw quote).

SlowChess is playing much more aggressive chess since version 2.2.
For the high level Slow have more speculative attacking moves, this produced a great style with a lesser move average.
Wasp and Slow are on the right way!

After all ...
With neural network support the tournament have much more power as the tournament before (FCP Toruney-2020). Playing styles by engines isn't more boring after all I can see (often I am thinking before if more engines support NNUE eng-eng = more boring). Contrary, with NN support all is much more interesting!!

The new engines, like Seer or Koivisto, Marvin the others are great.
Combusken is playing with a complete other face / style to version 1.2.0.

Most aggressive chess from Halogen / Orion / Seer ... comes from Seer. But the other two can play very nice chess also.
Koivisto 4.19 need a bit more king safty but runs very stable, very nice development.

I am very very happy with all what I can see here.
Nice engines, nice tournament!
Programmes make me happy.

My first impressions ...

Best
Frank
Frank Quisinsky
Posts: 6808
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: FCP Tourney Ratings ...

Post by Frank Quisinsky »

Hello Andreas,

we all made in the past a small mistake (CEGT, IPON and my work with SWCR / FCP Ratings).
Shredder 12 = 2800 Elo = 25 Elo to high.

Today more games are available, more games vs. strong humans are available.

CCRL is clearly to high but the differences between the engines are right.
Same for CEGT, differences between the engines are right.

So CCRL and CEGT ... very strong work, all the time.

Most realisitic for myself after experiments with 3.1 Million computer chess games, 21.000 from humans I added (vs. computer chess engines, my private database I collected over many years) comes from yourself. I am very sure that Shredder 12 have in rapid exactly 2778 Elo. And if Shredder 12 is playing with 2778 Shredder 13 should have 3122 Elo, so 3125 Elo is OK for me.

Your ratings are with my results and experiments most realistic.
CEGT and what we added in the past for Shredder 12 (2800 Elo) are in the near but more perfect is Shredder 12 = 2775.

Important is to use an engine, strong in endgames (most games produced a decision in transition into endgame). Engines, strong in king attacks are not good for a rating list calculation. Shredder is here all the time the "perfect" solution.

Best
Frank
Frank Quisinsky
Posts: 6808
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: FCP Tourney Ratings ...

Post by Frank Quisinsky »

Hi there,

the games I have on the intel i7 10900, 4.9Ghz FCP Tourney system!

It seems that Andscacs 0.95.123 have start problems for FCP-Toruney-2021.
Same NirvanaChess 2.4 have for FCP-Tourney-2020.
400 games are clearly not enough!

Arasan 21.2 seems to be weaker as version 21.0.
Same here, I have not enough games.

I need the tables for the average calculation from the still running FCP Tourney-2021.
After 400 finnished games the average goes from 3095 to 3097 Elo (news 30 for FCP Tourney-2021 detail page).

Average calculation:
Have a look in the second list.

For the first list (engines with more as 320 games added only).

And for John Stanback the third list!
Possible that Wasp v4.5 like 5-man ... v4.0 tested with 4-man!
But I believe that Wasp 4.5 will be lost around 10-15 Elo points in the still running FCP Tourney-2021 with more games.
Fact is: The start after 400 finnished games I like a lot.

:-)

Best
Frank

Code: Select all

   # Player                          :      Elo  Games  Score%  Draw%  Error   OppAvg   OppE   OppD
   1 Stockfish 110121 NN BMI2 x64    :  3478.58    400    88.6   22.8  38.11  3088.03  18.70   40.0
   2 Dragon by Komodo NN AVX2 x64    :  3434.53    400    85.9   27.8  34.07  3089.14  18.80   40.0
   3 Stockfish 11 BMI2 x64           :  3366.22   2000    83.7   32.1  14.65  3053.41  10.95   40.0
   4 Komodo 14.0 BMI2 x64            :  3295.66   2000    77.7   40.5  13.25  3055.17  10.99   40.0
   5 Houdini 6.03 Pro x64            :  3286.19   2000    76.8   43.3  13.33  3055.41  10.98   40.0
   6 SlowChess 2.5 NN AVX2 x64       :  3274.65    400    72.0   42.5  26.81  3093.13  18.98   40.0
   7 Ethereal 12.75 PEXT x64         :  3261.86    400    70.6   48.3  25.60  3093.45  19.01   40.0
   8 Ethereal 12.25 PEXT x64         :  3226.60   2000    70.7   50.5  12.57  3056.90  11.00   40.0
   9 Igel 2.9.0 NN BMI2 x64          :  3214.60    400    65.3   54.0  24.87  3094.63  19.03   40.0
  10 RubiChess 1.9 NN BMI2 x64       :  3206.20    400    64.3   52.0  23.18  3094.84  19.07   40.0
  11 Nemorino 6.04 NN PEXT x64       :  3203.08    400    63.9   50.3  24.61  3094.92  19.04   40.0
  12 SlowChess 2.2 x64               :  3195.88   2000    67.2   50.1  12.16  3057.67  11.01   40.0
  13 Fire 7.1 POP x64                :  3193.73   2000    67.0   52.1  11.78  3057.72  11.02   40.0
  14 Pedone 3.0 NN BMI2 x64          :  3184.60    400    61.6   53.3  24.13  3095.38  19.05   40.0
  15 Xiphos 0.6 BMI2 x64             :  3176.15   2500    64.5   53.1  10.41  3061.86  12.24   52.6
  16 rofChade 2.3 BMI2 x64           :  3171.01   2500    63.9   50.9  11.10  3061.99  12.22   52.6
  17 Booot 6.4 POPCNT x64            :  3170.85   2500    63.9   54.4  10.52  3061.99  12.24   52.6
  18 Lc0 0.26.3 NN CPU x64           :  3164.26    720    69.7   42.8  19.74  2993.70  21.33   73.0
  19 Defenchess 2.3 dev BMI2 x64     :  3153.67    400    57.8   52.0  24.36  3096.16  19.04   40.0
  20 Laser 1.7 BMI2 x64              :  3141.47   2500    60.2   55.4  10.43  3062.70  12.24   52.6
  21 Fritz 17 (Ginkgo) x64           :  3127.99   2500    58.5   54.8  10.02  3063.02  12.25   52.6
  22 Schooner 2.2 SSE x64            :  3127.52   2500    58.5   56.2  10.20  3063.03  12.24   52.6
  23 Shredder 13 POPCNT x64          :  3125.00   2500    58.2   52.5   9.86  3063.09  12.25   52.6
  24 Defenchess 2.2 POP x64          :  3121.35   2100    58.5   57.1  10.80  3056.74  10.87   38.8
  25 RubiChess 1.7.3 x64             :  3116.54   2000    57.5   53.9  11.46  3059.65  11.03   40.0
  26 Andscacs 0.95 BMI2 x64          :  3109.61   2100    57.0   53.6  11.48  3057.02  10.85   38.8
  27 Wasp 4.50 Modern x64            :  3101.40    400    51.0   60.0  23.07  3097.46  19.07   40.0
  28 Fizbo 2.0 BMI2 x64              :  3093.74   2500    54.1   51.6  10.40  3063.84  12.24   52.6
  29 Andscacs 0.95.123 x64           :  3088.97    400    49.4   56.3  22.77  3097.77  19.08   40.0
  30 GullChess 3.0 Sy BMI2 x64       :  3085.54    460    49.6   52.2  21.15  3092.67  19.70   38.7
  31 Wasp 4.08 dev Modern x64        :  3078.23    380    71.6   41.1  25.68  2898.50  23.60   41.1
  32 Arasan 22.0 BMI2 x64            :  3062.71   2100    50.9   52.1  11.49  3058.14  10.85   38.8
  33 Winter 0.9 NN BMI2 x64          :  3060.30    460    46.1   47.8  22.16  3094.32  19.63   38.7
  34 GullChess 3.0 BMI2 x64          :  3059.99   2100    50.5   54.7  11.26  3058.21  10.86   38.8
  35 Koivisto 4.19 AVX x64           :  3054.50    400    44.9   50.8  23.58  3098.64  19.06   40.0
  36 Arasan 22.2 BMI2 x64            :  3053.54    400    44.8   55.0  24.51  3098.66  19.04   40.0
  37 Marvin 5.0.0 NN AVX2 x64        :  3042.94    400    43.4   49.8  23.96  3098.92  19.05   40.0
  38 Combusken 1.4.0 AMD x64         :  3035.69    460    42.7   52.0  22.70  3095.92  19.59   38.7
  39 Orion 0.8 NN FMA x64            :  3024.71    720    53.6   50.0  18.11  2997.19  21.37   73.0
  40 Fritz 16 (Rybka) x64            :  3021.27   2100    45.5   51.0  11.02  3059.13  10.86   38.8
  41 Nirvanachess 2.5 POPCNT x64     :  3020.56    400    40.5   49.5  23.74  3099.48  19.06   40.0
  42 Pedone 2.0 BMI2 x64             :  3016.52   2100    44.8   52.1  11.12  3059.24  10.86   38.8
  43 Halogen 9 NN PEXT x64           :  3015.65    400    39.9   51.3  23.73  3099.61  19.06   40.0
  44 Chiron 4 x64                    :  3013.92   2500    43.7   52.4  10.20  3065.76  12.24   52.6
  45 Vajolet2 2.8 BMI2 x64           :  3010.52   2500    43.3   52.6  10.29  3065.84  12.24   52.6
  46 Winter 0.8 x64                  :  3008.65   2100    43.8   48.6  10.89  3059.43  10.87   38.8
  47 Critter 1.6a x64                :  3001.22   2500    42.1   48.3  10.33  3066.06  12.24   52.6
  48 Wasp 4.00 Modern x64            :  3001.03   5100    45.0   52.5   7.29  3040.71  11.35   38.9
  49 Seer 1.2.1 NN Skylake x64       :  3000.91    720    50.7   46.9  18.19  2997.79  21.37   73.0
  50 Equinox 3.30 x64                :  2996.88   2100    42.3   53.3  11.38  3059.71  10.85   38.8
  51 Igel 2.5.0 BMI2 x64             :  2996.07   2000    41.8   52.3  10.95  3062.66  11.04   40.0
  52 Nirvanachess 2.4 POPCNT x64     :  2992.87   2420    44.9   52.1   9.99  3034.74  12.66   56.0
  53 chess22k 1.14 JAVA x64          :  2992.43    720    49.7   43.5  17.83  2998.00  21.38   73.0
  54 Demolito 2020-12-24 PEXT x64    :  2988.72    400    36.5   43.5  23.32  3100.28  19.07   40.0
  55 Koivisto 4.0 POPCNT AVX x64     :  2988.15    320    65.0   43.8  26.45  2870.37  23.89   40.0
  56 Nemorino 5.00 BMI2 x64          :  2980.35   2100    40.2   47.5  11.38  3060.10  10.85   38.8
  57 Texel 1.08a13 BMI2 x64          :  2979.57    400    35.4   48.3  23.96  3100.51  19.05   40.0
  58 Demolito 2020-05-14 PEXT x64    :  2969.70   2000    38.5   45.9  11.72  3063.32  11.02   40.0
  59 iCE 4.0 v853 Modern x64         :  2967.19   2500    37.8   47.1   9.98  3066.88  12.25   52.6
  60 ChessBrainVB 3.74 TCEC w32      :  2966.72    320    62.3   40.9  26.24  2870.91  23.89   40.0
  61 Protector 1.9.0 x64             :  2965.72   2820    40.4   48.8   9.41  3044.68  13.63   69.3
  62 Hannibal 1.7 x64                :  2960.28   2500    36.9   48.4   9.95  3067.05  12.25   52.6
  63 Texel 1.07 BMI2 x64             :  2956.16   2100    37.1   47.3  11.20  3060.68  10.86   38.8
  64 Marvin 4.0.1 POPCNT x64         :  2953.14    320    60.6   45.6  27.43  2871.25  23.86   40.0
  65 Minic 2.33 x64                  :  2952.13   2100    36.6   46.3  11.18  3060.77  10.86   38.8
  66 Senpai 2.0 BMI2 x64             :  2933.25   2100    34.3   46.5  11.32  3061.22  10.86   38.8
  67 Combusken 1.2.0 x64             :  2921.12   2000    32.5   44.7  12.04  3064.54  11.02   40.0
  68 pirarucu 3.3.5 JAVA x64         :  2920.06    720    40.8   44.2  18.12  2999.81  21.37   73.0
  69 Topple 0.7.5 Skylake x64        :  2911.05    320    55.2   47.8  25.98  2872.30  23.90   40.0
  70 SmarThink 1.98 AVX2 x64         :  2910.49   2420    34.7   40.1  10.52  3036.71  12.65   56.0
  71 Topple 0.8.0 Modern x64         :  2905.83    400    26.9   41.3  26.57  3102.35  18.99   40.0
  72 Halogen 8.1 PEXT-AVX2 x64       :  2905.13    320    54.4   45.0  25.55  2872.45  23.91   40.0
  73 Amoeba 3.2 x64                  :  2901.59    320    53.9   45.9  26.58  2872.54  23.88   40.0
  74 Naum 4.6 x64                    :  2900.81    420    49.6   48.8  22.84  2903.14  20.00   28.8
  75 Bagatur 2.2 JAVA x64            :  2899.23    320    53.6   45.9  26.55  2872.59  23.88   40.0
  76 FabChess 1.16 BMI2 x64          :  2889.81    320    52.3   50.3  26.10  2872.83  23.89   40.0
  77 Cheng 4.40 dev AVX2 x64         :  2883.93    320    51.6   44.4  26.65  2872.98  23.88   40.0
  78 Monolith 2.01 PEXT x64          :  2882.96   2320    31.4   45.0  11.04  3038.94  12.87   58.0
  79 Rodent IV 0.22 POP x64          :  2876.05   2100    27.7   42.7  12.28  3062.59  10.83   38.8
  80 Rodent IV 0.30 BMI2 x64         :  2875.72    320    50.5   50.9  26.05  2873.18  23.89   40.0
  81 Tucano 9.00 x64                 :  2875.72    320    50.5   45.3  26.53  2873.18  23.88   40.0
  82 Hakkapeliitta TCEC v2 x64       :  2873.64    420    46.1   44.5  23.06  2903.66  20.00   28.8
  83 Weiss 1.2 PEXT x64              :  2872.20    320    50.0   45.6  26.02  2873.27  23.90   40.0
  84 Gödel 7.0 SSE42 x64             :  2865.16    320    49.1   41.9  25.91  2873.45  23.90   40.0
  85 Hiarcs 14 WCSC w32              :  2828.67    320    44.2   46.6  26.45  2874.36  23.88   40.0
  86 Crafty 25.6 x64                 :  2810.80    320    41.9   45.0  26.07  2874.81  23.89   40.0
  87 Francesca 0.29a x64             :  2805.99    320    41.3   41.3  25.58  2874.93  23.91   40.0
  88 Junior 13.3.00 x64              :  2805.99    320    41.3   39.4  26.26  2874.93  23.89   40.0
  89 Asymptote 0.8 Broadwell x64     :  2796.33    320    40.0   40.6  25.54  2875.17  23.91   40.0
  90 Dirty Cucumber x64              :  2787.81    320    38.9   43.4  26.66  2875.38  23.88   40.0
  91 Gogobello 2.2 BMI2 x64          :  2787.81    320    38.9   44.7  26.30  2875.38  23.89   40.0
  92 Atlas 3.91 POPCNT x64           :  2773.02    320    37.0   37.2  28.90  2875.75  23.82   40.0
  93 Spike 1.4 Leiden w32            :  2770.53    320    36.7   39.1  27.62  2875.81  23.86   40.0
  94 Gaviota 1.0 AVX x64             :  2768.03    320    36.4   37.2  26.50  2875.87  23.88   40.0
  95 Quazar 0.4 x64                  :  2763.01    320    35.8   41.6  26.82  2876.00  23.88   40.0
  96 Stash 24.0 BMI2 x64             :  2760.49    320    35.5   38.4  27.41  2876.06  23.86   40.0
  97 Invictus r305 PEXT x64          :  2732.11    320    32.0   38.4  27.91  2876.77  23.85   40.0
  98 TheBaron 3.44.1 x64             :  2716.05    320    30.2   43.4  29.04  2877.17  23.82   40.0
  99 Mr Bob 0.9.0 POPCNT x64         :  2702.29    320    28.6   34.7  28.80  2877.52  23.83   40.0
 100 Cheese 2.2 POPCNT x64           :  2699.49    320    28.3   30.9  29.41  2877.59  23.81   40.0

White advantage = 49.16 +/- 1.02
Draw rate (equal opponents) = 60.28 % +/- 0.24

Code: Select all

   # Player                          :      Elo  Games  Score%  Draw%  Error   OppAvg   OppE   OppD
   1 Stockfish 110121 NN BMI2 x64    :  3478.58    400    88.6   22.8  38.11  3088.03  18.70   40.0
   2 Dragon by Komodo NN AVX2 x64    :  3434.53    400    85.9   27.8  34.07  3089.14  18.80   40.0
   3 SlowChess 2.5 NN AVX2 x64       :  3274.65    400    72.0   42.5  26.81  3093.13  18.98   40.0
   4 Ethereal 12.75 PEXT x64         :  3261.86    400    70.6   48.3  25.60  3093.45  19.01   40.0
   5 Igel 2.9.0 NN BMI2 x64          :  3214.60    400    65.3   54.0  24.87  3094.63  19.03   40.0
   6 RubiChess 1.9 NN BMI2 x64       :  3206.20    400    64.3   52.0  23.18  3094.84  19.07   40.0
   7 Nemorino 6.04 NN PEXT x64       :  3203.08    400    63.9   50.3  24.61  3094.92  19.04   40.0
   8 Pedone 3.0 NN BMI2 x64          :  3184.60    400    61.6   53.3  24.13  3095.38  19.05   40.0
   9 Xiphos 0.6 BMI2 x64             :  3176.15   2500    64.5   53.1  10.41  3061.86  12.24   52.6
  10 rofChade 2.3 BMI2 x64           :  3171.01   2500    63.9   50.9  11.10  3061.99  12.22   52.6
  11 Booot 6.4 POPCNT x64            :  3170.85   2500    63.9   54.4  10.52  3061.99  12.24   52.6
  12 Lc0 0.26.3 NN CPU x64           :  3164.26    720    69.7   42.8  19.74  2993.70  21.33   73.0
  13 Defenchess 2.3 dev BMI2 x64     :  3153.67    400    57.8   52.0  24.36  3096.16  19.04   40.0
  14 Laser 1.7 BMI2 x64              :  3141.47   2500    60.2   55.4  10.43  3062.70  12.24   52.6
  15 Fritz 17 (Ginkgo) x64           :  3127.99   2500    58.5   54.8  10.02  3063.02  12.25   52.6
  16 Schooner 2.2 SSE x64            :  3127.52   2500    58.5   56.2  10.20  3063.03  12.24   52.6
  17 Shredder 13 POPCNT x64          :  3125.00   2500    58.2   52.5   9.86  3063.09  12.25   52.6
  18 Wasp 4.50 Modern x64            :  3101.40    400    51.0   60.0  23.07  3097.46  19.07   40.0
  19 Fizbo 2.0 BMI2 x64              :  3093.74   2500    54.1   51.6  10.40  3063.84  12.24   52.6
  20 Andscacs 0.95.123 x64           :  3088.97    400    49.4   56.3  22.77  3097.77  19.08   40.0
  21 GullChess 3.0 Sy BMI2 x64       :  3085.54    460    49.6   52.2  21.15  3092.67  19.70   38.7
  22 Winter 0.9 NN BMI2 x64          :  3060.30    460    46.1   47.8  22.16  3094.32  19.63   38.7
  23 Koivisto 4.19 AVX x64           :  3054.50    400    44.9   50.8  23.58  3098.64  19.06   40.0
  24 Arasan 22.2 BMI2 x64            :  3053.54    400    44.8   55.0  24.51  3098.66  19.04   40.0
  25 Marvin 5.0.0 NN AVX2 x64        :  3042.94    400    43.4   49.8  23.96  3098.92  19.05   40.0
  26 Combusken 1.4.0 AMD x64         :  3035.69    460    42.7   52.0  22.70  3095.92  19.59   38.7
  27 Orion 0.8 NN FMA x64            :  3024.71    720    53.6   50.0  18.11  2997.19  21.37   73.0
  28 Nirvanachess 2.5 POPCNT x64     :  3020.56    400    40.5   49.5  23.74  3099.48  19.06   40.0
  29 Halogen 9 NN PEXT x64           :  3015.65    400    39.9   51.3  23.73  3099.61  19.06   40.0
  30 Chiron 4 x64                    :  3013.92   2500    43.7   52.4  10.20  3065.76  12.24   52.6
  31 Vajolet2 2.8 BMI2 x64           :  3010.52   2500    43.3   52.6  10.29  3065.84  12.24   52.6
  32 Critter 1.6a x64                :  3001.22   2500    42.1   48.3  10.33  3066.06  12.24   52.6
  33 Seer 1.2.1 NN Skylake x64       :  3000.91    720    50.7   46.9  18.19  2997.79  21.37   73.0
  34 chess22k 1.14 JAVA x64          :  2992.43    720    49.7   43.5  17.83  2998.00  21.38   73.0
  35 Demolito 2020-12-24 PEXT x64    :  2988.72    400    36.5   43.5  23.32  3100.28  19.07   40.0
  36 Texel 1.08a13 BMI2 x64          :  2979.57    400    35.4   48.3  23.96  3100.51  19.05   40.0
  37 iCE 4.0 v853 Modern x64         :  2967.19   2500    37.8   47.1   9.98  3066.88  12.25   52.6
  38 Protector 1.9.0 x64             :  2965.72   2820    40.4   48.8   9.41  3044.68  13.63   69.3
  39 Hannibal 1.7 x64                :  2960.28   2500    36.9   48.4   9.95  3067.05  12.25   52.6
  40 pirarucu 3.3.5 JAVA x64         :  2920.06    720    40.8   44.2  18.12  2999.81  21.37   73.0
  41 Topple 0.8.0 Modern x64         :  2905.83    400    26.9   41.3  26.57  3102.35  18.99   40.0

126.999,93 : 41 = 3.097,56 Elo!

Code: Select all

   # Player                          :      Elo  Games  Score%  Draw%  Error   OppAvg   OppE   OppD
  27 Wasp 4.50 Modern x64            :  3101.40    400    51.0   60.0  23.07  3097.46  19.07   40.0
  31 Wasp 4.08 dev Modern x64        :  3078.23    380    71.6   41.1  25.68  2898.50  23.60   41.1
  48 Wasp 4.00 Modern x64            :  3001.03   5100    45.0   52.5   7.29  3040.71  11.35   38.9