FCP-Tourney-2024 ... ratings!

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

Frank Quisinsky
Posts: 6888
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

FCP-Tourney-2024 ... ratings!

Post by Frank Quisinsky »

Hi there,

the last round 16 is still-running.
Here the ratings from engines with more as 400 games.
- 90 minutes games, without resign-mode on 4Ghz with 5-man -

Best
Frank

Code: Select all

After 20.576 games (engines with more as 400 games)

   # Player                          :      Elo  Games  Score%  won  draw  lost  Points  Draw%  Error   OppAvg   OppE   OppD
   1 Stockfish 16 NN                 :  3492.55    766    69.5  300   465     1   532.5   60.7  14.18  3338.33  12.71   54.4
   2 Dragon 3.3 NN (Komodo)          :  3488.23    766    69.0  292   473     1   528.5   61.7  13.63  3338.41  12.72   54.4
   3 Berserk 12 NN                   :  3470.22    766    66.8  266   492     8   512.0   64.2  13.32  3338.76  12.72   54.4
   4 RubiChess 20230918 NN           :  3443.18    816    63.9  234   575     7   521.5   70.5  12.37  3335.60  13.01   59.2
   5 Caissa 1.14.1 NN                :  3432.37    666    61.0  162   488    16   406.0   73.3  13.31  3348.73  12.26   45.0
   6 CSTal 2.00 NN                   :  3432.36    816    62.6  217   587    12   510.5   71.9  11.66  3335.79  13.02   59.2
   7 Koivisto 9.2 NN dev             :  3419.82    734    61.3  194   512    28   450.0   69.8  12.82  3333.09  13.03   56.4
   8 Clover 6.1 NN                   :  3415.25    600    58.8  132   442    26   353.0   73.7  13.77  3348.18  12.15   40.0
   9 rofChade 3.1 NN                 :  3414.28    816    60.2  194   595    27   491.5   72.9  11.83  3336.13  13.02   59.2
  10 Uralochka 3.40a NN              :  3413.91    706    59.0  163   507    36   416.5   71.8  12.11  3345.47  12.48   48.7
  11 Igel 3.5.0 NN                   :  3412.88    816    60.0  183   614    19   490.0   75.2  11.53  3336.15  13.02   59.2
  12 Revenge 3.0 NN                  :  3412.00    816    59.9  183   612    21   489.0   75.0  11.71  3336.17  13.02   59.2
  13 Obsidian 8.0 NN                 :  3409.56    642    58.1  138   470    34   373.0   73.2  13.12  3348.12  12.20   43.0
  14 Rebel EAS NN                    :  3404.54    816    58.9  180   602    34   481.0   73.8  11.89  3336.31  13.02   59.2
  15 Koivisto 9.2 NN dev (hotfix)    :  3400.87    600    56.9  119   445    36   341.5   74.2  13.17  3348.54  12.16   40.0
  16 Seer 2.6.0 NN                   :  3400.17    400    61.4  105   281    14   245.5   70.3  16.98  3313.39  13.21   40.0
  17 Caissa 1.13.1 NN                :  3397.28    510    59.4  111   384    15   303.0   75.3  15.14  3325.53  13.21   51.0
  18 Clover 6.0 NN                   :  3395.25    734    58.1  158   537    39   426.5   73.2  12.22  3333.56  13.04   56.4
  19 Seer 2.7.0 NN                   :  3395.19    766    57.2  154   569    43   438.5   74.3  11.71  3340.23  12.75   54.4
  20 Alexandria 5.1.0 NN             :  3394.42    642    56.1  116   488    38   360.0   76.0  12.74  3348.47  12.21   43.0
  21 Alexandria 5.0.0 NN             :  3393.97    630    58.5  142   453    35   368.5   71.9  13.27  3329.35  13.13   54.8
  22 Viridithas 11.0.0 NN            :  3392.40    816    57.4  169   598    49   468.0   73.3  11.54  3336.53  13.02   59.2
  23 SlowChess Blitz 2.9 NN          :  3380.00    816    55.7  151   607    58   454.5   74.4  11.29  3336.76  13.03   59.2
  24 Arasan 24.0 NN                  :  3377.22    816    55.3  141   621    54   451.5   76.1  10.82  3336.81  13.04   59.2
  25 Obsidian 7.0 NN                 :  3364.84    480    52.5   60   384    36   252.0   80.0  14.58  3346.02  12.13   40.0
  26 Fire 9.2 NN                     :  3355.31    706    51.1   99   524    83   361.0   74.2  12.51  3346.72  12.48   48.7
  27 Minic 3.39 NN                   :  3353.83    766    51.7  108   576    82   396.0   75.2  11.25  3341.04  12.76   54.4
  28 Fritz 19 NN (Gingko)            :  3351.21    666    50.1   86   495    85   333.5   74.3  12.24  3350.56  12.28   45.0
  29 Carp 3.0.1 NN                   :  3341.67    816    50.6  106   613    97   412.5   75.1  11.18  3337.46  13.03   59.2
  30 Booot 7.2 NN                    :  3339.42    816    50.2  107   606   103   410.0   74.3  10.85  3337.50  13.03   59.2
  31 Uralochka 3.39d NN              :  3337.96    450    51.2   71   319    60   230.5   70.9  15.29  3328.84  13.20   45.0
  32 Minic 3.32 NN                   :  3326.46    400    51.5   57   298    45   206.0   74.5  15.97  3315.24  13.23   40.0
  33 Superultra 1.0 NN               :  3312.59    816    46.6   92   577   147   380.5   70.7  11.26  3338.00  13.03   59.2
  34 Black Marlin 8.0 NN             :  3311.72    816    46.5   90   579   147   379.5   71.0  11.06  3338.01  13.03   59.2
  35 Altair 6.0.0 NN                 :  3311.18    600    44.8   42   453   105   268.5   75.5  13.00  3350.78  12.17   40.0
  36 Wasp 6.50 NN                    :  3307.47    450    47.1   59   306    85   212.0   68.0  14.74  3329.52  13.21   45.0
  37 Wasp 6.61 NN dev                :  3306.17    706    44.5   65   498   143   314.0   70.5  12.06  3347.76  12.49   48.7
  38 Fire 9 NN                       :  3304.99    450    46.8   61   299    90   210.5   66.4  15.14  3329.58  13.20   45.0
  39 Stormphrax 3.0.0 NN             :  3301.41    706    43.8   64   491   151   309.5   69.5  11.54  3347.86  12.50   48.7
  40 Velvet 5.3.0 NN                 :  3301.22    816    45.1   82   572   162   368.0   70.1  11.50  3338.20  13.02   59.2
  41 PowerFritz 18 NN (Gingko)       :  3299.07    510    46.3   48   376    86   236.0   73.7  14.29  3327.46  13.23   51.0
  42 Komodo 14.1                     :  3293.44    400    47.0   41   294    65   188.0   73.5  15.62  3316.06  13.24   40.0
  43 Texel 1.10 NN                   :  3276.25    816    41.8   68   546   202   341.0   66.9  11.29  3338.66  13.03   59.2
  44 Akimbo 0.7.0 NN                 :  3270.86    706    39.8   48   466   192   281.0   66.0  13.02  3348.51  12.47   48.7
  45 Stormphrax 2.0.0 NN             :  3264.94    450    41.4   36   301   113   186.5   66.9  16.02  3330.47  13.18   45.0
  46 Devre 4.0 NN                    :  3260.35    816    39.7   53   542   221   324.0   66.4  11.63  3338.96  13.02   59.2
  47 BlackCore 6.0 NN                :  3255.11    816    39.0   63   511   242   318.5   62.6  11.79  3339.05  13.02   59.2
  48 Marvin 6.2.0 NN                 :  3252.72    816    38.7   45   542   229   316.0   66.4  12.04  3339.10  13.01   59.2
  49 Nemorino 6.11 NN dev            :  3251.81    816    38.6   45   540   231   315.0   66.2  12.29  3339.11  13.01   59.2
  50 Pawn 2.0 NN                     :  3251.35    816    38.5   45   539   232   314.5   66.1  12.34  3339.12  13.01   59.2
  51 Halogen 11.4 NN                 :  3248.02    816    38.1   45   532   239   311.0   65.2  11.44  3339.18  13.02   59.2
  52 Smallbrain 7.0 NN               :  3246.13    816    37.9   43   532   241   309.0   65.2  11.92  3339.22  13.01   59.2
  53 Chess.cpp 4.0 NN                :  3233.00    666    34.5   31   397   238   229.5   59.6  14.49  3353.22  12.23   45.0
  54 Willow 3.1 NN                   :  3229.65    816    35.8   38   508   270   292.0   62.3  13.33  3339.52  12.99   59.2
  55 StockDory Starfish 0.1 NN       :  3224.94    510    36.6   23   327   160   186.5   64.1  15.45  3328.91  13.20   51.0
  56 Tucano 11.00.1 NN               :  3222.64    450    36.0   21   282   147   162.0   62.7  16.33  3331.41  13.18   45.0
  57 Weiss 230309 dev                :  3220.53    734    35.0   51   412   271   257.0   56.1  13.12  3336.90  13.02   56.4
  58 Peacekeeper 2.10 NN             :  3215.81    400    33.6   11   247   142   134.5   61.8  18.26  3343.63  12.26   40.0
  59 Avalanche 2.0.0 NN              :  3205.61    450    33.9   15   275   160   152.5   61.1  17.42  3331.78  13.15   45.0
  60 Akimbo 0.6.0 NN                 :  3192.38    400    33.8   15   240   145   135.0   60.0  18.23  3318.59  13.17   40.0
  61 Midnight 8 NN                   :  3182.17    400    32.5   11   238   151   130.0   59.5  18.58  3318.84  13.17   40.0

White advantage             = 59.17  +/- 1.25
Draw rate (equal opponents) = 87.80% +/- 0.41

White Wins =   4.700 ( 22.84% )
Draws      =  14.327 ( 69.63% )
Black Wins =   1.549 (  7.53% )
Average    =  190.92 ( 95,4 moves )

A00-A99    =   4.384 ( 21.30% )
B00-B99    =   4.793 ( 21.20% )
C00-C99    =   4.301 ( 20,90% )
D00-D99    =   3.445 ( 16,70% )
E00-E99    =   3.653 ( 17,70% )

Code: Select all

FCP-Tourney-2024, hardware

Operating system: Windows 10 Professional
GUI:              Shredder 12 by Stefan Meyer-Kahlen
Processor:        AMD Ryzen™ 9 5950X / RTX 3070-Ti = 16 cores
Ghz, RAM:         4.0Ghz overclocked, DDR4 3200Mhz
Bench:            Total time= 87,18 seconds, nodes= 126164000, nps= 1447112
                  Bench results by Wasp 6.50 NN with 1 core, 768Mb hashtables
TalkChess:        U.S. Forum, thread 82625



FCP-Tourney-2024, parameters / statistics

Start of tourney: September 24th, 2023 (22:30)
End of tourney:   ~December 27th, 2023

FTP updates:      Every 10 minutes, the current table is updated with Fling Plus 5.04.
Tournament table: https://www.amateurschach.de/fling/fcp-tourney-2024.html

FTP updates:      Every 10 minutes, the current game-plan is updated with Fling Plus 5.04.
Game-Plan         https://www.amateurschach.de/fling/fcp-tourney-2024.sto

HTTPS updates:    After every or every other round. If I work on it more often (irregular)
Games & Stats     https://www.amateurschach.de/download/_fcp-tourney-2024.zip

                  **********************************************************
                  * Current statistics after round 14 (Dec. 23rd, 2023)    *
                  * Move-average: 190,72 = 95,3 moves                      *
                  * Draws: 70,56%                                          *
                  * Difference between rank 1 & rank 41: 265,12 Elo (Ordo) *
                  * Average game: ~250 games per day                       *
                  **********************************************************

Elo:              ~3351 (avg. of 41 participate engines) setting for Shredder 12 GUI
                  SlowChess Blitz 2.9 NN is playing with ~3380 Elo (reference)

Tournament type:  Everyone against everyone, 41 engines, 16 games per match,
                  640 games per engine, 820 games per round, 16 x 820 = 13.120 games total

Engine-Updates:   Stopped since December 13th, 2023

Time control:     40/20, 40 moves in 20 minutes "repeatedly"

Endgame 5-man:    syzygy
Endgame 5-man:    gaviotabases & syzygy for Texel 1.10 NN

Opening book:     feobos-v20.1-contempt_3-5_tuned-v2.bkt for Shredder GUI
                  Lines are balanced, 3 moves after the end of the ECO-code.

Cores:            1 core, Hyperthreading = off, Large-Pages = off
Hashtables:       768Mb
Contempt:         Default engine settings changed to contempt = 0
                  Setting forgotten for SlowChess Blitz 2.9 NN
                  resign = off, ponder = off, learning = off

Replay games:     Every draw less than 20 moves



FCP-Tourney-2024, this and that

Neural-Network:   Each programmer has to develop his own neural network.
Quantity engines: Each programmer can participate with only one engine.
dev:              Developer builds from available engines are allowed.
Derivat:          Derived engines are not allowed.



Frank Quisinsky, Germany / Gutweiler
Frank Quisinsky
Posts: 6888
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: FCP-Tourney-2024 ... ratings!

Post by Frank Quisinsky »

I am very surprised ...
A work of three months only with ... 1 PC only!

With a better move average from many engines many more games are possible with resign=off.

But I start a new tournament in about 4 days!
Been working on it for a while.

See you later ...
If not ... bye-bye, but I am here if the days are long and ...

:-)

Best
Frank