Automated tuning... finally... (Topple v0.3.0)

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

User avatar
CMCanavessi
Posts: 1142
Joined: Thu Dec 28, 2017 4:06 pm
Location: Argentina

Re: Automated tuning... finally... (Topple v0.3.0)

Post by CMCanavessi »

In the end, I let the gauntlet finish. It was a huge improvement even though the rating and the % came down a bit after more games:

Topple v0.3.2 x64 157.0/240 (65.4%)
Topple v0.2.1 x64 118.0/240 (49.2%)
Topple v0.3.0 x64 115.5/240 (48.1%)


Current ratings:

Topple v0.3.2 x64 : 2552.5
Topple v0.2.1 x64 : 2424.9
Topple v0.3.0 x64 : 2421.7
Topple v0.2.0 x64 : 2413.3
Follow my tournament and some Leela gauntlets live at http://twitch.tv/ccls
konsolas
Posts: 182
Joined: Sun Jun 12, 2016 5:44 pm
Location: London
Full name: Vincent

Re: Automated tuning... finally... (Topple v0.3.0)

Post by konsolas »

So I've written some more search improvements which should score another 50 or so elo:

Code: Select all

Rank Name                          Elo     +/-   Games   Score   Draws
   0 Topple v0.3.2                  49      44     200   57.0%   19.0%
   1 pawny_1.2.x64.SSE4.2          241     228      20   80.0%   10.0%
   2 Fruit-2-3-1                   191     173      20   75.0%   20.0%
   3 ghost_v3.1-64bit               53     140      20   57.5%   25.0%
   4 danasah680                      0     144      20   50.0%   20.0%
   5 asymptote                     -53     140      20   42.5%   25.0%
   6 orion64-v0.5-bmi2             -89     144      20   37.5%   25.0%
   7 simplex-098-32-ja             -89     144      20   37.5%   25.0%
   8 drosophila-win64             -191     194      20   25.0%   10.0%
   9 GarboChess2-32               -301     161      20   15.0%   30.0%
  10 Teki2_win64                  -382     nan      20   10.0%    0.0%

200 of 200 games finished.

Code: Select all

Rank Name                          Elo     +/-   Games   Score   Draws
   0 Topple v0.3.3_dev             100      44     200   64.0%   21.0%
   1 Fruit-2-3-1                   168     175      20   72.5%   15.0%
   2 pawny_1.2.x64.SSE4.2           70     147      20   60.0%   20.0%
   3 ghost_v3.1-64bit              -53     140      20   42.5%   25.0%
   4 GarboChess2-32               -108     152      20   35.0%   20.0%
   5 danasah680                   -127     135      20   32.5%   35.0%
   6 drosophila-win64             -127     149      20   32.5%   25.0%
   7 asymptote                    -168     175      20   27.5%   15.0%
   8 orion64-v0.5-bmi2            -168     157      20   27.5%   25.0%
   9 simplex-098-32-ja            -191     151      20   25.0%   30.0%
  10 Teki2_win64                  -512     nan      20    5.0%    0.0%

200 of 200 games finished.
I'll try to make some more changes before releasing Topple v0.3.3 later. I think I'll also have to remove Teki from my gauntlet.
User avatar
CMCanavessi
Posts: 1142
Joined: Thu Dec 28, 2017 4:06 pm
Location: Argentina

Re: Automated tuning... finally... (Topple v0.3.0)

Post by CMCanavessi »

Wow, really nice!
Follow my tournament and some Leela gauntlets live at http://twitch.tv/ccls
konsolas
Posts: 182
Joined: Sun Jun 12, 2016 5:44 pm
Location: London
Full name: Vincent

Re: Automated tuning... finally... (Topple v0.3.0)

Post by konsolas »

Topple v0.3.3 has been released, which has several search improvements for an estimated gain of around 50 elo.

Binaries can be found here: https://github.com/konsolas/ToppleChess ... tag/v0.3.3

I'm currently working on some eval improvements but everything seems quite fragile so not much is coming out of it at the moment.