OKE - one year after

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

User avatar
Rebel
Posts: 6991
Joined: Thu Aug 18, 2011 12:04 pm

Re: OKE - one year after

Post by Rebel »

xr_a_y wrote: Fri Sep 11, 2020 11:31 am What is "Rubichess NNUE_Minic".
Is that Rubi with the same SV net as Minic ?
Yes.
Please, can you give credits to nets authors by using a naming convention like ?

ENGINE_NNUE_NETVERSION

For instance

Minic_NNUE_SV2257
Will keep that in mind for serious publications, this is just a first smell on the side effects of a new development.
90% of coding is debugging, the other 10% is writing bugs.
User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: OKE - one year after

Post by Laskos »

Rebel wrote: Fri Sep 11, 2020 5:45 pm
Laskos wrote: Fri Sep 11, 2020 11:50 am
Rebel wrote: Thu Sep 10, 2020 11:41 pm NNUE sim results

http://rebel13.nl/html/mysim.html [100 ms]
http://rebel13.nl/html/mysim-1000ms.html
http://rebel13.nl/html/mysim-2500ms.html

Note that engines like Lc0 and SF12 at 1 second per move already perform at ~3200 elo and so it's not a big suprise they are finding more and more similar moves with increasing time controls. The result is better than I expected.
Great!

My opinion about the convergence on Sim I observed too between SF12 and Lc0 at longer and longer TC is that in mostly quiet positions like Sim ones, Lc0 is incredibly strong and SF12 approaches it with longer and longer TC. One can check that by doing the Sim of Lc0 at 100ms vs Lc0 2500ms (above 70%) and SF12 at 100ms vs 2500ms (below 60%).
Still not sure about the meaning of the convergence. Do they converge to play "perfect" positional chess at longer TC? Maybe they have the same move ordering, that's why they converge? And even the perfect chess often probably has multiple perfect moves in quiet positions, so there is not necessarily a convergence even if they play perfect moves.
I think it's the same relationship with the increase of draws with increased time control.
There are some differences. Perfect chess is most probably a draw, so draw rate naturally increases towards 100%. Perfect move in a position is not necessarily unique. In fact knowing the rating of the random player and the rating of the perfect player, one can roughly estimate that there are on average 1.3 - 1.4 perfect moves for each position, so the Sim test of two different perfect players won't show 100%, but 70-80-90%
Milos
Posts: 4190
Joined: Wed Nov 25, 2009 1:47 am

Re: OKE - one year after

Post by Milos »

Laskos wrote: Fri Sep 11, 2020 7:11 pm
Rebel wrote: Fri Sep 11, 2020 5:45 pm
Laskos wrote: Fri Sep 11, 2020 11:50 am
Rebel wrote: Thu Sep 10, 2020 11:41 pm NNUE sim results

http://rebel13.nl/html/mysim.html [100 ms]
http://rebel13.nl/html/mysim-1000ms.html
http://rebel13.nl/html/mysim-2500ms.html

Note that engines like Lc0 and SF12 at 1 second per move already perform at ~3200 elo and so it's not a big suprise they are finding more and more similar moves with increasing time controls. The result is better than I expected.
Great!

My opinion about the convergence on Sim I observed too between SF12 and Lc0 at longer and longer TC is that in mostly quiet positions like Sim ones, Lc0 is incredibly strong and SF12 approaches it with longer and longer TC. One can check that by doing the Sim of Lc0 at 100ms vs Lc0 2500ms (above 70%) and SF12 at 100ms vs 2500ms (below 60%).
Still not sure about the meaning of the convergence. Do they converge to play "perfect" positional chess at longer TC? Maybe they have the same move ordering, that's why they converge? And even the perfect chess often probably has multiple perfect moves in quiet positions, so there is not necessarily a convergence even if they play perfect moves.
I think it's the same relationship with the increase of draws with increased time control.
There are some differences. Perfect chess is most probably a draw, so draw rate naturally increases towards 100%. Perfect move in a position is not necessarily unique. In fact knowing the rating of the random player and the rating of the perfect player, one can roughly estimate that there are on average 1.3 - 1.4 perfect moves for each position, so the Sim test of two different perfect players won't show 100%, but 70-80-90%
Ofc perfect move is not unique. There are 3 possible outcomes for each move, and most possible moves in a given position don't change previous outcome. However, on average there is still probably not more than 2 optimal (calling them perfect is kind of too pretentious). Problem is that in couple of decisive moments (and sometimes could be even more than 10 such occasions) in a typical game there is only one optimal move. However, a similarity tool can only measure average values and not values in those critical points of the game.
User avatar
Rebel
Posts: 6991
Joined: Thu Aug 18, 2011 12:04 pm

Re: OKE - one year after

Post by Rebel »

RubiChess wrote: Thu Sep 10, 2020 9:02 am Can you also test "regular" Rubi-1.8? Would be interesting to see how good (bad) it is compared to the other non-NNUE engines.

Regards, Andreas
At your service.

http://rebel13.nl/html/2-moves.html
http://rebel13.nl/html/3-moves.html
http://rebel13.nl/html/4-moves.html
http://rebel13.nl/html/5-moves.html
http://rebel13.nl/html/6-moves.html
90% of coding is debugging, the other 10% is writing bugs.
User avatar
Rebel
Posts: 6991
Joined: Thu Aug 18, 2011 12:04 pm

Re: OKE - one year after

Post by Rebel »

Terje wrote: Wed Sep 09, 2020 8:15 pm
Dann Corbit wrote: Wed Sep 09, 2020 7:15 pm You would have to turn off the book or the test would be meaningless.

The same could be said for programs that communicate with Bojun Guo's chess database.
It would be fun to see the result of that though - Weiss can do it with NoobBook = true if you want to try @Rebel (expect about 0.7 seconds per move or so, though).

Also slightly off-topic, but it would be cool to see an update to SRL - many engines have had a new version since the last update :)
I considered the SRL a closed project, but the NNUE developments awakened my curiosity again, will add NNUE engines only.
90% of coding is debugging, the other 10% is writing bugs.
User avatar
Rebel
Posts: 6991
Joined: Thu Aug 18, 2011 12:04 pm

Re: OKE - one year after

Post by Rebel »

http://rebel13.nl/html/srl-1000ms.html

Added SF12, Rubichess, Minic, Igel.

Rubichess was using the Minic network and is above SF11.

Fun....

Website update will follow later.
90% of coding is debugging, the other 10% is writing bugs.
Terje
Posts: 347
Joined: Tue Nov 19, 2019 4:34 am
Location: https://github.com/TerjeKir/weiss
Full name: Terje Kirstihagen

Re: OKE - one year after

Post by Terje »

Rebel wrote: Sat Sep 12, 2020 7:16 am I considered the SRL a closed project, but the NNUE developments awakened my curiosity again, will add NNUE engines only.
Oh, that's a bummer, it was a cool list :(

Crazy jumps for the NNUEs!
Madeleine Birchfield
Posts: 512
Joined: Tue Sep 29, 2020 4:29 pm
Location: Dublin, Ireland
Full name: Madeleine Birchfield

Re: OKE - one year after

Post by Madeleine Birchfield »

How well do the new engines Seer and Komodo Dragon, as well as the updated Halogen 8, Nemorino 6, Ethereal 12.75, Igel 2.8, and Minic 3 perform when given low ply openings?