Murka 3.0 released

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

User avatar
Ajedrecista
Posts: 1968
Joined: Wed Jul 13, 2011 9:04 pm
Location: Madrid, Spain.

Re: Murka 3.0 - similary test.

Post by Ajedrecista »

Hello Gabor:
SzG wrote:
mike angel wrote:it seems to be a derivate

look here: http://computer-chess.org/forum/index.p ... ad&id=2507
Is that enough to raise such a suspicion?
There is also a similarity test on Murka 2:

http://computer-chess.org/forum/index.p ... ad&id=2506

IIRC, there are three regions:

Code: Select all

Similarity > 60%:         guilty/clone/derivative region.
55% =< similarity =< 60%&#58; dubious region.
Similarity < 55%&#58;         safe region.
These bounds are a bit random, but are based in the titanic effort of Adam Hair:

A Pairwise Comparison of Chess Engine Move Selections

Long time ago, I expanded a little a chart provided by Adam (some numbers differ a little). According to my post, and taking the data of 58.61% of similarity with Rybka 2.3.2a (the highest rate of similarity in Murka 3):

Code: Select all

z_&#40;58.61&#41; = &#40;58.61 - 45.16&#41;/2.86 ~ 4.7028; 2/&#123;1 - erf&#91;z_&#40;58.61&#41;/sqrt&#40;2&#41;&#93;&#125; ~ 779,358.5966 ~ 779,359
It is up to you interpreting those numbers. The fact is that the Elo gain from Murka 2 to Murka 3 are some hundreds of Elo (still untested) in a lapse of 19 months more less (approximated date releases of Murka 2 and Murka 3). (Elo gain)/week ~ [Elo(Murka 3) - Elo(Murka 2)]/83, possibly greater than 5, which is a high number in those stages of development (Murka 2 was not a random generator move...). Anyway, I am not totally sure about its status.

Regards from Spain.

Ajedrecista.
zullil
Posts: 6442
Joined: Tue Jan 09, 2007 12:31 am
Location: PA USA
Full name: Louis Zulli

Re: Murka 3.0 - similary test

Post by zullil »

mike angel wrote:it seems to be a derivate

look here: http://computer-chess.org/forum/index.p ... ad&id=2507
The source code is openly available. Has anyone studied it?
jdart
Posts: 4366
Joined: Fri Mar 10, 2006 5:23 am
Location: http://www.arasanchess.org

Re: Murka 3.0 - similary test

Post by jdart »

I have looked at it a little bit.

Not obviously a clone IMO although a few search parameters are the same as Stockfish. The search is not that similar to Stockfish nor is it similar to the Ippolit series. The eval looks original to me but I have not studied it much.

Really, IMO it does make sense to run a similarity tester on a program for which source is available. Looking at the source is a much more reliable guide to what it is similar to.

--Jon
zullil
Posts: 6442
Joined: Tue Jan 09, 2007 12:31 am
Location: PA USA
Full name: Louis Zulli

Re: Murka 3.0 - similary test

Post by zullil »

jdart wrote:
Really, IMO it does make sense to run a similarity tester on a program for which source is available. Looking at the source is a much more reliable guide to what it is similar to.

--Jon
Did you mean "does not"?
jdart
Posts: 4366
Joined: Fri Mar 10, 2006 5:23 am
Location: http://www.arasanchess.org

Re: Murka 3.0 - similary test

Post by jdart »

zullil wrote:
Did you mean "does not"?
Yes.
Adam Hair
Posts: 3226
Joined: Wed May 06, 2009 10:31 pm
Location: Fuquay-Varina, North Carolina

Re: Murka 3.0 - similary test

Post by Adam Hair »

jdart wrote:I have looked at it a little bit.

Not obviously a clone IMO although a few search parameters are the same as Stockfish. The search is not that similar to Stockfish nor is it similar to the Ippolit series. The eval looks original to me but I have not studied it much.

Really, IMO it does make sense to run a similarity tester on a program for which source is available. Looking at the source is a much more reliable guide to what it is similar to.

--Jon
Looking at the source code should be more reliable than using the similarity test. Though the similarity test seemingly has not produced any false positives, that does not mean it could not occur. Matching source code to source code does not have that flaw. Anybody who is familiar with the code of the major open source engines could do a more definitive job of determining if a particular open source engine is a derivative or not.

Having said that, the similarity test would identify the engine to compare the code to. In this case, if someone is truly worried that Murka 3 is a derivative then they should compare it to Strelka's code.
Tennison
Posts: 183
Joined: Sat Nov 26, 2011 2:02 pm

Re: Murka 3.0 - similary test

Post by Tennison »

When I take a look at the Murka 3.0's code, I have a strange feeling : a sense of already seen.

Some parts of the code, some namings, ... make me thinking about Fruit / Toga family.

But nothing as a clone, just as "in the family".
User avatar
michiguel
Posts: 6401
Joined: Thu Mar 09, 2006 8:30 pm
Location: Chicago, Illinois, USA

Re: Murka 3.0 - similary test

Post by michiguel »

Adam Hair wrote:
jdart wrote:I have looked at it a little bit.

Not obviously a clone IMO although a few search parameters are the same as Stockfish. The search is not that similar to Stockfish nor is it similar to the Ippolit series. The eval looks original to me but I have not studied it much.

Really, IMO it does make sense to run a similarity tester on a program for which source is available. Looking at the source is a much more reliable guide to what it is similar to.

--Jon
Looking at the source code should be more reliable than using the similarity test. Though the similarity test seemingly has not produced any false positives, that does not mean it could not occur. Matching source code to source code does not have that flaw. Anybody who is familiar with the code of the major open source engines could do a more definitive job of determining if a particular open source engine is a derivative or not.

Having said that, the similarity test would identify the engine to compare the code to. In this case, if someone is truly worried that Murka 3 is a derivative then they should compare it to Strelka's code.
Nobody mentioned that Belka is close and from the same author.

It is extremely tedious to cross check a program with all the available open source programs. Not to mention that nowadays people peek at closed ones, so this task become nearly impossible. So, having the ability to narrow the field to compare one program with one or a couple speeds up the process tremendously.

Miguel
User avatar
Steve Maughan
Posts: 1221
Joined: Wed Mar 08, 2006 8:28 pm
Location: Florida, USA

Re: Murka 3.0 - similary test.

Post by Steve Maughan »

Maybe this is a topic for another thread but...

Doesn't this type of similarity test only detect similarities in the evaluation and not the search?

And as engines get better wouldn't the similarity of moves also increase. For example if two engines could play the Philidor endgame they are more likely to play the same moves in the appropriate positions, even though they might not share anything in common.

Or am I missing something?

Steve
User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: Murka 3.0 - similary test.

Post by Laskos »

Steve Maughan wrote:Maybe this is a topic for another thread but...

Doesn't this type of similarity test only detect similarities in the evaluation and not the search?
Mostly in the evaluation, but not exclusively.

And as engines get better wouldn't the similarity of moves also increase. For example if two engines could play the Philidor endgame they are more likely to play the same moves in the appropriate positions, even though they might not share anything in common.

Or am I missing something?
Positions are chosen such as to not have a single best move. No, as engines get stronger, they will not converge to have accidentally higher similarity.
Steve