Similarity tests

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

Frank Quisinsky
Posts: 7042
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: Similarity tests

Post by Frank Quisinsky »

Hi Sedat,

yes of course.
Will study your conditions on weekend, more in detail.

Best
Frank
kranium
Posts: 2129
Joined: Thu May 29, 2008 10:43 am

Re: Similarity tests

Post by kranium »

Frank Quisinsky wrote: Sedat,

I hope of you ...
We need a bit against clone / derivative testing!
please don't leave the derivatives (Stockfish, etc.) out!
:shock: :D

...unless it doesn't pass the similarity test !?
Frank Quisinsky
Posts: 7042
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: Similarity tests

Post by Frank Quisinsky »

Hi Norman,

:-)

in case of Stockfish all is fully ok for me.
Sources are free, based on Glaurung, one of the programmers in the beginning of SF develops was Glaurung programmer Tord Romstad.

Not sure but for me not a derivative engine.
Possible that the SF used good ideas by others, but all can be see. A lot of people are working on this project. More or less a collection / a database from chess programming knowledge optimated by experts again and again. Really nice to have!

With SF I have problems if that engine will be commercial available in the future.

I am sure that programmers used good known ideas by others, but it must be documented.

A second problem I have with Stockfish is the free code. I am sure that we can see in the future the next person, useing SF sources, added own ideas for a commercial project. Will be allways the same.

Best
Frank
kranium
Posts: 2129
Joined: Thu May 29, 2008 10:43 am

Re: Similarity tests

Post by kranium »

Frank Quisinsky wrote:Hi Norman,

:-)

in case of Stockfish all is fully ok for me.
Sources are free, based on Glaurung, one of the programmers in the beginning of SF develops was Glaurung programmer Tord Romstad.

Not sure but for me not a derivative engine.
Possible that the SF used good ideas by others, but all can be see. A lot of people are working on this project. More or less a collection / a database from chess programming knowledge optimated by experts again and again. Really nice to have!

With SF I have problems if that engine will be commercial available in the future.

I am sure that programmers used good known ideas by others, but it must be documented.

A second problem I have with Stockfish is the free code. I am sure that we can see in the future the next person, useing SF sources, added own ideas for a commercial project. Will be allways the same.

Best
Frank
agreed, it's a fantastic program (but technically 'derived' from Glaurung none the less!)
just having a bit of fun with you Frank!
:D
Frank Quisinsky
Posts: 7042
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: Similarity tests

Post by Frank Quisinsky »

Hi Norman,

not only you have fun with me.
I too and different others.

:-)

The NON programmer to programming topics "Frank" have spoken!
Hope Lucas Braesch will not read my shit or Lucas start to make me troubles.

In this case, I hope of your support. Need a savior!
Lucas is very hard to non programmers if they discuss to programming topics.

In German we say:
Wenn Du keine Ahnung hast, einfach mal die Fresse halten. Nice sentence by a German comedian. I am not an expert in "Fresse halten".

Best
Frank
kranium
Posts: 2129
Joined: Thu May 29, 2008 10:43 am

Re: Similarity tests

Post by kranium »

Frank Quisinsky wrote: In German we say:
Wenn Du keine Ahnung hast, einfach mal die Fresse halten. Nice sentence by a German comedian. I am not an expert in "Fresse halten".
I won't translate that here Frank!

but Shakespeare once wrote:
“The fool doth think he is wise, but the wise man knows himself to be a fool.”
Frank Quisinsky
Posts: 7042
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: Similarity tests

Post by Frank Quisinsky »

Ok, all what you need in your life is more bad english from myself ...
you can have it.

Wenn Du keine Ahnung hast, einfach mal die Fresse halten ...
if you haven't a clue (or idea, intuition, not a hunch ... not sure), easy shut your face.

It seems a very complicted story for me!

Yes, Shakesbeare is nice, I know that.
English, not my world but more easy to understand as Shakesbeare is "Share Bear" for me. This one I like more.

Few years ago I discuss with Bob to a harmless topic!
I wrote him clown and not clone ... Bob get maid at me.
But only one of my good known mistakes in writing.

Best
Frank

You have not to discuss with me ...
You have to write your haunted new engine Norman!
Each good houre more time in invested this work will be 1 Elo more.

:-)
Adam Hair
Posts: 3226
Joined: Wed May 06, 2009 10:31 pm
Location: Fuquay-Varina, North Carolina

Re: Similarity tests

Post by Adam Hair »

Sedat Canbaz wrote:
Adam Hair wrote:
Sedat Canbaz wrote:Hello Adam,

One thing more, you helped a lot regarding sim tool, now it's my turn ;)
A little advise about how to run via sim tool, which you could not test
For example Bison, Ktulu, Chess Tiger etc..
You need to include all their files in sim test folder (during sim test process)

And I expect you can test them successfully too!

Hopes this helps too

Sedat
Have you confirmed that Ktulu, Chess Tiger, and the other engines are correctly obeying the commands sent to them by the sim tool?

During testing the mentioned engines, I could not see any problems...

Btw, have you managed to run them and I wonder what is your results?
Sorry that I missed your question, Sedat. I can run the sim test with those engines. I need a little time to be able to share my results. I am in the process of collecting results.
Sedat Canbaz
Posts: 3018
Joined: Thu Mar 09, 2006 11:58 am
Location: Antalya/Turkey

Re: Similarity tests

Post by Sedat Canbaz »

Adam Hair wrote:
Sedat Canbaz wrote:
Adam Hair wrote:
Sedat Canbaz wrote:Hello Adam,

One thing more, you helped a lot regarding sim tool, now it's my turn ;)
A little advise about how to run via sim tool, which you could not test
For example Bison, Ktulu, Chess Tiger etc..
You need to include all their files in sim test folder (during sim test process)

And I expect you can test them successfully too!

Hopes this helps too

Sedat
Have you confirmed that Ktulu, Chess Tiger, and the other engines are correctly obeying the commands sent to them by the sim tool?

During testing the mentioned engines, I could not see any problems...

Btw, have you managed to run them and I wonder what is your results?
Sorry that I missed your question, Sedat. I can run the sim test with those engines. I need a little time to be able to share my results. I am in the process of collecting results.
It's ok...don't worry dear Adam

One thing more,
I was joking regarding BabyMaster )!
I never cloned any engine and I don't plan too!

Btw, without to not mention this I can't,
You are one the main people who helped me and why I preferred to relay on sim tool results, thank you again !!


Best,
Sedat
Sedat Canbaz
Posts: 3018
Joined: Thu Mar 09, 2006 11:58 am
Location: Antalya/Turkey

Re: Similarity tests

Post by Sedat Canbaz »

Hello there!

New engines have been tested...later maybe I can test some top engines more,
But however I think it's enough for nowadays...I've got the necessary data...what about you ?)


Btw, (without my current used rule: 55% +100 Elo)
Forget SCCT Top 20, even Top 50 engines will be based mainly on Rybkanians !!))

A little note:
-All those close engines to Rybka are released after Rybka 3 release!
Just saying...

And once more time I noticed that,
55% + 100 Elo almost perfectly suits for my needs...

Note also,
Only Houdini managed to be stronger than all, more than 200 Elo over Rybka !!
And I hope to to see more Roberts Houdarts !!!


sim version 3
------ Rybka 3 (time: 100 ms scale: 1.0) ------
61.79 RobboLito 0.085g3 w32 (time: 100 ms scale: 1.0)
61.09 Tankist 3.1 32-bit (time: 100 ms scale: 1.0)
60.61 LEOpard 0.7c (time: 100 ms scale: 1.0)
60.27 Firenzina 2.3.1 xTreme x64 (time: 100 ms scale: 1.0)
60.00 IvanHoe-Beta 999946h6 x64 Tr (time: 100 ms scale: 1.0)
59.64 IPPOLIT 0.080b3 x64 (time: 100 ms scale: 1.0)
59.18 Elektro 1.0 (time: 100 ms scale: 1.0)
59.08 PanChess 00.250 x64 (time: 100 ms scale: 1.0)
58.98 Bouquet 1.8 x64 (time: 100 ms scale: 1.0)
58.95 DeepSaros Human (time: 100 ms scale: 1.0)
58.76 Fire 3.0 x64 (time: 100 ms scale: 1.0)
58.45 BlackMamba 2.0 x64 (time: 100 ms scale: 1.0)
57.66 Critter 1.6a 64-bit (time: 100 ms scale: 1.0)
57.65 Equinox 3.20 x64mp (time: 100 ms scale: 1.0)
57.00 Naum 4.6 (time: 100 ms scale: 1.0)
56.98 Murka 3 x64 UCI (time: 100 ms scale: 1.0)
56.79 Strelka 6 w32 (time: 100 ms scale: 1.0)
56.48 Houdini 4 x64 (time: 100 ms scale: 1.0)
55.49 Gull II x64 (time: 100 ms scale: 1.0)
55.39 Belka 1.8.20 (time: 100 ms scale: 1.0)
55.12 Critter 0.90 64-bit SSE4 (time: 100 ms scale: 1.0)

54.87 Rybka 1.0 Beta (time: 100 ms scale: 1.0)


sim version 3
------ Fruit 2.1 (time: 100 ms scale: 1.0) ------
60.77 Deep Onno 1-2-70 (time: 100 ms scale: 1.0)
57.02 Strelka 2.0 B (time: 50 ms scale: 1.0)
55.80 Belka 1.8.20 (time: 100 ms scale: 1.0)
55.67 Toga II 3.0 (time: 100 ms scale: 1.0)



sim version 3
------ Delfi 5.4 (time: 100 ms scale: 1.0) ------
46.67 Arasan 17.2 (time: 100 ms scale: 1.0)
46.33 Arasan 17.4 (time: 100 ms scale: 1.0)
37.80 Igorrit 0.086v8_x64 (time: 100 ms scale: 1.0)
37.75 Igorrit 0.086v8_w32 (time: 100 ms scale: 1.0)
37.33 Deep Sjeng WC2008 x64 (time: 100 ms scale: 1.0)
36.40 Booot 5.2.0(64) (time: 100 ms scale: 1.0)
33.92 Fruit 2.1 (time: 100 ms scale: 1.0)

Note: So far, Delfi 5.4 seems to be clean on my machines!


Best,
Sedat