New: SCCT Scratch Rating

[Tom Likens]

Sedat does not have the full set of results. I will post a link to the results and a description of how the test was conducted later today.

Thanks Adam.

[michiguel]

Asking the authors is the best way to start. Minkochess used to be Umko (name change) and Umko derives from Fruit/Toga according to his own author.

http://www.open-aurec.com/wbforum/viewt ... =0#p193055

Miguel

[Sedat Canbaz]

Asking the authors is the best way to start. Minkochess used to be Umko (name change) and Umko derives from Fruit/Toga according to his own author.

http://www.open-aurec.com/wbforum/viewt ... =0#p193055

Miguel

Dear Miguel,

Many thanks for the useful info, otherwise without you... i could not run my latest scratch testing!

[Adam Hair]

Here is the link to the similarity data that I ran for Sedat, plus data from a side project. All engines were given a command to search 6 plies. Unlike my survey from a couple of years ago (from which I determined that 60% moves matched under my test conditions indicated that two engines may be related), I have done nothing with the data to determine if a particular percentage indicates a large amount of similarity. But the percentages are roughly in the same range as the previous survey.

In the compressed file, you will find 3 files: sim03_depth6.kit, sim03_depth6.exe, and Key.txt. To find the results for a particular engine, use the following commands:
LINUX
./sim03_depth6.kit -r [engine number found in Key.txt]
WINDOWS
sim03_depth6.exe -r [engine number]

[Disclaimer]
The results do not necessarily mean that that one engine is a clone of another engine, nor do they mean that one engine does not include any code from another engine. They just indicate how likely two engines will choose the same moves when given the positions found in the similarity tool. From my experience, high percentages indicate a high level of relatedness, but there could be exceptions.

[Tom Likens]

In the compressed file, you will find 3 files: sim03_depth6.kit, sim03_depth6.exe, and Key.txt. To find the results for a particular engine, use the following commands:
LINUX
./sim03_depth6.kit -r [engine number found in Key.txt]
WINDOWS
sim03_depth6.exe -r [engine number]

Adam,

I must be incredibly dense tonight, or maybe it's just late, but when I run either of the above commands I get the following output:

Code: Select all

shirov: /home/tlikens/downloads/similarity_depth6> ./sim03_depth6.kit -r 23

sim version 3

What am I doing wrong?

[Adam Hair]

In the compressed file, you will find 3 files: sim03_depth6.kit, sim03_depth6.exe, and Key.txt. To find the results for a particular engine, use the following commands:
LINUX
./sim03_depth6.kit -r [engine number found in Key.txt]
WINDOWS
sim03_depth6.exe -r [engine number]

Adam,

I must be incredibly dense tonight, or maybe it's just late, but when I run either of the above commands I get the following output:

Code: Select all

shirov: /home/tlikens/downloads/similarity_depth6> ./sim03_depth6.kit -r 23

sim version 3

What am I doing wrong?

You are not the dense one, Tom. I forgot to include the similarity.data file. That contains the moves made by each engine.

Here is the new link:
http://www.mediafire.com/download/92eao ... _depth6.7z

You should see the following when using the command
./sim03_depth6.kit -r 23:

Code: Select all

sim version 3
------ Djinn 1.008 (time: 100 ms  scale: 1.0) ------
 47.60  Fruit 2.1 (time: 100 ms  scale: 1.0)
 47.49  Toga II 1.0 (time: 100 ms  scale: 1.0)
 47.18  Psuedo 0.7c (time: 100 ms  scale: 1.0)
 47.04  SmarThink 1.20 (time: 100 ms  scale: 1.0)
 46.99  Toga II 1.1a (time: 100 ms  scale: 1.0)
 46.82  Fruit 2.2.1 (time: 100 ms  scale: 1.0)
 46.67  Loop 2007 32-Bit (time: 100 ms  scale: 1.0)
 46.65  Strelka 2.0 B (time: 100 ms  scale: 1.0)
 46.39  Murka 3 (time: 100 ms  scale: 1.0)
 46.21  Nebula 2.0 (time: 100 ms  scale: 1.0)
 46.15  Godel 2.3.7 (time: 100 ms  scale: 1.0)
 46.04  Strelka 1.8 (time: 100 ms  scale: 1.0)
 46.04  Hamsters 0.7.1 (time: 100 ms  scale: 1.0)
 45.85  Rybka 1.0 Beta (time: 100 ms  scale: 1.0)
 45.82  Movei 00.8.438 (time: 100 ms  scale: 1.0)
 45.78  Spike 1.4 (time: 100 ms  scale: 1.0)
 45.71  The Baron 2.23 (time: 100 ms  scale: 1.0)
 45.71  Naum 4.2 (time: 100 ms  scale: 1.0)
 45.65  Doch 09.980 (time: 100 ms  scale: 1.0)
 45.58  GreKo 10.3 x64 (time: 100 ms  scale: 1.0)
 44.97  Nemo 1.0.1 Beta (time: 100 ms  scale: 1.0)
 44.89  RedQueen 1.1.4 (time: 100 ms  scale: 1.0)
 44.87  Deuterium 13.1.31.113 (time: 100 ms  scale: 1.0)
 44.80  Twisted Logic 20090922 (time: 100 ms  scale: 1.0)
 44.78  DiscoCheck 4.3 (time: 100 ms  scale: 1.0)
 44.78  Cyrano 0.6b17 (time: 100 ms  scale: 1.0)
 44.73  RobboLite 0.085d3 (time: 100 ms  scale: 1.0)
 44.73  Crafty 23.6 (time: 100 ms  scale: 1.0)
 44.66  AnMon 5.75 (time: 100 ms  scale: 1.0)
 44.60  Yace 0.99.87 (time: 100 ms  scale: 1.0)
 44.57  Crafty 23.8 (time: 100 ms  scale: 1.0)
 44.55  Bobcat 3.25 (time: 100 ms  scale: 1.0)
 44.49  Shredder 11 (time: 100 ms  scale: 1.0)
 44.48  Alfil 13.1 (time: 100 ms  scale: 1.0)
 44.44  Spark 1.0 (time: 100 ms  scale: 1.0)
 44.42  Houdini 1.00 (time: 100 ms  scale: 1.0)
 44.38  Arasan 16.1 (time: 100 ms  scale: 1.0)
 44.16  Glass 2.0 (time: 100 ms  scale: 1.0)
 44.08  Strelka 5.7 MP (time: 100 ms  scale: 1.0)
 44.02  Arminius 2013-08-10 (time: 100 ms  scale: 1.0)
 43.93  Glaurung 2.2 (time: 100 ms  scale: 1.0)
 43.92  Gaviota 0.86 (time: 100 ms  scale: 1.0)
 43.88  IvanHoe 9.46b x64 (time: 100 ms  scale: 1.0)
 43.87  Gaviota 0.87-a8 (time: 100 ms  scale: 1.0)
 43.86  Frenzee 3.5.19 64-bit uci.exe (time: 100 ms  scale: 1.0)
 43.85  Daydreamer 1.75 (time: 100 ms  scale: 1.0)
 43.82  Stockfish 4 64 (time: 100 ms  scale: 1.0)
 43.78  Ruffian 2.1.0 (time: 100 ms  scale: 1.0)
 43.77  DiscoCheck 5.2 (time: 100 ms  scale: 1.0)
 43.75  Atlas  3.50 (time: 100 ms  scale: 1.0)
 43.74  Gandalf 6.0 (time: 100 ms  scale: 1.0)
 43.71  Critter 1.6a 64-bit (time: 100 ms  scale: 1.0)
 43.61  Houdini 3 (time: 100 ms  scale: 1.0)
 43.59  Cheng3 1.07 (time: 100 ms  scale: 1.0)
 43.52  Bouquet _1.6 x64 (time: 100 ms  scale: 1.0)
 43.48  Equinox 2.02 x64mp (time: 100 ms  scale: 1.0)
 43.42  DeepSaros version 4.1.6 (time: 100 ms  scale: 1.0)
 43.28  MinkoChess 1.3 (time: 100 ms  scale: 1.0)
 43.08  Arasan 16.3 (time: 100 ms  scale: 1.0)
 43.04  cheng4 0.36a (time: 100 ms  scale: 1.0)
 43.04  Rybka 4.1_64-bit (time: 100 ms  scale: 1.0)
 43.04  Octochess 5190 (time: 100 ms  scale: 1.0)
 42.94  Stockfish 070114 64 (time: 100 ms  scale: 1.0)
 42.89  Houdini 4 Pro x64 (time: 100 ms  scale: 1.0)
 42.81  Quazar 0.4 (time: 100 ms  scale: 1.0)
 42.78  Pawny 1.0 (time: 100 ms  scale: 1.0)
 42.60  Fire 3.0 x64 (time: 100 ms  scale: 1.0)
 42.50  Hannibal 1.3 (time: 100 ms  scale: 1.0)
 42.35  Jazz 799 (time: 100 ms  scale: 1.0)
 42.32  iCE 1.0 (time: 100 ms  scale: 1.0)
 42.22  Lime v66 (time: 100 ms  scale: 1.0)
 42.02  Komodo CCT (time: 100 ms  scale: 1.0)
 41.59  SlowChess 2.96 (time: 100 ms  scale: 1.0)
 41.59  Maverick 0.5 (No Popcount) (time: 100 ms  scale: 1.0)
 41.59  GNU Chess 5.50 (time: 100 ms  scale: 1.0)
 41.51  Vice 1.0 (time: 100 ms  scale: 1.0)
 41.37  Tornado 4.88 (time: 100 ms  scale: 1.0)
 41.20  Gull 2.2 (time: 100 ms  scale: 1.0)
 41.08  Komodo 5.1 (time: 100 ms  scale: 1.0)
 41.05  Diablo 0.5.1 (Intel 9.1 build - JA) (time: 100 ms  scale: 1.0)
 40.99  Gull 2.3 x64 (time: 100 ms  scale: 1.0)
 40.84  Komodo TCEC 64-bit  (time: 100 ms  scale: 1.0)
 40.53  EXchess 7.11b (time: 100 ms  scale: 1.0)
 40.30  Deep Smash x64 (time: 100 ms  scale: 1.0)
 38.07  Scorpio 2.1 (time: 100 ms  scale: 1.0)
 37.23  Texel 1.02 (time: 100 ms  scale: 1.0)
 36.08  Deep Sjeng WC2008 (time: 100 ms  scale: 1.0)
 35.64  Loop 2007 (time: 100 ms  scale: 1.0)
 33.21  FireFly v2.6.0 (x64) (time: 100 ms  scale: 1.0)

[Tom Likens]

Thanks again Adam, it's working now.

[Sedat Canbaz]

Pro Deo 1.87 and Jazz 801 x64 are participated too:
http://www.sedatcanbaz.com/chess/?page_id=634

Note: Delfi 5.4 is stopped of testing, due to Delfi's Elo strength and similarity percentage is near to Fruit 2.1


Btw, for chess friends who missed to read my previous posting, I decided to mention again...

SCCT Scratch Rating's New Rule:
1) X Chess Engine, which is with more than 55 % of similarity will be removed from the current scratch testing
2) X Derivative engine will be allowed of testing, but only in case if the derivative engine is:
- at least 500 Elo points stronger than the free open source engine (for example, derived on TSCP, Fruit, Crafty vs...)
3) Private engines will be not allowed for the current scratch testing

So... I hope with the current new rule to solve all injustices over X Engine Programmer




Best Regards,
Sedat

[Jim Logan]

Adam - I seem to be doing something wrong. Windows 7 64 bit. I use the Run command and enter as you say. A DOS box opens and the program runs, but the box then immediately closes leaving me with only desktop. What am I doing wrong?

[ZirconiumX]

Adam - I seem to be doing something wrong. Windows 7 64 bit. I use the Run command and enter as you say. A DOS box opens and the program runs, but the box then immediately closes leaving me with only desktop. What am I doing wrong?

Don't use run, use command prompt.

Matthew:out