Scorpio 2.8

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Daniel Shawul
Posts: 4185
Joined: Tue Mar 14, 2006 11:34 am
Location: Ethiopia

Re: Scorpio 2.8

Post by Daniel Shawul »

First of all, thanks very much for the tests. I also see some inconsistencies in performance probably due to some bugs. A bug i have yet to fix is the multicore version that hangs sometimes.

About its strength, It should be more or less same strength as scorpio 2.8 if you set treeht=0. See for example the test i gave here.

Code: Select all

Finished game 37 (scorpio vs scorpio-mcts): 1-0 {Black resigns} 
Score of scorpio vs scorpio-mcts: 12 - 10 - 15  [0.527] 37 
However, this is meaningless because mcts is used only at the root and its children. With other values of treeht=128 or so, you have to use a longer time control so that the standard alpha-beta search at the leaves is triggered enough. After I released scorpioMCTS, I have fixed this in a much better way. The idea is to spend the first 30% of the time growing the tree, and then freeze it, so that standard alpha-beta search is spawned at the leaves for the rest of the time. This should give comparable strengths at all time controls. Eventhough alpha-beta search is used 70% of the time, it should quickly compensate for the slow MCTS search in the first 30%. Since I am pretty sure of this approach gives comparable strenght's as standard verion (there could be a bug though), I am mostly focused on improving the MCTS part. With treeht=infinity, I think it is currently around 2300 elo, but other settings should quickly approach scorpio 2.8's level (~2700).

I would very much appreciate it if you can test these settings a. If so, let me know if you need the latest exes i have with negascout and the one that spends only 30% in growing the tree.

Daniel
tpoppins
Posts: 919
Joined: Tue Nov 24, 2015 9:11 pm
Location: upstate

Re: Scorpio 2.8

Post by tpoppins »

Daniel Shawul wrote:A bug i have yet to fix is the multicore version that hangs sometimes.
I can confirm this bug. In the mini-gauntlet posted above at least four games had to be replayed and replaced because Scorpio's "connection stalled" (in Cute Chess' terminology).
Daniel Shawul wrote:About its strength, It should be more or less same strength as scorpio 2.8 if you set treeht=0. See for example the test i gave here.

Code: Select all

Finished game 37 (scorpio vs scorpio-mcts): 1-0 {Black resigns} 
Score of scorpio vs scorpio-mcts: 12 - 10 - 15  [0.527] 37 
However, this is meaningless because mcts is used only at the root and its children.
Yes, I read that part. You also stated earlier that you would like to see treeht values > 0 tested, hence my tests.
Daniel Shawul wrote:With other values of treeht=128 or so, you have to use a longer time control so that the standard alpha-beta search at the leaves is triggered enough.
That's what I figured as well. At this stage MCTS would probably be too slow for blitz tests. Would you consider a 40/40 repeating time control long enough for our purposes? That would actually be something like 40/20 or 40/22 (adapted for CCRL), anything longer would not be eligible for CCRL; although I wouldn't mind doing a private test or two since the MCTS concept looks very interesting.

Daniel Shawul wrote:I would very much appreciate it if you can test these settings a. If so, let me know if you need the latest exes i have with negascout and the one that spends only 30% in growing the tree.
In the tests mentioned above I used the updated Scorpio 2.8 dated Feb 12, CRC32=4486111A. If you prefer I use other/newer execs please PM me the links (if you don't want to release them publicly). Also please post the exact settings I should use in my tests, it's not clear from your previous post what they should be.

I'd be glad if I could help to improve Scorpio's MCTS, as no other engine that I'm aware of is doing something like that.

Got a question about Scorpio 5-men EGBBs in the meantime. I experience unusually long load times in Cute Chess GUI when I have egbb_load_type set to 3 - a little over two minutes when reading off an SSD, and -- the worst scenario -- around five minutes when playing two Scorpio versions vs. each other and reading off a HDD (the E5-2690v2 has no SSD yet, but the HDD is a fast 10K one). Is it a problem with Cute Chess or do I have something misconfigured? For the tests mentioned above I had to change egbb_load_type to 1; the EGBB load times went down to 3 seconds, but I'd rather have Scorpio use 5-men EGBBs, of course. I don't think that egbb_cache_size set to 32 is the problem, all of my test boxes have at least 32 GB of RAM and even with 4CPU gauntlets running memory usage rarely exceeds 40% on any of them, according to the Task Manager (Win 7 x64 Pro on all three, BTW).
Daniel Shawul
Posts: 4185
Joined: Tue Mar 14, 2006 11:34 am
Location: Ethiopia

Scorpio 2.8.1 MCTS only

Post by Daniel Shawul »

tpoppins wrote:
Daniel Shawul wrote:A bug i have yet to fix is the multicore version that hangs sometimes.
I can confirm this bug. In the mini-gauntlet posted above at least four games had to be replayed and replaced because Scorpio's "connection stalled" (in Cute Chess' terminology).
Daniel Shawul wrote:About its strength, It should be more or less same strength as scorpio 2.8 if you set treeht=0. See for example the test i gave here.

Code: Select all

Finished game 37 (scorpio vs scorpio-mcts): 1-0 {Black resigns} 
Score of scorpio vs scorpio-mcts: 12 - 10 - 15  [0.527] 37 
However, this is meaningless because mcts is used only at the root and its children.
Yes, I read that part. You also stated earlier that you would like to see treeht values > 0 tested, hence my tests.
Daniel Shawul wrote:With other values of treeht=128 or so, you have to use a longer time control so that the standard alpha-beta search at the leaves is triggered enough.
That's what I figured as well. At this stage MCTS would probably be too slow for blitz tests. Would you consider a 40/40 repeating time control long enough for our purposes? That would actually be something like 40/20 or 40/22 (adapted for CCRL), anything longer would not be eligible for CCRL; although I wouldn't mind doing a private test or two since the MCTS concept looks very interesting.

Daniel Shawul wrote:I would very much appreciate it if you can test these settings a. If so, let me know if you need the latest exes i have with negascout and the one that spends only 30% in growing the tree.
In the tests mentioned above I used the updated Scorpio 2.8 dated Feb 12, CRC32=4486111A. If you prefer I use other/newer execs please PM me the links (if you don't want to release them publicly). Also please post the exact settings I should use in my tests, it's not clear from your previous post what they should be.

I'd be glad if I could help to improve Scorpio's MCTS, as no other engine that I'm aware of is doing something like that.

Got a question about Scorpio 5-men EGBBs in the meantime. I experience unusually long load times in Cute Chess GUI when I have egbb_load_type set to 3 - a little over two minutes when reading off an SSD, and -- the worst scenario -- around five minutes when playing two Scorpio versions vs. each other and reading off a HDD (the E5-2690v2 has no SSD yet, but the HDD is a fast 10K one). Is it a problem with Cute Chess or do I have something misconfigured? For the tests mentioned above I had to change egbb_load_type to 1; the EGBB load times went down to 3 seconds, but I'd rather have Scorpio use 5-men EGBBs, of course. I don't think that egbb_cache_size set to 32 is the problem, all of my test boxes have at least 32 GB of RAM and even with 4CPU gauntlets running memory usage rarely exceeds 40% on any of them, according to the Task Manager (Win 7 x64 Pro on all three, BTW).
Hi,
Sorry it took me some time to fix bugs that were causing blunders at the root. The think is in analysis mode everything seems Ok, but then it could randomly select a root move and throw away a piece. There were several causes for this but hoepfully i fixed all of them.

The bug fixed version can be dowloaded here.

This is version 2.8.1 MCTS only, no change in standard version.

To test the pure MCTS version, set in the ini file

Code: Select all

montecarlo 1
frac_freeze_tree 100
To test the strongest MCTS setting, set

Code: Select all

frac_freeze_tree 0
It seems frac_freeze_tree = 5 or 10 are just about 70 elo weaker but above that it seems to loose a sizeable elo.

I have set "treeht" to a high value of 12 GB, so the most important parameter now is frac_freeze_tree. It will just grow the tree for the first x % of the time, and stops doing that so the memory limit should not be a concern.

Let me know if you encounter issues.

===============
Other issues.

a) I think the parallel version should be working now too. I did some tests on HGM's server and seems to be not hanging anymore.

b) frac_freeze_tree prameter should make all time controlled tests equally feasible unlike before where treeht=128 would have required a long time control. However, going above 30% seems it would still require longer time controls.

c) About the 5 men bitbases, I recall the older versions of egbbdll used to load them very slow (like a minute or two), but the latests ones should load them fast in a second or so. Try to download the 5 men bitbases from Joshua Shriver's egtb server and let me know if they still load slow

Thanks for your help

Daniel
tpoppins
Posts: 919
Joined: Tue Nov 24, 2015 9:11 pm
Location: upstate

Re: Scorpio 2.8.1 MCTS only

Post by tpoppins »

Six gauntlets vs. the same lineup of 20 engines under CCRL testing conditions -- 256 MB hash, repeating TC, 5-men EGTBs and Scorpio EGBBs. Four gauntlets at effectively 40/2 and two at 40/20. 800 games in each gauntlet, except for the 40/40 fft0 one which is 600 games.

Dual E5-2690v2 @3GHz 32 GB RAM
Cute Chess GUI 20180203 dev build
FEOBOS v20.1 contempt 3 book, custom edit (most long lines trimmed to 10 moves, duplicates removed, three longest ECO codes missing)
fft - frac_freeze_tree


40/4 fft0

Code: Select all

Scorpio 2.8.1 64-bit MCTS   - Amoeba 2.7 64-bit                17.5 - 22.5    +10/=15/-15    43.75%
Scorpio 2.8.1 64-bit MCTS   - Atlas 3.91 64-bit                23.0 - 17.0    +16/=14/-10    57.50%
Scorpio 2.8.1 64-bit MCTS   - BugChess2 1.9 64-bit             31.0 - 9.0     +27/=8/-5      77.50%
Scorpio 2.8.1 64-bit MCTS   - Crafty 25.2 64-bit               18.5 - 21.5    +10/=17/-13    46.25%
Scorpio 2.8.1 64-bit MCTS   - Demolito 2017-08-26 64-bit       19.5 - 20.5    +13/=13/-14    48.75%
Scorpio 2.8.1 64-bit MCTS   - Deuterium 14.3.34.130 64-bit     18.5 - 21.5    +13/=11/-16    46.25%
Scorpio 2.8.1 64-bit MCTS   - DisasterArea 1.65 64-bit         20.5 - 19.5    +13/=15/-12    51.25%
Scorpio 2.8.1 64-bit MCTS   - Ethereal 9.00 64-bit             16.5 - 23.5     +8/=17/-15    41.25%
Scorpio 2.8.1 64-bit MCTS   - EXchess 7.97b 64-bit             17.5 - 22.5     +9/=17/-14    43.75%
Scorpio 2.8.1 64-bit MCTS   - Fruit Reloaded 3.2.1 64-bit      30.5 - 9.5     +24/=13/-3     76.25%
Scorpio 2.8.1 64-bit MCTS   - Gaviota 1.0 64-bit               20.5 - 19.5    +14/=13/-13    51.25%
Scorpio 2.8.1 64-bit MCTS   - Hakkapeliitta 3.0 64-bit         15.5 - 24.5    +10/=11/-19    38.75%
Scorpio 2.8.1 64-bit MCTS   - Murka 3 64-bit                   19.5 - 20.5    +12/=15/-13    48.75%
Scorpio 2.8.1 64-bit MCTS   - Nemo 1.0.1 64-bit                20.0 - 20.0    +10/=20/-10    50.00%
Scorpio 2.8.1 64-bit MCTS   - Quazar 0.4 64-bit                22.5 - 17.5    +14/=17/-9     56.25%
Scorpio 2.8.1 64-bit MCTS   - Rodent III 0.232 64-bit          15.5 - 24.5     +9/=13/-18    38.75%
Scorpio 2.8.1 64-bit MCTS   - Scorpio 2.7.9 64-bit             20.5 - 19.5    +11/=19/-10    51.25%
Scorpio 2.8.1 64-bit MCTS   - Scorpio 2.8 64-bit               16.0 - 24.0     +6/=20/-14    40.00%
Scorpio 2.8.1 64-bit MCTS   - SCTR 1.1f 64-bit                 10.5 - 29.5     +6/=9/-25     26.25%
Scorpio 2.8.1 64-bit MCTS   - Tornado 8.0 64-bit               22.0 - 18.0    +15/=14/-11    55.00%
40/4 fft10

Code: Select all

Scorpio 2.8.1 64-bit MCTS   - Amoeba 2.7 64-bit                 7.0 - 33.0     +4/=6/-30     17.50%
Scorpio 2.8.1 64-bit MCTS   - Atlas 3.91 64-bit                 7.0 - 33.0     +2/=10/-28    17.50%
Scorpio 2.8.1 64-bit MCTS   - BugChess2 1.9 64-bit             19.0 - 21.0    +14/=10/-16    47.50%
Scorpio 2.8.1 64-bit MCTS   - Crafty 25.2 64-bit                8.0 - 32.0     +3/=10/-27    20.00%
Scorpio 2.8.1 64-bit MCTS   - Demolito 2017-08-26 64-bit       10.0 - 30.0     +5/=10/-25    25.00%
Scorpio 2.8.1 64-bit MCTS   - Deuterium 14.3.34.130 64-bit     13.5 - 26.5     +8/=11/-21    33.75%
Scorpio 2.8.1 64-bit MCTS   - DisasterArea 1.65 64-bit          7.5 - 32.5     +3/=9/-28     18.75%
Scorpio 2.8.1 64-bit MCTS   - Ethereal 9.00 64-bit              5.0 - 35.0     +1/=8/-31     12.50%
Scorpio 2.8.1 64-bit MCTS   - EXchess 7.97b 64-bit             11.0 - 29.0     +6/=10/-24    27.50%
Scorpio 2.8.1 64-bit MCTS   - Fruit Reloaded 3.2.1 64-bit      11.0 - 29.0     +6/=10/-24    27.50%
Scorpio 2.8.1 64-bit MCTS   - Gaviota 1.0 64-bit               13.5 - 26.5     +9/=9/-22     33.75%
Scorpio 2.8.1 64-bit MCTS   - Hakkapeliitta 3.0 64-bit          6.5 - 33.5     +3/=7/-30     16.25%
Scorpio 2.8.1 64-bit MCTS   - Murka 3 64-bit                    9.5 - 30.5     +4/=11/-25    23.75%
Scorpio 2.8.1 64-bit MCTS   - Nemo 1.0.1 64-bit                 6.5 - 33.5     +2/=9/-29     16.25%
Scorpio 2.8.1 64-bit MCTS   - Quazar 0.4 64-bit                 8.5 - 31.5     +4/=9/-27     21.25%
Scorpio 2.8.1 64-bit MCTS   - Rodent III 0.238 64-bit           7.0 - 33.0     +3/=8/-29     17.50%
Scorpio 2.8.1 64-bit MCTS   - Scorpio 2.7.9 64-bit              8.5 - 31.5     +3/=11/-26    21.25%
Scorpio 2.8.1 64-bit MCTS   - Scorpio 2.8 64-bit                9.0 - 31.0     +3/=12/-25    22.50%
Scorpio 2.8.1 64-bit MCTS   - SCTR 1.1f 64-bit                  4.0 - 36.0     +1/=6/-33     10.00%
Scorpio 2.8.1 64-bit MCTS   - Tornado 8.0 64-bit               14.0 - 26.0     +6/=16/-18    35.00%
40/4 fft20

Code: Select all

Scorpio 2.8.1 64-bit MCTS   - Amoeba 2.7 64-bit                 9.0 - 31.0     +5/=8/-27     22.50%
Scorpio 2.8.1 64-bit MCTS   - Atlas 3.91 64-bit                 5.5 - 34.5     +2/=7/-31     13.75%
Scorpio 2.8.1 64-bit MCTS   - BugChess2 1.9 64-bit              9.5 - 30.5     +7/=5/-28     23.75%
Scorpio 2.8.1 64-bit MCTS   - Crafty 25.2 64-bit                6.5 - 33.5     +2/=9/-29     16.25%
Scorpio 2.8.1 64-bit MCTS   - Demolito 2017-08-26 64-bit        7.0 - 33.0     +1/=12/-27    17.50%
Scorpio 2.8.1 64-bit MCTS   - Deuterium 14.3.34.130 64-bit     10.5 - 29.5     +5/=11/-24    26.25%
Scorpio 2.8.1 64-bit MCTS   - DisasterArea 1.65 64-bit         10.0 - 30.0     +6/=8/-26     25.00%
Scorpio 2.8.1 64-bit MCTS   - Ethereal 9.00 64-bit              4.0 - 36.0     +1/=6/-33     10.00%
Scorpio 2.8.1 64-bit MCTS   - EXchess 7.97b 64-bit             10.5 - 29.5     +6/=9/-25     26.25%
Scorpio 2.8.1 64-bit MCTS   - Fruit Reloaded 3.2.1 64-bit      13.5 - 26.5    +11/=5/-24     33.75%
Scorpio 2.8.1 64-bit MCTS   - Gaviota 1.0 64-bit                9.5 - 30.5     +6/=7/-27     23.75%
Scorpio 2.8.1 64-bit MCTS   - Hakkapeliitta 3.0 64-bit          5.5 - 34.5     +2/=7/-31     13.75%
Scorpio 2.8.1 64-bit MCTS   - Murka 3 64-bit                    5.5 - 34.5     +2/=7/-31     13.75%
Scorpio 2.8.1 64-bit MCTS   - Nemo 1.0.1 64-bit                 9.0 - 31.0     +4/=10/-26    22.50%
Scorpio 2.8.1 64-bit MCTS   - Quazar 0.4 64-bit                 9.5 - 30.5     +2/=15/-23    23.75%
Scorpio 2.8.1 64-bit MCTS   - Rodent III 0.238 64-bit           6.0 - 34.0     +0/=12/-28    15.00%
Scorpio 2.8.1 64-bit MCTS   - Scorpio 2.7.9 64-bit              7.0 - 33.0     +2/=10/-28    17.50%
Scorpio 2.8.1 64-bit MCTS   - Scorpio 2.8 64-bit                9.0 - 31.0     +1/=16/-23    22.50%
Scorpio 2.8.1 64-bit MCTS   - SCTR 1.1f 64-bit                  0.0 - 40.0     +0/=0/-40      0.00%
Scorpio 2.8.1 64-bit MCTS   - Tornado 8.0 64-bit                7.0 - 33.0     +3/=8/-29     17.50%
40/4 fft100

Code: Select all

Scorpio 2.8.1 64-bit MCTS   - Amoeba 2.7 64-bit                 1.0 - 39.0     +1/=0/-39      2.50%
Scorpio 2.8.1 64-bit MCTS   - Atlas 3.91 64-bit                 1.0 - 39.0     +1/=0/-39      2.50%
Scorpio 2.8.1 64-bit MCTS   - BugChess2 1.9 64-bit              1.5 - 38.5     +0/=3/-37      3.75%
Scorpio 2.8.1 64-bit MCTS   - Crafty 25.2 64-bit                0.5 - 39.5     +0/=1/-39      1.25%
Scorpio 2.8.1 64-bit MCTS   - Demolito 2017-08-26 64-bit        0.5 - 39.5     +0/=1/-39      1.25%
Scorpio 2.8.1 64-bit MCTS   - Deuterium 14.3.34.130 64-bit      1.5 - 38.5     +0/=3/-37      3.75%
Scorpio 2.8.1 64-bit MCTS   - DisasterArea 1.65 64-bit          2.0 - 38.0     +0/=4/-36      5.00%
Scorpio 2.8.1 64-bit MCTS   - Ethereal 9.00 64-bit              0.0 - 40.0     +0/=0/-40      0.00%
Scorpio 2.8.1 64-bit MCTS   - EXchess 7.97b 64-bit              0.5 - 39.5     +0/=1/-39      1.25%
Scorpio 2.8.1 64-bit MCTS   - Fruit Reloaded 3.2.1 64-bit       0.0 - 40.0     +0/=0/-40      0.00%
Scorpio 2.8.1 64-bit MCTS   - Gaviota 1.0 64-bit                0.5 - 39.5     +0/=1/-39      1.25%
Scorpio 2.8.1 64-bit MCTS   - Hakkapeliitta 3.0 64-bit          1.0 - 39.0     +0/=2/-38      2.50%
Scorpio 2.8.1 64-bit MCTS   - Murka 3 64-bit                    2.5 - 37.5     +0/=5/-35      6.25%
Scorpio 2.8.1 64-bit MCTS   - Nemo 1.0.1 64-bit                 0.5 - 39.5     +0/=1/-39      1.25%
Scorpio 2.8.1 64-bit MCTS   - Quazar 0.4 64-bit                 1.0 - 39.0     +0/=2/-38      2.50%
Scorpio 2.8.1 64-bit MCTS   - Rodent III 0.238 64-bit           0.5 - 39.5     +0/=1/-39      1.25%
Scorpio 2.8.1 64-bit MCTS   - Scorpio 2.7.9 64-bit              0.5 - 39.5     +0/=1/-39      1.25%
Scorpio 2.8.1 64-bit MCTS   - Scorpio 2.8 64-bit                0.0 - 40.0     +0/=0/-40      0.00%
Scorpio 2.8.1 64-bit MCTS   - SCTR 1.1f 64-bit                  0.0 - 40.0     +0/=0/-40      0.00%
Scorpio 2.8.1 64-bit MCTS   - Tornado 8.0 64-bit                1.0 - 39.0     +0/=2/-38      2.50%

40/40 fft0

Code: Select all

Scorpio 2.8.1 64-bit MCTS   - Amoeba 2.7 64-bit                16.0 - 14.0    +10/=12/-8     53.33%
Scorpio 2.8.1 64-bit MCTS   - Atlas 3.91 64-bit                11.0 - 19.0     +4/=14/-12    36.67%
Scorpio 2.8.1 64-bit MCTS   - BugChess2 1.9 64-bit             19.0 - 11.0    +12/=14/-4     63.33%
Scorpio 2.8.1 64-bit MCTS   - Crafty 25.2 64-bit               11.5 - 18.5     +4/=15/-11    38.33%
Scorpio 2.8.1 64-bit MCTS   - Demolito 2017-08-26 64-bit       15.0 - 15.0    +10/=10/-10    50.00%
Scorpio 2.8.1 64-bit MCTS   - Deuterium 14.3.34.130 64-bit     15.5 - 14.5     +6/=19/-5     51.67%
Scorpio 2.8.1 64-bit MCTS   - DisasterArea 1.65 64-bit         15.5 - 14.5     +9/=13/-8     51.67%
Scorpio 2.8.1 64-bit MCTS   - Ethereal 9.00 64-bit             11.5 - 18.5     +3/=17/-10    38.33%
Scorpio 2.8.1 64-bit MCTS   - EXchess 7.97b 64-bit             17.0 - 13.0    +11/=12/-7     56.67%
Scorpio 2.8.1 64-bit MCTS   - Fruit Reloaded 3.2.1 64-bit      18.5 - 11.5    +13/=11/-6     61.67%
Scorpio 2.8.1 64-bit MCTS   - Gaviota 1.0 64-bit               15.0 - 15.0     +9/=12/-9     50.00%
Scorpio 2.8.1 64-bit MCTS   - Hakkapeliitta 3.0 64-bit         12.5 - 17.5     +8/=9/-13     41.67%
Scorpio 2.8.1 64-bit MCTS   - Murka 3 64-bit                   12.0 - 18.0     +6/=12/-12    40.00%
Scorpio 2.8.1 64-bit MCTS   - Nemo 1.0.1 64-bit                17.0 - 13.0    +12/=10/-8     56.67%
Scorpio 2.8.1 64-bit MCTS   - Quazar 0.4 64-bit                15.0 - 15.0     +8/=14/-8     50.00%
Scorpio 2.8.1 64-bit MCTS   - Rodent III 0.232 64-bit          17.0 - 13.0     +9/=16/-5     56.67%
Scorpio 2.8.1 64-bit MCTS   - Scorpio 2.7.9 64-bit             16.0 - 14.0     +5/=22/-3     53.33%
Scorpio 2.8.1 64-bit MCTS   - Scorpio 2.8 64-bit               14.0 - 16.0     +4/=20/-6     46.67%
Scorpio 2.8.1 64-bit MCTS   - SCTR 1.1f 64-bit                 11.0 - 19.0     +6/=10/-14    36.67%
Scorpio 2.8.1 64-bit MCTS   - Tornado 8.0 64-bit               18.0 - 12.0    +13/=10/-7     60.00%
40/40 fft10

Code: Select all

Scorpio 2.8.1 64-bit MCTS   - Amoeba 2.7 64-bit                 8.5 - 31.5     +4/=9/-27     21.25%
Scorpio 2.8.1 64-bit MCTS   - Atlas 3.91 64-bit                 6.5 - 33.5     +3/=7/-30     16.25%
Scorpio 2.8.1 64-bit MCTS   - BugChess2 1.9 64-bit             14.0 - 26.0    +10/=8/-22     35.00%
Scorpio 2.8.1 64-bit MCTS   - Crafty 25.2 64-bit                7.5 - 32.5     +2/=11/-27    18.75%
Scorpio 2.8.1 64-bit MCTS   - Demolito 2017-08-26 64-bit       13.0 - 27.0     +4/=18/-18    32.50%
Scorpio 2.8.1 64-bit MCTS   - Deuterium 14.3.34.130 64-bit     11.5 - 28.5     +5/=13/-22    28.75%
Scorpio 2.8.1 64-bit MCTS   - DisasterArea 1.65 64-bit          8.0 - 32.0     +4/=8/-28     20.00%
Scorpio 2.8.1 64-bit MCTS   - Ethereal 9.00 64-bit             10.0 - 30.0     +3/=14/-23    25.00%
Scorpio 2.8.1 64-bit MCTS   - EXchess 7.97b 64-bit             11.5 - 28.5     +4/=15/-21    28.75%
Scorpio 2.8.1 64-bit MCTS   - Fruit Reloaded 3.2.1 64-bit      13.0 - 27.0     +5/=16/-19    32.50%
Scorpio 2.8.1 64-bit MCTS   - Gaviota 1.0 64-bit                9.0 - 31.0     +6/=6/-28     22.50%
Scorpio 2.8.1 64-bit MCTS   - Hakkapeliitta 3.0 64-bit          8.0 - 32.0     +2/=12/-26    20.00%
Scorpio 2.8.1 64-bit MCTS   - Murka 3 64-bit                   11.5 - 28.5     +5/=13/-22    28.75%
Scorpio 2.8.1 64-bit MCTS   - Nemo 1.0.1 64-bit                10.0 - 30.0     +4/=12/-24    25.00%
Scorpio 2.8.1 64-bit MCTS   - Quazar 0.4 64-bit                 9.5 - 30.5     +4/=11/-25    23.75%
Scorpio 2.8.1 64-bit MCTS   - Rodent III 0.232 64-bit           8.5 - 31.5     +5/=7/-28     21.25%
Scorpio 2.8.1 64-bit MCTS   - Scorpio 2.7.9 64-bit              8.0 - 32.0     +1/=14/-25    20.00%
Scorpio 2.8.1 64-bit MCTS   - Scorpio 2.8 64-bit                9.5 - 30.5     +3/=13/-24    23.75%
Scorpio 2.8.1 64-bit MCTS   - SCTR 1.1f 64-bit                  2.5 - 37.5     +0/=5/-35      6.25%
Scorpio 2.8.1 64-bit MCTS   - Tornado 8.0 64-bit                9.0 - 31.0     +5/=8/-27     22.50%

All PGNs: ZIP
Daniel Shawul
Posts: 4185
Joined: Tue Mar 14, 2006 11:34 am
Location: Ethiopia

Re: Scorpio 2.8.1 MCTS only

Post by Daniel Shawul »

Thank you very much!

I really appreciate your big help in estimating scorpio-mcts strength.

As I suspected, It looks like fft=0 is the same strength as scropio 2.8 in both long and short time control which is good. This is good because in the previous version it was blundering pieces at the root that were hurting a lot.

I think i can not go more than fft=10 without loosing a significant elo. I expected that fft=5 or 10 will loose more about 100 elo which seems to be the case.

fft=100 is the pure MCTS version (which is the weakest) and it seems the opponentsare too strong for it.
My interal measurements puts it about 2300 ccrl (nebiyu/joker level), which is about 600 elo above TSCP and about 800 elo above current leela-chess :)
Good luck catching upto that leela-chess fans 8-)

Thanks again,
Daniel
megamau
Posts: 37
Joined: Wed Feb 10, 2016 6:20 am
Location: Singapore

Re: Scorpio 2.8

Post by megamau »

Daniel Shawul wrote: Wed Mar 28, 2018 5:49 pm My interal measurements puts it about 2300 ccrl (nebiyu/joker level), which is about 600 elo above TSCP and about 800 elo above current leela-chess
Good luck catching upto that leela-chess fans
Have you tried testing lately ?
I think the Leela-Chess fan had quite a good luck in catching up.