SF130118

Discussion of computer chess matches and engine tournaments.

Moderators: bob, hgm, Harvey Williamson

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
jhellis3
Posts: 399
Joined: Fri Aug 16, 2013 10:36 pm

Re: SF130118

Post by jhellis3 » Tue Jan 23, 2018 8:07 pm

It is difficult to say exactly how it will scale with regard to opposing engine strength. On the one hand, avoiding draws is more likely to pay off (as opposing engine strength decreases)... but on the other hand, you are already going to be winning most of those games anyway, so there are fewer opportunities for a given number of games for it to come into play.

JJJ
Posts: 1286
Joined: Sat Apr 19, 2014 11:47 am

Re: SF130118

Post by JJJ » Wed Jan 24, 2018 5:01 am

Yep, regression test showing a nice elo jump.

IWB
Posts: 1539
Joined: Thu Mar 09, 2006 1:02 pm

Re: SF130118

Post by IWB » Wed Jan 24, 2018 5:47 pm

I am running the same test again with 230118:

http://www.inwoba.de/C20.html

You can find the full rating for 130118 here in the thread. 130118 got 81%. I am quite sure it will be more with the contempt but the interesting question is if there is a performance boost against Houdin and probably Komodo and if not if that is pushing the contenders upward ...
130118 was only 3 Elo ahead of Houdini at the end ... I am courious to see the final ORDO calculation!

Ingo

pohl4711
Posts: 1082
Joined: Sat Sep 03, 2011 5:25 am
Location: Berlin, Germany
Contact:

Re: SF130118

Post by pohl4711 » Wed Jan 24, 2018 6:11 pm

IWB wrote:I am running the same test again with 230118:

http://www.inwoba.de/C20.html


Ingo
The link leads only to an empty page ?!?!

IWB
Posts: 1539
Joined: Thu Mar 09, 2006 1:02 pm

Re: SF130118

Post by IWB » Wed Jan 24, 2018 6:13 pm

pohl4711 wrote:
IWB wrote:I am running the same test again with 230118:

http://www.inwoba.de/C20.html


Ingo
The link leads only to an empty page ?!?!
Works for me ...

pohl4711
Posts: 1082
Joined: Sat Sep 03, 2011 5:25 am
Location: Berlin, Germany
Contact:

Re: SF130118

Post by pohl4711 » Wed Jan 24, 2018 6:14 pm

Yes. Now it works.

IWB
Posts: 1539
Joined: Thu Mar 09, 2006 1:02 pm

Re: SF130118

Post by IWB » Wed Jan 24, 2018 6:16 pm

The "old" 130118 had 56% vs Houdini and 60% vs komodo ... but that were only 220 games ... anyhow, it might look good in the rating lists but C20 might fail on a server ...

the old individual result is still online:
http://www.inwoba.de/SF.html

JJJ
Posts: 1286
Joined: Sat Apr 19, 2014 11:47 am

Re: SF130118

Post by JJJ » Wed Jan 24, 2018 7:18 pm

Too soon to tell, but it seems to hurt only vs Houdini so far.

Vinvin
Posts: 4375
Joined: Thu Mar 09, 2006 8:40 am
Full name: Vincent Lejeune

Re: SF130118

Post by Vinvin » Wed Jan 24, 2018 9:22 pm

IWB wrote:I am running the same test again with 230118:

http://www.inwoba.de/C20.html

You can find the full rating for 130118 here in the thread. 130118 got 81%. I am quite sure it will be more with the contempt but the interesting question is if there is a performance boost against Houdin and probably Komodo and if not if that is pushing the contenders upward ...
130118 was only 3 Elo ahead of Houdini at the end ... I am courious to see the final ORDO calculation!

Ingo
Thanks for this test !
Very nice start for C=20 ! Currently, it's around 21 points (+3%) above Houdini !

Code: Select all

Stockfish 230118 64 POPCNT C20 : 447.5	-	82.5		84.43%

Stockfish 130118 64 POPCNT    :   2672.0	-	628.0	80.97%
Houdini 6.02        :      81.4%

Vizvezdenec
Posts: 52
Joined: Fri Jan 12, 2018 12:30 am

Re: SF130118

Post by Vizvezdenec » Wed Jan 24, 2018 10:59 pm

At fishtest C=20 had shown 0 measurable regression, so it probably should not result in any meaningful regression vs houdini or komodo (also it didn't in some 1000-games samples of other testers).
Right now it scores slightly more vs houdini and slightly less vs komodo but I guess it's just a noise. But it for sure helps vs weaker engines a lot.

Post Reply