250 ELO in ~ 10 months

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

User avatar
MikeB
Posts: 4889
Joined: Thu Mar 09, 2006 6:34 am
Location: Pen Argyl, Pennsylvania

Re: 250 ELO in ~ 10 months

Post by MikeB »

jd1 wrote:It surely depends on just how unbalanced the position is.

To take it to the extreme, if the position is easily won even a weak player can score 50% against a much stronger opponent.

On the other hand, I do remember some studies here showing that unbalanced openings increased the % of wins the stronger engine could score against a weaker opponent.

I suppose it's partly because a lot of openings are very drawish at the higher levels of computer chess. Also unbalanced openings gives the stronger engine to show its superiority by winning the favourable position and holding the return game to a draw, whereas with a perfectly equal opening the weaker engine is likely to get two draws.
Draws in the variant CrazyHouse only run about 4% ( original subject matter).

time control game 25 sec with 0.25 increment
custom ZH book created ( over 5000 opening positions) by using the variant book generator by Fabian Fichter https://github.com/ianfab/bookgen/blob/master/Readme.md

Code: Select all

ResultSet>elo
ResultSet-EloRating>mm 0 1
00:00:00,00
ResultSet-EloRating>confidence .95
0.95
ResultSet-EloRating>r
Rank Name    Rating   Δ     +    -     #     Σ    Σ%     W    L    D   W%    =%   OppR 
---------------------------------------------------------------------------------------------------------
   1 ZH-McB   3105   0.0    9    9  5000 2565.5  51.3 2458 2327  215  49.2   4.3  3095 
   2 ZH       3095   9.0    9    9  5000 2434.5  48.7 2327 2458  215  46.5   4.3  3105 
---------------------------------------------------------------------------------------------------------
  Δ = delta from the next higher rated opponent
  # = number of games played
  Σ = total score, 1 point for win, 1/2 point for draw

ResultSet-EloRating>los
        ZH ZH
ZH-McB     96
ZH       3   
ResultSet-EloRating> 
User avatar
Nordlandia
Posts: 2821
Joined: Fri Sep 25, 2015 9:38 pm
Location: Sortland, Norway

Re: 250 ELO in ~ 10 months

Post by Nordlandia »

Endgames are unheard of in CH.

How do i contribute CPU to Crazyhouse SF?
Vinvin
Posts: 5228
Joined: Thu Mar 09, 2006 9:40 am
Full name: Vincent Lejeune

Re: 250 ELO in ~ 10 months

Post by Vinvin »

Nordlandia wrote:Endgames are unheard of in CH.

How do i contribute CPU to Crazyhouse SF?
Live tests are here : http://35.161.250.236:6543/tests
Forum about variants is here : https://github.com/ddugovic/Stockfish/issues
User avatar
MikeB
Posts: 4889
Joined: Thu Mar 09, 2006 6:34 am
Location: Pen Argyl, Pennsylvania

Re: 250 ELO in ~ 10 months

Post by MikeB »

Nordlandia wrote:Endgames are unheard of in CH.

How do i contribute CPU to Crazyhouse SF?
no endgames - every single draw, all 215, were of the repetition variety.

Example:

Code: Select all

[Event "Mac Pro x5690 3.46 Ghz 18 CPU"]
[Site "Mac-Pro.local"]
[Date "2017.10.28"]
[Round "4967"]
[White "ZH-McB"]
[Black "ZH"]
[Result "1/2-1/2"]
[TimeControl "25+0"]
[Variant "crazyhouse"]
[Number "4967"]
[FEN "rnbqkb1r/ppp2ppp/4pn2/3p4/8/3PP3/PPPB1PPP/RN1QKBNR[-] w KQkq - 0 1"]
[SetUp "1"]
1. Nc3 {-0.57/17 +24} Bd6 {+0.61/17 +24} 2. Nf3 {+0.00/16 +24} O-O
{+0.51/17 +23} 3. Nb5 {-0.67/17 +23} Be7 {+0.77/17 +23} 4. d4
{-0.74/18 +21} Bd7 {+0.83/17 +23} 5. Bd3 {-1.00/16 +20} c5 {+1.21/15 +23}
6. Ne5 {-0.82/16 +20} Bxb5 {+0.50/15 +23} 7. Bxb5 {-0.52/14 +20} Qb6
{+1.00/15 +22} 8. a4 {-0.31/16 +19} cxd4 {+0.10/16 +21} 9. O-O
{-0.28/16 +19} N@e4 {+1.30/16 +20} 10. exd4 {+0.48/13 +19} Qxd4
{-0.89/16 +18} 11. Nf3 {+0.12/16 +18} Qxb2 {-0.65/14 +18} 12. P@h6
{+1.82/14 +17} P@h3 {+1.54/13 +18} 13. hxg7 {+1.50/14 +17} hxg2
{-2.47/14 +18} 14. gxf8=Q+ {+2.70/13 +17} Bxf8 {-2.33/14 +18} 15. R@c8
{+3.01/13 +17} gxf1=Q+ {+0.00/11 +18} 16. Bxf1 {+0.35/14 +17} P@e2
{-2.15/15 +16} 17. P@e7 {+3.59/12 +17} R@g6+ {-0.59/12 +16} 18. P@g2
{+0.00/16 +15} Nbd7 {+0.00/14 +16} 19. Rxa8 {+0.00/16 +15} exd1=R
{+0.00/17 +16} 20. exf8=Q+ {+0.00/15 +15} Nxf8 {+0.00/1 +16} 21. Rxd1
{+0.00/16 +15} Q@h1+ {+0.00/18 +16} 22. Kxh1 {+0.00/1 +15} Nxf2+
{+0.00/21 +16} 23. Kg1 {+0.00/1 +15} Nh3+ {+0.00/25 +16} 24. Kh1
{+0.00/1 +15} Nf2+ {+0.00/26 +16} 25. Kg1 {+0.00/1 +15} Nh3+ {+0.00/27 +16}
26. Kh1 {+0.00/1 +16} Nf2+ {+0.00/29 +16} 27. Kg1 {+0.00/1 +16} Nh3+
{+0.00/29 +15} 28. Kh1 {+0.00/1 +16} Nf2+ {+0.00/32 +15} 29. Kg1
{+0.00/1 +16} Nh3+ {+0.00/30 +15} 30. Kh1 {+0.00/1 +16} Nf2+ {+0.00/33 +15}
31. Kg1 {+0.00/1 +16} Nh3+ {+0.00/30 +13} 32. Kh1 {+0.00/1 +17} Nf2+
{+0.00/35 +11}
{XBoard adjudication: repetition draw} 1/2-1/2
Isaac
Posts: 265
Joined: Sat Feb 22, 2014 8:37 pm

Re: 250 ELO in ~ 10 months

Post by Isaac »

Enormous thanks to SFZH programmers. They realized one of my dreams. I posted a few threads a few years ago (in Winboard forum and here under another account if I remember well) asking if someone could make SF play zh or improve Sunsetter.
I love zh (more than chess) and I plan to teach my 1 year old son zh before chess.
So thanks again Daniel, Fabian and the others.
Fabian Fichter
Posts: 50
Joined: Mon Dec 12, 2016 2:14 pm

Re: 250 ELO in ~ 10 months

Post by Fabian Fichter »

corres wrote:
Fabian Fichter wrote:
Strongly unbalanced positions usually decrease the Elo difference if the difference in playing strength is big as it helps the weaker engine to win some games.
??
Why do you think this?
I think just the opposite.
To a certain point the higher the unbalancing in the start positions the higher the chance of the stronger engine to win the competition with higher rate and higher Elo gain.
I think that crazyhouse is a completely different story from standard chess, since in crazyhouse the draw rate is basically negligible. This means that starting from a balanced position the weaker engine has almost no chance to escape with a draw, so it has to outplay the stronger engine. If the positions are more imbalanced, it is much easier for the weaker engine to sometimes score a lucky win due to favorable opening positions. I do not have much data to support this, but I would be surprised if the effect were the opposite.
Fabian Fichter
Posts: 50
Joined: Mon Dec 12, 2016 2:14 pm

Re: 250 ELO in ~ 10 months

Post by Fabian Fichter »

Nordlandia wrote:How do i contribute CPU to Crazyhouse SF?
If you are familiar of how to contribute CPU time to official fishtest, it is quite easy. Instead of using the worker code from Gary's repository, just use my fork https://github.com/ianfab/fishtest and get an account for multi-variant fishtest on http://35.161.250.236:6543/signup.

If you need any help, just ask here or in the thread that is mostly used for discussing issues related to multi-variant fishtest: https://github.com/ddugovic/Stockfish/issues/149
Fabian Fichter
Posts: 50
Joined: Mon Dec 12, 2016 2:14 pm

Re: 250 ELO in ~ 10 months

Post by Fabian Fichter »

Isaac wrote:Enormous thanks to SFZH programmers. They realized one of my dreams. I posted a few threads a few years ago (in Winboard forum and here under another account if I remember well) asking if someone could make SF play zh or improve Sunsetter.
I love zh (more than chess) and I plan to teach my 1 year old son zh before chess.
So thanks again Daniel, Fabian and the others.
Thanks, nice to hear that you like it.

Before I started to implement the crazyhouse rules about a year ago I did not really believe I would get it to work, but when I seriously started it, a first implementation (with dozens of bugs...) was to my surprise finished within a couple of hours. The official Stockfish code is in my opinion very well readable and structured, otherwise it would have been much harder to do this. It then took some time to stabilitze the implementation together with Daniel, but the performance without any crazyhouse-specific search or evaluation adaptions and still some bugs was already quite surprising. It is remarkable how well Stockfish's search techniques work for many variants that are quite different from standard chess.
User avatar
Nordlandia
Posts: 2821
Joined: Fri Sep 25, 2015 9:38 pm
Location: Sortland, Norway

Re: 250 ELO in ~ 10 months

Post by Nordlandia »

I have difficulties starting the worker. I've made .bat file but it doesn't start properly.

Can i use the same username for fishtest variant?

Is is difficult teaching SF another variant?

I wish Stockfish can play Two Kings variant.

Code: Select all

https://groups.google.com/forum/#!topic/jocly-community/B2cgrMnm7a8
Fabian Fichter
Posts: 50
Joined: Mon Dec 12, 2016 2:14 pm

Re: 250 ELO in ~ 10 months

Post by Fabian Fichter »

Nordlandia wrote:I have difficulties starting the worker. I've made .bat file but it doesn't start properly.

Can i use the same username for fishtest variant?

Is is difficult teaching SF another variant?

I wish Stockfish can play Two Kings variant.

Code: Select all

https://groups.google.com/forum/#!topic/jocly-community/B2cgrMnm7a8
It is a completely separate fishtest instance, so you have to create a new account under http://35.161.250.236:6543/signup (you can of course use the same username if you like) to be able to connect.

The difficulty of "teaching" Stockfish a new variant heavily depends on how different a variant is from standard chess. Additional winning conditions (king of the hill, three-check) are quite easy to implement, whereas differences in the rules that change the move generation (e.g., atomic, giveaway, losers, crazyhouse) are more challenging. The two kings variant should be feasible to implement, but it would take some effort especially regarding the logic for pins, checks and check evasions. Since it is not a very popular variant, it does not have a high priority for me. Maybe I (or someone else) will implement it in the future, but I do not expect it to be any time soon.