1st Mini Shogi Computer Association Championships 2017

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Ferdy
Posts: 4833
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

High 2nd player win percentage

Post by Ferdy »

Stage I results after 1st and 2nd rounds out of 5 rounds total.
Black Wins (60.4%), I guess this is because the first player to move in the starting position (white) loses the game if there is a repetition (without perpetual check).
It would be interesting to know the history of this specific rule.
When one side tries to perpetually check his opponent that side loses.

Code: Select all

No. Name                      1    2    3    4    5    6  Score   SOP
---------------------------------------------------------------------
  1 Lima v4.0 64bit        xxxx            7.0       7.0   14.0  64.0
  2 Shokidoki UEC9+ 32bit       xxxx            6.0  6.0   12.0  64.0
  3 CrazyWa 1.0.2 32bit              xxxx  4.0  5.0         9.0  80.0
  4 NebiyuAlien 1.46 32bit  1.0       4.0 xxxx              5.0 184.0
  5 TJshogi 5x5 0.19 32bit       2.0  3.0      xxxx         5.0 168.0
  6 Sjaak II v1.4.1 64bit   1.0  2.0                xxxx    3.0 208.0

Total Games:      48
White Wins:       19 (39.6%)
Black Wins:       29 (60.4%)
Draws:             0 (0.0%)
Top
Ferdy
Posts: 4833
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: 1st Mini Shogi Computer Association Championships 2017

Post by Ferdy »

Stage I, results after 4 rounds:

Code: Select all

No. Name                      1    2    3    4    5    6  Score
---------------------------------------------------------------
  1 Lima v4.0 64bit        xxxx       7.0  7.0  7.0  7.0   28.0
  2 Shokidoki UEC9+ 32bit       xxxx  5.0  7.0  6.0  6.0   24.0
  3 CrazyWa 1.0.2 32bit     1.0  3.0 xxxx  4.0       5.0   13.0
  4 NebiyuAlien 1.46 32bit  1.0  1.0  4.0 xxxx  5.0        11.0
  5 Sjaak II v1.4.1 64bit   1.0  2.0       3.0 xxxx  4.0   10.0
  6 TJshogi 5x5 0.19 32bit  1.0  2.0  3.0       4.0 xxxx   10.0

Total Games:      96
White Wins:       42 (43.8%)
Black Wins:       54 (56.2%)
Draws:             0 (0.0%)
In stage II, I will no longer broadcast the games as I am experiencing Winboard not responding after the game ends. With 8 positions in pgn opening suite scheduled for 16 games, and WB not responding at times, it would be too much work trying to continue the pairing and build again the command line for unfinished games.
Top
Ferdy
Posts: 4833
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Stage I is completed

Post by Ferdy »

Ferdy wrote:Stage 1 has started, live page is in
http://hgm.nubati.net/variants/msca1/

In the live page after pressing show games, the game started at game #268.

Brackets/result can be found here.
http://minishogi.challonge.com/ch2017
Stage I is completed, the top 4 will advance to stage II.

Code: Select all

No. Name                      1    2    3    4    5    6  Score
---------------------------------------------------------------
  1 Lima v4.0 64bit        xxxx  4.0  7.0  7.0  7.0  7.0   32.0
  2 Shokidoki UEC9+ 32bit   4.0 xxxx  5.0  7.0  6.0  6.0   28.0
  3 CrazyWa 1.0.2 32bit     1.0  3.0 xxxx  4.0  4.0  5.0   17.0
  4 NebiyuAlien 1.46 32bit  1.0  1.0  4.0 xxxx  5.0  5.0   16.0
  5 Sjaak II v1.4.1 64bit   1.0  2.0  4.0  3.0 xxxx  4.0   14.0
  6 TJshogi 5x5 0.19 32bit  1.0  2.0  3.0  3.0  4.0 xxxx   13.0

Total Games:     120
White Wins:       51 (42.5%)
Black Wins:       69 (57.5%)
Draws:             0 (0.0%)
Games can be downloaded at,
https://sites.google.com/view/minishogi ... mpionships
Top
User avatar
hgm
Posts: 27790
Joined: Fri Mar 10, 2006 10:06 am
Location: Amsterdam
Full name: H G Muller

Re: Stage I is completed

Post by hgm »

Unexpectedly good performance of CrazyWa. The only changes to the evaluation compared to Crazyhouse were halving the weight of King Safety, (because material balance is much more important in mini-Shogi than in larger drop variants), adding a bonus to the PST used for the generals at c3, and a bonus for the King PST on a1.
Top
User avatar
Evert
Posts: 2929
Joined: Sat Jan 22, 2011 12:42 am
Location: NL

Re: Stage I is completed

Post by Evert »

hgm wrote:The only changes to the evaluation compared to Crazyhouse were halving the weight of King Safety, (because material balance is much more important in mini-Shogi than in larger drop variants)
Interesting. I tried something like that two weeks ago, and it worked quite well for mini-Shogi and regular Shogi, and even for Crazyhouse. It blew up spectacularly for Tori Shogi.
Top
Ferdy
Posts: 4833
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: Stage I is completed

Post by Ferdy »

Ferdy wrote:
Ferdy wrote:Stage 1 has started, live page is in
http://hgm.nubati.net/variants/msca1/

In the live page after pressing show games, the game started at game #268.

Brackets/result can be found here.
http://minishogi.challonge.com/ch2017
Stage I is completed, the top 4 will advance to stage II.

Code: Select all

No. Name                      1    2    3    4    5    6  Score
---------------------------------------------------------------
  1 Lima v4.0 64bit        xxxx  4.0  7.0  7.0  7.0  7.0   32.0
  2 Shokidoki UEC9+ 32bit   4.0 xxxx  5.0  7.0  6.0  6.0   28.0
  3 CrazyWa 1.0.2 32bit     1.0  3.0 xxxx  4.0  4.0  5.0   17.0
  4 NebiyuAlien 1.46 32bit  1.0  1.0  4.0 xxxx  5.0  5.0   16.0
  5 Sjaak II v1.4.1 64bit   1.0  2.0  4.0  3.0 xxxx  4.0   14.0
  6 TJshogi 5x5 0.19 32bit  1.0  2.0  3.0  3.0  4.0 xxxx   13.0

Total Games:     120
White Wins:       51 (42.5%)
Black Wins:       69 (57.5%)
Draws:             0 (0.0%)
Games can be downloaded at,
https://sites.google.com/view/minishogi ... mpionships
Rule infractions: TJshogi got 2 from repetitions.

Code: Select all

Rank                            Engine   Games     Pts    Pct  rep  tif  per
   1                   Lima v4.0 64bit      40    32.0   80.0    0    0    0
   2             Shokidoki UEC9+ 32bit      40    28.0   70.0    0    0    0
   3               CrazyWa 1.0.2 32bit      40    17.0   42.5    0    0    0
   4            NebiyuAlien 1.46 32bit      40    16.0   40.0    0    0    0
   5             Sjaak II v1.4.1 64bit      40    14.0   35.0    0    0    0
   6            TJshogi 5x5 0.19 32bit      40    13.0   32.5    2    0    0

:: Rule infraction ::
rep   : Repetition
tif   : Time forfeit
per   : Perpetual

games : 120
tc    : 3600+10
file  : msca1-ch-st-1.pgn
Average depth and time comparison:

Code: Select all

 nr                       player  games  pts%      sumTime aveDep    aveTime

  1       NebiyuAlien 1.46 32bit     40  40.0  00:18:32:41  23.59  01:31:957
  2              Lima v4.0 64bit     40  80.0  00:23:12:15  21.13  01:31:195
  3        Sjaak II v1.4.1 64bit     40  35.0  00:17:43:02  15.52  01:15:841
  4        Shokidoki UEC9+ 32bit     40  70.0  01:00:59:27  15.38  01:41:428
  5          CrazyWa 1.0.2 32bit     40  42.5  00:15:36:27  14.89  01:30:624
  6       TJshogi 5x5 0.19 32bit     40  32.5  00:22:16:14  13.84  01:32:367

file         : msca1-ch-st-1.pgn
score window : [-1000.0, +1000.0]
notes        : 1. games and pts% are not affected by score window.
               2. Table is sorted by aveDep in descending order.
               3. aveTime is the average time/move in m:s:ms
               4. sumTime is in d:h:m:s
Top
Ferdy
Posts: 4833
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Stage II started

Post by Ferdy »

Current results:

Code: Select all

Results from file msca-1-ch-stage-II.pgn:

No. Name                    1  2  3  4  Score
---------------------------------------------
  1 Lima v4.0 64bit        xx    11 1     3.0
  2 Shokidoki UEC9+ 32bit     xx 11       2.0
  3 CrazyWa 1.0.2 32bit    00 00 xx       0.0
  4 NebiyuAlien 1.46 32bit 0        xx    0.0

Total Games:       5
White Wins:        3 (60.0%)
Black Wins:        2 (40.0%)
Draws:             0 (0.0%)
Updated scoring can also be found in,
http://minishogi.challonge.com/ch2017
Top
Ferdy
Posts: 4833
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: Stage II finished

Post by Ferdy »

Stage II final results:

Code: Select all

Results from file msca-1-ch-stage-II.pgn:

No. Name                      1    2    3    4  Score
-----------------------------------------------------
  1 Lima v4.0 64bit        xxxx 13.0 12.0 11.0   36.0
  2 Shokidoki UEC9+ 32bit   3.0 xxxx 13.0 15.0   31.0
  3 CrazyWa 1.0.2 32bit     4.0  3.0 xxxx 12.0   19.0
  4 NebiyuAlien 1.46 32bit  5.0  1.0  4.0 xxxx   10.0

Total Games:      96
White Wins:       42 (43.8%)
Black Wins:       54 (56.2%)
Draws:             0 (0.0%)
Head to head statistics:

Code: Select all

 1) Lima v4.0 64bit         2569.4 :     48 (+36,=0,-12),  75.0 %

    vs.                            :  games (  +, =,  -),   (%) :    Diff,    SD, CFS (%)
    Shokidoki UEC9+ 32bit          :     16 ( 13, 0,  3),  81.3 :   +69.4,  71.4,   83.5
    CrazyWa 1.0.2 32bit            :     16 ( 12, 0,  4),  75.0 :  +225.5,  77.1,   99.8
    NebiyuAlien 1.46 32bit         :     16 ( 11, 0,  5),  68.8 :  +352.6,  89.8,  100.0

 2) Shokidoki UEC9+ 32bit   2500.0 :     48 (+31,=0,-17),  64.6 %

    vs.                            :  games (  +, =,  -),   (%) :    Diff,    SD, CFS (%)
    Lima v4.0 64bit                :     16 (  3, 0, 13),  18.8 :   -69.4,  71.4,   16.5
    CrazyWa 1.0.2 32bit            :     16 ( 13, 0,  3),  81.3 :  +156.1,  76.0,   98.0
    NebiyuAlien 1.46 32bit         :     16 ( 15, 0,  1),  93.8 :  +283.1,  87.6,   99.9

 3) CrazyWa 1.0.2 32bit     2343.9 :     48 (+19,=0,-29),  39.6 %

    vs.                            :  games (  +, =,  -),   (%) :    Diff,    SD, CFS (%)
    Lima v4.0 64bit                :     16 (  4, 0, 12),  25.0 :  -225.5,  77.1,    0.2
    Shokidoki UEC9+ 32bit          :     16 (  3, 0, 13),  18.8 :  -156.1,  76.0,    2.0
    NebiyuAlien 1.46 32bit         :     16 ( 12, 0,  4),  75.0 :  +127.1,  83.3,   93.6

 4) NebiyuAlien 1.46 32bit  2216.9 :     48 (+10,=0,-38),  20.8 %

    vs.                            :  games (  +, =,  -),   (%) :    Diff,    SD, CFS (%)
    Lima v4.0 64bit                :     16 (  5, 0, 11),  31.3 :  -352.6,  89.8,    0.0
    Shokidoki UEC9+ 32bit          :     16 (  1, 0, 15),   6.3 :  -283.1,  87.6,    0.1
    CrazyWa 1.0.2 32bit            :     16 (  4, 0, 12),  25.0 :  -127.1,  83.3,    6.4
Games can be downloaded from,
https://sites.google.com/view/minishogi ... mpionships

Infractions/crash:

Code: Select all

Rank                            Engine   Games     Pts    Pct  rep  tif  per  crash
   1                   Lima v4.0 64bit      48    36.0   75.0    0    0    0      0
   2             Shokidoki UEC9+ 32bit      48    31.0   64.6    0    0    0      0
   3               CrazyWa 1.0.2 32bit      48    19.0   39.6    0    0    0      0
   4            NebiyuAlien 1.46 32bit      48    10.0   20.8    1    0    3      3

:: Rule infraction ::
rep   : Repetition
tif   : Time forfeit
per   : Perpetual
crash : Program exited unexpectedly

games : 96
tc    : 3600+10
file  : msca-1-ch-stage-II.pgn
Top
User avatar
hgm
Posts: 27790
Joined: Fri Mar 10, 2006 10:06 am
Location: Amsterdam
Full name: H G Muller

Re: Stage II finished

Post by hgm »

Thank you for organizing a great tourney. And congratulations with Lima's performance! The results are a bit anomalous, though: Shokidoki crushed Nebiyu and CrazyWa (15-1 and 13-3), but both of these did better against Lima than Shokidoki did. I will study the games to see how this is possible.

It is clear the big strength gap is between Lima / Shokidoki and the CrazyWa / Sjaak / Nebiyu / TJshogi. The latter four are pretty close, though. So a full round-robin with 16 games/pairing would also be very interesting, perhaps even more so than the stage II round robin. (Which was a bit of a massacre.) So out of curiosity: could you still do the remaining 5 matches between between Crazywa / Sjaak/ Nebiyu and TJshogi?

Anyway, it seems we will get a very interesting UEC Cup, this year.
Top
Ferdy
Posts: 4833
Joined: Sun Aug 10, 2008 3:15 pm
Location: Philippines

Re: Stage II finished

Post by Ferdy »

hgm wrote:Thank you for organizing a great tourney. And congratulations with Lima's performance! The results are a bit anomalous, though: Shokidoki crushed Nebiyu and CrazyWa (15-1 and 13-3), but both of these did better against Lima than Shokidoki did. I will study the games to see how this is possible.
Lima is primarily developed against Shokidoki. My test matches are mostly beween Shokidoki and old versions of Lima, I knew Lima could beat Nebiyu and CrazyWa but not sure how many games it is ahead.

There are only a couple of games played, the scoring differences would be clearer if more games will be played. Also stage 2 is only based on 8 starting positions. It would have been better if it is more, engines have its own weakneses and strengths.
Top

Return to “Computer Chess Club: General Topics”