Test tournament started: Alex, BikJump, Chesley

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

User avatar
beachknight
Posts: 3533
Joined: Tue Jan 09, 2007 8:33 pm
Location: Antalya, Turkey

Re: Test tournament started: Alex, BikJump, Chesley

Post by beachknight »

Graham Banks wrote:
beachknight wrote:Notes and Problems:

Plisk 0.1.2 1cpu uses both available cpus, ie ponders.
This only tends to happen if there's a spare cpu available for it to do so? However, I've removed it from my future testing too.
This problem appeared in all three versions I have tested.

1, 2 and 4cpu.

best,
hi, merhaba, hallo HT
Top
User avatar
beachknight
Posts: 3533
Joined: Tue Jan 09, 2007 8:33 pm
Location: Antalya, Turkey

Re: Test tournament started: Alex, BikJump, Chesley

Post by beachknight »

Code: Select all

    Engine                 Score BiBiKuKuAlAlFiFiChChScJaNuJaZCZCWaWaIfScHeAr    S-B
01: BikJump 2.0 w32        0.0/0 ·                                              0,00
01: BikJump 1.8 w32        0.0/0   ·                                            0,00
01: Kurt 271009 JA w32     0.0/0     ·                                          0,00
01: Kurt 271009 DC         0.0/0       ·                                        0,00
01: Alex 1.8.7 w32         0.0/0         ·                                      0,00
01: Alex 1.9.6 w32         0.0/0           ·                                    0,00
01: FireFly 2.5.4 1cpu     0.0/0             ·                                  0,00
01: FireFly 2.5.4 1cpu w32 0.0/0               ·                                0,00
01: Chesley r268 JA        0.0/0                 ·                              0,00
01: Chesley r268 JA w32    0.0/0                   ·                            0,00
01: Schola 1.1             0.0/0                     ·                          0,00
01: Jabba 1.0 DC           0.0/0                       ·                        0,00
01: Numpty 0.4pr w32       0.0/0                         ·                      0,00
01: Jabba 1.0 w32          0.0/0                           ·                    0,00
01: ZCT 0.3.2500 JA        0.0/0                             ·                  0,00
01: ZCT 0.3.2500 JA w32    0.0/0                               ·                0,00
01: Waxman 2008 w32        0.0/0                                 ·              0,00
01: Waxman 2009 w32        0.0/0                                   ·            0,00
01: Ifrit j2.6b w32        0.0/0                                     ·          0,00
01: Schola 1.1 w32         0.0/0                                       ·        0,00
01: Heracles 0.6.16 w32    0.0/0                                         ·      0,00
01: ArabianKnight 0.88 w32 0.0/0                                           ·    0,00

0 of 231 games played
Name of the tournament: CET2403y
Site/ Country: CET24_Antalya_TUR, Türkiye
Level: Blitz 3/2
hi, merhaba, hallo HT
Top
User avatar
abik
Posts: 819
Joined: Fri Dec 01, 2006 10:46 pm
Location: Mountain View, CA, USA
Full name: Aart Bik

Re: Test tournament started: Alex, BikJump, Chesley

Post by abik »

If still possible, I would recommend using 2.0.1 instead of 2.0. Despite the difference in scores in your previous tests, they are really identical, except for a bug fix (embarrassing: 2.0 sometimes castles while in check).
Top
User avatar
beachknight
Posts: 3533
Joined: Tue Jan 09, 2007 8:33 pm
Location: Antalya, Turkey

Re: Test tournament started: Alex, BikJump, Chesley

Post by beachknight »

beachknight wrote:Notes and Problems:

Plisk 0.1.2 1cpu uses both available cpus, ie ponders.

AviChess 0.6 & 0.7 not working, even with xboard switch.

Carballo 0.3, Luzhin 0.1, ChessBin 00.61, ArabianKnight 0.48 and
ArabianKnight 0.88 not working. What I am thinking is: a java update
might solve the problem.

to be cont'd
After installing both java updates, one for w32 and one for x64,
ArabianKnight 0.88 seems working well on Arena 2.0.1 (on W7 Ultimate
Pro x64). Luzhin 0.1 moves strangely.

Avi still not working.

All Numpty 0.5pr w32 scores are to be changed to: Numpty 0.4pr w32.

I made an error in duplication process.

Numpty 0.5pr w32 runs today.


Best,
hi, merhaba, hallo HT
Top
User avatar
beachknight
Posts: 3533
Joined: Tue Jan 09, 2007 8:33 pm
Location: Antalya, Turkey

Re: Test tournament started: Alex, BikJump, Chesley

Post by beachknight »

abik wrote:If still possible, I would recommend using 2.0.1 instead of 2.0. Despite the difference in scores in your previous tests, they are really identical, except for a bug fix (embarrassing: 2.0 sometimes castles while in check).
Hi Aart,

These preliminary runs are being done for determining the divisions.
No need to panic. In division fights, I'll use BikJump 2.0.1 and
BikJump 2.0.1 w32 or new updates :)

Best,
hi, merhaba, hallo HT
Top
P. Villanueva
Posts: 85
Joined: Sat May 17, 2008 10:57 pm
Location: Bilbao, Spain

Re: Test tournament started: Alex, BikJump, Chesley

Post by P. Villanueva »

Thank for the tournament.

I´ve got a question. Wich values do you use as reference to calculate engines ELO?
Top
User avatar
beachknight
Posts: 3533
Joined: Tue Jan 09, 2007 8:33 pm
Location: Antalya, Turkey

Re: Test tournament started: Alex, BikJump, Chesley

Post by beachknight »

P. Villanueva wrote:Thank for the tournament.

I´ve got a question. Wich values do you use as reference to calculate engines ELO?
IMHO, this is a very hot topic. I am following an old tradition in
computer chess testing by fixing Shredder 09.1 w32 (UCI) at 2750.

I'll try to outline what I'll be doing in my future tests. Before
inter-divisions fights begin, I should find a simple way for
reflecting engines ratings. As an enthuaistic tester, I need
to find solutions for all of these below and therefore an
automated process for each new engine would be great!

Procedure:

First of all: Execute a sample of test suites, 1, 2, 3 or more.
Nunn2, STS, WAC etc... comes to mind.

Secondly: Set up two or three tournaments each with eight
opponents, 16 games per tourn.

Thirdly: Determine the division of the engine.
Criteria : Which engines could compete, which not?

Like in the case of Plisk that uses all my precious memory : could not.

Fourth: Tournaments, double round robin or one blitz + one rapid

Fifth: Which engine goes upper? which going down? Some guidelines.

Well, I am tired. :)

Best,
hi, merhaba, hallo HT
Top
User avatar
beachknight
Posts: 3533
Joined: Tue Jan 09, 2007 8:33 pm
Location: Antalya, Turkey

Re: Test tournament started: Alex, BikJump, Chesley

Post by beachknight »

Code: Select all

    Engine                 Score BiJaFiWaWaBiZCJaZCKuScFiAlKuChAlHeArIfScChNu    S-B
01: BikJump 2.0 w32        5.0/6 ·     = 1                       1 = 1 1       10,00
02: Jabba 1.0 DC           4.5/5   ·               1 = 1 1   1                 10,25
03: FireFly 2.5.4 1cpu w32 4.5/5     ·       1       = 1     1             1    9,25
04: Waxman 2008 w32        4.0/6 =     ·   0               =   1 1   1          8,00
05: Waxman 2009 w32        4.0/6 0       ·       1 =     =         1   1        7,25
06: BikJump 1.8 w32        4.0/5       1   · 0                   1   1     1    6,50
07: ZCT 0.3.2500 JA        3.5/5     0     1 ·             1   1 =              8,75
08: Jabba 1.0 w32          3.5/5               ·   0   = 1   1     1            6,25
09: ZCT 0.3.2500 JA w32    3.0/6         0       · 1   0 =         1   =        5,00
10: Kurt 271009 JA w32     2.5/5   0     =     1 0 ·                   1        6,50
10: Schola 1.1             2.5/5   = =               ·     =   0         1      6,50
12: FireFly 2.5.4 1cpu     2.5/5   0 0         = 1     ·                 1      5,75
13: Alex 1.8.7 w32         2.0/5   0     =     0 =       ·               1      4,50
14: Kurt 271009 DC         2.0/5       =     0       =     ·         0     1    3,25
15: Chesley r268 JA        2.0/5   0 0         0             · 1         1      3,00
16: Alex 1.9.6 w32         2.0/5       0     0       1       0 ·           1    2,50
17: Heracles 0.6.16 w32    1.5/5 0     0   0 =                   ·   1          2,75
18: ArabianKnight 0.88 w32 1.0/5 =       0     0 0                 ·   =        3,00
19: Ifrit j2.6b w32        1.0/5 0     0   0               1     0   ·          2,00
19: Schola 1.1 w32         1.0/5 0       0       = 0               =   ·        2,00
21: Chesley r268 JA w32    1.0/5                     0 0 0   0           · 1    0,00
22: Numpty 0.5pr w32       0.0/5     0     0               0   0         0 ·    0,00

57 of 231 games played
Name of the tournament: CET2403y
Site/ Country: CET24_Antalya_TUR, Türkiye
Level: Blitz 3/2
Schola 1.1 >>>>

KMT 1.2.1 DC <<<<
hi, merhaba, hallo HT
Top
User avatar
beachknight
Posts: 3533
Joined: Tue Jan 09, 2007 8:33 pm
Location: Antalya, Turkey

Re: Test tournament started: Alex, BikJump, Chesley

Post by beachknight »

Code: Select all

    Engine                 Score BiWaJaJaZCFiWaAlFiKMBiKuZCAlChHeScChKuIfArNu    S-B
01&#58; BikJump 1.8 w32        9.0/12 · 0 0 1 0   1           1   1 1 1     1 1 1   32,50
02&#58; Waxman 2009 w32        8.0/10 1 · 1         =     0 = 1 1     1   1   1     37,75
03&#58; Jabba 1.0 w32          7.5/12 1 0 ·     =   1 =     0   0 1   = 1 1   1     32,50
04&#58; Jabba 1.0 DC           7.5/11 0     ·   1   1 1     1   0 1     0 1   = 1   32,25
05&#58; ZCT 0.3.2500 JA        7.0/12 1       · 0 0 0 = 0   1   1 1 =     1 1       32,00
06&#58; FireFly 2.5.4 1cpu w32 6.5/9      = 0 1 ·   = 1     = 1   1             1   33,00
07&#58; Waxman 2008 w32        6.5/11 0       1   · 0 = 0 = 1   1   1     = 1       29,75
08&#58; Alex 1.8.7 w32         6.5/11   = 0 0 1 = 1 ·         = 0       1   1   1   27,50
09&#58; FireFly 2.5.4 1cpu     6.5/10     = 0 = 0 =   ·       1 1       1 1     1   24,00
09&#58; KMT 1.2.1 DC           6.5/7          1   1     · =         1   1   1   1   24,00
11&#58; BikJump 2.0 w32        6.0/8    1         =     = ·   =     1 1     1 =     25,50
12&#58; Kurt 271009 JA w32     6.0/12   = 1 0 0 = 0         · 0     0 1 1   1   1   20,75
13&#58; ZCT 0.3.2500 JA w32    5.5/11 0 0       0   = 0   = 1 · 1     =   1   1     20,75
14&#58; Alex 1.9.6 w32         4.0/10   0 1 1 0   0 1 0       0 · 0             1   21,50
15&#58; Chesley r268 JA        4.0/9  0   0 0 0 0               1 ·     1 1     1    8,00
16&#58; Heracles 0.6.16 w32    3.5/8  0       =   0     0 0 1       ·       1   1   11,50
17&#58; Schola 1.1 w32         2.0/8  0 0 =               0 0 =       ·   =   =      8,25
18&#58; Chesley r268 JA w32    2.0/8      0 1       0 0 0   0     0     ·       1    7,50
19&#58; Kurt 271009 DC         2.0/11   0 0 0 0   =   0       0   0   =   · 0   1    4,25
20&#58; Ifrit j2.6b w32        2.0/10 0       0   0 0   0 0 0       0     1 ·   1    2,00
21&#58; ArabianKnight 0.88 w32 1.5/7  0 0 0 =             =   0       =       ·      7,75
22&#58; Numpty 0.5pr w32       0.0/13 0     0   0   0 0 0   0   0 0 0   0 0 0   ·    0,00

110 of 231 games played
Name of the tournament&#58; CET2403y
Site/ Country&#58; CET24_Antalya_TUR, Türkiye
Level&#58; Blitz 3/2
hi, merhaba, hallo HT
Top
User avatar
beachknight
Posts: 3533
Joined: Tue Jan 09, 2007 8:33 pm
Location: Antalya, Turkey

Re: Test tournament started: Alex, BikJump, Chesley

Post by beachknight »

Code: Select all

    Engine                 Score  BiBiWaKMZCFiJaFiWaJaAlAlKuScZCHeChKuArChIfNu    S-B
01&#58; BikJump 2.0 w32        12.5/15 ·   1 = =   1 1 = 1       1 = 1 1   = 1 1 1   82,50
02&#58; BikJump 1.8 w32        12.5/16   · 0 = 0 1 0   1 1   1 1 1 1 1 1   1   1 1   78,00
03&#58; Waxman 2009 w32        11.5/14 0 1 · 1   = 1     1 1 = = 1 1   1 1 1         87,00
04&#58; KMT 1.2.1 DC           11.0/14 = = 0 · 1     0 1   1     1   1   1 1 1 1 1   65,50
05&#58; ZCT 0.3.2500 JA        9.5/15  = 1   0 · =   0 0   1 0 1     = 1 1   1 1 1   58,00
06&#58; FireFly 2.5.4 1cpu     9.5/15    0 =   = · = 0 = 0 1     = 1   1 1 1 1   1   53,75
07&#58; Jabba 1.0 w32          9.0/15  0 1 0     = · =   = 0 1 0 = 1   1 1 1 1       59,75
07&#58; FireFly 2.5.4 1cpu w32 9.0/15  0     1 1 1 = · 0 0   = =   1 = 1     0 1 1   59,75
09&#58; Waxman 2008 w32        9.0/14  = 0   0 1 =   1 ·   1 0 1     1   =   = 1 1   57,25
10&#58; Jabba 1.0 DC           8.5/16  0 0 0     1 = 1   · 0 1 1 0 =   1 1 = 0   1   52,25
11&#58; Alex 1.9.6 w32         8.0/15      0 0 0 0 1   0 1 · 1 1   0 1 0     1 1 1   44,50
12&#58; Alex 1.8.7 w32         7.5/15    0 =   1   0 = 1 0 0 ·   0 =     = = 1 1 1   42,00
13&#58; Kurt 271009 JA w32     7.0/16    0 =   0   1 = 0 0 0   · 1 0 0   0 1 1 1 1   35,75
14&#58; Schola 1.1 w32         6.5/14  0 0 0 0   = =     1   1 0 · = 1 1 = =         44,00
15&#58; ZCT 0.3.2500 JA w32    6.0/14  = 0 0     0 0 0   = 1 = 1 = ·   0 1 1         40,00
16&#58; Heracles 0.6.16 w32    6.0/14  0 0   0 =     = 0   0   1 0   ·   = = 1 1 1   26,50
17&#58; Chesley r268 JA        6.0/15  0 0 0   0 0 0 0   0 1     0 1   · 1 1 1   1   25,00
18&#58; Kurt 271009 DC         4.0/15      0 0 0 0 0   = 0   = 1 = 0 = 0 ·     0 1   21,50
19&#58; ArabianKnight 0.88 w32 3.5/14  = 0 0 0   0 0     =   = 0 = 0 = 0   ·   1     23,50
20&#58; Chesley r268 JA w32    3.5/15  0     0 0 0 0 1 = 1 0 0 0     0 0     · 0 1   22,00
21&#58; Ifrit j2.6b w32        3.0/14  0 0   0 0     0 0   0 0 0     0   1 0 1 · 1    7,50
22&#58; Numpty 0.5pr w32       0.0/16  0 0   0 0 0   0 0 0 0 0 0     0 0 0   0 0 ·    0,00

163 of 231 games played
Name of the tournament&#58; CET2403y
Site/ Country&#58; CET24_Antalya_TUR, Türkiye
Level&#58; Blitz 3/2
Numpty 0.5pr w32 >>>>>
hi, merhaba, hallo HT
Top

Return to “Computer Chess Club: Tournaments and Matches”