ChessUSA.com TalkChess.com
Hosted by Your Move Chess & Games
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

Test tournament started: Alex, BikJump, Chesley
Goto page Previous  1, 2, 3  Next
 
Post new topic       TalkChess.com Forum Index -> Computer Chess Club: Tournaments and Matches Threaded
View previous topic :: View next topic  
Author Message
Harun Taner



Joined: 09 Jan 2007
Posts: 3533
Location: Antalya, Turkey

PostPosted: Thu Jan 14, 2010 12:17 am    Post subject: Re: Test tournament started: Alex, BikJump, Chesley Reply to topic Reply with quote

Graham Banks wrote:
beachknight wrote:
Notes and Problems:

Plisk 0.1.2 1cpu uses both available cpus, ie ponders.


This only tends to happen if there's a spare cpu available for it to do so? However, I've removed it from my future testing too.


This problem appeared in all three versions I have tested.

1, 2 and 4cpu.

best,
_________________
hi, merhaba, hallo HT
Back to top
View user's profile Send private message Visit poster's website
Harun Taner



Joined: 09 Jan 2007
Posts: 3533
Location: Antalya, Turkey

PostPosted: Thu Jan 14, 2010 6:23 am    Post subject: Re: Test tournament started: Alex, BikJump, Chesley Reply to topic Reply with quote

Code:
    Engine                 Score BiBiKuKuAlAlFiFiChChScJaNuJaZCZCWaWaIfScHeAr    S-B
01: BikJump 2.0 w32        0.0/0 ·                                              0,00
01: BikJump 1.8 w32        0.0/0   ·                                            0,00
01: Kurt 271009 JA w32     0.0/0     ·                                          0,00
01: Kurt 271009 DC         0.0/0       ·                                        0,00
01: Alex 1.8.7 w32         0.0/0         ·                                      0,00
01: Alex 1.9.6 w32         0.0/0           ·                                    0,00
01: FireFly 2.5.4 1cpu     0.0/0             ·                                  0,00
01: FireFly 2.5.4 1cpu w32 0.0/0               ·                                0,00
01: Chesley r268 JA        0.0/0                 ·                              0,00
01: Chesley r268 JA w32    0.0/0                   ·                            0,00
01: Schola 1.1             0.0/0                     ·                          0,00
01: Jabba 1.0 DC           0.0/0                       ·                        0,00
01: Numpty 0.4pr w32       0.0/0                         ·                      0,00
01: Jabba 1.0 w32          0.0/0                           ·                    0,00
01: ZCT 0.3.2500 JA        0.0/0                             ·                  0,00
01: ZCT 0.3.2500 JA w32    0.0/0                               ·                0,00
01: Waxman 2008 w32        0.0/0                                 ·              0,00
01: Waxman 2009 w32        0.0/0                                   ·            0,00
01: Ifrit j2.6b w32        0.0/0                                     ·          0,00
01: Schola 1.1 w32         0.0/0                                       ·        0,00
01: Heracles 0.6.16 w32    0.0/0                                         ·      0,00
01: ArabianKnight 0.88 w32 0.0/0                                           ·    0,00

0 of 231 games played
Name of the tournament: CET2403y
Site/ Country: CET24_Antalya_TUR, Türkiye
Level: Blitz 3/2

_________________
hi, merhaba, hallo HT
Back to top
View user's profile Send private message Visit poster's website
Aart Bik



Joined: 01 Dec 2006
Posts: 561
Location: Mountain View, CA, USA

PostPosted: Thu Jan 14, 2010 7:06 am    Post subject: Re: Test tournament started: Alex, BikJump, Chesley Reply to topic Reply with quote

If still possible, I would recommend using 2.0.1 instead of 2.0. Despite the difference in scores in your previous tests, they are really identical, except for a bug fix (embarrassing: 2.0 sometimes castles while in check).
Back to top
View user's profile Send private message Visit poster's website
Harun Taner



Joined: 09 Jan 2007
Posts: 3533
Location: Antalya, Turkey

PostPosted: Thu Jan 14, 2010 8:02 am    Post subject: Re: Test tournament started: Alex, BikJump, Chesley Reply to topic Reply with quote

beachknight wrote:
Notes and Problems:

Plisk 0.1.2 1cpu uses both available cpus, ie ponders.

AviChess 0.6 & 0.7 not working, even with xboard switch.

Carballo 0.3, Luzhin 0.1, ChessBin 00.61, ArabianKnight 0.48 and
ArabianKnight 0.88 not working. What I am thinking is: a java update
might solve the problem.

to be cont'd


After installing both java updates, one for w32 and one for x64,
ArabianKnight 0.88 seems working well on Arena 2.0.1 (on W7 Ultimate
Pro x64). Luzhin 0.1 moves strangely.

Avi still not working.

All Numpty 0.5pr w32 scores are to be changed to: Numpty 0.4pr w32.

I made an error in duplication process.

Numpty 0.5pr w32 runs today.


Best,
_________________
hi, merhaba, hallo HT
Back to top
View user's profile Send private message Visit poster's website
Harun Taner



Joined: 09 Jan 2007
Posts: 3533
Location: Antalya, Turkey

PostPosted: Thu Jan 14, 2010 8:08 am    Post subject: Re: Test tournament started: Alex, BikJump, Chesley Reply to topic Reply with quote

abik wrote:
If still possible, I would recommend using 2.0.1 instead of 2.0. Despite the difference in scores in your previous tests, they are really identical, except for a bug fix (embarrassing: 2.0 sometimes castles while in check).


Hi Aart,

These preliminary runs are being done for determining the divisions.
No need to panic. In division fights, I'll use BikJump 2.0.1 and
BikJump 2.0.1 w32 or new updates Smile

Best,
_________________
hi, merhaba, hallo HT
Back to top
View user's profile Send private message Visit poster's website
Paul Villanueva



Joined: 17 May 2008
Posts: 85
Location: Bilbao, Spain

PostPosted: Thu Jan 14, 2010 12:57 pm    Post subject: Re: Test tournament started: Alex, BikJump, Chesley Reply to topic Reply with quote

Thank for the tournament.

I´ve got a question. Wich values do you use as reference to calculate engines ELO?
_________________
Download KMT Chess 1.2.1
http://sourceforge.net/projects/kmtchess/
Back to top
View user's profile Send private message
Harun Taner



Joined: 09 Jan 2007
Posts: 3533
Location: Antalya, Turkey

PostPosted: Thu Jan 14, 2010 1:25 pm    Post subject: Re: Test tournament started: Alex, BikJump, Chesley Reply to topic Reply with quote

P. Villanueva wrote:
Thank for the tournament.

I´ve got a question. Wich values do you use as reference to calculate engines ELO?


IMHO, this is a very hot topic. I am following an old tradition in
computer chess testing by fixing Shredder 09.1 w32 (UCI) at 2750.

I'll try to outline what I'll be doing in my future tests. Before
inter-divisions fights begin, I should find a simple way for
reflecting engines ratings. As an enthuaistic tester, I need
to find solutions for all of these below and therefore an
automated process for each new engine would be great!

Procedure:

First of all: Execute a sample of test suites, 1, 2, 3 or more.
Nunn2, STS, WAC etc... comes to mind.

Secondly: Set up two or three tournaments each with eight
opponents, 16 games per tourn.

Thirdly: Determine the division of the engine.
Criteria : Which engines could compete, which not?

Like in the case of Plisk that uses all my precious memory : could not.

Fourth: Tournaments, double round robin or one blitz + one rapid

Fifth: Which engine goes upper? which going down? Some guidelines.

Well, I am tired. Smile

Best,
_________________
hi, merhaba, hallo HT
Back to top
View user's profile Send private message Visit poster's website
Harun Taner



Joined: 09 Jan 2007
Posts: 3533
Location: Antalya, Turkey

PostPosted: Thu Jan 14, 2010 3:31 pm    Post subject: Re: Test tournament started: Alex, BikJump, Chesley Reply to topic Reply with quote

Code:
    Engine                 Score BiJaFiWaWaBiZCJaZCKuScFiAlKuChAlHeArIfScChNu    S-B
01: BikJump 2.0 w32        5.0/6 ·     = 1                       1 = 1 1       10,00
02: Jabba 1.0 DC           4.5/5   ·               1 = 1 1   1                 10,25
03: FireFly 2.5.4 1cpu w32 4.5/5     ·       1       = 1     1             1    9,25
04: Waxman 2008 w32        4.0/6 =     ·   0               =   1 1   1          8,00
05: Waxman 2009 w32        4.0/6 0       ·       1 =     =         1   1        7,25
06: BikJump 1.8 w32        4.0/5       1   · 0                   1   1     1    6,50
07: ZCT 0.3.2500 JA        3.5/5     0     1 ·             1   1 =              8,75
08: Jabba 1.0 w32          3.5/5               ·   0   = 1   1     1            6,25
09: ZCT 0.3.2500 JA w32    3.0/6         0       · 1   0 =         1   =        5,00
10: Kurt 271009 JA w32     2.5/5   0     =     1 0 ·                   1        6,50
10: Schola 1.1             2.5/5   = =               ·     =   0         1      6,50
12: FireFly 2.5.4 1cpu     2.5/5   0 0         = 1     ·                 1      5,75
13: Alex 1.8.7 w32         2.0/5   0     =     0 =       ·               1      4,50
14: Kurt 271009 DC         2.0/5       =     0       =     ·         0     1    3,25
15: Chesley r268 JA        2.0/5   0 0         0             · 1         1      3,00
16: Alex 1.9.6 w32         2.0/5       0     0       1       0 ·           1    2,50
17: Heracles 0.6.16 w32    1.5/5 0     0   0 =                   ·   1          2,75
18: ArabianKnight 0.88 w32 1.0/5 =       0     0 0                 ·   =        3,00
19: Ifrit j2.6b w32        1.0/5 0     0   0               1     0   ·          2,00
19: Schola 1.1 w32         1.0/5 0       0       = 0               =   ·        2,00
21: Chesley r268 JA w32    1.0/5                     0 0 0   0           · 1    0,00
22: Numpty 0.5pr w32       0.0/5     0     0               0   0         0 ·    0,00

57 of 231 games played
Name of the tournament: CET2403y
Site/ Country: CET24_Antalya_TUR, Türkiye
Level: Blitz 3/2


Schola 1.1 >>>>

KMT 1.2.1 DC <<<<
_________________
hi, merhaba, hallo HT
Back to top
View user's profile Send private message Visit poster's website
Harun Taner



Joined: 09 Jan 2007
Posts: 3533
Location: Antalya, Turkey

PostPosted: Thu Jan 14, 2010 11:36 pm    Post subject: Re: Test tournament started: Alex, BikJump, Chesley Reply to topic Reply with quote

Code:
    Engine                 Score BiWaJaJaZCFiWaAlFiKMBiKuZCAlChHeScChKuIfArNu    S-B
01: BikJump 1.8 w32        9.0/12 · 0 0 1 0   1           1   1 1 1     1 1 1   32,50
02: Waxman 2009 w32        8.0/10 1 · 1         =     0 = 1 1     1   1   1     37,75
03: Jabba 1.0 w32          7.5/12 1 0 ·     =   1 =     0   0 1   = 1 1   1     32,50
04: Jabba 1.0 DC           7.5/11 0     ·   1   1 1     1   0 1     0 1   = 1   32,25
05: ZCT 0.3.2500 JA        7.0/12 1       · 0 0 0 = 0   1   1 1 =     1 1       32,00
06: FireFly 2.5.4 1cpu w32 6.5/9      = 0 1 ·   = 1     = 1   1             1   33,00
07: Waxman 2008 w32        6.5/11 0       1   · 0 = 0 = 1   1   1     = 1       29,75
08: Alex 1.8.7 w32         6.5/11   = 0 0 1 = 1 ·         = 0       1   1   1   27,50
09: FireFly 2.5.4 1cpu     6.5/10     = 0 = 0 =   ·       1 1       1 1     1   24,00
09: KMT 1.2.1 DC           6.5/7          1   1     · =         1   1   1   1   24,00
11: BikJump 2.0 w32        6.0/8    1         =     = ·   =     1 1     1 =     25,50
12: Kurt 271009 JA w32     6.0/12   = 1 0 0 = 0         · 0     0 1 1   1   1   20,75
13: ZCT 0.3.2500 JA w32    5.5/11 0 0       0   = 0   = 1 · 1     =   1   1     20,75
14: Alex 1.9.6 w32         4.0/10   0 1 1 0   0 1 0       0 · 0             1   21,50
15: Chesley r268 JA        4.0/9  0   0 0 0 0               1 ·     1 1     1    8,00
16: Heracles 0.6.16 w32    3.5/8  0       =   0     0 0 1       ·       1   1   11,50
17: Schola 1.1 w32         2.0/8  0 0 =               0 0 =       ·   =   =      8,25
18: Chesley r268 JA w32    2.0/8      0 1       0 0 0   0     0     ·       1    7,50
19: Kurt 271009 DC         2.0/11   0 0 0 0   =   0       0   0   =   · 0   1    4,25
20: Ifrit j2.6b w32        2.0/10 0       0   0 0   0 0 0       0     1 ·   1    2,00
21: ArabianKnight 0.88 w32 1.5/7  0 0 0 =             =   0       =       ·      7,75
22: Numpty 0.5pr w32       0.0/13 0     0   0   0 0 0   0   0 0 0   0 0 0   ·    0,00

110 of 231 games played
Name of the tournament: CET2403y
Site/ Country: CET24_Antalya_TUR, Türkiye
Level: Blitz 3/2

_________________
hi, merhaba, hallo HT
Back to top
View user's profile Send private message Visit poster's website
Harun Taner



Joined: 09 Jan 2007
Posts: 3533
Location: Antalya, Turkey

PostPosted: Fri Jan 15, 2010 7:00 am    Post subject: Re: Test tournament started: Alex, BikJump, Chesley Reply to topic Reply with quote

Code:
    Engine                 Score  BiBiWaKMZCFiJaFiWaJaAlAlKuScZCHeChKuArChIfNu    S-B
01: BikJump 2.0 w32        12.5/15 ·   1 = =   1 1 = 1       1 = 1 1   = 1 1 1   82,50
02: BikJump 1.8 w32        12.5/16   · 0 = 0 1 0   1 1   1 1 1 1 1 1   1   1 1   78,00
03: Waxman 2009 w32        11.5/14 0 1 · 1   = 1     1 1 = = 1 1   1 1 1         87,00
04: KMT 1.2.1 DC           11.0/14 = = 0 · 1     0 1   1     1   1   1 1 1 1 1   65,50
05: ZCT 0.3.2500 JA        9.5/15  = 1   0 · =   0 0   1 0 1     = 1 1   1 1 1   58,00
06: FireFly 2.5.4 1cpu     9.5/15    0 =   = · = 0 = 0 1     = 1   1 1 1 1   1   53,75
07: Jabba 1.0 w32          9.0/15  0 1 0     = · =   = 0 1 0 = 1   1 1 1 1       59,75
07: FireFly 2.5.4 1cpu w32 9.0/15  0     1 1 1 = · 0 0   = =   1 = 1     0 1 1   59,75
09: Waxman 2008 w32        9.0/14  = 0   0 1 =   1 ·   1 0 1     1   =   = 1 1   57,25
10: Jabba 1.0 DC           8.5/16  0 0 0     1 = 1   · 0 1 1 0 =   1 1 = 0   1   52,25
11: Alex 1.9.6 w32         8.0/15      0 0 0 0 1   0 1 · 1 1   0 1 0     1 1 1   44,50
12: Alex 1.8.7 w32         7.5/15    0 =   1   0 = 1 0 0 ·   0 =     = = 1 1 1   42,00
13: Kurt 271009 JA w32     7.0/16    0 =   0   1 = 0 0 0   · 1 0 0   0 1 1 1 1   35,75
14: Schola 1.1 w32         6.5/14  0 0 0 0   = =     1   1 0 · = 1 1 = =         44,00
15: ZCT 0.3.2500 JA w32    6.0/14  = 0 0     0 0 0   = 1 = 1 = ·   0 1 1         40,00
16: Heracles 0.6.16 w32    6.0/14  0 0   0 =     = 0   0   1 0   ·   = = 1 1 1   26,50
17: Chesley r268 JA        6.0/15  0 0 0   0 0 0 0   0 1     0 1   · 1 1 1   1   25,00
18: Kurt 271009 DC         4.0/15      0 0 0 0 0   = 0   = 1 = 0 = 0 ·     0 1   21,50
19: ArabianKnight 0.88 w32 3.5/14  = 0 0 0   0 0     =   = 0 = 0 = 0   ·   1     23,50
20: Chesley r268 JA w32    3.5/15  0     0 0 0 0 1 = 1 0 0 0     0 0     · 0 1   22,00
21: Ifrit j2.6b w32        3.0/14  0 0   0 0     0 0   0 0 0     0   1 0 1 · 1    7,50
22: Numpty 0.5pr w32       0.0/16  0 0   0 0 0   0 0 0 0 0 0     0 0 0   0 0 ·    0,00

163 of 231 games played
Name of the tournament: CET2403y
Site/ Country: CET24_Antalya_TUR, Türkiye
Level: Blitz 3/2


Numpty 0.5pr w32 >>>>>
_________________
hi, merhaba, hallo HT
Back to top
View user's profile Send private message Visit poster's website
Display posts from previous:   
Post new topic       TalkChess.com Forum Index -> Computer Chess Club: Tournaments and Matches All times are GMT
Goto page Previous  1, 2, 3  Next
Threaded
Page 2 of 3

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum




Powered by phpBB © 2001, 2005 phpBB Group
Enhanced with Moby Threads