Larsson endings test - strong engines

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

Marc MP

Re: Larsson endings test - strong engines

Post by Marc MP »

I rated the tournament up to now and done a comparison with CCRL 40/4 single cpu engine list (offset = 2897): http://computerchess.org.uk/ccrl/404/cg ... ons_only=1.

Code: Select all

Rank Name                 Elo    +    - games score oppo. draws CCRL DIFF
   1 Rybka 2.3.2a/64     2955   31   31   225   61%  2889   53% 3067 -112
   2 Zap!Chess Zanzibar  2926   32   31   225   55%  2893   47% 2848  78
   3 HIARCS 11.1 UCI     2905   31   31   226   51%  2896   49% 2915 -10
   4 Shredder 10.1 UCI   2900   31   31   225   50%  2897   52% 2853  47
   5 Fritz 10            2899   31   31   226   50%  2896   56% 2883  16
   6 Loop M1-P           2882   31   31   225   47%  2899   52% 2906 -24
   7 Toga II 1.3x4/32    2868   31   31   226   45%  2901   50% 2871 -03
   8 Junior 10.1         2843   31   31   226   40%  2905   52% 2835  08
User avatar
Rubinus
Posts: 1211
Joined: Thu Jan 18, 2007 4:05 pm
Location: Prague
Full name: Pavel Háse

Re: Larsson endings test - strong engines

Post by Rubinus »

Larsson Endings test

Position Nr. 17:
[d]8/6b1/4k2p/p1p1p1p1/2P1K1P1/PP3N1P/8/8 w - - 1 2

Code: Select all

                        1  2  3  4  5  6  7  8  
1   Shredder 10.1 UCI   ** 01 0˝ 1˝ 1˝ ˝1 ˝1 ˝1   9.0/14
2   Toga II 1.3x4/32    10 ** ˝1 0˝ 0˝ ˝1 1˝ ˝˝   7.5/14  51.75
3   Loop M1-P           1˝ ˝0 ** 01 ˝˝ 10 01 ˝1   7.5/14  51.25
4   Rybka 2.3.2a/64     0˝ 1˝ 10 ** ˝˝ ˝˝ ˝˝ 1˝   7.5/14  49.75
5   Zap!Chess Zanzibar  0˝ 1˝ ˝˝ ˝˝ ** ˝˝ ˝0 1˝   7.0/14  47.00
6   Fritz 10            ˝0 ˝0 01 ˝˝ ˝˝ ** 1˝ ˝1   7.0/14  46.00
7   HIARCS 11.1 UCI     ˝0 0˝ 10 ˝˝ ˝1 0˝ ** 1˝   6.5/14
8   Junior 10.1         ˝0 ˝˝ ˝0 0˝ 0˝ ˝0 0˝ **   4.0/14

Current standings (17/20)
                            1         2         3         4         5         6         7         8
1   Rybka 2.3.2a/64     ********* 17.5:16.5 18.5:15.5 19.5:14.5 20.5:13.5 21.5:12.5 23.0:11.0 24.0:10.0  144.5/238
2   Zap!Chess Zanzibar  16.5:17.5 ********* 19.0:15.0 17.5:16.5 18.0:16.0 19.0:15.0 20.5:13.5 20.5:13.5  131.0/238
3   Shredder 10.1 UCI   15.5:18.5 15.0:19.0 ********* 18.5:15.5 16.5:17.5 18.0:16.0 18.0:16.0 20.5:13.5  122.0/238
4   HIARCS 11.1 UCI     14.5:19.5 16.5:17.5 15.5:18.5 ********* 18.0:16.0 16.5:17.5 19.5:14.5 20.5:13.5  121.0/238
5   Fritz 10            13.5:20.5 16.0:18.0 17.5:16.5 16.0:18.0 ********* 17.5:16.5 18.0:16.0 21.5:12.5  120.0/238
6   Loop M1-P           12.5:21.5 15.0:19.0 16.0:18.0 17.5:16.5 16.5:17.5 ********* 17.0:17.0 18.0:16.0  112.5/238
7   Toga II 1.3x4/32    11.0:23.0 13.5:20.5 16.0:18.0 14.5:19.5 16.0:18.0 17.0:17.0 ********* 20.0:14.0  108.0/238
8   Junior 10.1         10.0:24.0 13.5:20.5 13.5:20.5 13.5:20.5 12.5:21.5 16.0:18.0 14.0:20.0 *********   93.0/238
AMD Athlon64 3200+, 256MB hash, 15m+10s, GUI Fritz 10 (* ->Z.Z. only 32bit ...), 5TB+EGBB, 4Shrederbase.

download games here.
User avatar
Rubinus
Posts: 1211
Joined: Thu Jan 18, 2007 4:05 pm
Location: Prague
Full name: Pavel Háse

Re: Larsson endings test - strong engines

Post by Rubinus »

Larsson Endings test

Position Nr. 18:
[d]2r3k1/4pp1p/3p2p1/p2R4/1r6/1P4P1/P3PP1P/R5K1 b - - 1 1

Code: Select all

                        1  2  3  4  5  6  7  8  
1   Rybka 2.3.2a/64     ** ˝˝ ˝˝ ˝1 ˝˝ ˝˝ ˝1 ˝˝   8.0/14  55.00
2   Shredder 10.1 UCI   ˝˝ ** ˝˝ ˝1 ˝˝ ˝˝ ˝˝ 1˝   8.0/14  54.50
3   Toga II 1.3x4/32    ˝˝ ˝˝ ** ˝˝ ˝˝ 1˝ ˝˝ ˝˝   7.5/14  51.75
4   HIARCS 11.1 UCI     ˝0 ˝0 ˝˝ ** 1˝ 01 ˝1 ˝1   7.5/14  49.75
5   Fritz 10            ˝˝ ˝˝ ˝˝ 0˝ ** 1˝ ˝0 ˝˝   6.5/14  45.75
6   Loop M1-P           ˝˝ ˝˝ 0˝ 10 0˝ ** ˝˝ ˝1   6.5/14  45.25
7   Junior 10.1         ˝0 ˝˝ ˝˝ ˝0 ˝1 ˝˝ ** ˝˝   6.5/14  45.00
8   Zap!Chess Zanzibar  ˝˝ 0˝ ˝˝ ˝0 ˝˝ ˝0 ˝˝ **   5.5/14

Current standings (18/20)
                            1         2         3         4         5         6         7         8
1   Rybka 2.3.2a/64     ********* 18.5:17.5 19.5:16.5 21.0:15.0 21.5:14.5 22.5:13.5 24.0:12.0 25.5:10.5  152.5/252
2   Zap!Chess Zanzibar  17.5:18.5 ********* 19.5:16.5 18.0:18.0 19.0:17.0 19.5:16.5 21.5:14.5 21.5:14.5  136.5/252
3   Shredder 10.1 UCI   16.5:19.5 16.5:19.5 ********* 20.0:16.0 17.5:18.5 19.0:17.0 19.0:17.0 21.5:14.5  130.0/252
4   HIARCS 11.1 UCI     15.0:21.0 18.0:18.0 16.0:20.0 ********* 19.5:16.5 17.5:18.5 20.5:15.5 22.0:14.0  128.5/252
5   Fritz 10            14.5:21.5 17.0:19.0 18.5:17.5 16.5:19.5 ********* 19.0:17.0 19.0:17.0 22.0:14.0  126.5/252
6   Loop M1-P           13.5:22.5 16.5:19.5 17.0:19.0 18.5:17.5 17.0:19.0 ********* 17.5:18.5 19.0:17.0  119.0/252
7   Toga II 1.3x4/32    12.0:24.0 14.5:21.5 17.0:19.0 15.5:20.5 17.0:19.0 18.5:17.5 ********* 21.0:15.0  115.5/252
8   Junior 10.1         10.5:25.5 14.5:21.5 14.5:21.5 14.0:22.0 14.0:22.0 17.0:19.0 15.0:21.0 *********   99.5/252
AMD Athlon64 3200+, 256MB hash, 15m+10s, GUI Fritz 10 (* ->Z.Z. only 32bit ...), 5TB+EGBB, 4Shrederbase.

download games here.
PauloSoare
Posts: 1335
Joined: Thu Mar 09, 2006 5:30 am
Location: Cabo Frio, Brasil

Re: Larsson endings test - strong engines

Post by PauloSoare »

Pavel, great work !
Based in test suites and in positions that I like,
I have the following reference:
1- Rybka 2.3.2a
2- Shredder 10
3- Fritz 10
4- Hiarcs 11.1

I don´t have Zap and Junior. Toga and Loop are
wrong in my tests, they are inferior to the new
Glaurung-W32.
My computer is mp, then I run the tests with 1 core.

Paulo Soares
User avatar
Rubinus
Posts: 1211
Joined: Thu Jan 18, 2007 4:05 pm
Location: Prague
Full name: Pavel Háse

Re: Larsson endings test - strong engines

Post by Rubinus »

Larsson Endings test

Position Nr. 19:
[d]3r4/7p/Rp4k1/5p2/4p3/2P5/PP3P1P/5K2 b - - 1 1

Code: Select all

                        1  2  3  4  5  6  7  8  
1   Shredder 10.1 UCI   ** ˝˝ ˝1 1˝ ˝˝ ˝˝ 1˝ ˝˝   8.5/14
2   HIARCS 11.1 UCI     ˝˝ ** ˝˝ ˝˝ 1˝ ˝˝ ˝˝ ˝1   8.0/14  54.25
3   Rybka 2.3.2a/64     ˝0 ˝˝ ** ˝˝ 1˝ ˝˝ ˝1 ˝1   8.0/14  53.00
4   Toga II 1.3x4/32    0˝ ˝˝ ˝˝ ** 10 ˝˝ ˝˝ 1˝   7.0/14
5   Zap!Chess Zanzibar  ˝˝ 0˝ 0˝ 01 ** 1˝ 0˝ 1˝   6.5/14
6   Fritz 10            ˝˝ ˝˝ ˝˝ ˝˝ 0˝ ** ˝˝ ˝0   6.0/14  43.75
7   Junior 10.1         0˝ ˝˝ ˝0 ˝˝ 1˝ ˝˝ ** 0˝   6.0/14  42.00
8   Loop M1-P           ˝˝ ˝0 ˝0 0˝ 0˝ ˝1 1˝ **   6.0/14  41.25

Current standings (19/20)
                            1         2         3         4         5         6         7         8
1   Rybka 2.3.2a/64     ********* 20.0:18.0 20.0:18.0 22.0:16.0 22.5:15.5 24.0:14.0 25.0:13.0 27.0:11.0  160.5/266
2   Zap!Chess Zanzibar  18.0:20.0 ********* 20.5:17.5 18.5:19.5 20.5:17.5 21.0:17.0 22.5:15.5 22.0:16.0  143.0/266
3   Shredder 10.1 UCI   18.0:20.0 17.5:20.5 ********* 21.0:17.0 18.5:19.5 20.0:18.0 20.5:17.5 23.0:15.0  138.5/266
4   HIARCS 11.1 UCI     16.0:22.0 19.5:18.5 17.0:21.0 ********* 20.5:17.5 19.0:19.0 21.5:16.5 23.0:15.0  136.5/266
5   Fritz 10            15.5:22.5 17.5:20.5 19.5:18.5 17.5:20.5 ********* 19.5:18.5 20.0:18.0 23.0:15.0  132.5/266
6   Loop M1-P           14.0:24.0 17.0:21.0 18.0:20.0 19.0:19.0 18.5:19.5 ********* 18.0:20.0 20.5:17.5  125.0/266
7   Toga II 1.3x4/32    13.0:25.0 15.5:22.5 17.5:20.5 16.5:21.5 18.0:20.0 20.0:18.0 ********* 22.0:16.0  122.5/266
8   Junior 10.1         11.0:27.0 16.0:22.0 15.0:23.0 15.0:23.0 15.0:23.0 17.5:20.5 16.0:22.0 *********  105.5/266
AMD Athlon64 3200+, 256MB hash, 15m+10s, GUI Fritz 10 (* ->Z.Z. only 32bit ...), 5TB+EGBB, 4Shrederbase.

download games here.
Last edited by Rubinus on Sat Jul 21, 2007 7:17 pm, edited 1 time in total.
User avatar
Rubinus
Posts: 1211
Joined: Thu Jan 18, 2007 4:05 pm
Location: Prague
Full name: Pavel Háse

Re: Larsson endings test - strong engines

Post by Rubinus »

Hi, Pablo
Probably, Shredder advantage is 5men shredderbase.
My choice
a) 256MB hash + cca 1MB shredderbase 34men
b) 128MB hash + cca 125MB shredderbase 345men.
At time have advantage RAM extra, e.g. CSS
Best wishes Pavel Háse
User avatar
Rubinus
Posts: 1211
Joined: Thu Jan 18, 2007 4:05 pm
Location: Prague
Full name: Pavel Háse

Re: Larsson endings test - strong engines

Post by Rubinus »

Larsson Endings test

Position Nr. 20:
[d]4b3/pp2kp1p/5bp1/8/8/4P3/PP2NPPP/3N2K1 w - - 1 2

Code: Select all

                        1  2  3  4  5  6  7  8  
1   Rybka 2.3.2a/64     ** 1˝ 11 ˝1 11 ˝˝ 1˝ 1˝  11.0/14
2   Toga II 1.3x4/32    0˝ ** ˝˝ 1˝ ˝˝ ˝1 1˝ 1˝   8.5/14
3   HIARCS 11.1 UCI     00 ˝˝ ** ˝˝ 1˝ 1˝ ˝1 01   7.5/14  46.25
4   Shredder 10.1 UCI   ˝0 0˝ ˝˝ ** ˝˝ ˝˝ ˝1 11   7.5/14  45.50
5   Loop M1-P           00 ˝˝ 0˝ ˝˝ ** ˝1 ˝˝ 1˝   6.5/14
6   Junior 10.1         ˝˝ ˝0 0˝ ˝˝ ˝0 ** ˝˝ ˝˝   5.5/14  39.25
7   Zap!Chess Zanzibar  0˝ 0˝ ˝0 ˝0 ˝˝ ˝˝ ** ˝1   5.5/14  35.25
8   Fritz 10            0˝ 0˝ 10 00 0˝ ˝˝ ˝0 **   4.0/14

Standings
                            1         2         3         4         5         6         7         8
1   Rybka 2.3.2a/64     ********* 21.5:18.5 21.5:18.5 24.0:16.0 24.0:16.0 26.0:14.0 26.5:13.5 28.0:12.0  171.5/280
2   Zap!Chess Zanzibar  18.5:21.5 ********* 21.0:19.0 19.0:21.0 22.0:18.0 22.0:18.0 23.0:17.0 23.0:17.0  148.5/280
3   Shredder 10.1 UCI   18.5:21.5 19.0:21.0 ********* 22.0:18.0 20.5:19.5 21.0:19.0 21.0:19.0 24.0:16.0  146.0/280
4   HIARCS 11.1 UCI     16.0:24.0 21.0:19.0 18.0:22.0 ********* 21.5:18.5 20.5:19.5 22.5:17.5 24.5:15.5  144.0/280
5   Fritz 10            16.0:24.0 18.0:22.0 19.5:20.5 18.5:21.5 ********* 20.0:20.0 20.5:19.5 24.0:16.0  136.5/280
6   Loop M1-P           14.0:26.0 18.0:22.0 19.0:21.0 19.5:20.5 20.0:20.0 ********* 19.0:21.0 22.0:18.0  131.5/280
7   Toga II 1.3x4/32    13.5:26.5 17.0:23.0 19.0:21.0 17.5:22.5 19.5:20.5 21.0:19.0 ********* 23.5:16.5  131.0/280
8   Junior 10.1         12.0:28.0 17.0:23.0 16.0:24.0 15.5:24.5 16.0:24.0 18.0:22.0 16.5:23.5 *********  111.0/280
AMD Athlon64 3200+, 256MB hash, 15m+10s, GUI Fritz 10 (* ->Z.Z. only 32bit ...), 5TB+EGBB, 4Shrederbase.

download games here.
User avatar
Rubinus
Posts: 1211
Joined: Thu Jan 18, 2007 4:05 pm
Location: Prague
Full name: Pavel Háse

Re: Larsson endings test - strong engines

Post by Rubinus »

Complement:
a) Shredder 64bit only Deep variant. Deep Shredder 10.1x64 increase speed cca 8% from Deep Shredder (I not legal user Deep version, 100 euros dear ..., if Rybka MP 59, Loop and Zap!chess 50, etc., so far not have multiCPU machine).
b) Loop M1-P for my computer AMD 3200+ very little speedly, than M1-T, max. 1%.
c) Zap!chess 64bit increase speed cca 35-40%, but GUI Fritz 10 not support 64bit CB engine :roll: .
d) Toga II 1.3x4 probably less than 1.2.1a (in endings, my sense).
ernest
Posts: 2053
Joined: Wed Mar 08, 2006 8:30 pm

Re: Larsson endings test - strong engines

Post by ernest »

Rubinus wrote:Complement:
d) Toga II 1.3x4 probably less than 1.2.1a (in endings, my sense).
Are you using Bitbases with Toga II 1.3x4 ?
(I know there is a bug there, but how important I don't know...)
User avatar
Rubinus
Posts: 1211
Joined: Thu Jan 18, 2007 4:05 pm
Location: Prague
Full name: Pavel Háse

Re: Larsson endings test - strong engines

Post by Rubinus »

ernest wrote:
Rubinus wrote:Complement:
d) Toga II 1.3x4 probably less than 1.2.1a (in endings, my sense).
Are you using Bitbases with Toga II 1.3x4 ?
(I know there is a bug there, but how important I don't know...)
Yes, EGBB 3-5men in WBEC

My edit UCI file for Fritz10 (C:\Documents ...\user\Application Data\Chessbase\Engines.UCI\Toga II 1.3x4.uci):

[ENGINE]
Name=Toga II 1.3x4
Author=Thomas Gaksch and Fabien Letouzey
Filename=C:\Chess\UCI_WB_Engine\toga\TogaII.exe
[OPTIONS]
BookFile=toga-ph-book.bin
Bitbases Path=c:\chess\egbb\
Bitbases Cache Size=8


For Arena? I don't know :evil: - probably edit arenaENG.cfg file. Compilation by Bryan Hofman probably bug (bad egbb.dll?) - try DOS Prompt.