Houdini 1.03a tests

[beachknight]

Thanks Harun.
I have been testing for one of the comm. companies. After
180 games at 5/3 TC. Houdini is clearly the leader.
15 games ahead of Rybka 4 in head to head testing.

Best,
Gerold.

P.S. I have run tests with just about all the Ivanhoe versions.
A couple was within 20elo of Houdini. Waiting for a stronger
version of Ivanhoe before testing anymore of them.

Hi Gerold, my experience summarized:

approx. 20 FireBird versions and 55 IvanHoe versions.

Well, Crafty is the sole leader of all times, around 200 versions.



Best,

[beachknight]

Final Standings:

Code: Select all

   Engine               Score    Ho   Ig   Fi   Iv   Ry   St    S-B
1: Houdini 1.03ai 4cpu  12.0/20 ···· 1011 0101 =1== ==== 1===  115,75
2: Igorrit 0.086v9      10.5/20 0100 ···· ==== 0=== 11== 1==1  100,25
3: FireBird 1.3.1i 4cpu 10.0/20 1010 ==== ···· ===1 ==10 ===0  100,25
4: IvanHoe 9.63 24      9.5/20  =0== 1=== ===0 ···· =0== ===1   95,25
5: Rybka 4.0i 4cpu      9.0/20  ==== 00== ==01 =1== ···· =001   91,75
6: Stockfish 1.8.0      9.0/20  0=== 0==0 ===1 ===0 =110 ····   90,25

60 games played / Tournament finished
Name of the tournament: CET2793a
Site/ Country: CET_Antalya_TUR, Türkiye
Level: Blitz 2/2

[beachknight]

Code: Select all

CET2793a CET_Antalya_TUR  2010

                                      1    2    3    4    5    6    
1   Houdini 1.03ai 4cpu   3400   -23  **** 1011 0101 ½1½½ ½½½½ 1½½½  12.0/20
2   Igorrit 0.086v9       3328    +9  0100 **** ½½½½ 0½½½ 11½½ 1½½1  10.5/20
3   FireBird 1.3.1i 4cpu  3300   +25  1010 ½½½½ **** ½½½1 ½½10 ½½½0  10.0/20
4   IvanHoe 9.63 24       3300    +8  ½0½½ 1½½½ ½½½0 **** ½0½½ ½½½1   9.5/20
5   Rybka 4.0i 4cpu       3300    -9  ½½½½ 00½½ ½½01 ½1½½ **** ½001   9.0/20  91.75
6   Stockfish 1.8.0       3300    -9  0½½½ 0½½0 ½½½1 ½½½0 ½110 ****   9.0/20  90.25

[ernest]

Houdini 1.03ai 4cpu

What does the i mean in 1.03ai ?

[Tomcass]

TESTING HOUDINI 1.03a – GAMES IN 10 MINUTES
Global: 720 games(about 240 hours testing).
1st. leg: 240 games (about 80 hours, 40 each computer).


TEST 1
Quad 2.33
Gui: Fritz 12
Ponder: Off
No Triple or Robbo Bases
Book: HS Masterbook 2
Time Control: 10 min+ 0 sec.
4 cores
120 games


2010-07Houdini1.03a3 2010

1 2 3 4
1 Deep Rybka 4 w32 9.0 - 11.0 11.0 - 9.0 11.0 - 9.0 31.0/60
2 Ivanhoe-B57d_whm08_w32(x4) 11.0 - 9.0 9.0 - 11.0 10.5 - 9.5 30.5/60
3 IvanHoe 55mU-x32Vlad0(x4) 9.0 - 11.0 11.0 - 9.0 9.5 - 10.5 29.5/60
4 Houdini 1.03a w32 4_CPU 9.0 - 11.0 9.5 - 10.5 10.5 - 9.5 29.0/60



TEST 2.

i7 975
Gui: Fritz 12
Ponder: Off
No Triple or Robbo Bases
Book: HS Masterbook 2
Time Control: 10 min+ 0 sec.
4 cores and 8 threads
120 games
201007Houdini1.03a-10min(1)-1 2010

1 2 3 4
1 Deep Rybka 4 x64 12.0 - 8.0 10.0 - 10.0 11.0 - 9.0 33.0/60
2 Houdini 1.03a x64 8_CPU 8.0 - 12.0 11.5 - 8.5 11.0 - 9.0 30.5/60
3 Ivanhoe-B57d_whm08_w64 10.0 - 10.0 8.5 - 11.5 10.5 - 9.5 29.0/60
4 IvanHoe 55mU-x64Vlad0 9.0 - 11.0 9.0 - 11.0 9.5 - 10.5 27.5/60

GLOBAL SCORE AFTER 240 GAMES.

1 2 3 4
1 Deep Rybka 4 23.0 -17.0 19.0 -21.0 22.0 -18.0 64.0/120
2 Houdini 1.03a 17.0 -23.0 21.0 -19,0 21.5 -18,5 59.5/120
3 Ivanhoe-B57d_whm08 21.0 -19.0 19,0 -21,0 19.5 - 20.5 59,5/120
4 IvanHoe 55mU-Vlad0 18.0 -22.0 18,5 -21.5 20.5 - 19.5 57.0/120



COMMENTS

In my slower quad things have gone very even, with a minimal advantage for DR4. The two Ivans performed very well in this environment. However in my i7 the 10 minutes game allowed DR4 to a confortable advantage. In this faster environment Houdini performed better than two Ivans.

Whilst I do not expect DR4 to maintain its leadership in the slower w32 environment in legs 2 and 3, it seems to me very difficult that it loses its advantage both in i7 w64 and globally. Let’s see!.

Regards,

Tom.

[Tomcass]

FINAL RESULTS

TESTING HOUDINI 1.03a – GAMES IN 10 MINUTES

Global: 720 games(3 legs x 240 games each).

3rd. leg: 240 games.

TEST 1-Leg3-w32

Quad 2.33
Gui: Fritz 12
Ponder: Off
No Triple or Robbo Bases
Book: HS Masterbook 2.0
Time Control: 10 min+ 0 sec.
4 cores
120 games

1 Deep Rybka 4 x64 9.5 - 10.5 11.5 - 8.5 11.0 - 9.0 32.0/60
2 Houdini 1.03a x64 10.5 - 9.5 9.5 - 10.5 10.5 - 9.5 30.5/60
3 Ivanhoe-B57d_whm08 8.5 - 11.5 10.5-9.5 11.5 - 8.5 30.5/60
4 IvanHoe 55mU-x64Vlad0 9.0 - 11.0 9.5-10.5 8.5-11.5 27.0/60




CUMULATIVE RESULTS TEST 1 (w32) AFTER 360 GAMES.

1 Deep Rybka 4 w32 30,5-29.5 33.0-27.0 31.5-28.5 95.0/180 52,78%
2 IvanHoe 55mU-x32Vlad0 29.5-30.5 29.5-30.5 33.5-26.5 92.5/180 51.39%
3 Houdini 1.03a w32 27.0-33.0 30.5-29.5 30.0-30.0 87,5/180 48.61%
4 Ivanhoe-B57d_whm08 28.5-31.5 26.5-33.5 30.0-30.0 85.0/180 47.22%





TEST 2.- Leg3.-w64

I7 975
Gui: Fritz 12
Ponder: Off
No Triple or Robbo Bases
Book: HS Masterbook 2
Time Control: 10 min+ 0 sec.
4 cores and 8 threads
120 games

1 Deep Rybka 4 x64 9.5 - 10.5 11.5 - 8.5 11.0 - 9.0 32.0/60
2 Houdini 1.03a x64 10.5 - 9.5 9.5 - 10.5 10.5 - 9.5 30.5/60
3 Ivanhoe-B57d_whm08 8.5 - 11.5 10.5-9.5 11.5 - 8.5 30.5/60
4 IvanHoe 55mU-x64Vlad0 9.0 - 11.0 9.5-10.5 8.5-11.5 27.0/60


CUMULATIVE RESULTS TEST 2 (w64) AFTER 360 GAMES.

1 Deep Rybka 4 x64 32.0–28.0 32.0-28.0 34.5-25.5 98.5/180 54.72%
2 Houdini 1.03a x64 28.0-32.0 30.5-29.5 31.5-28.5 90.0/180 50,00%
3 Ivanhoe-B57d_whm08 28.0-32.0 29.5-30.5 31.5-28.5 89.0/180 49,44%
4 IvanHoe 55mU-x64 25.5-34.6 28.5-31.5 28.5-31.5 82.5/180 45,83%




GLOBAL SCORE AFTER 720 GAMES TIME CONTROL 10' 0.

1 Deep Rybka 4 65.0-55.0 65.0-55.0 63.5-56.5 193.5/360 53,75%
2 Houdini 1.03a 55.0-65.0 62.0-58.0 60.5-59.5 177.5/360 49.31%
3 IvanHoe 55mU-Vlad0 55.0-65.0 58.0-62.0 62.0-58.0 175.0/360 48.61%
4 Ivanhoe-B57d_whm08 56.5-63.5 59.5.-60.5 58.0-62.0 174.0/360 48.33%


PREVIOUS TEST SUMMARY. 480 GAMES. SAME GUI AND BOOKs. TIME CONTROL 5’ 0.

Houdini 1.03a 81,0-79,0 86,5-73,5 167,5/320 52.34%
Ivanhoe-B 57d_whm 79,0-81,0 79,5-80,5 158,5/320 49,53%
Deep Rybka4 73,5-86,5 80,5-79,5 154,0/320 48.13%


COMMENTS

After more than 300 hours testing and 1.200 games overall, this is my brief summary:

Whilst in my first test at 5’ 0 Houdini 1.3a was clearly stronger than Deep Rybka 4, with a win of 86,5-73,5 in its bilateral match, doubling the time control to 10’ 0 totally changed the landscape, with a very comfortable win for Deep Rybka 4. DR4 got a very convincing 65.0-55.0 against Houdini 1.3a. All Ivans (Bill’s, Vlad0’s and Ahmed’s) performed very well, but below the two leaders.

The inflection point where the weighted average strength of Houdini 1.3a and Deep Rybka 4 is roughly even in my computers, under the mentioned conditions, will be found at a time control around 7’ 0.

Regards from Barcelona,

Tom.

[beachknight]

Houdini 1.03ai 4cpu

What does the i mean in 1.03ai ?

Hi Ernest,

i : inert in Thinker,

ie Thinker 5.4Di 4cpu means ChessTinker 5.4D x64 mp inert version with 4 threads

i : i7 special popc enabled compile, in Rybka, IvanHoe, Houdini, FireBird etc or SSE42

Best,