Houdini 1.03a tests

[beachknight]

TESTING HOUDINI 1.03a
240 games

TEST 1

Quad 2.33
Gui: Fritz 12
Ponder: Off
No Triple or Robbo Bases
Book: HS Masterbook 2
Time Control: 5 min+ 0 sec.
4 cores for Houdini, Ivan B57D whm06 and DRybka4. Only ONE CORE (my mistake!) for Ivan T53.

120 games
2010-07Houdini1.03a 2010

1 2 3 4
1 Houdini 1.03a w32 4_CPU 10.5 - 9.5 12.0 - 8.0 14.5 - 5.5** 37.0/60
2 Ivanhoe-B57d_whm06_w32(x4) 9.5 - 10.5 11.5 - 8.5 15.0 - 5.0 ** 36.0/60
3 Deep Rybka 4 w32 8.0 - 12.0 8.5 - 11.5 13.5 - 6.5 ** 30.0/60
4 IvanHoe T53 5.5 - 14.5 5.0 - 15.0 6.5 - 13.5 ** 17.0/60

TEST 2.

I7 975
Gui: Fritz 12
Ponder: Off
No Triple or Robbo Bases
Book: HS Masterbook 2
Time Control: 5 min+ 0 sec.
4 cores and 8 threads
120 games
201007Houdini1.03ax8-1 2010

1 2 3 4
1 Houdini 1.03a x64 8_CPU 10.0 - 10.0 10.5 - 9.5 12.0 - 8.0** 32.5/60
2 IvanHoe T53(x8) 10.0 - 10.0 10.5 - 9.510.0 - 10.0 ** 30.5/60
3 Ivanhoe-B57d_whm06_w64(x8) 9.5 - 10.5 9.5 - 10.5 11.5 - 8.5 ** 30.5/60
4 Deep Rybka 4 x64 8.0 - 12.0 10.0 - 10.0 8.5 - 11.5 ** 26.5/60



GLOBAL (Not including Ivan T53 because of my mistake in first test)
1 Houdini 1.03 4_CPU 21,0 - 19.0 24,0 - 16.0 45,0/80
1 Ivanhoe-B57d_WHM 19,0 - 21.0 23,0 – 17,0 42.0/80
3 Deep Rybka 4 16,0 – 24,0 17,0 – 23,0 33,0/80

[color=blue]COMMENTS[/color]

Houdini 1.03a confirm its leadership. Excellent performance of Ivan-B57d-whm06 . Again both clearly better than Deep Rybka 4 after 120 games. (Plus 240 previous games at 5 min + 0). Ivan T53 seems also very strong. More test are needed to confirm this point.

Regards,
Tom.

Hi Tom,

Thanks for the test results.

On a side question:

I want to test latest IvanHoe 4cpu x64 versions.
As I dont have enough computer resources to try
all of them, I had to select few ones. Could you
suggest me two best versions from each "class",
I mean from 962 to 953:

62x, Y62
...
58q, T58d
57....
56...
55z, 55JR
T54B, 54KLO
53..

Your overall RL could also be helpful.

Best,

Hi,
My advice:

____IvanHoe T55 x64 MP
____Ivanhoe-B 57d whm06 x64 MP
____IvanHoe-T v63Mini10 x64 MP
____IvanHoe-B v63Mod12c x64 MP

Through all this period of time,I've found these particular versions to worth wasting testing time upon them '
Dr.D

Thanks Dr Deeb,

Last two are already in my RL.
First two noted.

Best,

[Tomcass]

Hi, Harun,

Dr. Deeb advice seems to me very wise. Perhaps could I suggest you to find the newest version of Ivanhoe 57d whm. It is 08 instead of 06, although both seems to be similar in strength. Very strong!. Bill is doing a fantastic work. And why not to try Ahmed's T53 instead of T55. It is slightly better, I think.

And finally one of the strongest Ivanhoe versions -at least according to my tests- : Vlad0's. IvanHoe 55mU-x64. JR and Peterpan compiles are usually very strong, as well.

All Ivanhoe versions mentioned before performs a bit better than DR4 -in my tests- when time control is not longer than 5 min/ game.

I follow and enjoy your tests, Harun. Please keep going!.

Regards,

Tom.

[beachknight]

Hi, Harun,

Dr. Deeb advice seems to me very wise. Perhaps could I suggest you to find the newest version of Ivanhoe 57d whm. It is 08 instead of 06, although both seems to be similar in strength. Very strong!. Bill is doing a fantastic work. And why not to try Ahmed's T53 instead of T55. It is slightly better, I think.

And finally one of the strongest Ivanhoe versions -at least according to my tests- : Vlad0's. IvanHoe 55mU-x64. JR and Peterpan compiles are usually very strong, as well.

All Ivanhoe versions mentioned before performs a bit better than DR4 -in my tests- when time control is not longer than 5 min/ game.

I follow and enjoy your tests, Harun. Please keep going!.

Regards,

Tom.

Thanks Tom. All three noted. Furthermore I'll add two latest JR and PP compiles to the list. 5 or 6 versions should suffice for blitz tests.

Best,

[kranium]

Code: Select all

CET2791a CET_Antalya_TUR  2010

                                      1    2    3    4    5    6    7    8    9    0    
1   Houdini 1.03ai 4cpu   3300  +137  **** ½01½ 1½½½ ½1½½ 01½1 ½½11 ½11½ 1½11 111½ 1½11  26.0/36
2   Stockfish 1.8.0       3300     0  ½10½ ****                                           2.0/4
3   FireBird 1.3.0i 4cpu  3341  -129  0½½½      ****                                      1.5/4  39.00
4   Rybka 4.0i 4cpu       3300   -88  ½0½½           ****                                 1.5/4  39.00
5   Crab 1.0b             3272   -60  10½0                ****                            1.5/4  39.00
6   Igorrit 0.086v9       3328  -218  ½½00                     ****                       1.0/4  26.00
7   Critter 0.70 4cpu     3231  -121  ½00½                          ****                  1.0/4  26.00
8   IvanHoe 9.68B         3250  -288  0½00                               ****             0.5/4  13.00
9   RobboLito TA04        3228  -266  000½                                    ****        0.5/4  13.00
10  Naum 4.1              3190  -228  0½00                                         ****   0.5/4  13.00

YES! finally...thank-you!
we now know the truth...
after Harun's 4 game tournament, it's absolutely clear:
?

my point: 4 games?
are you serious?

i have a much better idea...let's roll the dice and see what turns up!

[beachknight]

Code: Select all

CET2791a CET_Antalya_TUR  2010

                                      1    2    3    4    5    6    7    8    9    0    
1   Houdini 1.03ai 4cpu   3300  +137  **** ½01½ 1½½½ ½1½½ 01½1 ½½11 ½11½ 1½11 111½ 1½11  26.0/36
2   Stockfish 1.8.0       3300     0  ½10½ ****                                           2.0/4
3   FireBird 1.3.0i 4cpu  3341  -129  0½½½      ****                                      1.5/4  39.00
4   Rybka 4.0i 4cpu       3300   -88  ½0½½           ****                                 1.5/4  39.00
5   Crab 1.0b             3272   -60  10½0                ****                            1.5/4  39.00
6   Igorrit 0.086v9       3328  -218  ½½00                     ****                       1.0/4  26.00
7   Critter 0.70 4cpu     3231  -121  ½00½                          ****                  1.0/4  26.00
8   IvanHoe 9.68B         3250  -288  0½00                               ****             0.5/4  13.00
9   RobboLito TA04        3228  -266  000½                                    ****        0.5/4  13.00
10  Naum 4.1              3190  -228  0½00                                         ****   0.5/4  13.00

YES! finally...thank-you!
we now know the truth...
after Harun's 4 game tournament, it's absolutely clear:
?

my point: 4 games?
are you serious?

i have a much better idea...let's roll the dice and see what turns up!

You are welcome, Norman. You know I am the best tester around.

Best,

[kranium]

Code: Select all

CET2791a CET_Antalya_TUR  2010

                                      1    2    3    4    5    6    7    8    9    0    
1   Houdini 1.03ai 4cpu   3300  +137  **** ½01½ 1½½½ ½1½½ 01½1 ½½11 ½11½ 1½11 111½ 1½11  26.0/36
2   Stockfish 1.8.0       3300     0  ½10½ ****                                           2.0/4
3   FireBird 1.3.0i 4cpu  3341  -129  0½½½      ****                                      1.5/4  39.00
4   Rybka 4.0i 4cpu       3300   -88  ½0½½           ****                                 1.5/4  39.00
5   Crab 1.0b             3272   -60  10½0                ****                            1.5/4  39.00
6   Igorrit 0.086v9       3328  -218  ½½00                     ****                       1.0/4  26.00
7   Critter 0.70 4cpu     3231  -121  ½00½                          ****                  1.0/4  26.00
8   IvanHoe 9.68B         3250  -288  0½00                               ****             0.5/4  13.00
9   RobboLito TA04        3228  -266  000½                                    ****        0.5/4  13.00
10  Naum 4.1              3190  -228  0½00                                         ****   0.5/4  13.00

YES! finally...thank-you!
we now know the truth...
after Harun's 4 game tournament, it's absolutely clear:
?

my point: 4 games?
are you serious?

i have a much better idea...let's roll the dice and see what turns up!

You are welcome, Norman. You know I am the best tester around.

Best,

yes i can see that clearly...
whatever you test is simply magic...

do you have a crystal ball perhaps?

[Tomcass]

TESTING HOUDINI 1.03a
240 games


TEST 1

Quad 2.33
Gui: Fritz 12
Ponder: Off
No Triple or Robbo Bases
Book: HS Masterbook 2
Time Control: 5 min+ 0 sec.
4 cores
120 games
2010-07Houdini1.03a2 2010

1 2 3 4
1 Houdini 1.03a w32 4_CPU 10.5 - 9.5 11.0 - 9.0 13.0 - 7.0 34.5/60
2 Ivanhoe-B57d_whm08_w32(x4) 9.5 - 10.5 11.0 - 9.0 9.0 - 11.0 29.5/60
3 IvanHoe T53(x4) 9.0 - 11.0 9.0 - 11.0 10.5 - 9.5 28.5/60
4 Deep Rybka 4 w32 7.0 - 13.0 11.0 - 9.0 9.5 - 10.5 27.5/60


TEST2.

I7 975
Gui: Fritz 12
Ponder: Off
No Triple or Robbo Bases
Book: HS Masterbook 2
Time Control: 5 min+ 0 sec.
4 cores and 8 threads
120 games
201007Houdini1.03ax8-2 2010

1 2 3 4
1 Ivanhoe-B57d_whm08_w64(x8) 11.0 - 9.0 9.0 - 11.0 12.5 - 7.5 32.5/60
2 Deep Rybka 4 x64 9.0 - 11.0 11.5 - 8.5 10.5 - 9.5 31.0/60
3 Houdini 1.03a x64 8_CPU 11.0 - 9.0 8.5 - 11.5 10.5 - 9.5 30.0/60
4 IvanHoe T53(x8) 7.5 - 12.5 9.5 - 10.5 9.5 - 10.5 26.5/60


GLOBAL

1 2 3 4
1 Houdini 1.03a w32 4_CPU 21,5-18,5 21,5-18.5 21,5-18,5 64,5/120
2 Ivanhoe-B57d_whm08_w32(x4) 18.5-21.5 20.0-20.0 23,5-16,5 62,0/120
3 Deep Rybka 4 w32 18,5-21,5 20.0-20.0 20,0-20.0 58,5/120
4 IvanHoe T53(x4) 18,5-21,5 16,5-23,5 20,0-20,0 55,0/120

FINAL GLOBAL CUMULATIVE TESTS


480 GAMES
1 2 3
Houdini 1.03a 81,0-79,0 86,5-73,5 167,5/320 52,34%
Ivanhoe-B 57d_whm 79,0-81,0 79,5-80,5 158,5/320 49,53%
Deep Rybka4 73,5-86,5 80,5-79,5 154,0/320 48,13%


COMMENTS

After 600 games at 5 min/0 control, and about 100 hours almost non stop I finished this series of tests. The final global accumulated includes only games played between Houdini, Ivanhoe-B57d_whm and Deep Rybka 4. That is 480 games. Ivanhoe T53 performance is not bad, but clearly below them.
At this time control it is quite clear for me that Houdini 1.03a is the number one.

My next test will double the time control: 10min/0. I will include Vlad0’s Ivanhoe 55mU together with the three mentioned engines. At 10 minutes/game I expect Deep Rybka to increase its percentage up to 50%.

Regards,

Tom.

[beachknight]

Code: Select all

   Engine               Score HoIgFiRyStIv    S-B
1: Houdini 1.03ai 4cpu  0.0/0  ·              0,00
1: Igorrit 0.086v9      0.0/0    ·            0,00
1: FireBird 1.3.1i 4cpu 0.0/0      ·          0,00
1: Rybka 4.0i 4cpu      0.0/0        ·        0,00
1: Stockfish 1.8.0      0.0/0          ·      0,00
1: IvanHoe 9.63 24      0.0/0            ·    0,00

0 of 60 games played
Name of the tournament: CET2793a
Site/ Country: CET_Antalya_TUR, Türkiye
Level: Blitz 2/2

All 4cpu and x64.

I consider that 2/2 is somewhat superior than 5/0.
But roughly equal, both produces 5 games per an hour.

[beachknight]

Code: Select all

   Engine               Score  Ho Ig Fi Iv St Ry    S-B
1: Houdini 1.03ai 4cpu  6.0/10 ·· 10 01 =1 1= ==   28,50
2: Igorrit 0.086v9      6.0/10 01 ·· == 0= 1= 11   28,00
3: FireBird 1.3.1i 4cpu 5.0/10 10 == ·· == == ==   25,00
4: IvanHoe 9.63 24      4.5/10 =0 1= == ·· == =0   23,50
5: Stockfish 1.8.0      4.5/10 0= 0= == == ·· =1   21,50
6: Rybka 4.0i 4cpu      4.0/10 == 00 == =1 =0 ··   20,00

30 of 60 games played
Name of the tournament: CET2793a
Site/ Country: CET_Antalya_TUR, Türkiye
Level: Blitz 2/2

Only SF180 plays with the book in this tournament. All others are bookless.

[gerold]

Thanks Harun.
I have been testing for one of the comm. companies. After
180 games at 5/3 TC. Houdini is clearly the leader.
15 games ahead of Rybka 4 in head to head testing.

Best,
Gerold.

P.S. I have run tests with just about all the Ivanhoe versions.
A couple was within 20elo of Houdini. Waiting for a stronger
version of Ivanhoe before testing anymore of them.