Houdini 6 has been released

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

User avatar
Houdini
Posts: 1471
Joined: Tue Mar 16, 2010 12:00 am

Re: Houdini 6 has been released

Post by Houdini »

Lion wrote:ASMFish is about 30% faster than SF Dev
Is it really? I thought the speed difference was about 15%.
Maybe you are also including the contribution from the NUMA support or Large Pages?
Lion
Posts: 531
Joined: Fri Mar 31, 2006 1:26 pm
Location: Switzerland

Re: Houdini 6 has been released

Post by Lion »

Right, I am including Large pages.

rgds
User avatar
Houdini
Posts: 1471
Joined: Tue Mar 16, 2010 12:00 am

Re: Houdini 6 has been released

Post by Houdini »

Lion wrote:Right, I am including Large pages.

rgds
OK, but also other engines (including Houdini and SF) can use Large Pages.
So the real speed improvement from ASMFish is probably 15%.
Lion
Posts: 531
Joined: Fri Mar 31, 2006 1:26 pm
Location: Switzerland

Re: Houdini 6 has been released

Post by Lion »

Well, Stockfish is not using Large Pages right?

The 50-60 ELO improvement of H6 over H5 was already including the Large Pages on both right?

So I assume it is fair to say that ASMFish is 30% faster than Stockfish Dev.
Thus the 30% faster may cover the gap ?!

rgds
JJJ
Posts: 1346
Joined: Sat Apr 19, 2014 1:47 pm

Re: Houdini 6 has been released

Post by JJJ »

Robert haven't you tested yourself Houdini 6 against Stockfish dev ?
Leo
Posts: 1078
Joined: Fri Sep 16, 2016 6:55 pm
Location: USA/Minnesota
Full name: Leo Anger

Re: Houdini 6 has been released

Post by Leo »

JJJ wrote:Robert haven't you tested yourself Houdini 6 against Stockfish dev ?

Good question.
Advanced Micro Devices fan.
User avatar
Houdini
Posts: 1471
Joined: Tue Mar 16, 2010 12:00 am

Re: Houdini 6 has been released

Post by Houdini »

Lion wrote:Well, Stockfish is not using Large Pages right?

The 50-60 ELO improvement of H6 over H5 was already including the Large Pages on both right?

So I assume it is fair to say that ASMFish is 30% faster than Stockfish Dev.
Thus the 30% faster may cover the gap ?!

rgds
No, that is wrong. Because in the testing (CCRL, IPON, ...) that produces the strength difference between Houdini and SF you didn't allow Houdini to use Large Pages. If you would activate Large Pages for Houdini, the Elo difference with the vanilla SF would increase.
Werewolf
Posts: 1795
Joined: Thu Sep 18, 2008 10:24 pm

Re: Houdini 6 has been released

Post by Werewolf »

This is a test just finished. The sample size is not big enough to make conclusions, but some data is better than no data.

ASMFish 22nd May 2017
Houdini 6

game in 3 mins + 2 sec per move
200 games
opening book = 10 plies deep
Hardware = single core Xeon 2697 v2 (3.00 GHz)

Houdini 6 scored:
35 wins
38 loses
127 draws

(I bought the pro version and but ran using the standard version since I was running on single threads in Cutechess and didn't know if I needed to change the NUMA setting. If this is wrong, please tell me)
JJJ
Posts: 1346
Joined: Sat Apr 19, 2014 1:47 pm

Re: Houdini 6 has been released

Post by JJJ »

Nice test and close result. Still Houdini might win with longer time control because the fastest compile of Stockfish loose more elo with more time.
Lion
Posts: 531
Joined: Fri Mar 31, 2006 1:26 pm
Location: Switzerland

Re: Houdini 6 has been released

Post by Lion »

Thanks for doing the test and sharing !

So it seems ASMFish is still a little stronger..... ok very close and in the margin error....