New engine test for the IPON list is running

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

Frank Quisinsky
Posts: 6808
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: New engine test for the IPON list is running

Post by Frank Quisinsky »

Hi Milos,

I am testing the TOP-20 of available engines.
The list of testing engines is complete, sorry!

Best
Frank
Frank Quisinsky
Posts: 6808
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: New engine test for the IPON list is running

Post by Frank Quisinsky »

Hi,

interesting message I read here ...

Open Chess Forum ...
And the main topic are the ippo familie :-)
Where are the topics to all the others open chess engines?

And now the reader wrote about amateurschach.de

My webpage has not the name clonechess.de.

I know for the most "amateurschach" is "clonechess".
Not for myself.

But indeed an interesting topic I think.
Open Chess should be renamend in Clone Chess.

Best
Frank
beram
Posts: 1187
Joined: Wed Jan 06, 2010 3:11 pm

Re: New engine test for the IPON list is running

Post by beram »

You are making such a fool of yourself. Why ?
Frank Quisinsky
Posts: 6808
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: New engine test for the IPON list is running

Post by Frank Quisinsky »

Hi Bram,

anything wrong what I wrote?
What?

Could you give me an example?
Perhaps I am wrong ...

Best
Frank
User avatar
Houdini
Posts: 1471
Joined: Tue Mar 16, 2010 12:00 am

Re: New engine test for the IPON list is running

Post by Houdini »

Ingo,

Thanks, it's great fun to watch the progress of the test match.

Cheers,
Robert
beram
Posts: 1187
Joined: Wed Jan 06, 2010 3:11 pm

Re: New engine test for the IPON list is running

Post by beram »

Houdini wrote:Ingo,

Thanks, it's great fun to watch the progress of the test match.

Cheers,
Robert
Indeed great to watch and nice to see my results for Houdini 1.02 against Deep Rybka confirmed.
After 160 games on my AMD 6core, TC 2m2s, I had a 80,5 - 79,5 score for DR4, so approx even.
Momentarily I let it run against Ivanhoe63B-Mod12C (the best(?) Ivanhoe atm) first 50 games also very close but for Houdini 26,5 - 23,5

Keep up the good work Robert, I appreciate it very much.
kind regards Bram
IWB
Posts: 1539
Joined: Thu Mar 09, 2006 2:02 pm

Re: New engine test for the IPON list is running

Post by IWB »

My Pleasure,

I wrote this on OpenChess as well but I will post it here to clarify things:

The shown Elo in my test are preliminary and therefore not 100% precise. They show a direction rather than an aim.

1. The Elo for the opponents are Bayeselo
2. The Classic GUI is calculation more straight, maybe more like ELOstat - so there is a mismatch
3. The Classic is simply calculation an average ELO of the opponents, while in reality the opponent ELO is build with the outcome of the games. The Classic is considering the opponent elos as static while they are dynamic.

Right now (1200 games) the real ELO calculated with Bayes is 8 Points lower than it is displayed.

To be "sure" about the perfomance one has to wait until I integrated the enigne in the real list.

Btw: Houdini still tends to crash from time to time in the Classic. It is not the worst engine but for from good (~1% of the games / most enignes have a0% rate!)

Bye
Ingo
User avatar
Houdini
Posts: 1471
Joined: Tue Mar 16, 2010 12:00 am

Re: New engine test for the IPON list is running

Post by Houdini »

IWB wrote:Btw: Houdini still tends to crash from time to time in the Classic. It is not the worst engine but for from good (~1% of the games / most enignes have a0% rate!)
Wow, that's way too much! I haven't encountered a single crash with version 1.02 so far - and, as you can imagine, I'm running games non-stop.
I'll try to run some tournaments in Shredder GUI with settings similar to the IPON test, this might be related to the "ponder on" setting.

Thanks for sharing your results,
Robert
beram
Posts: 1187
Joined: Wed Jan 06, 2010 3:11 pm

Re: New engine test for the IPON list is running

Post by beram »

Houdini wrote:
IWB wrote:Btw: Houdini still tends to crash from time to time in the Classic. It is not the worst engine but for from good (~1% of the games / most enignes have a0% rate!)
Wow, that's way too much! I haven't encountered a single crash with version 1.02 so far - and, as you can imagine, I'm running games non-stop.
I'll try to run some tournaments in Shredder GUI with settings similar to the IPON test, this might be related to the "ponder on" setting.

Thanks for sharing your results,
Robert
Sofar for me under F12 gui no crashes with Houdini 1.02 (after approx 500 games) the earlier versions did crash.

grts Bram
IWB
Posts: 1539
Joined: Thu Mar 09, 2006 2:02 pm

Re: New engine test for the IPON list is running

Post by IWB »

Hello
Houdini wrote:
IWB wrote:Btw: Houdini still tends to crash from time to time in the Classic. It is not the worst engine but for from good (~1% of the games / most enignes have a0% rate!)
Wow, that's way too much! I haven't encountered a single crash with version 1.02 so far - and, as you can imagine, I'm running games non-stop.
I'll try to run some tournaments in Shredder GUI with settings similar to the IPON test, this might be related to the "ponder on" setting.

Thanks for sharing your results,
Robert
I have to correct myself: The crashing rate of Houdini "feels" like 1%. In reality I had 8 crashes in 1800 games which is a rate of 0.44%.
It feels worse as I have to restart a GUI every 2-3 hours or even more in the morning.
Nevertheless it is one of the "bad" engines in my list even if it is by far not the worst one!

Bye
Ingo