Page 2 of 3

Re: New engine test for the IPON list is running

Posted: Mon Jun 21, 2010 6:29 am
by Frank Quisinsky
Hi Milos,

I am testing the TOP-20 of available engines.
The list of testing engines is complete, sorry!

Best
Frank

Re: New engine test for the IPON list is running

Posted: Mon Jun 21, 2010 9:27 am
by Frank Quisinsky
Hi,

interesting message I read here ...

Open Chess Forum ...
And the main topic are the ippo familie :-)
Where are the topics to all the others open chess engines?

And now the reader wrote about amateurschach.de

My webpage has not the name clonechess.de.

I know for the most "amateurschach" is "clonechess".
Not for myself.

But indeed an interesting topic I think.
Open Chess should be renamend in Clone Chess.

Best
Frank

Re: New engine test for the IPON list is running

Posted: Mon Jun 21, 2010 10:09 am
by beram
You are making such a fool of yourself. Why ?

Re: New engine test for the IPON list is running

Posted: Mon Jun 21, 2010 10:39 am
by Frank Quisinsky
Hi Bram,

anything wrong what I wrote?
What?

Could you give me an example?
Perhaps I am wrong ...

Best
Frank

Re: New engine test for the IPON list is running

Posted: Mon Jun 21, 2010 11:59 am
by Houdini
Ingo,

Thanks, it's great fun to watch the progress of the test match.

Cheers,
Robert

Re: New engine test for the IPON list is running

Posted: Mon Jun 21, 2010 12:17 pm
by beram
Houdini wrote:Ingo,

Thanks, it's great fun to watch the progress of the test match.

Cheers,
Robert
Indeed great to watch and nice to see my results for Houdini 1.02 against Deep Rybka confirmed.
After 160 games on my AMD 6core, TC 2m2s, I had a 80,5 - 79,5 score for DR4, so approx even.
Momentarily I let it run against Ivanhoe63B-Mod12C (the best(?) Ivanhoe atm) first 50 games also very close but for Houdini 26,5 - 23,5

Keep up the good work Robert, I appreciate it very much.
kind regards Bram

Re: New engine test for the IPON list is running

Posted: Mon Jun 21, 2010 6:23 pm
by IWB
My Pleasure,

I wrote this on OpenChess as well but I will post it here to clarify things:

The shown Elo in my test are preliminary and therefore not 100% precise. They show a direction rather than an aim.

1. The Elo for the opponents are Bayeselo
2. The Classic GUI is calculation more straight, maybe more like ELOstat - so there is a mismatch
3. The Classic is simply calculation an average ELO of the opponents, while in reality the opponent ELO is build with the outcome of the games. The Classic is considering the opponent elos as static while they are dynamic.

Right now (1200 games) the real ELO calculated with Bayes is 8 Points lower than it is displayed.

To be "sure" about the perfomance one has to wait until I integrated the enigne in the real list.

Btw: Houdini still tends to crash from time to time in the Classic. It is not the worst engine but for from good (~1% of the games / most enignes have a0% rate!)

Bye
Ingo

Re: New engine test for the IPON list is running

Posted: Mon Jun 21, 2010 7:08 pm
by Houdini
IWB wrote:Btw: Houdini still tends to crash from time to time in the Classic. It is not the worst engine but for from good (~1% of the games / most enignes have a0% rate!)
Wow, that's way too much! I haven't encountered a single crash with version 1.02 so far - and, as you can imagine, I'm running games non-stop.
I'll try to run some tournaments in Shredder GUI with settings similar to the IPON test, this might be related to the "ponder on" setting.

Thanks for sharing your results,
Robert

Re: New engine test for the IPON list is running

Posted: Mon Jun 21, 2010 7:14 pm
by beram
Houdini wrote:
IWB wrote:Btw: Houdini still tends to crash from time to time in the Classic. It is not the worst engine but for from good (~1% of the games / most enignes have a0% rate!)
Wow, that's way too much! I haven't encountered a single crash with version 1.02 so far - and, as you can imagine, I'm running games non-stop.
I'll try to run some tournaments in Shredder GUI with settings similar to the IPON test, this might be related to the "ponder on" setting.

Thanks for sharing your results,
Robert
Sofar for me under F12 gui no crashes with Houdini 1.02 (after approx 500 games) the earlier versions did crash.

grts Bram

Re: New engine test for the IPON list is running

Posted: Tue Jun 22, 2010 9:30 am
by IWB
Hello
Houdini wrote:
IWB wrote:Btw: Houdini still tends to crash from time to time in the Classic. It is not the worst engine but for from good (~1% of the games / most enignes have a0% rate!)
Wow, that's way too much! I haven't encountered a single crash with version 1.02 so far - and, as you can imagine, I'm running games non-stop.
I'll try to run some tournaments in Shredder GUI with settings similar to the IPON test, this might be related to the "ponder on" setting.

Thanks for sharing your results,
Robert
I have to correct myself: The crashing rate of Houdini "feels" like 1%. In reality I had 8 crashes in 1800 games which is a rate of 0.44%.
It feels worse as I have to restart a GUI every 2-3 hours or even more in the morning.
Nevertheless it is one of the "bad" engines in my list even if it is by far not the worst one!

Bye
Ingo