New engine test for the IPON list is running

Discussion of computer chess matches and engine tournaments.

Moderators: Harvey Williamson, Dann Corbit, hgm

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Frank Quisinsky
Posts: 5299
Joined: Wed Nov 18, 2009 6:16 pm
Location: Trier, Germany
Full name: Frank Quisinsky
Contact:

Re: New engine test for the IPON list is running

Post by Frank Quisinsky » Mon Jun 21, 2010 4:29 am

Hi Milos,

I am testing the TOP-20 of available engines.
The list of testing engines is complete, sorry!

Best
Frank
I like computer chess!

Frank Quisinsky
Posts: 5299
Joined: Wed Nov 18, 2009 6:16 pm
Location: Trier, Germany
Full name: Frank Quisinsky
Contact:

Re: New engine test for the IPON list is running

Post by Frank Quisinsky » Mon Jun 21, 2010 7:27 am

Hi,

interesting message I read here ...

Open Chess Forum ...
And the main topic are the ippo familie :-)
Where are the topics to all the others open chess engines?

And now the reader wrote about amateurschach.de

My webpage has not the name clonechess.de.

I know for the most "amateurschach" is "clonechess".
Not for myself.

But indeed an interesting topic I think.
Open Chess should be renamend in Clone Chess.

Best
Frank
I like computer chess!

beram
Posts: 1187
Joined: Wed Jan 06, 2010 2:11 pm

Re: New engine test for the IPON list is running

Post by beram » Mon Jun 21, 2010 8:09 am

You are making such a fool of yourself. Why ?

Frank Quisinsky
Posts: 5299
Joined: Wed Nov 18, 2009 6:16 pm
Location: Trier, Germany
Full name: Frank Quisinsky
Contact:

Re: New engine test for the IPON list is running

Post by Frank Quisinsky » Mon Jun 21, 2010 8:39 am

Hi Bram,

anything wrong what I wrote?
What?

Could you give me an example?
Perhaps I am wrong ...

Best
Frank
I like computer chess!

User avatar
Houdini
Posts: 1471
Joined: Mon Mar 15, 2010 11:00 pm
Contact:

Re: New engine test for the IPON list is running

Post by Houdini » Mon Jun 21, 2010 9:59 am

Ingo,

Thanks, it's great fun to watch the progress of the test match.

Cheers,
Robert

beram
Posts: 1187
Joined: Wed Jan 06, 2010 2:11 pm

Re: New engine test for the IPON list is running

Post by beram » Mon Jun 21, 2010 10:17 am

Houdini wrote:Ingo,

Thanks, it's great fun to watch the progress of the test match.

Cheers,
Robert
Indeed great to watch and nice to see my results for Houdini 1.02 against Deep Rybka confirmed.
After 160 games on my AMD 6core, TC 2m2s, I had a 80,5 - 79,5 score for DR4, so approx even.
Momentarily I let it run against Ivanhoe63B-Mod12C (the best(?) Ivanhoe atm) first 50 games also very close but for Houdini 26,5 - 23,5

Keep up the good work Robert, I appreciate it very much.
kind regards Bram

IWB
Posts: 1539
Joined: Thu Mar 09, 2006 1:02 pm

Re: New engine test for the IPON list is running

Post by IWB » Mon Jun 21, 2010 4:23 pm

My Pleasure,

I wrote this on OpenChess as well but I will post it here to clarify things:

The shown Elo in my test are preliminary and therefore not 100% precise. They show a direction rather than an aim.

1. The Elo for the opponents are Bayeselo
2. The Classic GUI is calculation more straight, maybe more like ELOstat - so there is a mismatch
3. The Classic is simply calculation an average ELO of the opponents, while in reality the opponent ELO is build with the outcome of the games. The Classic is considering the opponent elos as static while they are dynamic.

Right now (1200 games) the real ELO calculated with Bayes is 8 Points lower than it is displayed.

To be "sure" about the perfomance one has to wait until I integrated the enigne in the real list.

Btw: Houdini still tends to crash from time to time in the Classic. It is not the worst engine but for from good (~1% of the games / most enignes have a0% rate!)

Bye
Ingo

User avatar
Houdini
Posts: 1471
Joined: Mon Mar 15, 2010 11:00 pm
Contact:

Re: New engine test for the IPON list is running

Post by Houdini » Mon Jun 21, 2010 5:08 pm

IWB wrote:Btw: Houdini still tends to crash from time to time in the Classic. It is not the worst engine but for from good (~1% of the games / most enignes have a0% rate!)
Wow, that's way too much! I haven't encountered a single crash with version 1.02 so far - and, as you can imagine, I'm running games non-stop.
I'll try to run some tournaments in Shredder GUI with settings similar to the IPON test, this might be related to the "ponder on" setting.

Thanks for sharing your results,
Robert

beram
Posts: 1187
Joined: Wed Jan 06, 2010 2:11 pm

Re: New engine test for the IPON list is running

Post by beram » Mon Jun 21, 2010 5:14 pm

Houdini wrote:
IWB wrote:Btw: Houdini still tends to crash from time to time in the Classic. It is not the worst engine but for from good (~1% of the games / most enignes have a0% rate!)
Wow, that's way too much! I haven't encountered a single crash with version 1.02 so far - and, as you can imagine, I'm running games non-stop.
I'll try to run some tournaments in Shredder GUI with settings similar to the IPON test, this might be related to the "ponder on" setting.

Thanks for sharing your results,
Robert
Sofar for me under F12 gui no crashes with Houdini 1.02 (after approx 500 games) the earlier versions did crash.

grts Bram

IWB
Posts: 1539
Joined: Thu Mar 09, 2006 1:02 pm

Re: New engine test for the IPON list is running

Post by IWB » Tue Jun 22, 2010 7:30 am

Hello
Houdini wrote:
IWB wrote:Btw: Houdini still tends to crash from time to time in the Classic. It is not the worst engine but for from good (~1% of the games / most enignes have a0% rate!)
Wow, that's way too much! I haven't encountered a single crash with version 1.02 so far - and, as you can imagine, I'm running games non-stop.
I'll try to run some tournaments in Shredder GUI with settings similar to the IPON test, this might be related to the "ponder on" setting.

Thanks for sharing your results,
Robert
I have to correct myself: The crashing rate of Houdini "feels" like 1%. In reality I had 8 crashes in 1800 games which is a rate of 0.44%.
It feels worse as I have to restart a GUI every 2-3 hours or even more in the morning.
Nevertheless it is one of the "bad" engines in my list even if it is by far not the worst one!

Bye
Ingo

Post Reply