TalkChess.com
Hosted by Your Move Chess & Games

Author Message
Ferdinand Mosca

Joined: 10 Aug 2008
Posts: 453
Location: Philippines

Post subject: Re: CLOP for Noisy Black-Box Parameter Optimization    Posted: Tue Oct 11, 2011 8:22 am

 Rémi Coulom wrote: Hi, This is my paper for the Tilburg conference: Title: CLOP: Confident Local Optimization for Noisy Black-Box Parameter Tuning Abstract: Artificial intelligence in games often leads to the problem of parameter tuning. Some heuristics may have coefficients, and they should be tuned to maximize the win rate of the program. A possible approach consists in building local quadratic models of the win rate as a function of program parameters. Many local regression algorithms have already been proposed for this task, but they are usually not robust enough to deal automatically and efficiently with very noisy outputs and non-negative Hessians. The CLOP principle, which stands for Confident Local OPtimization, is a new approach to local regression that overcomes all these problems in a simple and efficient way. It consists in discarding samples whose estimated value is confidently inferior to the mean of all samples. Experiments demonstrate that, when the function to be optimized is smooth, this method outperforms all other tested algorithms. pdf and source code: http://remi.coulom.free.fr/CLOP/ It makes no miracle: you'll have to play a lot of games to get really good parameters. But it is certainly much more efficient than any manual method you could use with bayeselo. It is also more efficient than any other algorithm I am aware of. Compared to the old version of QLR, I solved all the unstability problems. I do not have a mathematical proof of convergence, but I am convinced it always work well, unless the maximum is at a discontinuity, which never happens in practice. Comments and questions are welcome. Rémi

Hi Remi, from the read me below, I can not find the dummy.exe file from the CLOP-0.08.tar.bz2? Is there any CLOP compilaton for windows? Thanks.

 Quote: Windows & Mac ------------- Get the Qt SDK. Project files in programs/clop/compqt/* can be opened in Qt Creator and compiled. Optimizing a program with CLOP ============================== First step: connection script ----------------------------- The first step to connect a program to CLOP consists in writing a connection script. A connection script takes parameter values as input, plays one game, and returns the game outcome as output. For more information, run "Dummy.exe" in the Windows distribution, or programs/clop/script/real/DummyScript.py in Linux.
 Display posts from previous: All Posts1 Day7 Days2 Weeks1 Month3 Months6 Months1 Year Oldest FirstNewest First
Subject Author Date/Time
Rémi Coulom Thu Sep 01, 2011 10:32 am
Joona Kiiski Fri Sep 02, 2011 8:52 am
Rémi Coulom Fri Sep 02, 2011 9:45 am
Marco Costalba Fri Sep 02, 2011 5:34 pm
Zach Wegner Fri Sep 02, 2011 4:44 pm
Rémi Coulom Fri Sep 02, 2011 7:58 pm
Rein Halbersma Fri Sep 02, 2011 10:07 pm
Rémi Coulom Sat Sep 03, 2011 9:24 am
Rein Halbersma Sat Sep 03, 2011 5:01 pm
Rémi Coulom Sat Sep 03, 2011 5:28 pm
Andres Valverde Sat Sep 03, 2011 10:28 am
Rémi Coulom Sat Sep 03, 2011 10:40 am
Peter Österlund Sat Sep 03, 2011 6:54 pm
Rémi Coulom Sat Sep 03, 2011 7:34 pm
Ernest Bonnem Sun Sep 04, 2011 4:49 pm
Don Dailey Wed Sep 07, 2011 4:57 pm
Rémi Coulom Wed Sep 07, 2011 5:47 pm
Don Dailey Wed Sep 07, 2011 6:09 pm
Rémi Coulom Wed Sep 07, 2011 6:26 pm
F. Bluemers Wed Sep 07, 2011 6:39 pm
Rémi Coulom Wed Sep 07, 2011 8:19 pm
Rémi Coulom Thu Sep 08, 2011 4:44 pm
Larry Kaufman Fri Sep 09, 2011 3:36 am
Rémi Coulom Fri Sep 09, 2011 6:11 am
Larry Kaufman Fri Sep 09, 2011 2:43 pm
Rémi Coulom Fri Sep 09, 2011 7:47 pm
Marco Costalba Sun Nov 06, 2011 8:24 am
Rémi Coulom Sun Nov 06, 2011 8:30 am
Marco Costalba Sun Nov 06, 2011 8:50 am
Peter Österlund Sun Nov 06, 2011 1:11 pm
Marco Costalba Sun Nov 06, 2011 4:53 pm
Rémi Coulom Sun Nov 06, 2011 5:14 pm
Peter Österlund Sun Nov 06, 2011 11:11 pm
Rémi Coulom Mon Nov 07, 2011 11:18 am
Rémi Coulom Sun Nov 06, 2011 5:05 pm
Rémi Coulom Fri Sep 09, 2011 7:52 pm
Rémi Coulom Sat Sep 10, 2011 9:49 am
Michel Van den Bergh Sun Sep 25, 2011 8:18 am
Rémi Coulom Sun Sep 25, 2011 8:47 am
Michel Van den Bergh Mon Sep 26, 2011 10:55 am
Rémi Coulom Mon Sep 26, 2011 1:40 pm
Michel Van den Bergh Tue Sep 27, 2011 7:54 am
Rémi Coulom Tue Sep 27, 2011 8:39 am
Michel Van den Bergh Thu Sep 29, 2011 2:04 pm
Rémi Coulom Thu Sep 29, 2011 3:38 pm
Daniel Shawul Mon Oct 17, 2011 2:03 am
Michel Van den Bergh Mon Oct 17, 2011 7:51 am
Rémi Coulom Mon Oct 17, 2011 7:56 am
Rémi Coulom Mon Oct 17, 2011 8:02 am
Rémi Coulom Mon Oct 17, 2011 8:11 am
Daniel Shawul Mon Oct 17, 2011 9:54 am
Rémi Coulom Mon Oct 17, 2011 11:10 am
david nash Wed Oct 05, 2011 12:19 am
Edward Yu Fri Oct 07, 2011 11:58 am
Rémi Coulom Fri Oct 07, 2011 1:17 pm
Edward Yu Fri Oct 07, 2011 4:01 pm
Rémi Coulom Fri Oct 07, 2011 4:30 pm
Edward Yu Sat Oct 08, 2011 3:59 am
Rémi Coulom Sat Oct 08, 2011 7:49 am
Edward Yu Tue Oct 11, 2011 4:04 pm
Rémi Coulom Tue Oct 11, 2011 4:22 pm
Daniel Shawul Tue Oct 11, 2011 4:49 pm
Rémi Coulom Tue Oct 11, 2011 5:27 pm
Michel Van den Bergh Sat Oct 15, 2011 2:51 pm
Rémi Coulom Sun Oct 16, 2011 6:30 am
Michel Van den Bergh Sun Oct 16, 2011 8:10 am
Rémi Coulom Sun Oct 16, 2011 9:02 am
Michel Van den Bergh Sun Oct 16, 2011 3:10 pm
Rémi Coulom Sun Oct 16, 2011 7:25 pm
Michel Van den Bergh Sat Oct 08, 2011 6:00 am
Rémi Coulom Sat Oct 08, 2011 7:53 am
Rémi Coulom Sat Oct 08, 2011 8:27 am
Re: CLOP for Noisy Black-Box Parameter Optimization Ferdinand Mosca Tue Oct 11, 2011 8:22 am
Rémi Coulom Tue Oct 11, 2011 1:38 pm
Ferdinand Mosca Sun Oct 23, 2011 7:39 pm
Rémi Coulom Sun Oct 23, 2011 8:55 pm
Ferdinand Mosca Sun Oct 23, 2011 10:47 pm
Jonatan Pettersson Fri Nov 04, 2011 9:42 am
Rémi Coulom Fri Nov 04, 2011 9:58 am
Jonatan Pettersson Fri Nov 04, 2011 10:17 am
Rémi Coulom Fri Nov 04, 2011 10:30 am
Jonatan Pettersson Fri Nov 04, 2011 10:44 am
Rémi Coulom Fri Nov 04, 2011 10:56 am
Jonatan Pettersson Fri Nov 04, 2011 11:04 am
Rémi Coulom Fri Nov 04, 2011 11:56 am
Jonatan Pettersson Fri Nov 04, 2011 4:16 pm
Jonatan Pettersson Fri Nov 04, 2011 5:48 pm
Sergei S. Markoff Fri Nov 04, 2011 3:02 pm
Rémi Coulom Sat Nov 05, 2011 7:45 pm
Jonatan Pettersson Sat Nov 05, 2011 10:49 pm
Ilari Pihlajisto Sat Nov 05, 2011 11:17 pm
Jonatan Pettersson Sun Nov 06, 2011 12:06 am
Rémi Coulom Sun Nov 06, 2011 8:00 am
Jonatan Pettersson Sun Nov 06, 2011 10:20 am
Rémi Coulom Sun Nov 06, 2011 5:10 pm

 Jump to: Select a forum Computer Chess Club Forums----------------Computer Chess Club: General TopicsComputer Chess Club: Tournaments and MatchesComputer Chess Club: Programming and Technical DiscussionsComputer Chess Club: Engine Origins Other Forums----------------Chess Thinkers ForumForum Help and Suggestions
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum