Hi,
Back in 2005 I posted on rec.games.chess.computer that I had a FEN position database containing millions of positions. Since then a couple of persons emailed me asking to get it usually to use in some research or university projects.
I just updated the database and put it on my website if anyone is interested :
http://mathieupage.com/?p=65
FEN database (287 millions posiitions)
Moderators: hgm, Rebel, chrisw
-
- Posts: 286
- Joined: Mon Mar 13, 2006 5:23 pm
- Location: Québec
-
- Posts: 3226
- Joined: Wed May 06, 2009 10:31 pm
- Location: Fuquay-Varina, North Carolina
Re: FEN database (287 millions posiitions)
Thank you very much, Mathieu! I have a few hundred thousand positions in epd format that I have been using. 286 million is much better.
-
- Posts: 286
- Joined: Mon Mar 13, 2006 5:23 pm
- Location: Québec
Re: FEN database (287 millions posiitions)
You're welcome.
By curiousity, what do you use thoses for?
By curiousity, what do you use thoses for?
Mathieu Pagé
mathieu@mathieupage.com
mathieu@mathieupage.com
-
- Posts: 3226
- Joined: Wed May 06, 2009 10:31 pm
- Location: Fuquay-Varina, North Carolina
Re: FEN database (287 millions posiitions)
I used them to compare Gaviota's evaluation to the evaluations from a group of stronger engines. I collected the depth 4 evaluations from all of the stronger engines, determined the mean and standard deviation of the evals for each position, then compared Gaviota's eval to the group mean. For any position that was several deviations different from the mean, I studied Gaviota's behavior for that position in more detail and sent my findings to Gaviota's author, Miguel Ballicora. Miguel has been able to correct some undesired behavior in Gaviota from this information.
-
- Posts: 286
- Joined: Mon Mar 13, 2006 5:23 pm
- Location: Québec
Re: FEN database (287 millions posiitions)
That's an interesting way to find weak spot in an engine's evaluation.
Mathieu Pagé
mathieu@mathieupage.com
mathieu@mathieupage.com
-
- Posts: 3226
- Joined: Wed May 06, 2009 10:31 pm
- Location: Fuquay-Varina, North Carolina
Re: FEN database (287 millions posiitions)
The idea was Miguel's. It looked like a good idea to me, so I went forward with it.
-
- Posts: 3226
- Joined: Wed May 06, 2009 10:31 pm
- Location: Fuquay-Varina, North Carolina
Re: FEN database (287 millions posiitions)
By the way, we have also found a few flaws with the search with this method.
-
- Posts: 879
- Joined: Mon Dec 15, 2008 11:45 am
Re: FEN database (287 millions posiitions)
Thx Mathieu !
I spent today some of my rare time today to implement some functions to get use of this data.
Then suddenly out of the blue sky Nemo was crashing and i need at least 30 min to find out what was going on.
Warning for UCI followers:
Chess Interfaces and GUIs will never send Mate and Stalemate positions
to the engine. So, not expecting to get a Mate Position from fen, Nemo never handled such case.
If not already done, one should catch these cases at the root, which is normally not necessary for uci implementation. Somthing like will do the job.
Hopefully this saves some unecessary debugging time.
Michael
I spent today some of my rare time today to implement some functions to get use of this data.
Then suddenly out of the blue sky Nemo was crashing and i need at least 30 min to find out what was going on.
Warning for UCI followers:
Chess Interfaces and GUIs will never send Mate and Stalemate positions
to the engine. So, not expecting to get a Mate Position from fen, Nemo never handled such case.
If not already done, one should catch these cases at the root, which is normally not necessary for uci implementation. Somthing like will do the job.
Code: Select all
// Ignore Mate / Stalemate (especially injected by Fen Test DB)
if( mli->size == 0 )
{ return INCHECK ? mateIn(0) : STALEMATE; }
Michael
-
- Posts: 286
- Joined: Mon Mar 13, 2006 5:23 pm
- Location: Québec
Re: FEN database (287 millions posiitions)
Hi Michael,
You're welcome. I'm happy it can be useful.
mp
You're welcome. I'm happy it can be useful.
mp
Mathieu Pagé
mathieu@mathieupage.com
mathieu@mathieupage.com
-
- Posts: 303
- Joined: Sat Apr 28, 2012 6:18 pm
- Location: Austin, TX
Re: FEN database (287 millions posiitions)
Adam,Adam Hair wrote:I used them to compare Gaviota's evaluation to the evaluations from a group of stronger engines. I collected the depth 4 evaluations from all of the stronger engines, determined the mean and standard deviation of the evals for each position, then compared Gaviota's eval to the group mean. For any position that was several deviations different from the mean, I studied Gaviota's behavior for that position in more detail and sent my findings to Gaviota's author, Miguel Ballicora. Miguel has been able to correct some undesired behavior in Gaviota from this information.
This is a really interesting idea. How did you automate this?
regards,
--tom