Chess databases from online servers

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

yolin
Posts: 30
Joined: Thu Mar 30, 2006 6:12 pm

Chess databases from online servers

Post by yolin »

Not sure if this has been posted, but for those into big data, here are links to the game database from lichess and fics:

https://database.lichess.org/

(250 million games, about 10% includes stockfish analysis)

and

http://ficsgames.org/

(300 million games)

Does anyone know of other chess servers with a public game database? Playchess? ICC? chess.com?

Any program capable of handling a 1 billion game pgn?
jdart
Posts: 4366
Joined: Fri Mar 10, 2006 5:23 am
Location: http://www.arasanchess.org

Re: Chess databases from online servers

Post by jdart »

There are quite a few Playchess (and some InfinityChess) engine games available here:

http://www.gladiators-chess.ru/downloads.php?cat_id=1

(site is in Russian but you can use Google Translate).

But they have no updates from Playchess since Jan. this year.

--Jon
Dann Corbit
Posts: 12540
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Chess databases from online servers

Post by Dann Corbit »

CCRL, CEGT, SSDF are good sources of computer games.
The TCEC tournament has high quality analysis attached to the games.

As for the size of a PGN file, it is limited only by disk space, since they are just text.

I have found that most chess database systems have problems with huge collections, so I generally split my collections by types.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
User avatar
Guenther
Posts: 4605
Joined: Wed Oct 01, 2008 6:33 am
Location: Regensburg, Germany
Full name: Guenther Simon

Re: Chess databases from online servers

Post by Guenther »

yolin wrote:
Does anyone know of other chess servers with a public game database? Playchess? ICC? chess.com?

Any program capable of handling a 1 billion game pgn?
For Playchess the question was already anwered.
For ICC it seems there is no known free download site or private collection available.

OTH here is a receipe how to download games from their database, but it needs a paid account.
http://chessdb.sourceforge.net/tutorial ... riveal.php
https://rwbc-chess.de

trollwatch:
Chessqueen + chessica + AlexChess + Eduard + Sylwy
Fulvio
Posts: 395
Joined: Fri Aug 12, 2016 8:43 pm

Re: Chess databases from online servers

Post by Fulvio »

yolin wrote:Any program capable of handling a 1 billion game pgn?
The limit of the new version of SCID will be 4 billion games, 256 million unique names, and 64TB.
However even opening one of the monthly lichess database uses more than 16GB of RAM, so the power of the computer will be the real limit.
styx
Posts: 338
Joined: Tue Mar 13, 2012 9:59 pm
Location: Germany

Re: Chess databases from online servers

Post by styx »

This is good news :D