The limits of cutechess

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

User avatar
Rebel
Posts: 7293
Joined: Thu Aug 18, 2011 12:04 pm
Full name: Ed Schröder

The limits of cutechess

Post by Rebel »

I have been playing matches of 100.000 games and cutechess somewhere in the range of 80.000 games crashes with a timeout on one of the engines. I suspect cutechess needs too much time to maintain the PGN.

And so I tried 75.000 games, it goes better, but after some time the same thing happens, one of the engines times out and cutechess aborts.

Playing 50.000 games all is okay.

Is there a workaround?
90% of coding is debugging, the other 10% is writing bugs.
smatovic
Posts: 3205
Joined: Wed Mar 10, 2010 10:18 pm
Location: Hamburg, Germany
Full name: Srdja Matovic

Re: The limits of cutechess

Post by smatovic »

As far as I got it, people use now fastchess:

https://www.chessprogramming.org/Fastch ... e_Manager)

https://github.com/Disservin/fastchess/

Less overhead they say.

--
Srdja
User avatar
flok
Posts: 557
Joined: Tue Jul 03, 2018 10:19 am
Full name: Folkert van Heusden

Re: The limits of cutechess

Post by flok »

smatovic wrote: Mon Feb 17, 2025 2:06 pm As far as I got it, people use now fastchess:

https://www.chessprogramming.org/Fastch ... e_Manager)

https://github.com/Disservin/fastchess/

Less overhead they say.

--
Srdja
I can confirm. With 31 threads, cutechess uses > 100% cpu. Fastchess on the other hand less than 1%.
User avatar
Steve Maughan
Posts: 1262
Joined: Wed Mar 08, 2006 8:28 pm
Location: Florida, USA

Re: The limits of cutechess

Post by Steve Maughan »

smatovic wrote: Mon Feb 17, 2025 2:06 pm As far as I got it, people use now fastchess:

https://www.chessprogramming.org/Fastch ... e_Manager)

https://github.com/Disservin/fastchess/

Less overhead they say.

--
Srdja
I was looking at FastChess — it's interesting. It doesn't seem to have opening book capabilities. The engine needs to use their own opening book.

— Steve
http://www.chessprogramming.net - Maverick Chess Engine
User avatar
flok
Posts: 557
Joined: Tue Jul 03, 2018 10:19 am
Full name: Folkert van Heusden

Re: The limits of cutechess

Post by flok »

Steve Maughan wrote: Tue Feb 18, 2025 6:52 pm
smatovic wrote: Mon Feb 17, 2025 2:06 pm As far as I got it, people use now fastchess:

https://www.chessprogramming.org/Fastch ... e_Manager)

https://github.com/Disservin/fastchess/

Less overhead they say.

--
Srdja
I was looking at FastChess — it's interesting. It doesn't seem to have opening book capabilities. The engine needs to use their own opening book.

— Steve
Yes it does:

-openings file=NAME format=(epd|pgn) [order=ORDER] [plies=PLIES] [start=START]
Specifies an opening book file and its format for game starting positions.
format - file format, either epd or pgn.
ORDER - order of openings (random or sequential). Default is sequential.
PLIES - number of plies for pgn. Defaults to max available plies.
START - starting index of the opening book. Default is 1.
User avatar
Steve Maughan
Posts: 1262
Joined: Wed Mar 08, 2006 8:28 pm
Location: Florida, USA

Re: The limits of cutechess

Post by Steve Maughan »

flok wrote: Tue Feb 18, 2025 7:01 pm
Steve Maughan wrote: Tue Feb 18, 2025 6:52 pm
smatovic wrote: Mon Feb 17, 2025 2:06 pm As far as I got it, people use now fastchess:

https://www.chessprogramming.org/Fastch ... e_Manager)

https://github.com/Disservin/fastchess/

Less overhead they say.

--
Srdja
I was looking at FastChess — it's interesting. It doesn't seem to have opening book capabilities. The engine needs to use their own opening book.

— Steve
Yes it does:

-openings file=NAME format=(epd|pgn) [order=ORDER] [plies=PLIES] [start=START]
Specifies an opening book file and its format for game starting positions.
format - file format, either epd or pgn.
ORDER - order of openings (random or sequential). Default is sequential.
PLIES - number of plies for pgn. Defaults to max available plies.
START - starting index of the opening book. Default is 1.
Oh OK Thanks — I guess I was looking for Polyglot compatibility.

— Steve
http://www.chessprogramming.net - Maverick Chess Engine
User avatar
Ozymandias
Posts: 1537
Joined: Sun Oct 25, 2009 2:30 am

Re: The limits of cutechess

Post by Ozymandias »

Years ago, before the utilities bills went trough the roof, I used to leave the PCs playing hundreds of thousands of games each, for months. I never experienced cutechess related crashes.
Jouni
Posts: 3618
Joined: Wed Mar 08, 2006 8:15 pm
Full name: Jouni Uski

Re: The limits of cutechess

Post by Jouni »

I have used Cute Chess 1.2.0 GUI 4 years intensively without single crash.
Jouni
User avatar
flok
Posts: 557
Joined: Tue Jul 03, 2018 10:19 am
Full name: Folkert van Heusden

Re: The limits of cutechess

Post by flok »

Jouni wrote: Sat Feb 22, 2025 5:34 pm I have used Cute Chess 1.2.0 GUI 4 years intensively without single crash.
cutechess-cli crashed everytime here when terminating.
The chess programs themselves never crashed (I checked using coredumpctl).
With fastchess: 0 problems.
mar
Posts: 2644
Joined: Fri Nov 26, 2010 2:00 pm
Location: Czech Republic
Full name: Martin Sedlak

Re: The limits of cutechess

Post by mar »

I've played many games with cutechess-cli (still do), in the past when generating data for texeltuning I played 100k+ games at fast tc and never experienced any problems whatsoever.
I also play 16t and never noticed any measurable overhead either.

I'd make sure it's not some other problem before accusing cutechess.
apart from fastchess (haven't tried) there's also c-chess-cli