Why is CCRL Outdated when it comes to Stockfish?

Discussion of anything and everything relating to chess playing software and machines.

Moderator: Ras

Sicilian101
Posts: 5
Joined: Sun Aug 06, 2023 10:12 am
Full name: Ani Barua

Why is CCRL Outdated when it comes to Stockfish?

Post by Sicilian101 »

Whenever I look up computer chess rating, I rely on CCRL, however, when it comes to 40/15 CCRL is REALLY bad about updating Stockfish. For example, we have SF 17 now but in the 40/15 it is still showing number 1. engine as SF 2023 version from June last year! And when I do "complete list" it says SF 16.1 (which came out in Feb 2024) lower rated then SF June 2023 and SF 17 even lower!
This website is becoming very unreliable.
Are there any other trusted website that list computer chess engine ratings?
Viz
Posts: 223
Joined: Tue Apr 09, 2024 6:24 am
Full name: Michael Chaly

Re: Why is CCRL Outdated when it comes to Stockfish?

Post by Viz »

sp-cc.de
User avatar
Graham Banks
Posts: 44821
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: Why is CCRL Outdated when it comes to Stockfish?

Post by Graham Banks »

Sicilian101 wrote: Tue Sep 17, 2024 8:53 pm Whenever I look up computer chess rating, I rely on CCRL, however, when it comes to 40/15 CCRL is REALLY bad about updating Stockfish. For example, we have SF 17 now but in the 40/15 it is still showing number 1. engine as SF 2023 version from June last year! And when I do "complete list" it says SF 16.1 (which came out in Feb 2024) lower rated then SF June 2023 and SF 17 even lower!
This website is becoming very unreliable.
Are there any other trusted website that list computer chess engine ratings?
https://www.computerchess.org.uk/ccrl/4 ... ons_only=1

Which engine is at the top?

Still hundreds more games to run for the 4CPU list.

A lot of people don't know how to access different lists. Scroll down to the bottom of the index page and make your selections there.
gbanksnz at gmail.com
Wolfgang
Posts: 989
Joined: Sat May 13, 2006 1:08 am

Re: Why is CCRL Outdated when it comes to Stockfish?

Post by Wolfgang »

Sicilian101 wrote: Tue Sep 17, 2024 8:53 pm Are there any other trusted website that list computer chess engine ratings?
CEGT
www.cegt.net

40/4

40/20

5'+3" Ponder, the only reliable Ponder list

The remaining lists are outdated
Best
Wolfgang
CEGT-Team
www.cegt.net
www.cegt.forumieren.com
User avatar
Graham Banks
Posts: 44821
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: Why is CCRL Outdated when it comes to Stockfish?

Post by Graham Banks »

Both CCRL and CEGT use balanced openings in their testing.

Because the top engines search so deeply, it's difficult for them to outsmart each other, which is why they have a high draw rate and their ratings are compressed in a similar manner to human rating lists.

The other rating list mentioned has a much smaller selection of engines and uses opening lines that are highly favourable to one side.

There are other rating lists around as well.
You need to look at more than one rating list in order to get an overall picture.
gbanksnz at gmail.com