SPCC: Testrun of Crystal 7 finished

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

User avatar
pohl4711
Posts: 2701
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

SPCC: Testrun of Crystal 7 finished

Post by pohl4711 »

My UHO-Top15 Ratinglist is the world's first engine-ratinglist, using UHO-openings, and the world's first ratinglist offering additionally Gamepair-statistics.

Ratinglist-testrun of Crystal 7 finished.
Crystal is made for better results in analyzing games (less pruning than Stockfish and a fortress-detection), not for higher playing strength. So, Crystal 7 is only added to the full UHO ratinglist, not to the UHO-Top15 Ratinglist.
As expected, Crystal 7 plays somewhat weaker than Stockfish 16. Far more interesting are the EAS-stats: Crystal 7 plays less sacrifices, the number of short wins is smaller, the number of bad draws is higher. So, overall Crystal 7 plays more solid and less risky than Stockfish. For an engine, made for analyzing, this is, of course, not a bad thing.

Code: Select all

                                 bad  avg.win 
Rank  EAS-Score  sacs   shorts  draws  moves  Engine/player 
-------------------------------------------------------------------
   1    186308  21.43%  26.00%  09.42%   70   Stockfish 16 230630  
   5    145852  16.75%  22.03%  12.22%   71   Crystal 7 CMB avx2  
https://www.sp-cc.de/files/uho_full_list.txt

https://www.sp-cc.de

Also take a look at the EAS-Ratinglist, the world's first engine-ratinglist not measuring strength of engines but engines's style of play:
https://www.sp-cc.de/eas-ratinglist.htm


(Perhaps you have to clear your browsercache (press STRG+SHIFT+DEL) or reload the website))
Frank Quisinsky
Posts: 6888
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: SPCC: Testrun of Crystal 7 finished

Post by Frank Quisinsky »

Hi Stefan,

thanks for testing Crystal ... interesting to see in your list.

BY THE WAY:
Short wins by Uralocka (move 40 stats ...)
02.46% ... absolute number 1 (about twice as much as Stockfish / Dragon).
The style for the first moves after opening book is really fantastic.
For me at the moment clearly the most interesting chess program for opening analyses ... with a very big advantage over all the others. The programmer seems to be a maestro!

The short wins (move 45 statistics) are also great.
It's good that your tool is listed... 40 / 45 / 50 / 55 / 60
Do that for the older FCP Tourneys for 49 / 59, often games with more than 55 are endgames.

To Stockfish:
I think the most aggressive version is v13 (from the release versions).
I compare a bit in the last months with v12, v14, v15, v16 ... with 40/8 tests (not enough games and the differences are small).
Could you confirm this with your older statistics?

You do a great job for us, you know :-)
Thanks again!

Best
Frank
User avatar
pohl4711
Posts: 2701
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

Re: SPCC: Testrun of Crystal 7 finished

Post by pohl4711 »

Frank Quisinsky wrote: Sat Dec 02, 2023 2:50 am Hi Stefan,

thanks for testing Crystal ... interesting to see in your list.

BY THE WAY:
Short wins by Uralocka (move 40 stats ...)
02.46% ... absolute number 1 (about twice as much as Stockfish / Dragon).
The style for the first moves after opening book is really fantastic.
For me at the moment clearly the most interesting chess program for opening analyses ... with a very big advantage over all the others. The programmer seems to be a maestro!

The short wins (move 45 statistics) are also great.
It's good that your tool is listed... 40 / 45 / 50 / 55 / 60
Do that for the older FCP Tourneys for 49 / 59, often games with more than 55 are endgames.

To Stockfish:
I think the most aggressive version is v13 (from the release versions).
I compare a bit in the last months with v12, v14, v15, v16 ... with 40/8 tests (not enough games and the differences are small).
Could you confirm this with your older statistics?

You do a great job for us, you know :-)
Thanks again!

Best
Frank
Look at my old full list here:
https://www.sp-cc.de/files/spcc_full_list.txt

Below the old SPCC full ratinglist, the EAS full ratinglist can be found. 2 EAS lists, as usual. Second list with all stats...(lot of numbers here...)

Including Stockfish final HCE (Stockfish 11, with some more patches until SF 12 with nnue came out). And all Stockfishes from 12 to 16.
User avatar
pohl4711
Posts: 2701
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

Re: SPCC: Testrun of Crystal 7 finished

Post by pohl4711 »

By the way: For my new EAS ratinglist, made out of the UHO-Top15 engine games, I added a new information below the list, which IMO is interesting:

https://www.sp-cc.de/eas-ratinglist.htm

EAS Stats-Highscores (Top3):
A) Most high-value sacrifices (>= 3 pawnunits): (1) Stockfish 231116, (2) Stockfish 16, (3) Rebel EAS
B) Most sacrifices played overall: (1) Stockfish 16, (2) Stockfish 231116, (3) Rebel EAS
C) Most very short wins: (1) Uralochka 3.40a, (2) Stockfish 16, (3) Stockfish 231116
(45 moves or less, if the short wins are 60 moves and below (the short wins boundaries are variable...))

D) Most short wins overall: (1) Torch 1, (2) Stockfish 16, (3) Revenge 3.0
E) Smallest average length of all won games: (1) Torch 1, (2) Stockfish 16 & Stockfish 231116
F) Smallest number of bad draws: (1) Stockfish 231116, (2) Stockfish 16, (3) Torch 1

And, you are right, Uralochka 3.40a has the most very short wins (45 moves or less, if the short wins are 60 moves and below (the short wins boundaries are variable and are calculated by the EAS Tool for each new database...))

Since V5.2, the move-limit of the EAS Tool is no longer fixed to 40-60 moves, but the average length of all won
games in the source.pgn is calculated, rounded to 5 or 10 and -15. Reason is, that human games or adjucated engine games are much shorter than non-adjucated engine-games for example and the EAS-tools will now adjust the move-limits for short-win EAS-points to this "reality":
Example 1: Average won game length in the source.pgn is 78 moves: Rounded to 75 and -15 = 60 is the upper limit, followed by 55, 50, 45, 40
Example 2: Average won game length is 58 moves: Rounded to 55 and -15 = 40 is the upper limit, followed by 35, 30, 25, 20
Frank Quisinsky
Posts: 6888
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: SPCC: Testrun of Crystal 7 finished

Post by Frank Quisinsky »

Thank you Stefan!!
Good work!!

Best
Frank
User avatar
Rebel
Posts: 7298
Joined: Thu Aug 18, 2011 12:04 pm
Full name: Ed Schröder

Re: SPCC: Testrun of Crystal 7 finished

Post by Rebel »

pohl4711 wrote: Sat Dec 02, 2023 12:54 pm By the way: For my new EAS ratinglist, made out of the UHO-Top15 engine games, I added a new information below the list, which IMO is interesting:

https://www.sp-cc.de/eas-ratinglist.htm

EAS Stats-Highscores (Top3):
A) Most high-value sacrifices (>= 3 pawnunits): (1) Stockfish 231116, (2) Stockfish 16, (3) Rebel EAS
B) Most sacrifices played overall: (1) Stockfish 16, (2) Stockfish 231116, (3) Rebel EAS
You made my day.
90% of coding is debugging, the other 10% is writing bugs.
Frank Quisinsky
Posts: 6888
Joined: Wed Nov 18, 2009 7:16 pm
Location: Gutweiler, Germany
Full name: Frank Quisinsky

Re: SPCC: Testrun of Crystal 7 finished

Post by Frank Quisinsky »

:-)