SlowChess Blitz Classic 2.1 64-bit 4CPU Gauntlet for CCRL 40/15

[Graham Banks]

PGN - http://kirill-kryukov.com/chess/discuss ... p?id=46675

[Graham Banks]

Code: Select all

CCRL 40/15 Rating List - Custom engine selection
1157654 games played by 2680 programs, run by 23 testers
Ponder off, General books (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 15 minutes on an Intel i7-4770k.
Computed on June 27, 2020 with Bayeselo based on 1'157'654 games
Tested by CCRL team, 2005-2020, http://ccrl.chessdom.com/ccrl/4040/

Rank                 Engine                   Elo   +    -   Score  AvOp  Games
1 SlowChess Blitz Classic 2.1 64-bit 4CPU 3279  +22  -22  42.1%  +50.5   599
  SlowChess Blitz Classic 1.9 64-bit 4CPU 3181  +27  -27  53.3%  -18.6   383

[Dann Corbit]

That list is really interesting because in the other contest, Slowchess finished above Xiphos and Ethereal in the contest and in this contest both of those engines cleaned his clock.
This was a 4 CPU contest, so I wonder it Slowchess has a SMP problem.

Of course, it really isn't enough games to draw a firm conclusion of any kind.

[jonkr]

The biggest reason is this test is not the latest version, it's 2.1 instead of 2.2

However my limited SMP test did suggest a possible minor weakness, it scored 11 elo worse against Xiphos 0.6 in my 4-thread test. (It was only 4000 games at 10s + 0.1s and even that took quite a while to run. Not enough games to say how much elo diff but enough to suggest it wasn't just pure luck. )