Stockfish 8-11 and Arasan testsuite

[Jouni]

Engines tested at 30 sec and one core. 200 positions.

Code: Select all

SF8   129/51m24s
SF9   138/46m20s
SF10  143/40m54s
SF11  154/35m33s

Testsuites are not useful in development, but afterwards they can confirm progress nicely!

[Paloma]

Yes, but at the time of SF8 and SF9 the Test-Suite was built differently (different positions)
Suite-Vers. 15, 16 or 17

Nowadays we are at Ver 19a
Every Suite has a bunch of new Positionen, while the easier ones were deleted.
No good comparison possible.

Or have you tested SF8, SF9 and SF10 with the latest suite. (But who still has the old SF8 or SF9)
Then thanks for the comparison.