How many rating points is SF 8 over SF 7?

[jplchess]

To chess community:
How many rating points is Stockfish 8 over Stockfish 7 under the same fast hardware?
Jonathan Lee

[Dann Corbit]

To chess community:
How many rating points is Stockfish 8 over Stockfish 7 under the same fast hardware?
Jonathan Lee

Most of the tests I have seen are just under 90 Elo.

[Guenther]

To chess community:
How many rating points is Stockfish 8 over Stockfish 7 under the same fast hardware?
Jonathan Lee

Most of the tests I have seen are just under 90 Elo.

I have seen similar results as Dann, somewhere between 80 and 100 RP.

[gerold]

To chess community:
How many rating points is Stockfish 8 over Stockfish 7 under the same fast hardware?
Jonathan Lee

Most of the tests I have seen are just under 90 Elo.

I have seen similar results as Dann, somewhere between 80 and 100 RP.

Same here about 90.

[mjlef]

That will depend on the time control, since longer times lead to more draws. IPON is at a pretty fast 5 min/game + 3 sec/move, and has Stockfish 8 as 67 elo over Stockfish 7: http://www.inwoba.de/

CCRL and CEGT are testing now so we have to wait for a bunch of games to see the difference at different time controls or numbers of threads.

[carldaman]

To chess community:
How many rating points is Stockfish 8 over Stockfish 7 under the same fast hardware?
Jonathan Lee

The question can be better phrased, as in how many more points in self-play (SF8 vs SF7) or in a rating list vs many opponents. Not to mention, the time control, which can make a big difference.

[mjlef]

I see CCRL has some result son the 40/4 list:

http://www.computerchess.org.uk/ccrl/40 ... t_all.html

it shows 52 elo on one thread, and also 52 elo n 4 threads.

[Modern Times]

I see CCRL has some results on the 40/4 list:

http://www.computerchess.org.uk/ccrl/40 ... t_all.html

it shows 52 elo on one thread, and also 52 elo n 4 threads.

Using Ordo against our database gives +65 Elo and +60 Elo, but yes I don't believe it is nowhere near 80 or 90 under ratings list conditions against a variety of engines.

[Frank Quisinsky]

Hi Dann,

it will be 30 ELO not more.

If engines started with optimal settings (in case of many opponents with Contempt).

Can be see in my list if ASM Fish 8 BMI2 x64 will be start in three days. With shorter time controls I think also much more as 30 Elo. I am absolutely sure that ASM isn't stronger as Komodo 10.2 with more as 30 Elo. And we are speaking from the strongest available SF version.

The 40 days old SF with the fastest compile by ii u. ll is at the moment 8.5 Elo stronger as Komodo 10.2! Fact with 4.0 GHz hardware and many opponents and 45 minutes per game with a very very equal opening book.

Important is again and again ...
A big group of opponents or never a rating can be exactly enough. After my experiments with my own list ... 26 opponents are min. a "to have" for a rating list. In all other cases, not important how many games ... ratings are not exactly enough.

Easy to find out it with my database in self work!

Best
Frank

And SF 7 to SF 8 ...

Code: Select all

   SF 18Sep2016 BMI2 x64 C10        :  3216.77   2650    87.4   24.0  14.48  2837.65   8.28   53.0
   Stockfish 7 KP BMI2 x64          :  3160.17   3200    85.8   26.6  12.93  2808.96   7.91   64.0

= 56 + 5-10 Elo more to the Version 8 + max. 5-10 Elo more for ASM +15-20 Elo more for Contempt = around 85-100 Elo with longer time controls.

[Lyudmil Tsvetkov]

it seems that the ratings have already stabilised.

SF is around 95 elo at super-bullet, 80 at bullet and around 65 at blitz.
Maybe they simply implemented too many simplifications. I bet SF without all the simplifications would be around 40 elo at bullet, the way they measure progress at the framework, and the same 65 elo at blitz.

It is fine to include elo-gaining simplifications, but why commit simplis that score negative?