Stockfish 17092216 vs. Clones

[drj4759]

Code: Select all

   # PLAYER                :  RATING  POINTS  PLAYED   (%)
   1 Sugar XPro 1.3        :  3667.7   401.5     600    67
   2 Raubfisch X36b        :  3643.4   379.5     600    63
   3 McBrain 2.7           :  3536.6   277.5     600    46
   4 CorChess 1.8          :  3533.5   274.5     600    46
   5 Brain Fish 170923     :  3521.0   262.5     600    44
   6 Goby 170925           :  3520.5   262.0     600    44
   7 Stockfish 17092216    :  3500.0   242.5     600    40

See details:
http://chessowl.blogspot.com/2017/09/st ... lones.html

[Vinvin]

Code: Select all

   # PLAYER                :  RATING  POINTS  PLAYED   (%)
   1 Sugar XPro 1.3        :  3667.7   401.5     600    67
   2 Raubfisch X36b        :  3643.4   379.5     600    63
   3 McBrain 2.7           :  3536.6   277.5     600    46
   4 CorChess 1.8          :  3533.5   274.5     600    46
   5 Brain Fish 170923     :  3521.0   262.5     600    44
   6 Goby 170925           :  3520.5   262.0     600    44
   7 Stockfish 17092216    :  3500.0   242.5     600    40

See details:
http://chessowl.blogspot.com/2017/09/st ... lones.html

Thanks for this match but your numbers are weird.
As I see here : http://www.talkchess.com/forum/viewtopic.php?t=65311 , SF is very close to Sugar.
Why is it 160 point higher in your tests ?

[drj4759]

We do not have the same tournament environment, not a single component is identical in terms of software, hardware, time control, rounds, etc. etc.

For interest, the tournament manager used here is cutechess-cli v1.0 which is the same as used by the Stockfish testing. This is probably the most accurate tournament manager. If in doubt, you can reproduce the result by running it yourself.

[gogamoga]

Why is it 160 point higher in your tests ?

Sugar by default uses all available cores, maybe that was the issue.

[drj4759]

Additional tournament conditions:
1. Time control is 1 minute + 1 second which is longer than Stockfish testing LTC of 1 minute + 0.6 second.
2. The tournament was ran under Linux (PCLinuxOS 4.9.13), AMD 4 cores, 8GB ram, cutechess-cli v1.0.
3. Used single core only with 10 simultaneous games.
4. Book used is customized which are selected from the games between Brainfish and Stockfish/Sugar/Raubfisch with average of 120 seconfs per move which is longer than the 70 seconds of Brainfish. All of the games were draws up to 15 moves which is truncated to 5 moves for the tournament with a threshold of 30 centipawn. Moves selection are random from a set of 700 drawn games and each game is repeated to make sure each engine gets equal white and black color.

[Lyudmil Tsvetkov]

Code: Select all

   # PLAYER                :  RATING  POINTS  PLAYED   (%)
   1 Sugar XPro 1.3        :  3667.7   401.5     600    67
   2 Raubfisch X36b        :  3643.4   379.5     600    63
   3 McBrain 2.7           :  3536.6   277.5     600    46
   4 CorChess 1.8          :  3533.5   274.5     600    46
   5 Brain Fish 170923     :  3521.0   262.5     600    44
   6 Goby 170925           :  3520.5   262.0     600    44
   7 Stockfish 17092216    :  3500.0   242.5     600    40

See details:
http://chessowl.blogspot.com/2017/09/st ... lones.html

better not test, if test like that.

[Jouni]

Sugar won SF by 71,5-28,5. +160 ELO. We have here REVOLUTION . From PGN I can't figure whats wrong, weird. A prank?

[Milos]

Sugar won SF by 71,5-28,5. +160 ELO. We have here REVOLUTION . From PGN I can't figure whats wrong, weird. A prank?

Sugar and Raubfisch on all cores, all others on a single core. The tournament is a joke.

[tpoppins]

Additional tournament conditions:
[...]
2. The tournament was ran under Linux (PCLinuxOS 4.9.13), AMD 4 cores, 8GB ram, cutechess-cli v1.0.
3. Used single core only with 10 simultaneous games. [...]

2.5 simultaneous games per core? Quite a novel approach.

[drj4759]

Thanks for pointing out the possible cause of irregularity. Here is the partial replay:

Code: Select all

   # PLAYER                :  RATING  POINTS  PLAYED   (%)
   1 McBrain 2.7           :  3543.1   167.0     300    56
   2 Raubfisch X36b        :  3507.0   146.5     300    49
   3 Sugar XPro 1.3        :  3502.6   144.0     300    48
   4 Stockfish 17092216    :  3500.0   142.5     300    48

See details here:
http://chessowl.blogspot.com/2017/09/st ... eplay.html