Threads test incl. Crafty 24.1

[Laskos]

Sorry can I just clarify what we're saying here?

Komodo 8 on 32 threads is around 30 elo stronger than Komodo 8 on 16 threads?


On all my testsuites it's the other way around, but that may be just down to small sample size etc.

My prediction is 30. Andreas as of now gets 27.
You get 32 thread Komodo 8 weaker than 16 thread on testsuites? Don't know why, generally testsuites are not very well representing the strength. For Komodo even TTD is not the measure, so we are left only with playing actual games, and many of them. That is what Andreas is doing. The hard and the only way.

[fastgm]

Hello Kai,

here the final result:

Code: Select all

    Program         Elo    +   -   Games   Score   Av.Op.  Draws
 -----------------------------------------------------------------
  1 Komodo 8 T32  : 3013   7   7   3000    53.9 %   2987   71.4 %
  2 Komodo 8 T16  : 2987   7   7   3000    46.1 %   3013   71.4 %


Wins   = 545
Draws  = 2141
Losses = 314
Av.Op. Elo = 3000

Result     : 1615.5/3000 (+545,=2141,-314)
Perf.      : 53.9 %
Margins    :
 68 %      : (+  0.5,-  0.5 %) -> [ 53.4, 54.3 %]
 95 %      : (+  0.9,-  0.9 %) -> [ 52.9, 54.8 %]
 99.7 %    : (+  1.4,-  1.4 %) -> [ 52.4, 55.3 %]

Elo        : 3027
Margins    :
 68 %      : (+  3,-  3) -> [3023,3030]
 95 %      : (+  7,-  7) -> [3020,3033]
 99.7 %    : (+ 10,- 10) -> [3017,3037]


Games        :   3000 (finished)

White Wins   :    569 (19.0 %)
Black Wins   :    290 ( 9.7 %)
Draws        :   2141 (71.4 %)

White Perf.  : 54.6 %
Black Perf.  : 45.4 %


Individual statistics:

1 Komodo 8 T32  : 3013  3000 (+545,=2141,-314), 53.9 %
2 Komodo 8 T16  : 2987  3000 (+314,=2141,-545), 46.1 %

[Laskos]

Hello Kai,

here the final result:

Code: Select all

    Program         Elo    +   -   Games   Score   Av.Op.  Draws
 -----------------------------------------------------------------
  1 Komodo 8 T32  : 3013   7   7   3000    53.9 %   2987   71.4 %
  2 Komodo 8 T16  : 2987   7   7   3000    46.1 %   3013   71.4 %


Wins   = 545
Draws  = 2141
Losses = 314
Av.Op. Elo = 3000

Result     : 1615.5/3000 (+545,=2141,-314)
Perf.      : 53.9 %
Margins    :
 68 %      : (+  0.5,-  0.5 %) -> [ 53.4, 54.3 %]
 95 %      : (+  0.9,-  0.9 %) -> [ 52.9, 54.8 %]
 99.7 %    : (+  1.4,-  1.4 %) -> [ 52.4, 55.3 %]

Elo        : 3027
Margins    :
 68 %      : (+  3,-  3) -> [3023,3030]
 95 %      : (+  7,-  7) -> [3020,3033]
 99.7 %    : (+ 10,- 10) -> [3017,3037]


Games        :   3000 (finished)

White Wins   :    569 (19.0 %)
Black Wins   :    290 ( 9.7 %)
Draws        :   2141 (71.4 %)

White Perf.  : 54.6 %
Black Perf.  : 45.4 %


Individual statistics:

1 Komodo 8 T32  : 3013  3000 (+545,=2141,-314), 53.9 %
2 Komodo 8 T16  : 2987  3000 (+314,=2141,-545), 46.1 %

Thank you very much for this excellent test, and for all your tests. I will prepare a post in context of arguments about the scaling with number of threads.