16 vs 32 threads - Stockfish 180104

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

fastgm
Posts: 818
Joined: Mon Aug 19, 2013 6:57 pm

Re: 16 vs 32 threads - Stockfish 180104

Post by fastgm »

After 250 games:

Code: Select all

1   Stockfish 180104 T32   +19  +18/=228/-4 52.80%  132.0/250
2   Stockfish 180104 T16   -19  +4/=228/-18 47.20%  118.0/250

 Engine                 Depth       Time   Games     Moves  Average
--------------------------------------------------------------------
 Stockfish 180104 T32   37.94   63:11:48     250     16017    14.20 
 Stockfish 180104 T16   37.30   63:25:23     250     16034    14.24
.
Top
fastgm
Posts: 818
Joined: Mon Aug 19, 2013 6:57 pm

Re: 16 vs 32 threads - Stockfish 180104

Post by fastgm »

After 374 games:

Code: Select all

1   Stockfish 180104 T32   +18  +24/=345/-5 52.54%  196.5/374
2   Stockfish 180104 T16   -18  +5/=345/-24 47.46%  177.5/374

 Engine                 Depth       Time   Games     Moves  Average
--------------------------------------------------------------------
 Stockfish 180104 T16   37.17   91:53:39     374     22867    14.47
 Stockfish 180104 T32   37.88   91:44:25     374     22847    14.46
.
Top
fastgm
Posts: 818
Joined: Mon Aug 19, 2013 6:57 pm

Re: 16 vs 32 threads - Stockfish 180104

Post by fastgm »

After 570 games:

Code: Select all

 Engine                 Depth       Time   Games     Moves  Average
--------------------------------------------------------------------
 Stockfish 180104 T32   38.01  140:48:28     570     35210    14.40
 Stockfish 180104 T16   37.24  140:59:07     570     35243    14.40


    Program                 Elo    +   -   Games   Score   Av.Op.  Draws
 -------------------------------------------------------------------------
  1 Stockfish 180104 T32  : 3008   8   7    570    52.4 %   2992   92.8 %
  2 Stockfish 180104 T16  : 2992   7   8    570    47.6 %   3008   92.8 %


Av.Op. Elo = 3000

Result     : 298.5/570 (+34,=529,-7)
Perf.      : 52.4 %
Margins    :
 68 %      : (+  0.6,-  0.5 %) -> [ 51.8, 52.9 %]
 95 %      : (+  1.2,-  1.0 %) -> [ 51.3, 53.5 %]
 99.7 %    : (+  1.8,-  1.5 %) -> [ 50.9, 54.2 %]

Elo        : 3016
Margins    :
 68 %      : (+  4,-  4) -> [3013,3020]
 95 %      : (+  8,-  7) -> [3009,3025]
 99.7 %    : (+ 13,- 10) -> [3006,3029]


Games        :    570 (finished)

White Wins   :     36 ( 6.3 %)
Black Wins   :      5 ( 0.9 %)
Draws        :    529 (92.8 %)

White Perf.  : 52.7 %
Black Perf.  : 47.3 %


Individual statistics:

1 Stockfish 180104 T32  : 3008  570 (+ 34,=529,-  7), 52.4 %
2 Stockfish 180104 T16  : 2992  570 (+  7,=529,- 34), 47.6 %
.
Top
fastgm
Posts: 818
Joined: Mon Aug 19, 2013 6:57 pm

Final result after 750 games

Post by fastgm »

Final result after 750 games and the statistics:

Cutechess-Cli: 610 games

Code: Select all

1   Stockfish 180104 T32   +15  +34/=569/-7 52.21%  318.5/610
2   Stockfish 180104 T16   -15  +7/=569/-34 47.79%  291.5/610

 Engine                 Depth       Time   Games     Moves  Average
--------------------------------------------------------------------
 Stockfish 180104 T32   38.07  150:37:40     610     37589    14.43
 Stockfish 180104 T16   37.28  150:46:46     610     37625    14.43

    Program                 Elo    +   -   Games   Score   Av.Op.  Draws
 -------------------------------------------------------------------------
  1 Stockfish 180104 T32  : 3008   8   7    610    52.2 %   2992   93.3 %
  2 Stockfish 180104 T16  : 2992   7   8    610    47.8 %   3008   93.3 %
LittleBlitzer GUI: 140 games

Code: Select all

1   Stockfish 180104 T32    +7  +3/=137/-0  51.07%   71.5/140
2   Stockfish 180104 T16    -7  +0/=137/-3  48.93%   68.5/140

Games Completed = 140 of 140 (Avg game length = 1685.429 sec)
Settings = RR/4096MB/600000ms+6000ms/M 650cp for 5 moves, D 60 moves/PGN:C:\Schach\LittleBlitzer-2.75\Noomen_2-move_Testsuite.pgn(200)
Time = 237405 sec elapsed, 0 sec remaining

 1.  Stockfish 180104 T32  71.5/140  3-0-137  (L: m=0 t=0 i=0 a=0)  (D: r=66 i=2 f=0 s=0 a=69)  (tpm=16372.0 d=36.37 nps=29381961)
 2.  Stockfish 180104 T16  68.5/140  0-3-137  (L: m=0 t=0 i=0 a=3)  (D: r=66 i=2 f=0 s=0 a=69)  (tpm=16391.1 d=35.56 nps=17092852)

    Program                  Elo    +   -   Games   Score   Av.Op.  Draws
 --------------------------------------------------------------------------
  1 Stockfish 180104 T32  : 3004   13   6    140    51.1 %   2996   97.9 %
  2 Stockfish 180104 T16  : 2996    6  13    140    48.9 %   3004   97.9 %
Overall result: 750 games

Code: Select all

    Program                 Elo    +   -   Games   Score   Av.Op.  Draws
 -------------------------------------------------------------------------
  1 Stockfish 180104 T32  : 3007   6   6    750    52.0 %   2993   94.1 %
  2 Stockfish 180104 T16  : 2993   6   6    750    48.0 %   3007   94.1 %


Wins   = 37
Draws  = 706
Losses = 7
Av.Op. Elo = 3000

Result     : 390.0/750 (+37,=706,-7)
Perf.      : 52.0 %
Margins    :
 68 %      : (+  0.5,-  0.4 %) -> [ 51.6, 52.5 %]
 95 %      : (+  0.9,-  0.8 %) -> [ 51.2, 52.9 %]
 99.7 %    : (+  1.4,-  1.2 %) -> [ 50.8, 53.4 %]

Elo        : 3014
Margins    :
 68 %      : (+  3,-  3) -> [3011,3017]
 95 %      : (+  6,-  6) -> [3008,3020]
 99.7 %    : (+ 10,-  8) -> [3006,3024]


Games        :    750 (finished)

White Wins   :     38 ( 5.1 %)
Black Wins   :      6 ( 0.8 %)
Draws        :    706 (94.1 %)

White Perf.  : 52.1 %
Black Perf.  : 47.9 %


Individual statistics:

1 Stockfish 180104 T32  : 3007  750 (+ 37,=706,-  7), 52.0 %
2 Stockfish 180104 T16  : 2993  750 (+  7,=706,- 37), 48.0 %
.
Top
fastgm
Posts: 818
Joined: Mon Aug 19, 2013 6:57 pm

Re: Final result after 750 games

Post by fastgm »

All games: http://www.fastgm.de/schach/SF180104-T3 ... +6-750.zip
Top
fastgm
Posts: 818
Joined: Mon Aug 19, 2013 6:57 pm

16 vs 32 threads - Stockfish 180124, 30' + 15"

Post by fastgm »

Conditions:
Dual AMD Opteron 6376, Windows 10 Professional 64-Bit
Cutechess-Cli, Stockfish 180124, tc = 30 min + 15 sec, 4096 MB Hash, Contempt = 0, opening book: Noomen_2-move_Testsuite.pgn, changing colors, adjudication rules, 6-men Syzygy Tablebases

Final result after 100 games:

Code: Select all

 Engine                 Depth       Time   Games     Moves  Average
--------------------------------------------------------------------
 Stockfish 180124 T32   39.93   62:56:27     100      4970    45.59
 Stockfish 180124 T16   39.27   63:11:43     100      4976    45.72


    Program                 Elo    +   -   Games   Score   Av.Op.  Draws
 -------------------------------------------------------------------------
  1 Stockfish 180124 T32  : 3003   17   6   100    51.0 %   2997   98.0 %
  2 Stockfish 180124 T16  : 2997    6  17   100    49.0 %   3003   98.0 %


Av.Op. Elo = 3000

Result     : 51.0/100 (+2,=98,-0)
Perf.      : 51.0 %
Margins    :
 68 %      : (+  1.0,-  0.5 %) -> [ 50.5, 52.0 %]
 95 %      : (+  2.5,-  0.9 %) -> [ 50.1, 53.5 %]
 99.7 %    : (+  5.1,-  1.1 %) -> [ 49.9, 56.1 %]

Elo        : 3007
Margins    :
 68 %      : (+  7,-  4) -> [3003,3014]
 95 %      : (+ 17,-  6) -> [3001,3024]
 99.7 %    : (+ 36,-  8) -> [2999,3043]


Games        :    100 (finished)

White Wins   :      2 ( 2.0 %)
Black Wins   :      0 ( 0.0 %)
Draws        :     98 (98.0 %)

White Perf.  : 51.0 %
Black Perf.  : 49.0 %


Individual statistics:

1 Stockfish 180124 T32  : 3003  100 (+  2,= 98,-  0), 51.0 %
2 Stockfish 180124 T16  : 2997  100 (+  0,= 98,-  2), 49.0 %
Games: http://www.fastgm.de/schach/SF180124-T3 ... 800+15.zip
Top

Return to “Computer Chess Club: Tournaments and Matches”