Symmetric multiprocessing (SMP) scaling - K10.4 Contempt=0

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Harvey Williamson, bob

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Post Reply
fastgm
Posts: 389
Joined: Mon Aug 19, 2013 4:57 pm
Contact:

Symmetric multiprocessing (SMP) scaling - K10.4 Contempt=0

Post by fastgm » Thu May 11, 2017 6:39 am

Symmetric multiprocessing (SMP) scaling
Komodo 10.4 with and without Contempt Factor under Windows & Linux


Windows: Windows 10 Professional 64-Bit, Dual AMD Opteron 6376 @ 2.3 GHz
Linux: Ubuntu Server 16.04 LTS (HVM) 64-Bit, Amazon EC2 Instance, m4.16xlarge, Intel Xeon E5-2686v4 @ 2.3 GHz

Komodo 10.4: default settings, except Contempt, 128 MB Hash
Cutechess-Cli: no draw and resign rules, no ponder, no learning, no tablebases, 1500 different opening positions, changing colors
TC = time control, T = number of threads, Depth = Average search depth, Elostat Start Elo = 3000

Here the results, also as PDF-File:
http://www.fastgm.de/schach/SMP-scaling-K10.4-C0.pdf

Code: Select all

Windows – 1 thread vs 2 threads
 
TC = 60" + 0.05" – Contempt = 0                                             default Contempt = 10
 
    Program           Elo    +   -   Games   Score    Draws   Depth           Program           Elo    +   -   Games   Score    Draws   Depth  
 -------------------------------------------------------------------       -------------------------------------------------------------------
  1 Komodo 10.4 T2  : 3032   7   7   3000    59.2 %   66.3 %  18.84         1 Komodo 10.4 T2  : 3044   8   8   3000    62.3 %   59.1 %  18.48
  2 Komodo 10.4 T1  : 2968   7   7   3000    40.8 %   66.3 %  17.78         2 Komodo 10.4 T1  : 2956   8   8   3000    37.7 %   59.1 %  17.44
 
  Result     : 1777.0/3000 (+782,=1990,-228)                                Result     : 1868.5/3000 (+982,=1773,-245)
  Perf.      : 59.2 %                                                       Perf.      : 62.3 %
  Elo        : 3065                                                         Elo        : 3087                  +22 Elo

---------------------------------------------------------------------------------------------------------------------------------------------- 
 
Linux – 1 thread vs 2 threads
 
TC = 10" + 0.1" – Contempt = 0                                              default Contempt = 10
 
    Program           Elo    +   -   Games   Score    Draws   Depth           Program           Elo    +   -   Games   Score    Draws   Depth
 -------------------------------------------------------------------       -------------------------------------------------------------------
  1 Komodo 10.4 T2  : 3036   8   8   3000    60.3 %   62.0 %  17.28         1 Komodo 10.4 T2  : 3044   8   8   3000    62.3 %   55.2 %  17.02
  2 Komodo 10.4 T1  : 2964   8   8   3000    39.7 %   62.0 %  16.32         2 Komodo 10.4 T1  : 2956   8   8   3000    37.7 %   55.2 %  16.06
 
  Result     : 1808.5/3000 (+879,=1859,-262)                                Result     : 1868.5/3000 (+1040,=1657,-303)
  Perf.      : 60.3 %                                                       Perf.      : 62.3 %
  Elo        : 3072                                                         Elo        : 3087                  +15 Elo

----------------------------------------------------------------------------------------------------------------------------------------------  
 
Windows – 1 thread vs 4 threads
 
TC = 60" + 0.05" – Contempt = 0                                             default Contempt = 10
 
    Program           Elo    +   -   Games   Score    Draws   Depth           Program           Elo    +   -   Games   Score    Draws   Depth 
 -------------------------------------------------------------------       -------------------------------------------------------------------
  1 Komodo 10.4 T4  : 3062   8   7   3000    67.2 %   59.8 %  20.47         1 Komodo 10.4 T4  : 3076   8   8   3000    70.6 %   51.5 %  20.04
  2 Komodo 10.4 T1  : 2938   7   8   3000    32.8 %   59.8 %  17.92         2 Komodo 10.4 T1  : 2924   8   8   3000    29.4 %   51.5 %  17.71

  Result     : 2017.5/3000 (+1120,=1795,-85)                                Result     : 2118.0/3000 (+1345,=1546,-109)
  Perf.      : 67.2 %                                                       Perf.      : 70.6 % 
  Elo        : 3125                                                         Elo        : 3152                  +27 Elo

----------------------------------------------------------------------------------------------------------------------------------------------  
 
Linux – 1 thread vs 4 threads
 
TC = 10" + 0.1" – Contempt = 0                                              default Contempt = 10
 
    Program           Elo    +   -   Games   Score    Draws   Depth           Program           Elo    +   -   Games   Score    Draws   Depth
 -------------------------------------------------------------------       -------------------------------------------------------------------
  1 Komodo 10.4 T4  : 3069   8   8   3000    68.9 %   54.7 %  18.89         1 Komodo 10.4 T4  : 3084   9   9   3000    72.4 %   47.4 %  18.51
  2 Komodo 10.4 T1  : 2931   8   8   3000    31.1 %   54.7 %  16.61         2 Komodo 10.4 T1  : 2916   9   9   3000    27.6 %   47.4 %  16.29

  Result     : 2067.0/3000 (+1246,=1642,-112)                               Result     : 2170.5/3000 (+1459,=1423,-118)
  Perf.      : 68.9 %                                                       Perf.      : 72.4 %
  Elo        : 3138                                                         Elo        : 3167                  +29 Elo

----------------------------------------------------------------------------------------------------------------------------------------------  
  
Windows – 1 thread vs 8 threads
 
TC = 60" + 0.05"  – Contempt = 0                                            default Contempt = 10
 
    Program           Elo    +   -   Games   Score    Draws   Depth           Program           Elo    +   -   Games   Score    Draws   Depth 
 -------------------------------------------------------------------       -------------------------------------------------------------------
  1 Komodo 10.4 T8  : 3091   9   8   3000    74.0 %   49.6 %  21.44         1 Komodo 10.4 T8  : 3104   9   9   3000    76.8 %   42.7 %  21.19
  2 Komodo 10.4 T1  : 2909   8   9   3000    26.0 %   49.6 %  17.88         2 Komodo 10.4 T1  : 2896   9   9   3000    23.2 %   42.7 %  17.82
 
  Result     : 2219.0/3000 (+1475,=1488,-37)                                Result     : 2305.5/3000 (+1665,=1281,-54)
  Perf.      : 74.0 %                                                       Perf.      : 76.8 %
  Elo        : 3181                                                         Elo        : 3208                  +27 Elo

----------------------------------------------------------------------------------------------------------------------------------------------  
 
Linux – 1 thread vs 8 threads
 
TC = 10" + 0.1" – Contempt = 0                                              default Contempt = 10
 
    Program           Elo    +   -   Games   Score    Draws   Depth           Program           Elo    +   -   Games   Score    Draws   Depth
 -------------------------------------------------------------------       -------------------------------------------------------------------
  1 Komodo 10.4 T8  : 3100   9   9   3000    76.0 %   45.8 %  19.85         1 Komodo 10.4 T8  : 3121   10  10  3000    80.1 %   35.8 %  19.47
  2 Komodo 10.4 T1  : 2900   9   9   3000    24.0 %   45.8 %  16.57         2 Komodo 10.4 T1  : 2879   10  10  3000    19.9 %   35.8 %  16.25
 
  Result     : 2279.5/3000 (+1593,=1373,-34)                                Result     : 2404.0/3000 (+1867,=1074,-59)
  Perf.      : 76.0 %                                                       Perf.      : 80.1 %
  Elo        : 3200                                                         Elo        : 3242                  +42 Elo

---------------------------------------------------------------------------------------------------------------------------------------------- 
 
Windows – 1 thread vs 16 threads
 
TC = 60" + 0.05" – Contempt = 0                                             default Contempt = 10
 
    Program           Elo    +   -   Games   Score    Draws   Depth           Program           Elo    +   -   Games   Score    Draws   Depth 
 -------------------------------------------------------------------       -------------------------------------------------------------------
  1 Komodo 10.4 T16 : 3113   9   9   3000    78.5 %   41.6 %  21.94         1 Komodo 10.4 T16 : 3140   11  11  3000    83.3 %   32.0 %  21.31
  2 Komodo 10.4 T1  : 2887   9   9   3000    21.5 %   41.6 %  17.80         2 Komodo 10.4 T1  : 2860   11  11  3000    16.7 %   32.0 %  17.38

  Result     : 2355.5/3000 (+1732,=1247,-21)                                Result     : 2499.5/3000 (+2020,=959,-21)
  Perf.      : 78.5 %                                                       Perf.      : 83.3 %
  Elo        : 3225                                                         Elo        : 3279                  +54 Elo

---------------------------------------------------------------------------------------------------------------------------------------------- 
 
Linux – 1 thread vs 16 threads
 
TC = 10" + 0.1" – Contempt = 0                                              default Contempt = 10
 
    Program           Elo    +   -   Games   Score    Draws   Depth           Program           Elo    +   -   Games   Score    Draws   Depth
 -------------------------------------------------------------------       -------------------------------------------------------------------
  1 Komodo 10.4 T16 : 3125   10  10  3000    80.8 %   37.3 %  20.90         1 Komodo 10.4 T16 : 3157   12  12  3000    86.0 %   26.8 %  20.43
  2 Komodo 10.4 T1  : 2875   10  10  3000    19.1 %   37.3 %  16.60         2 Komodo 10.4 T1  : 2843   12  12  3000    14.0 %   26.8 %  16.14

  Result     : 2425.5/3000 (+1866,=1119,-15)                                Result     : 2578.5/3000 (+2176,=805,-19)
  Perf.      : 80.8 %                                                       Perf.      : 86.0 %
  Elo        : 3250                                                         Elo        : 3315                  +65 Elo

---------------------------------------------------------------------------------------------------------------------------------------------- 
 
Windows – 2 threads vs 4 threads
 
TC = 60" + 0.05" – Contempt = 0                                             default Contempt = 10
 
    Program           Elo    +   -   Games   Score    Draws   Depth           Program           Elo    +   -   Games   Score    Draws   Depth 
 -------------------------------------------------------------------       -------------------------------------------------------------------
  1 Komodo 10.4 T4  : 3037   7   7   3000    60.6 %   66.7 %  20.22         1 Komodo 10.4 T4  : 3043   8   8   3000    62.2 %   60.7 %  19.82
  2 Komodo 10.4 T2  : 2963   7   7   3000    39.4 %   66.7 %  18.60         2 Komodo 10.4 T2  : 2957   8   8   3000    37.8 %   60.7 %  18.23

  Result     : 1818.0/3000 (+817,=2002,-181)                                Result     : 1867.0/3000 (+956,=1822,-222)
  Perf.      : 60.6 %                                                       Perf.      : 62.2 %
  Elo        : 3075                                                         Elo        : 3087                  +13 Elo

---------------------------------------------------------------------------------------------------------------------------------------------- 
 
Linux – 2 threads vs 4 threads
 
TC = 10" + 0.1" – Contempt = 0                                              default Contempt = 10
 
    Program           Elo    +   -   Games   Score    Draws   Depth           Program           Elo    +   -   Games   Score    Draws   Depth
 -------------------------------------------------------------------       -------------------------------------------------------------------
  1 Komodo 10.4 T4  : 3033   7   7   3000    59.5 %   64.6 %  18.65         1 Komodo 10.4 T4  : 3036   8   8   3000    60.1 %   57.3 %  18.24
  2 Komodo 10.4 T2  : 2967   7   7   3000    40.5 %   64.6 %  17.43         2 Komodo 10.4 T2  : 2964   8   8   3000    39.9 %   57.3 %  17.08

  Result     : 1784.5/3000 (+816,=1937,-247)                                Result     : 1803.0/3000 (+944,=1718,-338)
  Perf.      : 59.5 %                                                       Perf.      : 60.1 %
  Elo        : 3067                                                         Elo        : 3071                  +4 Elo

---------------------------------------------------------------------------------------------------------------------------------------------- 
 
Windows – 4 threads vs 8 threads
 
TC = 60" + 0.05" – Contempt = 0                                             default Contempt = 10
 
    Program           Elo    +   -   Games   Score    Draws   Depth           Program           Elo    +   -   Games   Score    Draws   Depth 
 -------------------------------------------------------------------       -------------------------------------------------------------------
  1 Komodo 10.4 T8  : 3031   7   6   3000    58.8 %   71.4 %  21.23         1 Komodo 10.4 T8  : 3037   7   7   3000    60.4 %   64.4 %  20.70
  2 Komodo 10.4 T4  : 2969   6   7   3000    41.2 %   71.4 %  20.09         2 Komodo 10.4 T4  : 2963   7   7   3000    39.6 %   64.4 %  19.59

  Result     : 1764.0/3000 (+693,=2142,-165)                                Result     : 1812.5/3000 (+847,=1931,-222)
  Perf.      : 58.8 %                                                       Perf.      : 60.4 %
  Elo        : 3062                                                         Elo        : 3073                  +11 Elo

---------------------------------------------------------------------------------------------------------------------------------------------- 
 
Linux – 4 threads vs 8 threads
 
TC = 10" + 0.1" – Contempt = 0                                              default Contempt = 10
 
    Program           Elo    +   -   Games   Score    Draws   Depth           Program           Elo    +   -   Games   Score    Draws   Depth
 -------------------------------------------------------------------       -------------------------------------------------------------------
  1 Komodo 10.4 T8  : 3025   9   9   1536    57.3 %   70.4 %  19.82         1 Komodo 10.4 T8  : 3029   10  10  1510    58.3 %   64.0 %  19.49
  2 Komodo 10.4 T4  : 2975   9   9   1536    42.7 %   70.4 %  19.06         2 Komodo 10.4 T4  : 2971   10  10  1510    41.7 %   64.0 %  18.78

  Result     : 879.5/1536 (+339,=1081,-116)                                 Result     : 881.0/1510 (+398,=966,-146)
  Perf.      : 57.3 %                                                       Perf.      : 58.3 %
  Elo        : 3051                                                         Elo        : 3059                  +8 Elo

---------------------------------------------------------------------------------------------------------------------------------------------- 

Linux – 8 threads vs 16 threads
 
TC = 10" + 0.1" – Contempt = 0                                              default Contempt = 10
 
    Program           Elo    +   -   Games   Score    Draws   Depth           Program           Elo    +   -   Games   Score    Draws   Depth
 -------------------------------------------------------------------       -------------------------------------------------------------------
 1 Komodo 10.4 T16  : 3020   9   9   1550    55.8 %   74.6 %  21.08         1 Komodo 10.4 T16 : 3022   10  10  1512    56.3 %   65.3 %  20.56
 2 Komodo 10.4 T8   : 2980   9   9   1550    44.2 %   74.6 %  20.48         2 Komodo 10.4 T8  : 2978   10  10  1512    43.7 %   65.3 %  19.88

 Result     : 865.0/1550 (+287,=1156,-107)                                  Result     : 851.5/1512 (+358,=987,-167)
 Perf.      : 55.8 %                                                        Perf.      : 56.3 %
 Elo        : 3041                                                          Elo        : 3044                  +3 Elo

---------------------------------------------------------------------------------------------------------------------------------------------- 
 
Linux – 16 threads vs 32 threads
 
TC = 10" + 0.1" – Contempt = 0                                              default Contempt = 10
 
    Program           Elo    +   -   Games   Score    Draws   Depth           Program           Elo    +   -   Games   Score    Draws   Depth
 -------------------------------------------------------------------       -------------------------------------------------------------------
  1 Komodo 10.4 T16 : 3002   10  10  1132    50.4 %   77.9 %  21.78         1 Komodo 10.4 T32 : 3004   11  11  1156    51.1 %   70.2 %  20.86
  2 Komodo 10.4 T32 : 2998   10  10  1132    49.6 %   77.9 %  20.64         2 Komodo 10.4 T16 : 2996   11  11  1156    48.9 %   70.2 %  21.37

  Result     : 561.0/1132 (+120,=882,-130)                                  Result     : 591.0/1156 (+185,=812,-159)
  Perf.      : 49.6 %                                                       Perf.      : 51.1 %
  Elo        : 2997                                                         Elo        : 3008                  -11 Elo

.

Post Reply