CCRL draw percentage?

Discussion of computer chess matches and engine tournaments.

Moderator: Ras

clumma
Posts: 187
Joined: Fri Oct 10, 2014 10:05 pm
Location: Berkeley, CA

CCRL draw percentage?

Post by clumma »

Bravo to CCRL for reporting stats like draw percentage and white score at the top of every page.

But these are apparently for all games ever played at a given time control.

I wonder -- and pardon if this is common knowledge around here -- Has the draw percentage increased among top engines recently? Has the white score changed?

I think this would be most interesting to know for top engines at the 40/40 time control...

-Carl
clumma
Posts: 187
Joined: Fri Oct 10, 2014 10:05 pm
Location: Berkeley, CA

Re: CCRL draw percentage?

Post by clumma »

I had a look at some PGNs from CCRL

Code: Select all

Komodo 8 2014-09-05
  total: 1298
  draw: 636 (0.49)
	decided: 662
  white: 376 (0.57)
SF 6 2015-01-28
  total: 1542
  draw: 883 (0.57)
	decided: 659
  white: 397 (0.60)
Komodo 9.2 2015-08-21
  total: 1060
  draw: 505 (0.48)
	decided: 555
  white: 350 (0.63)
SF 7 2016-01-02
  total: 310
  draw: 185 (0.60)
	decided: 125
  white: 77 (0.62)
No real evidence these stats are changing, but only 4 data points here. And it's not clear what opposition is being faced. Are most CCRL bouts Swiss? That would be good.

I've heard the draw percentage in later TCEC rounds has been increasing, such that they're moving to an 'all possible openings' format next time. Are data available? I've always found the TCEC website unnavigable...

-Carl
Dan Cooper
Posts: 184
Joined: Sun Nov 01, 2015 3:15 am

Re: CCRL draw percentage?

Post by Dan Cooper »

I went through the CCRL master PGN between two engines with 4CPU in the name. Here's the rating list and draw % by year.

2007

Code: Select all


   # PLAYER                            : RATING  ERROR   POINTS  PLAYED    (%)   CFS(next)
   1 Rybka 2.3.2a 64-bit 4CPU          : 2465.3   21.5    625.0     883   70.8%      57
   2 Rybka 2.1 64-bit 4CPU             : 2450.1  158.6      8.0      12   66.7%      53
   3 Rybka 2.2 64-bit 4CPU             : 2444.1   43.3    106.5     160   66.6%      96
   4 Zap!Chess Zanzibar 64-bit 4CPU    : 2404.8   25.9    284.5     464   61.3%      62
   5 Zappa Mexico 64-bit 4CPU          : 2399.7   19.6    531.0     874   60.8%     100
   6 Deep Shredder 11 64-bit 4CPU      : 2347.8   21.8    349.5     664   52.6%      86
   7 Naum 2.2 64-bit 4CPU              : 2333.2   19.8    415.5     770   54.0%      93
   8 Deep Fritz 10.1 4CPU              : 2311.3   24.9    239.0     462   51.7%      57
   9 Hiarcs 11.1 4CPU                  : 2308.7   20.5    363.0     715   50.8%      69
  10 Naum 2.1 64-bit 4CPU              : 2301.2   25.4    245.0     491   49.9%      63
  11 Hiarcs 11 4CPU                    : 2293.2   45.7     58.0     130   44.6%      78
  12 Loop M1-T 64-bit 4CPU             : 2273.5   19.6    369.0     806   45.8%      52
  13 Hiarcs 11.2 4CPU                  : 2272.4   34.4     96.0     242   39.7%      62
  14 Deep Shredder 10 64-bit 4CPU      : 2266.1   22.9    253.5     556   45.6%      78
  15 Deep Fritz 10 4CPU                : 2254.5   24.1    223.0     494   45.1%      51
  16 Glaurung 2.0.1 64-bit 4CPU        : 2254.0   25.3    198.5     471   42.1%      99
  17 Deep Junior 10 4CPU               : 2210.9   24.5    217.0     558   38.9%      70
  18 Bright 0.2c 4CPU                  : 2192.1   64.5     25.0      66   37.9%      67
  19 Deep Sjeng 2.7 4CPU               : 2175.7   26.5    142.5     426   33.5%      53
  20 Scorpio 2.0 32-bit 4CPU           : 2172.8   66.6     22.5      67   33.6%      54
  21 Glaurung 1.2.1 64-bit 4CPU        : 2168.6   24.6    191.0     615   31.1%     ---

White advantage = 34.99 +/- 3.91
Draw rate (equal opponents) = 47.25 % +/- 0.75

2008

Code: Select all


   # PLAYER                           : RATING  ERROR   POINTS  PLAYED    (%)   CFS(next)
   1 Rybka 3 64-bit 4CPU              : 2550.7   21.2    687.5     888   77.4%      77
   2 Rybka 3 Human 64-bit 4CPU        : 2525.8   65.2     38.5      66   58.3%      96
   3 Naum 4 64-bit 4CPU               : 2460.9   28.7    253.5     398   63.7%      81
   4 Rybka 2.3.2a 64-bit 4CPU         : 2443.8   24.6    354.5     531   66.8%      99
   5 Deep Fritz 11 4CPU               : 2395.3   29.7    171.5     319   53.8%      80
   6 Zappa Mexico 64-bit 4CPU         : 2370.9   46.1     82.0     132   62.1%      51
   7 Zappa Mexico II 64-bit 4CPU      : 2370.3   18.0    596.0    1023   58.3%      50
   8 Naum 3.1 64-bit 4CPU             : 2370.2   20.9    446.5     759   58.8%      90
   9 Naum 3 64-bit 4CPU               : 2351.3   20.9    432.0     703   61.5%      98
  10 Deep Sjeng WC2008 64-bit 4CPU    : 2315.9   25.6    228.0     479   47.6%      73
  11 Deep Shredder 11 64-bit 4CPU     : 2306.7   19.1    386.5     801   48.3%      79
  12 Deep Sjeng 3.0 64-bit 4CPU       : 2294.3   24.4    246.0     505   48.7%      51
  13 Glaurung 2.2 64-bit 4CPU         : 2293.6   93.3     14.0      28   50.0%      53
  14 Toga II 1.4.1SE 4CPU             : 2290.4   18.4    444.0     934   47.5%      53
  15 Naum 2.2 64-bit 4CPU             : 2287.4   65.8     35.5      64   55.5%      52
  16 Hiarcs Paderborn 2007 4CPU       : 2285.5   28.4    157.5     374   42.1%      53
  17 Hiarcs 12 4CPU                   : 2284.3   18.0    452.5     965   46.9%      66
  18 Hiarcs 12 Sharpen PV On 4CPU     : 2278.5   21.5    315.5     622   50.7%      52
  19 Rybka 2.1 64-bit 4CPU            : 2274.4  150.3      6.5      12   54.2%      50
  20 Hiarcs 11.2 4CPU                 : 2273.5   46.5     72.0     123   58.5%      52
  21 Deep Fritz 10.1 4CPU             : 2272.4   24.4    209.0     452   46.2%      51
  22 Toga II 1.4 beta5c 4CPU          : 2272.0   19.2    415.5     834   49.8%      62
  23 Bright 0.4a 4CPU                 : 2267.0   24.0    249.0     612   40.7%      84
  24 Glaurung 2.1 64-bit 4CPU         : 2252.4   20.7    292.5     737   39.7%      68
  25 Hiarcs 11.1 4CPU                 : 2239.2   50.0     42.5     110   38.6%      71
  26 Loop M1-T 64-bit 4CPU            : 2223.5   22.4    219.0     581   37.7%      77
  27 Bright 0.3a 4CPU                 : 2213.3   20.0    326.5     811   40.3%      90
  28 Glaurung 2.0.1 64-bit 4CPU       : 2193.5   25.8    165.5     447   37.0%      57
  29 Bright 0.2c 4CPU                 : 2190.4   27.7    148.0     379   39.1%      74
  30 Deep Sjeng 2.7 4CPU              : 2177.7   31.7    112.5     309   36.4%      54
  31 Deep Junior 10 4CPU              : 2175.5   24.2    174.0     527   33.0%      97
  32 Scorpio 2.0 32-bit 4CPU          : 2099.2   71.1     19.0      61   31.1%     ---

White advantage = 44.98 +/- 3.04
Draw rate (equal opponents) = 47.57 % +/- 0.63

2009

Code: Select all


   # PLAYER                            : RATING  ERROR   POINTS  PLAYED    (%)   CFS(next)
   1 Rybka 3 64-bit 4CPU               : 2575.4   30.3    351.0     460   76.3%      68
   2 Rybka 3 Human 64-bit 4CPU         : 2562.4   47.7     93.0     141   66.0%     100
   3 Naum 4 64-bit 4CPU                : 2479.3   25.7    331.5     503   65.9%      57
   4 Stockfish 1.6.3 64-bit 4CPU       : 2474.5   47.2     78.0     135   57.8%      89
   5 Deep Shredder 12 64-bit 4CPU      : 2443.8   23.1    398.0     644   61.8%     100
   6 Stockfish 1.5.1 64-bit 4CPU       : 2376.1   26.5    266.0     495   53.7%      78
   7 Zappa Mexico II 64-bit 4CPU       : 2363.4   27.0    210.0     387   54.3%      62
   8 Rybka 2.2 64-bit 4CPU             : 2357.7   28.5    241.5     410   58.9%      66
   9 Stockfish 1.4 64-bit 4CPU         : 2351.7   19.1    526.5    1001   52.6%      56
  10 Naum 3.1 64-bit 4CPU              : 2345.5   71.4     29.5      56   52.7%      58
  11 Spark 0.3 64-bit 4CPU             : 2337.6   28.6    206.0     411   50.1%      63
  12 Thinker 5.4c Inert 64-bit 4CPU    : 2332.1   19.7    501.5     969   51.8%      61
  13 Deep Sjeng WC2008 64-bit 4CPU     : 2328.3   23.5    322.5     616   52.4%      62
  14 Deep Shredder 11 64-bit 4CPU      : 2323.0   27.8    223.5     416   53.7%      69
  15 Toga II 1.4.1SE 4CPU              : 2314.2   26.1    265.5     482   55.1%      60
  16 Bright 0.4a 4CPU                  : 2310.0   24.3    319.0     582   54.8%      51
  17 Deep Sjeng 3.0 64-bit 4CPU        : 2309.4   60.4     35.0      72   48.6%      52
  18 Thinker 5.4a Inert 64-bit 4CPU    : 2308.0   24.0    257.5     551   46.7%      71
  19 Hiarcs 12.1 4CPU                  : 2300.4   19.3    445.5    1018   43.8%      68
  20 Glaurung 2.2 64-bit 4CPU          : 2294.3   21.1    397.0     851   46.7%      63
  21 Hiarcs 12 4CPU                    : 2289.2   27.8    194.0     385   50.4%      54
  22 Glaurung 2.1 64-bit 4CPU          : 2282.8  120.2      6.0      24   25.0%      50
  23 Hiarcs Paderborn 2007 4CPU        : 2282.4   25.3    194.5     464   41.9%      52
  24 Rybka 2.3.2a 64-bit 4CPU          : 2275.0  247.0      1.0       6   16.7%      61
  25 Loop M1-T 64-bit 4CPU             : 2238.1   23.9    233.0     613   38.0%      83
  26 Deep Junior 10 4CPU               : 2214.3   42.4     84.0     162   51.9%      86
  27 Crafty 23.1 64-bit 4CPU           : 2184.5   47.4     51.5     139   37.1%      98
  28 Crafty 23.0 64-bit 4CPU           : 2131.1   23.3    239.0     697   34.3%      68
  29 Glaurung 1.2.1 64-bit 4CPU        : 2109.6   84.9     21.5      40   53.8%      64
  30 Scorpio 2.0 32-bit 4CPU           : 2092.4   33.9     99.5     332   30.0%      67
  31 Scorpio 2.1 64-bit 4CPU           : 2082.7   30.9    128.5     393   32.7%     100
  32 Pharaon 3.5.1 4CPU                : 1930.8   59.9     26.5      99   26.8%     ---

White advantage = 53.30 +/- 3.31
Draw rate (equal opponents) = 47.78 % +/- 0.67

2010

Code: Select all


   # PLAYER                            : RATING  ERROR   POINTS  PLAYED    (%)   CFS(next)
   1 Houdini 1.5a 64-bit 4CPU          : 2566.4   68.7     28.5      50   57.0%      93
   2 Rybka 4 64-bit 4CPU               : 2516.0   22.5    508.0     764   66.5%     100
   3 Stockfish 1.9.1 64-bit 4CPU       : 2475.5   27.2    326.0     487   66.9%      60
   4 Rybka 3 64-bit 4CPU               : 2470.6   28.5    207.5     361   57.5%      72
   5 Stockfish 1.8 64-bit 4CPU         : 2460.7   23.0    430.5     666   64.6%      62
   6 Stockfish 1.7.1 64-bit 4CPU       : 2456.8   22.8    438.0     729   60.1%      64
   7 Critter 0.90 64-bit 4CPU          : 2448.2   43.8     72.0     128   56.3%      92
   8 Naum 4.2 64-bit 4CPU              : 2413.0   23.2    310.5     562   55.2%      90
   9 Naum 4.1 64-bit 4CPU              : 2390.1   29.0    209.0     344   60.8%      65
  10 Critter 0.80 64-bit 4CPU          : 2379.4   44.1     60.5     126   48.0%      91
  11 Deep Shredder 12 64-bit 4CPU      : 2347.8   22.1    251.5     533   47.2%      69
  12 Stockfish 1.6.3 64-bit 4CPU       : 2338.5   29.4    228.0     375   60.8%      87
  13 Deep Fritz 12 4CPU                : 2311.1   34.2    102.0     224   45.5%      58
  14 Zappa Mexico II 64-bit 4CPU       : 2306.8   28.6    125.0     387   32.3%      74
  15 Naum 4 64-bit 4CPU                : 2280.5   72.7     20.0      48   41.7%      71
  16 Protector 1.3.6 64-bit 4CPU       : 2256.9   36.5    100.5     221   45.5%      71
  17 Spark 0.4 64-bit 4CPU             : 2244.3   27.0    161.0     454   35.5%      69
  18 Deep Sjeng WC2008 64-bit 4CPU     : 2234.7   26.9    126.0     490   25.7%      60
  19 Bright 0.4a 4CPU                  : 2224.4   75.7     17.0      49   34.7%      56
  20 Thinker 5.4d Inert 64-bit 4CPU    : 2217.7   31.9    122.0     265   46.0%      53
  21 Spark 0.3 64-bit 4CPU             : 2216.1   46.0     47.0     129   36.4%      58
  22 Thinker 5.4c Inert 64-bit 4CPU    : 2209.3   42.7     53.0     207   25.6%      50
  23 Hiarcs 12.1 4CPU                  : 2209.0   34.1     79.0     283   27.9%      51
  24 Onno 1.2.70 64-bit 4CPU           : 2207.9   44.7     57.5     123   46.7%      54
  25 Bright 0.5c 4CPU                  : 2203.7   79.4     11.0      54   20.4%      65
  26 Toga II 1.4.1SE 4CPU              : 2186.2   35.5    101.0     227   44.5%      97
  27 Jonny 4.00 4CPU                   : 2130.0   56.1     37.5      87   43.1%      65
  28 Crafty 23.3 64-bit 4CPU           : 2118.2   34.7    106.0     265   40.0%      71
  29 Deep Junior 10 4CPU               : 2094.3   89.7     14.0      30   46.7%      56
  30 Loop M1-T 64-bit 4CPU             : 2086.0   62.3     24.5      84   29.2%     ---

White advantage = 50.59 +/- 3.92
Draw rate (equal opponents) = 54.75 % +/- 0.94

2011

Code: Select all


   # PLAYER                            : RATING  ERROR   POINTS  PLAYED    (%)   CFS(next)
   1 Houdini 2.0c 64-bit 4CPU          : 2484.8   38.9    131.0     207   63.3%      88
   2 Houdini 1.5a 64-bit 4CPU          : 2460.5   25.4    389.5     586   66.5%     100
   3 Rybka 4.1 64-bit 4CPU             : 2421.3   24.4    412.5     661   62.4%      57
   4 Critter 1.2 64-bit 4CPU           : 2418.6   30.1    243.5     401   60.7%      60
   5 Rybka 4 64-bit 4CPU               : 2411.1   48.0     58.5     114   51.3%      76
   6 Stockfish 2.0.1 64-bit 4CPU       : 2394.2   26.5    290.0     514   56.4%      74
   7 Stockfish 2.1.1 64-bit 4CPU       : 2383.2   29.2    222.0     406   54.7%      99
   8 Critter 1.01 64-bit 4CPU          : 2330.1   38.7     91.5     193   47.4%      51
   9 Protector 1.3.6 64-bit 4CPU       : 2327.0  321.8      1.0       2   50.0%      50
  10 Critter 0.90 64-bit 4CPU          : 2327.0   40.9     64.5     158   40.8%      52
  11 Stockfish 1.9.1 64-bit 4CPU       : 2325.3   58.8     28.5      83   34.3%      52
  12 Naum 4.2 64-bit 4CPU              : 2323.8   28.7    223.0     471   47.3%      81
  13 Stockfish 1.7.1 64-bit 4CPU       : 2280.5   90.7     10.0      32   31.3%      54
  14 Stockfish 1.8 64-bit 4CPU         : 2273.8   95.6      9.5      31   30.6%      55
  15 Deep Shredder 12 64-bit 4CPU      : 2267.9   29.3    152.5     371   41.1%      53
  16 Spike 1.4 Leiden 4CPU             : 2266.8   23.7    333.5     766   43.5%      59
  17 Deep Junior 12.5 64-bit 4CPU      : 2263.3   29.1    202.5     448   45.2%      93
  18 Zappa Mexico II 64-bit 4CPU       : 2235.5   33.7    119.0     278   42.8%      67
  19 Hiarcs 13.2 4CPU                  : 2227.0   26.2    224.5     535   42.0%      62
  20 Protector 1.4.0 64-bit 4CPU       : 2221.1   35.4    114.0     249   45.8%      77
  21 Spark 1.0 64-bit 4CPU             : 2207.6   28.6    189.5     491   38.6%      68
  22 Onno 1.2.70 64-bit 4CPU           : 2195.4   46.4     78.5     157   50.0%      61
  23 Thinker 5.4c Inert 64-bit 4CPU    : 2187.2   54.2     42.5      96   44.3%      54
  24 Toga II 1.4.1SE 4CPU              : 2182.1   86.5     14.0      32   43.8%      93
  25 Loop M1-T 64-bit 4CPU             : 2084.8   97.2     10.5      30   35.0%     ---

White advantage = 49.73 +/- 4.19
Draw rate (equal opponents) = 52.10 % +/- 0.95

2012

Code: Select all


   # PLAYER                            : RATING  ERROR   POINTS  PLAYED    (%)   CFS(next)
   1 Houdini 3 64-bit 4CPU             : 2556.6   25.1    553.5     792   69.9%     100
   2 Houdini 2.0c 64-bit 4CPU          : 2517.2   25.3    583.5     874   66.8%      68
   3 Houdini 1.5a 64-bit 4CPU          : 2503.1   56.0     34.0      70   48.6%      84
   4 Critter 1.6a 64-bit 4CPU          : 2474.7   22.6    579.0     999   58.0%      53
   5 Critter 1.01 64-bit 4CPU          : 2472.1   78.4     22.5      36   62.5%      61
   6 Rybka 4 64-bit 4CPU               : 2460.1   29.4    253.0     485   52.2%      57
   7 Critter 1.2 64-bit 4CPU           : 2457.0   39.8    104.0     197   52.8%      52
   8 Critter 1.4 64-bit 4CPU           : 2455.9   26.0    447.5     729   61.4%      52
   9 Stockfish 2.2.2 64-bit 4CPU       : 2455.4   22.4    562.0     949   59.2%      58
  10 Rybka 4.1 64-bit 4CPU             : 2453.0   23.8    448.5     817   54.9%      82
  11 Stockfish 2.3.1 64-bit 4CPU       : 2441.3   27.4    275.5     521   52.9%      52
  12 Sting SF 2 64-bit 4CPU            : 2440.0   51.6     38.5      90   42.8%      57
  13 Bouquet 1.5 64-bit 4CPU           : 2435.3   32.6    141.0     296   47.6%      86
  14 IvanHoe 9.46h 64-bit 4CPU         : 2417.0   23.8    499.5     917   54.5%      71
  15 Vitruvius 1.11C 64-bit 4CPU       : 2410.5   25.1    353.0     670   52.7%     100
  16 Hiarcs 14 4CPU                    : 2357.6   26.8    214.0     485   44.1%      68
  17 Naum 4.2 64-bit 4CPU              : 2351.2   24.6    292.5     657   44.5%      52
  18 Chiron 1.1a 64-bit 4CPU           : 2350.5   27.3    204.0     468   43.6%      98
  19 Deep Fritz 13 4CPU                : 2319.3   27.6    202.0     528   38.3%      52
  20 Deep Junior 12.5 64-bit 4CPU      : 2317.6   67.7     25.5      50   51.0%      52
  21 Deep Junior 13.3 64-bit 4CPU      : 2315.8   27.6    215.0     555   38.7%      66
  22 Deep Junior 13 64-bit 4CPU        : 2310.5   23.0    380.5     886   42.9%      58
  23 Deep Shredder 12 64-bit 4CPU      : 2308.0   27.0    234.0     593   39.5%      50
  24 Chiron 1.5 64-bit 4CPU            : 2307.6   76.8     13.0      52   25.0%      55
  25 Spike 1.4 Leiden 4CPU             : 2302.8   25.9    231.5     624   37.1%      72
  26 Critter 0.80 64-bit 4CPU          : 2278.2   81.3     13.0      36   36.1%      54
  27 Protector 1.4.0 64-bit 4CPU       : 2273.4   31.7    111.0     343   32.4%      64
  28 Zappa Mexico II 64-bit 4CPU       : 2266.5   29.8    138.0     367   37.6%      53
  29 Rybka 2.3.2a 64-bit 4CPU          : 2263.4   70.0     14.5      72   20.1%      57
  30 Hiarcs 13.2 4CPU                  : 2256.8   34.6     83.5     262   31.9%      81
  31 Spark 1.0 64-bit 4CPU             : 2237.2   32.0     92.5     260   35.6%      81
  32 Onno 1.2.70 64-bit 4CPU           : 2196.0   82.1     22.5      38   59.2%      62
  33 Thinker 5.4d Inert 64-bit 4CPU    : 2175.0  124.4      9.0      16   56.3%      64
  34 Toga II 1.4.1SE 4CPU              : 2149.5   58.8     24.5      70   35.0%      73
  35 Tornado 4.88 64-bit 4CPU          : 2122.6   64.1     68.0     121   56.2%      74
  36 Bright 0.5c 4CPU                  : 2103.5   66.6     56.5     104   54.3%      64
  37 MinkoChess 1.3 64-bit 4CPU        : 2092.6   66.5     55.0     105   52.4%      74
  38 Crafty 23.4 64-bit 4CPU           : 2072.8   62.0     58.0     120   48.3%      87
  39 Scorpio 2.7.5 64-bit 4CPU         : 2034.9   78.7     27.0      60   45.0%      53
  40 BugChess2 1.9 64-bit 4CPU         : 2032.0   69.8     44.0     100   44.0%      82
  41 Jonny 4.00 4CPU                   : 2002.8   70.0     39.5     100   39.5%      99
  42 Pharaon 3.5.1 4CPU                : 1852.7  129.9      5.5      24   22.9%     ---

White advantage = 45.78 +/- 2.85
Draw rate (equal opponents) = 57.64 % +/- 0.64
2013

Code: Select all


   # PLAYER                            : RATING  ERROR   POINTS  PLAYED    (%)   CFS(next)
   1 Houdini 4 64-bit 4CPU             : 2555.3   29.3    190.0     352   54.0%      50
   2 Stockfish DD 64-bit 4CPU          : 2555.3   26.7    278.0     462   60.2%      68
   3 Houdini 3 64-bit 4CPU             : 2548.1   20.6    590.5     937   63.0%      75
   4 Komodo TCEC 64-bit 4CPU           : 2535.7   33.6    136.5     252   54.2%      66
   5 Komodo 6 64-bit 4CPU              : 2528.4   19.9    617.0    1055   58.5%      66
   6 Stockfish 4 64-bit 4CPU           : 2524.3   19.6    635.0    1044   60.8%      77
   7 Komodo 5.1 64-bit 4CPU            : 2515.9   22.2    442.0     715   61.8%      89
   8 Houdini 1.5a 64-bit 4CPU          : 2479.2   56.4     49.5      74   66.9%      52
   9 Stockfish 3 64-bit 4CPU           : 2477.9   22.7    336.0     603   55.7%      74
  10 Critter 1.6a 64-bit 4CPU          : 2470.3   19.5    495.0     937   52.8%      63
  11 Stockfish 2.3.1 64-bit 4CPU       : 2465.3   31.0    162.0     269   60.2%      88
  12 Rybka 4.1 64-bit 4CPU             : 2446.8   19.9    419.5     868   48.3%      53
  13 Vitruvius 1.11C 64-bit 4CPU       : 2445.9   24.4    245.5     451   54.4%      69
  14 Gull 2.3 64-bit 4CPU              : 2439.2   21.9    309.5     637   48.6%      52
  15 Bouquet 1.8 64-bit 4CPU           : 2438.6   23.6    273.5     527   51.9%      52
  16 Bouquet 1.5 64-bit 4CPU           : 2437.8   39.7     62.5     148   42.2%      62
  17 Rybka 4 64-bit 4CPU               : 2430.1   32.2    117.0     276   42.4%      60
  18 IvanHoe 9.46h 64-bit 4CPU         : 2425.6   23.0    253.0     487   52.0%      88
  19 RobboLito 0.21Q 64-bit 4CPU       : 2408.7   23.2    265.5     527   50.4%      53
  20 Bouquet 1.6 64-bit 4CPU           : 2407.6   21.9    314.0     630   49.8%      58
  21 Sting SF 3 64-bit 4CPU            : 2405.1   22.3    301.5     633   47.6%      66
  22 Sting SF 2 64-bit 4CPU            : 2398.1   29.5    136.5     271   50.4%      89
  23 Gull 2.2 64-bit 4CPU              : 2375.6   25.5    182.5     440   41.5%      64
  24 Hannibal 1.4b 64-bit 4CPU         : 2370.0   25.9    195.0     466   41.8%      58
  25 Chiron 2 64-bit 4CPU              : 2360.3   84.7     11.0      44   25.0%      59
  26 Protector 1.5.0 64-bit 4CPU       : 2350.0   23.0    212.5     496   42.8%      53
  27 Naum 4.2 64-bit 4CPU              : 2348.9   22.5    251.5     656   38.3%      83
  28 Hiarcs 14 4CPU                    : 2336.1   23.5    198.0     509   38.9%      60
  29 Chiron 1.5 64-bit 4CPU            : 2332.7   20.2    315.5     741   42.6%      60
  30 Deep Fritz 14 64-bit 4CPU         : 2326.3   45.9     38.0     102   37.3%      58
  31 Hannibal 1.3 64-bit 4CPU          : 2321.2   22.1    239.5     577   41.5%      56
  32 Gull R375 64-bit 4CPU             : 2319.0   23.7    220.0     532   41.4%      55
  33 Spike 1.4 Leiden 4CPU             : 2316.5   37.4     79.0     159   49.7%      62
  34 Deep Fritz 13 4CPU                : 2310.0   23.4    223.0     501   44.5%      51
  35 Deep Shredder 12 64-bit 4CPU      : 2309.2   79.8     22.5      37   60.8%      55
  36 Protector 1.4.0 64-bit 4CPU       : 2301.8   95.7     15.5      26   59.6%      54
  37 Deep Junior 13.3 64-bit 4CPU      : 2296.1   39.5     71.0     142   50.0%      50
  38 Rybka 2.3.2a 64-bit 4CPU          : 2296.1   53.4     30.5      74   41.2%      65
  39 Chiron 1.1a 64-bit 4CPU           : 2282.1   47.6     36.0     138   26.1%      89
  40 Spark 1.0 64-bit 4CPU             : 2239.3   46.0     57.0     106   53.8%      81
  41 Thinker 5.4d Inert 64-bit 4CPU    : 2208.2   54.9     45.5      78   58.3%      72
  42 Toga II 3.0 4CPU                  : 2187.6   46.9     49.5     106   46.7%      64
  43 Onno 1.2.70 64-bit 4CPU           : 2176.0   48.9     41.5      95   43.7%      58
  44 Deep Sjeng WC2008 64-bit 4CPU     : 2165.8   83.7     16.0      28   57.1%      53
  45 Zappa Mexico II 64-bit 4CPU       : 2161.8   47.9     40.0      96   41.7%      83
  46 MinkoChess 1.3 64-bit 4CPU        : 2130.1   48.6     50.5     108   46.8%      61
  47 Crafty 23.4 64-bit 4CPU           : 2118.8   73.9     19.5      42   46.4%      55
  48 Tornado 4.88 64-bit 4CPU          : 2113.5   46.7     48.0     108   44.4%      59
  49 Scorpio 2.7.5 64-bit 4CPU         : 2106.8   46.3     51.5     114   45.2%      55
  50 Bright 0.5c 4CPU                  : 2103.2   49.6     42.5     100   42.5%      68
  51 Gaviota 0.86 64-bit 4CPU          : 2088.0   52.6     37.0      88   42.0%      60
  52 BugChess2 1.9 64-bit 4CPU         : 2080.5   45.8     68.0     140   48.6%      93
  53 Jonny 4.00 4CPU                   : 2037.2   53.2     51.5     108   47.7%      93
  54 Alfil 13.1 64-bit 4CPU            : 1987.8   58.0     39.0      86   45.3%      80
  55 Nebula 2.0 64-bit 4CPU            : 1943.7   96.2      7.5      28   26.8%      58
  56 Pharaon 3.5.1 4CPU                : 1932.4   71.5     25.5      58   44.0%     100
  57 FireFly 2.6.0 64-bit 4CPU         : 1428.3  219.3      1.5      40    3.8%     ---

White advantage = 41.32 +/- 2.39
Draw rate (equal opponents) = 61.22 % +/- 0.57
2014

Code: Select all


   # PLAYER                            : RATING  ERROR   POINTS  PLAYED    (%)   CFS(next)
   1 Komodo 8 64-bit 4CPU              : 2633.3   22.6    775.0    1078   71.9%      99
   2 Stockfish 5 64-bit 4CPU           : 2609.0   21.5    831.0    1225   67.8%      76
   3 Houdini 4 64-bit 4CPU             : 2601.7   21.4    739.0    1089   67.9%      98
   4 Stockfish DD 64-bit 4CPU          : 2573.4   28.0    312.5     478   65.4%      71
   5 Houdini 4 Tactical 64-bit 4CPU    : 2564.7   26.7    307.0     468   65.6%      60
   6 Komodo 7a 64-bit 4CPU             : 2561.1   22.7    544.5     897   60.7%      93
   7 Komodo TCEC 64-bit 4CPU           : 2541.4   25.8    372.0     581   64.0%      62
   8 Fire 4 64-bit 4CPU                : 2535.7   35.1    104.5     206   50.7%      68
   9 Vitruvius 1.11C 64-bit 4CPU       : 2510.0  104.6     15.0      22   68.2%      54
  10 Gull 2.8b 64-bit 4CPU             : 2504.9   25.9    273.5     508   53.8%      87
  11 Gull 3 64-bit 4CPU                : 2489.2   22.4    424.5     800   53.1%      54
  12 Equinox 3.20 64-bit 4CPU          : 2488.0   24.9    252.0     484   52.1%      51
  13 Equinox 3.30 64-bit 4CPU          : 2487.4   43.5     61.0     128   47.7%      59
  14 RobboLito 0.21Q 64-bit 4CPU       : 2474.2  103.4     14.0      22   63.6%      50
  15 Critter 1.6a 64-bit 4CPU          : 2474.0   22.7    391.0     802   48.8%      59
  16 Rybka 4 64-bit 4CPU               : 2469.6   38.0     78.0     186   41.9%      60
  17 Gull 2.3 64-bit 4CPU              : 2463.5   32.7    119.5     283   42.2%      57
  18 Fire 3.0 64-bit 4CPU              : 2460.5   21.8    467.0     946   49.4%      56
  19 Bouquet 1.8 64-bit 4CPU           : 2458.6   24.3    280.0     611   45.8%      60
  20 Rybka 4.1 64-bit 4CPU             : 2455.3   22.8    309.5     703   44.0%      90
  21 DeepSaros 4.1.6 64-bit 4CPU       : 2433.5   31.8    132.5     304   43.6%      66
  22 BlackMamba 2.0 64-bit 4CPU        : 2426.5   23.0    301.5     699   43.1%      99
  23 Sting SF 4 64-bit 4CPU            : 2397.1   25.2    230.0     550   41.8%      85
  24 Naum 4.6 64-bit 4CPU              : 2382.5   23.1    296.5     692   42.8%      72
  25 Deep Fritz 14 64-bit 4CPU         : 2375.3   21.0    380.5     921   41.3%      51
  26 Chiron 2 64-bit 4CPU              : 2374.9   21.2    378.0     973   38.8%      82
  27 Hannibal 1.4b 64-bit 4CPU         : 2363.3   24.5    243.0     666   36.5%      53
  28 Chiron 1.5 64-bit 4CPU            : 2359.2  101.8     10.5      22   47.7%      51
  29 Protector 1.7.0 64-bit 4CPU       : 2358.2   24.7    238.0     608   39.1%      51
  30 Protector 1.6.0 64-bit 4CPU       : 2357.6   24.4    203.0     531   38.2%      63
  31 Texel 1.04 64-bit 4CPU            : 2353.2   23.1    248.0     604   41.1%      78
  32 Protector 1.5.0 64-bit 4CPU       : 2339.5   31.2    112.5     295   38.1%      52
  33 Naum 4.2 64-bit 4CPU              : 2338.6   24.3    202.5     617   32.8%      77
  34 Hiarcs 14 4CPU                    : 2325.9   30.1    123.0     322   38.2%      60
  35 Deep Shredder 12 64-bit 4CPU      : 2319.8   37.9     72.0     169   42.6%      70
  36 Deep Junior 13.3 64-bit 4CPU      : 2303.2   48.7     57.5      96   59.9%      51
  37 Senpai 1.0 64-bit 4CPU            : 2302.7   26.1    169.0     360   46.9%      60
  38 Spike 1.4 Leiden 4CPU             : 2298.6   25.8    201.5     422   47.7%      60
  39 Texel 1.03 64-bit 4CPU            : 2293.3   32.9    108.5     210   51.7%      62
  40 Protector 1.4.0 64-bit 4CPU       : 2282.8   59.6     41.0      66   62.1%      87
  41 Spark 1.0 64-bit 4CPU             : 2243.4   38.1     90.0     164   54.9%      69
  42 Rybka 2.3.2a 64-bit 4CPU          : 2222.0   74.7     16.0      38   42.1%      51
  43 Hiarcs 13.2 4CPU                  : 2220.6  109.8     11.0      18   61.1%      59
  44 Onno 1.2.70 64-bit 4CPU           : 2207.8   38.2     72.0     156   46.2%      50
  45 Zappa Mexico II 64-bit 4CPU       : 2207.8   53.6     36.5      77   47.4%      51
  46 MinkoChess 1.3 64-bit 4CPU        : 2207.2   43.7     62.0     120   51.7%      60
  47 Toga II 3.0 4CPU                  : 2200.8   39.3     82.5     168   49.1%      53
  48 Tornado 4.88 64-bit 4CPU          : 2198.2   55.0     41.5      80   51.9%      50
  49 Crafty 23.4 64-bit 4CPU           : 2197.9  175.3      4.5       8   56.3%      53
  50 Gaviota 1.0 64-bit 4CPU           : 2191.0   35.9     74.5     182   40.9%      73
  51 Crafty 23.8 64-bit 4CPU           : 2176.0   33.0    113.5     235   48.3%      52
  52 Cheng4 0.36c 64-bit 4CPU          : 2175.2   36.7     95.5     192   49.7%      51
  53 Thinker 5.4d Inert 64-bit 4CPU    : 2174.4   58.0     26.5      64   41.4%      58
  54 Bright 0.5c 4CPU                  : 2164.9   75.8     16.5      37   44.6%      52
  55 Spark 0.4 64-bit 4CPU             : 2161.8   63.8     28.5      54   52.8%      54
  56 Scorpio 2.7.6 64-bit 4CPU         : 2158.0   36.8    118.5     232   51.1%      52
  57 Deep Sjeng WC2008 64-bit 4CPU     : 2155.4   77.7     16.0      37   43.2%      52
  58 Glaurung 2.1 64-bit 4CPU          : 2153.4   59.6     42.5      76   55.9%      58
  59 Crafty 24.1 64-bit 4CPU           : 2145.2   56.0     28.5      88   32.4%      61
  60 EXchess 7.18b 64-bit 4CPU         : 2135.3   34.4    113.0     238   47.5%      60
  61 Gaviota 0.86 64-bit 4CPU          : 2128.8   48.7     53.5     108   49.5%      66
  62 Arasan 16.3 64-bit 4CPU           : 2118.4   36.3    114.0     232   49.1%      85
  63 Octochess r5190 64-bit 4CPU       : 2097.5   35.2    120.5     264   45.6%      77
  64 BugChess2 1.9 64-bit 4CPU         : 2073.1   64.3     27.0      60   45.0%      73
  65 Bright 0.4a 4CPU                  : 2025.2  136.6      4.5      16   28.1%      54
  66 Nebula 2.0 64-bit 4CPU            : 2017.3   61.9     28.0      68   41.2%      53
  67 Scorpio 2.7.5 64-bit 4CPU         : 2008.6  250.0      1.0       4   25.0%      54
  68 Alfil 13.1 64-bit 4CPU            : 1994.8   56.2     41.0      98   41.8%      99
  69 RedQueen 1.1.97 64-bit 4CPU       : 1891.6   75.9     13.5      58   23.3%      99
  70 Gaviota 0.83 64-bit 4CPU          : 1607.2  232.8      1.0      10   10.0%     ---

White advantage = 33.22 +/- 2.22
Draw rate (equal opponents) = 59.58 % +/- 0.52
2015

Code: Select all


   # PLAYER                            : RATING  ERROR   POINTS  PLAYED    (%)   CFS(next)
   1 Komodo 9.2 64-bit 4CPU            : 2714.4   22.8    730.5     976   74.8%      71
   2 Komodo 9.3 64-bit 4CPU            : 2707.3   24.1    606.0     830   73.0%      94
   3 Komodo 9.1 64-bit 4CPU            : 2687.0   23.3    533.5     748   71.3%      50
   4 Komodo 9 64-bit 4CPU              : 2686.9   24.0    542.5     774   70.1%      97
   5 Stockfish 6 64-bit 4CPU           : 2666.5   18.8   1007.5    1542   65.3%      57
   6 Gull 2.2 64-bit 4CPU              : 2650.6  170.4     26.0      29   89.7%      55
   7 Stockfish 5 64-bit 4CPU           : 2638.7   57.0     50.5      79   63.9%      52
   8 Komodo 8 64-bit 4CPU              : 2637.5   39.4     92.5     171   54.1%     100
   9 Houdini 4 64-bit 4CPU             : 2584.0   21.8    369.0     798   46.2%      56
  10 DeepSaros 4.1.6 64-bit 4CPU       : 2572.4  153.1      8.5      12   70.8%      60
  11 Houdini 4 Tactical 64-bit 4CPU    : 2549.2   82.0     18.5      36   51.4%      53
  12 Gull 3 64-bit 4CPU                : 2546.3   20.9    357.5     767   46.6%      64
  13 Fire 4 64-bit 4CPU                : 2542.3   21.4    487.5    1043   46.7%      97
  14 Equinox 3.20 64-bit 4CPU          : 2519.6   27.0    192.5     516   37.3%      69
  15 Gull 2.8b 64-bit 4CPU             : 2510.1   34.0     92.5     255   36.3%      70
  16 Equinox 3.30 64-bit 4CPU          : 2500.1   24.5    264.0     590   44.7%      61
  17 Critter 1.6a 64-bit 4CPU          : 2496.4   22.5    283.5     745   38.1%      52
  18 Rybka 4 64-bit 4CPU               : 2495.6   27.9    161.5     488   33.1%      61
  19 NirvanaChess 2.2 64-bit 4CPU      : 2491.4   24.3    233.0     531   43.9%      62
  20 Alfil 15.7 64-bit 4CPU            : 2487.2   25.1    250.5     542   46.2%      52
  21 Bouquet 1.8 64-bit 4CPU           : 2486.6   23.4    242.5     635   38.2%      69
  22 Rybka 4.1 64-bit 4CPU             : 2478.5   28.2    156.5     406   38.5%      52
  23 Fritz 15 64-bit 4CPU              : 2477.5   30.0    131.0     351   37.3%      50
  24 Sting SF 4.8.4 64-bit 4CPU        : 2477.4   29.9    157.5     297   53.0%      59
  25 Protector 1.9.0 64-bit 4CPU       : 2473.1   25.9    190.0     442   43.0%      62
  26 BlackMamba 2.0 64-bit 4CPU        : 2468.0   24.3    216.0     464   46.6%      63
  27 Protector 1.8.0 64-bit 4CPU       : 2462.5   26.8    192.5     382   50.4%      54
  28 Elektro 1.2 64-bit 4CPU           : 2460.7   24.0    239.0     519   46.1%      76
  29 Sting SF 5 64-bit 4CPU            : 2449.9   24.6    219.5     461   47.6%      54
  30 Andscacs 0.84 64-bit 4CPU         : 2446.1   81.2     15.0      32   46.9%      51
  31 Hannibal 1.5 64-bit 4CPU          : 2445.3   22.7    308.0     585   52.6%      71
  32 Andscacs 0.83 64-bit 4CPU         : 2436.7   27.5    157.5     338   46.6%      71
  33 Naum 4.6 64-bit 4CPU              : 2427.6   23.3    231.0     482   47.9%      54
  34 Hannibal 1.4b 64-bit 4CPU         : 2424.8   43.4     82.5     130   63.5%      51
  35 Critter 1.01 64-bit 4CPU          : 2423.9  109.0      8.5      20   42.5%      51
  36 NirvanaChess 2.1c 64-bit 4CPU     : 2422.7   21.9    264.0     594   44.4%      67
  37 Texel 1.05 64-bit 4CPU            : 2417.0   20.8    319.0     716   44.6%      57
  38 Andscacs 0.82 64-bit 4CPU         : 2414.3   28.1    165.5     328   50.5%      50
  39 Protector 1.7.0 64-bit 4CPU       : 2414.1   41.3     77.0     141   54.6%      51
  40 Chiron 2 64-bit 4CPU              : 2413.7   32.8    118.0     249   47.4%      53
  41 Vitruvius 1.11C 64-bit 4CPU       : 2410.0   87.9     12.5      30   41.7%      54
  42 Protector 1.6.0 64-bit 4CPU       : 2404.3   73.1     31.0      47   66.0%      52
  43 Andscacs 0.81 64-bit 4CPU         : 2401.8   31.4    131.5     280   47.0%      53
  44 Protector 1.5.0 64-bit 4CPU       : 2399.4   65.0     37.5      59   63.6%      63
  45 Alfil 15.8 64-bit 4CPU            : 2388.6   27.5    169.0     326   51.8%      65
  46 NirvanaChess 2.0a 64-bit 4CPU     : 2380.9   29.3    145.0     325   44.6%      54
  47 Stockfish 1.6.3 64-bit 4CPU       : 2377.1   61.4     25.5      63   40.5%      55
  48 Hiarcs 14 4CPU                    : 2372.7   34.5    106.0     216   49.1%      56
  49 Texel 1.04 64-bit 4CPU            : 2367.1   68.8     30.5      48   63.5%      54
  50 Critter 0.90 64-bit 4CPU          : 2360.8   92.6     12.5      26   48.1%      52
  51 Gull R375 64-bit 4CPU             : 2357.5   58.4     40.0      68   58.8%      50
  52 Chiron 1.1a 64-bit 4CPU           : 2357.2   91.2     16.5      28   58.9%      51
  53 Rybka 2.1 64-bit 4CPU             : 2355.1   64.3     30.0      51   58.8%      53
  54 Deep Shredder 12 64-bit 4CPU      : 2352.0   61.7     25.0      59   42.4%      51
  55 Critter 0.80 64-bit 4CPU          : 2350.8  100.5     12.0      24   50.0%      50
  56 Texel 1.03 64-bit 4CPU            : 2350.4  110.9     11.5      19   60.5%      56
  57 Rybka 2.3.2a 64-bit 4CPU          : 2341.7   39.7     68.0     153   44.4%      55
  58 Andscacs 0.80 64-bit 4CPU         : 2338.5   29.6    152.5     305   50.0%      53
  59 Deep Junior 13 64-bit 4CPU        : 2336.0   61.7     34.0      59   57.6%      52
  60 Cheng 4.39 64-bit 4CPU            : 2334.6   24.1    209.5     420   49.9%      54
  61 Senpai 1.0 64-bit 4CPU            : 2333.1   25.9    153.5     364   42.2%      51
  62 Hannibal 1.3 64-bit 4CPU          : 2332.3   86.6     21.5      34   63.2%      52
  63 Protector 1.4.0 64-bit 4CPU       : 2330.0   60.2     50.5      71   71.1%      63
  64 Spike 1.4 Leiden 4CPU             : 2318.8   30.1    130.0     260   50.0%      56
  65 Sting SF 4 64-bit 4CPU            : 2307.3  148.4      5.0      10   50.0%      50
  66 Fizbo 1.5 64-bit 4CPU             : 2307.3   27.5    187.0     356   52.5%      50
  67 Naum 3 64-bit 4CPU                : 2307.2   71.4     20.0      42   47.6%      55
  68 Deep Junior 13.3 64-bit 4CPU      : 2301.1   63.8     31.5      54   58.3%      53
  69 Spark 1.0 64-bit 4CPU             : 2298.4   27.5    174.5     309   56.5%      69
  70 Zappa Mexico 64-bit 4CPU          : 2282.1   60.9     29.5      59   50.0%      53
  71 Cheng4 0.38 64-bit 4CPU           : 2279.8   22.5    232.5     507   45.9%      64
  72 Arasan 18.2 64-bit 4CPU           : 2272.8   32.0    160.0     299   53.5%      63
  73 Naum 2.2 64-bit 4CPU              : 2247.4  147.8      5.0      10   50.0%      50
  74 Fizbo 1.31 64-bit 4CPU            : 2247.4   26.7    175.0     344   50.9%      53
  75 Hiarcs 13.2 4CPU                  : 2245.0   70.1     28.5      48   59.4%      52
  76 Thinker 5.4d Inert 64-bit 4CPU    : 2242.3   85.9     14.0      31   45.2%      52
  77 Onno 1.2.70 64-bit 4CPU           : 2240.1   54.4     38.0      73   52.1%      54
  78 Spark 0.4 64-bit 4CPU             : 2236.5   44.4     76.0     128   59.4%      56
  79 Arasan 18.0 64-bit 4CPU           : 2232.3   29.5    169.5     358   47.3%      50
  80 Gaviota 1.0 64-bit 4CPU           : 2232.2   23.5    218.0     450   48.4%      53
  81 Stockfish 1.4 64-bit 4CPU         : 2229.4   70.0     21.5      48   44.8%      51
  82 EXchess 7.71b 64-bit 4CPU         : 2228.7   26.5    207.0     385   53.8%      59
  83 Bobcat 7.1 64-bit 4CPU            : 2222.0   51.4     42.0      87   48.3%      53
  84 Fizbo 1.4 64-bit 4CPU             : 2219.6   26.5    179.0     390   45.9%      57
  85 EXchess 7.51b 64-bit 4CPU         : 2215.7   33.8    116.0     220   52.7%      51
  86 Arasan 17.5 64-bit 4CPU           : 2215.2   26.2    180.5     386   46.8%      57
  87 Toga II 3.0 4CPU                  : 2211.1   40.0     69.0     139   49.6%      86
  88 BugChess2 1.9 64-bit 4CPU         : 2180.6   43.0     67.0     124   54.0%      51
  89 Tornado 6.0 64-bit 4CPU           : 2180.2   26.4    179.0     388   46.1%      51
  90 Deep Sjeng WC2008 64-bit 4CPU     : 2179.4   43.0     55.0     122   45.1%      54
  91 Glaurung 2.2 64-bit 4CPU          : 2176.5   32.0     94.5     224   42.2%      51
  92 Arasan 16.3 64-bit 4CPU           : 2175.1   86.3     15.0      30   50.0%      56
  93 Tornado 7 64-bit 4CPU             : 2167.9   28.4    150.5     316   47.6%      50
  94 Bright 0.4a 4CPU                  : 2167.8   47.0     43.5     117   37.2%      55
  95 MinkoChess 1.3 64-bit 4CPU        : 2164.2   33.4     89.0     207   43.0%      51
  96 Bright 0.5c 4CPU                  : 2163.4   39.0     83.0     164   50.6%      50
  97 Jonny 4.00 4CPU                   : 2163.0   72.2     21.0      40   52.5%      53
  98 Cheng4 0.36c 64-bit 4CPU          : 2159.7   46.3     47.0      99   47.5%      61
  99 Pedone 1.3 64-bit 4CPU            : 2152.4   30.9    135.0     291   46.4%      56
 100 Crafty 24.1 64-bit 4CPU           : 2149.4   31.7    109.5     230   47.6%      52
 101 The Baron 3.29 64-bit 4CPU        : 2148.4   27.5    173.5     360   48.2%      56
 102 Scorpio 2.7.6 64-bit 4CPU         : 2144.9   35.4     82.0     188   43.6%      52
 103 Tornado 4.88 64-bit 4CPU          : 2143.0   48.4     34.5     109   31.7%      51
 104 Bobcat 6.4b 64-bit 4CPU           : 2142.2   27.4    184.5     391   47.2%      63
 105 Glaurung 2.1 64-bit 4CPU          : 2128.6   83.9     15.5      30   51.7%      50
 106 Scorpio 2.7.7 64-bit 4CPU         : 2128.6   30.7    120.0     290   41.4%      52
 107 Zappa Mexico II 64-bit 4CPU       : 2127.2   53.3     28.5      80   35.6%      52
 108 Gaviota 0.86 64-bit 4CPU          : 2125.2   39.8     72.0     161   44.7%      97
 109 Octochess r5190 64-bit 4CPU       : 2074.8   38.0     65.0     168   38.7%      58
 110 Pedone 1.1 64-bit 4CPU            : 2069.6   34.9    179.5     333   53.9%      51
 111 Crafty 23.4 64-bit 4CPU           : 2067.6  115.2      6.0      18   33.3%      51
 112 Pedone 1.2 64-bit 4CPU            : 2065.4   39.3     96.5     200   48.3%      62
 113 Naum 2.1 64-bit 4CPU              : 2044.8  124.8      5.5      18   30.6%      69
 114 Glaurung 1.2.1 64-bit 4CPU        : 2003.4   96.2     10.5      26   40.4%      66
 115 Nebula 2.0 64-bit 4CPU            : 1981.2   50.9     77.0     144   53.5%      73
 116 Alfil 13.1 64-bit 4CPU            : 1961.4   52.4     51.0     114   44.7%      77
 117 Pharaon 3.5.1 4CPU                : 1935.0   61.3     41.0      84   48.8%      67
 118 Hamsters 0.7.1 4CPU               : 1916.6   78.6     25.0      48   52.1%      56
 119 Jellyfish 1.1 64-bit 4CPU         : 1910.2   70.5     27.5      58   47.4%      55
 120 RedQueen 1.1.97 64-bit 4CPU       : 1905.8   55.4     58.5     124   47.2%     100
 121 Fridolin 2.0 64-bit 4CPU          : 1822.4   54.7     46.0     140   32.9%      68
 122 Gaviota 0.83 64-bit 4CPU          : 1796.9   97.5      8.0      56   14.3%      65
 123 Delphil 3.2 64-bit 4CPU           : 1773.6   67.3     26.0      84   31.0%     100
 124 Myrddin 0.87 64-bit 4CPU          : 1528.4  163.7      3.0      28   10.7%     ---

White advantage = 36.04 +/- 1.96
Draw rate (equal opponents) = 58.03 % +/- 0.44
clumma
Posts: 187
Joined: Fri Oct 10, 2014 10:05 pm
Location: Berkeley, CA

Re: CCRL draw percentage?

Post by clumma »

Thank you, Dan! That certainly looks like evidence draw % is increasing. Not so clear what's going on with white's advantage.

-Carl
clumma
Posts: 187
Joined: Fri Oct 10, 2014 10:05 pm
Location: Berkeley, CA

Re: CCRL draw percentage?

Post by clumma »

Assuming chess is a draw and that we're within ~ 400 Elo of perfect play with current engines (and closing fast), I expect both the draw percentage and white's advantage to increase.

Intensifying competition can also cause them to increase. White's advantage increases with the average Elo of play and decreases with the Elo difference between players.

Competition among top engines actually fell during Rybka's heyday, as older projects weren't willing or able to adopt tuning-driven development practices. But the field has become competitive again in the past 2-3 years, with almost no Elo difference between the top two engines at long time controls.

As long as the Elo gap between engines is small, white's advantage should be a function of their distance from perfect play (reaching 100% in the limit). Same with the draw percentage.

-Carl
whereagles
Posts: 565
Joined: Thu Nov 13, 2014 12:03 pm

Re: CCRL draw percentage?

Post by whereagles »

Quick back-of-the-envelope calculation w/ R:

Code: Select all

> xad
  year white  draw
1 2007 34.99 47.25
2 2008 44.98 47.57
3 2009 53.30 47.78
4 2010 50.59 54.75
5 2011 49.73 52.10
6 2012 45.78 57.64
7 2013 41.32 61.22
8 2014 33.22 59.58
9 2015 36.04 58.03
> summary(lm(draw~year,data=xad))

Call:
lm(formula = draw ~ year, data = xad)

Residuals:
    Min      1Q  Median      3Q     Max 
-3.2224 -1.8911  0.1429  1.8336  3.5982 

Coefficients:
              Estimate Std. Error t value Pr(>|t|)    
(Intercept) -3596.6442   656.7668  -5.476 0.000930 ***
year            1.8153     0.3266   5.559 0.000852 ***
---
Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1

Residual standard error: 2.53 on 7 degrees of freedom
Multiple R-squared:  0.8153,	Adjusted R-squared:  0.7889 
F-statistic:  30.9 on 1 and 7 DF,  p-value: 0.0008523

> summary(lm(white~year,data=xad))

Call:
lm(formula = white ~ year, data = xad)

Residuals:
     Min       1Q   Median       3Q      Max 
-12.3278  -3.2978  -0.0128   6.2647   7.9772 

Coefficients:
             Estimate Std. Error t value Pr(>|t|)
(Intercept) 2049.3003  1890.1709   1.084    0.314
year          -0.9975     0.9399  -1.061    0.324

Residual standard error: 7.281 on 7 degrees of freedom
Multiple R-squared:  0.1386,	Adjusted R-squared:  0.01554 
F-statistic: 1.126 on 1 and 7 DF,  p-value: 0.3238
Draw rate significantly going up, white advantage not representable by a linear model.
clumma
Posts: 187
Joined: Fri Oct 10, 2014 10:05 pm
Location: Berkeley, CA

Re: CCRL draw percentage?

Post by clumma »

The CCRL data is a bit of a black box until the the Elo gap between opponents is characterized. The number of pairings between strong and weak engines could vary from year to year.

The data should be sliced into sections by Elo.
Norm Pollock
Posts: 1070
Joined: Thu Mar 09, 2006 4:15 pm
Location: Long Island, NY, USA

Re: CCRL draw percentage?

Post by Norm Pollock »

Of the 627,825 games in the current CCRL 40/40, there are (by my count, there may be more) 4,682 intra-family games. Intra-family games have a higher draw rate because of the similarity of analysis.

The intra-family games:

White Wins = 1229 ( 26.25 % )
Draws = 2758 ( 58.91 % )
Black Wins = 695 ( 14.84 % )
White Pct = 55.7 %
Black Pct = 44.3 %

All games, including intra-family games:

White Wins = 218616 ( 34.82 % )
Draws = 247209 ( 39.38 % )
Black Wins = 162000 ( 25.8 % )
White Pct = 54.51 %
Black Pct = 45.49 %

Another issue is the Elo distance between players.
For the entire 627,825 games:
Elo Distance: Maximum = 852 Average = 72.276
User avatar
Graham Banks
Posts: 44127
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: CCRL draw percentage?

Post by Graham Banks »

clumma wrote:The CCRL data is a bit of a black box until the the Elo gap between opponents is characterized. The number of pairings between strong and weak engines could vary from year to year.

The data should be sliced into sections by Elo.
The average opponent rating is already there for each engine.

Image

If you click on the engine name from the list, it will bring up the opponents played.

Image
gbanksnz at gmail.com
clumma
Posts: 187
Joined: Fri Oct 10, 2014 10:05 pm
Location: Berkeley, CA

Re: CCRL draw percentage?

Post by clumma »

Whoa, I never knew you could click on the engine names! Cool.

I put some draw percentages together for the nearest opposition of some well-known engines:

Code: Select all

SF7MP v Komodo9.2MP: 7 Elo, 76% draw
SF6MP v Komodo8MP: 7 Elo, 72% draw
SF5 v Komodo8: 13 Elo, 74% draw

Houdini4MP v SFDDMP: 11 Elo, 53% draw
Houdini4 v
  Komodo7a: 1 Elo, 67% draw
  SFDD: 7 Elo, 50% draw

Rybka4.1MP v
  Gull2.3MP: 1 Elo, 56% draw
  SF2.3.1MP: 1 Elo, 51% draw
  Critter1.4MP: 2 Elo, 58% draw
"Elo" is the Elo gap.

Is draw percentage increasing because we're nearing perfection, or because of different engines (contempt etc), different opening books and tablebases...?

-Carl