CCRL 40/4 engines

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

PaulieD
Posts: 213
Joined: Tue Jun 25, 2013 8:19 pm

CCRL 40/4 engines

Post by PaulieD »

Graham,

When will the 40/4 list be updated to the latest versions I.E. Stockfish 7 and Komodo 9.3 ?

I do not even check it any more, it used to be the first rating list I always checked.
Top
User avatar
Graham Banks
Posts: 41423
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: CCRL 40/4 engines

Post by Graham Banks »

PaulieD wrote:Graham,

When will the 40/4 list be updated to the latest versions I.E. Stockfish 7 and Komodo 9.3 ?

I do not even check it any more, it used to be the first rating list I always checked.

Code: Select all

CCRL 40/4 Rating List - Single-CPU engines
1350406 games played by 1552 programs, run by 20 testers
Ponder off, General books (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz)
Computed on February 13, 2016 with Bayeselo based on 1'350'406 games
Tested by CCRL team, 2005-2016, http://computerchess.org.uk/ccrl/404/

   Rank               Engine                 Elo   +    -   Score  AvOp  Games
      1 Stockfish 7 64-bit                  3352  +17  -17  80.3% -221.3  1507
      2 Komodo 9.3 64-bit                   3339  +15  -15  76.8% -198.0  1844
        Komodo 9.2 64-bit                   3336  +18  -18  83.5% -283.4  1614
        Stockfish 6 64-bit                  3315  +12  -11  70.8% -148.5  2865
        Komodo 9.1 64-bit                   3312  +15  -15  71.0% -148.2  1625
        Komodo 9 64-bit                     3257  +20  -20  73.9% -174.0   949
        Stockfish 5 64-bit                  3242  +19  -19  77.0% -202.4  1129
      3 Houdini 4 64-bit                    3237  +10  -10  60.6%  -75.9  4087
        Stockfish 020514 64-bit             3234  +17  -17  66.3% -108.1  1143
        Komodo 8 64-bit                     3233  +13  -12  66.7% -117.0  2311
        Stockfish 5 syzygy 64-bit           3232  +17  -17  72.3% -154.2  1328
        Stockfish DD 64-bit                 3224  +18  -18  57.0%  -44.1   912
        Houdini 3 64-bit                    3214  +14  -14  61.9%  -77.7  1756
        Komodo TCEC 64-bit                  3208  +20  -20  64.6% -101.7   855
        Komodo 7a 64-bit                    3203  +14  -14  66.0% -107.7  1681
        Houdini 2.0c 64-bit                 3199  +16  -15  68.2% -135.5  1564
        Houdini 3 Tactical 64-bit           3190  +39  -39  56.8%  -44.4   200
      4 Gull 3 64-bit                       3188  +13  -13  55.2%  -36.3  2144
      5 Fire 4 64-bit                       3186  +13  -12  58.7%  -63.4  2253

Code: Select all

CCRL 40/4 Rating List - Multi-CPU engines
1350406 games played by 1552 programs, run by 20 testers
Ponder off, General books (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz)
Computed on February 13, 2016 with Bayeselo based on 1'350'406 games
Tested by CCRL team, 2005-2016, http://computerchess.org.uk/ccrl/404/

 Rank               Engine                 Elo   +    -   Score  AvOp  Games
    1 Stockfish 251115 64-bit 4CPU        3414  +19  -19  74.7% -170.2  1022
    2 Komodo 9.2 64-bit 4CPU              3406  +19  -19  73.0% -162.4  1005
      Komodo 9.3 64-bit 4CPU              3399  +19  -18  72.5% -154.8  1027
      Stockfish 6 64-bit 4CPU             3387  +15  -15  67.7% -118.6  1485
      Komodo 9 64-bit 4CPU                3379  +16  -16  72.7% -150.6  1400
      Komodo 9.1 64-bit 4CPU              3375  +18  -18  72.9% -150.9  1100
      Stockfish 5 64-bit 4CPU             3362  +16  -16  71.8% -145.9  1380
      Komodo 8 64-bit 4CPU                3347  +16  -16  68.0% -120.4  1330
    3 Houdini 4 64-bit 4CPU               3329  +11  -11  62.6%  -94.0  3126
      Houdini 3 64-bit 4CPU               3317  +13  -13  77.3% -204.0  2382
      Komodo 7a 64-bit 4CPU               3317  +16  -15  61.5%  -76.4  1334
      Stockfish DD 64-bit 4CPU            3306  +15  -15  66.6% -122.4  1559
      BlackMamba 2.0 64-bit 4CPU          3294 +113 -110  60.0%  -51.0    20
      Komodo TCEC 64-bit 4CPU             3282  +16  -16  64.9% -111.3  1429
      Houdini 2.0c 64-bit 4CPU            3272  +12  -12  73.3% -172.4  2666
      Stockfish 4 64-bit 4CPU             3265  +17  -17  69.2% -145.8  1346
    4 Gull 3 64-bit 4CPU                  3263  +13  -13  50.9%  -14.7  2113
      Houdini 1.5a 64-bit 4CPU            3259  +16  -16  74.8% -186.1  1649
      Gull 2.8b 64-bit 4CPU               3253  +21  -21  70.1% -147.6   849
      Komodo 6 64-bit 4CPU                3248  +19  -19  66.1% -117.5   998
    5 Equinox 3.30 64-bit 4CPU            3243  +14  -14  41.1%  +55.7  1543
      Gull 2.3 64-bit 4CPU                3240  +17  -17  63.8% -101.4  1137
    6 Fire 4 64-bit 4CPU                  3237  +13  -13  46.1%  +23.2  1857
gbanksnz at gmail.com
Top
PaulieD
Posts: 213
Joined: Tue Jun 25, 2013 8:19 pm

Re: CCRL 40/4 engines

Post by PaulieD »

I simply needed to change the list I was viewing.
Thanks Graham
Top
User avatar
Graham Banks
Posts: 41423
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: CCRL 40/4 engines

Post by Graham Banks »

PaulieD wrote:I simply needed to change the list I was viewing.
Thanks Graham
No problem. :)
gbanksnz at gmail.com
Top
Modern Times
Posts: 3546
Joined: Thu Jun 07, 2012 11:02 pm

Re: CCRL 40/4 engines

Post by Modern Times »

PaulieD wrote:I simply needed to change the list I was viewing.
Thanks Graham
Stockfish 7 4CPU wasn't tested because Stockfish is already #1 on the list, and there seemed little point in my opinion. A later development version will be tested at the same time as a later Komodo release though.
Top
User avatar
Graham Banks
Posts: 41423
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: CCRL 40/4 engines

Post by Graham Banks »

Modern Times wrote:
PaulieD wrote:I simply needed to change the list I was viewing.
Thanks Graham
Stockfish 7 4CPU wasn't tested because Stockfish is already #1 on the list, and there seemed little point in my opinion. A later development version will be tested at the same time as a later Komodo release though.
Nathanael or myself might test Stockfish 7 64-bit 4CPU for the 40/4 list if we get the chance, but no guarantees.
gbanksnz at gmail.com
Top
Gusev
Posts: 1476
Joined: Mon Jan 28, 2013 2:51 pm

Re: CCRL 40/4 engines

Post by Gusev »

Hi Graham,

How come Ginkgo is not on CCRL? I see it in CEGT.

Dmitri
Graham Banks wrote:
PaulieD wrote:Graham,

When will the 40/4 list be updated to the latest versions I.E. Stockfish 7 and Komodo 9.3 ?

I do not even check it any more, it used to be the first rating list I always checked.

Code: Select all

CCRL 40/4 Rating List - Single-CPU engines
1350406 games played by 1552 programs, run by 20 testers
Ponder off, General books (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz)
Computed on February 13, 2016 with Bayeselo based on 1'350'406 games
Tested by CCRL team, 2005-2016, http://computerchess.org.uk/ccrl/404/

   Rank               Engine                 Elo   +    -   Score  AvOp  Games
      1 Stockfish 7 64-bit                  3352  +17  -17  80.3% -221.3  1507
      2 Komodo 9.3 64-bit                   3339  +15  -15  76.8% -198.0  1844
        Komodo 9.2 64-bit                   3336  +18  -18  83.5% -283.4  1614
        Stockfish 6 64-bit                  3315  +12  -11  70.8% -148.5  2865
        Komodo 9.1 64-bit                   3312  +15  -15  71.0% -148.2  1625
        Komodo 9 64-bit                     3257  +20  -20  73.9% -174.0   949
        Stockfish 5 64-bit                  3242  +19  -19  77.0% -202.4  1129
      3 Houdini 4 64-bit                    3237  +10  -10  60.6%  -75.9  4087
        Stockfish 020514 64-bit             3234  +17  -17  66.3% -108.1  1143
        Komodo 8 64-bit                     3233  +13  -12  66.7% -117.0  2311
        Stockfish 5 syzygy 64-bit           3232  +17  -17  72.3% -154.2  1328
        Stockfish DD 64-bit                 3224  +18  -18  57.0%  -44.1   912
        Houdini 3 64-bit                    3214  +14  -14  61.9%  -77.7  1756
        Komodo TCEC 64-bit                  3208  +20  -20  64.6% -101.7   855
        Komodo 7a 64-bit                    3203  +14  -14  66.0% -107.7  1681
        Houdini 2.0c 64-bit                 3199  +16  -15  68.2% -135.5  1564
        Houdini 3 Tactical 64-bit           3190  +39  -39  56.8%  -44.4   200
      4 Gull 3 64-bit                       3188  +13  -13  55.2%  -36.3  2144
      5 Fire 4 64-bit                       3186  +13  -12  58.7%  -63.4  2253

Code: Select all

CCRL 40/4 Rating List - Multi-CPU engines
1350406 games played by 1552 programs, run by 20 testers
Ponder off, General books (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 4 minutes on Athlon 64 X2 4600+ (2.4 GHz)
Computed on February 13, 2016 with Bayeselo based on 1'350'406 games
Tested by CCRL team, 2005-2016, http://computerchess.org.uk/ccrl/404/

 Rank               Engine                 Elo   +    -   Score  AvOp  Games
    1 Stockfish 251115 64-bit 4CPU        3414  +19  -19  74.7% -170.2  1022
    2 Komodo 9.2 64-bit 4CPU              3406  +19  -19  73.0% -162.4  1005
      Komodo 9.3 64-bit 4CPU              3399  +19  -18  72.5% -154.8  1027
      Stockfish 6 64-bit 4CPU             3387  +15  -15  67.7% -118.6  1485
      Komodo 9 64-bit 4CPU                3379  +16  -16  72.7% -150.6  1400
      Komodo 9.1 64-bit 4CPU              3375  +18  -18  72.9% -150.9  1100
      Stockfish 5 64-bit 4CPU             3362  +16  -16  71.8% -145.9  1380
      Komodo 8 64-bit 4CPU                3347  +16  -16  68.0% -120.4  1330
    3 Houdini 4 64-bit 4CPU               3329  +11  -11  62.6%  -94.0  3126
      Houdini 3 64-bit 4CPU               3317  +13  -13  77.3% -204.0  2382
      Komodo 7a 64-bit 4CPU               3317  +16  -15  61.5%  -76.4  1334
      Stockfish DD 64-bit 4CPU            3306  +15  -15  66.6% -122.4  1559
      BlackMamba 2.0 64-bit 4CPU          3294 +113 -110  60.0%  -51.0    20
      Komodo TCEC 64-bit 4CPU             3282  +16  -16  64.9% -111.3  1429
      Houdini 2.0c 64-bit 4CPU            3272  +12  -12  73.3% -172.4  2666
      Stockfish 4 64-bit 4CPU             3265  +17  -17  69.2% -145.8  1346
    4 Gull 3 64-bit 4CPU                  3263  +13  -13  50.9%  -14.7  2113
      Houdini 1.5a 64-bit 4CPU            3259  +16  -16  74.8% -186.1  1649
      Gull 2.8b 64-bit 4CPU               3253  +21  -21  70.1% -147.6   849
      Komodo 6 64-bit 4CPU                3248  +19  -19  66.1% -117.5   998
    5 Equinox 3.30 64-bit 4CPU            3243  +14  -14  41.1%  +55.7  1543
      Gull 2.3 64-bit 4CPU                3240  +17  -17  63.8% -101.4  1137
    6 Fire 4 64-bit 4CPU                  3237  +13  -13  46.1%  +23.2  1857
Top
User avatar
Graham Banks
Posts: 41423
Joined: Sun Feb 26, 2006 10:52 am
Location: Auckland, NZ

Re: CCRL 40/4 engines

Post by Graham Banks »

Gusev wrote:Hi Graham,

How come Ginkgo is not on CCRL? I see it in CEGT.

Dmitri
We don't usually test private engines.

Having said that, the Ginkgo author has been happy to let me use his engine in some of my tournaments, which I really appreciate.
gbanksnz at gmail.com
Top

Return to “Computer Chess Club: Tournaments and Matches”