PGN - http://kirill-kryukov.com/chess/discuss ... p?id=47539
Dragon by Komodo 64-bit Gauntlet for CCRL 40/15
Moderators: hgm, Rebel, chrisw
-
Graham Banks
- Posts: 41473
- Joined: Sun Feb 26, 2006 10:52 am
- Location: Auckland, NZ
Dragon by Komodo 64-bit Gauntlet for CCRL 40/15
gbanksnz at gmail.com
-
Graham Banks
- Posts: 41473
- Joined: Sun Feb 26, 2006 10:52 am
- Location: Auckland, NZ
Re: Dragon by Komodo 64-bit Gauntlet for CCRL 40/15
Code: Select all
CCRL 40/15 Rating List - Custom engine selection
1197230 games played by 2747 programs, run by 23 testers
Ponder off, General books (up to 12 moves), 3-4-5 piece EGTB
Time control: Equivalent to 40 moves in 15 minutes on an Intel i7-4770k.
Computed on December 12, 2020 with Bayeselo based on 1'197'230 games
Tested by CCRL team, 2005-2020, http://ccrl.chessdom.com/ccrl/4040/
Rank Engine Elo + - Score AvOp Games
1 Dragon by Komodo 64-bit 3475 +21 -21 74.7% -166.8 756
Komodo 13.3 64-bit 3345 +13 -14 56.3% -37.2 1586
Komodo 14 64-bit 3341 +13 -13 60.5% -63.6 1731
Komodo 13.1 64-bit 3330 +17 -17 57.8% -46.4 1062
Komodo 11.3.1 64-bit 3323 +14 -14 68.7% -123.3 1636
Komodo 12.2.2 64-bit 3323 +14 -14 59.8% -63.7 1594
Komodo 13.01 64-bit 3321 +18 -18 59.0% -52.6 832
Komodo 11.2 64-bit 3320 +14 -14 70.7% -139.6 1802
Komodo 12.3 64-bit 3320 +16 -16 63.0% -83.9 1150
Komodo 12 64-bit 3315 +14 -15 67.0% -110.2 1509
Komodo 10.4 64-bit 3305 +14 -14 75.0% -166.8 1713
Komodo 14 MCTS 64-bit 3298 +19 -19 46.8% +20.2 843
Komodo 11.01 64-bit 3292 +21 -20 71.3% -135.2 755
Komodo 13.3 MCTS 64-bit 3292 +19 -19 51.8% -9.6 755
Komodo 10.2 64-bit 3290 +16 -16 73.3% -153.2 1318
Komodo 13.01 MCTS 64-bit 3277 +17 -18 52.2% -12.6 904
Komodo 13.2.5 MCTS 64-bit 3277 +16 -16 44.9% +33.1 1165
Komodo 10.3 64-bit 3269 +16 -16 71.2% -135.0 1248
Komodo 10.1 64-bit 3265 +19 -18 75.6% -165.1 1004
Komodo 10 64-bit 3260 +11 -10 59.0% -57.2 3051
Komodo 9.2 64-bit 3258 +20 -20 73.5% -153.6 864
Komodo 9.3 64-bit 3253 +19 -19 73.3% -149.6 936
Komodo 9.42 64-bit 3241 +21 -21 71.2% -133.9 722
Komodo 9 64-bit 3235 +20 -20 71.8% -138.4 848
Komodo 12.3 MCTS 64-bit 3234 +14 -14 50.4% -3.1 1616
Komodo 9.1 64-bit 3229 +21 -20 70.3% -129.9 770
Komodo 12.2.2 MCTS 64-bit 3212 +16 -16 62.4% -82.9 1350
Komodo 8 64-bit 3204 +16 -16 68.9% -117.5 1239
Komodo 7a 64-bit 3173 +20 -20 62.0% -75.1 730
Komodo TCEC 64-bit 3143 +17 -17 60.1% -61.7 1060
Komodo 6 64-bit 3141 +15 -15 60.3% -62.9 1339
Komodo CCT 64-bit 3125 +15 -15 59.0% -55.3 1383
Komodo 5 64-bit 3108 +11 -11 58.1% -51.1 2800
Komodo 5.1 64-bit 3104 +17 -17 58.0% -50.2 989
Komodo 4 64-bit 3098 +11 -11 57.5% -50.5 2532
Komodo 3 64-bit 3090 +14 -14 58.8% -58.6 1699
Komodo 12.1.1 MCTS 64-bit 3079 +15 -15 46.9% +24.6 1430
Komodo 2.03 64-bit 3045 +28 -28 50.1% -1.5 369
Komodo 2.01 64-bit 3042 +21 -21 56.2% -41.7 710
Komodo 1.3 64-bit 2972 +19 -19 46.6% +20.7 891
Komodo 1.2 64-bit 2945 +16 -16 45.6% +27.3 1246
Komodo 1.0 64-bit 2921 +14 -14 48.5% +7.7 1706gbanksnz at gmail.com
-
mehmet123
- Posts: 671
- Joined: Sun Jan 26, 2020 10:38 pm
- Location: Turkey
- Full name: Mehmet Karaman
Re: Dragon by Komodo 64-bit Gauntlet for CCRL 40/15
Thanks Graham for your efforts. Can we see Dragon by Komodo (4 cpu) test in near future?
I'm looking forward to whether Dragon by Komodo (4 cpu) will surpass Stockfish 12 (4 cpu). Stockfish 12 (4 cpu) is only 42 elo stronger than Dragon by Komodo (1 cpu) ar CCRL rating list.
I'm looking forward to whether Dragon by Komodo (4 cpu) will surpass Stockfish 12 (4 cpu). Stockfish 12 (4 cpu) is only 42 elo stronger than Dragon by Komodo (1 cpu) ar CCRL rating list.
-
Pi4Chess
- Posts: 253
- Joined: Mon Nov 16, 2020 12:13 pm
- Full name: Manuel Rivera
Re: Dragon by Komodo 64-bit Gauntlet for CCRL 40/15
Impressive ShashChess 
Raspberry Pi4 bot : https://lichess.org/@/BetterAnalyze
-
Graham Banks
- Posts: 41473
- Joined: Sun Feb 26, 2006 10:52 am
- Location: Auckland, NZ
Re: Dragon by Komodo 64-bit Gauntlet for CCRL 40/15
Sergio is going to run a 4CPU Gauntlet.mehmet123 wrote: ↑Wed Dec 16, 2020 10:56 pm Thanks Graham for your efforts. Can we see Dragon by Komodo (4 cpu) test in near future?
I'm looking forward to whether Dragon by Komodo (4 cpu) will surpass Stockfish 12 (4 cpu). Stockfish 12 (4 cpu) is only 42 elo stronger than Dragon by Komodo (1 cpu) ar CCRL rating list.
gbanksnz at gmail.com
-
lkaufman
- Posts: 5960
- Joined: Sun Jan 10, 2010 6:15 am
- Location: Maryland USA
Re: Dragon by Komodo 64-bit Gauntlet for CCRL 40/15
One elo behind Stockfish 12 -- recount the ballots! Take it to the Supreme Court!Graham Banks wrote: ↑Wed Dec 16, 2020 10:50 pmCode: Select all
CCRL 40/15 Rating List - Custom engine selection 1197230 games played by 2747 programs, run by 23 testers Ponder off, General books (up to 12 moves), 3-4-5 piece EGTB Time control: Equivalent to 40 moves in 15 minutes on an Intel i7-4770k. Computed on December 12, 2020 with Bayeselo based on 1'197'230 games Tested by CCRL team, 2005-2020, http://ccrl.chessdom.com/ccrl/4040/ Rank Engine Elo + - Score AvOp Games 1 Dragon by Komodo 64-bit 3475 +21 -21 74.7% -166.8 756 Komodo 13.3 64-bit 3345 +13 -14 56.3% -37.2 1586 Komodo 14 64-bit 3341 +13 -13 60.5% -63.6 1731 Komodo 13.1 64-bit 3330 +17 -17 57.8% -46.4 1062 Komodo 11.3.1 64-bit 3323 +14 -14 68.7% -123.3 1636 Komodo 12.2.2 64-bit 3323 +14 -14 59.8% -63.7 1594 Komodo 13.01 64-bit 3321 +18 -18 59.0% -52.6 832 Komodo 11.2 64-bit 3320 +14 -14 70.7% -139.6 1802 Komodo 12.3 64-bit 3320 +16 -16 63.0% -83.9 1150 Komodo 12 64-bit 3315 +14 -15 67.0% -110.2 1509 Komodo 10.4 64-bit 3305 +14 -14 75.0% -166.8 1713 Komodo 14 MCTS 64-bit 3298 +19 -19 46.8% +20.2 843 Komodo 11.01 64-bit 3292 +21 -20 71.3% -135.2 755 Komodo 13.3 MCTS 64-bit 3292 +19 -19 51.8% -9.6 755 Komodo 10.2 64-bit 3290 +16 -16 73.3% -153.2 1318 Komodo 13.01 MCTS 64-bit 3277 +17 -18 52.2% -12.6 904 Komodo 13.2.5 MCTS 64-bit 3277 +16 -16 44.9% +33.1 1165 Komodo 10.3 64-bit 3269 +16 -16 71.2% -135.0 1248 Komodo 10.1 64-bit 3265 +19 -18 75.6% -165.1 1004 Komodo 10 64-bit 3260 +11 -10 59.0% -57.2 3051 Komodo 9.2 64-bit 3258 +20 -20 73.5% -153.6 864 Komodo 9.3 64-bit 3253 +19 -19 73.3% -149.6 936 Komodo 9.42 64-bit 3241 +21 -21 71.2% -133.9 722 Komodo 9 64-bit 3235 +20 -20 71.8% -138.4 848 Komodo 12.3 MCTS 64-bit 3234 +14 -14 50.4% -3.1 1616 Komodo 9.1 64-bit 3229 +21 -20 70.3% -129.9 770 Komodo 12.2.2 MCTS 64-bit 3212 +16 -16 62.4% -82.9 1350 Komodo 8 64-bit 3204 +16 -16 68.9% -117.5 1239 Komodo 7a 64-bit 3173 +20 -20 62.0% -75.1 730 Komodo TCEC 64-bit 3143 +17 -17 60.1% -61.7 1060 Komodo 6 64-bit 3141 +15 -15 60.3% -62.9 1339 Komodo CCT 64-bit 3125 +15 -15 59.0% -55.3 1383 Komodo 5 64-bit 3108 +11 -11 58.1% -51.1 2800 Komodo 5.1 64-bit 3104 +17 -17 58.0% -50.2 989 Komodo 4 64-bit 3098 +11 -11 57.5% -50.5 2532 Komodo 3 64-bit 3090 +14 -14 58.8% -58.6 1699 Komodo 12.1.1 MCTS 64-bit 3079 +15 -15 46.9% +24.6 1430 Komodo 2.03 64-bit 3045 +28 -28 50.1% -1.5 369 Komodo 2.01 64-bit 3042 +21 -21 56.2% -41.7 710 Komodo 1.3 64-bit 2972 +19 -19 46.6% +20.7 891 Komodo 1.2 64-bit 2945 +16 -16 45.6% +27.3 1246 Komodo 1.0 64-bit 2921 +14 -14 48.5% +7.7 1706
Actually this is better than expected. It seems that Dragon does consistently better relative to Stockfish against a range of opponents than it does in direct matches. Being outsearched a couple ply is crippling in a direct match, but against unrelated engines quality of eval probably matters more. That's my theory anyway. Let's see if we gain more from 4 threads than the 43 elo gain by SF12. That seems quite achievable.
Komodo rules!