CEGT - rating lists January 19th 2014

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

User avatar
Werner
Posts: 2872
Joined: Wed Mar 08, 2006 10:09 pm
Location: Germany
Full name: Werner Schüle

CEGT - rating lists January 19th 2014

Post by Werner »

Hi all, :D

our actual rating lists are online and can be found under the attached links.

40 / 20:
New games: 1712; 28 different engines
Total: 714.592

NEW Engines
228 DiscoCheck 5.2 x64: 2769 - 848 games (+112 to v. 5.0.1)
524 Nirvana Chess 1.4 x64: 2612 - 481 games (+20 to v. 1.3)

UPDATES
2 Stockfish DD x64 4CPU: 3148 - 1052 games (-9)
396 SmarThink 1.50 x64: 2677 - 1200 games (-4)
435 DiscoCheck 5.0.1 x64: 2657 - 807 games (-8)
562 Arasan 16.2 x64 1CPU: 2587 - 800 games (+2)
524 Nirvana Chess 1.3 x64: 2592 - 900 games (+7)

40 / 4: (from Jan. 09th)
no update;
we are testing: DiscoCheck 5.2 x64 2751/500; Chiron 2.0 x64 4CPU +54/400; Vajolet 2.48 and EveAnn 1.72 - see more in our Forum.

40/120
See here our single-list ):
http://www.husvankempen.de/nunn//40120n ... liste.html.
Last update was January 10th with 13150 games and 49 engines.

5'+3'' pb=on
no update;
We started to test DiscoCheck 5,2 x64: It would be nice to hear from Lucas - as we have crashes too with 5 or less pieces on the board inside Shredder GUI or Arena 3.5!

A big „Thank you“ to all testers as usual!!

Links

40/20: http://www.husvankempen.de/nunn/rating.htm
Blitz: http://www.husvankempen.de/nunn/blitz.htm
40/120: http://www.husvankempen.de/nunn/rating120.htm
Tester: http://www.husvankempen.de/nunn/testers/testers.htm
40/20 pb=on: http://www.husvankempen.de/nunn/rating4020PBON.htm
5+3 pb=on: http://www.husvankempen.de/nunn/rating5plus3pbon.htm
Games of the week: http://www.husvankempen.de/nunn/40_40%2 ... on/gow.jpg

Werner Schuele
CEGT-Team
User avatar
lucasart
Posts: 3232
Joined: Mon May 31, 2010 1:29 pm
Full name: lucasart

Re: CEGT - rating lists January 19th 2014

Post by lucasart »

Werner wrote: 5'+3'' pb=on
no update;
We started to test DiscoCheck 5,2 x64: It would be nice to hear from Lucas - as we have crashes too with 5 or less pieces on the board inside Shredder GUI or Arena 3.5!
Sorry, I forgot to answer your PM. It has also been pointed out by other people in another thread. Yes, DiscoCheck is very broken in pondering mode. It becomes especially apparent when you disable the GUI adjudication/resign. One bug I can reproduce (depth 127) and another one (not delivering mate while keeping mate in sight) I cannot reproduce deterministically although I have seen it too. It's a hash table problem: the worst kind...
Theory and practice sometimes clash. And when that happens, theory loses. Every single time.
User avatar
Werner
Posts: 2872
Joined: Wed Mar 08, 2006 10:09 pm
Location: Germany
Full name: Werner Schüle

Re: CEGT - rating lists January 19th 2014

Post by Werner »

lucasart wrote: Sorry, I forgot to answer your PM. It has also been pointed out by other people in another thread. Yes, DiscoCheck is very broken in pondering mode. It becomes especially apparent when you disable the GUI adjudication/resign. One bug I can reproduce (depth 127) and another one (not delivering mate while keeping mate in sight) I cannot reproduce deterministically although I have seen it too. It's a hash table problem: the worst kind...
Thanks Lucas,
the second problem causes to Crash the GUI too - so it is not easy to find out what happens. Perhaps a log can help you ?

At the moment I use CB GUI with tbs. This is the only way I can avoid these problems.

Good Luck !
Werner
User avatar
Werner
Posts: 2872
Joined: Wed Mar 08, 2006 10:09 pm
Location: Germany
Full name: Werner Schüle

Re: CEGT - rating lists January 19th 2014

Post by Werner »

Hi Lucas,
here is a picture of such a crash with debug infos inside GUI:

[img]http://www.husvankempen.de\nunn\DiscoCheck-2.jpg[/img]

and the last lines of a debug file which is also provided from Shredder GUI

Werner

Mon Jan 20 11:15:18 2014: from Doch 09.980 x64 (0): bestmove d3c4 ponder a2a1q
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 70 nodes 2150 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 71 nodes 2181 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 72 nodes 2212 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 73 nodes 2243 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 74 nodes 2274 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 75 nodes 2305 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 76 nodes 2336 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 77 nodes 2367 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 78 nodes 2398 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 79 nodes 2429 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 80 nodes 2460 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 81 nodes 2491 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 82 nodes 2522 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 83 nodes 2553 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 84 nodes 2584 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 85 nodes 2615 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 86 nodes 2646 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 87 nodes 2677 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 88 nodes 2708 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 89 nodes 2739 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 90 nodes 2770 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 91 nodes 2801 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 92 nodes 2832 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 93 nodes 2863 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 94 nodes 2894 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 95 nodes 2925 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 96 nodes 2956 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 97 nodes 2987 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 98 nodes 3018 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 99 nodes 3049 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 100 nodes 3080 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 101 nodes 3111 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 102 nodes 3142 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 103 nodes 3173 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 104 nodes 3204 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 105 nodes 3235 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 106 nodes 3266 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 107 nodes 3297 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 108 nodes 3328 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 109 nodes 3359 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 110 nodes 3390 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 111 nodes 3421 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 112 nodes 3452 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 113 nodes 3483 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 114 nodes 3514 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 115 nodes 3545 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 116 nodes 3576 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 117 nodes 3607 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 118 nodes 3638 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 119 nodes 3669 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 120 nodes 3700 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 121 nodes 3731 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 122 nodes 3762 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 123 nodes 3793 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 124 nodes 3824 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 125 nodes 3855 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 126 nodes 3886 time 0 pv a2a1n c2b1
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 127 nodes 3988 time 0 pv a2a1n c2b1 a1c2 b1b3
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): bestmove a2a1n ponder c2b1
User avatar
lucasart
Posts: 3232
Joined: Mon May 31, 2010 1:29 pm
Full name: lucasart

Re: CEGT - rating lists January 19th 2014

Post by lucasart »

Werner wrote: Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): info score mate -2 depth 127 nodes 3988 time 0 pv a2a1n c2b1 a1c2 b1b3
Mon Jan 20 11:15:18 2014: from DiscoCheck 5.2 x64 (1): bestmove a2a1n ponder c2b1
This is the bug! When iteration depth=127 finishes, the iterative deepening loop stops, DiscoCheck returns the best move and stops searching. The UCI protocol explicitly says that engines should never stop when pondering, which means some artificial code needs to be added to prevent it (ideally a blocking I/O read). I will fix this in the next version. In the meantime, we will have to live with the fact that DiscoCheck is buggy in pondering mode :oops:
Theory and practice sometimes clash. And when that happens, theory loses. Every single time.