The Speedy Rating List

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

lkaufman
Posts: 5960
Joined: Sun Jan 10, 2010 6:15 am
Location: Maryland USA

Re: The Speedy Rating List

Post by lkaufman »

Rebel wrote: Sun May 31, 2020 9:31 am @Larry

On a second thought -

Code: Select all

CEGT 40/4       SF11 3486
CEGT 40/20      SF11 3450
CEGT 40/120     SF11 3409

CCRL 40/2       SF11 3534
CCRL 40/15      SF11 3433

FGRL 60s+0.6    SF11 3497
FGRL 10m+6.0    SF11 3426
FGRL 60m+15.0   SF11 3391
On all 3 rating lists the longer time control the more the elo of an engine drops, with SRL it's exactly the other way around.

Instinctively more natural, one ply deeper it is not, I understand :D

I think I will keep my elo formula.

BTW, the NICE tool is developed for engine tuning, that it also can produce a reasonable reliable rating list was an unexpected bonus.
Rating differences between engines definitely do decline with longer time controls, due to increased percentage of draws. If draws were not rated, some studies suggest that rating differences would tend to climb slightly with longer time controls. But when you rate engines by problems solved, draws are not an issue, so this makes sense. I suppose that your unscaled rating list would be a reasonable estimate of how engines might perform at 40 moves in 2 hours or so, especially against humans, but it won't come close to correlating with rating differences on blitz lists. But that's no problem, it's easy enough to multiply by 2 for that purpose!
Komodo rules!
Patrice Duhamel
Posts: 193
Joined: Sat May 25, 2013 11:17 am
Location: France
Full name: Patrice Duhamel

Re: The Speedy Rating List

Post by Patrice Duhamel »

Rebel wrote: Sun May 31, 2020 7:54 pm
Patrice Duhamel wrote: Sun May 31, 2020 5:37 pm I'm curious to see Cheese score, it's possible to add it in the list ? or to download LC1.epd ?
If Cheese is still developed I will include it.
Yes, Cheese is still developed.
Anything that can go wrong will go wrong.
User avatar
Rebel
Posts: 6995
Joined: Thu Aug 18, 2011 12:04 pm

Re: The Speedy Rating List

Post by Rebel »

Patrice Duhamel wrote: Mon Jun 01, 2020 10:52 am
Rebel wrote: Sun May 31, 2020 7:54 pm
Patrice Duhamel wrote: Sun May 31, 2020 5:37 pm I'm curious to see Cheese score, it's possible to add it in the list ? or to download LC1.epd ?
If Cheese is still developed I will include it.
Yes, Cheese is still developed.
Cool..., will be done.
90% of coding is debugging, the other 10% is writing bugs.
bob
Posts: 20943
Joined: Mon Feb 27, 2006 7:30 pm
Location: Birmingham, AL

Re: The Speedy Rating List

Post by bob »

Rebel wrote: Sat May 30, 2020 3:29 pm
Terje wrote: Sat May 30, 2020 1:59 pm Given that a lot of engines have exactly 41 errors it would be interesting to know which positions (or even 1 of them) these occur in.
4Rk2/2R5/2p3p1/3p4/3P3r/P7/1P3P1p/7K b - - bm Kxe8; ce -32000; acd 0;
k5rb/3r4/1ppP4/p1p1p1p1/P1P1Pp1p/1P1R4/3R1PPN/3q1K2 w - - bm Rxd1; ce -32000; acd 0;
8/3P2k1/5p2/6pp/4p3/1b2P2P/6r1/2BK4 w - - bm Ke1; ce -32000; acd 0;
3r2k1/6p1/4p3/1p1nB1Qp/1PpP3P/R1P2P2/1r4qK/8 w - - bm Qxg2; ce -32000; acd 0;

'What they have in common, it's called the chopper move.
What they also have in common is a syntax error.

For FEN, you need <position FEN> color castle EP and the two move counters. You need a ";" before the bm field. I notice that Crafty handles those, but it does complain about the bogus move/half-move values.
User avatar
Rebel
Posts: 6995
Joined: Thu Aug 18, 2011 12:04 pm

Re: The Speedy Rating List

Post by Rebel »

1. Finished the 4000ms testing.

2. Added Orion 0.6

3. Split the 1000ms and 4000ms into 2 pages.
The new URL's are -
http://rebel13.nl/download/srl-1000.html
http://rebel13.nl/download/srl-4000.html

4. Next -
Cheese 2.1
Stash 16.0
Sting 21
Ares 005-2
Godel 7.0
Baron 3.44.1

5. Will try to get Winboard engines to work with MEA, some monumental engines (for instance Crafty) belong to the list.
90% of coding is debugging, the other 10% is writing bugs.
David Carteau
Posts: 121
Joined: Sat May 24, 2014 9:09 am
Location: France
Full name: David Carteau

Re: The Speedy Rating List

Post by David Carteau »

Rebel wrote: Tue Jun 02, 2020 1:04 pm 2. Added Orion 0.6
A big thank you !
MMarc
Posts: 4
Joined: Fri Feb 28, 2020 11:13 pm
Full name: Marc Moisan

Re: The Speedy Rating List

Post by MMarc »

Rebel wrote: Tue Jun 02, 2020 1:04 pm 1. Finished the 4000ms testing.

2. Added Orion 0.6

3. Split the 1000ms and 4000ms into 2 pages.
The new URL's are -
http://rebel13.nl/download/srl-1000.html
http://rebel13.nl/download/srl-4000.html

4. Next -
Cheese 2.1
Stash 16.0
Sting 21
Ares 005-2
Godel 7.0
Baron 3.44.1

5. Will try to get Winboard engines to work with MEA, some monumental engines (for instance Crafty) belong to the list.
Very interesting. If you have time, could you test the SlowChess 2.1? Thank you!
User avatar
Rebel
Posts: 6995
Joined: Thu Aug 18, 2011 12:04 pm

Re: The Speedy Rating List

Post by Rebel »

MMarc wrote: Tue Jun 02, 2020 3:57 pm
Rebel wrote: Tue Jun 02, 2020 1:04 pm 1. Finished the 4000ms testing.

2. Added Orion 0.6

3. Split the 1000ms and 4000ms into 2 pages.
The new URL's are -
http://rebel13.nl/download/srl-1000.html
http://rebel13.nl/download/srl-4000.html

4. Next -
Cheese 2.1
Stash 16.0
Sting 21
Ares 005-2
Godel 7.0
Baron 3.44.1

5. Will try to get Winboard engines to work with MEA, some monumental engines (for instance Crafty) belong to the list.
Very interesting. If you have time, could you test the SlowChess 2.1? Thank you!
Have it running....

Waiting for the +50 elo version :lol:
90% of coding is debugging, the other 10% is writing bugs.
Terje
Posts: 347
Joined: Tue Nov 19, 2019 4:34 am
Location: https://github.com/TerjeKir/weiss
Full name: Terje Kirstihagen

Re: The Speedy Rating List

Post by Terje »

Requesting testing again this soon is ... but Weiss 1.0 is out so if you find the time :D
User avatar
Rebel
Posts: 6995
Joined: Thu Aug 18, 2011 12:04 pm

Re: The Speedy Rating List

Post by Rebel »

MMarc wrote: Tue Jun 02, 2020 3:57 pm Very interesting. If you have time, could you test the SlowChess 2.1? Thank you!

Code: Select all

    EPD  : epd\lc1.epd
    Time : 1000ms

                                                               Max            Time   Hash          
    Engine           Points  Used Time   Found   Pos    Elo   Score   Score    ms     Mb  Cpu  Errors
 1  Stockfish 11     324287  11:30:00.8  23191  40000  3242  400000  81.07%   1000   128    1     0
 2  Komodo 14        317110  11:09:21.4  22398  40000  3171  400000  79.28%   1000   128    1     0
 3  Houdini 6.03     314596  11:27:54.8  22218  40000  3146  400000  78.65%   1000   128    1     0
 4  rofChade 2.3     309642  11:24:20.2  21587  40000  3096  400000  77.41%   1000   128    1    41
 5  SlowChess 2.1    309590  10:31:56.2  21595  40000  3096  400000  77.40%   1000   128    1     0
 6  Ethereal 12      309088  11:30:20.9  21840  40000  3090  400000  77.27%   1000   128    1     0
 7  Laser 1.7        308178  11:29:30.5  21320  40000  3081  400000  77.04%   1000   128    1     0
 8  Schooner 2.2     306808  10:22:01.9  21335  40000  3068  400000  76.70%   1000   128    1     0
 9  Xiphos 0.6       306796  10:03:55.9  21333  40000  3068  400000  76.70%   1000   128    1     0
10  RubiChess 1.7.2  305900  11:26:03.9  21215  40000  3059  400000  76.48%   1000   128    1     0

Oh la la....

Rank 5 :!:

Have the 4000ms run now.

Curious....

Nice interface BTW.
90% of coding is debugging, the other 10% is writing bugs.