Doubling of time control

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Harvey Williamson, bob

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Post Reply
fastgm
Posts: 350
Joined: Mon Aug 19, 2013 4:57 pm
Contact:

Doubling of time control

Post by fastgm » Fri Oct 21, 2016 9:48 am

Doubling of time control

Conditions:
1 Core, 128 MB Hash, 3000 games, 1500 opening positions, no ponder, no learning, no tablebases
GUI: Cutechess-Cli

Hardware:
Intel i5-750 @ 3.5 GHz

Engine:
Komodo 9.3, default settings

Download PDF:

http://fastgm.de/K93-Doubling-TC.pdf

Time in seconds

Image
Image

Dann Corbit
Posts: 8795
Joined: Wed Mar 08, 2006 7:57 pm
Location: Redmond, WA USA
Contact:

Re: Doubling of time control

Post by Dann Corbit » Fri Oct 21, 2016 9:53 am

This testing clearly shows a fundamental flaw in the Elo model.
The engine does not get weaker at long time control but stronger.
When given an hour to think, compared to one second, the move chosen with more time allowed will clearly be a much better move.

The increase in draws probably just shows that more careful chess is played by both sides at slower time control.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.

User avatar
Laskos
Posts: 8233
Joined: Wed Jul 26, 2006 8:21 pm

Re: Doubling of time control

Post by Laskos » Fri Oct 21, 2016 10:02 am

Important post, thank you, I will look at it more carefully today. This is the reference now to the doubling of time control.

Sven
Posts: 3633
Joined: Thu May 15, 2008 7:57 pm
Location: Berlin, Germany
Full name: Sven Schüle
Contact:

Re: Doubling of time control

Post by Sven » Fri Oct 21, 2016 10:44 am

Dann Corbit wrote:This testing clearly shows a fundamental flaw in the Elo model.
The engine does not get weaker at long time control but stronger.
When given an hour to think, compared to one second, the move chosen with more time allowed will clearly be a much better move.

The increase in draws probably just shows that more careful chess is played by both sides at slower time control.
The reported Elo ratings are the rating differences between the engine with double time and the engine with normal time. It is just the differences that become smaller.

Based on the table above you get the following ratings if you transform "double time" into "same time but double speed" (@Kai: is the following correct?):

Code: Select all

Speed Elo
   1    0
   2  144
   4  277
   8  389
  16  490
  32  583
  64  656
 128  715
 256  766
Of course the strength of the "Speed = 1" engine is already quite high so this can't be used for weaker engines the same way.

User avatar
Guenther
Posts: 2367
Joined: Wed Oct 01, 2008 4:33 am
Location: Regensburg, Germany
Full name: Guenther Simon
Contact:

Re: Doubling of time control

Post by Guenther » Fri Oct 21, 2016 10:57 am

Laskos wrote:Important post, thank you, I will look at it more carefully today. This is the reference now to the doubling of time control.
Average ply depth would be interesting for this table too, if it could be extracted.

fastgm
Posts: 350
Joined: Mon Aug 19, 2013 4:57 pm
Contact:

Re: Doubling of time control

Post by fastgm » Fri Oct 21, 2016 11:48 am

The ply depth for each move is saved in the pgn-file, for example: 14. Bh3 {+0.33/27 191s}

Is there a tool that extracts the average ply depth from a pgn?

User avatar
Laskos
Posts: 8233
Joined: Wed Jul 26, 2006 8:21 pm

Re: Doubling of time control

Post by Laskos » Fri Oct 21, 2016 2:29 pm

fastgm wrote:The ply depth for each move is saved in the pgn-file, for example: 14. Bh3 {+0.33/27 191s}

Is there a tool that extracts the average ply depth from a pgn?
If there are no such tools, you could ask via personal message Ferdinand Mosca, he helped me many times with similar quests. He writes python scripts, and also builds executables. Very easy to use. You might explain to him the importance of your work by pointing to this thread.

User avatar
Laskos
Posts: 8233
Joined: Wed Jul 26, 2006 8:21 pm

Re: Doubling of time control

Post by Laskos » Fri Oct 21, 2016 2:39 pm

Sven Schüle wrote:
Dann Corbit wrote:This testing clearly shows a fundamental flaw in the Elo model.
The engine does not get weaker at long time control but stronger.
When given an hour to think, compared to one second, the move chosen with more time allowed will clearly be a much better move.

The increase in draws probably just shows that more careful chess is played by both sides at slower time control.
The reported Elo ratings are the rating differences between the engine with double time and the engine with normal time. It is just the differences that become smaller.

Based on the table above you get the following ratings if you transform "double time" into "same time but double speed" (@Kai: is the following correct?):

Code: Select all

Speed Elo
   1    0
   2  144
   4  277
   8  389
  16  490
  32  583
  64  656
 128  715
 256  766
Of course the strength of the "Speed = 1" engine is already quite high so this can't be used for weaker engines the same way.
Yes, numbers seem correct, and it's good to have the total ELO. Also, to have relation to CCRL 40/40' rating, I wrote it next to the last data point, where it stands on time control:

Code: Select all

Speed Elo
   1    0
   2  144
   4  277
   8  389
  16  490
  32  583
  64  656
 128  715
 256  766    CCRL 40/40'   3260

shrapnel
Posts: 1113
Joined: Fri Nov 02, 2012 8:43 am
Location: New Delhi, India

Re: Doubling of time control

Post by shrapnel » Fri Oct 21, 2016 3:16 pm

Dann Corbit wrote:This testing clearly shows a fundamental flaw in the Elo model.
The engine does not get weaker at long time control but stronger.
When given an hour to think, compared to one second, the move chosen with more time allowed will clearly be a much better move.

The increase in draws probably just shows that more careful chess is played by both sides at slower time control.
I've been crying myself hoarse for the last few years that testing through Blitz/STC games is NO SUBSTITUTE for testing through LTC games.
Glad to be vindicated.
Its not just a matter of engines being "more careful"....LTC games ruthlessly expose any weakness in the Evaluation and Search patterns of the Engine.
That is why in the TCEC, Houdini winning the Rapids is no guarantee that it will beat SF in the super-final ( though I hope it does, just to discomfit Adam :D ).
Adam has a point though, when he says that the Super-Final will be a different kind of ballgame.
Houdini can win only if it is REALLY the better Engine.
i7 5960X @ 4.1 Ghz, 64 GB G.Skill RipJaws RAM, Asus ROG Strix 11 GB Geforce 1080 Ti and AMD Ryzen 7 1800X @4.0 GHz, 32 GB DDR4-2400 G.Skill RAM, ASUS Prime x370-PRO, Noctua NH-D15 SE-AM4 Cooler.

Uri Blass
Posts: 8116
Joined: Wed Mar 08, 2006 11:37 pm
Location: Tel-Aviv Israel

Re: Doubling of time control

Post by Uri Blass » Fri Oct 21, 2016 3:33 pm

shrapnel wrote:
Dann Corbit wrote:This testing clearly shows a fundamental flaw in the Elo model.
The engine does not get weaker at long time control but stronger.
When given an hour to think, compared to one second, the move chosen with more time allowed will clearly be a much better move.

The increase in draws probably just shows that more careful chess is played by both sides at slower time control.
I've been crying myself hoarse for the last few years that testing through Blitz/STC games is NO SUBSTITUTE for testing through LTC games.
Glad to be vindicated.
Its not just a matter of engines being "more careful"....LTC games ruthlessly expose any weakness in the Evaluation and Search patterns of the Engine.
That is why in the TCEC, Houdini winning the Rapids is no guarantee that it will beat SF in the super-final ( though I hope it does, just to discomfit Adam :D ).
Adam has a point though, when he says that the Super-Final will be a different kind of ballgame.
Houdini can win only if it is REALLY the better Engine.
I believe that difference between rapid TCEC and slow time control TCEC is small and we do not have enough games.

Conditions are also not the same in long and rapid time control because in rapid time control there are many weak opponents.

Rapid TCEC is clearly slower time control than blitz espacially when you consider the number of cores and is clearly slower than the time controls in this thread.

Post Reply