hi. i have made some tests and observed this:
old stockfish 9 reached depth 32 at 45 sec average
26/10/19 sf dv reached 32 depth at 60+ sec average
so sf 9 is faster but in tests is far weaker vs sf dv
is there an explanation?
something weird
Moderators: hgm, Rebel, chrisw
-
- Posts: 12541
- Joined: Wed Mar 08, 2006 8:57 pm
- Location: Redmond, WA USA
Re: something weird
YBW search verses Lazy SMP search.
YBW is faster in time to ply.
Lazy SMP is better in Elo strength.
YBW is faster in time to ply.
Lazy SMP is better in Elo strength.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
-
- Posts: 476
- Joined: Sun Mar 17, 2019 12:00 pm
- Full name: Henk Drost
Re: something weird
SF9 uses Lazy SMP.Dann Corbit wrote: ↑Tue Dec 31, 2019 11:37 pm YBW search verses Lazy SMP search.
YBW is faster in time to ply.
Lazy SMP is better in Elo strength.
I think some dev version of SF6 started using Lazy SMP*.
SF6 was the last YWB-fish
Last edited by Raphexon on Tue Dec 31, 2019 11:49 pm, edited 1 time in total.
-
- Posts: 12541
- Joined: Wed Mar 08, 2006 8:57 pm
- Location: Redmond, WA USA
Re: something weird
You are right, I looked it up. SF7 changed to Lazy SMP.
In that case, it is probably changes to the extensions and pruning rules.
At any rate, you cannot directly correlate depth to Elo, except to say that deeper searches are generally better than shallower searches by the same engine.
In that case, it is probably changes to the extensions and pruning rules.
At any rate, you cannot directly correlate depth to Elo, except to say that deeper searches are generally better than shallower searches by the same engine.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
-
- Posts: 4556
- Joined: Tue Jul 03, 2007 4:30 am
Re: something weird
The general explanation is that Depths of different engines mean different things, as an engine evolves it will stop meaning the same as old versions. For instance if a new evaluation term is introduced and it's very heavy, every cycle that uses it will make the iteration take longer, so depth will decrease, even though the engine will play stronger (Crystal is an example of this, with much thicker Depths than Stockfish.) If an evaluation term becomes deprecated and it is found that it's not worth the extra time used and it's removed, the engine will get deeper depth faster (and will play worse in some positions where that term was useful. But if of every 100 affected positions, it becomes dumber in 49 but reaches bigger Depth and plays a better move in 51, it's a net gain.)
I still remember doing some Depth 10 match between Pro Deo and Houdini 5 or some version and was happy to see Pro Deo absolutely DESTROY Houdini. Until I realized it meant nothing (you can actually make a personality of Pro Deo that is much stronger than default at fixed depth, you just make it advance through the iterations very slowly), because of this.
I still remember doing some Depth 10 match between Pro Deo and Houdini 5 or some version and was happy to see Pro Deo absolutely DESTROY Houdini. Until I realized it meant nothing (you can actually make a personality of Pro Deo that is much stronger than default at fixed depth, you just make it advance through the iterations very slowly), because of this.
-
- Posts: 20943
- Joined: Mon Feb 27, 2006 7:30 pm
- Location: Birmingham, AL
Re: something weird
I'm not sure that is the truth, the whole truth, and nothing but the truth.Dann Corbit wrote: ↑Tue Dec 31, 2019 11:37 pm YBW search verses Lazy SMP search.
YBW is faster in time to ply.
Lazy SMP is better in Elo strength.
I don't believe lazy SMP is inherently stronger than YBW and its derivatives (such as DTS). It does seem to scale better, in that adding additional cores/threads improves playing skill, where the YBW/DTS algorithm encounters difficulty at the 32-64 core level due to lock contention and the shared data structures necessary to implement YBW/DTS.
Given a 4-cpu system, I would be utterly amazed if lazy SMP was better. In fact, I would be utterly amazed if it were even close to a good YBW/DTS implementation. On a 128 core system, I would expect lazy SMP to be significantly stronger due to the lock contention / shared memory issues I mentioned. Somewhere there is a crossover point where lazy SMP gains the advantage. It is inherently inferior as a search algorithm compared to YBW, until you reach the crossover and the SMP overhead in YBW causes issues. I have seen implementations that would play worse with 32 cores than with 16, for example. Lazy SMP doesn't seem to suffer from that issue. It just scales significantly worse until you reach the magic crossover point.
Depth is a completely different issue. depth means different things to different programs. The old "King" engine would often 2-3 minutes on a 2 ply search, and uncork a 10-15 move long PV. LOTS of extensions. If you did a depth=2 test against other programs it would blow them away, because it would take 2-3 minutes per move while the opponents would take a fraction of a second (back then).
-
- Posts: 4556
- Joined: Tue Jul 03, 2007 4:30 am
Re: something weird
If those are the extremes now I wonder how high a Depth does Stockfish need to play at the level of The King's Depth 2. Probably the extreme is some Komodo Personality made to reach high depth, I've seen it reach Depth 60 in middle game positions in under a minute.
-
- Posts: 3657
- Joined: Wed Nov 18, 2015 11:41 am
- Location: hungary
Re: something weird
At least the engine will play stronger in the sense of the new evaluation term.Ovyron wrote: ↑Tue Dec 31, 2019 11:50 pm The general explanation is that Depths of different engines mean different things, as an engine evolves it will stop meaning the same as old versions. For instance if a new evaluation term is introduced and it's very heavy, every cycle that uses it will make the iteration take longer, so depth will decrease, even though the engine will play stronger (Crystal is an example of this, with much thicker Depths than Stockfish.)
...
In general Crystal plays weaker than Stockfish.dev but it finds mate and solving of puzzles more faster than Stockfish.dev.
-
- Posts: 165
- Joined: Tue Dec 02, 2014 1:29 am
Re: something weird
hello friends
making something experiments i found something paranormal fhenomenom
my device has 8 cores with 5200kn/sec with time to depth 33d/120secs average ,hash at 512mb
then i reduced the number of cores to 2 and i found this:2090kn/sec with time to depth 33d at 90 secs!!! 512 hash also.
tested up to 20 times ,with reduced cores lower speed but faster time of depth?
anyone to explain this mystery?
ps.i used droidfish latest sf dv arm8 android 9
making something experiments i found something paranormal fhenomenom
my device has 8 cores with 5200kn/sec with time to depth 33d/120secs average ,hash at 512mb
then i reduced the number of cores to 2 and i found this:2090kn/sec with time to depth 33d at 90 secs!!! 512 hash also.
tested up to 20 times ,with reduced cores lower speed but faster time of depth?
anyone to explain this mystery?
ps.i used droidfish latest sf dv arm8 android 9
-
- Posts: 2727
- Joined: Wed May 12, 2010 10:00 pm
Re: something weird
There is no mystery here. I have explained this many times. And this is why you can not use NPS to judge the speed of the engine. When using different core count. If you want to know the true difference in speed you must use time to depth. And this only gets worse as the core count gets higher.stavros wrote: ↑Sun Jan 05, 2020 9:37 pm hello friends
making something experiments i found something paranormal fhenomenom
my device has 8 cores with 5200kn/sec with time to depth 33d/120secs average ,hash at 512mb
then i reduced the number of cores to 2 and i found this:2090kn/sec with time to depth 33d at 90 secs!!! 512 hash also.
tested up to 20 times ,with reduced cores lower speed but faster time of depth?
anyone to explain this mystery?
ps.i used droidfish latest sf dv arm8 android 9
What is your CPU? Your scaling is very poor.... And your Speed at 5200kn/s is very slow for 8 Cores. My phone is almost as fast with 8 cores.
If you are running a phone. Sometimes not all cores are clocked at the same speed.
"The worst thing that can happen to a forum is a running wild attacking moderator(HGM) who is not corrected by the community." - Ed Schröder
But my words like silent raindrops fell. And echoed in the wells of silence.
But my words like silent raindrops fell. And echoed in the wells of silence.