New lc0 v0.23-rc1 VERY FAST

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

shrapnel
Posts: 1339
Joined: Fri Nov 02, 2012 9:43 am
Location: New Delhi, India

New lc0 v0.23-rc1 VERY FAST

Post by shrapnel »

Hi all lc0 users
Do upgrade to the new lc0 v0.23-rc1.
Its giving greatly improved speed and performance.
My speed using the sergio NNs almost doubled !
It should be good for the other NNs too.
Regards
i7 5960X @ 4.1 Ghz, 64 GB G.Skill RipJaws RAM, Twin Asus ROG Strix OC 11 GB Geforce 2080 Tis
smatovic
Posts: 2645
Joined: Wed Mar 10, 2010 10:18 pm
Location: Hamburg, Germany
Full name: Srdja Matovic

Re: New lc0 v0.23-rc1 VERY FAST

Post by smatovic »

shrapnel wrote: Fri Nov 22, 2019 6:34 am Hi all lc0 users
Do upgrade to the new lc0 v0.23-rc1.
Its giving greatly improved speed and performance.
My speed using the sergio NNs almost doubled !
It should be good for the other NNs too.
Regards
Common, numbers please :)

--
Srdja
crem
Posts: 177
Joined: Wed May 23, 2018 9:29 pm

Re: New lc0 v0.23-rc1 VERY FAST

Post by crem »

It should be neither faster nor slower, but there are reports for both.
Being slower is more plausible (e.g. due to bugs, not optimized code etc), but most likely it's just either different weights file or different settings (e.g. you have lc0.config near v0.22).
corres
Posts: 3657
Joined: Wed Nov 18, 2015 11:41 am
Location: hungary

Re: New lc0 v0.23-rc1 VERY FAST

Post by corres »

crem wrote: Fri Nov 22, 2019 9:46 am It should be neither faster nor slower, but there are reports for both.
Being slower is more plausible (e.g. due to bugs, not optimized code etc), but most likely it's just either different weights file or different settings (e.g. you have lc0.config near v0.22).
As I saw the main difference is in time management.
corres
Posts: 3657
Joined: Wed Nov 18, 2015 11:41 am
Location: hungary

Re: New lc0 v0.23-rc1 VERY FAST

Post by corres »

I made some speed test with this dev version:
Params:
setoption name backend value cudnn-fp16
setoption name nncachesize value 5000000
go nodes 10000000
Others are Default
GPU 1 x RTX2060 OC
Net 42872

Results:
lc0 v0.22.0 max nps = 28.7 kN/s (Depth 19, Nodes 9.8 MN)
lc0 v0.23-rc1 max nps = 23.7 kN/s (Depth 19, Nodes 9.7 MN)
So rc1 is rather slower than lc0 v0.22.0
Note
The source of rc1 contains some bugs.
crem
Posts: 177
Joined: Wed May 23, 2018 9:29 pm

Re: New lc0 v0.23-rc1 VERY FAST

Post by crem »

corres wrote: Fri Nov 22, 2019 9:09 pm I made some speed test with this dev version:
Params:
setoption name backend value cudnn-fp16
setoption name nncachesize value 5000000
go nodes 10000000
Others are Default
GPU 1 x RTX2060 OC
Net 42872

Results:
lc0 v0.22.0 max nps = 28.7 kN/s (Depth 19, Nodes 9.8 MN)
lc0 v0.23-rc1 max nps = 23.7 kN/s (Depth 19, Nodes 9.7 MN)
So rc1 is rather slower than lc0 v0.22.0
Note
The source of rc1 contains some bugs.
It's a known bug (for few hours already). When there is no ucinewgame or position befor go command, v0.23 starts counting time from the engine start, while v0.22 starts timer at go command. So it's not a real nps drop, just timer started too early.
That will be fixed in RC2.
corres
Posts: 3657
Joined: Wed Nov 18, 2015 11:41 am
Location: hungary

Re: New lc0 v0.23-rc1 VERY FAST

Post by corres »

crem wrote: Fri Nov 22, 2019 10:21 pm
corres wrote: Fri Nov 22, 2019 9:09 pm I made some speed test with this dev version:
Params:
setoption name backend value cudnn-fp16
setoption name nncachesize value 5000000
go nodes 10000000
Others are Default
GPU 1 x RTX2060 OC
Net 42872

Results:
lc0 v0.22.0 max nps = 28.7 kN/s (Depth 19, Nodes 9.8 MN)
lc0 v0.23-rc1 max nps = 23.7 kN/s (Depth 19, Nodes 9.7 MN)
So rc1 is rather slower than lc0 v0.22.0
Note
The source of rc1 contains some bugs.
It's a known bug (for few hours already). When there is no ucinewgame or position befor go command, v0.23 starts counting time from the engine start, while v0.22 starts timer at go command. So it's not a real nps drop, just timer started too early.
That will be fixed in RC2.
Thanks.
I am waiting for.
User avatar
Ovyron
Posts: 4556
Joined: Tue Jul 03, 2007 4:30 am

Re: New lc0 v0.23-rc1 VERY FAST

Post by Ovyron »

Does "RC1" stand for "Release Candidate"? Because with my experience as Beta tester, I'd advice people to avoid RCs like the plague, and wait until the actual release, because the most bugs tend to hide in them. Unless you're wanting to beta test it yourself.
mwyoung
Posts: 2727
Joined: Wed May 12, 2010 10:00 pm

Re: New lc0 v0.23-rc1 VERY FAST

Post by mwyoung »

shrapnel wrote: Fri Nov 22, 2019 6:34 am Hi all lc0 users
Do upgrade to the new lc0 v0.23-rc1.
Its giving greatly improved speed and performance.
My speed using the sergio NNs almost doubled !
It should be good for the other NNs too.
Regards
"New option --logit-q (UCI: LogitQ). Changes subtree selection algorithm a bit, possibly making it stronger (experimental, default off)."

Any more information on this new option? I will test this to see if works in any meaningful way.
"The worst thing that can happen to a forum is a running wild attacking moderator(HGM) who is not corrected by the community." - Ed Schröder
But my words like silent raindrops fell. And echoed in the wells of silence.
shrapnel
Posts: 1339
Joined: Fri Nov 02, 2012 9:43 am
Location: New Delhi, India

Re: New lc0 v0.23-rc1 VERY FAST

Post by shrapnel »

mwyoung wrote: Sat Nov 23, 2019 6:24 pm"New option --logit-q (UCI: LogitQ). Changes subtree selection algorithm a bit, possibly making it stronger (experimental, default off)."

Any more information on this new option? I will test this to see if works in any meaningful way.
Thanks.
I switched back to v0.22 after all the uproar, but I wasn't having any real problems with v0.23 RC-1, except for a few crashes which I ascribed to some Hardware tweaks I was doing at the same time.
Anyway, do let me know the Results of your Test.
i7 5960X @ 4.1 Ghz, 64 GB G.Skill RipJaws RAM, Twin Asus ROG Strix OC 11 GB Geforce 2080 Tis