lc0-win-20180512-cuda90-cudnn712-00

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

Milos
Posts: 4190
Joined: Wed Nov 25, 2009 1:47 am

Re: lc0-win-20180512-cuda90-cudnn712-00

Post by Milos »

IQ wrote: Wed May 23, 2018 8:44 pm
So who is gonna write that concurrent self-play client, you? Do have any idea how much effort is required to do this properly without introducing further bugs? I guess you don't...
That's done already - try:

lc0-cudnn selfplay --parallelism=8 --backend=multiplexing "--backend-opts=cudnn(threads=2)" --games=1000 --visits=800 --tempdecay-moves=10
you can also pass different arguments for both players by adding "player1: --argument=x player2: --argument=y"

You should really tone down your language and insults, Milos - why don't you contribute instead of complaining? Let us all see your awesome skills.
Oh, please, you clearly don't know what you are talking about.
We are talking about official LCZero client not CUDA branch from Alex that is anyway already using batching on single instance, because self-play games so far are only played by official client. Multiplexing batches with CUDA is easier, with official LC0 you'd have to rewrite OpenCL part from scratch.
IQ
Posts: 162
Joined: Thu Dec 17, 2009 10:46 am

Re: lc0-win-20180512-cuda90-cudnn712-00

Post by IQ »

Milos wrote: Wed May 23, 2018 9:02 pm Oh, please, you clearly don't know what you are talking about.
We are talking about official LCZero client not CUDA branch from Alex that is anyway already using batching on single instance, because self-play games so far are only played by official client. Multiplexing batches with CUDA is easier, with official LC0 you'd have to rewrite OpenCL part from scratch.
Plans are to use LC0 (the CUDA branch) for training games eventually - I really do not get what you are complaining about. But as discussions with you are generally turning into the unpleasant, lets just end it here.
oreopoulos
Posts: 110
Joined: Fri Apr 25, 2008 10:56 pm

Re: lc0-win-20180512-cuda90-cudnn712-00

Post by oreopoulos »

Is there any link explaining all these UCI options?

Also why does it report depth to 1 or 2?
Lion
Posts: 531
Joined: Fri Mar 31, 2006 1:26 pm
Location: Switzerland

Re: lc0-win-20180512-cuda90-cudnn712-00

Post by Lion »

Albert Silver wrote: Sun May 20, 2018 6:33 am
shrapnel wrote: Sun May 20, 2018 5:46 am
Albert Silver wrote: Sun May 20, 2018 5:28 am No, it is completely unnecessary. You can ignore that warning too. It relates only to CUDA items for VS, and nothing to do with Leela. There is now a 9.2 version, so by all means install it and use the latest LC0 built for it.

lc0-win-20180519-cuda92-cudnn714-00.7z
Thank You, that was very helpful.
Which CUDA Installer should I use, the exe (network) or exe (local) ?
I used local. It is a big install, with some unnecessary items such as the Visual Studio extras. Don't worry if it complains it can't find it. Once all is installed, including cuDNN, you need to locate three DLLs in all, and copy them in the LCZero folder:

cublas64_92.dll
cudart64_92.dll
cudnn64_7.dll

After that just enjoy LC0 in https://crem.xyz/lc0/ Be sure to configure its UCI options, including the path of the weights file. For example, mine shows: C:\Users\Albert\Chess\LCZero\weights.txt.

Feel free to use the optimized settings described in a previous post in this thread.
Hello,

I thought I installed everything needed but couldn't find/locate the 2 following dll's:
cublas64_92.dll
cudart64_92.dll

Where can I find them/download them from ?

rgds
Albert Silver
Posts: 3019
Joined: Wed Mar 08, 2006 9:57 pm
Location: Rio de Janeiro, Brazil

Re: lc0-win-20180512-cuda90-cudnn712-00

Post by Albert Silver »

Lion wrote: Fri May 25, 2018 9:39 am
Albert Silver wrote: Sun May 20, 2018 6:33 am
shrapnel wrote: Sun May 20, 2018 5:46 am
Thank You, that was very helpful.
Which CUDA Installer should I use, the exe (network) or exe (local) ?
I used local. It is a big install, with some unnecessary items such as the Visual Studio extras. Don't worry if it complains it can't find it. Once all is installed, including cuDNN, you need to locate three DLLs in all, and copy them in the LCZero folder:

cublas64_92.dll
cudart64_92.dll
cudnn64_7.dll

After that just enjoy LC0 in https://crem.xyz/lc0/ Be sure to configure its UCI options, including the path of the weights file. For example, mine shows: C:\Users\Albert\Chess\LCZero\weights.txt.

Feel free to use the optimized settings described in a previous post in this thread.
Hello,

I thought I installed everything needed but couldn't find/locate the 2 following dll's:
cublas64_92.dll
cudart64_92.dll

Where can I find them/download them from ?

rgds
C:\Program Files\Nvidia GPU Computing Toolkit\Cuda\v9.2\bin
"Tactics are the bricks and sticks that make up a game, but positional play is the architectural blueprint."
Lion
Posts: 531
Joined: Fri Mar 31, 2006 1:26 pm
Location: Switzerland

Re: lc0-win-20180512-cuda90-cudnn712-00

Post by Lion »

Albert Silver wrote: Fri May 25, 2018 3:00 pm
Lion wrote: Fri May 25, 2018 9:39 am
Albert Silver wrote: Sun May 20, 2018 6:33 am

I used local. It is a big install, with some unnecessary items such as the Visual Studio extras. Don't worry if it complains it can't find it. Once all is installed, including cuDNN, you need to locate three DLLs in all, and copy them in the LCZero folder:

cublas64_92.dll
cudart64_92.dll
cudnn64_7.dll

After that just enjoy LC0 in https://crem.xyz/lc0/ Be sure to configure its UCI options, including the path of the weights file. For example, mine shows: C:\Users\Albert\Chess\LCZero\weights.txt.

Feel free to use the optimized settings described in a previous post in this thread.
Hello,

I thought I installed everything needed but couldn't find/locate the 2 following dll's:
cublas64_92.dll
cudart64_92.dll

Where can I find them/download them from ?

rgds
C:\Program Files\Nvidia GPU Computing Toolkit\Cuda\v9.2\bin
Thank you !

I have now found them and copy them to the same folder as LC0. Unfortunately, I still dont see any increase of nps....?
Any idea what I am still missing?

rgds
Albert Silver
Posts: 3019
Joined: Wed Mar 08, 2006 9:57 pm
Location: Rio de Janeiro, Brazil

Re: lc0-win-20180512-cuda90-cudnn712-00

Post by Albert Silver »

Lion wrote: Fri May 25, 2018 3:23 pm
Albert Silver wrote: Fri May 25, 2018 3:00 pm
Lion wrote: Fri May 25, 2018 9:39 am

Hello,

I thought I installed everything needed but couldn't find/locate the 2 following dll's:
cublas64_92.dll
cudart64_92.dll

Where can I find them/download them from ?

rgds
C:\Program Files\Nvidia GPU Computing Toolkit\Cuda\v9.2\bin
Thank you !

I have now found them and copy them to the same folder as LC0. Unfortunately, I still dont see any increase of nps....?
Any idea what I am still missing?

rgds
You have all three DLLs in the folder, and your cuDNN is the correct one for CUDA 9.2?
"Tactics are the bricks and sticks that make up a game, but positional play is the architectural blueprint."
User avatar
pohl4711
Posts: 2433
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

Re: lc0-win-20180512-cuda90-cudnn712-00

Post by pohl4711 »

Lion wrote: Fri May 25, 2018 3:23 pm
Albert Silver wrote: Fri May 25, 2018 3:00 pm
Lion wrote: Fri May 25, 2018 9:39 am

Hello,

I thought I installed everything needed but couldn't find/locate the 2 following dll's:
cublas64_92.dll
cudart64_92.dll

Where can I find them/download them from ?

rgds
C:\Program Files\Nvidia GPU Computing Toolkit\Cuda\v9.2\bin
Thank you !

I have now found them and copy them to the same folder as LC0. Unfortunately, I still dont see any increase of nps....?
Any idea what I am still missing?

rgds
Nothing. With Cuda 9.2 Leela is only 5% faster, than with Cuda 9.0. No big difference.
Werewolf
Posts: 1795
Joined: Thu Sep 18, 2008 10:24 pm

Re: lc0-win-20180512-cuda90-cudnn712-00

Post by Werewolf »

pohl4711 wrote: Fri May 25, 2018 6:34 pm
Lion wrote: Fri May 25, 2018 3:23 pm
Albert Silver wrote: Fri May 25, 2018 3:00 pm

C:\Program Files\Nvidia GPU Computing Toolkit\Cuda\v9.2\bin
Thank you !

I have now found them and copy them to the same folder as LC0. Unfortunately, I still dont see any increase of nps....?
Any idea what I am still missing?

rgds
Nothing. With Cuda 9.2 Leela is only 5% faster, than with Cuda 9.0. No big difference.
I think he meant only 5% faster than the Open CL (non-CUDA) LCZero. So something is wrong.
Albert Silver
Posts: 3019
Joined: Wed Mar 08, 2006 9:57 pm
Location: Rio de Janeiro, Brazil

Re: lc0-win-20180512-cuda90-cudnn712-00

Post by Albert Silver »

Werewolf wrote: Fri May 25, 2018 6:51 pm
pohl4711 wrote: Fri May 25, 2018 6:34 pm
Lion wrote: Fri May 25, 2018 3:23 pm

Thank you !

I have now found them and copy them to the same folder as LC0. Unfortunately, I still dont see any increase of nps....?
Any idea what I am still missing?

rgds
Nothing. With Cuda 9.2 Leela is only 5% faster, than with Cuda 9.0. No big difference.
I think he meant only 5% faster than the Open CL (non-CUDA) LCZero. So something is wrong.
It should be noted that without the DLLs, LC0 won't even run.
"Tactics are the bricks and sticks that make up a game, but positional play is the architectural blueprint."