Page 9 of 11

Re: lc0-win-20180512-cuda90-cudnn712-00

Posted: Wed May 23, 2018 9:02 pm
by Milos
IQ wrote: Wed May 23, 2018 8:44 pm
So who is gonna write that concurrent self-play client, you? Do have any idea how much effort is required to do this properly without introducing further bugs? I guess you don't...
That's done already - try:

lc0-cudnn selfplay --parallelism=8 --backend=multiplexing "--backend-opts=cudnn(threads=2)" --games=1000 --visits=800 --tempdecay-moves=10
you can also pass different arguments for both players by adding "player1: --argument=x player2: --argument=y"

You should really tone down your language and insults, Milos - why don't you contribute instead of complaining? Let us all see your awesome skills.
Oh, please, you clearly don't know what you are talking about.
We are talking about official LCZero client not CUDA branch from Alex that is anyway already using batching on single instance, because self-play games so far are only played by official client. Multiplexing batches with CUDA is easier, with official LC0 you'd have to rewrite OpenCL part from scratch.

Re: lc0-win-20180512-cuda90-cudnn712-00

Posted: Wed May 23, 2018 10:27 pm
by IQ
Milos wrote: Wed May 23, 2018 9:02 pm Oh, please, you clearly don't know what you are talking about.
We are talking about official LCZero client not CUDA branch from Alex that is anyway already using batching on single instance, because self-play games so far are only played by official client. Multiplexing batches with CUDA is easier, with official LC0 you'd have to rewrite OpenCL part from scratch.
Plans are to use LC0 (the CUDA branch) for training games eventually - I really do not get what you are complaining about. But as discussions with you are generally turning into the unpleasant, lets just end it here.

Re: lc0-win-20180512-cuda90-cudnn712-00

Posted: Fri May 25, 2018 2:51 am
by oreopoulos
Is there any link explaining all these UCI options?

Also why does it report depth to 1 or 2?

Re: lc0-win-20180512-cuda90-cudnn712-00

Posted: Fri May 25, 2018 9:39 am
by Lion
Albert Silver wrote: Sun May 20, 2018 6:33 am
shrapnel wrote: Sun May 20, 2018 5:46 am
Albert Silver wrote: Sun May 20, 2018 5:28 am No, it is completely unnecessary. You can ignore that warning too. It relates only to CUDA items for VS, and nothing to do with Leela. There is now a 9.2 version, so by all means install it and use the latest LC0 built for it.

lc0-win-20180519-cuda92-cudnn714-00.7z
Thank You, that was very helpful.
Which CUDA Installer should I use, the exe (network) or exe (local) ?
I used local. It is a big install, with some unnecessary items such as the Visual Studio extras. Don't worry if it complains it can't find it. Once all is installed, including cuDNN, you need to locate three DLLs in all, and copy them in the LCZero folder:

cublas64_92.dll
cudart64_92.dll
cudnn64_7.dll

After that just enjoy LC0 in https://crem.xyz/lc0/ Be sure to configure its UCI options, including the path of the weights file. For example, mine shows: C:\Users\Albert\Chess\LCZero\weights.txt.

Feel free to use the optimized settings described in a previous post in this thread.
Hello,

I thought I installed everything needed but couldn't find/locate the 2 following dll's:
cublas64_92.dll
cudart64_92.dll

Where can I find them/download them from ?

rgds

Re: lc0-win-20180512-cuda90-cudnn712-00

Posted: Fri May 25, 2018 3:00 pm
by Albert Silver
Lion wrote: Fri May 25, 2018 9:39 am
Albert Silver wrote: Sun May 20, 2018 6:33 am
shrapnel wrote: Sun May 20, 2018 5:46 am
Thank You, that was very helpful.
Which CUDA Installer should I use, the exe (network) or exe (local) ?
I used local. It is a big install, with some unnecessary items such as the Visual Studio extras. Don't worry if it complains it can't find it. Once all is installed, including cuDNN, you need to locate three DLLs in all, and copy them in the LCZero folder:

cublas64_92.dll
cudart64_92.dll
cudnn64_7.dll

After that just enjoy LC0 in https://crem.xyz/lc0/ Be sure to configure its UCI options, including the path of the weights file. For example, mine shows: C:\Users\Albert\Chess\LCZero\weights.txt.

Feel free to use the optimized settings described in a previous post in this thread.
Hello,

I thought I installed everything needed but couldn't find/locate the 2 following dll's:
cublas64_92.dll
cudart64_92.dll

Where can I find them/download them from ?

rgds
C:\Program Files\Nvidia GPU Computing Toolkit\Cuda\v9.2\bin

Re: lc0-win-20180512-cuda90-cudnn712-00

Posted: Fri May 25, 2018 3:23 pm
by Lion
Albert Silver wrote: Fri May 25, 2018 3:00 pm
Lion wrote: Fri May 25, 2018 9:39 am
Albert Silver wrote: Sun May 20, 2018 6:33 am

I used local. It is a big install, with some unnecessary items such as the Visual Studio extras. Don't worry if it complains it can't find it. Once all is installed, including cuDNN, you need to locate three DLLs in all, and copy them in the LCZero folder:

cublas64_92.dll
cudart64_92.dll
cudnn64_7.dll

After that just enjoy LC0 in https://crem.xyz/lc0/ Be sure to configure its UCI options, including the path of the weights file. For example, mine shows: C:\Users\Albert\Chess\LCZero\weights.txt.

Feel free to use the optimized settings described in a previous post in this thread.
Hello,

I thought I installed everything needed but couldn't find/locate the 2 following dll's:
cublas64_92.dll
cudart64_92.dll

Where can I find them/download them from ?

rgds
C:\Program Files\Nvidia GPU Computing Toolkit\Cuda\v9.2\bin
Thank you !

I have now found them and copy them to the same folder as LC0. Unfortunately, I still dont see any increase of nps....?
Any idea what I am still missing?

rgds

Re: lc0-win-20180512-cuda90-cudnn712-00

Posted: Fri May 25, 2018 6:05 pm
by Albert Silver
Lion wrote: Fri May 25, 2018 3:23 pm
Albert Silver wrote: Fri May 25, 2018 3:00 pm
Lion wrote: Fri May 25, 2018 9:39 am

Hello,

I thought I installed everything needed but couldn't find/locate the 2 following dll's:
cublas64_92.dll
cudart64_92.dll

Where can I find them/download them from ?

rgds
C:\Program Files\Nvidia GPU Computing Toolkit\Cuda\v9.2\bin
Thank you !

I have now found them and copy them to the same folder as LC0. Unfortunately, I still dont see any increase of nps....?
Any idea what I am still missing?

rgds
You have all three DLLs in the folder, and your cuDNN is the correct one for CUDA 9.2?

Re: lc0-win-20180512-cuda90-cudnn712-00

Posted: Fri May 25, 2018 6:34 pm
by pohl4711
Lion wrote: Fri May 25, 2018 3:23 pm
Albert Silver wrote: Fri May 25, 2018 3:00 pm
Lion wrote: Fri May 25, 2018 9:39 am

Hello,

I thought I installed everything needed but couldn't find/locate the 2 following dll's:
cublas64_92.dll
cudart64_92.dll

Where can I find them/download them from ?

rgds
C:\Program Files\Nvidia GPU Computing Toolkit\Cuda\v9.2\bin
Thank you !

I have now found them and copy them to the same folder as LC0. Unfortunately, I still dont see any increase of nps....?
Any idea what I am still missing?

rgds
Nothing. With Cuda 9.2 Leela is only 5% faster, than with Cuda 9.0. No big difference.

Re: lc0-win-20180512-cuda90-cudnn712-00

Posted: Fri May 25, 2018 6:51 pm
by Werewolf
pohl4711 wrote: Fri May 25, 2018 6:34 pm
Lion wrote: Fri May 25, 2018 3:23 pm
Albert Silver wrote: Fri May 25, 2018 3:00 pm

C:\Program Files\Nvidia GPU Computing Toolkit\Cuda\v9.2\bin
Thank you !

I have now found them and copy them to the same folder as LC0. Unfortunately, I still dont see any increase of nps....?
Any idea what I am still missing?

rgds
Nothing. With Cuda 9.2 Leela is only 5% faster, than with Cuda 9.0. No big difference.
I think he meant only 5% faster than the Open CL (non-CUDA) LCZero. So something is wrong.

Re: lc0-win-20180512-cuda90-cudnn712-00

Posted: Fri May 25, 2018 6:52 pm
by Albert Silver
Werewolf wrote: Fri May 25, 2018 6:51 pm
pohl4711 wrote: Fri May 25, 2018 6:34 pm
Lion wrote: Fri May 25, 2018 3:23 pm

Thank you !

I have now found them and copy them to the same folder as LC0. Unfortunately, I still dont see any increase of nps....?
Any idea what I am still missing?

rgds
Nothing. With Cuda 9.2 Leela is only 5% faster, than with Cuda 9.0. No big difference.
I think he meant only 5% faster than the Open CL (non-CUDA) LCZero. So something is wrong.
It should be noted that without the DLLs, LC0 won't even run.