lc0-win-20180512-cuda90-cudnn712-00

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Dann Corbit, Harvey Williamson

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Milos
Posts: 3988
Joined: Wed Nov 25, 2009 12:47 am

Re: lc0-win-20180512-cuda90-cudnn712-00

Post by Milos » Wed May 23, 2018 7:02 pm

IQ wrote:
Wed May 23, 2018 6:44 pm
So who is gonna write that concurrent self-play client, you? Do have any idea how much effort is required to do this properly without introducing further bugs? I guess you don't...
That's done already - try:

lc0-cudnn selfplay --parallelism=8 --backend=multiplexing "--backend-opts=cudnn(threads=2)" --games=1000 --visits=800 --tempdecay-moves=10
you can also pass different arguments for both players by adding "player1: --argument=x player2: --argument=y"

You should really tone down your language and insults, Milos - why don't you contribute instead of complaining? Let us all see your awesome skills.
Oh, please, you clearly don't know what you are talking about.
We are talking about official LCZero client not CUDA branch from Alex that is anyway already using batching on single instance, because self-play games so far are only played by official client. Multiplexing batches with CUDA is easier, with official LC0 you'd have to rewrite OpenCL part from scratch.

IQ
Posts: 162
Joined: Thu Dec 17, 2009 9:46 am

Re: lc0-win-20180512-cuda90-cudnn712-00

Post by IQ » Wed May 23, 2018 8:27 pm

Milos wrote:
Wed May 23, 2018 7:02 pm
Oh, please, you clearly don't know what you are talking about.
We are talking about official LCZero client not CUDA branch from Alex that is anyway already using batching on single instance, because self-play games so far are only played by official client. Multiplexing batches with CUDA is easier, with official LC0 you'd have to rewrite OpenCL part from scratch.
Plans are to use LC0 (the CUDA branch) for training games eventually - I really do not get what you are complaining about. But as discussions with you are generally turning into the unpleasant, lets just end it here.

oreopoulos
Posts: 109
Joined: Fri Apr 25, 2008 8:56 pm

Re: lc0-win-20180512-cuda90-cudnn712-00

Post by oreopoulos » Fri May 25, 2018 12:51 am

Is there any link explaining all these UCI options?

Also why does it report depth to 1 or 2?

Lion
Posts: 521
Joined: Fri Mar 31, 2006 11:26 am
Location: Switzerland

Re: lc0-win-20180512-cuda90-cudnn712-00

Post by Lion » Fri May 25, 2018 7:39 am

Albert Silver wrote:
Sun May 20, 2018 4:33 am
shrapnel wrote:
Sun May 20, 2018 3:46 am
Albert Silver wrote:
Sun May 20, 2018 3:28 am
No, it is completely unnecessary. You can ignore that warning too. It relates only to CUDA items for VS, and nothing to do with Leela. There is now a 9.2 version, so by all means install it and use the latest LC0 built for it.

lc0-win-20180519-cuda92-cudnn714-00.7z
Thank You, that was very helpful.
Which CUDA Installer should I use, the exe (network) or exe (local) ?
I used local. It is a big install, with some unnecessary items such as the Visual Studio extras. Don't worry if it complains it can't find it. Once all is installed, including cuDNN, you need to locate three DLLs in all, and copy them in the LCZero folder:

cublas64_92.dll
cudart64_92.dll
cudnn64_7.dll

After that just enjoy LC0 in https://crem.xyz/lc0/ Be sure to configure its UCI options, including the path of the weights file. For example, mine shows: C:\Users\Albert\Chess\LCZero\weights.txt.

Feel free to use the optimized settings described in a previous post in this thread.
Hello,

I thought I installed everything needed but couldn't find/locate the 2 following dll's:
cublas64_92.dll
cudart64_92.dll

Where can I find them/download them from ?

rgds

Albert Silver
Posts: 2964
Joined: Wed Mar 08, 2006 8:57 pm
Location: Rio de Janeiro, Brazil

Re: lc0-win-20180512-cuda90-cudnn712-00

Post by Albert Silver » Fri May 25, 2018 1:00 pm

Lion wrote:
Fri May 25, 2018 7:39 am
Albert Silver wrote:
Sun May 20, 2018 4:33 am
shrapnel wrote:
Sun May 20, 2018 3:46 am

Thank You, that was very helpful.
Which CUDA Installer should I use, the exe (network) or exe (local) ?
I used local. It is a big install, with some unnecessary items such as the Visual Studio extras. Don't worry if it complains it can't find it. Once all is installed, including cuDNN, you need to locate three DLLs in all, and copy them in the LCZero folder:

cublas64_92.dll
cudart64_92.dll
cudnn64_7.dll

After that just enjoy LC0 in https://crem.xyz/lc0/ Be sure to configure its UCI options, including the path of the weights file. For example, mine shows: C:\Users\Albert\Chess\LCZero\weights.txt.

Feel free to use the optimized settings described in a previous post in this thread.
Hello,

I thought I installed everything needed but couldn't find/locate the 2 following dll's:
cublas64_92.dll
cudart64_92.dll

Where can I find them/download them from ?

rgds
C:\Program Files\Nvidia GPU Computing Toolkit\Cuda\v9.2\bin
"Tactics are the bricks and sticks that make up a game, but positional play is the architectural blueprint."

Lion
Posts: 521
Joined: Fri Mar 31, 2006 11:26 am
Location: Switzerland

Re: lc0-win-20180512-cuda90-cudnn712-00

Post by Lion » Fri May 25, 2018 1:23 pm

Albert Silver wrote:
Fri May 25, 2018 1:00 pm
Lion wrote:
Fri May 25, 2018 7:39 am
Albert Silver wrote:
Sun May 20, 2018 4:33 am


I used local. It is a big install, with some unnecessary items such as the Visual Studio extras. Don't worry if it complains it can't find it. Once all is installed, including cuDNN, you need to locate three DLLs in all, and copy them in the LCZero folder:

cublas64_92.dll
cudart64_92.dll
cudnn64_7.dll

After that just enjoy LC0 in https://crem.xyz/lc0/ Be sure to configure its UCI options, including the path of the weights file. For example, mine shows: C:\Users\Albert\Chess\LCZero\weights.txt.

Feel free to use the optimized settings described in a previous post in this thread.
Hello,

I thought I installed everything needed but couldn't find/locate the 2 following dll's:
cublas64_92.dll
cudart64_92.dll

Where can I find them/download them from ?

rgds
C:\Program Files\Nvidia GPU Computing Toolkit\Cuda\v9.2\bin
Thank you !

I have now found them and copy them to the same folder as LC0. Unfortunately, I still dont see any increase of nps....?
Any idea what I am still missing?

rgds

Albert Silver
Posts: 2964
Joined: Wed Mar 08, 2006 8:57 pm
Location: Rio de Janeiro, Brazil

Re: lc0-win-20180512-cuda90-cudnn712-00

Post by Albert Silver » Fri May 25, 2018 4:05 pm

Lion wrote:
Fri May 25, 2018 1:23 pm
Albert Silver wrote:
Fri May 25, 2018 1:00 pm
Lion wrote:
Fri May 25, 2018 7:39 am


Hello,

I thought I installed everything needed but couldn't find/locate the 2 following dll's:
cublas64_92.dll
cudart64_92.dll

Where can I find them/download them from ?

rgds
C:\Program Files\Nvidia GPU Computing Toolkit\Cuda\v9.2\bin
Thank you !

I have now found them and copy them to the same folder as LC0. Unfortunately, I still dont see any increase of nps....?
Any idea what I am still missing?

rgds
You have all three DLLs in the folder, and your cuDNN is the correct one for CUDA 9.2?
"Tactics are the bricks and sticks that make up a game, but positional play is the architectural blueprint."

pohl4711
Posts: 1461
Joined: Sat Sep 03, 2011 5:25 am
Location: Berlin, Germany
Contact:

Re: lc0-win-20180512-cuda90-cudnn712-00

Post by pohl4711 » Fri May 25, 2018 4:34 pm

Lion wrote:
Fri May 25, 2018 1:23 pm
Albert Silver wrote:
Fri May 25, 2018 1:00 pm
Lion wrote:
Fri May 25, 2018 7:39 am


Hello,

I thought I installed everything needed but couldn't find/locate the 2 following dll's:
cublas64_92.dll
cudart64_92.dll

Where can I find them/download them from ?

rgds
C:\Program Files\Nvidia GPU Computing Toolkit\Cuda\v9.2\bin
Thank you !

I have now found them and copy them to the same folder as LC0. Unfortunately, I still dont see any increase of nps....?
Any idea what I am still missing?

rgds
Nothing. With Cuda 9.2 Leela is only 5% faster, than with Cuda 9.0. No big difference.

Werewolf
Posts: 1334
Joined: Thu Sep 18, 2008 8:24 pm

Re: lc0-win-20180512-cuda90-cudnn712-00

Post by Werewolf » Fri May 25, 2018 4:51 pm

pohl4711 wrote:
Fri May 25, 2018 4:34 pm
Lion wrote:
Fri May 25, 2018 1:23 pm
Albert Silver wrote:
Fri May 25, 2018 1:00 pm


C:\Program Files\Nvidia GPU Computing Toolkit\Cuda\v9.2\bin
Thank you !

I have now found them and copy them to the same folder as LC0. Unfortunately, I still dont see any increase of nps....?
Any idea what I am still missing?

rgds
Nothing. With Cuda 9.2 Leela is only 5% faster, than with Cuda 9.0. No big difference.
I think he meant only 5% faster than the Open CL (non-CUDA) LCZero. So something is wrong.

Albert Silver
Posts: 2964
Joined: Wed Mar 08, 2006 8:57 pm
Location: Rio de Janeiro, Brazil

Re: lc0-win-20180512-cuda90-cudnn712-00

Post by Albert Silver » Fri May 25, 2018 4:52 pm

Werewolf wrote:
Fri May 25, 2018 4:51 pm
pohl4711 wrote:
Fri May 25, 2018 4:34 pm
Lion wrote:
Fri May 25, 2018 1:23 pm


Thank you !

I have now found them and copy them to the same folder as LC0. Unfortunately, I still dont see any increase of nps....?
Any idea what I am still missing?

rgds
Nothing. With Cuda 9.2 Leela is only 5% faster, than with Cuda 9.0. No big difference.
I think he meant only 5% faster than the Open CL (non-CUDA) LCZero. So something is wrong.
It should be noted that without the DLLs, LC0 won't even run.
"Tactics are the bricks and sticks that make up a game, but positional play is the architectural blueprint."

Post Reply