NN Engine GPU Usage

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

User avatar
George Tsavdaris
Posts: 1627
Joined: Thu Mar 09, 2006 12:35 pm

Re: NN Engine GPU Usage

Post by George Tsavdaris »

Stephen Ham wrote: Fri Nov 22, 2019 1:07 am
OK, switching Leela to Multiplexing, since I have two GPUs, and 4 CPUs, but leaving BackendOptions blank, since it crashes when the recommended data is entered (see my other post) I now have Task Manager open exactly as you advised.
Leaving backendoptions blank can never lead to a good end. :D

And what Corres said, is the first time i see this type of command for Leela. :D
This is what you want to put in the BackendOptions in Leela parameters the Fritz GUI:
(backend=cudnn-fp16,gpu=0),(backend=cudnn-fp16,gpu=1)

And choose multiplex(if you do NOT have 2 identical GPUs) or roundrobin(if you have 2 identical GPUs) for using the 2 GPUs.

If that doesn't work then.......nah it will work. :D
After his son's birth they've asked him:
"Is it a boy or girl?"
YES! He replied.....
User avatar
Nordlandia
Posts: 2821
Joined: Fri Sep 25, 2015 9:38 pm
Location: Sortland, Norway

Re: NN Engine GPU Usage

Post by Nordlandia »

I'm considering another ASUS Rog RTX 2080 Super for black friday. How much gain can i expect over single 2080 Super?

Enhanced Leela performance.
corres
Posts: 3657
Joined: Wed Nov 18, 2015 11:41 am
Location: hungary

Re: NN Engine GPU Usage

Post by corres »

Windows Task Manager shows only the CPU usage of GPU (=GRAPHIC CARD)and associated programs..
As I have supposed for monitoring the real GPU parameters and usage YOU OUGHT TO USE GPU-Z and not Task Manager.
corres
Posts: 3657
Joined: Wed Nov 18, 2015 11:41 am
Location: hungary

Re: NN Engine GPU Usage

Post by corres »

Nordlandia wrote: Fri Nov 22, 2019 12:49 pm I'm considering another ASUS Rog RTX 2080 Super for black friday. How much gain can i expect over single 2080 Super?
Enhanced Leela performance.
About 20-30 % plus.
User avatar
George Tsavdaris
Posts: 1627
Joined: Thu Mar 09, 2006 12:35 pm

Re: NN Engine GPU Usage

Post by George Tsavdaris »

corres wrote: Fri Nov 22, 2019 1:35 pm
Nordlandia wrote: Fri Nov 22, 2019 12:49 pm I'm considering another ASUS Rog RTX 2080 Super for black friday. How much gain can i expect over single 2080 Super?
Enhanced Leela performance.
About 20-30 % plus.
Much more. I think 85 % to 95 % is to be expected.
After his son's birth they've asked him:
"Is it a boy or girl?"
YES! He replied.....
corres
Posts: 3657
Joined: Wed Nov 18, 2015 11:41 am
Location: hungary

Re: NN Engine GPU Usage

Post by corres »

George Tsavdaris wrote: Fri Nov 22, 2019 1:47 pm
corres wrote: Fri Nov 22, 2019 1:35 pm
Nordlandia wrote: Fri Nov 22, 2019 12:49 pm I'm considering another ASUS Rog RTX 2080 Super for black friday. How much gain can i expect over single 2080 Super?
Enhanced Leela performance.
About 20-30 % plus.
Much more. I think 85 % to 95 % is to be expected.
It is an illusion.
The price is not proportional to the powers.
corres
Posts: 3657
Joined: Wed Nov 18, 2015 11:41 am
Location: hungary

Re: NN Engine GPU Usage

Post by corres »

corres wrote: Fri Nov 22, 2019 2:52 pm
George Tsavdaris wrote: Fri Nov 22, 2019 1:47 pm
corres wrote: Fri Nov 22, 2019 1:35 pm
Nordlandia wrote: Fri Nov 22, 2019 12:49 pm I'm considering another ASUS Rog RTX 2080 Super for black friday. How much gain can i expect over single 2080 Super?
Enhanced Leela performance.
About 20-30 % plus.
Much more. I think 85 % to 95 % is to be expected.
It is an illusion.
The price is not proportional to the powers.
Sorry, I misunderstood your sentence.
A twin GPUs give about 70 % plus power considering a single GPU.
User avatar
Nordlandia
Posts: 2821
Joined: Fri Sep 25, 2015 9:38 pm
Location: Sortland, Norway

Re: NN Engine GPU Usage

Post by Nordlandia »

Is ponder an option for twin GPUs and NN

For example Leela selfplay at one GPU each.

My PSU is strong enough.
shrapnel
Posts: 1339
Joined: Fri Nov 02, 2012 9:43 am
Location: New Delhi, India

Re: NN Engine GPU Usage

Post by shrapnel »

George Tsavdaris wrote: Fri Nov 22, 2019 10:04 am roundrobin(if you have 2 identical GPUs) for using the 2 GPUs.
Hmm... I didn't know that. I tried it and it seems to be giving faster speeds than multiplexing, so you are right.
Any other tips for multi-gpu users ?
i7 5960X @ 4.1 Ghz, 64 GB G.Skill RipJaws RAM, Twin Asus ROG Strix OC 11 GB Geforce 2080 Tis
corres
Posts: 3657
Joined: Wed Nov 18, 2015 11:41 am
Location: hungary

Re: NN Engine GPU Usage

Post by corres »

Nordlandia wrote: Fri Nov 22, 2019 3:39 pm Is ponder an option for twin GPUs and NN
For example Leela selfplay at one GPU each.
My PSU is strong enough.
If you play one GPU against the other GPU the ponder may be O.K.
I am not sure if ponder works on Leela.
If it works you should configure Leela-s well.
I do not know why you stick to ponder. It causes plus heat and decreases the stability of the system.
Ponder is really good for PC against PC match but for engine-engine match is problematic.