Leela on two RTX cards, technical question

[Hugo]

Hi there

i have installed two RTX cards for Leela.
Are there parameters to bring out the best performance for such setup?
Right now I get 60.000 nps - 65.000 nps in console mode after go depth 5000000
But ist different when using leela in a game.
Pretty soon the GPU load is going down to 70% - 80% on both cards.
PSU is big enough, so is this normal ?

C.K.

[smatovic]

Just a guess, but it could be thermal issues, so the gpus clocks go down...

viewtopic.php?f=2&t=70097

Two RTX have about 500 watts TDP, this has somehow to leave the PC case.

--
Srdja

[smatovic]

...
Are there parameters to bring out the best performance for such setup?
...

Take a look at this sheet for different LC0 gpu parameters and nps:

https://docs.google.com/spreadsheets/d/ ... CjBILe6uA/

For RTX gpus you should use currently the cudnn-fp16 backend, tunebale params are threads, nn cache and batch size for example.

--
Srdja

[Albert Silver]

Hi there

i have installed two RTX cards for Leela.
Are there parameters to bring out the best performance for such setup?
Right now I get 60.000 nps - 65.000 nps in console mode after go depth 5000000
But ist different when using leela in a game.
Pretty soon the GPU load is going down to 70% - 80% on both cards.
PSU is big enough, so is this normal ?

C.K.

It is normal.