Lc0 + CUDA 11 --- 50% loss of speed?

[zullil]

Yesterday I upgraded to CUDA 11.0.189 RC + Driver 450.36.06 + cuDNN v8.0.0 RC. This is on an Ubuntu 18.04.4 box with a 2080Ti GPU.

I then built Lc0-dev and benchmarked, using several networks I had benchmarked previously. All my speeds were at about 50% of what they had been before.

I reverted everything to CUDA 10.2, and, after rebuilding Lc0, speeds were back to their previous levels.

Anyone else experience this? Or have some thoughts about what might have occurred? Thanks.

[brianr]

This was mentioned on the Leela Discord also.
It was pointed out that this is a "release candidate" level release, so more to be done.

[zullil]

Thanks. Good to know it wasn't just me.

Yes, I had some concerns regarding that RC designation.

[zullil]

Yesterday I upgraded to CUDA 11.0.189 RC + Driver 450.36.06 + cuDNN v8.0.0 RC. This is on an Ubuntu 18.04.4 box with a 2080Ti GPU.

I then built Lc0-dev and benchmarked, using several networks I had benchmarked previously. All my speeds were at about 50% of what they had been before.

I reverted everything to CUDA 10.2, and, after rebuilding Lc0, speeds were back to their previous levels.

Anyone else experience this? Or have some thoughts about what might have occurred? Thanks.

Has anyone upgraded to CUDA 11.0.194 + cuDNN v8.0.1 RC2? Any info about their effects on Lc0 speed? Not sure I want to upgrade and then discover that I need to revert this again.