Modified Leela for 24x320 nets

Discussion of anything and everything relating to chess playing software and machines.

Moderators: hgm, Rebel, chrisw

corres
Posts: 3657
Joined: Wed Nov 18, 2015 11:41 am
Location: hungary

Modified Leela for 24x320 nets

Post by corres »

As we can read on chess.com Leela use a modified lc0.exe for the bigger nets.
But where that .exe and its source is?
With lc0 ver.0.22.0 these nets are rather weak.
Dann Corbit
Posts: 12542
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Modified Leela for 24x320 nets

Post by Dann Corbit »

I guess the problem is with the GPUs and not the nets.

If you have several very strong GPUs, I guess it will play well.

I found that the 320 nets are too large for my Nvidia 1080 TI card.
(At least, the nets one size down play better).
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
corres
Posts: 3657
Joined: Wed Nov 18, 2015 11:41 am
Location: hungary

Re: Modified Leela for 24x320 nets

Post by corres »

Dann Corbit wrote: Tue Nov 12, 2019 9:41 pm I guess the problem is with the GPUs and not the nets.

If you have several very strong GPUs, I guess it will play well.

I found that the 320 nets are too large for my Nvidia 1080 TI card.
(At least, the nets one size down play better).
O.K.
But chess.com writes about a modified lc0.exe for 6111x net what is a 24 x 320 (medium size) net.
About this modified lco there is no any information.
Btw.
I am not the only one man who would be satisfied if you would make test (as I also did) with your powerful system.
Dann Corbit
Posts: 12542
Joined: Wed Mar 08, 2006 8:57 pm
Location: Redmond, WA USA

Re: Modified Leela for 24x320 nets

Post by Dann Corbit »

I have a lot of GPUs, but most of them are pretty wimpy.
I only have one big one (1080 TI) and it runs out of steam trying to do the x320 nets.
I already did my own experiment with that card.
The smallest nets were too small and the biggest nets were too big for my card.
Either that, or the mid-sized network I used was just better built.

Hard to know at this point.

I am going to buy a bunch of high-end cards, but it won't be until 2020.
Taking ideas is not a vice, it is a virtue. We have another word for this. It is called learning.
But sharing ideas is an even greater virtue. We have another word for this. It is called teaching.
User avatar
Laskos
Posts: 10948
Joined: Wed Jul 26, 2006 10:21 pm
Full name: Kai Laskos

Re: Modified Leela for 24x320 nets

Post by Laskos »

corres wrote: Tue Nov 12, 2019 10:23 pm
Dann Corbit wrote: Tue Nov 12, 2019 9:41 pm I guess the problem is with the GPUs and not the nets.

If you have several very strong GPUs, I guess it will play well.

I found that the 320 nets are too large for my Nvidia 1080 TI card.
(At least, the nets one size down play better).
O.K.
But chess.com writes about a modified lc0.exe for 6111x net what is a 24 x 320 (medium size) net.
About this modified lco there is no any information.
Btw.
I am not the only one man who would be satisfied if you would make test (as I also did) with your powerful system.
I had on OC RTX 2070 at some LTC 3600 sec + 36 sec some 3:1 =16 result in favor of 24x320 against 20x256. Inconclusive, but it seems that only at LTC on strong hardware the bigger net beats the regular late T40 net.

EDIT: I have mixed results in similar conditions of the two nets against Stockfish, totally inconclusive in comparing the two nets.
corres
Posts: 3657
Joined: Wed Nov 18, 2015 11:41 am
Location: hungary

Re: Modified Leela for 24x320 nets

Post by corres »

Laskos wrote: Tue Nov 12, 2019 10:40 pm
corres wrote: Tue Nov 12, 2019 10:23 pm
Dann Corbit wrote: Tue Nov 12, 2019 9:41 pm I guess the problem is with the GPUs and not the nets.

If you have several very strong GPUs, I guess it will play well.

I found that the 320 nets are too large for my Nvidia 1080 TI card.
(At least, the nets one size down play better).
O.K.
But chess.com writes about a modified lc0.exe for 6111x net what is a 24 x 320 (medium size) net.
About this modified lco there is no any information.
Btw.
I am not the only one man who would be satisfied if you would make test (as I also did) with your powerful system.
I had on OC RTX 2070 at some LTC 3600 sec + 36 sec some 3:1 =16 result in favor of 24x320 against 20x256. Inconclusive, but it seems that only at LTC on strong hardware the bigger net beats the regular late T40 net.

EDIT: I have mixed results in similar conditions of the two nets against Stockfish, totally inconclusive in comparing the two nets.
Interesting, maybe the new lc0 will produce more balanced results.
The Lczero-client ver.0.23.0 can be downloaded from Github, but lc0.exe ver.0.23.0 can not at present.
corres
Posts: 3657
Joined: Wed Nov 18, 2015 11:41 am
Location: hungary

Re: Modified Leela for 24x320 nets

Post by corres »

It is obvious to me the developers of Leela intentionally keep lc0 ver.0.23 and its source back from the publicity.
There were a lot of dispute between them and the authors of the Leela`s derivatives.
I think if developers of Stockfish would behave the same mode the source of Stockfish would be closed in the far past...
User avatar
Guenther
Posts: 4610
Joined: Wed Oct 01, 2008 6:33 am
Location: Regensburg, Germany
Full name: Guenther Simon

Re: Modified Leela for 24x320 nets

Post by Guenther »

corres wrote: Tue Nov 12, 2019 11:15 pm ...


The Lczero-client ver.0.23.0 can be downloaded from Github, but lc0.exe ver.0.23.0 can not at present.
The latest dev version can always be downloaded via appveyor (for at least a year).
https://ci.appveyor.com/project/LeelaCh ... c0/history
https://rwbc-chess.de

trollwatch:
Talkchess nowadays is a joke - it is full of trolls/idiots/people stuck in the pleistocene > 80% of the posts fall into this category...