This is the mistake the Testers at lc0.org are making, at least as far as Competitive Chess against AB Engines is concerned.corres wrote: ↑Fri Oct 25, 2019 7:32 pmOpening positions was the same in both matches.
Leela parameters were also the same in the case of the two net.
So enhancing the move time (or the power of GPUs) the result tend to reach equality.
It would be interesting to make a match with Time = 1 min + 200 sec / move (~ FIDE tempo)
While your Tests are very interesting and have their own significance, there is a BIG difference between playing different NNs of lc0 against each other and playing lc0 against powerful AB Engines like Stockfish and its derivatives.
For example, if I use one of the smaller NNs like the 128x10 or 256x20 on my System, lc0 gets "smoked" nearly every time against even relatively weak CPUs running Stockfish, no matter the very high Knps or Time Control used.
Its ONLY using the very large 384x30 Net that enables lc0 to match upto the AB Engine, whatever the TC. Of course, a strong GPU or two is required to fully utilize the large NN, unless one wants to run it at 1 Knps or so, which is again pointless.
So, in the Real World (in a manner of speaking) of competitive Engine-Engine Matches a very large NN is required, supported by a strong GPU or two, at least at the present stage of lc0 development, no matter what the Theorists say.