While the run2 (30xxx bignet 256x20) of test30 almost completely stalls for already 900 nets, almost 25 million expensive games, and some $10,000 spent uselessly on electricity bills, the smallnet run1 (35xxx, 128x10 nets) makes remarkable progress. I think they had a LR drop, but with only some 3 million "cheap" (4 times faster) games, the strength achieved is remarkable, only some 150 Elo points weaker than bignet after 40+ million (expensive) games.
Someone sent me the Lc0 v0.20-dev engine which uses the new architecture of the smallnets, and I checked at short time control. One thing, either this compile is buggy or it's a feature, the speed of Lc0 v0.20-dev with a smallnet accelerates on RTX 2070 in 2-3 seconds to some 90,000+ NPS, then stalls and even decreases, having large cache and apparently good settings. I anticipated that it can easily would have increased further than for only 2-3 seconds, to some maybe 120,000 - 130,000 NPS (4x faster than the bignet). But I don't know, maybe it's a feature of the new architecture.
First I saw that it's going well in Cutechess-Cli, but for illustration I show fast games against SF8 on 4 fast i7 cores in LittleBlitzer. Lc0 is on RTX 2070.
TC: 15s + 0.25s
Openings: gm2600.pgn to 12 plies.
Code: Select all
Games Completed = 100 of 100 (Avg game length = 61.417 sec)
Settings = Gauntlet/512MB/15000ms+250ms/M 2000cp for 5 moves, D 200 moves/EPD:F:\LittleBlitzer\gm2600_12plies.epd(27202)
Time = 6417 sec elapsed, 0 sec remaining
1. Lc0 v0.20.0-dev 35229 37.0/100 14-40-46 (L: m=19 t=0 i=0 a=21) (D: r=28 i=11 f=7 s=0 a=0) (tpm=439.2 d=9.10 nps=1061510)
2. Stockfish 8 64 BMI2 63.0/100 40-14-46 (L: m=0 t=0 i=0 a=14) (D: r=28 i=11 f=7 s=0 a=0) (tpm=429.3 d=26.26 nps=9257779)
So, the performance on RTX 2070 is about 3400 CCRL 40/4 Elo points. On GTX 1060, probably some 3000 CCRL 40/4 Elo points. And their shown self-Elo is also about 3000 Elo points. The progress is remarkable. I am curious if this smallnet 35xxx can reach, after several LR drops, the level of the best test10 bignets. And if they won't start playing silly with it, I hope for improvements soon.