4 core i7 fast CPU
RTX 2070 OC-ed GPU
1/
I was on holidays, in fact unknowingly, in coronavirus hit areas, and left my PC for a long run to check for a possible improvement to the Kiudee settings to LTC. I seem to get a positive result changing that:
CPuct=1.90
instead of Kiudee one CPuct=2.147 (v023.2 engine)
Kiudee settings are abbreviated by "K", new settings by "KL".
This is what I got in a longish test (almost one week) from unbalanced openings:
Code: Select all
TC: 120s + 1.2s
# PLAYER : RATING ERROR POINTS PLAYED (%) CFS(next)
1 T_59_KL : 24.68 18.15 370.5 700 52.9 93
2 T_59_K : 5.41 18.12 354.5 700 50.6 72
3 SF_11 : 0.00 ---- 675.0 1400 48.2 ---
White advantage = 154.72 +/- 6.57
Draw rate (equal opponents) = 64.66 % +/- 1.78
LOS = 97%
The result is fairly conclusive. To fast TC, "KL" and "K" settings perform the same (within 1 SD error margins even in 1000 games). So, I guess that setting CPuct=1.90 in Kiudee settings is generally better and scales well to LTC. The improvement to LTC seems even larger in self-games with the same net, some 25-30 Elo points.
2/
The v0.24 engine has two fast backends for my hardware, CUDA and DX12. For 256x20 nets, CUDA is faster, but for 384x30 SV nets DX12 is faster. I checked also the strength at 30s + 0.3s:
Code: Select all
TC: 30s + 0.3s
Score of SV_384x30_2880_DX vs SV_384x30_2880_CUDA: 116 - 88 - 196 [0.535] 400
Elo difference: 24.36 +/- 24.32
Finished match
I used some scaling results with 10x nodes, and got that SV 384x30-t60-28XX.pb nets scale the best and are probably surpassing the strongest up to now net SV 256x20-t40-1541.pb to LTC (above 100k large net nodes).
A sanity test was performed at 15min + 9s (about 200k nodes per move for large net, and about 600k nodes per move 1541 net):
Code: Select all
Score of SV_384x30_2880 vs SV_256x20_1541: 7 - 3 - 10 [0.600]
Elo difference: 70.4 +/- 111.6, LOS: 89.7 %, DrawRatio: 50.0 %
20 of 20 games finished.
Using the pentanomial variance LOS = 97%. In fact SV 384x30_2880 seems to smash (+ 4 -0 =6 pairwise) the 1541 net at this longer TC on an RTX 2070 GPU. Being at only the second LR drop (0.01), these SV large nets will be hard to beat at LTC on RTX GPUs for T60 nets in foreseeable future. Sergio is doing a very good job.
3/
Now I am performing a sanity check against SF_11 using SV 384x30_2880 net with "KL" LTC settings, DX12 backend v0.24rc1 engine, games at 15m + 9s. I expect Lc0 to win, but let's see how heavily it wins with these optimized settings and probably the best net to LTC.
4/
An observation: the test results on tactical Arasan 21 test suite at say 30s/position correlate very well with the strength of the nets to LTC, and the results seem to show that to LTC SV 384x30-t60-28XX.pb nets are clearly the best, followed by T60 latest nets and by 1541 SV net (these two almost equal to LTC).