Lc0 - various size nets vs Stockfish 201225

[MMarco]

Match: Lc0 - various size nets vs Stockfish 201225 modern
Hardware: GTX 1660 Ti, Ryzen-7 3750H
Time control: 20s + 0.5s (time forfeit disabled)
Openings: TCEC superfinals 10-19 (500 pos.) + balsa_v500.pgn (500 pos.)
bench (startpos 1.5s): Stockfish = 1,100,000 nps / J104.1-30 = 38 000 nps / 730730= 30 196 nps / LS-15 = 5915 nps / 67142 = 2472 nps
Stockfish: threads=1, hash=32, moveoverhead=0
Lc0 26.3: cudnn-fp16, move-overhead=0 (see individual config below)
TBs and adj.: syzygy 5-men, resign (two-sided) movecount=5 score=500, draw movenumber=30 movecount=5 score=5
Comment: Some Lc0 gauntlets for fun, just to see how they fare on my system. Smaller networks do relatively better on the GTX card.
Games: https://easyupload.io/rxau28

Code: Select all

# PLAYER                   : RATING  ERROR  PLAYED   (%)   CFS    W     D     L    D(%)
1 lc0-67142 (30x384)       :    7.7    8.6    2000  51.08   96   337  1369   294  68.45
2 stockfish-201225-1T      :    0.0   ----   14000  54.48  100  2973  9309  1718  66.49
3 lc0-ls-15 (20x256)       :  -18.2    8.7    2000  47.48   99   260  1379   361  68.95
4 lc0-J104.1-30-t (10x128) :  -33.6    8.6    2000  45.35   67   227  1360   413  68.00
5 lc0-J104.1-30 (10x128)   :  -36.3    8.9    2000  44.98   60   243  1313   444  65.65
6 lc0-tinker-6430 (10x128) :  -38.0    8.7    2000  44.75   93   209  1372   419  68.60
7 lc0-PS.81kk (20x256)     :  -47.1    8.8    2000  43.50   99   236  1268   496  63.40
8 lc0-730730 (14x128)      :  -61.8    8.7    2000  41.50  ---   206  1248   546  62.40

White advantage = 58.31 +/- 1.72
Draw rate (equal opponents) = 70.73 % +/- 0.42

Individual Lc0 config file options:

Code: Select all

J104.1-30
--minibatch-size=128
--moves-left-max-effect=0.2
--moves-left-threshold=0.0
--moves-left-slope=0.004
--moves-left-scaled-factor=1.0
--moves-left-quadratic-factor=0
--moves-left-constant-factor=0

J104.1-30-t
--minibatch-size=128
--max-prefetch=16
--max-collision-events=917
--max-collision-visits=1000
--moves-left-max-effect=0.2
--moves-left-threshold=0.0
--moves-left-slope=0.004
--moves-left-scaled-factor=1.0
--moves-left-quadratic-factor=0
--moves-left-constant-factor=0

Tinker-6430
--minibatch-size=128

LS-15
--threads=1
--minibatch-size=64

PhoenixStein 81000000
--threads=1
--minibatch-size=64

67142
--nncache=100000
--threads=1
--minibatch-size=48
--max-prefetch=16
--moves-left-max-effect=0.2
--moves-left-threshold=0
--moves-left-slope=0.004
--moves-left-scaled-factor=1
--moves-left-quadratic-factor=0
--moves-left-constant-factor=0

730730
--minibatch-size=128
--moves-left-max-effect=0.2
--moves-left-threshold=0.0
--moves-left-slope=0.004
--moves-left-scaled-factor=1.0
--moves-left-quadratic-factor=0
--moves-left-constant-factor=0