SPCC: Testrun of SFnnue v200724_0123 finished

Discussion of computer chess matches and engine tournaments.

Moderators: hgm, Rebel, chrisw

User avatar
pohl4711
Posts: 2435
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

SPCC: Testrun of SFnnue v200724_0123 finished

Post by pohl4711 »

AB-testrun of Stockfish nnue sv_200724_0123 (S.Vieri net and 200719 avx2 nodchip-compile) finished. Incredible progress!

https://www.sp-cc.de


Why did I use that net? Because I did a lot of pre-tests of S-Vieri nets (see below) and sv200724_0123 was the strongest in that pre-tests:

Hert250 openings, 60''+0.5'', singlethread. Each testrun 500 games vs. Stockfish 200717
Binary: nodchip 200719 bmi2:

Code: Select all

sv200724_0123         : 3326 500 (+175,=286,- 39), 63.6 %
sv200722_1621exp      : 3321 500 (+174,=281,- 45), 62.9 %
sv200722_2115exp      : 3324 500 (+168,=289,- 43), 62.5 %
sv200722_1130exp      : 3317 500 (+172,=280,- 48), 62.4 %
sv200723_0511         : 3322 500 (+167,=288,- 45), 62.2 %
sv200724_0640         : 3320 500 (+165,=286,- 49), 61.6 %
sv200722_2141         : 3355 500 (+177,=262,- 61), 61.6 %
sv200724_0650exp      : 3318 500 (+171,=271,- 58), 61.3 %
sv200724_1240         : 3317 500 (+174,=264,- 62), 61.2 %
sv200723_1334exp      : 3307 500 (+159,=292,- 49), 61.0 %
sv200723_1134         : 3311 500 (+155,=294,- 51), 60.4 %
sv200724_1215exp      : 3308 500 (+153,=294,- 53), 60.0 %
sv200723_1844         : 3300 500 (+157,=286,- 57), 60.0 %
sv200724_1732         : 3300 500 (+159,=271,- 70), 58.9 %
gk200627              : 3305 500 (+118,=311,- 71), 54.7 %
josh 384cr            : 3269 500 (+ 87,=322,- 91), 49.6 %
(Perhaps you have to clear your browsercache or reload the website)
User avatar
pohl4711
Posts: 2435
Joined: Sat Sep 03, 2011 7:25 am
Location: Berlin, Germany
Full name: Stefan Pohl

Re: SPCC: Testrun of SFnnue v200724_0123 finished

Post by pohl4711 »

More fast (1 testrun takes around 4 hours) pre-test vs Stockfish 200717 are finished.
Sadly, the S.V. nets are not getting stronger anymore at this point. sv200724_0123 is still the best.

Hert250 openings, 60''+0.5'', singlethread. Each testrun 500 games vs. Stockfish 200717
Binary: nodchip 200719 bmi2:

Code: Select all

sv200724_0123         : 3326 500 (+175,=286,- 39), 63.6 %
sv200722_1621exp      : 3321 500 (+174,=281,- 45), 62.9 %
sv200722_2115exp      : 3324 500 (+168,=289,- 43), 62.5 %
sv200722_1130exp      : 3317 500 (+172,=280,- 48), 62.4 %
sv200723_0511         : 3322 500 (+167,=288,- 45), 62.2 %
sv200724_0640         : 3320 500 (+165,=286,- 49), 61.6 %
sv200722_2141         : 3355 500 (+177,=262,- 61), 61.6 %
sv200724_0650exp      : 3318 500 (+171,=271,- 58), 61.3 %
sv200724_1240         : 3317 500 (+174,=264,- 62), 61.2 %
sv200725_1313         : 3325 500 (+167,=276,- 57), 61.0 %
sv200723_1334exp      : 3307 500 (+159,=292,- 49), 61.0 %
sv200723_1134         : 3311 500 (+155,=294,- 51), 60.4 %
sv200724_2244exp      : 3320 500 (+156,=291,- 53), 60.3 %
sv200724_1215exp      : 3308 500 (+153,=294,- 53), 60.0 %
sv200723_1844         : 3300 500 (+157,=286,- 57), 60.0 %
sv200725_0545         : 3314 500 (+155,=285,- 60), 59.5 %
sv200724_1732         : 3300 500 (+159,=271,- 70), 58.9 %
sv200724_2344         : 3309 500 (+150,=288,- 62), 58.8 %
sv200724_2343         : 3308 500 (+154,=278,- 68), 58.6 %
gk200627              : 3305 500 (+118,=311,- 71), 54.7 %
StockFiNN CCC         : 3276 500 (+115,=311,- 74), 54.1 %
josh 384cr            : 3269 500 (+ 87,=322,- 91), 49.6 %