Search found 698 matches

by Rein Halbersma
Fri Nov 20, 2020 3:15 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Pytorch NNUE training
Replies: 58
Views: 3903

Re: Pytorch NNUE training

gladius wrote:
Fri Nov 20, 2020 2:26 pm
That's from the pytorch torch.nn.Module, and it's calling forward(), but also supports running hooks.
Thanks, that's a surprising but useful idiom.
by Rein Halbersma
Fri Nov 20, 2020 10:09 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Pytorch NNUE training
Replies: 58
Views: 3903

Re: Pytorch NNUE training

I started an implementation of the SF NNUE training in Pytorch: https://github.com/glinscott/nnue-pytorch . Perhaps a silly question, but I'm having a hard time understanding this line in the step_ function https://github.com/glinscott/nnue-pytorch/blob/9e4b6b2edd4155b1ed87c7a03d7d1bbf08583df8/mode...
by Rein Halbersma
Tue Nov 17, 2020 4:23 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: First success with neural nets
Replies: 30
Views: 6211

Re: First success with neural nets

In your C++ header NeuralNet.h I see a commented SumIncremental() stub. Implementing this should speed up the eval considerably. A regular non-capture move requires a maxtrix column addition and subtraction in the first hidden layer, instead of a summation over 121 of those columns. That could be a ...
by Rein Halbersma
Tue Nov 17, 2020 12:15 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: NNUE accessible explanation
Replies: 16
Views: 5853

Re: NNUE accessible explanation

Note that Jonathan's network has an input layer PieceSq x PieceType (i.e. 32 x 4 inputs, but since checkers can't be on the promotion line, he used (32 + 28) x 2 = 120, and then 1 more for the side to move). A NNUE for checkers / draughts would have to feature a fully quadratic PieceSq x PieceSq inp...
by Rein Halbersma
Tue Nov 17, 2020 9:58 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: NNUE accessible explanation
Replies: 16
Views: 5853

Re: NNUE accessible explanation

A followup to this post, is anyone aware of any NNUE engines that have been developed for Checkers/Draughts? The 8x8 version of course has been proved as a draw, but 10x10 and other variants might be a nice challenge! In fact 8x8 might be an interesting experiment to see how simple an initial evalu...
by Rein Halbersma
Sun Nov 15, 2020 9:04 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Pytorch NNUE training
Replies: 58
Views: 3903

Re: Pytorch NNUE training

Do any people out here have tried to directly import Keras/Tensorflow or PyTorch trained models (i.e. graphs + weights, not just weights) into C++? For Keras/Tensorflow there is model.save() on the Python side and then LoadSavedModel on the C++ side to load a graph + weights and link against TF C++ ...
by Rein Halbersma
Sat Nov 14, 2020 3:33 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: First success with neural nets
Replies: 30
Views: 6211

Re: First success with neural nets

Maybe first try international draughts. I'd like to see somebody break the dominance of Fabien Letouzey's Scan in international draughts, and nobody that I know of has yet implemented a draughts engine with neural networks yet. Fabien might disagree with me, but you can call the Scan pattern-based ...
by Rein Halbersma
Sat Nov 14, 2020 3:01 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: First success with neural nets
Replies: 30
Views: 6211

Re: First success with neural nets

Training on my CPU looks about 2.7X slower (Xeon E5-1650v4, 6/12 C/T @ 3.6GHz) with almost 98% CPU utilization on all 12 hyperthreads. Training on the GPU didn't raise CPU utilization above 20% and also let me watch some Netflix while training without any hiccups.
by Rein Halbersma
Sat Nov 14, 2020 2:39 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: First success with neural nets
Replies: 30
Views: 6211

Re: First success with neural nets

The details are described here : http://www.3dkingdoms.com/checkers.htm This is really amazing! I've managed to both compile your engine and run your Python training code, it all works flawlessly. I have a GTX 1050 Ti with 4Gb RAM as GPU and that allows me to use a batch size of 1M (instead of your...
by Rein Halbersma
Tue Sep 08, 2020 7:38 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Is cloning a hobby?
Replies: 79
Views: 11218

Re: Is cloning a hobby?

cloning is the new learning :D still waiting for some 100 elo/month geniuses to pass SF but somehow that never happens... It used to be possible in the old days (pre ~2015) to clone + add a few new tricks and become #1 for a while. But IMO, the biggest contribution of SF is not the engine itself, b...