Search found 564 matches

by gladius
Wed Mar 17, 2021 3:14 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: FEN compression
Replies: 21
Views: 8923

Re: FEN compression

Occupancy : 8-bytes Evaluation : 2-bytes Turn : 1-bytes White King Sq : 1-bytes Black King Sq : 1-bytes Piece Count : 1-bytes Packed Pieces : 1-bytes per two pieces (16 max, 12 average) = Average of 26-bytes, max of 30-bytes. This is already better, and simpler, than the one from NNUE folks. And ye...
by gladius
Sun Feb 14, 2021 12:00 am
Forum: Computer Chess Club: General Topics
Topic: Fat Fritz 2
Replies: 491
Views: 69818

Re: Fat Fritz 2

Latest from the blitz list. https://i.postimg.cc/9QF0QrHH/Rating-FF2.jpg I have a lot of respect for CCRL, but, IMO, it is a bad choice to include Fat Fritz 2 on the list. It is trivial to release Stockfish derivatives that would flood rating lists and make them totally meaningless. Very disappoint...
by gladius
Sat Jan 09, 2021 5:17 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Pytorch NNUE training
Replies: 61
Views: 21802

Re: Pytorch NNUE training

Progress is still being made! It's been much tougher than anticipated, but we are only 5 elo from the best SV net now. That SV net was then optimized using SPSA to produce the best master net, so still about 15 elo from master. Best results from @vondele (who has been training up a storm): # PLAYER ...
by gladius
Fri Nov 27, 2020 4:20 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Pytorch NNUE training
Replies: 61
Views: 21802

Re: Pytorch NNUE training

xr_a_y wrote:
Thu Nov 26, 2020 7:55 pm
But current official or master nets has been built with data of what depth ?
I believe Sergio used depth 12-14 data, with about 10 billion positions.
by gladius
Thu Nov 26, 2020 6:02 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Pytorch NNUE training
Replies: 61
Views: 21802

Re: Pytorch NNUE training

Another quick update on some experiments: - Tried training from scratch using 1B d20 games, and it was disastrous. ELO was far worse than the d5 positions. So, interestingly, it appears that depth is just way too deep for the network to learn on. - vondele validated that you can train a net equal to...
by gladius
Wed Nov 25, 2020 5:00 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Pytorch NNUE training
Replies: 61
Views: 21802

Re: Pytorch NNUE training

So I am curious how did you resolve the "qsearch inference" issue above? Did you re-implement the Stockfish qsearch in python? Let's say suppose we did not use the qsearch to do inference but directly call NNUE evaluation over the sfen position, do you think that will make a big difference on learn...
by gladius
Wed Nov 25, 2020 4:58 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Pytorch NNUE training
Replies: 61
Views: 21802

Re: Pytorch NNUE training

So a question, which is not really per this threads name, but was touched on here. What efforts can be taken, during training when using floats, to try to map the weights and biases into a smaller range. IE, get most of the weights within [-2.0, 2.0], such that quantization can be done with minimal...
by gladius
Sun Nov 22, 2020 3:17 am
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Pytorch NNUE training
Replies: 61
Views: 21802

Re: Pytorch NNUE training

We've been trying a bunch of experiments, but not a huge amount of forward progress. We are at about -80 elo from master, but still a long ways away. This is all still training on d5 data though, so I'm hopeful that higher depth data will be a big win (unfortunately, it takes a really long time to g...
by gladius
Fri Nov 20, 2020 2:26 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Pytorch NNUE training
Replies: 61
Views: 21802

Re: Pytorch NNUE training

I started an implementation of the SF NNUE training in Pytorch: https://github.com/glinscott/nnue-pytorch . Perhaps a silly question, but I'm having a hard time understanding this line in the step_ function https://github.com/glinscott/nnue-pytorch/blob/9e4b6b2edd4155b1ed87c7a03d7d1bbf08583df8/mode...
by gladius
Thu Nov 19, 2020 3:19 pm
Forum: Computer Chess Club: Programming and Technical Discussions
Topic: Pytorch NNUE training
Replies: 61
Views: 21802

Re: Pytorch NNUE training

thank you for your explanation and code let me recap what I have understood on factorizer so far: 1) you have 2 different network topologies, 1 one for training (TNNUE) and 1 for the engine (ENNUE) 2) you have a trick when saving the weight in the trainer so TNNUE and ENNUE have the same output for...