ConvChess CNN

Discussion of chess software programming and technical issues.

Moderators: hgm, Rebel, chrisw

brianr
Posts: 536
Joined: Thu Mar 09, 2006 3:01 pm

ConvChess CNN

Post by brianr »

AlvaroBegue
Posts: 931
Joined: Tue Mar 09, 2010 3:46 pm
Location: New York
Full name: Álvaro Begué (RuyDos)

Re: ConvChess CNN

Post by AlvaroBegue »

The paper reports they couldn't get learning to work with 5 layers. There are a couple of easy tricks that make learning 5 layers trivial: Careful initialization of weights and using skip connections (see the ResNet paper). Other useful tricks are batch normalization and weight normalization.

I have trained CNNs for go with 30 layers using just the first two tricks.
bhamadicharef
Posts: 31
Joined: Fri Nov 25, 2016 10:14 am
Location: Singapore

Re: ConvChess CNN

Post by bhamadicharef »

Very interesting topic, thank you for sharing
Brahim HAMADICHAREF
Singapore