ConvChess CNN

Discussion of chess software programming and technical issues.

Moderators: hgm, Harvey Williamson, bob

Forum rules
This textbox is used to restore diagrams posted with the [d] tag before the upgrade.
Post Reply
brianr
Posts: 344
Joined: Thu Mar 09, 2006 2:01 pm

ConvChess CNN

Post by brianr » Wed Mar 15, 2017 5:33 pm


AlvaroBegue
Posts: 918
Joined: Tue Mar 09, 2010 2:46 pm
Location: New York
Full name: Álvaro Begué (RuyDos)

Re: ConvChess CNN

Post by AlvaroBegue » Wed Mar 15, 2017 6:01 pm

The paper reports they couldn't get learning to work with 5 layers. There are a couple of easy tricks that make learning 5 layers trivial: Careful initialization of weights and using skip connections (see the ResNet paper). Other useful tricks are batch normalization and weight normalization.

I have trained CNNs for go with 30 layers using just the first two tricks.

bhamadicharef
Posts: 31
Joined: Fri Nov 25, 2016 9:14 am
Location: Singapore
Contact:

Re: ConvChess CNN

Post by bhamadicharef » Thu Mar 16, 2017 4:16 am

Very interesting topic, thank you for sharing
Brahim HAMADICHAREF
Singapore

Post Reply