Google's bfloat for neural networks
Posted: Tue Apr 16, 2019 11:30 am
Hehe, funny, Google started to use their own bfloat datatype in TPU gen 2 and gen 3 for neural networks,
https://en.wikipedia.org/wiki/Bfloat16_ ... int_format
https://www.nextplatform.com/2018/05/10 ... processor/
and now Intel starts to implement it in their hardware. That's when you know you are a big player
https://venturebeat.com/2018/05/23/inte ... -training/
Wonder if Nvidia or AMD will join.
--
Srdja
https://en.wikipedia.org/wiki/Bfloat16_ ... int_format
https://www.nextplatform.com/2018/05/10 ... processor/
and now Intel starts to implement it in their hardware. That's when you know you are a big player
https://venturebeat.com/2018/05/23/inte ... -training/
Wonder if Nvidia or AMD will join.
--
Srdja