arXiv 2106.10165
The Principles of Deep Learning Theory
By Daniel A. Roberts, Sho Yaida, et al.
Published 2021-06-18
Wiki summary
Explore the paper's summary, context, and related research on Papiers.
This book develops an effective theory approach to understanding deep neural networks of practical relevance. Beginning from a first-principles component-level picture of networks, we explain how to determine an accurate description of the output of trained networks by solving layer-to-layer iteration equations and nonlinear learning dynamics. A main result is that the predictions of networks are described by nearly…