arXiv 1808.02822
Backprop Evolution
By Maximilian Alber, Irwan Bello, et al.
Published 2018-08-08
Citation lineage
Review the prior work and downstream research connected to this paper.
The back-propagation algorithm is the cornerstone of deep learning. Despite its importance, few variations of the algorithm have been attempted. This work presents an approach to discover new variations of the back-propagation equation. We use a domain specific lan- guage to describe update equations as a list of primitive functions. An evolution-based method is used to discover new propagation rules that maximize t…