arXiv 1412.6980
Adam: A Method for Stochastic Optimization
By Diederik P. Kingma and Jimmy Ba
Published 2014-12-22
Wiki summary
Explore the paper's summary, context, and related research on Papiers.
We introduce Adam, an algorithm for first-order gradient-based optimization of stochastic objective functions, based on adaptive estimates of lower-order moments. The method is straightforward to implement, is computationally efficient, has little memory requirements, is invariant to diagonal rescaling of the gradients, and is well suited for problems that are large in terms of data and/or parameters. The method is…