arXiv 1505.00387
Highway Networks
By Rupesh Kumar Srivastava, Klaus Greff, et al.
Published 2015-05-03
Citation lineage
Review the prior work and downstream research connected to this paper.
There is plenty of theoretical and empirical evidence that depth of neural networks is a crucial ingredient for their success. However, network training becomes more difficult with increasing depth and training of very deep networks remains an open problem. In this extended abstract, we introduce a new architecture designed to ease gradient-based training of very deep networks. We refer to networks with this archite…