arXiv 1505.00387
Highway Networks
By Rupesh Kumar Srivastava, Klaus Greff, et al.
Published 2015-05-03
Discussion
Read the public discussion and references gathered around this paper.
There is plenty of theoretical and empirical evidence that depth of neural networks is a crucial ingredient for their success. However, network training becomes more difficult with increasing depth and training of very deep networks remains an open problem. In this extended abstract, we introduce a new architecture designed to ease gradient-based training of very deep networks. We refer to networks with this archite…