arXiv 1803.03635
The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks
By Jonathan Frankle and Michael Carbin
Published 2018-03-09
Discussion
Read the public discussion and references gathered around this paper.
Neural network pruning techniques can reduce the parameter counts of trained networks by over 90%, decreasing storage requirements and improving computational performance of inference without compromising accuracy. However, contemporary experience is that the sparse architectures produced by pruning are difficult to train from the start, which would similarly improve training performance. We find that a standard pru…