arXiv 2507.07338
Bayesian Double Descent
By Nick Polson and Vadim Sokolov
Published 2025-07-09
Citation lineage
Review the prior work and downstream research connected to this paper.
Double descent is a phenomenon of over-parameterized statistical models such as deep neural networks which have a re-descending property in their risk function. As the complexity of the model increases, risk exhibits a U-shaped region due to the traditional bias-variance trade-off, then as the number of parameters equals the number of observations and the model becomes one of interpolation where the risk can be unbo…