arXiv 2507.07338
Bayesian Double Descent
By Nick Polson and Vadim Sokolov
Published 2025-07-09
Wiki summary
Explore the paper's summary, context, and related research on Papiers.
Double descent is a phenomenon of over-parameterized statistical models such as deep neural networks which have a re-descending property in their risk function. As the complexity of the model increases, risk exhibits a U-shaped region due to the traditional bias-variance trade-off, then as the number of parameters equals the number of observations and the model becomes one of interpolation where the risk can be unbo…