arXiv 2506.17859
In-Context Learning Strategies Emerge Rationally
By Daniel Wurgaft, Ekdeep Singh Lubana, et al.
Published 2025-06-21
Wiki summary
Explore the paper's summary, context, and related research on Papiers.
Recent work analyzing in-context learning (ICL) has identified a broad set of strategies that describe model behavior in different experimental conditions. We aim to unify these findings by asking why a model learns these disparate strategies in the first place. Specifically, we start with the observation that when trained to learn a mixture of tasks, as is popular in the literature, the strategies learned by a mode…