arXiv 2507.12549
The Serial Scaling Hypothesis
By Yuxi Liu, Konpat Preechakul, et al.
Published 2025-07-16
Wiki summary
Explore the paper's summary, context, and related research on Papiers.
While machine learning has advanced through massive parallelization, we identify a critical blind spot: some problems are fundamentally sequential. These "inherently serial" problems-from mathematical reasoning to physical simulations to sequential decision-making-require sequentially dependent computational steps that cannot be efficiently parallelized. We formalize this distinction in complexity theory, and demons…