arXiv 2505.11581
Questioning Representational Optimism in Deep Learning: The Fractured Entangled Representation Hypothesis
By Akarsh Kumar, Jeff Clune, et al.
Published 2025-05-16
Wiki summary
Explore the paper's summary, context, and related research on Papiers.
Much of the excitement in modern AI is driven by the observation that scaling up existing systems leads to better performance. But does better performance necessarily imply better internal representations? While the representational optimist assumes it must, this position paper challenges that view. We compare neural networks evolved through an open-ended search process to networks trained via conventional stochasti…