arXiv 2601.03220
From Entropy to Epiplexity: Rethinking Information for Computationally Bounded Intelligence
By Marc Finzi, Shikai Qiu, et al.
Published 2026-01-06
Citation lineage
Review the prior work and downstream research connected to this paper.
Can we learn more from data than existed in the generating process itself? Can new and useful information be constructed from merely applying deterministic transformations to existing data? Can the learnable content in data be evaluated without considering a downstream task? On these questions, Shannon information and Kolmogorov complexity come up nearly empty-handed, in part because they assume observers with unlim…