arXiv 2008.07669
HiPPO: Recurrent Memory with Optimal Polynomial Projections
By Albert Gu, Tri Dao, et al.
Published 2020-08-17
Mindmap
Browse the paper's core ideas, clusters, and relationships in a structured outline.
A central problem in learning from sequential data is representing cumulative history in an incremental fashion as more data is processed. We introduce a general framework (HiPPO) for the online compression of continuous signals and discrete time series by projection onto polynomial bases. Given a measure that specifies the importance of each time step in the past, HiPPO produces an optimal solution to a natural onl…