arXiv 2310.08560
MemGPT: Towards LLMs as Operating Systems
By Charles Packer, Sarah Wooders, et al.
Published 2023-10-12
Discussion
Read the public discussion and references gathered around this paper.
Large language models (LLMs) have revolutionized AI, but are constrained by limited context windows, hindering their utility in tasks like extended conversations and document analysis. To enable using context beyond limited context windows, we propose virtual context management, a technique drawing inspiration from hierarchical memory systems in traditional operating systems that provide the appearance of large memo…