arXiv 2510.17800
Glyph: Scaling Context Windows via Visual-Text Compression
By Jiale Cheng, Yusen Liu, et al.
Published 2025-10-20
Citation lineage
Review the prior work and downstream research connected to this paper.
Large language models (LLMs) increasingly rely on long-context modeling for tasks such as document understanding, code analysis, and multi-step reasoning. However, scaling context windows to the million-token level brings prohibitive computational and memory costs, limiting the practicality of long-context LLMs. In this work, we take a different perspective-visual context scaling-to tackle this challenge. Instead of…